AR Object Editing Across World and Terminal Coordinate Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The operability of editing augmented reality (AR) objects is hindered when a user wearing a wearable terminal moves, causing the display range on a tablet terminal to change, making it difficult to accurately add annotations to objects.
Innovation Solution
An augmented reality processing system that uses a head-mounted display (HMD) and a tablet terminal connected via a communication network, sharing a world coordinate system based on real-space GPS, allowing the HMD to transmit AR object information to the tablet for editing, where provisional AR objects are displayed and edited on the tablet's terminal coordinate system, with edits reflected in the HMD's world coordinate system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video of real space is stream-delivered to tablet terminal, then the AR object can be displayed on tablet terminal, but the display range changes moment by moment with user movement making annotation work inefficient
Solution Approach 1:
The system divides the AR object into two separate representations: a world coordinate system AR object displayed in the HMD that moves with the user, and a terminal coordinate system AR object displayed on the tablet that remains stable. This segmentation allows each representation to serve its specific function without interference, resolving the contradiction between display stability and annotation operability.
Solution Approach 2:
The processor acts as an intermediary that receives annotation operations from the tablet terminal and applies them to the world coordinate system AR object. This mediator translates operations performed on the stable terminal coordinate system representation into corresponding actions on the dynamic world coordinate system representation, enabling efficient annotation work while maintaining display accuracy.
2Productivity
If user focuses on tablet terminal to add annotation, then annotation can be added efficiently, but HMD is displaced from object direction causing object not to be displayed
Solution Approach 1:
The system separates the annotation interface (on tablet) from the viewing interface (in HMD), allowing the user to perform annotation operations on the stable tablet display while the HMD continues to track and display the AR object in the correct spatial position. This segmentation eliminates the conflict between focusing on annotation and maintaining object positioning.
Solution Approach 2:
The tablet terminal displays a copy of the AR object in terminal coordinate system that is stable and suitable for annotation. This copy contains all necessary visual information for annotation work, allowing users to annotate without needing to keep the original HMD view stable or focused.
3Measurement precision
If AR object is displayed in world coordinate system on HMD, then AR object maintains correct spatial position, but editing operations become difficult due to display range changes
Solution Approach 1:
The system creates two coordinate system representations: world coordinate system for accurate spatial positioning in HMD, and terminal coordinate system for stable editing on tablet. The segmentation allows each coordinate system to optimize for its specific purpose without compromise.
Solution Approach 2:
The system dynamically switches between coordinate systems based on the device and operation type. The HMD uses world coordinate system for accurate spatial display, while the tablet uses terminal coordinate system for stable editing operations. The processor dynamically translates between these coordinate systems to maintain consistency.
Data Source
AI summary
An augmented reality processing system transmits information regarding an augmented reality object(ARO) arranged in a virtual space on the basis of a world-coordinate-system from an information display device to an information processing device. The information processing device arranges a provisional ARO on the basis of the received information about the ARO in a work space on the basis of a terminal-coordinate-system with the information processing device as a reference and displays the provisional ARO on a display of the information processing device, and accepts an edit operation for the displayed provisional ARO and transmits the same to the information display device. The information display device reflects the content of the edit operation in the ARO arranged in the virtual space on the basis of the world-coordinate-system and displays the ARO, on the basis of the received information regarding the edit operation for the provisional ARO.