Virtual Object Overlay Response Time Reduction via Sensor-Based Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing devices require detection of a characteristic marker in a captured image before they can overlay and display a virtual object, leading to increased response time for the overlay process.
Innovation Solution
The system updates the position and orientation of virtual objects and cameras in a virtual space based on the shooting state of an imaging device, allowing virtual objects to be overlaid on captured images before the marker is detected, and includes features like shadow objects to notify users of the virtual reference plane and object positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the system waits for marker detection before overlaying virtual objects, then the positioning accuracy is improved, but the response time increases
Solution Approach 1:
The system performs preliminary actions by updating the position and orientation of virtual objects and cameras based on shooting state information (acceleration, angular velocity) before marker detection is complete. This allows the virtual reality system to prepare overlay content in advance, reducing the perceived response time while maintaining positioning accuracy through subsequent marker-based refinement.
Solution Approach 2:
The system dynamically adjusts the updating frequency and method of virtual object positions based on the detection state. Before marker detection, updates are based on sensor data at lower frequency; during and after detection, updates synchronize with captured images at higher frequency, optimizing both response time and positioning accuracy at different stages.
2Speed
If the system continuously updates virtual object positions based on shooting state, then the response time is reduced, but the computational load increases
Solution Approach 1:
The system implements periodic updating of virtual object positions based on captured images at predetermined intervals rather than continuously. Between image captures, updates are performed only when significant changes in shooting state occur, reducing computational energy while maintaining responsive performance.
Solution Approach 2:
The system changes updating parameters dynamically - using acceleration and angular velocity data for continuous updates during motion, switching to image-based updates when stable, and adjusting update frequency based on detected movement intensity. This optimizes energy usage by processing only when necessary.
Data Source
AI summary
A virtual reference plane and a virtual camera are updated based on detection of a characteristic portion in a captured image. A virtual object and the virtual camera are updated based on a shooting state. An overlay image in which an image of the virtual object is overlaid on the captured image is generated. The virtual camera and the virtual object are controlled such that the virtual object is in a field-of-view range, before the detection of the characteristic portion. The virtual object, the virtual reference plane, and the virtual camera are updated such that the virtual object is along the virtual reference plane, based on the shooting state, after the detection of the characteristic portion, and such that an appearance of the virtual object is in association with the shooting state, no matter whether or not the characteristic portion has been detected, when a position fixation condition is satisfied.