Mixed Reality Visual Field Indicator for Observer Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality exhibiting systems fail to accurately convey the visual field of an observer, leading to difficulties in sharing and coordinating mixed reality spaces, especially when elderly individuals or those with mobility issues are involved, as they struggle to change their visual field, and current methods only provide direction data without clear visual field information.
Innovation Solution
A system that calculates and generates a three-dimensional visual-field area for observers, represented by a virtual visual-field object, which is superimposed on the mixed reality image, allowing exhibitors to recognize the observer's view volume area, thereby facilitating effective object presentation and cooperative work.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a HMD is worn to detect and indicate the direction of the observer's visual line, then the direction of the visual line can be detected and indicated in the exhibiter's mixed reality space, but the information obtained is only data regarding the direction of visual line and does not clearly tell the exhibiter the visual field of the observer
Solution Approach 1:
The patent transitions from representing only the direction of the visual line (one-dimensional angular information) to representing the entire visual field area (two-dimensional spatial region). This is achieved by calculating the visual field area based on the observer's head position and orientation, and displaying it as a projected area on the ground plane, thereby providing comprehensive visual field information rather than just directional data.
2Reliability
If clipping is performed in a rendered virtual object to restrict display to the view volume, then objects exhibited off the area between the front clipping surface and the rear clipping surface are not displayed, but the exhibiter is unable to determine such situation based only on the indication of the virtual object representing the direction of the observer's visual line
Solution Approach 1:
The patent introduces an intermediary visual field indicator that mediates between the complex rendering clipping operations and the exhibiter's perception. This indicator visually represents the observer's visual field area, allowing the exhibiter to understand whether objects are within the visible range without needing to interpret complex clipping plane data or visual line direction information alone.
3Ease of operation
If the observer is an elderly person who is difficult to change the visual field by himself/herself, then the exhibiter can carry the object to the observer's visual field, but it is necessary for the exhibiter to predict the observer's visual field by visually identifying the external state of the observer and the position/orientation of an image sensing apparatus
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously tracks the observer's head position and orientation, calculates the corresponding visual field area, and displays this information to the exhibiter. This real-time feedback replaces the need for the exhibiter to manually predict the visual field by observing external states, providing accurate and automatic visual field information for effective object presentation.
Data Source
AI summary
Image exhibiting method of exhibiting an image of mixed reality space is provided. A three-dimensional visual-field area of an observer in the mixed reality space is calculated, a virtual visual-field object representing the visual-field area is generated, and the virtual visual-field object is superimposed on the image of the mixed reality space to be exhibited.