AR Display Control via Pointing Device for Object Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) devices, particularly head-mounted displays, lack intuitive methods for users to select and control the display of additional information for objects in real space, as manual operations are not feasible due to the device's placement on the user's face.
Innovation Solution
An information display system that includes a display device, a pointing device, and a control device, where the control device identifies objects in real space based on information from the pointing device, allowing for intuitive display control of additional information without direct screen interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a head-mounted display is worn on the user's face to provide augmented reality information, then additional information can be displayed in the user's field of view, but manual operations for selecting and controlling displayed objects become infeasible
Solution Approach 1:
A portable pointing device is introduced as an intermediary between the user and the head-mounted display. The pointing device captures images of the real-world environment and transmits them to the display device, enabling the user to select objects by pointing in physical space rather than performing manual operations on the display itself. This resolves the contradiction by providing intuitive control without adding complexity to the head-mounted display structure.
Solution Approach 2:
The patent replaces manual mechanical operations (touching, clicking, or manipulating controls on the display) with a pointing-based selection mechanism. The user points at objects in the real environment captured by the pointing device, and the system translates this pointing action into object selection and information display control. This substitution eliminates the need for complex mechanical control interfaces on the head-mounted display.
2Loss of information
If multiple objects are displayed with additional information on a limited display space, then comprehensive information is provided, but the display becomes cluttered and difficult to manage
Solution Approach 1:
The system applies local quality by displaying additional information specifically for the pointed object rather than uniformly displaying information for all objects in the field of view. When the user points at a particular object, only that object's additional information is displayed in detail, while other objects remain visible without cluttering information. This allows comprehensive information access when needed while maintaining a clean display during normal viewing.
Solution Approach 2:
The display dynamically adapts its content based on the user's pointing action. The system transitions from a static display state (showing basic information or no additional information) to a dynamic state where additional information is displayed for the specifically pointed object. This dynamic behavior allows the display to provide comprehensive information on demand while remaining manageable and uncluttered during normal operation.
Data Source
AI summary
In an AR device, when display control of additional information is performed for an object, a display device acquires a picture including an object in real space. An pointing device outputs, when pointing the object in real space by an operation of a user, information showing a feature for identifying the pointed object. A control device analyzes the picture by the display device and identifies objects in the picture. The control device outputs position information in the picture for the identified object. The control device outputs position information in the picture for the pointed object based on the outputted information from the pointing device. The control device extracts additional information of a target object from an additional information group of objects in real space. The control device performs display control of the additional information based on the calculated position information. The display device displays the additional information.