Head-Mounted Display Procedure Teaching via Virtual-Real Superposition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display devices using augmented reality struggle to effectively teach and support series of action procedures, as they lack integration with real-world objects and manual actions, limiting their practical application in work support systems.
Innovation Solution
A head-mounted display device equipped with an image display unit, specifying unit, and acquiring unit that allows users to visually recognize virtual images and outside scenes, specifying procedure information using tag information, and acquiring incidental procedure information to support teaching of action procedures through augmented reality, enabling the display of virtual objects in relation to real-world objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If work support using augmented reality is realized with virtual objects, then users can learn action procedures with real objects present in front of their eyes, but the existing systems lack integration with real-world objects and manual actions
Solution Approach 1:
The patent merges virtual objects with real-world objects by superimposing virtual images representing action procedures onto the real scene captured by the camera. This combining allows users to see both the real object and virtual instructional content simultaneously, achieving effective work support without requiring separate systems for virtual and real world interaction.
Solution Approach 2:
The camera acts as an intermediary between the real world and the virtual display system. By capturing the real scene and overlaying virtual objects onto this captured image, the system creates a bridge that integrates virtual instructional content with the actual work environment, solving the integration problem.
2Loss of information
If only one action procedure is displayed, then the display remains simple and clear, but related action procedures cannot be taught
Solution Approach 1:
The system performs preliminary action by automatically acquiring and preparing related action procedures in advance based on the selected procedure. When a user selects one action procedure, the system proactively retrieves and displays related procedures without requiring additional user input, ensuring comprehensive information is available while maintaining simple operation.
Solution Approach 2:
The system uses feedback by analyzing the user's selection of a specific action procedure and automatically responding by acquiring and displaying related procedures. This feedback mechanism ensures that the information displayed is both comprehensive and relevant to the user's current needs, balancing information completeness with processing efficiency.
3Ease of operation
If manual selection of procedures is used, then the system is simple to operate, but user convenience and flexibility in input methods are limited
Solution Approach 1:
The system implements self-service by automatically acquiring related action procedures based on user selection without requiring manual configuration or complex input. The system serves itself by intelligently determining what additional information is needed and retrieving it automatically, enhancing user convenience while maintaining operational simplicity.
Data Source
AI summary
A head-mounted display device with which a user can visually recognize a virtual image and an outside scene includes an image display unit that causes the user to visually recognize the virtual image, a specifying unit that specifies procedure information, which is information representing a series of action procedures, using a virtual object to be displayed in addition to a real world, the specifying unit specifying at least a singularity of kind of the procedure information out of a plurality of kinds of the procedure information prepared in advance, and an acquiring unit that acquires the specified procedure information and incidental procedure information, which is the procedure information incidental to the procedure information before and after the specified procedure information and causes the image display unit to form the virtual image representing the virtual object included in at least one of the acquired procedure information and the incidental procedure information.