Head Mounted Display Superimposing Invisible Information
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of head-mounted displays, particularly in medical and construction applications, face challenges in simultaneously viewing real images and information not visible in the object's appearance without moving their visual line, which is a common issue across various fields including surgery, construction, and other applications where CT, MRI, or X-ray images are involved.
Innovation Solution
A head-mounted display system that incorporates an image display unit and a superimposition processing unit to overlay invisible information onto real images in the user's visual field, allowing users to recognize both the real image and invisible information without moving their gaze, through features like edge detection, marker recognition, and image correction, enabling the display of virtual images and external scenery simultaneously.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the user views invisible information (CT, MRI, X-ray images) using a head mounted display, then the user can recognize internal structure information, but the user cannot directly view the real surgical site or external scenery simultaneously without moving visual line
Solution Approach 1:
The patent merges the real image from the camera and the invisible information (CT, MRI, X-ray images) into a single composite image that is displayed on the head mounted display. This allows the user to view both the external scenery and internal structure information simultaneously in one visual field, eliminating the need to move the visual line between different sources.
Solution Approach 2:
The patent creates a virtual copy of the invisible information and superimposes it onto the real image captured by the camera. This copying approach allows the internal structure data to be displayed in the same spatial context as the external view, enabling simultaneous perception without requiring the user to switch between different viewing modes or locations.
2Reliability
If the user moves visual line to view external scenery separately from invisible information, then the user can see real images, but the operational efficiency decreases and visual discomfort increases
Solution Approach 1:
The patent combines multiple information sources (real image from camera, CT images, MRI images, X-ray images) into a single integrated visual display. This merging allows the user to maintain accurate visual recognition of both external and internal structures while improving operational efficiency by eliminating the need to repeatedly move the visual line between different information sources.
Data Source
AI summary
A display which allows a user to visually recognize a virtual image and external scenery includes an image display unit that forms the virtual image which is visually recognized by the user. The display also includes a superimposition processing unit that generates a plurality of pieces of superimposition information, based on a plurality of images of the external scenery, for superimposing invisible information which is not shown in an outward appearance of an object on the object included in the external scenery. The superimposition processing unit extracts a feature of the object. The invisible information includes a feature in common with the extracted feature of the object. The superimposition processing unit generates the plurality of pieces of superimposition information such that the extracted feature of the object and the feature of the invisible information overlap.