3D Medical Image Display Using Eye-Tracked Ray Casting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional medical image display devices require complex operations to obtain three-dimensional information from two-dimensional medical images, hindering quick and instant access to required information during other medical procedures.
Innovation Solution
A display device with a three-dimensional image display function that automatically senses viewer eye locations and determines ray casting paths to provide three-dimensional display effects, utilizing a processor to convert eye coordinates, calculate ray paths, and generate display data from volume data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If two-dimensional medical images are displayed on conventional display devices, then medical personnel can view medical images, but complex operations are required to obtain three-dimensional information and quick access to required information is hindered
Solution Approach 1:
The display device automatically senses viewer eye locations and determines ray casting paths without requiring manual intervention or complex operations from medical personnel. The system self-adjusts to provide three-dimensional display effects based on automatic eye tracking, eliminating the need for manual configuration while maintaining ease of obtaining three-dimensional information.
Solution Approach 2:
The patent replaces manual mechanical operations with automatic electronic sensing and calculation systems. Instead of requiring medical personnel to manually adjust or perform complex operations to obtain three-dimensional information, the system uses automatic eye coordinate sensing and ray path calculation to generate three-dimensional display effects, thereby reducing operational complexity.
2Extent of automation
If automatic eye location sensing and ray casting path calculation are implemented, then three-dimensional display effects are provided automatically, but device complexity increases
Solution Approach 1:
The display device integrates multiple functions including two-dimensional image display, eye location sensing, coordinate conversion, ray path calculation, and three-dimensional image rendering into a single unified system. This multi-functionality approach allows the device to provide automatic three-dimensional display effects while managing complexity through consolidation rather than adding separate independent systems.
Data Source
AI summary
A three-dimensional image display method and a display device with a three-dimensional image display function are provided. The three-dimensional image display method includes following steps: obtaining first volume data and defining a plurality of coordinates of a plurality of voxels in the first volume data in a display device coordinate system to generate second volume data; obtaining two first eye coordinates and converting the two first eye coordinates to the display device coordinate system to generate two second eye coordinates; calculating a plurality of ray paths corresponding to a plurality of pixels of the display device; matching the ray paths with the two second eye coordinates to determine a plurality of ray casting paths; determining a plurality of sampling data corresponding to the pixels according to the second volume data and the ray casting paths to generate display data.


