Mixed Reality Probe Guidance for Low-Latency Remote Ultrasound
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote interaction technologies, such as teleultrasound and robotic systems, face inefficiencies in probe positioning and orientation due to reliance on verbal guidance or augmented reality overlays, leading to high latency and low precision, and are hindered by high costs, large size, and safety concerns, limiting their feasibility in remote communities and ambulances.
Innovation Solution
A mixed reality headset and remote system with low-latency communication (0.5 seconds or less) facilitate precise alignment of a virtual representation with a physical element by combining a local system for data collection and a remote system for user interaction, using a haptic device to control the position and orientation of the virtual element.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If verbal guidance or augmented reality overlays are used for probe positioning, then the system is simple and low cost, but positioning precision and orientation accuracy are low
Solution Approach 1:
A virtual representation of the probe is introduced as an intermediary element that overlays the physical probe's position in mixed reality. This virtual probe serves as a mediator between the physical probe and the expert sonographer, enabling precise positioning guidance without requiring complex robotic systems. The virtual representation allows the novice user to align the physical probe with the virtual guide, achieving high precision while maintaining system simplicity.
Solution Approach 2:
A virtual copy of the ultrasound probe is created and displayed in the mixed reality environment. This virtual probe copy mirrors the physical probe's position and orientation, providing a visual guide for the novice user. By copying the probe's appearance and behavior in the virtual environment, the system enables precise positioning without requiring the physical probe itself to be complex or expensive.
2Loss of time
If robotic systems are used for teleultrasound, then positioning precision and latency are improved, but cost and device size increase significantly
Solution Approach 1:
The patent replaces the mechanical robotic arm system with a mixed reality-based virtual guidance system. Instead of using a physical robotic manipulator to position the probe, the system uses a virtual representation in the mixed reality environment to guide the novice user's manual positioning. This substitution eliminates the need for complex mechanical components, reducing cost and device size while maintaining low latency through direct digital communication between the expert's input device and the virtual representation.
3Reliability
If robotic systems are deployed in remote communities, then expert care quality is improved, but cost and feasibility are reduced
Solution Approach 1:
The patent employs inexpensive mixed reality headsets and standard computing devices instead of expensive robotic systems. These affordable components can be deployed in remote communities without requiring significant infrastructure investment. The system uses software-based virtual guidance rather than hardware-based robotic manipulators, making the solution economically feasible for widespread deployment in resource-limited settings while maintaining expert care quality.
4Reliability
If a human follower is required for monitoring, then safety is improved, but productivity and efficiency are reduced
Solution Approach 1:
The system enables the novice user to perform the ultrasound procedure independently by providing real-time virtual guidance through the mixed reality headset. The virtual probe representation and visual feedback allow the user to self-correct positioning and orientation without requiring continuous monitoring or approval from a human follower. This self-service capability maintains safety through automated guidance while significantly improving productivity by eliminating the need for on-site monitoring personnel.
Data Source
AI summary
An apparatus for remote interaction with an object includes a local system and a remote system. The local system includes a mixed reality headset configured to display a virtual representation of a physical element relative to the object, and a device configured to obtain information relating to or dependent on position and orientation of the physical element interacting with the object. The remote system includes an electronic device including a display for displaying an image based on the information, and an input device for remote user interaction and configured to control position and orientation of the virtual representation displayed on the mixed reality headset. The remote system is configured to communicate with the local system with latency of 0.5 seconds or less, facilitating alignment of the physical element with the position and orientation of the virtual representation.