AR Head-Mounted Display Synchronization for Medical Collaboration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality virtual object display systems, multiple observers face difficulties in viewing a common virtual object from appropriate directions without moving, especially in medical settings like pre-surgery conferences, where synchronizing the view of a three-dimensional virtual object among participants is challenging.
Innovation Solution
A virtual object display system with multiple devices that can switch between first and second display controls, allowing observers to view the virtual object from individual directions in the first mode and from the same orientation as the surgeon in the second mode, using display information acquired from markers or other devices, enabling synchronized display of a three-dimensional medical image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If each participant views the virtual object independently based on their own device's display information, then each observer can view from their individual direction, but all participants cannot view the virtual object from the same orientation
Solution Approach 1:
The system dynamically switches between two display control modes: first display control for independent viewing and second display control for synchronized viewing. This allows the system to adapt its behavior based on the current operational requirement, resolving the contradiction between individual and collective viewing needs.
Solution Approach 2:
The system changes the orientation parameter of the virtual object based on the selected display control mode. In the first mode, each device uses its own orientation parameters; in the second mode, all devices synchronize to the surgeon's orientation parameters, allowing flexible adaptation between individual and unified viewing perspectives.
2Measurement precision
If participants move to easy-to-view positions to observe difficult-to-view sites, then they can see the virtual object from appropriate directions, but participants cannot proceed with the conference while staying in their original positions
Solution Approach 1:
The system provides dynamic switching between viewing modes, allowing participants to maintain their physical positions while changing their virtual viewing perspective. The second display control mode enables all participants to view from the surgeon's perspective without moving, while the first mode allows individual perspective adjustment when needed.
Solution Approach 2:
The system acts as an intermediary that translates the surgeon's viewing perspective to all other participants' devices. This mediation allows participants to access the surgeon's optimized viewing angle without physically relocating, resolving the contradiction between viewing quality and position flexibility.
3Adaptability or versatility
If the virtual object is displayed based on each device's acquired display information, then each device can display according to its own orientation, but synchronized display of the virtual object with identical orientation across all devices is not achieved
Solution Approach 1:
The system dynamically adjusts the display control strategy based on the selected mode. In the second display control mode, the system ensures synchronized display by having all devices use the surgeon's display information, guaranteeing identical virtual object orientation across all devices for reliable collaborative viewing.
Data Source
AI summary
A virtual object display system includes a plurality of head-mounted displays 1 each having a virtual object acquisition unit 22 that acquires a virtual object, a display information acquisition unit 23 that acquires display information used to display the virtual object, and a display control unit 24 that causes a display unit to display the virtual object on the basis of the display information, and enables switching between of first display control for causing the virtual object to be displayed on the basis of display information acquired by each of the plurality of head-mounted displays 1 and second display control for causing the virtual object having an identical orientation to an orientation of the virtual object displayed on the basis of display information acquired by another head-mounted display 1 to be displayed.