Multiple HMD Coordinate Alignment via Mutual Face Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for coordinate system alignment in multiple head mounted displays (HMDs) require pre-configuration with a fixed reference object, limiting flexibility and convenience.
Innovation Solution
A system and method where HMDs align their coordinate systems by capturing images of each other, performing face detection, and calculating positional differences using cameras and depth sensors to update their coordinate systems without needing a fixed reference object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a third-party reference object is used for coordinate system alignment, then the alignment process can be performed, but the reference object type or location cannot be freely changed, reducing flexibility
Solution Approach 1:
Each HMD captures images of the other HMD and performs face detection on the captured images to obtain bounding boxes. The coordinate system alignment is achieved through mutual gaze detection without requiring external reference objects or pre-configuration, allowing each device to serve itself in the alignment process.
Solution Approach 2:
Instead of using a third-party reference object that both HMDs observe, the patent inverts the approach by having each HMD observe the other HMD directly. This mutual observation method eliminates the need for external reference objects and pre-configuration, enabling flexible coordinate system alignment.
2Ease of operation
If mutual gaze detection is used for alignment, then flexibility and convenience are improved, but the system must perform face detection and coordinate calculation between devices
Solution Approach 1:
The patent replaces manual pre-configuration and physical reference object placement with automated image capture, face detection, and coordinate calculation algorithms. The system uses computer vision and image processing to automatically determine device positions and orientations, eliminating manual setup steps.
Solution Approach 2:
The patent introduces captured images as an intermediary medium between the two HMDs. Instead of direct device-to-device communication for alignment, each HMD captures images of the other, and the face detection algorithm processes these images to extract positioning information, facilitating indirect coordinate system alignment.
Data Source
AI summary
A system and a method of coordinate system alignment for multiple head mounted displays are provided. The method includes: capturing a first image of a second head mounted display by a first camera of a first head mounted display; performing a first face detection on the first image to obtain a first bounding box corresponding to a first coordinate system by the first head mounted display; aligning the first coordinate system corresponding to the first head mounted display with a second coordinates system corresponding to the second head mounted display according to a first position of the first bounding box by the first head mounted display, so as to update the first coordinate system; and displaying an output image according to the updated first coordinate system by the first head mounted display.


