Head-Mounted AR Display Mode Switching for Sensor Faults
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays (HMDs) used for augmented reality (AR) image display face challenges in continuing normal operation when camera or sensor abnormalities occur, leading to interruptions in maintenance and inspection work.
Innovation Solution
The HMD incorporates a camera abnormality detector, sensor abnormality detector, battery, image generator, display, and mode switcher to switch between advanced and simple processing modes, ensuring continuous AR image display even in abnormal conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the HMD uses camera and sensor group for AR image display, then the AR image accuracy is improved, but the system reliability deteriorates when abnormality occurs
Solution Approach 1:
The system dynamically switches between AR advanced processing mode and AR simple processing mode based on the operational status of the camera and sensor group. When abnormality is detected, the mode switcher transitions from the advanced mode (which requires both camera and sensor group for high accuracy) to the simple mode (which can operate with limited data), thereby maintaining system reliability while preserving AR image display functionality.
2Manufacturing precision
If the HMD operates in AR advanced processing mode, then the AR image quality is improved, but the ease of operation deteriorates when abnormality occurs
Solution Approach 1:
The mode switcher automatically detects abnormalities in the camera or sensor group and self-initiates the mode transition from AR advanced processing mode to AR simple processing mode without requiring user intervention. This self-service mechanism ensures continuous AR image display while maintaining ease of operation, as the user simply continues their maintenance and inspection work without needing to manually adjust settings or restart the system.
3Measurement precision
If the HMD uses multiple sensors and camera for accurate AR display, then the measurement precision is improved, but the device complexity increases
Solution Approach 1:
The mode switcher serves multiple functions: it monitors the operational status of the camera and sensor group, determines abnormality conditions, and controls the switching between processing modes. This multi-functional component manages the complexity introduced by having both camera and sensor group, allowing the system to operate in advanced mode when all components are functional and switch to simple mode when needed, thereby handling device complexity while preserving measurement precision when possible.
Data Source
AI summary
An HMD includes: a camera configured to image an external landscape; a camera abnormality detector configured to detect operation abnormality of the camera; a sensor group configured to detect a position, a distance, and the like of an object within the external landscape; a sensor abnormality detector configured to detect operation abnormality of the sensor group; an image generator configured to generate an image; and a mode switcher configured to switch a processing mode of the image generator. The image generator has an AR advanced processing mode of generating a high-accuracy AR advanced image by using image data captured by the camera and detection data detected by the sensor group, and an AR simple processing mode of generating AR simple image simpler than the AR advanced image. When an operation of the camera or the sensor group is abnormal, the mode switcher switches into the AR simple processing mode.