HMD Error Correction via Frame Substitution and Pixel Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mixed reality systems using video see-through Head Mounted Displays (HMDs), communication errors during wireless image transmission can lead to disrupted views of the real world, making it difficult for users to maintain sight, especially when errors occur frequently due to environmental factors or distance, and interpolation methods struggle to reconstruct accurate stereoscopic images as error frequencies increase.

Innovation Solution

A head-mounted display system with an input unit for sequential image frames, a determination unit to detect error portions, and a display control unit that decides whether to display the previous frame or correct the error using surrounding pixel groups, ensuring a stable image presentation by assessing error size and previous frame data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If wireless image transmission is used in HMD systems, then device portability and flexibility are improved, but communication errors occur frequently due to environmental factors or distance

Engineering Contradiction:
Improvewireless transmission capabilityVSAvoidimage transmission reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by detecting errors in incoming image frames and preparing correction strategies (substitution with previous frame or interpolation using surrounding pixels) before displaying the corrected image. This proactive error handling ensures continuous reliable display despite wireless transmission issues.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If error correction through interpolation is used, then image accuracy is improved for small errors, but the method fails to reconstruct accurate stereoscopic images when error frequency increases

Engineering Contradiction:
Improveimage reconstruction accuracyVSAvoidstereoscopic image accuracy under high error frequency
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The system dynamically switches between different error correction strategies based on real-time conditions: using interpolation for small isolated errors, substituting previous frames for moderate errors, and displaying only the real-world view for severe or frequent errors. This dynamic adaptation maintains image quality and stereoscopic accuracy across varying error frequencies.

Inventive Principle:
Principle #15Dynamics

3Stability of the object's composition

If frequent error correction is performed, then image stability is improved, but processing time and computational load increase

Engineering Contradiction:
Improveimage display stabilityVSAvoidprocessing time
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The system applies partial correction actions based on error severity: only correcting specific error portions through interpolation when errors are small, using frame substitution for moderate errors, and skipping correction for severe errors by displaying the real-world view directly. This selective approach maintains stability while minimizing processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9715765B2Head mounted display and display for selectively displaying a synthesized image and a physical space image, and control method thereof
Publication Date: 2017.07.25 CANON KK
  • US9715765B2 patent drawing
  • US9715765B2 patent drawing
  • US9715765B2 patent drawing

AI summary

A display control unit causes a display device to display the synthesized image in a case where the determination unit does not determine that the error region exists in the synthesized image, and causes the display device to display the physical space image in a case where the determination unit does determine that the error region exists in the synthesized image.