Image Adjustment System for Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Head-mounted displays with omnidirectional cameras face challenges in accurately adjusting images to match user head movements, leading to delayed and inaccurate alignment of the displayed image with the user's field of view, especially when camera shake correction is not synchronized with the user's head movements.

Innovation Solution

An image adjustment system that includes a camera, an image adjustment device with an image generator and processor, and a controller, which generates a spherical surface image and adjusts the captured image based on user input to correct camera shake and align the image with the user's head movements, determining changes in the camera's direction and adjusting the image display accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If camera shake correction is applied to the captured image, then image stability is improved, but the synchronization with user head movements deteriorates causing delayed response

Engineering Contradiction:

Improveimage stabilityVSAvoidresponse delay

Core Design Contradiction:

Stability of the object's compositionVSLoss of time

Solution Approach 1:

The image processing is divided into separate stages: first adjusting the captured image based on head movement information, then applying camera shake correction to the adjusted image. This segmentation allows each processing stage to operate independently and efficiently, preventing the synchronization delay that would occur if both operations competed for processing resources simultaneously.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs image adjustment as a preliminary action before applying camera shake correction. By pre-adjusting the image based on head movement data, the system prepares the image in advance so that subsequent shake correction can be applied more quickly and synchronously with the user's movements.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If the captured image is adjusted based on head movements, then alignment with user field of view is improved, but image stability deteriorates due to movement artifacts

Engineering Contradiction:

Improvealignment precisionVSAvoidimage stability

Core Design Contradiction:

Measurement precisionVSStability of the object's composition

Solution Approach 1:

The processing pipeline is segmented into two distinct operations: image adjustment for alignment and camera shake correction for stability. By separating these functions, the system can achieve precise alignment through adjustment while subsequently removing movement artifacts through dedicated shake correction processing.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The adjusted image serves as an intermediary between the raw captured image and the final stabilized output. The adjustment process creates an intermediate representation that is aligned with the user's field of view, which then becomes the input for shake correction, allowing both alignment precision and stability to be achieved in sequence.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If spherical surface image rotation is applied, then field of view coverage is improved, but processing complexity increases

Engineering Contradiction:

Improvefield of view coverageVSAvoidprocessing complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses a spherical surface image as the basis for omnidirectional display, allowing the image to be rotated and adjusted to match any field of view direction. The spherical geometry naturally accommodates 360-degree coverage while maintaining consistent pixel density and distortion characteristics across all viewing angles.

Inventive Principle:

Principle #14Spheroidality (Curvature)

Solution Approach 2:

The spherical surface image serves multiple functions: it provides the base for omnidirectional viewing, enables rotation to any orientation, and acts as the input for both adjustment and shake correction processes. This multi-functionality reduces overall system complexity by using a single data structure for multiple purposes.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS11703948B2Image adjustment system, image adjustment device, and image adjustment method

Publication Date: 2023.07.18 JVC KENWOOD CORP

AI summary

In an image adjustment system, an image display device displays a captured image that is adjusted by an image adjustment device. The image adjustment device includes an image processor and an image generator. The image generator generates a spherical surface image. The image processor acquires the spherical surface image from the image generator to display the spherical surface image on the image display device on the basis of instruction information output from a controller. The image generator adjusts the captured image in accordance with a rotation of the spherical surface image, corrects camera shake in the captured image adjusted, and determines that a travel direction of a camera is changed when the captured image that is camera-shake corrected is changed by a predetermined angle or greater.