Display System Image Cutout Adjustment for Shake Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display systems face issues with image stabilization during camera movement, leading to unintended shaking of displayed images, which can cause motion sickness and inaccurate object recognition, and there is a need for reduced size, cost, power consumption, and improved user convenience.

Innovation Solution

A display system that includes an image pickup section, a movement sensor, and a data processing section that adjusts the image cutout region based on detected movement, transmitting stabilized image data to a display device, with features like interpolation processing to smooth transitions and adjustable frame rates, and automatic target object detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If moving image data is corrected to cancel the detected shake, then the shake of the displayed image is reduced, but the moving image becomes different from what the photographer actually desires to acquire

Engineering Contradiction:
Improveimage stabilityVSAvoidphotographer's intended movement
Core Design Contradiction:
Stability of the object's compositionVSLoss of information

Solution Approach 1:

The system dynamically adjusts the shake correction application based on detected movement characteristics. When intentional movement is detected (movement amount exceeds threshold and duration exceeds predetermined time), shake correction is suspended to preserve the photographer's intended movement. When only unintentional shake is detected, correction is applied to stabilize the image.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the image pickup section moves intentionally to capture different scenes, then the photographer can acquire desired moving images, but the displayed image shakes due to the movement

Engineering Contradiction:
Improvephotographer's movement freedomVSAvoidimage stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The system uses feedback from the sensor to detect movement characteristics and determines whether to apply shake correction based on this feedback. The sensor continuously monitors movement amount and duration, and the control section adjusts the image processing accordingly to distinguish between intentional scene changes and unintentional shake.

Inventive Principle:
Principle #23Feedback

3Stability of the object's composition

If tilt correction is performed on picked-up image data, then the target object displayed on the display device remains stable, but the system complexity increases

Engineering Contradiction:
Improvetarget object stabilityVSAvoidprocessing complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

Instead of continuously applying full tilt correction to all image data, the system applies correction selectively based on movement detection. When unintentional shake is detected, correction is applied; when intentional movement is detected, correction is suspended. This partial application reduces unnecessary processing complexity.

Inventive Principle:
Principle #16Partial or excessive action

4Object-affected harmful factors

If the frame rate is reduced when acceleration exceeds a threshold, then motion sickness is reduced, but the image quality and smoothness deteriorate

Engineering Contradiction:
Improvemotion sicknessVSAvoidimage quality
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The system applies different processing qualities to different situations. When unintentional shake is detected, full shake correction is applied to maintain image quality. When intentional movement is detected, correction is suspended to preserve the photographer's intended movement. This localized quality adjustment addresses motion sickness only when necessary.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10334169B2Display system
Publication Date: 2019.06.25 SEIKO EPSON CORP
  • US10334169B2 patent drawing
  • US10334169B2 patent drawing
  • US10334169B2 patent drawing

AI summary

When a movement of an image pickup section detected by a sensor satisfies a predetermined condition, a data processing section sets, in a reference cutout position set in advance, a specified position of a cutout region for cutting out an image and generates the image data for display. When the movement does not satisfy the predetermined condition, the data processing section shifts the specified position from the reference cutout position in a direction opposite to the movement of the image pickup section from a reference position and generates the image data for display.