Stereoscopic Image Display Gesture Interaction System

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional stereoscopic display technologies do not allow users to interact with stereoscopic images directly, as they produce combined virtual images that cannot be interacted with.

Innovation Solution

A stereoscopic image display system that includes a gesture sensor to detect user gestures, calculating stereo coordinate variations to determine interactive commands such as clicks, swipes, rotations, or zooms, and updating the displayed stereoscopic image accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional stereoscopic display technologies are used to produce combined virtual images, then the stereoscopic image can be displayed with depth perception, but the user is unable to directly interact with the virtual image

Engineering Contradiction:

Improveinteract with stereoscopic imageVSAvoidvirtual image stability

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent introduces a gesture recognition system as an intermediary between the user and the stereoscopic image. The system detects hand gestures in the 3D space in front of the display and translates them into interaction commands, allowing users to manipulate virtual images without direct contact. This mediator enables interaction while maintaining the integrity of the virtual image display.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical interaction methods (touchscreens, controllers) with gesture-based interaction. By using computer vision and motion detection technologies, the system captures hand movements and converts them into digital commands, eliminating the need for physical contact with the display while enabling intuitive interaction with stereoscopic images.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If a gesture sensor is added to enable interaction, then the user can perform gestures to manipulate the stereoscopic image, but the device complexity increases

Engineering Contradiction:

Improveinteractive capabilityVSAvoidsystem structure

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent designs the gesture sensor system to serve multiple functions: it detects hand gestures for interaction, tracks 3D hand positions for spatial awareness, and can potentially recognize different gesture types (pinch, swipe, rotate). This multi-functional approach allows a single added component to provide comprehensive interaction capabilities without requiring separate systems for each function.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the user's own hand gestures as the interaction interface, eliminating the need for external controllers or additional input devices. The gesture sensor captures natural hand movements and the processing system automatically translates them into meaningful commands, making the interaction self-contained and reducing the need for complex external control mechanisms.

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to interact with stereoscopic images by performing gestures, allowing for dynamic manipulation of the image, such as moving, rotating, or zooming, through effective sensing and coordinate transformation techniques.

Implementation Method 1

the gesture sensor can obtain depth information of the gesture by a time of flight detection technology

Methodology Applied

Scientific EffectTime of flight detection: Time of Flight

Implementation Method 2

the gesture sensor can obtain depth information of the gesture by a time of flight detection technology, an acoustic detection technology

Methodology Applied

Scientific EffectAcoustic detection: Acoustics

Implementation Method 3

the gesture sensor can obtain depth information of the gesture by a time of flight detection technology, an acoustic detection technology, a binocular parallax detection technology

Methodology Applied

Scientific EffectBinocular parallax detection: Parallax

Implementation Method 4

the gesture sensor can obtain depth information of the gesture by a time of flight detection technology, an acoustic detection technology, a binocular parallax detection technology, or a structured light detection technology

Methodology Applied

Scientific EffectStructured light detection: Light

Data Source

PatentUS11934585B2Method for performing interactive operation upon a stereoscopic image and stereoscopic image display system

Publication Date: 2024.03.19 LIXEL INC

AI summary

A method for performing interactive operation upon a stereoscopic image and a stereoscopic image display system are provided. The stereoscopic image display system includes a stereoscopic display and a gesture sensor. In the method, the stereoscopic display displays the stereoscopic image, and the gesture sensor senses a gesture. A current gesture state is obtained. A previous state of the stereoscopic image and a previous gesture state are obtained. Stereo coordinate variations corresponding to the gesture can be calculated according to the current gesture state and the previous gesture state. New stereoscopic image data can be obtained according to the previous state of the stereoscopic image and the stereo coordinate variations corresponding to the gesture. The stereoscopic display is used to display a new stereoscopic image that is rendered from the new stereoscopic image data.