3D Vision System Gesture Control for TV Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture control systems for TVs and other devices struggle to accurately track user interactions in three-dimensional space, particularly in varied environments with ambient light and background conditions, limiting their effectiveness for controlling television functions and interactive applications.

Innovation Solution

A 3D vision system integrated into displays, comprising stereo vision, structured light, laser rangefinders, or time-of-flight cameras, processes vision data to recognize user gestures, track body movements, and control display settings, media playback, and interactive content, using computer algorithms for depth estimation, noise reduction, and user analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture control systems are used to control TV functions, then the need for traditional remote controls is reduced, but the systems fail to accurately track user interactions in three-dimensional space under varied environmental conditions

Engineering Contradiction:
Improvegesture control capabilityVSAvoidtracking accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines multiple sensing technologies (stereo vision, structured light, laser rangefinders, time-of-flight cameras) into an integrated 3D vision system. This merging of different measurement approaches allows the system to accurately track user gestures in three-dimensional space while compensating for the limitations of individual sensing methods, thereby maintaining tracking precision under varied ambient light and background conditions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces structured light patterns and active illumination as intermediary elements between the user and the sensing system. These intermediaries enhance the contrast and detectability of user gestures against varying backgrounds, enabling accurate tracking even in challenging environmental conditions where passive gesture recognition would fail.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If 3D vision systems with multiple sensing technologies are integrated into displays, then tracking accuracy improves, but device complexity increases

Engineering Contradiction:
Improvegesture tracking accuracyVSAvoidsystem integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent designs the 3D vision system with multi-functional components that serve multiple purposes. For example, the structured light projector not only provides illumination for depth sensing but also creates reference patterns for gesture recognition. The camera system simultaneously captures both the structured light patterns and ambient scene information. This multi-functionality reduces the need for separate dedicated components, thereby managing complexity while maintaining high measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent divides the 3D vision system into distinct functional modules (stereo vision module, structured light module, laser rangefinder module, time-of-flight camera module) that can be independently optimized and calibrated. This segmentation allows each subsystem to be developed and tested separately, reducing the overall integration complexity while achieving high tracking accuracy through the synergistic combination of modular components.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and intuitive control of TV functions and interactive content through gesture recognition, adapting to ambient light and user behavior, enhancing user experience and reducing the need for traditional remote controls.

Implementation Method 1

A 3D vision system integrated into displays, comprising stereo vision, structured light, laser rangefinders, or time-of-flight cameras

Methodology Applied
Scientific EffectStructured light:

Implementation Method 2

A 3D vision system integrated into displays, comprising stereo vision, structured light, laser rangefinders, or time-of-flight cameras

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

A 3D vision system integrated into displays, comprising stereo vision, structured light, laser rangefinders, or time-of-flight cameras

Methodology Applied
Scientific EffectLaser: Laser

Data Source

PatentUS10831278B2Display with built in 3D sensing capability and gesture control of tv
Publication Date: 2020.11.10 META PLATFORMS INC
  • US10831278B2 patent drawing
  • US10831278B2 patent drawing
  • US10831278B2 patent drawing

AI summary

Information from execution of a vision processing module may be used to control a 3D vision system.