Digital TV Control via Voice and Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital TV control systems are inconvenient as they require separate applications and processes for controlling devices beyond basic functions, limiting user interaction and functionality, especially when using smartphones or other devices instead of traditional remote controllers.

Innovation Solution

A system that allows control of digital devices using embedded functions of controlling devices without additional applications, utilizing voice, gesture, and network connectivity to enable intuitive control of targeted devices, including digital TVs, through voice recognition and gesture recognition interfaces, allowing control from neighboring devices without the need for specific pairing or installation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a separate application is installed on a smartphone to control a digital TV, then control functionality is provided, but device complexity and user inconvenience increase due to installation and execution requirements

Engineering Contradiction:
Improvecontrol functionalityVSAvoidinstallation and execution process
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The digital TV is designed to function both as a display device and as a controlling device. The TV's built-in controller can directly control other digital devices without requiring a separate smartphone application, thereby eliminating the need for additional software installation and execution while maintaining control functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The controlling device utilizes its own embedded functions and resources to perform control operations. The TV's controller serves itself and other devices by leveraging the TV's existing hardware capabilities (camera, microphone, processor) without needing external smartphone applications.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If traditional remote controllers or smartphone applications are used, then basic control functions are available, but diverse functions and scenarios require separate program installations

Engineering Contradiction:
Improvebasic control functionsVSAvoiddiverse functions and scenarios
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The controlling device is designed with universal control capabilities that can handle both basic control functions and diverse advanced scenarios through a single integrated system. The controller uses voice recognition, gesture recognition, and camera-based object recognition to provide adaptable control for various functions without requiring separate applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control system dynamically adapts its operation mode based on the detected scenario. It can switch between voice-based control, gesture-based control, and automatic object recognition control depending on the user's needs and environmental context, providing both ease of operation for basic functions and versatility for diverse scenarios.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If voice and gesture recognition are implemented, then intuitive control is achieved, but processing time and system complexity increase

Engineering Contradiction:
Improveintuitive controlVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The controller continuously monitors the environment using its camera and microphone, pre-processing sensory data in real-time. When a control command is detected (such as a recognized voice or gesture), the system is already in a state ready to quickly execute the appropriate control action, thereby reducing the perceived processing time for the user.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces traditional mechanical button-pressing interfaces with voice and gesture recognition. By using the TV's built-in camera and microphone along with its processor, it directly translates physical gestures and spoken commands into control signals, eliminating the need for separate remote controllers and reducing the time required to initiate control actions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If paired remote controllers are used, then control is limited to pre-decided functions, but user mobility is restricted as users must locate the remote controller

Engineering Contradiction:
Improvecontrol accessibilityVSAvoidcontrol location flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The digital TV itself serves as the controlling device, eliminating the need for separate remote controllers. Since the TV is stationary and the user approaches it to watch content, the control function is naturally integrated into the device the user is already interacting with, providing both accessibility and location flexibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control function is merged with the display device. Instead of having a separate remote controller that must be located and used, the TV incorporates control capabilities directly, combining the functions of display and control into a single integrated system that eliminates the need for users to search for or handle separate control devices.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3226569B1System for controlling device, digital device, and method for controlling same
Publication Date: 2021.12.15 LG ELECTRONICS INC
  • EP3226569B1 patent drawingFigure 1
  • EP3226569B1 patent drawingFigure 2
  • EP3226569B1 patent drawingFigure 3

AI summary

A digital device and a method for controlling the digital device are disclosed in this specification. Herein, according to an exemplary embodiment of the present invention, a targeted device being controlled by a control command received through at least one or more controlling devices includes a first receiving unit receiving content, a second receiving unit receiving a voice signal or text data respective to the voice signal from the controlling device, a decoder decoding the content, a processing unit processing the text data, a controlling unit identifying whether or not text data received from the processing data include a control command, controlling an output of a voice interface in response to a reception of the identified text data, configuring a result screen respective to the processed data and controlling an output of the result screen, and performing control operations so as to execute functions corresponding to the outputted result screen, and an outputting unit outputting the decoded content, the voice interface and its result screen or its function execution screen.