Gaze-Controlled AI Device Selection Using Distance Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In environments with multiple AI devices, it is challenging to accurately select the intended device to respond to user commands, leading to unintended devices being activated.

Innovation Solution

An AI device equipped with a camera and processor that captures user images, determines the user's gaze position, calculates the distance to its own camera, and compares this with distances calculated by external AI devices to select the device closest to the user's gaze, thereby preventing unintended devices from operating.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple AI devices are deployed in the environment, then the coverage and availability of AI services are improved, but the difficulty of selecting the intended device to respond to user commands increases

Engineering Contradiction:
Improveservice coverageVSAvoiddevice selection accuracy
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces a gaze detection mechanism as an intermediary to bridge the user and the AI device selection process. The camera captures the user's line of sight, and the processor determines the gaze position to identify which device the user is looking at. This intermediary mechanism enables accurate device selection in multi-device environments without requiring direct user interaction with each device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical or manual device selection methods (such as physically approaching a device or pressing buttons) with an optical-based gaze detection system. The camera and processor work together to detect the user's gaze direction and automatically determine the intended target device, substituting manual selection with automated visual tracking.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Speed

If AI devices respond to voice commands in multi-device environments, then the responsiveness and user experience are improved, but the reliability of command execution deteriorates due to unintended device activation

Engineering Contradiction:
Improveresponse speedVSAvoidcommand execution accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent performs preliminary device identification through gaze detection before the voice command is executed. The camera continuously monitors the user's gaze position, and the processor pre-determines which device should be the target. This preliminary action ensures that when a voice command is given, the system already knows which device to activate, preventing unintended device responses and ensuring reliable command execution.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If gaze detection functionality is added to AI devices, then the precision of device selection is improved, but the device complexity increases

Engineering Contradiction:
Improvegaze position accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the existing camera component serve multiple functions: it is used both for general environmental perception and specifically for gaze detection. The processor also performs dual roles in general data processing and gaze position calculation. This multi-functionality approach allows the system to achieve precise gaze detection without adding dedicated hardware components, thereby minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10872438B2Artificial intelligence device capable of being controlled according to user's gaze and method of operating the same
Publication Date: 2020.12.22 LG ELECTRONICS INC
  • US10872438B2 patent drawing
  • US10872438B2 patent drawing
  • US10872438B2 patent drawing

AI summary

An artificial intelligence (AI) device capable of being controlled according to a user's gaze includes a communication unit, a camera configured to capture an image of a user, and a processor configured to acquire user state information from the image of the user, acquire a gaze position of the user based on the acquired user state information, calculate a distance between the acquired gaze position and the camera, receive, from one or more external AI devices, one or more distances between gaze positions of the user respectively acquired by the external AI devices and cameras respectively provided in the external AI devices through the communication unit, and compare the calculated distance with the received one or more distances to select a controlled device.