Gaze-Based External Device Control via Image Sensor
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices require manual registration and selection of slave devices for control, which is inconvenient and time-consuming, especially when multiple devices need to be controlled simultaneously.
Innovation Solution
An electronic device that uses a line of sight determination method via an image sensor to identify and control external objects or associated devices without manual selection, allowing users to control devices by simply looking at them and providing a method for generating and transmitting control signals based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual registration and selection of slave devices is required, then device control functionality is achieved, but user convenience and operation time are reduced
Solution Approach 1:
The patent replaces manual mechanical selection operations with an optical detection system using an image sensor. The system automatically detects the user's line of sight direction and identifies the intended slave device, substituting the manual search and selection process with automated visual recognition and coordinate mapping.
Solution Approach 2:
The system enables self-service by automatically identifying and selecting the target slave device based on the user's gaze direction without requiring manual intervention. The electronic device autonomously determines which device the user intends to control by analyzing the line of sight and corresponding screen coordinates.
2Adaptability or versatility
If multiple slave devices are registered, then device control versatility is improved, but device complexity and selection difficulty increase
Solution Approach 1:
The patent replaces the complex manual selection process with an automated visual targeting system. The image sensor captures the user's eye position, the controller calculates the line of sight direction, and maps it to screen coordinates to automatically identify the intended device, eliminating the need for users to manually navigate through multiple registered devices.
3Productivity
If manual device selection is required, then control precision is maintained, but operation efficiency is reduced
Solution Approach 1:
The patent uses an image sensor and coordinate mapping system to automatically determine the target device with high precision. The system captures eye position coordinates, calculates the line of sight direction, and maps these to screen coordinates to precisely identify which slave device the user intends to control, replacing manual selection with automated optical measurement.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless and efficient control of external objects or devices by eliminating the need for manual registration and selection, allowing users to control multiple devices with ease through gaze-based interaction.
Implementation Method 1
determining a line of sight of a user based on an image of an eye of the user captured by the camera module
Data Source
AI summary
Methods and apparatuses are provided for controlling an external object by an electronic device. A line of sight of a user is determined using an image sensor of the electronic device. An object located outside of the electronic device is determined based on the line of sight of the user. Object information regarding the object is determined. A user input with respect to the object is received from the user. The object or another electronic device associated with the object is controlled based on the user input and the object information.