Operator Determination via Line of Sight in User Interface Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies lack a method to effectively determine the operator performing operations through line of sight, which is essential for processing based on user line of sight in user interface systems.

Innovation Solution

An information processing apparatus and method that acquires a captured image of users, determines the operator by various criteria such as face region size, distance, or gestures, and conducts processes based on the determined operator's line of sight.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If line-of-sight detection technology is used to enable user operation, then user interface capability is improved, but the ability to determine which user is the operator deteriorates

Engineering Contradiction:
Improveuser interface capabilityVSAvoidoperator determination accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system segments the determination of operator status into multiple independent criteria: face region size analysis, distance measurement from the apparatus, and gesture detection. Each criterion independently evaluates user characteristics, and their results are combined to determine the operator, thereby improving accuracy while maintaining versatility

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary determination unit that acts as a mediator between the line-of-sight detection technology and the operator identification. This unit integrates multiple detection results (face size, distance, gestures) to resolve ambiguity and accurately identify the operator, enabling both versatile UI operation and precise operator determination

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple users are included in the captured image, then system inclusivity is improved, but operator identification reliability deteriorates

Engineering Contradiction:
Improvesystem inclusivityVSAvoidoperator identification reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system applies different evaluation criteria to different users in the captured image based on their local characteristics. Each user's face region size, distance from the apparatus, and performed gestures are individually analyzed, allowing the system to maintain high reliability in operator identification even when multiple users are present by evaluating each user's specific attributes

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10928896B2Information processing apparatus and information processing method
Publication Date: 2021.02.23 SONY GROUP CORP
  • US10928896B2 patent drawing
  • US10928896B2 patent drawing
  • US10928896B2 patent drawing

AI summary

There is provided an information processing apparatus including an image acquisition unit configured to acquire a captured image of users, a determination unit configured to determine an operator from among the users included in the acquired captured image, and a processing unit configured to conduct a process based on information about user line of sight corresponding to the determined operator.