Dual Sensor Input System for Precise Coordinate Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current techniques for monitoring objects using image processing lack accuracy in sensing user inputs, particularly in indoor environments where precise detection of input devices or hands is challenging.

Innovation Solution

An information processing system comprising an overhead sensor and a homing sensor, where the overhead sensor captures a wide view of the environment and determines the input state of a user, and the homing sensor, with a narrower view, accurately detects the input coordinates by selecting the optimal imaging position based on the positional relation between the input-related object and imaging candidates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single imaging device is used to capture user input, then the device complexity is low, but the measurement precision of input coordinates is insufficient

Engineering Contradiction:

Improveinput coordinate detection accuracyVSAvoidimaging device configuration

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging system is segmented into two functional parts: an overhead sensor for wide-area monitoring and a homing sensor for precise input detection. This segmentation allows each sensor to specialize in its optimal function, improving overall measurement precision without requiring a single complex device

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The overhead sensor acts as an intermediary that provides positional information about the input-related object to the homing sensor controller. This intermediary role enables the homing sensor to position itself accurately for precise measurement without the overhead sensor needing direct measurement capability

Inventive Principle:

Principle #24Intermediary (Mediator)

2Area of stationary object

If an overhead sensor with wide view is used, then the coverage area is large, but the measurement precision of input coordinates is reduced

Engineering Contradiction:

Improvemonitoring coverage areaVSAvoidinput coordinate detection accuracy

Core Design Contradiction:

Area of stationary objectVSMeasurement precision

Solution Approach 1:

The monitoring system is divided into two stages: wide-area monitoring by the overhead sensor and focused precision measurement by the homing sensor. This segmentation allows the system to maintain both large coverage area and high measurement precision by using each sensor in its optimal operating range

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system transitions from a single two-dimensional imaging plane to a three-dimensional spatial arrangement with the overhead sensor positioned above and the homing sensor positioned laterally. This dimensional change allows simultaneous wide coverage and focused precision measurement

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the homing sensor captures a narrow view, then the measurement precision is high, but the area of detection is limited

Engineering Contradiction:

Improveinput coordinate detection accuracyVSAvoiddetection coverage area

Core Design Contradiction:

Measurement precisionVSArea of stationary object

Solution Approach 1:

The overhead sensor performs preliminary action by capturing the user's position and the input-related object's location before the homing sensor begins precision measurement. This preliminary positioning enables the homing sensor to focus its narrow view on the correct area, achieving high precision without sacrificing overall detection capability

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11501459B2Information processing apparatus, method of information processing, and information processing system

Publication Date: 2022.11.15 SONY GROUP CORP

AI summary

Provided is an information processing apparatus including a determination unit that determines an input state of a user based on a captured image of a first imaging device and a sensor controller that determines an imaging position at which an input image is captured by a second imaging device different from the first imaging device, based on a positional relation between an input-related object related to input by the user and each of a plurality of imaging position candidates and the input state.