Face Position Based Operation Area for Screen Pointing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing systems that use captured images for user input face difficulties in accurately allowing users to point to positions on a screen, as the correspondence between the user's hands or controller and screen positions is unclear, requiring significant body movement.

Innovation Solution

An information processor with a captured image acquisition section, face position identification section, and operation area setting section, which acquires and processes images to identify the user's face, sets an operation area, and detects a detection target within that area to receive user-inputted screen positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a captured image is used as operation input, then the system can receive user input through imaging, but it becomes difficult for the user to point to a position on the screen

Engineering Contradiction:
Improveautomatic operation input receptionVSAvoidease of pointing to screen position
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent introduces a face position identification mechanism that adds a new reference dimension (face position) to the captured image coordinate system. By identifying the face position and setting the operation area based on relative position to the face, the system creates a natural reference frame that helps users understand the correspondence between their physical position and screen position, thereby enabling accurate pointing operations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the correspondence between user's hands/controller and screen position is established, then accurate pointing is possible, but the user is required to significantly move their body

Engineering Contradiction:
Improveprecision of screen position pointingVSAvoidease of body movement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies local quality by setting the operation area based on the local position of the user's face within the captured image. Instead of requiring global body movement, the system identifies the face position and establishes the operation area locally around that position. This allows users to point to screen positions by moving only their head or upper body within a limited range, significantly reducing the required body movement while maintaining accurate pointing precision.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the operation area is set based on face position, then pointing accuracy improves, but the system complexity increases

Engineering Contradiction:
Improveaccuracy of operation inputVSAvoidcomplexity of image processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into distinct functional modules: face position identification section, operation area setting section, and detection target detection section. Each module performs a specific function - identifying face position, setting operation area based on that position, and detecting targets within the operation area. This segmentation allows the system to achieve high pointing accuracy through coordinated modular processing while managing system complexity through clear functional decomposition.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2919099B1Information processing device
Publication Date: 2020.04.15 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2919099B1 patent drawingFigure 1
  • EP2919099B1 patent drawingFigure 2A
  • EP2919099B1 patent drawingFigure 2B~3

AI summary

Provided is an information processor which readily permits operation input to be made so as to point a position on a screen when an operation input is received from a user using a captured image obtained by imaging the user. The information processor acquires a captured image including a user's face, identifies the position of the user's face included in the acquired captured image, sets an operation area at a position on the captured image determined in accordance with the identified face position, detects a detection target within the operation area, and receives, as a user-pointed position, a position on the screen corresponding to a relative position of the detected detection target within the operation area.