Imaging Unit Shielding Detection for Head-Mounted Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In head-mounted devices, users face difficulties in directly viewing input devices due to their placement, making conventional input methods like buttons and touch sensors less convenient, and gesture recognition requires high-load processing, increasing power consumption.

Innovation Solution

An information processing apparatus that determines whether an imaging unit is in a predetermined shielding state and recognizes user operations based on this state, allowing for input recognition without the need for visible input devices, using imaging units to detect shielding by the user's hand, thereby reducing processing load and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture recognition is used for input in head-mounted devices, then user input convenience is improved, but processing load and power consumption increase

Engineering Contradiction:
Improveuser input convenienceVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent extracts the essential feature of gesture recognition (hand shielding the imaging unit) and uses only this specific detection criterion rather than performing full image recognition processing. By taking out only the necessary detection element (shielding state detection), the system achieves gesture input functionality while minimizing processing load and power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of operation

If input devices are placed in head-mounted devices, then user input capability is provided, but direct viewing of input devices becomes difficult

Engineering Contradiction:
Improveuser input capabilityVSAvoidvisibility of input device
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses the imaging unit as an intermediary to detect user input. Instead of requiring direct viewing of physical input devices, the imaging unit mediates the detection process by capturing light changes when the user's hand shields it, thereby providing input capability without visibility requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical system of physical buttons and touch sensors with an optical detection system. By substituting mechanical input devices with imaging-based shielding detection, the system eliminates the need for users to directly view or physically access input components.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If conventional input devices (buttons, touch sensors) are used in head-mounted devices, then input functionality is provided, but user access and viewing become inconvenient

Engineering Contradiction:
Improveinput functionalityVSAvoiduser access convenience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent makes the imaging unit serve multiple functions: it is used for both capturing images for display/augmented reality purposes and for detecting user input through shielding detection. This multi-functionality provides input capability without requiring separate physical input devices, thereby improving user access convenience while maintaining input versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3617851B1Information processing device, information processing method, and recording medium
Publication Date: 2021.05.19 SONY GROUP CORP
  • EP3617851B1 patent drawingFigure 1
  • EP3617851B1 patent drawingFigure 2
  • EP3617851B1 patent drawingFigure 3

AI summary

To recognize a user input in a more favorable form without via an input device provided in a housing of an apparatus. An information processing apparatus includes a determination unit configured to determine whether or not an imaging unit is in a predetermined shielding state, and a recognition unit configured to recognize an operation input of a user according to the predetermined shielding state.