Optical Hardware Key Operation Using Remote Pointing Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing pointing technologies fail to enable operation on hardware keys located outside the screen from a remote place, necessitating the use of an operation device that is inconvenient when not nearby.

Innovation Solution

An information processing apparatus and method that utilizes two cameras to capture images of a pointing object, detect its position, and determine if it is over a hardware key, executing the corresponding function based on this detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a remote control device is used to operate hardware keys from a distance, then the operation capability is improved, but the convenience deteriorates when the device is not located nearby

Engineering Contradiction:

Improveremote operation capabilityVSAvoidavailability when device is absent

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system captures images of the pointing object (hand/finger) using image-capturing devices and creates a digital representation to detect the pointed position. This optical copy approach replaces the need for physical proximity to hardware keys, enabling remote operation through image processing rather than direct device interaction

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical interaction between a physical remote control and hardware keys with an optical system. Image-capturing devices capture visual information, and image processing circuitry analyzes the images to detect pointing positions and trigger corresponding hardware key functions, substituting mechanical operation with optical detection and digital processing

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If hardware keys are installed outside the screen area, then the functionality is improved, but the accessibility from remote location deteriorates

Engineering Contradiction:

Improvefunctional capabilityVSAvoidremote accessibility

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system extends the operational space from the two-dimensional screen area to three-dimensional space by using image-capturing devices that can detect pointing positions in the spatial environment around the display. This allows hardware keys located outside the screen area to be accessed remotely by detecting the direction and position of the pointing object in 3D space

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20250348206A1Information processing apparatus, information processing method, and non-transitory recording medium

Publication Date: 2025.11.13 RICOH CO LTD

AI summary

An information processing apparatus includes circuitry that: receives a captured image of a pointing object, from an image-capturing device that captures an image of the pointing object; detects a pointed position pointed to by the pointing object from the received captured image; determines whether the detected pointed position is in an area of a hardware key installed on an electronic device; and executes a function corresponding to a button of the hardware key, based on a determination that the pointed position is in the area of the hardware key.