Mid-Air Screen Interaction Zones for Accurate Contactless Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Selecting and executing objects on a screen through contactless operation is challenging due to difficulty in determining the position of the target away from the screen, leading to potential erroneous selections.

Innovation Solution

Allocate a first region for selecting objects in a mid-air space immediately above the screen and a second region for executing the selected object in a mid-air space farther from the screen, facilitating accurate object selection and execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a target is brought closer to the screen to select an object, then contactless operation is enabled, but it becomes difficult to determine the position of the target away from the screen, leading to wrong object selection

Engineering Contradiction:
Improvecontactless operationVSAvoidtarget position determination
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a vertical dimension (distance from the screen) to the traditional two-dimensional screen interface. By allocating different mid-air spaces at different heights above the screen to different operations (selection vs. execution), the system enables contactless operation while maintaining precise position determination through spatial differentiation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the mid-air space above the screen into multiple regions (first mid-air space for selection, second mid-air space for execution). This segmentation allows the system to distinguish between different operations based on the vertical position of the target, resolving the contradiction between enabling contactless operation and maintaining position determination accuracy.

Inventive Principle:
Principle #1Segmentation

2Area of stationary object

If the same mid-air space is used for both selection and execution, then the operation area is maximized, but erroneous selection occurs due to inability to distinguish operation types

Engineering Contradiction:
Improveoperation areaVSAvoidobject selection accuracy
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent divides the operation space into distinct vertical regions: a first mid-air space for object selection and a second mid-air space for object execution. This segmentation maintains a comprehensive operation area while preventing erroneous selection by clearly distinguishing between selection and execution operations through spatial separation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different portions of the mid-air space are assigned different functions (selection vs. execution). The first mid-air space has the quality of receiving selection operations, while the second mid-air space has the quality of receiving execution operations, ensuring reliable operation differentiation throughout the extended operation area.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12602141B2Information processing apparatus information processing method, and non-transitory computer readable medium
Publication Date: 2026.04.14 FUJIFILM BUSINESS INNOVATION CORP
  • US12602141B2 patent drawing
  • US12602141B2 patent drawing
  • US12602141B2 patent drawing

AI summary

An information processing apparatus includes a processor configured to: in an operation of selecting and executing an object in a screen by a contactless operation with a target, allocate a first region for selecting the object to a mid-air space immediately above the screen; and allocate a second region for executing the selected object to a mid-air space farther from the screen than the first region.