Dynamic Virtual Keyboard Positioning for Touch Panel Usability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional touch panel desks with fixed keyboard displays often position the keyboard inconveniently for users, as the display position is fixed and does not adapt to changes in user positioning.

Innovation Solution

An information processing apparatus that includes a presentation unit, a hand position detection unit, and a presentation control unit to dynamically position an operation input unit based on the detected hand position, using imaging and hand shape recognition to ensure the input unit is presented in an easily accessible location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the keyboard display position is fixed on the touch panel, then the space can be used for other purposes when the keyboard is not needed, but the keyboard may not be displayed in a convenient position when the user sits in different positions

Engineering Contradiction:
Improvespace utilizationVSAvoidkeyboard accessibility
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements dynamic positioning of the keyboard display by detecting the user's hand position and automatically adjusting the keyboard display location accordingly. The keyboard transitions from a fixed position to a dynamically adjustable position that adapts to the user's location, resolving the contradiction between space utilization and keyboard accessibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses hand position detection to provide feedback about user location, then adjusts the keyboard display position based on this feedback. This closed-loop control ensures the keyboard is always displayed in a convenient position relative to the user, while maintaining the ability to use the space for other purposes when the keyboard is not needed.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the keyboard is physically placed on the desk, then it is convenient for use, but it occupies valuable desk space that cannot be used for other work

Engineering Contradiction:
Improvekeyboard usabilityVSAvoiddesk space
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent replaces the physical keyboard with a virtual keyboard displayed on the touch panel. This virtual copy provides the same input functionality without occupying physical desk space, allowing the area previously used by the physical keyboard to be utilized for other work purposes.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The mechanical keyboard system is replaced with an electronic touch panel interface. The physical mechanical keys are substituted with a digital display and touch input mechanism, eliminating the need for physical keyboard hardware on the desk while maintaining input capabilities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If the operation input unit is displayed in a fixed position, then the display is simple, but the user must move their hand more distance to access the keyboard when positioned differently

Engineering Contradiction:
Improvedisplay control complexityVSAvoidhand movement time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The keyboard display position changes dynamically based on detected hand position, reducing the distance the user's hand must travel to access the keyboard. This dynamic adjustment optimizes accessibility while the automated detection and positioning minimizes the added complexity of the system.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10754435B2Information processing apparatus and method, and program
Publication Date: 2020.08.25 SONY GROUP CORP
  • US10754435B2 patent drawing
  • US10754435B2 patent drawing
  • US10754435B2 patent drawing

AI summary

The present technology relates to information processing apparatus and method, and a program, which are capable of presenting an operation input unit in a position in which a user easily performs an input operation. An imaging unit captures an image of a vicinity of a display unit. A hand recognition unit recognizes a hand by extracting a hand image obtained by capturing a hand, based on feature information of the hand, from the image captured by the imaging unit. The hand position detection unit specifies a real position on a display unit from information on a position in an image in which the hand image is present. A display control unit for an operation input unit displays an operation input unit in a position on the display unit which is specified based on the position of the hand detected by the hand position detection unit.