In-Vehicle Display Hand Overlay for Intuitive Touch Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing in-vehicle information processing systems are not intuitive, requiring operators to constantly focus on the screen to understand the correspondence between hand movements and pointer movements, leading to inefficient operation.

Innovation Solution

An in-vehicle information processing system that includes a display, a touch operation interface, an imaging unit to capture the operation hand, and a controller to associate hand positions with screen positions, allowing the operator's hand to be displayed in overlap on the screen, enhancing intuitive operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a pointer or cursor is displayed on the screen to indicate operation position, then the operation position can be shown, but the operator must constantly focus on the screen to understand the correspondence between hand movements and pointer movements, reducing intuitiveness

Engineering Contradiction:
Improvecorrespondence relationship between hand position and pointer positionVSAvoidintuitiveness of operation
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The imaging unit captures an image of the operator's hand, and the display unit overlays this captured hand image directly onto the screen at the corresponding position. This creates a visual copy of the actual hand position on the display, eliminating the need for a separate pointer and making the correspondence between hand movement and operation position immediately apparent and intuitive.

Inventive Principle:
Principle #26Copying

2Measurement precision

If a pointer or cursor is used to indicate operation position, then the operation position can be indicated, but the operator spends a long time looking closely at the pointer to understand the correspondence relationship

Engineering Contradiction:
Improveposition correspondence accuracyVSAvoidtime spent focusing on the screen
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of using a small pointer that requires close attention, the system creates a full-scale visual copy of the operator's hand on the display screen. This enlarged visual representation allows the operator to easily perceive position correspondence without straining to look at a small pointer, significantly reducing the time needed to understand the relationship between hand position and operation position.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the operator's hand is captured and displayed in overlap on the screen, then intuitive operation is achieved, but additional components (imaging unit, control unit) are required

Engineering Contradiction:
ImproveintuitivenessVSAvoidsystem structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system merges the imaging unit, control unit, and display unit into an integrated operation display system. The imaging unit captures the hand, the control unit processes and coordinates the hand image with screen position data, and the display unit overlays them together. This merging of multiple functions into a coordinated system achieves intuitive operation while managing complexity through functional integration.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10788904B2In-vehicle information processing system
Publication Date: 2020.09.29 CALSONIC KANSEI CORP
  • US10788904B2 patent drawing
  • US10788904B2 patent drawing
  • US10788904B2 patent drawing

AI summary

Provided is an in-vehicle information processing system that can be operated intuitively. An in-vehicle information processing system (10) includes a display (11), a touch operation interface (12), an imaging unit (13), and a controller (14). The display (11) includes at least one screen. The touch operation interface (12) detects contact by an operation hand of an operator. The imaging unit (13) captures an image of the touch operation interface (12) and at least a portion of the operation hand. The controller (14) associates position coordinates in an operation region (R2) on the screen with position coordinates in a predetermined region (R1) of the touch operation interface (12) and causes at least a portion of the operation hand to be displayed in overlap on the screen on the basis of the image captured by the imaging unit (13).