Vehicle Display Gesture Synchronization via Optical Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display synchronization methods in motor vehicles are limited, as they require complex operation of digital menus and cannot freely select or synchronize display devices showing different thematic contexts, and often rely on physical buttons or sensors.

Innovation Solution

A method using a video camera to capture three-dimensional operating gestures, such as pointing or dragging, which are detected by an optical sensor and processed by a gesture recognition device to synchronize any two display devices, allowing for the selection and transfer of data sets between them without the need for physical buttons or complex menu operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If physical buttons or electrical switches are used to trigger functions, then reliable function activation is achieved, but device complexity and installation complexity increase

Engineering Contradiction:
Improvefunction activation reliabilityVSAvoidinstallation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces mechanical buttons and electrical switches with an optical gesture recognition system. A video camera captures hand movements, and image processing algorithms translate these gestures into control commands, eliminating the need for physical control elements while maintaining reliable function activation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an optical sensor and gesture recognition algorithm as an intermediary between the user and the display system. This intermediary translates physical hand movements into digital control signals, providing a reliable control mechanism without requiring direct mechanical or electrical contact

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If digital menus are used for operation, then information display capability is improved, but ease of operation deteriorates

Engineering Contradiction:
Improveinformation display capabilityVSAvoidoperation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces complex digital menu navigation with natural hand gesture control. Users can select and manipulate display content through intuitive gestures captured by the video camera, eliminating the need to navigate through multiple menu levels while maintaining full access to information and functions

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces dynamic gesture-based control that adapts to user movements in real-time. The system continuously tracks hand position and gesture trajectory, allowing users to dynamically select and interact with display content as it appears, rather than following static menu structures

Inventive Principle:
Principle #15Dynamics

3Device complexity

If display devices are functionally separate, then system simplicity is maintained, but adaptability deteriorates

Engineering Contradiction:
Improvesystem simplicityVSAvoiddisplay synchronization capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal gesture recognition system that can control multiple different display devices simultaneously. The same optical sensor and gesture algorithms work across various display types and locations, enabling cross-device synchronization and information sharing while maintaining simple individual device architectures

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses the gesture recognition system as a universal intermediary that mediates between users and multiple display devices. This intermediary translates gestures into device-specific control commands, enabling synchronized operation across functionally separate displays without requiring complex inter-device communication protocols

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If theme-specific synchronization is required, then data accuracy is improved, but adaptability deteriorates

Engineering Contradiction:
Improvedata context accuracyVSAvoiddisplay selection freedom
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic theme detection and synchronization that automatically adapts to the current display context. The system monitors display content in real-time, detects thematic changes, and automatically adjusts synchronization parameters accordingly, allowing users to freely select any display devices while maintaining data context accuracy through automatic theme matching

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless and intuitive interaction between display devices, allowing users to freely select and synchronize data sets across different thematic contexts, enhancing user experience by eliminating the need for physical controls and improving the efficiency of information flow.

Implementation Method 1

An optical sensor device, e.g. a PMD camera (i.e. a photomixing detector), detects an operating gesture of a user

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP2943367B1Method for synchronizing display devices in a motor vehicle
Publication Date: 2020.03.18 AUDI AG
  • EP2943367B1 patent drawingFigure 1
  • EP2943367B1 patent drawingFigure 2

AI summary

The invention relates to a method for synchronizing two display devices (30, 34) in a motor vehicle. According to the invention, the first display device (30) already displays a first data set (32) which comprises a first display content relating to a predetermined thematic context. A sensor device (10), in particular a PMD camera, detects a control gesture of a user, which consists of a free movement in the chamber of a body part (24) of the user (S10). A signal which is then generated by the sensor device (10) and which describes the control gesture, is transmitted to a gesture recognition device which generates a control signal (S30) in accordance with the determined control gesture. In accordance with said control signal, a control device (18) capturing the control signal determines the predetermined thematic context of the determined data set (32). Using the defined predetermined thematic context, an additional data set (40) which includes a second display content of the predetermined thematic context is provided. Said additional data set (40) is displayed on the second display device (34).