Vehicle Virtual Interface With Ultrasonic Haptics and Self-Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional vehicle user interfaces are not accessible or adaptable to drivers in autonomous driving scenarios where they face away from the forward position, and existing haptic solutions lack flexibility and freedom in display and operation.

Innovation Solution

A user interface system comprising a 3D image generation system, sensor system, and signaling device with tunable ultrasonic loudspeakers, allowing for a location-independent and adaptable display and operation, with self-calibration and object tracking capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional forward-facing user interfaces are used in autonomous vehicles, then the interface is easily accessible to drivers facing forward, but the interface becomes inaccessible when the driver rotates the seat 180° towards the rear passenger compartment

Engineering Contradiction:
ImproveAccessibility of user interfaceVSAvoidAdaptability to driver position changes
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The user interface is transformed from a fixed physical display to a dynamic virtual image that can be projected to any location within the passenger compartment. The projection system allows the interface to move and reposition itself based on the driver's seat orientation, maintaining accessibility whether the driver faces forward or backward

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The interface transitions from a two-dimensional fixed screen to a three-dimensional virtual image that can be projected throughout the passenger compartment space. This spatial freedom allows the interface to adapt to different driver positions by changing its location in 3D space rather than being constrained to a single fixed position

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If fixed displays are located on doors, windows, or table surfaces, then the displays are accessible even if the driver changes position, but the degrees of freedom regarding display arrangement and operation are strictly limited

Engineering Contradiction:
ImproveAccessibility from different positionsVSAvoidDegrees of freedom in display arrangement
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The projection system serves multiple functions: it can display information on any surface, project virtual objects in 3D space, provide haptic feedback through ultrasonic technology, and adapt to various driver positions. This single system replaces multiple fixed displays and provides unlimited configurability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system allows continuous adjustment of multiple parameters including the position, orientation, size, and content of the virtual interface. The projection can be dynamically repositioned and resized, and the haptic feedback parameters can be adjusted, providing extensive adaptability beyond fixed displays

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If ultrasonic loudspeakers are arranged in fixed modules, then the device structure is simplified, but the flexibility in configuring the haptically perceptible area is reduced

Engineering Contradiction:
ImproveModule arrangement structureVSAvoidFlexibility in haptic area configuration
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

While the physical modules remain stationary, the system dynamically configures which modules are active and how they work together. The control system can activate different module combinations and adjust their parameters to create haptically perceptible areas at different locations and with different characteristics, providing flexibility without requiring physical reconfiguration

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables flexible and accessible operation of vehicle interfaces from various positions, providing haptic feedback and adapting to the operator's position, enhancing usability in autonomous driving environments.

Implementation Method 1

a plurality of ultrasonic loudspeakers for generating a haptically perceptible area within the interaction space

Methodology Applied
Scientific EffectUltrasonic vibration: Ultrasonic Vibration

Implementation Method 2

ultrasonic loudspeakers whose ultrasonic signals are tunable with respect to phase, frequency and amplitude, wherein the ultrasonic loudspeakers individually or in groups form several modules

Methodology Applied
Scientific EffectAcoustic radiation pressure: Acoustic Radiation Pressure

Implementation Method 3

optics that project the real image of the user interface into an interaction space located within the operator's field of vision

Methodology Applied
Scientific EffectOptical projection: Lens

Implementation Method 4

several ultrasonic microphones are arranged directly on the modules, wherein the user interface is configured to perform self-calibration, wherein, for the configuration of the device, the modules successively emit defined test signals which are registered by the ultrasonic microphones

Methodology Applied
Scientific EffectSound wave detection: Sound

Data Source

PatentEP3894991B1User interface of a vehicle, and method for configuring and controlling the user interface
Publication Date: 2026.03.18 VOLKSWAGEN AG
  • EP3894991B1 patent drawingFigure 1
  • EP3894991B1 patent drawingFigure 2

AI summary

The present invention relates to a user interface of a vehicle and to a method for configuring and controlling a user interface, the signal apparatus of which has a multiplicity of ultrasonic loudspeakers for producing a haptically perceptible area inside the interaction space. In order to provide a user interface for a vehicle and a method for configuring and controlling the user interface, which can be used flexibly and has more degrees of freedom in respect of the presentation, the user interface has, according to the invention, a display apparatus for producing a virtual image of a control surface, an operator control unit for using the virtual control surface having a sensor system for capturing and/or tracking control objects, and a signal apparatus configured to produce perceptible signals on the basis of the use of the control surface. To control and configure the user interface, there is provision for the modules to successively deliver defined test signals that are recorded immediately and/or after a reflection from one or more reflection bodies by ultrasonic microphones arranged directly on the modules and/or freely in the space, so that the relative positions and orientations of the modules and ultrasonic microphones are obtained from the delay times and/or the intensities of the recorded test signals.