Vehicle 3D Display Interaction Using Pressure and Gesture Depth Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D display technologies in vehicles do not allow for effective interaction with controls displayed at different spatial depths, as they require operation on a two-dimensional surface, limiting spatial interaction with visually perceived 3D objects.
Innovation Solution
A method and device that enable interaction with 3D content by detecting the depth level of user actions using sensors, allowing interaction with controls at specific depth levels based on pressure intensity, area, or gestures, and providing visual and haptic feedback to enhance controllability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3D display technology is used to display controls at different spatial depths, then visual information distribution in space is improved, but interaction capability with controls at different depths deteriorates
Solution Approach 1:
The patent extends 2D touchscreen interaction into 3D space by detecting hand position coordinates (x, y, z) and mapping them to controls at corresponding depth levels. The system determines depth level based on the z-coordinate of the detected hand position, enabling natural spatial interaction with 3D displayed controls without requiring physical depth variation in the display itself.
Solution Approach 2:
The patent introduces an image sensor as an intermediary between the user and the 3D display controls. The sensor detects hand gestures and positions in 3D space, translating physical hand movements into digital interaction signals that activate controls at appropriate depth levels, thereby mediating the interaction between the user and the virtual 3D interface.
2Device complexity
If 2D touchscreen interaction is used for 3D displays, then device simplicity is maintained, but spatial interaction accuracy deteriorates
Solution Approach 1:
The patent replaces traditional mechanical touchscreen contact interaction with optical field-based hand gesture detection. Instead of requiring physical contact with the display surface, the system uses an image sensor to detect hand position and gestures in 3D space, substituting mechanical interaction with optical sensing and computational mapping.
3Loss of information
If multiple depth levels are displayed simultaneously, then information hierarchy is improved, but control selection complexity deteriorates
Solution Approach 1:
The patent applies local quality by making different depth levels accessible through distinct spatial zones. Each depth level corresponds to a specific z-coordinate range, allowing users to interact with controls at different depths by positioning their hands at appropriate distances from the display. This creates localized interaction zones that naturally guide user attention and reduce selection complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless spatial interaction with 3D controls by determining the appropriate depth level for user actions, improving the usability of 3D displays in vehicles by allowing operation at different spatial distances, enhancing user experience and operational efficiency.
Implementation Method 1
An image sensor is used to detect when the user has an activating object, such as. B. placed a hand or a finger in three-dimensional space at a location where from his point of view an activatable object is located
Implementation Method 2
the pressure strength can also be determined by measuring changes in capacitance by changing the distance between different layers of the display
Data Source
Figure 1
Figure 2
Figure 3
AI summary
For interaction with image contents displayed on a display device in a vehicle, image contents are displayed with a spatial impression of depth, the image contents comprising control elements in more than one depth plane. An operating action by a user is detected by means of at least one sensor provided in the vehicle, and it is determined in which depth plane an operating element should be operated. An interaction with a displayed operating element then takes place in the determined depth plane, in accordance with the detected operating action. According to a first embodiment of the invention, a touch screen is provided for the operating action of the user. According to this embodiment, the level of pressure exerted by the user is detected and the user interacts with operating elements in different depth planes depending on the detected pressure level. According to a second embodiment of the invention, a gesture sensor is provided for the operating action by the user. According to this embodiment, at least one virtual surface is provided in the vehicle interior, which is used to distinguish the different depth planes, by detecting whether all or parts of the user's hand are located in front of or behind said virtual surface.