Vehicle Gesture Control via Virtual Object Superposition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for operating vehicle functions using gestures in three-dimensional space are not simple and reliable, particularly in interacting with the real environment around the vehicle.
Innovation Solution
A method and device that utilize an image-based detection process to detect gestures in three-dimensional space, superimpose virtual objects on the real environment, and allow manipulation of these objects through gestures, with the ability to display information on a vehicle's display unit, using a combination of image-based detection devices and display units such as head-up displays or central displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture-based control is implemented in three-dimensional space, then ease of operation is improved, but reliability of interaction with real environment is worsened
Solution Approach 1:
The patent introduces virtual objects as an intermediary layer between the user's gestures and the real environment. These virtual objects are superimposed on the real environment through a head-up display, allowing users to interact with simplified digital representations rather than directly with complex real-world objects. This mediator layer enhances reliability by providing clear visual feedback and unambiguous interaction targets while maintaining the ease of gesture-based operation.
Solution Approach 2:
The patent creates virtual copies of real environment objects and superimposes them on the actual scene. These virtual objects replicate key features of real objects (such as traffic lights, signs, or navigation markers) and can be manipulated through gestures. The copying principle allows users to interact with simplified digital representations that maintain the essential characteristics of real objects, improving both ease of operation and reliability of interaction.
2Adaptability or versatility
If virtual objects are superimposed on real environment, then adaptability of interface is improved, but device complexity is worsened
Solution Approach 1:
The patent implements a universal head-up display system that can superimpose multiple types of virtual objects (navigation markers, traffic information, warnings, etc.) on various real environment scenes. The same hardware infrastructure (cameras, display, processing unit) handles diverse functions including gesture detection, virtual object rendering, and real-time scene analysis. This multi-functionality approach increases adaptability while managing device complexity through shared components.
Solution Approach 2:
The patent merges multiple system functions into an integrated head-up display system. The gesture detection device, virtual object generation system, and real environment display are combined into a unified interface that overlays digital information directly onto the driver's field of view. By merging these functions, the system achieves high adaptability for different interaction scenarios while reducing the need for separate control systems and interfaces.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A method for the control of functions in a vehicle using gestures performed in three-dimensional space has the following steps: determining (S100) whether or not an optically detected first gesture performed in three-dimensional space is directed to a virtual object superimposed on an actual environment around the vehicle; determining (S500) whether or not an optically detected second gesture performed in three-dimensional space is a gesture assigned to a manipulation of the virtual object; and manipulating (S700) the virtual object, if it has been determined that the detected first gesture is the gesture that is directed to the virtual object superimposed on the actual environment around the vehicle, and if it is determined that the detected second gesture is the gesture assigned to the manipulation of the virtual object.