Mixed-Reality Driving View for Low-Latency Actuator Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for generating an immersive driving experience of an actual vehicle in a virtual environment suffer from delays in providing feedback on the state of actuators, making sports driving dangerous due to inconsistent dynamics between the actual and virtual environments.
Innovation Solution
A system comprising a first positioning unit to detect the actual vehicle's position, virtual reality goggles with image acquisition means to capture images of the vehicle's interior and control elements, and a computational entity to generate mixed images combining virtual and actual environment elements, reducing delays by displaying accurate and synchronized virtual and real-world elements in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the state of actuators is detected and represented in the virtual environment, then the virtual environment can be generated, but delays occur in providing feedback on the state of actuators
Solution Approach 1:
The system segments the visual feedback into two distinct components: real-time captured images of actual vehicle elements (steering wheel, dashboard) and rendered virtual environment graphics. This segmentation allows each component to be processed and displayed independently, eliminating the delay caused by detecting and representing actuator states in a fully virtual model.
Solution Approach 2:
Instead of creating virtual representations of vehicle actuators and their states, the system uses optical copying by capturing actual images of the vehicle's control elements with cameras mounted in the vehicle. These real-world images are then composited with the virtual environment, providing immediate visual feedback without the processing delays inherent in sensor-based virtual modeling.
2Adaptability or versatility
If the virtual environment is generated based on actuator state detection, then the immersive experience can be provided, but the dynamics between actual and virtual environments become inconsistent
Solution Approach 1:
The system merges real-time captured images of actual vehicle elements with rendered virtual environment graphics to create a unified composite display. This merging ensures that the visual feedback from actual vehicle controls and the virtual environment evolve together in real-time, maintaining dynamic consistency between the physical and virtual domains while providing an immersive experience.
Solution Approach 2:
The system implements immediate visual feedback by displaying captured images of actual vehicle controls and the virtual environment simultaneously in the composite view. This real-time feedback loop ensures that any changes in the actual vehicle's actuator states are instantly reflected in the visual display, maintaining consistency between the actual and virtual environments during dynamic driving maneuvers.
3Device complexity
If only virtual images are generated, then the system complexity is reduced, but the delay in providing accurate feedback increases
Solution Approach 1:
The system performs preliminary action by pre-positioning cameras in the vehicle to capture images of control elements and pre-establishing the composite display framework. This preparation allows the system to immediately composite real-time captured images with virtual environment graphics without requiring complex real-time processing of actuator states, thereby reducing feedback delay while maintaining manageable system complexity.
Data Source
Figure 1
Figure 2
AI summary
The present invention relates to a system for generating an immersive driving experience of an actual vehicle (V) in a virtual environment, comprising: - virtual reality goggles (G); - positioning units (P1, P2) to detect the positions of the actual vehicle (V) and of the virtual reality goggles (G) with respect to the actual vehicle (V); and - a computational entity (S) to generate mixed images that combine those of the virtual environment with acquired images or representative images thereof, of elements of the actual vehicle (V) or of the interior of its passenger compartment, and to send representative signals of such mixed images to the virtual reality goggles (G) to display same. The invention also relates to a method and a computer program for generating an immersive driving experience of an actual vehicle in a virtual environment.