Vehicle VR Display Segmentation for Interior Object Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for displaying virtual reality information in vehicles do not adequately account for intermediate objects within the vehicle compartment, leading to inaccuracies and potential damage during driving, as they fail to correctly classify and display interior elements alongside external information.
Innovation Solution
A method and system that classify image segments into interior, exterior, and additional object layers, allowing for precise modification and display of virtual reality information using virtual reality glasses, which captures and processes images to separate and display these segments accurately, enhancing user interaction and safety.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual reality information is displayed without classifying intermediate objects, then the display system is simpler, but accuracy and safety deteriorate due to inability to distinguish interior elements from exterior information
Solution Approach 1:
The patent segments the field of view into multiple layers (interior layer, intermediate objects layer, exterior layer) and classifies image segments into different categories. This segmentation enables the system to distinguish between interior vehicle elements and exterior information, resolving the contradiction by organizing complex visual data into manageable, classified segments that improve accuracy without overwhelming system complexity.
Solution Approach 2:
The patent introduces an image processing unit as an intermediary between the camera system and display system. This intermediary classifies and processes image segments, identifying intermediate objects and determining their transparency levels. The intermediary handles the complex classification task, allowing the overall system to achieve high measurement precision while managing complexity through specialized processing.
2Reliability
If all image segments are displayed with equal clarity, then the display system is simpler, but safety deteriorates due to inability to prioritize important exterior information over interior elements
Solution Approach 1:
The patent applies local quality by assigning different transparency levels to different regions of the display based on their classification. Intermediate objects and interior elements that are not critical receive higher transparency, while important exterior information receives lower transparency for better visibility. This localized differentiation improves driving safety by prioritizing critical information without requiring complete system redesign.
Solution Approach 2:
The system incorporates feedback mechanisms where the image processing unit continuously analyzes the classified segments and adjusts transparency levels based on the importance and priority of different elements. This feedback loop ensures that the most critical exterior information is always displayed with appropriate prominence, enhancing safety while managing processing complexity through adaptive adjustments.
3Object-affected harmful factors
If intermediate objects are not detected, then the system is simpler, but harmful factors increase due to user inability to perceive what they are touching
Solution Approach 1:
The patent implements preliminary action by detecting and classifying intermediate objects before the user interacts with them. The image processing unit identifies objects such as the driver's hands, passengers, or interior elements in advance, determines their transparency levels, and prepares the display accordingly. This preliminary detection prevents harmful factors by ensuring users can perceive what they are touching or approaching before contact occurs.
Solution Approach 2:
The patent replaces mechanical detection systems with optical-based image processing. Instead of using physical sensors or mechanical switches to detect intermediate objects, the system uses cameras and image analysis algorithms to identify and classify objects. This substitution reduces the mechanical complexity of the detection system while effectively identifying intermediate objects to prevent damage risks.
Data Source
Figure 1~4B
Figure 5A~5B
Figure 6A~7C
AI summary
Method, and associated system, for displaying virtual reality information in a vehicle (1), in which a virtual reality device (3) is used by a user (2) inside the vehicle (1), with the steps of i) capturing at least one image (5) of an environment of the user (2), ii) classifying the at least one segment (52) of the at least one image (5) as pertaining to the interior (11) of the vehicle (1), the area outside (12) the vehicle (1), and an additional object (13) of the vehicle (1), iii) modifying the at least one segment (52) based on the classification of the at least one segment (52), iv) generating a virtual environment of the user (2), and v) displaying the virtual environment generated by means of the virtual reality device (3). Virtual reality information is thus displayed in a vehicle, in such a way that this information may be modified to offer new functions in the vehicle (1).