Remote Vehicle Interior Visualization via VR and Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for presenting vehicle interior information in augmented or virtual reality require the user to be physically present in or near the vehicle, limiting remote access and comprehensive visualization.
Innovation Solution
A method and system that utilize cameras within the vehicle to record and transmit 360° panoramic images of the vehicle interior to an external server, where they are processed and displayed via VR goggles, allowing remote users to access and search the vehicle's interior using motion detection and object recognition techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user is physically present in or near the vehicle to access interior information, then the user can obtain real-time vehicle interior data, but remote access capability is limited
Solution Approach 1:
The patent creates a virtual copy of the vehicle interior by capturing images with cameras, processing them through object recognition algorithms, and rendering them in a VR environment. This virtual copy allows remote users to access and interact with vehicle interior information without being physically present, resolving the contradiction between remote access capability and information accessibility
Solution Approach 2:
The system introduces a server as an intermediary between the vehicle cameras and the user's VR device. The server receives image data from cameras, processes it through object recognition, and transmits the processed information to the VR device. This intermediary enables remote access while maintaining information fidelity, solving the contradiction between physical presence requirement and remote accessibility
2Device complexity
If standard cameras are used to capture vehicle interior images, then the system structure is simple, but comprehensive 360° panoramic view and detailed object detection are limited
Solution Approach 1:
The patent divides the vehicle interior monitoring task into multiple segments by deploying multiple cameras at different positions (front, rear, left, right). Each camera captures a specific zone, and the server integrates these segmented views into a comprehensive 360° panoramic view with enhanced object detection capability, resolving the contradiction between system simplicity and detection accuracy
Solution Approach 2:
The system transitions from single-point camera views to a multi-dimensional panoramic representation by combining images from multiple camera positions. This dimensional expansion creates a comprehensive spatial model of the vehicle interior, enabling both simple camera implementation and high-precision object detection across the entire interior space
3Area of stationary object
If multiple cameras are installed to capture comprehensive vehicle interior views, then 360° panoramic coverage is achieved, but the number of components and system complexity increase
Solution Approach 1:
The patent makes each camera multi-functional by positioning them to simultaneously capture panoramic views, detect objects, and monitor specific zones. The server processes images from all cameras to generate both the 360° panoramic representation and perform object recognition, allowing comprehensive coverage without proportionally increasing system complexity
Solution Approach 2:
The system merges the functions of multiple cameras into a unified processing pipeline on the server. Instead of treating each camera independently, the server combines images from all camera positions to create a single comprehensive panoramic view and performs centralized object recognition, reducing the effective complexity despite using multiple cameras
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables remote users to visually inspect and search the vehicle interior without being physically present, providing a comprehensive and interactive 360° view with highlighted object detection, facilitating the retrieval of forgotten items.
Implementation Method 1
A respective marking is situated on objects which cannot be seen by the human eye, which marking can be detected by a camera on the basis of reflected light
Data Source
AI summary
At least one image of an interior of a vehicle is captured by at least one camera present in the vehicle. Image data of the at least one image that are denoted in reference to the vehicle are transmitted to an external server. A user is authorized by the external server to access the image data denoted in reference to the vehicle, for display to the user via VR goggles. An object detected by numerical methods is highlighted in color in the image depicted in the VR goggles.