In-Vehicle Image Analysis for Proprietary Dashboard Data Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Telematics systems face challenges in obtaining certain types of vehicle information due to the increasing use of proprietary communication protocols and lack of standardized higher-layer protocols in vehicles, especially electric vehicles, making it difficult to decode and collect data from visual data sources within the vehicle.
Innovation Solution
Implementing a camera and image processing unit in vehicles to capture images of visual data sources like dashboards, and using machine learning models to extract vehicle information, which is then combined with conventional telematics data to enhance and supplement the collected information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional telematics data pathways are used to collect vehicle information, then data collection is straightforward for standardized protocols, but vehicle information becomes inaccessible when manufacturers use proprietary messages without decoding instructions
Solution Approach 1:
The patent introduces an image processing unit as an intermediary component that captures images of visual data sources (dashboards, displays) and extracts vehicle information from them. This intermediary pathway bypasses the need for direct communication with proprietary ECUs, allowing access to vehicle information that would otherwise be inaccessible through conventional telematics pathways.
Solution Approach 2:
The system creates visual copies of vehicle information by capturing images of dashboard displays and instruments. Instead of directly accessing the proprietary digital data from ECUs, the system photographs the visual representation of the information and processes these images to extract the underlying vehicle parameters, effectively copying the information in an alternative format.
2Loss of information
If a camera and image processing unit are added to extract vehicle information from visual data sources, then previously inaccessible vehicle information can be collected, but device complexity increases
Solution Approach 1:
The image processing unit serves multiple functions: it captures images of various visual data sources (dashboards, displays, instruments), processes different types of visual information (text, graphs, indicators), and extracts diverse vehicle parameters (speed, temperature, fuel level, battery state). This multi-functional component adds comprehensive data collection capability without requiring separate specialized systems for each function.
3Adaptability or versatility
If image processing is used to extract vehicle information from visual data sources, then data collection can bypass proprietary communication protocols, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by capturing images of visual data sources proactively, before the information is needed. The image processing unit continuously monitors and stores visual information from dashboards and displays, so when vehicle data is required, the processing has already been initiated or completed, reducing the actual extraction time and enabling faster response to data requests.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods for vehicle data collection by image analysis are provided. An example method involves positioning a camera in a vehicle to be pointed toward a field of interest in the vehicle, capturing an image of the field of interest with the camera, identifying a region of interest in the image that is expected to convey vehicle information, and running an image processing model over the region of interest to extract vehicle information from the image.