Camera Preview Texture Preprocessing for Low-CPU ADAS Image Flow
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing AR navigation systems, the CPU needs to allocate an additional thread to monitor camera data, leading to increased memory consumption and CPU resource occupation, which can cause delays in sending image data to the ADAS, resulting in hysteresis in image rendering and affecting user experience.
Innovation Solution
The method involves creating a pre-created drawing surface window by the CPU to obtain and convert the current camera data frame into a preview texture, which is then sent to the GPU for processing, eliminating the need for the CPU to assign an additional thread for camera data monitoring.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the CPU assigns an additional thread to monitor camera data for preprocessing, then the image preprocessing can be performed, but the memory consumption of the CPU increases and preprocessing speed decreases
Solution Approach 1:
The patent extracts the image preprocessing function from the CPU and assigns it to the GPU. The CPU no longer needs to allocate additional threads for camera data monitoring and preprocessing, thereby reducing memory consumption and improving preprocessing speed. The GPU handles the preprocessing tasks independently through its own memory and processing units.
Solution Approach 2:
The patent introduces a camera data callback function as an intermediary mechanism. This callback function automatically triggers when new camera data is available, eliminating the need for the CPU to continuously monitor the camera. The callback serves as a mediator between the camera and the preprocessing system, enabling efficient data transfer without占用CPU resources.
2Productivity
If the CPU performs image preprocessing, then the image data can be processed, but CPU resources are occupied causing delays in sending data to ADAS
Solution Approach 1:
The patent extracts the preprocessing function from the CPU to the GPU, allowing the CPU to focus on sending processed data to the ADAS system. This separation eliminates the resource conflict between preprocessing and data transmission, ensuring timely data delivery to the ADAS without delays.
Solution Approach 2:
The patent replaces the CPU-based preprocessing mechanism with a GPU-based parallel processing system. The GPU's architecture, designed for handling large amounts of pixel data simultaneously, significantly accelerates preprocessing speed and reduces the time required before data can be sent to the ADAS system.
3Reliability
If the CPU allocates additional thread for camera monitoring, then continuous camera data processing is achieved, but system resource efficiency decreases
Solution Approach 1:
The patent uses a camera data callback function as an intermediary that automatically activates when new camera frames are captured. This mechanism ensures continuous processing capability without requiring the CPU to allocate dedicated monitoring threads, thereby maintaining reliability while improving resource efficiency.
Solution Approach 2:
The system implements self-service through the callback mechanism, where the camera system automatically notifies the preprocessing system when new data is available. This eliminates the need for active CPU monitoring, allowing the system to maintain continuous operation with minimal resource allocation.
Data Source
Figure 1~2
Figure 3~4
AI summary
The disclosure discloses a method for reprocessing an image. A current data frame captured through a camera is obtained (S101) by a pre-created drawing surface window called by a central processing unit (CPU) in response to a preview activating instruction of the camera. The current data frame is converted (S102) into a preview texture corresponding to the current data frame by the pre-created drawing surface window. The preview texture corresponding to the current data frame is sent (SI03) to a graphics processing unit (GPU). The preview texture corresponding to the current data frame is processed by the GPU. The preview texture processed is sent by the CPU to an advanced driving assistance system (ADAS).