Image Signal Processor Internal Buffer for AR Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in accurately detecting a device's position with sufficient frequency while conserving computing resources and power, particularly in augmented reality (AR) and virtual reality (VR) applications on mobile devices with limited resources.
Innovation Solution
An image signal processor is designed to obtain and compress input data from a camera, generating data points for localization and mapping without the need for external memory processing, thereby reducing computational load and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image data is processed externally with high computational power, then localization accuracy is improved, but power consumption and computational load increase
Solution Approach 1:
The patent combines the image signal processor with the localization and mapping functions by integrating a buffer memory within the ISP that can store compressed image data. This merging eliminates the need for external memory access and allows localization processing to occur within the ISP itself, resolving the contradiction by achieving accurate localization without the power overhead of external processing.
Solution Approach 2:
The patent introduces a buffer memory as an intermediary component within the ISP that temporarily stores compressed image data. This buffer acts as a mediator between the compression module and the localization module, enabling efficient data transfer without requiring power-intensive external memory access, thus maintaining localization accuracy while reducing power consumption.
2Quantity of substance
If image data is compressed, then memory usage is reduced, but processing time increases
Solution Approach 1:
The patent applies compression to the image data before it is stored in the buffer memory within the ISP. By performing preliminary compression, the system reduces the volume of data that needs to be processed and stored, thereby reducing memory usage without significantly impacting overall processing time since the compression occurs in the data flow path before localization processing.
3Productivity
If external memory is used for processing, then computational resources are available, but access time and power consumption increase
Solution Approach 1:
The patent merges the buffer memory for image data storage directly into the image signal processor, eliminating the need for external memory access. This integration allows the ISP to access image data directly from its internal buffer, significantly reducing memory access time and power consumption while maintaining sufficient computational resources for localization and mapping operations.
Data Source
AI summary
An image signal processor, comprising an input module for obtaining input data from a camera, whereby the camera is arranged to capture a representation of a real-world environment. The image signal processor further comprises at least one adjustment module for compressing the input data and producing compressed input data, and a localization and mapping module arranged to generate one or more data points from the compressed input data. The image signal processor also comprises an output module for outputting at least the one or more data points.