Unified Sensor Image Data Structure for Mobile Device Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices face delays and synchronization issues when providing data from multiple sensors, such as IMUs and cameras, as they often transmit data separately, leading to inconsistencies and inefficiencies in processing.
Innovation Solution
Embedding sensor data within a digital image structure that includes image data, allowing for simultaneous transmission over a camera bus interface, ensuring that all data corresponds to the same instance in time and reducing delays by using a processor to generate a digital image that combines image and sensor data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If sensor data and image data are transmitted separately, then each data type can be processed independently, but delays and synchronization issues occur between different sensors
Solution Approach 1:
The patent combines sensor data and image data into a single unified data structure that is transmitted together. This merging ensures that data from multiple sensors (IMU, camera, etc.) are synchronized and correspond to the same time instance, eliminating delays while maintaining independent processing capability through the structured organization of data within the unified format.
2Device complexity
If data from multiple sensors is provided separately, then data structure complexity is reduced, but processing efficiency and time sensitivity deteriorate
Solution Approach 1:
The unified data structure is segmented into distinct fields and sections, with sensor data and image data organized in specific locations. This segmentation allows the data to maintain a structured, manageable format that improves processing efficiency while the overall unified structure ensures synchronization. The segmentation enables efficient parsing and processing without increasing actual complexity.
3Speed
If sensor data is embedded in digital image pixels, then data transmission speed increases, but the digital image structure becomes more complex
Solution Approach 1:
The patent embeds sensor data within the pixel structure of digital images, effectively nesting sensor information inside the image data structure. This nesting allows high-speed transmission through the camera bus interface while the nested organization maintains a manageable structure that can be efficiently parsed. The sensor data is embedded in a way that integrates with the existing image format without creating excessive complexity.
Data Source
AI summary
Methods and systems for providing depth data and image data to an application processor on a mobile device are described. An example method involves receiving image data from at least one camera of the mobile device and receiving depth data from a depth processor of the mobile device. The method further involves generating a digital image that includes at least the image data and the depth data. The depth data may be embedded in pixels of the digital image, for instance. Further, the method then involves providing the digital image to an application processor of the mobile device using a camera bus interface. Thus, the depth data and the image data may be provided to the application processor in a single data structure.