Mobile Device Sensor Data Embedding in Digital Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices face challenges in reliably communicating sensor data due to the risk of digital images being dropped when the co-processor is overloaded, leading to incomplete data sets for functions like trajectory determination and map generation.
Innovation Solution
A processor configures digital images to include sensor data from previous timeframes, allowing redundant data to be used in case of data loss, and sends IMU data via a low-latency side-channel for timely access by the application processor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the co-processor includes sensor data from multiple timeframes in each digital image to ensure data availability, then the reliability of data communication is improved, but the device complexity and processing overhead increase
Solution Approach 1:
The co-processor proactively collects and stores sensor data from multiple previous timeframes in advance, embedding this redundant data into current digital images before transmission. This preliminary action ensures that if current data is lost, previously collected data is already available for recovery, resolving the reliability-complexity contradiction by preparing backup data beforehand rather than reacting to data loss
Solution Approach 2:
The system embeds redundant sensor data from previous timeframes into each digital image as a protective measure against data loss. This cushioning approach ensures that even if the current data transmission fails or data is dropped, the embedded historical data provides a safety buffer that maintains functionality for time-sensitive applications
2Adaptability or versatility
If the co-processor processes and packages sensor data from multiple sensors into unified digital images, then the data integration is improved, but the processing time and potential data loss risk increase due to overload
Solution Approach 1:
The co-processor merges sensor data from multiple different sensors (e.g., IMU, cameras, microphones) into unified digital image structures, creating an integrated data format that can be processed by a single application processor. This merging improves data integration capability while the embedded redundant data from previous timeframes compensates for any potential transmission losses
Solution Approach 2:
The system creates copies of sensor data from previous timeframes and embeds these copies within current digital images. This copying mechanism ensures that even if the primary data transmission is lost or corrupted, redundant copies are available for recovery, maintaining reliability despite the complexity of processing multiple sensor inputs
3Reliability
If the system embeds redundant sensor data from previous timeframes in each digital image, then the data loss mitigation is improved, but the data structure size and bandwidth requirements increase
Solution Approach 1:
The system nests redundant sensor data from previous timeframes within the structure of current digital images, embedding historical data packets inside the image data format. This nesting approach allows efficient packaging of multiple data types (current sensor data, historical sensor data, image data) in a hierarchical structure that optimizes bandwidth utilization while providing robust data loss mitigation
Data Source
AI summary
Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.