Fragmented Image Data Format Identification via Continuity Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing methods are inefficient in identifying the format of byte-aligned integer image/sensor data fragments without relying on headers or other data, leading to suboptimal processing and storage strategies.
Innovation Solution
The method involves determining continuity properties in the input data to identify breakpoints and format characteristics, using a fitting penalty function to assess representation size, group size, and alignment, and employing dynamic programming to assign format identifiers and segment boundaries, allowing for efficient format identification in byte-aligned data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If indiscriminate processing is used for data fragments of different formats, then processing simplicity is maintained, but processing efficiency deteriorates
Solution Approach 1:
The patent segments data fragments into fixed-size chunks and processes each chunk independently through format identification and optimization steps, enabling efficient handling of diverse formats while maintaining systematic processing simplicity
Solution Approach 2:
The patent changes processing parameters dynamically based on identified data format characteristics (such as integer vs. floating-point, endianness, alignment requirements), allowing optimized processing for each format type while maintaining a unified processing framework
2Adaptability or versatility
If format identification without headers is implemented, then data fragment autonomy is improved, but computational complexity increases
Solution Approach 1:
The patent replaces complex statistical analysis and machine learning approaches with a deterministic algorithm that uses bit-position analysis and continuity property detection, significantly reducing computational complexity while maintaining format identification accuracy
Solution Approach 2:
The format identification algorithm extracts all necessary format characteristics (data type, endianness, alignment, group size) directly from the data fragment content itself without requiring external headers or metadata, enabling autonomous processing
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Format identification for fragmented data is disclosed. In some embodiments, an input stream of information that includes a continuity property is received. A format identifier of at least a portion of the stream is determined, wherein the format identifier includes a data representation size, a group size, and an alignment that is consistent with the continuity property. The stream of information is compressed using a compression technique selected based on the format identifier to produce a compressed stream, and the compressed stream is stored.