Event Data Timestamp Compression for Faster Stream Processing

The patent segments the timestamp representation into two parts: a reference timestamp that can be shared across multiple events, and a time difference value that represents the offset from the reference. This segmentation allows the system to store only the difference values (which are smaller) while maintaining the ability to reconstruct complete timestamps when needed, thus reducing storage space while preserving time information integrity.

The patent changes the parameter representation from absolute timestamps to relative time differences. By storing time differences (Δt) instead of complete timestamps, the patent reduces the number of bits required per event while maintaining the ability to recover absolute time information through addition of the reference timestamp, thereby resolving the contradiction between storage efficiency and information integrity.

The patent segments the timestamp processing into a reference component and a difference component. During processing, the system can work with the smaller difference values directly for operations like sorting and filtering, only reconstructing complete timestamps when absolutely necessary. This segmentation accelerates processing speed while maintaining time information integrity through the preserved reference timestamp.

The patent transforms the time parameter from absolute timestamps to relative time differences, which are computationally more efficient to handle. Operations such as comparing event times, detecting temporal patterns, and sorting become faster when working with small difference values rather than large absolute timestamp values, thereby improving processing speed while preserving the ability to recover exact timing information.

The patent applies preliminary action by pre-selecting and storing a reference timestamp that serves as a baseline for subsequent events. This reference timestamp is established beforehand and reused for multiple events, allowing the system to store only time differences rather than complete timestamps. This preliminary setup simplifies the overall structure compared to storing full timestamps for every event, reducing storage space without significantly increasing processing complexity.

The patent uses a copying mechanism where the reference timestamp is effectively copied and applied to multiple events through simple addition of time differences. Instead of storing and processing complete timestamp values for each event, the system copies the reference timestamp concept and applies it efficiently to generate absolute times when needed, reducing storage requirements while maintaining processing simplicity.