Random-Access Compacted Data Using Codebook Metadata

Solution Overview

Problem

The rapid growth of data storage demand exceeds the capacity to store it, and existing data compression methods, such as lossless and lossy compression, are inadequate, especially with multimedia data, leading to bottlenecks in data transmission and security concerns as quantum computing emerges.

Innovation Solution

A system and method utilizing a reference codebook, random-access engine, and data deconstruction engine enable random access to compacted data by encoding and decoding bits using a frequency table and location hints, allowing direct access to data without full file scanning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data is compacted to increase storage capacity, then storage efficiency is improved, but random access capability deteriorates

Engineering Contradiction:

Improvestorage capacityVSAvoidrandom access capability

Core Design Contradiction:

Quantity of substanceVSEase of operation

Solution Approach 1:

The patent applies preliminary action by pre-computing and storing metadata about the compacted data structure, including information about codebook organization and data segment locations. This allows the random-access engine to directly navigate to specific data portions without full decompression, as the structural information was prepared in advance during the compaction process

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary metadata layer between the compacted data and the access mechanism. This metadata includes information about data segments, their locations in the compacted file, and associated codebook references, enabling the random-access engine to interpret and navigate the compacted structure without fully decompressing it

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If full file decompression is performed to enable random access, then access capability is improved, but processing time and energy consumption worsen

Engineering Contradiction:

Improvedata access capabilityVSAvoidprocessing time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent extracts only the necessary portions of the compacted data for access rather than decompressing the entire file. The random-access engine uses metadata to identify and retrieve specific data segments, their associated codebooks, and relevant information, leaving the rest of the compacted data untouched

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the compacted data into distinct portions with associated metadata, allowing independent access to specific segments. Each segment can be accessed, decoded, and processed separately without affecting or requiring decomposition of other segments, enabling selective and efficient data retrieval

Inventive Principle:

Principle #1Segmentation

3Quantity of substance

If traditional compression methods are used to reduce data size, then storage efficiency is improved, but transmission bandwidth requirements worsen

Engineering Contradiction:

Improvedata sizeVSAvoidtransmission bandwidth

Core Design Contradiction:

Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-computing and storing metadata about the compacted data structure, including information about codebook organization and data segment locations. This allows the random-access engine to directly navigate to specific data portions without full decompression, as the structural information was prepared in advance during the compaction process

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary metadata layer between the compacted data and the access mechanism. This metadata includes information about data segments, their locations in the compacted file, and associated codebook references, enabling the random-access engine to interpret and navigate the compacted structure without fully decompressing it

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12468662B2System and method for providing randomly-accessible compacted data

Publication Date: 2025.11.11 ATOMBEAM TECH INC

AI summary

A system and method for random-access manipulation of compacted data files, utilizing a reference codebook, a random-access engine, a data deconstruction engine, and a data deconstruction engine. The system may receive a data query pertaining to a data read or data write request, wherein the data file to be read from or written to is a compacted data file. A random-access engine may facilitate data manipulation processes by accessing a reference codebook associated with the compacted data file, a frequency table used to construct the reference codebook, and data query details. A data read request is supported by random-access search capabilities that may enable the locating and decoding of the bits corresponding to data query details. A random-access engine facilitates data write processes. The random-access engine may encode the data to be written, insert the encoded data into a compacted data file, and update the codebook as needed.