ML Codebook Data Compaction for Faster Blockchain Validation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Blockchain technology faces challenges with high energy consumption and network congestion due to large data throughput and storage requirements, which hinder its adoption and slow down mining processes.

Innovation Solution

A distributed node-based data compaction system using machine learning to generate codebooks for compacting data, implemented on existing or new blockchain protocols, reducing storage needs and increasing data packet speed and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional blockchain data transmission and storage methods are used, then data integrity and consensus are maintained, but network congestion and energy consumption increase due to large data throughput requirements

Engineering Contradiction:
Improvedata integrityVSAvoidenergy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential information from blockchain data by using machine learning to identify and retain critical features while removing redundant data. This extraction approach maintains data integrity for consensus validation while significantly reducing the volume of data that needs to be transmitted and stored across the network, thereby lowering energy consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms blockchain data from its original format into a compacted representation by changing key parameters such as data structure, encoding methods, and storage format. Machine learning models learn optimal parameter transformations that preserve essential information while reducing data size, enabling efficient transmission and storage without compromising consensus reliability.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If traditional blockchain data transmission methods are used, then complete data is transmitted for validation, but network speed and transfer rates decrease due to large data volumes

Engineering Contradiction:
Improvevalidation accuracyVSAvoidnetwork transfer rate
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent creates compacted copies of blockchain data using machine learning-generated codebooks that represent the essential information content. These compacted copies are transmitted across the network instead of full data blocks, maintaining validation accuracy while dramatically increasing network transfer rates. Nodes can validate consensus using these compacted representations.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary data compaction using machine learning models before data transmission. The codebooks are pre-trained and prepared in advance, allowing rapid compaction of incoming data into compacted representations that can be quickly transmitted and validated, thereby improving network speed without sacrificing validation accuracy.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If traditional blockchain storage methods are used, then complete blockchain history is preserved, but storage capacity requirements become prohibitively large

Engineering Contradiction:
Improvehistorical data preservationVSAvoidstorage capacity
Core Design Contradiction:
ReliabilityVSVolume of stationary object

Solution Approach 1:

The patent extracts essential historical information from the complete blockchain data using machine learning codebooks. By identifying and retaining only the critical features and patterns from historical blocks while removing redundant information, the system preserves the essential historical record needed for consensus validation while reducing storage requirements by significant factors.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges multiple blockchain data representations into a compacted form by combining original data with machine learning-generated codebooks. This merging creates a unified storage structure that maintains historical integrity through the codebook references while physically occupying minimal storage space, as the codebooks serve as compacted proxies for the full historical data.

Inventive Principle:
Principle #5Merging (Combining)

4Quantity of substance

If data compression is applied to blockchain data, then storage and transmission size are reduced, but mining speed and validation timing are slowed down

Engineering Contradiction:
Improvedata sizeVSAvoidmining speed
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent performs preliminary compaction using pre-trained machine learning codebooks before the mining and validation processes. This preliminary action prepares the data in an optimized format that requires less computational processing during mining operations, thereby maintaining or even improving mining speed while achieving data size reduction. The codebooks are prepared in advance so no additional processing time is required during critical mining operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional mechanical data processing and compression methods with machine learning-based compaction. The ML models learn optimal compaction strategies that are computationally more efficient than conventional compression algorithms, enabling rapid compaction and decompression operations that do not slow down mining and validation processes. The substitution of ML-based methods for traditional mechanical processing maintains productivity while reducing data volume.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12381574B2System and method for distributed node-based data compaction
Publication Date: 2025.08.05 ATOMBEAM TECH INC
  • US12381574B2 patent drawing
  • US12381574B2 patent drawing
  • US12381574B2 patent drawing

AI summary

A system and method for distributed node-based data compaction. The system uses machine learning on data chunks to generate codebooks which compact the data to be stored, processed, or sent with a smaller data profile than uncompacted data. The system uses a data compaction in an existing blockchain fork or implemented in a new blockchain protocol from which nodes that wish to or need to use the blockchain can do so with a reduced storage requirement. The system uses network data compaction across all nodes to increase the speed of and decrease the size of a blockchain's data packets. The system uses data compaction firmware to increase the efficiency at which mining rigs can computationally validate new blocks on the blockchain. The system can be implemented using any combination of the three data compaction services to meet the needs of the desired blockchain technology.