Data Replacement Apparatus for High-Speed Microaggregation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing techniques for microaggregation of large-scale data are limited by the requirement that all data must fit into a primary storage device, making it impossible to process large-scale data that exceeds the capacity of the primary storage device.

Innovation Solution

A data replacement apparatus that includes an attribute value set retrieval unit, a median computation unit, and a division determination unit, which allows for the retrieval and processing of grouped attribute values into either the primary or secondary storage device, enabling microaggregation of large-scale data even when it exceeds the primary storage capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If all data is loaded into the primary storage device for microaggregation processing, then processing speed is improved, but the method becomes inapplicable when data size exceeds primary storage capacity

Engineering Contradiction:

Improvemicroaggregation processing speedVSAvoidapplicability to large-scale data

Core Design Contradiction:

SpeedVSAdaptability or versatility

Solution Approach 1:

The patent divides the large-scale data into multiple groups that can be processed separately. The attribute value set retrieval unit divides the attribute value set into multiple groups, and the median computation unit computes medians for each group separately. This segmentation allows processing of data larger than primary storage capacity by handling manageable chunks in memory while storing intermediate results in secondary storage.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of storage hierarchy by utilizing both primary storage device (for active processing) and secondary storage device (for intermediate and final results). This dimensional expansion from single-storage to multi-storage architecture enables the system to handle arbitrarily large datasets by leveraging the combined capacity of multiple storage devices.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If a small-capacity primary storage device is used, then system resource requirements are reduced, but the ability to process large-scale data is lost

Engineering Contradiction:

Improveprimary storage device capacityVSAvoidlarge-scale data processing capability

Core Design Contradiction:

Quantity of substanceVSProductivity

Solution Approach 1:

The patent segments the large dataset into multiple attribute value sets that fit within the limited primary storage capacity. The division determination unit divides the attribute value set into multiple groups based on the primary storage device's capacity, ensuring each group can be loaded and processed completely in memory. This allows the system to process large-scale data by handling smaller segments sequentially.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces the secondary storage device as an intermediary between the limited primary storage and the large-scale data. Intermediate results from median computations are stored in the secondary storage device, allowing the system to accumulate processing results without requiring all data to reside simultaneously in the primary storage device.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Quantity of substance

If data is divided into multiple groups for processing, then memory requirements are reduced, but additional processing overhead is introduced

Engineering Contradiction:

Improvememory usageVSAvoidprocessing complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent systematically segments data into groups based on primary storage capacity constraints. The attribute value set retrieval unit and division determination unit work together to create optimally-sized groups that maximize memory utilization while minimizing the number of groups. This structured segmentation approach balances memory efficiency with processing complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts processing parameters including group size, number of divisions, and storage allocation based on the primary storage device's capacity. The system changes these parameters adaptively to optimize the balance between memory usage and processing complexity for different data sizes and storage configurations.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12339980B2Data replacement apparatus, data replacement method, and program

Publication Date: 2025.06.24 NT T INC

AI summary

A data replacement apparatus that can perform microaggregation of large-scale data at high speed using only a primary storage device of a small capacity. The data replacement apparatus includes an attribute value set retrieval unit that retrieves a grouped attribute value set into a primary storage device when a size of the grouped attribute value set is equal to or smaller than a predefined size and retrieves the grouped attribute value set into a secondary storage device when the size of the grouped attribute value set is larger than the predefined size. Further, there is a median computation unit that computes a median of the grouped attribute value set at the primary storage device or at the secondary storage device and a division determination unit that sets respective ones of the two attribute value sets formed by the division as new groups.