Key-Value Data Processing via Set Operations and Functions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems face difficulties in performing complex queries and operations directly on key-value pairs, requiring multiple queries and set operations to manipulate values.
Innovation Solution
A data processing apparatus and method that generates new key-value pairs by applying set operations to keys and functions to values, enabling direct manipulation and processing of key-value pairs through a processor connected to a storage unit and interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users perform set operations and work on values of key-value pairs, then the desired data processing can be achieved, but users have to perform various queries and set operations at first, which increases operational complexity
Solution Approach 1:
The patent merges the set operation and value processing into a single integrated operation. The processor applies both the set operation on keys and the function on values simultaneously in one execution step, rather than requiring separate queries and operations. This is achieved by the processor generating new key-value pairs where new keys result from set operations on original keys and new values result from applying functions to original values, all in one processing pass.
Solution Approach 2:
The processing unit is designed to perform multiple functions simultaneously: it executes set operations on keys, applies arbitrary functions to values, and generates new key-value pairs all within a single operational framework. This multi-functional capability allows the system to handle complex data processing tasks that would otherwise require multiple separate operations, thereby simplifying user interaction while maintaining computational power.
2Productivity
If users perform multiple queries and set operations to manipulate values, then the desired processing can be achieved, but the processing time increases
Solution Approach 1:
The system performs preliminary organization of key-value pairs in a structured format that enables simultaneous processing. By maintaining keys and values in associated pairs within the storage unit, the system prepares the data structure in advance to allow the processor to apply set operations and functions in a single pass without requiring multiple sequential queries, thus reducing processing time.
Solution Approach 2:
The processor continuously processes key-value pairs by applying set operations to keys and functions to values in an uninterrupted sequence. Rather than pausing between queries or operations, the system maintains continuous processing flow through the stored key-value pairs, maximizing productivity while minimizing idle time and overall processing duration.
3Adaptability or versatility
If the system stores key-value pairs for flexible data representation, then different kinds of information can be stored, but direct manipulation of values becomes difficult
Solution Approach 1:
The processor acts as an intermediary that bridges the flexible storage structure and the manipulation operations. It receives set operations and functions as input, applies them to the stored key-value pairs, and produces new key-value pairs as output. This intermediary processing layer enables direct manipulation of values while preserving the flexible key-value storage structure, as the processor translates high-level operations into the appropriate manipulations of stored data.
Data Source
AI summary
Data processing apparatuses and data processing methods are provided. The data processing apparatus includes a storage unit, an interface, and a processor. The storage unit stores a first key-value set including a plurality of first key-value pairs. Each of the first key-value pairs has a first key and a first value. The interface receives an instruction regarding a set operation and a function. The processor generates a plurality of second keys by applying the set operation to the first keys. Each of the second keys includes at least one of the first keys. The processor generates a second value for each of the second keys by applying the function to at least one datum corresponding to the at least one first key comprised in the second key. Each second key and the corresponding second value form a second key-value pair and the second key-value pairs form a second key-value set.