Information Processing System Dynamic Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In production sites, efficiently collecting and storing data while managing increasing data volumes and analysis processing loads, especially when common identification information is assigned to associated data, poses challenges due to potential storage and processing inefficiencies.
Innovation Solution
An information processing system that includes a transmission unit, a database, and a data management unit, which transmits data with identification information and topics, allowing for efficient storage by associating values with existing identification information, automatically adding new storage destinations or columns as needed, and executing operations on collected values, thereby facilitating flexible data management and utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If common identification information is assigned to associated data for data association, then data association capability is improved, but storage amount and analysis processing load increase
Solution Approach 1:
The patent extracts the identification information from the data storage structure itself and places it in the message header for transmission. This separates the identification function from the data storage, allowing the database to store only the actual data values without duplicating identification information across multiple records, thereby reducing storage requirements while maintaining data association capability.
Solution Approach 2:
The patent creates a universal identification mechanism where a single identification value in the message header serves multiple purposes: it identifies the data source, the data type, and enables data association across different transmission instances. This multi-functional identification approach eliminates the need for separate identification fields in each data record, reducing overall storage requirements.
2Reliability
If common identification information is assigned to associated data for data association, then data association capability is improved, but analysis processing load increases
Solution Approach 1:
The patent extracts identification information from the data payload and places it in the message header, separating the identification function from data processing. This allows the system to process data values without repeatedly analyzing identification information that is already established in the header, reducing analysis processing load while maintaining data association capability.
Solution Approach 2:
The patent performs identification matching and data association in advance during the data reception and initial processing stage, rather than during subsequent analysis operations. By establishing the identification associations early when data is first ingested into the database, the system eliminates the need for repeated identification analysis during data retrieval and processing operations.
3Adaptability or versatility
If database structure is explicitly changed to accommodate new data types, then data storage capability is improved, but system complexity and reconfiguration requirements increase
Solution Approach 1:
The patent implements a dynamic database structure where data is stored in a flexible format that can accommodate new data types without requiring structural reconfiguration. The system uses a schema-less or flexible schema approach that allows new data types to be integrated by simply inserting data with appropriate type identifiers in the message header, rather than requiring pre-defined database schemas and explicit structural changes.
Solution Approach 2:
The patent changes the data type parameter representation from fixed schema definitions to dynamic type identifiers included in the message header. This allows the system to adapt to new data types by changing the type parameter values in the header rather than changing the database structure itself, enabling flexible data storage without increasing system complexity.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
An information processing system (1) includes: a transmission unit (200, 250) configured to transmit transmission data (50) including data (54) including one or more values (58) and identification information (56) associated with the one or more values and a topic (52) indicating an attribute of the data; a database (160, 162) configured to store data for each topic; and a data management unit (152) configured to specify a storage destination of data based on the topic included in the transmission data and stores the data included in the transmission data in the specified storage destination of the data. When a value associated with same identification information as the identification information included in the transmission data is already stored in the database, the data management unit stores one or more values included in the data included in the transmission data in association with the identification information already stored in the database.