Sensor Data Field Interpretation for Unknown Vendor Formats
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems face challenges in interpreting sensor data from multiple vendors without pre-defined formats, as the definitions of sensor data fields are often unknown, making it difficult to understand the represented physical quantities and formats.
Innovation Solution
A data processing apparatus and method that includes a data acquisition unit, interpretation unit, output unit, estimating unit, and confirming unit to acquire, interpret, and output sensor data, even when field definitions are unknown, by estimating definitions based on sensor data characteristics such as variation patterns and physical addresses, and confirming these definitions with user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sensor data from multiple vendors is processed without pre-defined formats, then the system's adaptability and versatility are improved, but the difficulty of detecting and measuring field definitions increases
Solution Approach 1:
The system automatically analyzes sensor data to self-determine field definitions without requiring external documentation or manual configuration. The determination unit examines data patterns, ranges, and characteristics to autonomously identify what each field represents, enabling the system to adapt to different vendor formats independently.
Solution Approach 2:
The system changes the parameter of field definition from a static, pre-defined format to a dynamic, data-driven definition. By analyzing actual data characteristics such as value ranges, variation patterns, and temporal behavior, the system adapts field definitions to match the specific sensor data being processed.
2Productivity
If field definitions are determined automatically without user input, then the productivity and ease of operation are improved, but the measurement precision and reliability of field definition accuracy may worsen
Solution Approach 1:
The system incorporates feedback mechanisms where the determination unit continuously refines field definition based on analyzed data patterns. By monitoring data characteristics and adjusting definitions accordingly, the system improves accuracy over time while maintaining automated processing speed.
Solution Approach 2:
The system performs preliminary analysis of sensor data to establish initial field definitions before full processing begins. This preliminary action allows the system to prepare accurate definitions in advance, improving both the speed and accuracy of subsequent data processing operations.
3Loss of information
If all sensor data fields are interpreted with known definitions, then the loss of information is reduced, but the device complexity increases due to needing to handle unknown fields
Solution Approach 1:
The system extracts and separates known fields from unknown fields in the sensor data. By identifying and extracting fields with recognizable patterns and characteristics, the system can process these with high confidence while handling remaining unknown fields through automated determination, reducing overall complexity.
Solution Approach 2:
The determination process is segmented into multiple stages: initial data analysis, pattern recognition, field definition hypothesis generation, and verification. This segmentation allows the system to handle complexity in manageable steps while maintaining comprehensive data interpretation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A data processing apparatus is provided comprising a data acquisition unit configured to acquire sensor data of a sensor that is capable of measuring physical quantities of a measurement target, an interpretation unit configured to attempt to interpret, in accordance with a definition for each field of the sensor data, sensor data in the respective fields, and an output unit configured to output the sensor data interpreted by the interpretation unit for a field of which a definition is known, and to output the sensor data acquired by the data acquisition unit as is for a field of which a definition is unknown along with an indicator indicating unidentified. The data processing apparatus further comprises a confirming unit configured to later confirm a definition for at least one field among fields of which the definition is unknown.