Automatic Unit Conversion in Data Stream Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The variability in units of measurement across different systems, such as the Imperial and Metric systems, poses a challenge in data processing, leading to errors when incorrect units are mixed during calculations, particularly in data stream processing where conversions are necessary for proper comparison or aggregation of physical quantities like temperature or length.
Innovation Solution
A method for data stream processing that automatically converts units of measurement using predefined mappings and operators, ensuring that input data streams are transformed to match expected types, allowing for accurate processing and output in desired units, utilizing techniques like base, full, and ring mappings within a data stream processing system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If automatic unit conversion is implemented during data stream processing, then measurement precision and calculation accuracy are improved, but device complexity increases due to the need for conversion mappings and operators
Solution Approach 1:
The patent introduces conversion operators as intermediary components that automatically handle unit transformations. These operators act as mediators between data streams with different units, enabling accurate conversions without requiring complex manual intervention. The conversion operators are integrated into the data stream processing pipeline, providing automated unit handling while maintaining system manageability through standardized conversion interfaces.
2Reliability
If unit conversion operators are added to process data streams, then reliability of calculations is improved, but device complexity increases
Solution Approach 1:
The patent performs unit conversion as a preliminary action before data processing operations. By converting units upfront based on expected input types and operator requirements, the system ensures that subsequent processing operations receive data in the correct format, preventing calculation errors and improving reliability. This preliminary conversion approach separates the conversion logic from the processing logic, making the system more robust without significantly increasing overall complexity.
3Device complexity
If manual unit conversion is performed, then device complexity is reduced, but productivity decreases due to time-consuming conversion processes
Solution Approach 1:
The patent implements self-service unit conversion where the system automatically detects and converts units based on metadata about input data streams and operator expectations. The conversion operators autonomously handle unit transformations without requiring manual intervention, thereby maintaining system simplicity while significantly improving processing throughput. The self-service mechanism uses predefined conversion mappings and runtime type checking to perform conversions efficiently as part of the normal data stream processing flow.
Data Source
AI summary
Data streams are received for processing by a query. The query is associated with expected input data stream types and expected output data stream types. The received data streams are evaluated to determine if they correspond to the expected data stream types. If the received data stream types define data for a physical quantity that is defined in a unit of measure that is not the expected unit of measure, then unit conversion is required. Predefined mappings are utilized for performing required unit conversions and an optimal solution for conversion is determined. The unit conversions are performed automatically by unit conversion operators that are integrated within the process of generating of a runnable query. The runnable query is deployed and executed to generate result output streams that match the expected output stream type.