Confidence Score Analytics for Partial Data in IoT
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In data collection systems, particularly in mobile and IoT environments, real-time analytics are hindered by incomplete data arrival, leading to inaccurate results due to the propagation of insufficient data, as existing systems wait for all data before processing, which is not feasible in all network conditions.
Innovation Solution
A system that calculates a confidence score for analytics results based on streamed data and streams these results along with the score to another apparatus, allowing for conditional processing only when the confidence score meets a predetermined threshold, thereby managing and recovering from insufficient data propagation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the system waits for all data to be collected before analytics is conducted, then measurement precision is improved, but productivity deteriorates due to inability to perform real-time analytics
Solution Approach 1:
The patent applies partial action by conducting analytics on the portion of data that has been collected so far, rather than waiting for complete data. The system performs analytics on partial datasets and generates interim results, which can then be updated as more data arrives. This allows real-time analytics to proceed with available data while maintaining the option to improve accuracy with additional data.
2Productivity
If the system proceeds with partial data received, then productivity is improved by enabling real-time analytics, but measurement precision deteriorates due to propagation of insufficient data
Solution Approach 1:
The patent implements feedback mechanisms where the system continuously monitors data collection progress and updates analytics results as new data arrives. The interim results from partial data are fed back into the analytics system, allowing for iterative refinement. This feedback loop enables the system to maintain real-time analytics capability while progressively improving accuracy as more complete data becomes available.
Solution Approach 2:
The system performs preliminary analytics on partial data to generate initial results before complete data is available. These preliminary analytics provide immediate insights that can be acted upon in real-time, while the system continues to collect data for subsequent refinement of the analytics results.
3Speed
If analytics is conducted on incomplete data, then speed is improved by reducing waiting time, but reliability deteriorates due to propagation of inaccurate results
Solution Approach 1:
The patent segments the analytics process into multiple stages: initial analytics on partial data to produce interim results, followed by subsequent updates as more data arrives. This segmentation allows the system to deliver results at different stages of data completeness, providing fast initial results that can be refined later, thus balancing speed and reliability.
Data Source
AI summary
The present disclosure discloses method and apparatus to manage insufficient data targeted for partially distributed and partially centralized analytics in mobile or internet of things (IoT) environment. The present disclosure also discloses method and apparatus to get more accurate data if sent data does not have enough accuracy to the certain analytics.