Connected Device Data Indexing for Query Speed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for data storage, retrieval, and sharing in connected device systems, such as home monitoring systems, are inefficient and insufficient, lacking in application design flexibility and data protection.
Innovation Solution
A framework that formats and stores data from connected devices, including surveillance cameras and sensors, by tagging and indexing the data, allowing for local querying and remote storage, with options for user-controlled access and encryption, utilizing specialized processing units and hardware for efficient data management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data from multiple connected devices is stored remotely in cloud-based storage, then data protection and security are improved, but data retrieval efficiency and access speed deteriorate
Solution Approach 1:
The patent segments data into two categories: indexed metadata (stored locally) and actual data content (stored remotely). The local index contains tags, time identifications, and chunk identifiers that enable rapid querying without retrieving full data from remote storage. This segmentation allows the system to maintain secure remote storage while achieving fast local query performance.
Solution Approach 2:
The system performs preliminary indexing of data chunks with tags and time identifications before actual data retrieval operations. By pre-processing and organizing data metadata locally, the system prepares the groundwork for efficient subsequent queries, avoiding the need to scan or retrieve entire remote data sets during query operations.
2Productivity
If an index of tags and time identifications is stored locally, then data querying efficiency is improved, but system complexity and memory requirements worsen
Solution Approach 1:
The patent extracts only the essential indexing information (tags and time identifications) from the full data sets and stores it locally, while leaving the bulk data content in remote storage. This extraction approach provides sufficient querying capability without the complexity of managing complete data sets locally.
Solution Approach 2:
The local index acts as an intermediary between query requests and remote data storage. Instead of directly querying remote storage for every operation, the system uses the local index as a mediator to quickly identify and retrieve only relevant data chunks, reducing system complexity compared to direct remote querying.
3Reliability
If user-controlled access and encryption are implemented, then data security is improved, but processing overhead and system performance worsen
Solution Approach 1:
The patent implements encryption selectively on data chunks rather than all data uniformly. By applying encryption only where necessary based on access control requirements, the system maintains strong security for sensitive data while reducing processing overhead for less sensitive information.
Data Source
AI summary
Techniques and constructs to facilitate data management can provide improved response time and space efficiency for time-series data such as from connected devices. The constructs may enable receiving a stream of time-series data comprising a plurality of objects and a time identification associated with each of the objects. One or more tags are associated with the objects. The constructs may also chunk the stream into a plurality of contiguous chunks, each including a plurality of objects, create an index associating the time identification and the one or more tags, transmit the chunks to a first, remote storage, and then store the index.