Edge Metadata Conversion for Real-Time Unstructured Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently processing and analyzing unstructured data, particularly in real-time data processing scenarios, such as video data, where existing methods are inefficient and laborious, and existing methods fail to address these challenges.
Innovation Solution
A data processing solution where unstructured data is converted into structured metadata using a data conversion strategy, with the conversion occurring at edge computing nodes, reducing server workload and enabling real-time data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If unstructured data is stored and processed on edge nodes, then data processing capability is improved, but data retrieval efficiency deteriorates due to laborious manual searching
Solution Approach 1:
The patent applies preliminary action by automatically generating metadata from unstructured data at the edge nodes before data retrieval operations. The system pre-processes video and audio data to create structured metadata including timestamps, locations, and event types, which enables efficient subsequent searches without manual intervention.
Solution Approach 2:
The patent introduces metadata as an intermediary between unstructured data and search queries. This metadata layer acts as a mediator that translates complex unstructured data into searchable structured information, allowing efficient retrieval without directly searching the raw unstructured data.
2Loss of energy
If data conversion strategy is implemented at edge computing nodes, then server computing load is reduced, but system complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the data processing system into edge computing nodes and central server components. The edge nodes handle local data conversion and metadata generation, while the server focuses on higher-level processing. This segmentation reduces the computing load on the server and distributes complexity across multiple independent units.
Solution Approach 2:
The patent implements self-service by enabling edge computing nodes to autonomously convert unstructured data into metadata using embedded conversion strategies. The edge nodes independently process their local data without requiring constant server intervention, reducing server workload and enabling self-sufficient edge processing.
Data Source
AI summary
Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for data processing. The method may include receiving a data conversion strategy from a server. The method may further include determining, in response to receiving unstructured data from a field device, metadata of the unstructured data based on the received data conversion strategy to form a set of metadata. In addition, the method may include transmitting at least a part of the set of metadata to the server. According to embodiments of the present disclosure, edge computing can be performed on unstructured data, which not only enables timely processing of monitoring data, but also reduces computing load on the side of the server, thereby improving the user experience.


