Custom Workflow System for Multi-Camera Data Curation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack flexibility and efficiency in processing and analyzing data from cameras and sensors, leading to wasted storage and limited machine assistance in interpreting image data, with application-specific software requirements and difficulty in sharing or building upon analysis performed by other applications.
Innovation Solution
A custom workflow system using SceneMarks and SceneData, which filters and analyzes raw sensor data to generate metadata, enabling higher-level understanding and presentation of contextual information, and allowing for dynamic configuration of camera operations based on detected events, utilizing a multi-layer technology stack with AI and machine learning for distributed processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If raw video data is captured and stored from multiple cameras, then more complete event information is available, but storage space is wasted and data processing becomes inefficient
Solution Approach 1:
The patent extracts only the essential event information from raw video data by detecting specific trigger conditions (such as motion, object detection, or scene changes) and capturing only the relevant video segments around these events. This selective extraction approach maintains event information completeness while dramatically reducing storage space consumption compared to storing all raw video data continuously.
Solution Approach 2:
The system performs preliminary analysis of video streams in real-time using detection algorithms to identify potential events before storing them. By pre-processing and filtering video data to identify only those segments that meet predefined criteria, the system avoids storing unnecessary data while ensuring important events are captured, thus resolving the contradiction between information completeness and storage efficiency.
2Measurement precision
If application-specific software is built to process camera data, then processing accuracy is improved, but device complexity and development time increase
Solution Approach 1:
The patent introduces a standardized intermediary interface layer that translates between raw camera data and application-specific processing requirements. This intermediary layer provides uniform data structures and standardized processing functions that applications can use without building custom low-level processing software, thereby maintaining processing accuracy while reducing overall system complexity and development effort.
Solution Approach 2:
The system implements a universal processing framework that can handle multiple application-specific tasks through a common set of tools and interfaces. Instead of requiring separate custom software for each application type, the framework provides multi-functional capabilities for event detection, data filtering, and information extraction that can be configured for different applications, thus reducing software complexity while maintaining processing accuracy.
3Loss of information
If human monitoring is used to interpret camera data, then meaningful insights are obtained, but time consumption and operational costs increase
Solution Approach 1:
The patent implements self-service processing where the system automatically detects events, extracts relevant information, and generates insights without requiring human intervention. By using automated detection algorithms and intelligent data processing, the system performs the same function that would otherwise require human monitors, thereby maintaining insight quality while dramatically reducing time consumption and operational costs.
Solution Approach 2:
The system replaces the mechanical human monitoring process with automated computational processes. Instead of human eyes and brains analyzing video streams, the patent uses computer vision algorithms, machine learning models, and data processing systems to automatically interpret camera data, generate insights, and trigger appropriate responses, thus eliminating time consumption associated with human monitoring while maintaining or improving insight quality through advanced algorithms.
4Loss of information
If sophisticated AI processing is implemented, then image understanding capability is improved, but processing time and computational resources increase
Solution Approach 1:
The patent segments the image processing task into multiple stages: preliminary filtering using fast algorithms to identify potential events, followed by sophisticated AI processing only on the filtered subset of data that meets trigger criteria. This segmentation approach applies heavy AI processing only where necessary, maintaining high image understanding capability for relevant events while reducing overall processing time and computational resource consumption by avoiding unnecessary AI analysis of all data.
Data Source
AI summary
A multi-layer technology stack includes a sensor layer including image sensors, a device layer, and a cloud layer, with interfaces between the layers. A method to curate different custom workflows for multiple applications include the following. Requirements for custom sets of data packages for the applications is received. The custom set of data packages include sensor data packages (e.g., SceneData) and contextual metadata packages that contextualize the sensor data packages (e.g., SceneMarks). Based on the received requirements and capabilities of components in the technology stack, the custom workflow for that application is deployed. This includes a selection, configuration and linking of components from the technology stack. The custom workflow is implemented in the components of the technology stack by transmitting workflow control packages directly and/or indirectly via the interfaces to the different layers.


