Custom Workflow System for Multi-Camera Data Curation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack flexibility and efficiency in processing and analyzing data from cameras and sensors, leading to wasted storage and limited machine assistance in interpreting image data, with application-specific software requirements and difficulty in sharing or building upon analysis performed by other applications.

Innovation Solution

A custom workflow system using SceneMarks and SceneData, which filters and analyzes raw sensor data to generate metadata, enabling higher-level understanding and presentation of contextual information, and allowing for dynamic configuration of camera operations based on detected events, utilizing a multi-layer technology stack with AI and machine learning for distributed processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If raw video data is captured and stored from multiple cameras, then more complete event information is available, but storage space is wasted and data processing becomes inefficient

Engineering Contradiction:
Improveevent information completenessVSAvoidstorage space consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential event information from raw video data by detecting specific trigger conditions (such as motion, object detection, or scene changes) and capturing only the relevant video segments around these events. This selective extraction approach maintains event information completeness while dramatically reducing storage space consumption compared to storing all raw video data continuously.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary analysis of video streams in real-time using detection algorithms to identify potential events before storing them. By pre-processing and filtering video data to identify only those segments that meet predefined criteria, the system avoids storing unnecessary data while ensuring important events are captured, thus resolving the contradiction between information completeness and storage efficiency.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If application-specific software is built to process camera data, then processing accuracy is improved, but device complexity and development time increase

Engineering Contradiction:
Improvedata processing accuracyVSAvoidsoftware complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a standardized intermediary interface layer that translates between raw camera data and application-specific processing requirements. This intermediary layer provides uniform data structures and standardized processing functions that applications can use without building custom low-level processing software, thereby maintaining processing accuracy while reducing overall system complexity and development effort.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements a universal processing framework that can handle multiple application-specific tasks through a common set of tools and interfaces. Instead of requiring separate custom software for each application type, the framework provides multi-functional capabilities for event detection, data filtering, and information extraction that can be configured for different applications, thus reducing software complexity while maintaining processing accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If human monitoring is used to interpret camera data, then meaningful insights are obtained, but time consumption and operational costs increase

Engineering Contradiction:
Improveinsight qualityVSAvoidmonitoring time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent implements self-service processing where the system automatically detects events, extracts relevant information, and generates insights without requiring human intervention. By using automated detection algorithms and intelligent data processing, the system performs the same function that would otherwise require human monitors, thereby maintaining insight quality while dramatically reducing time consumption and operational costs.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replaces the mechanical human monitoring process with automated computational processes. Instead of human eyes and brains analyzing video streams, the patent uses computer vision algorithms, machine learning models, and data processing systems to automatically interpret camera data, generate insights, and trigger appropriate responses, thus eliminating time consumption associated with human monitoring while maintaining or improving insight quality through advanced algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Loss of information

If sophisticated AI processing is implemented, then image understanding capability is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveimage understanding capabilityVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent segments the image processing task into multiple stages: preliminary filtering using fast algorithms to identify potential events, followed by sophisticated AI processing only on the filtered subset of data that meets trigger criteria. This segmentation approach applies heavy AI processing only where necessary, maintaining high image understanding capability for relevant events while reducing overall processing time and computational resource consumption by avoiding unnecessary AI analysis of all data.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230305903A1Curation of custom workflows using multiple cameras, with ai to provide awareness of situations
Publication Date: 2023.09.28 SCENERA INC
  • US20230305903A1 patent drawing
  • US20230305903A1 patent drawing
  • US20230305903A1 patent drawing

AI summary

A multi-layer technology stack includes a sensor layer including image sensors, a device layer, and a cloud layer, with interfaces between the layers. A method to curate different custom workflows for multiple applications include the following. Requirements for custom sets of data packages for the applications is received. The custom set of data packages include sensor data packages (e.g., SceneData) and contextual metadata packages that contextualize the sensor data packages (e.g., SceneMarks). Based on the received requirements and capabilities of components in the technology stack, the custom workflow for that application is deployed. This includes a selection, configuration and linking of components from the technology stack. The custom workflow is implemented in the components of the technology stack by transmitting workflow control packages directly and/or indirectly via the interfaces to the different layers.