Scene-based Sensor API for Flexible Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current sensor technologies lack flexibility and efficiency in processing and utilizing data from cameras and other sensor devices, requiring custom software and low-level interfaces for specific applications, leading to limited use and high storage waste, especially in surveillance and automotive environments.
Innovation Solution
A Scene-based API that allows applications to specify SceneModes to determine the type and processing of sensor data, enabling higher-level data collection and processing, independent of individual sensor settings, and facilitating data sharing across different applications and devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If custom built software and low-level interfaces are used for each camera, then application-specific processing can be achieved, but device complexity and development time increase significantly
Solution Approach 1:
The patent introduces a Scene Graph as an intermediary data structure that sits between the camera hardware and application software. This Scene Graph abstracts the complex low-level camera interfaces and provides a unified, application-agnostic representation of scene data that multiple applications can consume without requiring custom software for each camera type.
Solution Approach 2:
The Scene Graph is designed as a universal data structure that can serve multiple applications simultaneously. Instead of creating application-specific interfaces, the same Scene Graph format can be consumed by different applications (e.g., surveillance, autonomous driving, augmented reality) without modification, enabling one interface to serve multiple functions.
2Loss of information
If raw images are captured and stored for later analysis, then data availability is ensured, but storage space is wasted on unprocessed data
Solution Approach 1:
The patent performs preliminary processing of sensor data to create Scene Graphs at the time of capture. Instead of storing raw images and processing them later, the system pre-processes the data into structured Scene Graphs that contain extracted semantic information, making the data immediately useful while reducing the storage requirements compared to raw image sequences.
Solution Approach 2:
The system extracts only the relevant semantic information from raw sensor data and stores it in Scene Graph format. Rather than storing complete raw images, the extraction process pulls out key scene elements, objects, and relationships, significantly reducing storage requirements while maintaining data utility for analysis.
3Adaptability or versatility
If multiple applications use different low-level camera interfaces, then application-specific requirements are met, but ease of operation and interoperability decrease
Solution Approach 1:
The Scene Graph serves as a universal intermediary that all applications interact with through a common interface. Application developers work with the standardized Scene Graph structure rather than dealing with diverse low-level camera interfaces, significantly improving ease of operation while maintaining the ability to meet application-specific requirements through the flexible Scene Graph data model.
4Duration of action of moving object
If surveillance cameras capture continuous video, then monitoring coverage is maintained, but productivity and data utility decrease due to lack of real-time analysis
Solution Approach 1:
The system performs preliminary analysis and structuring of video data into Scene Graphs during the capture process itself. This allows continuous monitoring coverage to be maintained while simultaneously providing real-time structured data that can be immediately utilized for analysis, eliminating the delay between capture and utility.
Solution Approach 2:
The Scene Graph approach enables continuous transformation of raw video data into useful structured information throughout the entire monitoring period. Rather than capturing data and analyzing it later, the useful action of data structuring and analysis occurs continuously alongside data capture, maintaining both coverage and real-time utility.
Data Source
AI summary
An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.