Region of Interest Estimation from Mobile Sensor Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional event databases are cumbersome and time-consuming to maintain, often miss local events not advertised through mainstream channels, struggle to automatically determine Regions of Interest (ROI) during events, and lack intuitive user interfaces for navigating multiple viewpoints of events.

Innovation Solution

A system and method using sensor data from mobile devices to estimate and visualize Regions of Interest (ROI) by analyzing location and orientation data, constructing origin points and vectors, and generating viewing frustums to determine the spatial extent and shape of events, enabling intuitive navigation across multiple viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If manual efforts are used to maintain event databases by scouring communication channels, then event information can be collected, but the process becomes cumbersome and time-consuming

Engineering Contradiction:
Improveevent information completenessVSAvoiddatabase maintenance time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system enables automatic event discovery by having mobile devices self-report their location and orientation data, which the server automatically processes to identify events and update databases without manual intervention

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual database maintenance is replaced by an automated system that uses sensor data from mobile devices, coordinate space analysis, and algorithmic event detection to automatically discover and record events

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If content reviewers search limited communication channels for events, then some events are discovered, but many local events not advertised through mainstream channels are missed

Engineering Contradiction:
Improveevent discovery completenessVSAvoidsearch system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system transitions from searching communication channels (information dimension) to analyzing spatial data (geographic dimension) by constructing coordinate spaces from mobile device locations and orientations to discover events

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

Mobile devices serve multiple functions: they are both the sensors capturing event data and the sources of location/orientation information, eliminating the need for separate detection systems

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If multiple recording devices capture content from different locations, then more viewpoints are available, but determining the Region of Interest becomes complex

Engineering Contradiction:
Improveviewpoint coverageVSAvoidROI determination difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system divides the problem into discrete steps: constructing individual origin points from each device, creating vectors representing device orientations, generating viewing frustums for each device, and finally synthesizing these to determine the ROI through coordinate space analysis

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces coordinate spaces and viewing frustums as intermediary constructs that mediate between raw sensor data from multiple devices and the final ROI determination, making the complex synthesis manageable

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If users are offered video recordings from different viewpoints, then event perspectives are available, but navigating across multiple viewpoints lacks an intuitive interface

Engineering Contradiction:
Improveviewpoint navigation capabilityVSAvoiduser interface intuitiveness
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system adds a spatial dimension to viewpoint navigation by displaying recording device locations on a map interface, allowing users to intuitively select viewpoints based on geographic position rather than abstract video sources

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11315340B2Methods and systems for detecting and analyzing a region of interest from multiple points of view
Publication Date: 2022.04.26 SHOUTY LLC
  • US11315340B2 patent drawing
  • US11315340B2 patent drawing
  • US11315340B2 patent drawing

AI summary

Disclosed are devices, systems, methods, techniques, and computer program products for estimating a Region Of Interest (ROI) corresponding to a plurality of content streams. A method may include receiving a plurality of sensor data associated with a plurality of mobile devices. The plurality of sensor data corresponds to a plurality of content streams captured by the plurality of mobile devices. Further, each of the plurality of mobile devices may include at least one recorder configured to capture a corresponding content stream. Further, a sensor data associated with a mobile device may include a location data and an orientation data of the mobile device during capturing of a content stream. The method may further include, analyzing, by the system, the plurality of sensor data and determining, by the system, a ROI based on at least the plurality of sensor data, thereby generating an estimation of the ROI.