Video and Mobile Data Correlation for User Behavior Profiling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surveillance systems lack the capability to analyze user behavior in real-time and post-time effectively, particularly in retail environments, leading to inefficiencies in inventory management and security, as they primarily focus on individual occurrences rather than understanding underlying behaviors that contribute to issues like employee theft.

Innovation Solution

An analytical recognition system that combines video camera data with mobile communication device data to generate profiles of individuals, tracking arrival and departure times, behavior, and visit frequency, using a data analytics module to correlate and analyze this information for real-time and post-time analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video monitoring systems are used to track individual occurrences, then security and inventory control are improved, but the ability to understand underlying user behaviors is insufficient

Engineering Contradiction:
Improvesecurity and inventory controlVSAvoidunderlying user behaviors
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system merges video data from cameras with mobile device data from antennas to create comprehensive user profiles. This combination allows the system to capture both individual occurrences (video events) and underlying behaviors (patterns across multiple data sources), resolving the contradiction between tracking specific incidents and understanding overall user behavior patterns.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system adds a new dimension of analysis by incorporating mobile device data (GPS location, device identifiers) alongside traditional video data. This multi-dimensional approach enables the system to understand user behaviors beyond what video alone can capture, such as movement patterns, visit frequency, and device-based identification, thereby gaining insight into underlying behaviors while maintaining security monitoring capabilities.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If continuous video streaming is maintained for real-time analysis, then immediate detection of events is improved, but data storage requirements and processing complexity increase

Engineering Contradiction:
Improvereal-time detectionVSAvoiddata storage and processing
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system extracts only the most relevant information from continuous video streams and mobile device data for profile generation and analysis. Rather than storing and processing all raw video data, the system extracts key events, user identifiers, and behavioral patterns, significantly reducing storage requirements and processing complexity while maintaining real-time detection capabilities for security-relevant events.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary processing of video and mobile device data by generating user profiles in advance. These pre-generated profiles contain aggregated behavioral information that can be quickly queried and analyzed without requiring real-time processing of raw data streams. This preliminary action enables fast response to security events while reducing the computational burden during real-time operation.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If multiple data sources are integrated to create comprehensive user profiles, then behavioral analysis capability is improved, but system complexity and data correlation difficulty increase

Engineering Contradiction:
Improvebehavioral analysisVSAvoiddata correlation
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses user profiles as an intermediary data structure that bridges multiple data sources (video feeds, mobile device data, transaction records). These profiles aggregate and correlate information from various sources using consistent identifiers such as device IDs and recognized user characteristics, simplifying the correlation process while enabling comprehensive behavioral analysis across all integrated data sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10432897B2Video identification and analytical recognition system
Publication Date: 2019.10.01 CAREY JAMES
  • US10432897B2 patent drawing
  • US10432897B2 patent drawing
  • US10432897B2 patent drawing

AI summary

An analytical recognition system includes a video camera, an antenna, and a data analytics module. The video camera is configured to capture video data. The antenna is configured to capture mobile communication device data. The data analytics module is configured to correlate the video data and the mobile communication device data to generate a profile of a person associated with the video data and the mobile communication device data. The profile has profile data including any one or a combination of the captured video data and the captured mobile communication data.