Video Summarization Apparatus Preventing Target Object Overlap

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video image summarization techniques fail to efficiently extract and display relevant information from large datasets, often causing identical target objects to appear multiple times in summary videos, leading to missed actions of suspicious individuals.

Innovation Solution

An information processing apparatus that identifies and arranges movement paths of target objects to prevent overlap in the time direction, generating a summary video image by shifting the reproduction position of target objects, ensuring that identical objects are not displayed at multiple positions simultaneously.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If target objects are extracted and individually shifted in time direction to reduce reproduction time, then productivity is improved, but identical target objects may appear multiple times in the summary video, causing loss of information

Engineering Contradiction:
Improvevideo reproduction speedVSAvoidduplicate target object appearances
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system performs preliminary identification of identical target objects across multiple video frames before generating the summary video. By pre-grouping identical targets and determining their temporal relationships, the system avoids duplicate appearances in the summary while maintaining fast reproduction speed. This preliminary classification enables the subsequent summary generation to proceed efficiently without information loss.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a structured representation (copy) of target object data including identification information, movement paths, and temporal relationships. This data structure serves as an intermediate model that allows the system to reconstruct the video summary without directly copying identical target instances multiple times, thereby preventing information loss while maintaining productivity.

Inventive Principle:
Principle #26Copying

2Ease of operation

If target objects are grouped into clusters and arranged in time direction, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improvevideo analysis organizationVSAvoidprocessing system structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments the video analysis process into distinct functional modules: target object extraction, identification, movement path determination, clustering, and summary generation. Each module handles a specific aspect of the processing, making the overall complex system easier to operate and maintain. The segmentation allows operators to understand and control each stage independently while achieving organized video analysis.

Inventive Principle:
Principle #1Segmentation

3Reliability

If movement paths of identical target objects are arranged to prevent overlap, then reliability is improved, but productivity decreases

Engineering Contradiction:
Improvetarget tracking accuracyVSAvoidvideo reproduction speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system resolves movement path overlaps by utilizing the time dimension for arrangement. Instead of attempting to separate overlapping paths in spatial dimensions alone, the system orders identical target objects sequentially along the time axis, ensuring each target appears only once in the summary video at its appropriate temporal position. This dimensional approach maintains tracking accuracy while preserving reproduction speed.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11640712B2Information processing apparatus, video image summarization method, and storage medium
Publication Date: 2023.05.02 CANON KK
  • US11640712B2 patent drawing
  • US11640712B2 patent drawing
  • US11640712B2 patent drawing

AI summary

Visibility of a summary video image is improved. An information processing apparatus generates a summary video image by changing an appearance order of a target object detected from a video image, the information processing apparatus including an identification unit configured to identify an identical target object based on data on a plurality of target objects detected from a video image, a determination unit configured to determine an arrangement of movement paths of two or more target objects identified as an identical target object by the identification unit such that the movement paths do not overlap in a time direction, and a generation unit configured to generate the summary video image of the video image based on the arrangement determined by the determination unit.