Video Synopsis Apparatus Maintaining Relative Appearance Order
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video synopsis technologies generate summary videos where individuals appear to suddenly appear or disappear when getting on or off vehicles, leading to confusing and undesirable effects due to separate object recognition.
Innovation Solution
An information processing apparatus with a specification unit, determination unit, and generation unit that specifies relationships between objects, determines their motion trajectories while maintaining relative appearance order, and generates a summary video to avoid temporal overlap, ensuring the person and vehicle appear together in the correct order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If objects are extracted separately based on spatial positions to prevent overlap, then the video can be compressed into a short-time summary video, but the person and automobile appear separately leading to strange video effects and confusion
Solution Approach 1:
The patent merges the person and automobile into a single combined object when the person is detected to be getting on or off the vehicle. This is achieved by determining that these objects should be treated as one unified entity during the transition period, preventing the separate extraction and display issue while maintaining effective video compression through the synopsis technology
2Productivity
If objects are shifted in temporal direction to prevent overlap, then the summary video can be generated efficiently, but the relative appearance order of person and automobile may be disrupted
Solution Approach 1:
By combining the person and automobile into one object during the getting on/off transition, the patent ensures that their relative appearance order remains stable and logical. The combined object is extracted and displayed as a single entity, preventing the disruption of temporal sequence that would occur if they were treated separately
Solution Approach 2:
The patent performs preliminary determination of the relationship between objects before the actual video synopsis processing. By identifying that a person is getting on or off a vehicle in advance, the system can pre-establish the combined object status, ensuring correct appearance order is maintained throughout the summary video generation process
Data Source
AI summary
An information processing apparatus includes a specification unit, a determination unit, and a generation unit. The specification unit specifies a relationship between a plurality of objects detected in a video. The determination unit determines arrangement of motion trajectories of the plurality of objects, the relationship between which has been specified by the specification unit, while maintaining a relative appearance order in the video and avoiding an overlap of the motion trajectories in a temporal direction. The generation unit generates a summary video of the video based on the arrangement determined by the determination unit.