Video Summarization via Object Correlation Grouping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video summary methods either require significant time and effort for subjective editing or fail to accurately represent user preferences, particularly in providing content that is not scene-specific and may exclude desired scenes.
Innovation Solution
An electronic device that groups objects within frames based on correlation values and probability thresholds to generate a summary content, identifying representative objects and adjusting summary length according to user input, thereby improving accuracy and user satisfaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video summary is provided by subjective editing by an editor, then the flow of content is natural, but a long period of time and great effort are needed in the editing process
Solution Approach 1:
The system performs automatic video summarization by analyzing narrative structures, character relationships, and scene importance without human intervention. The processor automatically identifies key scenes and generates summary content based on objective analysis of the video data, eliminating the need for manual editing while maintaining content quality.
Solution Approach 2:
The patent replaces the mechanical editing process with an automated information processing system. The processor uses algorithms to analyze video frames, extract narrative structures, identify character relationships, and automatically generate summary content, substituting human editorial work with computational analysis.
2Loss of time
If video summary is provided by automatic processing based on sound and image information, then editing time is reduced, but it is difficult to transfer general content of the video
Solution Approach 1:
The patent adds a narrative structure analysis dimension to the automatic video summarization process. Instead of relying solely on visual and audio features, the system analyzes the narrative flow, character relationships, and story development across multiple dimensions, enabling comprehensive content representation that captures the general meaning of the video.
Solution Approach 2:
The system performs multiple analysis functions simultaneously: extracting visual features, analyzing audio information, identifying narrative structures, determining character relationships, and generating summary content. This multi-functional approach ensures comprehensive content capture while maintaining efficient automated processing.
3Loss of information
If video summary is provided by narrative centered method, then brief content is transferred, but scenes preferred and desired to watch by user may be excluded
Solution Approach 1:
The system dynamically adjusts the summarization process based on user preferences and requirements. It can modify the weight given to different narrative elements, adjust the level of detail for specific characters or scenes, and adapt the summary generation to match user interests, making the automated system flexible and user-adaptive.
Solution Approach 2:
The patent incorporates feedback mechanisms where user preferences and selections are used to refine and adjust the summarization process. The system learns from user interactions and adjusts its analysis and selection criteria to better match user preferences, ensuring that desired scenes are included in the summary.
Data Source
AI summary
An electronic device is disclosed. The electronic device comprises a memory for storing a content, and a processor for: acquiring a probability value for each of a plurality of objects included in each of a plurality of frames configuring the stored content; grouping the plurality of objects into at least one group according to a correlation value between the plurality of objects, the correlation value being obtained on the basis of the acquired probability value; counting, for each of a plurality of frames for each group, a case where the acquired probability value is equal to or greater than a preconfigured threshold value; and acquiring a summary content on the basis of a result of the counting.