Highlight Moving Image Generation via Video-Audio Priority Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing highlight scene extraction methods fail to accurately identify highlight scenes in moving images when frame images lack scene composition features, even if audio features satisfy predetermined conditions, leading to unnatural moving images with highlight scenes starting or ending inappropriately.
Innovation Solution
An information processing apparatus determines both video and audio highlight scenes based on their respective features in a moving image file, prioritizes them according to user input, and generates a highlight moving image by extracting relevant portions of video and audio data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If audio features are used to determine highlight scenes, then the accuracy of highlight detection is improved, but frame images without scene composition features are incorrectly excluded even when audio conditions are satisfied
Solution Approach 1:
The patent merges video highlight scene determination and audio highlight scene determination into a unified processing framework. Both types of highlight scenes are detected separately based on their respective features, then integrated through time period comparison and priority-based selection, ensuring that audio-based highlights are not excluded due to lack of video features.
Solution Approach 2:
The system dynamically adjusts the selection criteria based on the content type by accepting priority information from the electronic device. This allows the highlight scene determination to adapt between prioritizing video features, audio features, or both equally, depending on the specific content requirements.
2Measurement precision
If both audio features and scene composition features are required to satisfy conditions, then the precision of highlight scene identification is improved, but the time period alignment between audio and video highlights cannot be ensured, resulting in unnatural moving images
Solution Approach 1:
The patent performs preliminary determination of both video highlight scenes and audio highlight scenes separately before final selection. By obtaining time periods for both types of highlights in advance and comparing them, the system can identify alignment issues and resolve them through priority-based selection, ensuring stable time period composition in the final output.
3Device complexity
If frame images with no scene composition feature are excluded from determination, then the processing complexity is reduced, but the quantity of valid highlight scenes is decreased
Solution Approach 1:
The patent segments the highlight scene determination process into independent video-based determination and audio-based determination. This allows frame images without scene composition features to be evaluated through audio features alone, increasing the quantity of valid highlight scenes without significantly increasing overall processing complexity, as each segmentation can be handled independently.
Data Source
AI summary
An information processing apparatus capable of communicating with an electronic device includes one or more memories, and one or more processors in communication with the one or more memories, wherein the one or more processors and the one or more memories are configured to determine a video highlight scene and an audio highlight scene, obtain information about a time period of each of the video highlight scene and the audio highlight scene, receive priority information from the electronic device, the priority information indicating whether either the video highlight scene or the audio highlight scene or both are to be prioritized, determine a time period of a highlight moving image based on the priority information and information about the time period of each of the video highlight scene and the audio highlight scene, and provide a notification of the time period of the highlight moving image to the electronic device.