Video Object Scoring for Precise Visual Effect Application
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing techniques are cumbersome and limited in applying visual effects, as they often blur the wrong objects in a video, failing to accurately apply special effects to the intended primary and secondary objects, thus not enhancing the user experience.
Innovation Solution
A computer-implemented method and apparatus that determine object scores based on predetermined factors to identify primary and secondary objects in a video, allowing for the application of visual effects to both, enhancing the video by focusing on relevant objects automatically.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a user manually selects a region in a video to apply visual effects, then the visual effect can be applied to the intended object, but the operation becomes cumbersome and time-consuming
Solution Approach 1:
The system automatically identifies objects in the video and determines which objects should receive visual effects based on predetermined factors, eliminating the need for manual user selection. The apparatus performs self-service by autonomously analyzing video content and applying effects to appropriate primary and secondary objects without requiring user intervention for region selection.
Solution Approach 2:
The system changes the parameter of object identification from manual user specification to automatic computational determination. By introducing object scoring based on multiple factors (visibility, interaction, context), the system transforms the static manual selection process into a dynamic automated evaluation process that identifies primary and secondary objects for visual effect application.
2Device complexity
If visual effects are applied only to primary objects identified in the video, then the processing is simplified, but the enhancement is limited and may blur wrong objects
Solution Approach 1:
The system segments objects in the video into different categories: primary objects that are the main focus and secondary objects that are contextually relevant. This segmentation allows the application of visual effects to multiple object types simultaneously, ensuring that both the primary subject and important contextual elements (such as products in a demo) receive appropriate visual enhancement rather than being overlooked or incorrectly blurred.
Solution Approach 2:
The system applies different levels of visual effect processing to different objects based on their importance and contextual relevance. Primary objects receive standard visual effect application, while secondary objects are identified and processed based on their specific contextual significance. This local quality approach ensures that each object receives appropriate processing based on its role in the video, improving overall reliability of visual effect application.
3Ease of operation
If automated object identification is implemented to reduce manual selection, then user effort is reduced, but the system may fail to correctly identify the intended objects for visual effects
Solution Approach 1:
The system evaluates multiple parameters simultaneously (visibility factors, interaction factors, context factors) to compute comprehensive object scores. By considering several dimensions of object importance rather than relying on a single criterion, the automated identification achieves higher accuracy in selecting both primary and secondary objects for visual effects, matching or exceeding manual selection quality while maintaining ease of operation.
Data Source
AI summary
A computer-implemented method includes obtaining, from a storage, a video to be enhanced, based on a selection of a user; determining corresponding sets of object scores for a plurality of objects identified in the video, respectively, based on a set of predetermined factors; identifying a primary object and one or more secondary objects in the video, among the plurality of objects, based on the corresponding sets of object scores; and applying at least one visual effect to the primary object and at least one secondary object, from the one or more secondary objects, in at least a portion of the video, for obtaining an enhanced video with the at least one visual effect applied at least to the portion of the video.