Video Cropping via Object Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video ads displayed on terminal devices often require cropping, which can result in significant information loss, especially when the cropped frames do not prioritize the main content, leading to ineffective communication of information to users.

Innovation Solution

A video processing method that preprocesses target videos to identify the position of designated objects in each frame, determining a reserved image frame to indicate cropping, thereby reducing information loss by selecting frames that are less critical for cropping and maintaining the visibility of important content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If video frames are cropped to adapt to terminal device display sizes, then the video can be displayed in full-screen mode to highlight information, but significant information loss occurs when the cropped frames do not prioritize main content

Engineering Contradiction:
Improvedisplay areaVSAvoidinformation loss
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent applies preliminary action by performing object identification and cropping decision-making before the actual cropping operation. The system identifies designated objects (such as people, text, or important elements) in each video frame in advance, determines a reserved image frame that contains critical content, and establishes cropping parameters beforehand. This ensures that when cropping is executed to adapt video to terminal display sizes, the main content is preserved and information loss is minimized.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the entire video is cropped to fit terminal display, then full-screen display is achieved, but critical content may be lost or obscured

Engineering Contradiction:
Improvedisplay adaptabilityVSAvoidcontent integrity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies local quality by treating different regions of the video frame differently based on their importance. Instead of uniform cropping, the system identifies specific regions containing designated objects (such as human faces, text, or key visual elements) and prioritizes their preservation. The cropping operation is locally optimized to maintain these critical regions while adapting the overall frame to terminal display requirements, thus preserving content integrity while achieving display adaptability.

Inventive Principle:
Principle #3Local quality

3Productivity

If video ads are displayed in full-screen mode with cropping, then user attention is captured, but the original video information may be distorted or lost

Engineering Contradiction:
Improveinformation communication effectivenessVSAvoidoriginal video information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent applies feedback by using the identified position of designated objects to guide the cropping decision-making process. The system continuously monitors which regions contain important content and uses this information to determine the reserved image frame and cropping parameters. This feedback mechanism ensures that cropping operations do not remove critical information, thereby maintaining the effectiveness of information communication while adapting to full-screen display requirements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11922597B2Video processing method and apparatus, readable medium, and electronic device
Publication Date: 2024.03.05 BEIJING YOUZHUJU NETWORK TECH CO LTD
  • US11922597B2 patent drawing
  • US11922597B2 patent drawing
  • US11922597B2 patent drawing

AI summary

The present disclosure relates to a video processing method and apparatus, a readable medium, and an electronic device, which relate to the technical field of image processing; the method includes: preprocessing a target video to obtain a plurality of target image frames of the target video; identifying a position of a designated object in each of the target image frames; and determining a reserved image frame from the target image frames based on the position of the designated object in each of the target image frames, the reserved image frame being used to indicate a cropping on image frames before the reserved image frame in the target video.