Terminal Video Processing for Synchronized Audio-Visual Focus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video recording technologies require users to have good shooting skills to achieve simultaneous image and audio zooming, which can be challenging, and there is a need to enhance user experience during video recording.
Innovation Solution
A video processing method that enables simultaneous focus tracking of audio and image by determining a focus region, enhancing sound of the target object while suppressing other sounds, and displaying images in a 'picture-in-picture' form, allowing for a close-up video of the target object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the terminal implements simultaneous zooming of the audio and the image by adjusting the zoom magnification, then the sensory experience of the user is enhanced, but the user needs to have good shooting skills to achieve a good effect
Solution Approach 1:
The terminal automatically identifies the target object and adjusts the zoom magnification based on the detected object's position and size, eliminating the need for user manual adjustment. The system serves itself by autonomously optimizing the zoom parameters to maintain the target object as the focus, thereby resolving the contradiction between ease of operation and video quality.
2Adaptability or versatility
If the position of the photographed object relative to the terminal changes, then the terminal can capture different scenes, but the user needs to have good shooting skills to maintain focus on the target object
Solution Approach 1:
The terminal continuously monitors the position of the target object in the captured video feed and uses this feedback to dynamically adjust the zoom magnification. When the target object moves or changes size in the frame, the system responds by adjusting the zoom to keep the object as the focus, thereby maintaining focus accuracy while adapting to changing scenes.
3Area of moving object
If the zoom magnification becomes larger, then the photographed object becomes larger in the video, but the field of view becomes narrower
Solution Approach 1:
The terminal dynamically adjusts the zoom magnification based on the detected target object's characteristics and position. Rather than using a fixed zoom level, the system varies the magnification in real-time to optimize the balance between the size of the photographed object and the field of view, allowing the object to be prominently displayed while maintaining an appropriate contextual view.
Data Source
Figure 1A
Figure 1B~1C
Figure 1D~2
AI summary
A video processing method and a terminal are provided. In the method, when the terminal records a video, the terminal may shoot (acquire) an image by using a camera (the image shot by using the camera is referred to as an original image below), and determine a focus of the shooting based on the original image. Then, the terminal may implement image focus tracking on a photographed object displayed in a first image region in which the focus is located, and implement audio focus tracking on a photographed object displayed in a second image region in which the focus is located. A focus tracking video is obtained through the image focus tracking and the audio focus tracking.