Video Duet Facial Image Processing for Similarity Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional face image processing methods in interactive applications are limited to determining the beauty of facial features, failing to meet diverse user demands.

Innovation Solution

A face image processing method and device that presents a video duet interface with display windows for collecting and displaying facial images, performs similarity matching on the collected and video frame images, and provides a similarity matching result through effect resources, optionally utilizing a server for processing high-resolution images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If facial feature detection is performed to determine beauty, then the application can provide beauty assessment functionality, but the application scenario remains single and fails to satisfy diverse user demands

Engineering Contradiction:
Improveapplication scenario diversityVSAvoidfacial image processing capability
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs multiple types of facial image processing including similarity matching, beauty detection, and feature analysis using a unified technical approach. The same facial recognition and comparison algorithms are leveraged across different application scenarios (duet video creation, beauty assessment, face similarity search), allowing one set of processing capabilities to serve multiple user needs and expand application versatility without requiring separate specialized systems for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If similarity matching is performed on high-resolution images, then matching accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveface similarity matching accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs similarity matching on key facial feature points rather than processing entire high-resolution images. By extracting and comparing specific facial landmarks (eyes, nose, mouth positions and shapes) at reduced resolution, the system achieves sufficient matching accuracy for practical applications while dramatically reducing computational load and processing time. This partial processing approach provides adequate precision for social media and entertainment purposes without the excessive time cost of full-image analysis

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12456280B2Facial image processing method and device, terminal, and storage medium
Publication Date: 2025.10.28 DOUYIN VISION CO LTD
  • US12456280B2 patent drawing
  • US12456280B2 patent drawing
  • US12456280B2 patent drawing

AI summary

Embodiments of the present application disclose a facial image processing method and device, a terminal, and a storage medium. The method comprises: in response to a split-screen instruction regarding a target video, displaying a video split-screen interface comprising at least a first display window and a second display window; in response to an image acquisition instruction, acquiring an image frame including at least a first face, wherein the first display window is used to display a video image frame including a second face in the target video, and the second display window is used to display the image frame including at least the first face; obtaining, on the basis of the image frame including the first face and the video image frame including the second face, a similarity matching result between the first face and the second face; and displaying the similarity matching result in the video split-screen interface.