Cross-Terminal Face Swap via Network Image Exchange

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face swap technologies are limited to swapping faces within the same terminal, lacking inter-terminal functionality, which restricts their entertainment value and versatility.

Innovation Solution

A method and device configuration that enables face swapping between host and audience terminals connected over a network, allowing for the recognition and exchange of face images to create swapped images, enhancing interactivity and application range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If face swap is implemented only within the same terminal, then the technical implementation is simple, but the entertainment value and application range are limited

Engineering Contradiction:
Improveapplication rangeVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The face swap system is divided into independent terminal units, each capable of performing face recognition and image processing locally. The host terminal and audience terminal operate as separate but coordinated segments, with each terminal maintaining its own face swap capability while interacting through network communication.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A network communication intermediary is introduced to enable face image exchange between terminals. The system uses network protocols and data transmission mechanisms as intermediaries to transfer face images and control signals between the host terminal and audience terminal, allowing cross-terminal operation without direct physical connection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If face swap is performed across different terminals over a network, then the interactivity and entertainment value improve, but the system complexity and communication requirements increase

Engineering Contradiction:
Improveinter-terminal functionalityVSAvoidnetwork integration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The face swap system is designed with universal functionality that operates identically whether within a single terminal or across multiple terminals. The same face recognition algorithms, image processing techniques, and user interface mechanisms are used in both single-terminal and multi-terminal modes, requiring only network connectivity addition rather than fundamental system redesign.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Face images are captured and processed in advance at each terminal before network transmission. The host terminal and audience terminal both perform preliminary face recognition and image preparation locally, reducing the complexity of real-time network processing and enabling smoother inter-terminal communication.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If face images are exchanged between terminals, then the face swap functionality is enhanced, but the network bandwidth and data transmission requirements increase

Engineering Contradiction:
Improveface exchange capabilityVSAvoidnetwork energy consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

Only the essential face image data required for swapping is extracted and transmitted over the network, rather than transmitting complete video streams or entire image sets. The system extracts specific face regions and transmits only those necessary pixels and features, significantly reducing network bandwidth consumption and energy usage.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system transmits face images at optimized resolution and frequency - providing sufficient quality for effective face swapping without excessive data transmission. The transmission rate and image quality are tuned to match the minimum requirements for successful face swap operation, avoiding unnecessary energy consumption from over-transmission.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11151359B2Face swap method, face swap device, host terminal and audience terminal
Publication Date: 2021.10.19 JOYME PTE LTD
  • US11151359B2 patent drawing
  • US11151359B2 patent drawing
  • US11151359B2 patent drawing

AI summary

The present disclosure provides a face swap method, a face swap device, a host terminal and an audience terminal. The method includes: starting a face swap prompt; recognizing and determining a first face image in a first preset image of the host terminal according to the face swap prompt; receiving a second face image sent by the audience terminal; and replacing the first face image with the second face image to obtain a first face-swapped image.