Live Streaming Duet Capture With Host Portrait Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing live streaming platforms lack interactive functions to enhance user engagement and experience.
Innovation Solution
Implement a duet function in live streaming rooms that allows users to capture multimedia content and synthesize it with a host's portrait cutout, creating a duet multimedia product.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional live streaming interaction functions are used, then the system is simple and easy to operate, but user engagement and interaction richness are insufficient
Solution Approach 1:
The patent uses portrait cutout technology to create a virtual copy of the host that can be placed in various scenarios. This copy interacts with captured images or videos to create duet content, enabling rich interaction modes without requiring the actual host to be physically present in multiple locations simultaneously.
Solution Approach 2:
The system introduces an intermediary processing layer that combines the host portrait cutout with user-captured multimedia content. This intermediary mechanism facilitates interaction by automatically合成 (synthesizing) the two elements, reducing the complexity burden on users while enriching interaction possibilities.
2Adaptability or versatility
If a duet function with portrait cutout and multimedia synthesis is added, then interaction richness is improved, but processing complexity increases
Solution Approach 1:
The system segments the interaction process into distinct modules: portrait cutout extraction, multimedia capture, synthesis processing, and result display. This segmentation allows each module to be optimized independently and processed through dedicated APIs, reducing overall processing complexity while maintaining rich interaction functions.
Solution Approach 2:
The host portrait cutout is extracted and prepared in advance before the actual interaction occurs. This preliminary action allows the system to have the processed portrait ready for quick synthesis with user-captured content, reducing real-time processing complexity when users initiate duet interactions.
3Loss of time
If real-time camera capture and synthesis are implemented, then user feedback is immediate, but processing time and resources increase
Solution Approach 1:
The system performs synthesis processing on a partial basis - only processing the specific regions where the portrait cutout and captured content need to be combined, rather than processing entire frames. This selective processing reduces computational resources while maintaining real-time feedback capability.
Solution Approach 2:
The system uses the device's own camera and processing capabilities to capture and synthesize content locally, without requiring extensive external processing resources. This self-service approach minimizes resource consumption while providing immediate feedback to users.
Data Source
AI summary
Provided are an interaction method and apparatus in a live streaming room, and a device and a storage medium. The method comprises: in response to a trigger operation for a preset duet entry on a live streaming room page, jumping from the live streaming room page to a camera capture page, wherein a host portrait cutout corresponding to the live streaming room page is displayed on the camera capture page and a capture control is provided on the camera capture page acquiring multimedia information captured by a camera, in response to a trigger operation for the capture control on the camera capture page, wherein the multimedia information comprises an image or a video; and synthesizing the multimedia information with the host portrait cutout to obtain a duet multimedia product.