Thermal Contour AR Live Streaming Without Green Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR virtual live-streaming technologies face challenges in efficiently synthesizing special effects in real-time due to cumbersome processes and the inability to handle large-scale live streams without the use of large green screens, limiting interactive and display enhancements.
Innovation Solution
Utilizing thermal imaging to acquire contour information of live-streaming objects, binding preset special effect data with this information to generate target special effects, and synthesizing these effects in real-time with live-streaming images to create enhanced live-streaming data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If AR technology is applied to enhance live-streaming effects, then user viewing experience is improved, but the process of generating live-streaming pictures becomes cumbersome and complex
Solution Approach 1:
The patent extracts the background removal function from the complex AR processing pipeline by using thermal imaging to obtain contour information separately. This isolates the contour extraction step from the main image processing flow, simplifying the overall process while maintaining AR enhancement capabilities.
Solution Approach 2:
The patent introduces thermal imaging as an intermediary tool to obtain contour information. Instead of directly processing the complex AR image synthesis, the system first captures thermal contour data as an intermediate representation, which then guides the special effect application process, making the overall system more manageable.
2Adaptability or versatility
If traditional AR methods are used for special effect synthesis, then interaction enhancement is achieved, but the method cannot flexibly meet requirements in large-scale live streams
Solution Approach 1:
The patent makes the contour extraction method universal by using thermal imaging that works across different lighting conditions and environments. The thermal-based contour detection can be applied to various live-streaming scenarios including large-scale events, concerts, and broadcasts without requiring green screens or controlled environments, providing multi-functional adaptability.
Solution Approach 2:
The patent changes the parameter basis for contour detection from visual color information to thermal infrared information. This parameter transformation enables the system to operate in diverse lighting conditions and environments, providing flexibility for large-scale live streams where traditional visual-based AR methods would fail.
3Measurement precision
If green screens are used for AR synthesis, then special effect accuracy is improved, but the requirement for large green screens limits application in large-scale live streams
Solution Approach 1:
The patent replaces the mechanical green screen system with a thermal imaging-based contour detection system. Instead of using physical green screens that occupy large spaces and require controlled environments, the system uses thermal sensors to detect body heat signatures and extract contours, eliminating the need for large green screens while maintaining or improving detection precision.
Solution Approach 2:
The patent creates a thermal copy or representation of the subject's contour information without requiring the physical presence of green screens. The thermal imaging captures the shape and outline of performers or objects through heat signatures, creating an accurate contour model that can be used for AR synthesis without the spatial constraints of traditional green screen setups.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates real-time interaction and simplifies the special effect synthesis process, enabling effective application in large-scale live streams without the need for green screens, thereby enriching the user's viewing experience.
Implementation Method 1
acquiring current contour information of a live-streaming object by using a thermal imaging device
Data Source
AI summary
a method and an apparatus for generating live-streaming data, a computer-readable storage medium and an electronic device thereof are provided. The method includes: acquiring current contour information of a live-streaming object by using a thermal imaging device; generating target special effect data by binding preset special effect data with the current contour information of the live-streaming object; synthesizing a real-scene shooting image of the live-streaming object with the target special effect data into a special effect frame image; and converting the special effect frame image into live-streaming stream data.