Hybrid Content Streaming with Screen Source Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional streaming technologies often provide less than optimal picture quality for hybrid content, which includes scenes with both real objects and displayed objects, due to cameras having a lower dynamic range than the human eye, leading to overexposure or underexposure issues.
Innovation Solution
A device uses object detection and feature extraction algorithms to identify the position and features of displayed content within hybrid content, synchronizes and modifies the source video to match the depiction, and combines it with the captured hybrid content to optimize camera settings for real objects, resulting in improved picture quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If camera exposure settings are adjusted to optimize the brightness of a screen displaying content, then the screen brightness is improved, but other portions of the scene become underexposed
Solution Approach 1:
The patent segments the hybrid content into multiple regions: the real-world scene captured by the camera and the displayed content on the screen. By treating these regions separately, the system can apply different processing techniques to each region, allowing the screen content to be enhanced without compromising the exposure of the real-world scene.
Solution Approach 2:
The patent introduces an intermediary processing system that receives both the camera-captured scene and the source content being displayed on the screen. This intermediary system synchronizes and combines the two sources, applying geometric transformations and feature matching to ensure that the displayed content is properly integrated into the hybrid scene with consistent picture quality.
2Illumination intensity
If camera exposure settings are adjusted to optimize the brightness of a real object, then the real object brightness is improved, but the screen displaying content becomes overexposed
Solution Approach 1:
The patent segments the hybrid content into multiple regions: the real-world scene captured by the camera and the displayed content on the screen. By treating these regions separately, the system can apply different processing techniques to each region, allowing the real object to be properly exposed while the screen content is enhanced through separate source video processing.
Solution Approach 2:
The patent introduces an intermediary processing system that receives both the camera-captured scene and the source content being displayed on the screen. This intermediary system synchronizes and combines the two sources, applying geometric transformations and feature matching to ensure that the displayed content is properly integrated into the hybrid scene with consistent picture quality.
3Ease of manufacture
If traditional streaming technologies are used for hybrid content, then the implementation is simple, but the picture quality is less than optimal
Solution Approach 1:
The patent applies preliminary action by pre-processing the source video content before it is displayed on the screen. The system performs feature extraction, geometric transformation determination, and video modification in advance, so that when the source content is integrated into the hybrid scene, it already has the necessary adjustments for optimal picture quality.
Solution Approach 2:
The patent applies parameter changes by modifying various parameters of the source video, including geometric transformations (scaling, rotation, positioning), playback speed, frame rate, and synchronization parameters. These parameter adjustments ensure that the displayed content matches the visual characteristics of the real-world scene captured by the camera.
Data Source
AI summary
Systems and methods are provided herein for providing consistent picture quality during live or non-live streaming of hybrid content. For example, a camera may capture a first piece of hybrid content depicting a scene. The scene may include one or more real objects (e.g., a first person conducting an interview) and a piece of content (e.g., a stream of a second person being interviewed) being displayed on a screen (e.g., television screen). A system may receive the first piece of hybrid content and the source of the piece of content being displayed within the scene. The system may then insert the source of the piece of content into the first piece of content, replacing the depiction of the piece of content, to generate a second piece of hybrid content. The second piece of hybrid content may then be transmitted to one or more devices.