Hierarchical Video Layer Overlay for Real-Time Multi-Device Broadcasting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in transmitting video and audio data from multiple devices to a media platform in real time without delay, particularly when errors occur in communication networks, leading to delays and interruptions in real-time broadcasting.
Innovation Solution
An apparatus and method that include a shooting unit, receiver, layer generator, display controller, and transmitter to capture, receive, and display video and audio data, generating multiple layers for hierarchical combination and overlay on a screen, allowing continuous video capture and transmission to a media platform even if data from a subdevice is not received, using Wi-Fi direct communication without a router.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If video data from multiple devices is transmitted through a router in real time, then the quantity of video data transmitted is increased, but the transmission delay increases and reliability decreases when network errors occur
Solution Approach 1:
The patent divides the video transmission system into multiple independent channels: one channel transmits video data from the main device, and separate channels transmit video data from each subdevice. This segmentation allows each channel to operate independently, so if one channel experiences network errors, other channels continue transmitting without interruption, thereby improving reliability while maintaining the quantity of transmitted video data.
Solution Approach 2:
The main device acts as an intermediary that receives video data from subdevices and combines it with its own video data before transmitting to the media platform. This intermediary role allows the system to maintain continuous transmission even when direct connections between subdevices and the platform are interrupted, as the main device can relay and combine video streams from multiple sources through a single stable connection.
2Adaptability or versatility
If multiple video streams are combined and displayed on one screen, then the adaptability of the display system is improved, but the device complexity increases
Solution Approach 1:
The patent introduces a hierarchical layer structure for displaying multiple video streams, where video data from the main device and subdevices are organized into different layers (first layer, second layer, etc.) with defined overlay relationships. This dimensional organization allows the system to handle multiple video streams systematically through layer composition and blending operations, making the complexity manageable while achieving high display adaptability for various screen configurations and layouts.
3Duration of action of moving object
If video data is continuously captured and transmitted without interruption, then the duration of action is improved, but the loss of time due to network errors increases
Solution Approach 1:
The system performs preliminary actions by continuously capturing video data in the main device and buffering it locally before transmission. This allows the main device to have video data ready for immediate transmission even when network conditions are poor or when subdevice data is temporarily unavailable, reducing time loss and maintaining continuous playback without interruption to the duration of video capture.
Data Source
AI summary
The image processing apparatus includes a shooting unit configured to capture a moving picture including video data and audio data of a subject at a certain location; a receiver configured to receive video data of a moving picture of the subject without audio data of the moving picture; a layer generator configured to generate a first layer and at least one second layer to reproduce and display on the screen a plurality of pieces of video data including the video data captured by the shooting unit and at least one piece of video data received by the receiver; a display controller configured to reproduce and display the first layer and the at least one second layer to be overlaid with each other on one screen through hierarchical combining.