Video Block Segmentation for Real-Time Communication Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Monitoring and remote control systems face delays and communication degradation issues, leading to 'freezing images' and potential accidents in real-time video transmission over wireless networks, as existing techniques struggle to maintain real-time video reproduction and recognize communication state changes promptly.
Innovation Solution
Divide video frames into blocks, encode each block individually, and transmit using a connectionless scheme, with a margin time added to the expected time for receiving all blocks to reconstruct frames, allowing for real-time reconstruction and allocation of no-image signals for missing blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If packet retransmission request is repeated when communication state degrades, then packet loss is reduced, but packet delay occurs and real-time reproduction is compromised
Solution Approach 1:
The video frame is divided into multiple independent blocks that are encoded and transmitted separately. This segmentation allows the receiver to reconstruct the frame using only the blocks that were successfully received within the expected time period, without waiting for retransmission of missing blocks. Each block can be independently decoded and placed in the correct position, enabling real-time reproduction even with packet loss.
Solution Approach 2:
The system calculates and transmits all encoded blocks of a frame in advance before the expected reception time. The receiver has a predetermined time window to receive all blocks, and if any block is missing, the system proceeds with frame reconstruction using available blocks rather than waiting for retransmission. This preliminary action eliminates the need for time-consuming retransmission requests.
2Loss of time
If video is transmitted in real-time without waiting for complete frame reception, then delay is reduced, but packet loss causes decoding errors and freezing images
Solution Approach 1:
By dividing the frame into independent blocks, the system enables partial frame reconstruction. When some blocks are lost, the receiver can still decode and display the portions of the frame that were successfully received, avoiding complete frame failure and freezing images. This segmentation transforms a binary success/failure outcome into a graded quality output.
Solution Approach 2:
The system uses a disposable approach where each frame is attempted to be reconstructed with available blocks within a fixed time window. If reconstruction is incomplete, the frame is displayed with available data rather than waiting for perfect reconstruction. This accepts some quality degradation as a trade-off for maintaining real-time reproduction, avoiding the costly delay of retransmission.
3Productivity
If previous frame is displayed when current frame cannot be fully decoded, then continuous video display is maintained, but communication state degradation is not recognized timely
Solution Approach 1:
The system implements feedback by monitoring the number of successfully received blocks within the expected time period for each frame. When the reception status falls below a threshold, indicating communication degradation, the system adjusts its behavior by reducing the block reception time threshold for subsequent frames. This feedback mechanism allows the system to detect communication state changes and adapt, preventing indefinite display of stale frames.
Solution Approach 2:
The block reception time threshold is made dynamic rather than fixed. It adjusts based on the reception status of previous frames, becoming more stringent when communication degradation is detected. This dynamic adjustment allows the system to maintain continuous display while timely recognizing communication state changes, as the tightening threshold will eventually cause frame reconstruction to fail, signaling the degradation.
4Device complexity
If entire frame is encoded as single unit, then encoding simplicity is maintained, but packet loss causes complete frame decoding failure
Solution Approach 1:
The frame is segmented into multiple independently encoded blocks. This segmentation increases encoding structure complexity but dramatically improves decoding reliability. Each block can be independently decoded without requiring other blocks, so packet loss of some blocks does not prevent decoding of received blocks. This trade-off of increased complexity for improved reliability is essential for robust real-time video transmission.
Data Source
AI summary
A system, a device, a method, a program, and a recording medium with the program recorded thereon, which enable transmitted videos to be reproduced in real time without delay and the reproducibility of videos to be improved are provided. In addition, a system, a device, a method, a program, and a recording medium with the program recorded thereon, which allow states including a degraded communication state to be recognized in a real time manner without delay. A video communication method includes dividing each of a plurality of still image frames of a video including the plurality of still image frames into a plurality of blocks, encoding the plurality of blocks individually on a per block basis, and transmitting an encoded block obtained by encoding a block of the plurality of blocks by a connectionless communication scheme, and reconstructing, for each of the plurality of still image frames, a still image frame by allocating, at a corresponding position, a decoded block generated by decoding the encoded block of one said still image frame, the encoded block being received in an encoded block reception period corresponding to the one still image frame, in which the encoded block reception period is a period from a current frame start time to a time at which a certain time has elapsed, the certain time being obtained by adding a margin time to an expected time for receiving all encoded blocks of one frame.