Video Frame Latency Reduction via Extra Pixel Insertion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud gaming faces challenges in reducing latency due to delays in video frame capture and transmission, particularly when using conventional video capture cards, which hinder the responsiveness of fast-paced video games with high computing resource demands.
Innovation Solution
The method involves inserting extra pixels into video frames to increase the pixel clock rate, allowing visible pixels to be transferred faster, thereby reducing latency by capturing and compressing only the necessary pixels after they have been transferred.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If conventional video capture cards are used to capture video frames from cloud gaming, then the system can deliver compressed audio/video streams to client devices, but the video capture delay contributes significantly to latency between game computations and frame presentation
Solution Approach 1:
The patent applies preliminary action by inserting extra pixels into video frames before they are captured and transmitted. This pre-processing step increases the total pixel count in each frame, which in turn increases the pixel clock rate. The higher pixel clock rate enables faster transfer of the visible portion of the frame to the capture device, thereby reducing video capture delay without requiring changes to the capture card hardware or fundamental capture process.
2Speed
If the pixel clock rate is increased to transfer visible pixels faster, then video transfer delay is reduced, but the total frame size increases due to extra pixels
Solution Approach 1:
The patent applies segmentation by dividing the video frame into two distinct portions: visible pixels that contain actual image data and extra pixels that are inserted to increase the pixel clock rate. The capture device is configured to capture only the visible pixels portion of the frame, effectively segmenting the useful data from the auxiliary data. This allows the system to benefit from the higher transfer rate enabled by the extra pixels while discarding the additional pixel data that was only used to achieve the speed improvement.
Data Source
Figure 1~3A
Figure 3B
Figure 4A
AI summary
Aspects of the present disclosure relate to video capture. In particular, aspects of the present related to systems and methods for reducing latency in the capture of video frames. Various implementations of the present disclosure may add extra pixels to a video frame so that visible pixels within each frame may be transferred faster through a video interface. In particular, adding extra pixels to a frame may cause an increase in a pixel clock that is generated based on the total number of pixels within each frame. As a result of the corresponding decrease in the time needed to transfer visible pixels in each frame, latency due to delay in a video capture process may be reduced.