Image Transmission via Multi-Thread Segmentation for HMDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image transmission methods for Head-Mounted Displays (HMDs) suffer from low efficiency due to the use of single transmission threads for binocular rendering, leading to prolonged data transmission times and reduced realism in virtual reality experiences.
Innovation Solution
The method involves segmenting left-eye and right-eye image data into sub-images, assigning sequence numbers for playback and arrangement order, and transmitting these through multiple threads using Real-time Transport Protocol (RTP) data packets, allowing for synchronous combination and display of image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If single transmission thread is used for binocular rendering, then device complexity is reduced, but transmission efficiency deteriorates
Solution Approach 1:
The patent divides the image data transmission into multiple independent threads, where each thread transmits a portion of the image data (e.g., different color channels or data segments). This segmentation allows parallel transmission of multiple data streams simultaneously, thereby improving transmission efficiency without significantly increasing system complexity
Solution Approach 2:
The patent combines multiple transmission threads to work together for binocular rendering, merging their capabilities to achieve high-speed data transmission. The multiple threads are coordinated to transmit left-eye and right-eye image data concurrently, achieving both complexity reduction and efficiency improvement
2Productivity
If multiple transmission threads are used for image data transmission, then transmission efficiency is improved, but device complexity increases
Solution Approach 1:
The patent designs the multiple transmission threads to perform universal functions in image data transmission. Each thread is capable of transmitting different types of image data (left-eye, right-eye, different color channels) and can be dynamically allocated based on rendering needs, reducing the need for specialized hardware for each function
3Reliability
If left-eye and right-eye image data are transmitted through independent channels, then synchronous transmission is achieved, but transmission time is prolonged
Solution Approach 1:
The patent performs preliminary organization and preparation of image data before transmission, pre-segmenting the left-eye and right-eye image data into appropriate segments for parallel transmission. This preliminary action ensures that when transmission begins, the data is already structured for efficient parallel processing, reducing overall transmission time while maintaining synchronization
Solution Approach 2:
The patent implements continuous transmission of image data segments through multiple threads without idle waiting time. By keeping all transmission threads actively transmitting data throughout the process, the system eliminates gaps and delays, achieving both speed improvement and synchronization accuracy
Data Source
AI summary
Provided is an image transmission method. Left-eye image data and right-eye image data corresponding to a same original image frame in a target video are divided into sub-images on the image processing device side, multiple sets of image data in one-to-one correspondence with the sub-images are generated, and transmitted to the image display device through transmission threads. Each of the multiple sets of image data includes a sub-image, and first and second sequence numbers that correspond to the sub-image. Left-eye image data and right-eye image data corresponding to a same original image frame are obtained by combining sub-images in the multiple sets of image data, by the image display device, based on first and second sequence numbers in the multiple sets of image data. Finally, a left-eye image corresponding to the left-eye image data and a right-eye image corresponding to the right-eye image data are played.