Predictive 3D Image Streaming for Spatial Computing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transmission and processing of 3D image data are delayed due to its large file size, hindering the widespread adoption of point clouds and similar image formats, even with advanced wireless networks, as existing methods require the entire file to be downloaded before visualization can occur.
Innovation Solution
Predictive streaming prioritizes and streams the most interesting elements of a 3D image first, allowing immediate visualization on the recipient device, while continuing to stream additional data sets based on predicted viewer interactions, effectively transforming the 3D image into a 2D view initially, then expanding to full 3D details.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the entire 3D image file is downloaded before visualization, then complete 3D data is available for rendering, but transmission time and processing delay increase significantly
Solution Approach 1:
The patent segments the 3D image data into multiple data sets representing different elements or regions of the 3D image. These segmented data sets are streamed sequentially to the recipient device, allowing visualization to begin with earlier-arriving data while remaining data continues to stream in the background.
Solution Approach 2:
The patent performs preliminary actions by pre-processing the 3D image data into organized data sets and determining their transmission order before streaming begins. This preparation enables the recipient device to start rendering immediately as data arrives, rather than waiting for complete file download.
2Manufacturing precision
If high-resolution 3D point cloud data is transmitted, then image quality and detail are improved, but file size increases making transmission slower
Solution Approach 1:
The patent applies partial action by streaming only the necessary portions of the 3D image data in a sequential manner. The recipient device visualizes the 3D image using the data sets that have arrived, progressively adding detail as more data streams in, rather than requiring the entire high-resolution data set to be transmitted first.
3Loss of time
If 3D image data is streamed progressively, then visualization time is reduced, but data completeness and rendering accuracy may be compromised
Solution Approach 1:
The patent ensures continuity of useful action by maintaining an ongoing stream of data sets from the sender device to the recipient device. While the recipient begins visualizing with initial data, the streaming continues uninterrupted, allowing the visualization to progressively improve in accuracy and completeness without interruption or retransmission.
Data Source
AI summary
Disclosed are systems and methods for the out-of-order predictive streaming of elements from a three-dimensional (“3D”) image file so that a recipient device is able to produce a first visualization of at least a first streamed element from a particular perspective, similar to the instant transfer of two-dimensional (“2D”) images, while the additional elements and perspectives of the 3D image are streamed. The sending device prioritizes the 3D image elements based on a predicted viewing order, streams a particular element from a particular perspective with a priority that is greater than a priority associated with other elements and other perspectives, determines a next element to stream after the particular element based on the next element being positioned adjacent to the particular element and having a priority that is greater than adjacent elements, and streams the next element to the recipient device.