Content Server Low-Latency Streaming via 3D-to-2D Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current content streaming technologies for virtual reality (VR), augmented reality (AR), and mixed reality (MR) face challenges due to high installation and maintenance costs, as well as increased latency and network bandwidth usage, which degrade the quality of the user experience.
Innovation Solution
A content server and method that support low-latency content streaming by transmitting a 2D video in real-time, calculated based on the user's location and viewpoint, thereby reducing transmission delay and network overhead. This system includes a communication unit and a controller that processes terminal data to create a 3D space, position objects, render videos, segment data, and transmit it asynchronously to the user terminal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional VR/AR/MR content streaming is implemented, then realistic contents can be provided, but high installation and maintenance costs are required
Solution Approach 1:
The patent creates a 3D space model that replicates the user's environment and positions virtual objects within it. Instead of requiring complex hardware at the user terminal, the system copies the rendering function to the content server, which generates 2D video frames that are transmitted to the terminal for display. This approach maintains realistic content delivery while eliminating the need for high-end hardware at the client end.
Solution Approach 2:
The patent replaces traditional mechanical rendering systems (requiring powerful GPUs and complex hardware) with a software-based solution where the content server performs rendering calculations and transmits pre-processed 2D video frames. This substitution of mechanical/computational hardware with network-based software processing reduces device complexity while maintaining content quality.
2Loss of time
If real-time video transmission is performed, then low latency is achieved, but network bandwidth usage increases
Solution Approach 1:
The patent segments the video transmission process into two stages: first, the content server processes and prepares video frames in advance; second, the processed 2D video is transmitted to the user terminal. This segmentation allows for optimized data transmission with reduced latency while managing bandwidth usage through efficient processing at the server end.
Solution Approach 2:
The content server performs preliminary processing of the 3D space model, object positioning, and video rendering before transmission to the user terminal. By completing these computationally intensive tasks in advance at the server, the system reduces real-time processing requirements at the terminal and optimizes network transmission efficiency.
3Manufacturing precision
If high-end hardware equipment is used, then content quality is improved, but installation and maintenance costs increase
Solution Approach 1:
The system copies the complex rendering and processing functions from the user terminal to the content server. The server maintains a 3D space model and performs all necessary calculations and rendering, then transmits only the final 2D video frames to the terminal. This copying of computational functions to the server eliminates the need for high-end hardware at the client end while maintaining content quality.
Solution Approach 2:
The content server acts as an intermediary between the user's simple terminal and the complex rendering requirements. It receives user input, performs all heavy computational tasks including 3D space creation and object positioning, and delivers processed video output. This intermediary approach allows high content quality without requiring high-end hardware at the user end.
4Measurement precision
If complex software processing is performed, then rendering accuracy is improved, but computational load increases
Solution Approach 1:
The content server serves as an intermediary that handles all complex software processing and computational load. It maintains the 3D space model, performs object positioning calculations, and executes rendering operations, then transmits only the necessary 2D video data to the terminal. This shifts the computational burden from the terminal to the server, improving rendering accuracy without increasing terminal computational requirements.
Solution Approach 2:
The patent copies the complex rendering software and processing algorithms to the content server. Instead of requiring the terminal to perform these computationally intensive tasks, the server executes the full rendering pipeline and transmits pre-processed video frames. This copying of computational functions maintains rendering accuracy while eliminating the need for high computational power at the client end.
Data Source
AI summary
A content server and method supporting low-latency content streaming are proposed. The content server may include a communication unit and a controller. The communication unit may perform communication with a user terminal. The controller may calculate coordinates for a current user's location and camera pose and create a three-dimensional (3D) space by using terminal data including an image received from the user terminal upon detecting access of the user terminal. Also, the controller may position an object in the created 3D space, render a video reproduced from a user's viewpoint as a two-dimensional (2D) video, generate server data by segmenting the rendered 2D video, and transmit the generated server data to the user terminal.