3D Content Rendering with Viewpoint Data for Immersive Replay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing internet live broadcasting technologies fail to provide viewers with a realistic sensation and sense of immersion, especially in later viewing reproductions, and impose high communication and terminal hardware loads when sharing live content with multiple viewers.
Innovation Solution
A three-dimensional content distribution system that records and generates image data using virtual three-dimensional virtual space data, allowing viewers to interactively participate and modify content through a three-dimensional virtual space, reducing network and terminal loads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pre-rendered three-dimensional images are transmitted to each viewer terminal, then each viewer can obtain a personalized reproduction image, but the communication load and terminal hardware load increase significantly
Solution Approach 1:
The patent segments the three-dimensional content into two distinct data types: viewpoint information (position and direction of the virtual camera) and basic content data (three-dimensional coordinates and appearance of virtual objects). Only the lightweight viewpoint information is transmitted to each terminal, while the basic content data is shared universally. This segmentation enables personalized rendering without proportionally increasing data transmission volume.
Solution Approach 2:
Instead of transmitting complete pre-rendered images to each terminal, the patent transmits compact viewpoint information that serves as a template for local reproduction. Each terminal copies the basic content data from the server and uses it locally to generate personalized images based on the transmitted viewpoint information, dramatically reducing communication load while maintaining reproduction quality.
2Manufacturing precision
If complete three-dimensional content data is transmitted to each terminal for local rendering, then viewing quality is maintained, but terminal hardware load increases
Solution Approach 1:
The patent divides the rendering task between server and terminal. The server performs complex operations including three-dimensional coordinate calculations, collision detection, and determination of object visibility. The terminal only performs simpler operations using transmitted viewpoint information and basic content data. This segmentation maintains rendering quality while reducing terminal hardware load.
Solution Approach 2:
The server performs computationally intensive preprocessing operations before transmission, including calculating three-dimensional coordinates of virtual objects, determining which objects are visible from the given viewpoint, and preparing basic content data. This preliminary action transfers the heavy processing burden to the server, allowing terminals to render images with minimal computational resources.
3Adaptability or versatility
If pre-rendered images are used for later viewing, then content can be viewed after live broadcasting, but the sense of immersion and realism is lost
Solution Approach 1:
The patent enables dynamic reproduction by transmitting viewpoint information that allows terminals to render three-dimensional images in real-time based on the virtual camera's position and direction. This dynamic rendering process maintains the sense of immersion and realism in later viewing, unlike static pre-rendered images, while still allowing flexible viewing after live broadcasting concludes.
Data Source
AI summary
The present disclosure causes live content to be drawn on the basis of specification data on a virtual object, operation data on the virtual object, and the like, and causes the drawn content to be provided for viewing reproduction on a terminal for viewing.