VR Image Rendering for Multi-User Immersion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies fail to provide an immersive experience when users are in different locations, and network errors can disrupt the shared experience, lacking effective methods to maintain interaction and minimize disturbances during content appreciation.

Innovation Solution

An electronic apparatus and system that renders and transmits Virtual Reality (VR) images by processing motion information from multiple display devices, allowing synchronized rendering and transmission of VR content, including object movements and sound, to ensure a shared immersive experience across different locations, even in the presence of network errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If VR images are transmitted in real-time between users in different locations, then interaction and immersion are improved, but network errors and disruptions increase

Engineering Contradiction:
Improveinteraction experienceVSAvoidnetwork stability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary actions by predicting user motion and pre-rendering VR images before they are actually needed. The server predicts future head positions and orientations, prepares corresponding VR images in advance, and stores them for immediate transmission, thus maintaining real-time interaction while reducing network dependency during actual viewing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system cushions against network errors by implementing error correction codes and redundant transmission mechanisms. When network packets are lost or corrupted, the server can retransmit critical data or provide alternative lower-quality streams, ensuring continuous playback without disrupting the immersive experience.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Manufacturing precision

If high-resolution VR images are transmitted to maintain image quality, then immersion is improved, but data transmission requirements and network bandwidth increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The VR image transmission is segmented into multiple components: base layer information transmitted to all users, and additional detail layers transmitted selectively based on user position and device capabilities. This segmentation allows the system to maintain high image quality where needed while reducing overall data transmission volume.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies local quality enhancement by transmitting high-resolution data only for the specific region of the VR image that corresponds to the user's current field of view, while using lower resolution for peripheral areas. This ensures immersion is maintained in the critical viewing area without unnecessarily increasing overall data transmission.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If motion information from multiple display devices is processed to synchronize VR experiences, then interaction among users is improved, but system complexity increases

Engineering Contradiction:
Improvemulti-user interactionVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The server acts as an intermediary that centralizes the complex task of processing motion information from multiple display devices. Instead of each device needing to directly communicate and synchronize with every other device, they all send motion data to the server, which processes it and distributes synchronized VR images, thereby reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The server implements a universal processing platform that handles multiple functions: receiving motion information from various display devices, predicting user motion, rendering VR images, applying error correction, and distributing content to multiple users simultaneously. This multi-functionality reduces the need for separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11132054B2Electronic apparatus, control method thereof and electronic system
Publication Date: 2021.09.28 SAMSUNG ELECTRONICS CO LTD
  • US11132054B2 patent drawing
  • US11132054B2 patent drawing
  • US11132054B2 patent drawing

AI summary

An electronic apparatus is provided. The electronic apparatus according to an embodiment includes a storage, a communicator comprising communication circuitry, and a processor configured to render a virtual reality (VR) image including a first object corresponding to a first display device based on VR image information stored in the storage, wherein the processor is further configured to receive motion information of a second display device from the second display device through the communicator, to render one area of the VR image including the first object based the first object being included in a view of a second object corresponding to the second display device based on the motion information of the second display device, and to control the communicator to transmit the rendered one area of the VR image to the second display device.