Virtual Environment Streaming Via 3D-to-2D Casting

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video communication platforms struggle to effectively integrate and display virtual environments, such as those created by VR or AR applications, within video conferences, often resulting in distorted or incompatible content due to the lack of universal casting capabilities.

Innovation Solution

A system and method that utilizes system software to capture and transform VR or AR application views into 2D video content, which is then streamed to a video conference application, allowing seamless integration and display across various devices using system-level modules and casting modules.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If VR or AR application views are directly integrated into video conferences without transformation, then the original 3D immersive experience is preserved, but the content becomes distorted or incompatible on standard 2D video conference displays

Engineering Contradiction:

Improvecompatibility across devicesVSAvoiddistortion of virtual environment content

Core Design Contradiction:

Adaptability or versatilityVSShape

Solution Approach 1:

The system transforms the virtual environment content by changing its dimensional parameters from 3D to 2D representation. The rendering engine converts three-dimensional spatial data into two-dimensional video frames that are compatible with standard video conference displays, resolving the shape distortion issue while maintaining adaptability across devices.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

A system-level casting module acts as an intermediary between the VR/AR application and the video conference platform. This mediator captures the virtual environment rendering, transforms it into appropriate video format, and streams it to the video conference, enabling compatibility without direct integration.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If system-level casting modules are implemented to transform VR/AR views into 2D video, then compatibility and clarity across devices are improved, but the system complexity increases

Engineering Contradiction:

Improvecompatibility across devicesVSAvoidsystem software integration requirements

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The casting module is designed as a universal system-level component that can handle multiple VR/AR applications and stream to various video conference platforms. By creating a multi-functional intermediary that works across different applications and platforms, the system reduces overall complexity despite the added transformation capability.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Ease of operation

If 3D transformations are applied to convert virtual environment views into 2D video content, then the content becomes viewable on standard displays, but processing time and computational resources increase

Engineering Contradiction:

Improveviewability on standard displaysVSAvoidprocessing time for transformation

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary rendering of the virtual environment at the source device, preparing the 3D content for transmission. By pre-processing and capturing the rendered frames before transmission to the video conference platform, the system reduces real-time processing requirements and minimizes delays in the transformation process.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20250310482A1Virtual Environment Streaming To A Video Conference

Publication Date: 2025.10.02 ZOOM COMMUNICATIONS INC

AI summary

A virtual reality (VR) device may connect to a video conference. The VR device may capture a three-dimensional (3D) virtual environment view. The VR device may convert the 3D virtual environment view to a two-dimensional (2D) video. The VR device may transmit the 2D video to the video conference.