Transitioning 2D Video to Interactive 3D Game Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video streaming platforms for online multiplayer games lack interactivity for non-playing users, who can only passively watch standard video streams without engaging in the game environment.

Innovation Solution

A playback system that enables users to transition seamlessly from a 2D video to a 3D game environment, allowing users to control game characters and interact within the 3D environment by linking 2D video frames with 3D game data using reference identifiers, reducing bandwidth requirements and enabling on-demand data transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users transition from 2D video to 3D game environment, then user interactivity is improved, but data transfer requirements increase

Engineering Contradiction:
Improveuser interactivityVSAvoiddata transfer requirements
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system segments game data into two categories: 2D video data for passive viewing and 3D game data for interactive playback. The video is divided into discrete segments or clips, each associated with specific 3D game state data. This segmentation allows the system to transfer only the necessary 3D data when a user chooses to transition from passive video viewing to interactive game playback, rather than transferring all game data continuously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-processing video content into segmented clips and pre-associating them with corresponding 3D game state data during video generation. Reference identifiers are embedded in the video segments beforehand, enabling rapid transition to interactive mode without requiring real-time data processing or transfer when a user initiates game playback.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If 3D game data is transferred for interactive playback, then user engagement is improved, but bandwidth consumption increases

Engineering Contradiction:
Improveuser engagementVSAvoidbandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system implements partial action by transferring only the specific 3D game state data corresponding to the selected video segment, rather than transferring complete game data. When a user transitions from passive video viewing to interactive playback, only the minimal necessary game data for that particular segment is transferred, optimizing bandwidth utilization while maintaining user engagement.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system changes data transfer parameters dynamically based on user interaction state. During passive video viewing, minimal metadata is transferred. When a user initiates interactive game playback, the system transitions to transferring 3D game state data with appropriate compression and optimization for the specific game segment, adjusting bandwidth consumption to match actual user needs.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If video is segmented for interactive playback, then transition efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvetransition efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system introduces reference identifiers as intermediary elements that link video segments to their corresponding 3D game state data. These reference identifiers act as mediators, enabling efficient transitions between passive video viewing and interactive game playback without requiring complex real-time synchronization or data mapping logic during user interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10675542B2Method and system for transitioning between a 2D video and 3D environment
Publication Date: 2020.06.09 UNITY TECH APS
  • US10675542B2 patent drawing
  • US10675542B2 patent drawing
  • US10675542B2 patent drawing

AI summary

A system includes a display device, a memory storing 2-dimensional (2D) content and 3-dimensional (3D) game content associated with a content item, and a playback engine. The playback engine is configured to receive the 2D content, the 2D content including one or more reference identifiers (IDs), display the 2D content on the display device for a user and, during display of the 2D content, receive an indication of a transition event. The playback engine is also configured to determine a transition reference identifier (ID) from the one or more reference IDs, identify the 3D game content based on the transition reference ID, render a 3D game environment based on the 3D content, and transition the display device from the displaying the 2D content to providing the 3D game environment.