2D Video Projected onto Virtual Surfaces in Modeled 3D Space

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display systems limit 2D video content to traditional flat viewing modes, lacking the context and immersion provided by virtual reality (VR) and augmented reality (AR) systems, where users cannot seamlessly transition between 2D and 3D content experiences.

Innovation Solution

A multimedia distribution system that enables 2D video content to be projected onto specified surfaces within modeled 3D spaces, allowing users to view 2D content in either 2D or 3D modes using VR/AR capabilities, with the system monitoring user pose to update the projection accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If 2D video content is displayed in traditional flat mode, then compatibility with conventional display systems is maintained, but immersion and context are lost

Engineering Contradiction:
Improvedisplay mode compatibilityVSAvoidimmersion and context
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent transforms 2D video content into a 3D projected viewing experience by mapping video frames onto virtual surfaces within a modeled 3D space. This dimensional transition allows users to view 2D content with depth perception and spatial context, resolving the contradiction between maintaining compatibility and preserving immersion.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If VR/AR systems display only native 3D content, then immersion is maximized, but users cannot view traditional 2D video content

Engineering Contradiction:
Improvecontent format supportVSAvoid2D video accessibility
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system enables VR/AR headsets to display both native 3D content and traditional 2D video content through a unified rendering pipeline. By projecting 2D video onto virtual surfaces in the 3D environment, the system makes VR/AR devices universal platforms that can handle multiple content formats, resolving the contradiction between maximizing immersion and maintaining broad content compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If 2D video is projected into 3D space, then immersion and engagement are enhanced, but system complexity increases

Engineering Contradiction:
Improveviewing experience qualityVSAvoidprojection system requirements
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces a projection surface as an intermediary between the 2D video content and the 3D viewing environment. This virtual surface acts as a mediator that receives 2D video frames and presents them within the 3D space, simplifying the rendering process while maintaining immersion and engagement quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of operation

If static projection surfaces are used, then system complexity is reduced, but user interaction and engagement are limited

Engineering Contradiction:
Improvesystem operation simplicityVSAvoiduser interaction capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system transitions from static projection surfaces to dynamic, user-controllable projection surfaces. Users can interact with the virtual environment to move, rotate, and reposition projection surfaces, allowing the system to adapt to user preferences and actions while maintaining ease of operation through intuitive controls.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10909761B12D video with option for projected viewing in modeled 3D space
Publication Date: 2021.02.02 GOOGLE LLC
  • US10909761B1 patent drawing
  • US10909761B1 patent drawing
  • US10909761B1 patent drawing

AI summary

A multimedia distribution system enables a user to view 2D video content in a conventional 2D or “flat” viewing mode, or if the system is VR/AR enabled and the user is so inclined, a representation of a modeled 3D space may be provided or accessed in association with the 2D video content, and the 2D video content may be projected onto a specified surface within the modeled 3D space for viewing by the user as though the 2D video were being displayed at that surface/location within the modeled 3D space. Further, the pose of the user may be monitored and the projection of the 2D video content updated accordingly to match the user's current pose and view into the modeled 3D space.