Depth-Keying Web Content for Immersive HMD Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality (VR) technologies struggle to efficiently convert traditionally 2-dimensional web content into 3-dimensional formats for head-mounted displays (HMDs), resulting in a lack of immersive experiences when viewing webpages and online stores, as they retain their 2-dimensional properties.

Innovation Solution

The method involves assigning depth values to displayable objects within web content, using stereoscopy logic to render stereoscopic images for the left and right eyes, allowing HMD users to perceive objects at specific depths, thereby creating a 3-dimensional view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If web content is displayed on HMD without depth values, then the content remains compatible with traditional 2D displays, but the content loses immersive 3D experience and depth perception

Engineering Contradiction:
Improveimmersive 3D experienceVSAvoidcontent creation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-assigning depth values to displayable objects during webpage creation. Depth values are embedded in the webpage code (HTML/CSS) before the content is even viewed on an HMD, allowing the rendering system to automatically generate stereoscopic images without requiring complex real-time processing or manual 3D modeling.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements parameter changes by introducing depth values as a new parameter that can be assigned to web content elements. This parameter controls the stereoscopic shift amount in the rendered images, transforming 2D flat content into 3D immersive experiences through simple parameter assignment rather than complete content redesign.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If depth values are assigned to all displayable objects, then every object can be rendered with proper depth perception, but the processing complexity and computational load increase

Engineering Contradiction:
Improvedepth rendering accuracyVSAvoidstereoscopy processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling web developers to assign depth values directly to content elements using familiar HTML/CSS syntax. The system then automatically processes these depth values to generate appropriate stereoscopic rendering, eliminating the need for specialized 3D content creation tools or complex manual configuration.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If stereoscopic rendering is applied to web content, then 3D depth perception is achieved, but the compatibility with standard web browsers and display devices is reduced

Engineering Contradiction:
Improve3D view capabilityVSAvoidwebpage development ease
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent implements universality by designing a depth value assignment system that works across multiple platforms and devices. The same HTML/CSS-based depth keying approach can be used whether the content is viewed on HMDs, VR headsets, or even standard displays with depth simulation, making the solution broadly applicable without requiring device-specific content creation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables web developers to provide immersive 3-dimensional views of web content, enhancing user engagement by rendering objects at varying depths, thereby utilizing the 3D capabilities of HMDs and improving the overall VR experience.

Implementation Method 1

The computing device is configured to process the pre-assigned depth values using a stereoscopy logic, which is able to render a right eye image to be displayed by the right eye display as well as a left eye image to be displayed by the left eye display. The left eye image and the right eye image will include the displayable objects having been stereoscopically shifted according to their respective depth values.

Methodology Applied
Scientific EffectStereoscopy: Parallax

Data Source

PatentUS11086396B2Depth-keying of web content
Publication Date: 2021.08.10 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11086396B2 patent drawing
  • US11086396B2 patent drawing
  • US11086396B2 patent drawing

AI summary

Methods and systems are provided for enabling a head mounted display (HMD) user to view web content in 3-dimensional views. A computer-implemented method includes accessing a webpage having content items and detecting that the HMD user's field of view is being directed at one or more of the content items. The method further identifies pre-assigned depth values for one or more displayable objects of the content items, wherein the pre-assigned depth values specify an apparent depth that the one or more objects are to be displayed via the HMD. Moreover, the method applies the pre-assigned depth values to the displayable objects for rendering a 3-dimensional view with the displayable objects appearing to the HMD user at a depth corresponding to the pre-assigned depth values.