VR Content Generation for HMD and Flat-Screen Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies do not efficiently enable users to generate and share immersive game content from virtual reality experiences, particularly for social media and streaming, lacking seamless integration between head-mounted displays and flat-screen displays.

Innovation Solution

An information processing apparatus and method that generates three distinct content images: one for a head-mounted display, another for a flat-screen display, and a third that merges or separates these images, allowing users to capture and broadcast game footage with options for recording and broadcasting modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If game content is generated for head-mounted display only, then immersive VR experience is improved, but ease of sharing and broadcasting on social media deteriorates

Engineering Contradiction:
Improveimmersive VR experienceVSAvoidsharing capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The information processing apparatus generates multiple types of game content simultaneously: a first game image for HMD display providing immersive VR experience, and a second game image for flat-screen display enabling social media sharing and broadcasting. This multi-functionality allows the same game system to serve both immersive gameplay and content sharing purposes without requiring separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The game content generation is segmented into distinct processing paths: one path generates optimized content for HMD display with immersive characteristics, another path generates content for flat-screen display with sharing-oriented characteristics. This segmentation allows each content type to be optimized for its specific purpose while being generated from the same game data source.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If separate systems are used for HMD gaming and flat-screen broadcasting, then specialized functionality is improved, but device complexity deteriorates

Engineering Contradiction:
Improvedisplay compatibilityVSAvoidsystem configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A single information processing apparatus is designed to perform multiple functions: it serves as both the game execution environment for HMD and the content generation system for flat-screen broadcasting. The apparatus includes a game execution unit, a first game image generation unit, and a second game image generation unit, all integrated within one system, eliminating the need for separate dedicated systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the HMD game rendering function and the flat-screen content generation function into a single integrated system. The information processing apparatus combines the game execution engine, HMD image generation pipeline, and flat-screen image generation pipeline, allowing seamless switching and coordination between different display outputs without requiring multiple independent systems.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If game content is optimized for social media sharing, then ease of broadcasting is improved, but immersive VR experience deteriorates

Engineering Contradiction:
Improvebroadcasting easeVSAvoidVR immersion quality
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The content generation is segmented into distinct optimization paths: the first game image generation unit optimizes for HMD display with immersive characteristics such as stereoscopic rendering and field-of-view adjustments, while the second game image generation unit optimizes for flat-screen display with broadcasting-friendly characteristics such as wider aspect ratios and different camera angles. Each segment maintains its own optimization criteria without compromising the other.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality characteristics are applied locally to different output streams: the HMD output receives immersive-optimized processing including stereoscopic image generation and head-tracking synchronization, while the flat-screen output receives broadcasting-optimized processing including different resolution scaling and composition. This local quality differentiation ensures each output meets its specific requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240066394A1Information processing apparatus and image generation method
Publication Date: 2024.02.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20240066394A1 patent drawing
  • US20240066394A1 patent drawing
  • US20240066394A1 patent drawing

AI summary

Disclosed herein is an information processing apparatus including at least one processor that has hardware. The at least one processor generates a first content image in a three-dimensional virtual reality space to be displayed on a head-mounted display, generates a second content image to be displayed on a flat-screen display, and generates a third content image from the first content image and/or the second content image.