Virtual Object Rendering Across 2D Planes and 3D Depth Layers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies struggle to seamlessly transition between rendering an object as a two-dimensional video and a three-dimensional model, limiting the ability to create dynamic video representations in three-dimensional space.

Innovation Solution

An information processing apparatus and method that includes a first image processing unit for projecting an object onto a two-dimensional plane and a second image processing unit for rendering a three-dimensional model at a different location in the virtual space, allowing switchable rendering states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If an object is displayed as a two-dimensional video, then the rendering simplicity is improved, but the three-dimensional visual effect deteriorates

Engineering Contradiction:
Improverendering complexityVSAvoidthree-dimensional visual effect
Core Design Contradiction:
Device complexityVSShape

Solution Approach 1:

The display area is segmented into multiple depth layers (first depth layer, second depth layer, third depth layer) with different z-coordinate ranges. Objects are assigned to different layers based on their depth information, allowing 2D video objects to be displayed on the first depth layer while 3D model objects are displayed on the second and third depth layers. This segmentation enables simultaneous display of both 2D and 3D content with distinct visual characteristics.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a depth dimension (z-coordinate) to the traditional two-dimensional display space by creating multiple depth layers. This allows objects to be positioned at different depths along the z-axis, enabling 3D visual effects while maintaining 2D display plane. The depth layers are arranged along the optical axis direction, creating a pseudo-3D space that enhances visual engagement without requiring full 3D display hardware.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If an object is rendered as a three-dimensional model, then the visual engagement is improved, but the processing complexity worsens

Engineering Contradiction:
Improvevisual engagementVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent dynamically switches between 2D video rendering and 3D model rendering based on the object type and depth layer. The display control unit determines whether to display an object as 2D video or 3D model according to the depth layer and object characteristics. This dynamic adaptation allows the system to use computationally efficient 2D rendering for background objects while applying more intensive 3D rendering only where needed for foreground objects, optimizing processing resources.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different rendering qualities are applied to different regions and objects based on their depth layer and importance. Foreground objects on higher depth layers receive 3D model rendering with higher visual quality, while background objects on lower depth layers use 2D video rendering. This local quality differentiation ensures visual engagement for important objects while maintaining overall processing efficiency.

Inventive Principle:
Principle #3Local quality

3Device complexity

If multiple objects are displayed in a single depth layer, then the display simplicity is improved, but the depth perception worsens

Engineering Contradiction:
Improvedisplay structureVSAvoiddepth information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The display is segmented into multiple depth layers along the optical axis, with each layer having a specific z-coordinate range. Objects are distributed across different layers based on their depth information, preserving spatial relationships and depth perception. This segmentation allows the system to maintain relatively simple 2D display planes while encoding depth information through layer assignment, preventing loss of depth information.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12573134B2Information processing apparatus, information processing method, and program
Publication Date: 2026.03.10 SONY GROUP CORP
  • US12573134B2 patent drawing
  • US12573134B2 patent drawing
  • US12573134B2 patent drawing

AI summary

For example, rendering is switchable. There is provided an information processing apparatus including: a first image processing unit that projects a predetermined object onto a two-dimensional plane in a virtual space; and a second image processing unit that renders a three-dimensional model related to a predetermined object at a location that is not the two-dimensional plane in the virtual space, in which at least a first rendering state by the first image processing unit and a second rendering state by the second image processing unit are switchable.