Distributed Rendering for Composite Virtual Reality Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality and mixed reality systems face challenges in rendering a large number of virtual bodies due to limited computational resources, requiring all three-dimensional objects to be retained on a single information processing apparatus for composite imaging.

Innovation Solution

An information processing system comprising multiple apparatuses, where each stores and renders different virtual bodies, allowing composite images to be generated without needing all data on one device, and includes mechanisms for secure data retention and conditional image generation to prevent unauthorized access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a single information processing apparatus is used to render all virtual bodies, then all three-dimensional objects can be retained in one location, but the computational resources are insufficient for high-quality rendering of an enormous number of virtual bodies

Engineering Contradiction:
Improvenumber of virtual bodiesVSAvoidcomputational resources
Core Design Contradiction:
Quantity of substanceVSPower

Solution Approach 1:

The system divides the rendering workload by separating three-dimensional objects into different groups and assigning them to different rendering units. Each rendering unit renders a specific group of objects, and the rendered images are then composited together. This segmentation allows the system to handle a large number of virtual bodies without overwhelming the computational resources of a single apparatus.

Inventive Principle:
Principle #1Segmentation

2Power

If multiple rendering units are used to render different groups of three-dimensional objects, then computational resources are distributed, but at least one device needs to retain information of all three-dimensional objects to perform compositing

Engineering Contradiction:
Improvecomputational resourcesVSAvoiddata storage requirements
Core Design Contradiction:
PowerVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary rendering results (two-dimensional images and depth information) from the rendering units and transmits them to the compositing device. The original three-dimensional object data remains stored only at the respective rendering units, not replicated at the compositing device. This extraction approach allows compositing to be performed with minimal data transmission while avoiding the need for one device to retain all three-dimensional object information.

Inventive Principle:
Principle #2Taking out (Extraction)

3Ease of operation

If all three-dimensional objects are retained on a single apparatus for composite imaging, then compositing can be performed centrally, but security risks increase due to unauthorized data sharing

Engineering Contradiction:
Improvecompositing operationVSAvoiddata security
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system segments the three-dimensional objects into different groups that are managed by different rendering units. Each rendering unit retains only the data for its assigned objects, preventing unauthorized access to all objects. The compositing operation works with rendered images rather than original object data, maintaining security while enabling centralized compositing functionality.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250209764A1Information processing system and method of controlling information processing system capable of providing composite image of plurality of images
Publication Date: 2025.06.26 CANON KK
  • US20250209764A1 patent drawing
  • US20250209764A1 patent drawing
  • US20250209764A1 patent drawing

AI summary

An information processing system includes a first information processing apparatus that stores information of a first object, and a second information processing apparatus that stores information of a second object different from the first object. The first information processing apparatus generates a first image including a rendering of the first object, on the basis of position-orientation information of a first body and information of the first object. The second information processing apparatus generates a second image including a rendering of the second object, on the basis of the position-orientation information of the first body and information of the second object. The first information processing apparatus further generates an image that is a composite of the first image and the second image.