Virtual Space Representation via Spherical Mapping and Spatial Transformation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current virtual reality technologies require complex three-dimensional modeling of real spaces, consuming significant computing power and time, leading to poor user experience and practicability issues due to long waiting times and potential failures in generating virtual reality images.

Innovation Solution

A method involving the capture and processing of color and depth images from multiple observation points, superimposing these images onto spheres in a virtual space, performing spatial transformations, and shading to create virtual representations of real spaces without the need for three-dimensional modeling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If three-dimensional modeling is used to generate virtual reality image, then the virtual reality image can be generated, but the processing time and computing power required increase significantly

Engineering Contradiction:

Improvevirtual reality image generationVSAvoidprocessing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the complex three-dimensional modeling process into multiple simpler stages: capturing color images and depth images from multiple observation points, mapping them to spherical surfaces, and then performing spatial transformation. This segmentation allows each stage to be processed independently and efficiently, reducing overall processing time while maintaining image generation quality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-capturing color images and depth images from multiple observation points before generating the final virtual reality image. These pre-captured images are stored and can be quickly retrieved and processed when needed, eliminating the need for real-time three-dimensional modeling and significantly reducing processing time.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If three-dimensional modeling is used to generate virtual reality image, then the virtual reality image can be generated, but the computing power required increases significantly

Engineering Contradiction:

Improvevirtual reality image generationVSAvoidcomputing power

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent divides the computationally intensive three-dimensional modeling task into smaller, more manageable segments: capturing images from multiple viewpoints, mapping to spherical surfaces, and spatial transformation. Each segment requires less computing power individually, and they can be processed in parallel, reducing the peak computing power requirement.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Instead of performing complex three-dimensional modeling, the patent creates simplified copies of the real space by mapping captured images directly onto spherical surfaces. These spherical copies retain the essential spatial relationships and visual information needed for virtual reality viewing, but require significantly less computing power to generate and process.

Inventive Principle:

Principle #26Copying

3Reliability

If three-dimensional modeling process is complex, then detailed virtual reality image can be generated, but the ease of manufacture decreases

Engineering Contradiction:

Improvevirtual reality image qualityVSAvoidprocess complexity

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The patent inverts the traditional approach by not starting with three-dimensional modeling to generate images, but instead starting with captured images from multiple viewpoints and transforming them into a spherical virtual space representation. This inversion simplifies the process while maintaining the ability to generate high-quality virtual reality images.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The patent replaces the complex mechanical three-dimensional modeling system with a more straightforward image processing system. By using captured color images and depth images that are directly mapped to spherical surfaces, the system eliminates the need for complex geometric modeling algorithms while achieving the same virtual reality image generation goal.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240046554A1Presenting virtual representation of real space using spatial transformation

Publication Date: 2024.02.08 REALSEE (BEIJING) TECHNOLOGY CO LTD

AI summary

A method for presenting a virtual representation of a real space is provided. The method includes: obtaining a plurality of color images and a plurality of depth images respectively corresponding to the plurality of color images; for any of the plurality of observation points, superimposing a color image corresponding to the observation point and a depth image corresponding to the color image, to obtain a superimposed image; respectively mapping respective superimposed images corresponding to the plurality of observation points to a plurality of spheres in a virtual space; performing spatial transformation on vertices of the plurality of spheres in the virtual space; and for any vertex of any of the spheres, performing spatial editing and shading, so as to obtain and present respective virtual representations, in the virtual space, of respective partial scenes of a real space.