3D Virtual Scene Generation Using 2D Object Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual generation of three-dimensional virtual scenes in virtual world applications is inefficient, especially when dealing with dense 3D objects, as it becomes difficult to accurately place models due to obstructed views and the need to insert objects one by one.

Innovation Solution

A method and apparatus that identify 2D objects in a 2D picture, calculate their corresponding positions in a 3D scene, and simulate the falling of 3D objects from a predetermined height to determine accurate placement, simplifying the process of generating 3D scenes by using a 2D object identifying device, model acquiring device, position mapping device, and simulation device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual insertion of 3D objects one by one is used, then the user has control over object placement, but the operation time and complexity increase significantly

Engineering Contradiction:
Improveease of object placementVSAvoidtime for scene generation
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system pre-processes the 2D reference image to identify object positions and corresponding 3D model positions before actual placement. This preliminary analysis enables automated batch placement of multiple 3D objects simultaneously, eliminating the need for manual one-by-one insertion while maintaining accurate positioning control.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If dense 3D objects are placed in the scene, then the scene becomes more detailed and realistic, but the operator's view becomes obstructed making accurate placement difficult

Engineering Contradiction:
Improveplacement accuracyVSAvoidvisibility of placement position
Core Design Contradiction:
Manufacturing precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The system introduces a 2D reference image as an intermediary between the operator and the 3D scene. This 2D image serves as a visual guide that is not obstructed by 3D objects, allowing the operator to see and accurately place objects even in dense scenes. The 2D reference image acts as a mediator that preserves visibility while enabling precise placement.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automated methods are used to generate 3D scenes, then productivity increases, but the complexity of the generation system increases

Engineering Contradiction:
Improvescene generation efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system uses a 2D reference image (which can be a simple photograph or sketch) as a template to generate the 3D scene. By copying the spatial relationships and object positions from the 2D image, the system automates the scene generation process without requiring complex 3D modeling tools or expertise, thus increasing productivity while keeping the system relatively simple.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach simplifies the generation of 3D virtual scenes by allowing for the automatic placement of 3D objects based on 2D representations, reducing the complexity and accuracy issues associated with manual placement in dense scenes.

Implementation Method 1

simulating the falling of a model of a three-dimensional (3D) object onto a 3D scene from a predetermined height above the 3D scene

Methodology Applied
Scientific EffectFree fall: Free Fall

Data Source

PatentUS20230071026A1Generating three-dimensional virtual scene
Publication Date: 2023.03.09 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20230071026A1 patent drawing
  • US20230071026A1 patent drawing
  • US20230071026A1 patent drawing

AI summary

A method and system for generating a three-dimensional (3D) virtual scene are disclosed. The method includes: identifying a two-dimensional (2D) object in a 2D picture and the position of the 2D object in the 2D picture; obtaining the three-dimensional model of the 3D object corresponding to the 2D object; calculating the corresponding position of the 3D object corresponding to the 2D object in the horizontal plane of the 3D scene according to the position of the 2D object in the picture; and simulating the falling of the model of the 3D object onto the 3D scene from a predetermined height above the 3D scene, wherein the position of the landing point the model of the 3D object in the horizontal plane is the corresponding position of the 3D object in the horizontal plane of the 3D scene.