System for modeling 3D scene from single design picture

A picture modeling and 3D technology, applied in the field of computer vision, can solve problems such as wasting time, achieve the effect of reducing construction time and speeding up construction

Pending Publication Date: 2021-07-23
上海随幻智能科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And for another application scene, although the previous object materials ca

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System for modeling 3D scene from single design picture
  • System for modeling 3D scene from single design picture
  • System for modeling 3D scene from single design picture

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0046] Example 1

[0047] The present invention provides a system for modeling 3D scenes from a single design picture, please refer to Figure 1-Figure 3 , including the following steps:

[0048] Rendering: In the rendering engine, objects are randomly arranged to obtain the rendering result map and the data set of the 3D object transformation matrix of each object;

[0049] Extracting models: using deep learning networks to extract predictive models from datasets;

[0050] Instance segmentation: Input a single scene design picture, predict the result of instance segmentation and the transformation matrix of the 3D object of each instance;

[0051] Modeling: Place the object corresponding to a single instance into the scene with the guidance of the transformation matrix to complete the result modeling.

[0052] Further, the data set adopts the InGame loading material method, and the method steps are as follows:

[0053] Randomly load models from the model library and place...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of computer vision, in particular to a system for modeling a 3D scene from a single design picture. The method comprises the following steps: rendering: randomly arranging objects in a rendering engine to obtain a rendering result graph and a data set of a 3D object transformation matrix of each object; model extraction: extracting a prediction model from the data set by using a deep learning network; instance segmentation: inputting a single scene design picture, and predicting an instance segmentation result and a transformation matrix of a 3D object of each instance; and modeling: placing an object corresponding to a single instance in a scene under the guidance of the transformation matrix to complete result modeling. According to the method, instance segmentation is performed by using the deep neural network MaskR-CNN to obtain the images of a 2D object bounding box and a bounding box area, and the 3D scene arrangement is automatically completed by a single design picture according to the 2D plane mapping of the 3D object corresponding to the instance segmentation result, so that the scene construction time can be greatly shortened, and the scene construction speed is increased.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a system for modeling a 3D scene from a single design picture. Background technique [0002] 3D modeling is widely used in construction, home improvement, virtual city, ARVR, 3D games and other fields. Putting the model into the rendering engine can render 3D images offline or in fact. Arranging the model in the scene to form the entire scene material is called building the scene, which is generally constructed by 3D artists using 3D modeling software. The construction of the scene has a very important impact on the overall final rendering effect. [0003] However, the traditional scene construction method requires a lot of communication and manual adjustments to polish a scene. The UI designer is required to first produce a single scene design drawing (2D), and then the 3D artist makes the layout of the 3D scene according to the design drawing. No matter in terms of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A63F13/60G06T17/10G06T7/10G06K9/62G06N3/08G06N3/04
CPCA63F13/60G06T17/10G06T7/10G06N3/08G06T2207/10012G06N3/045G06F18/2411
Inventor 谭彬
Owner 上海随幻智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products