Functional modeling method for indoor scene

A technology for indoor scenes and modeling methods, applied in 3D modeling, image data processing, instruments, etc., can solve problems such as difficulty in obtaining 3D models, failure to achieve functional scene reconstruction, and inability to reconstruct the interior of objects, so as to improve the interactive experience. Effect

Active Publication Date: 2014-07-09
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF3 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (1) The existing 3D modeling methods for indoor scenes are affected by factors such as relatively cluttered indoor environments and serious occlusions, making it difficult to obtain a relatively complete 3D model, and generally only reconstruct the surfaces of objects in indoor scenes. It is not possible to reconstruct the interior of objects (such as the interior of cabinets);
[0006] (2) The existing methods and technologies for 3D modeling of indoor scenes have not realized the functional reconstruction of the scene, and the reconstruction of the existing methods has lost the functional information of meaningful objects in the scene

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Functional modeling method for indoor scene
  • Functional modeling method for indoor scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] see figure 1 , which is a schematic flowchart of the method for functional modeling of indoor scenes in the present invention.

[0022] In step S101, the robot and the depth camera are first used for 3D surface reconstruction, that is, the pose of the depth camera is extracted, incorporated into the algorithm of the extended iterative closest point, and real-time registration and reconstruction of the 3D surface is carried out accordingly.

[0023] Specifically, in this step, the core is that we integrate the pose change information of the depth camera into the extended iterative closest point (ICP) algorithm, and use this method to perform real-time registration and reconstruction of the 3D surface. The ICP algorithm is widely used in the registration of 3D point cloud data and registration based on free-form surfaces. The core of the ICP algorithm is to transform the data registration problem into an exact solution problem that minimizes the distance function between...

Embodiment 2

[0053] see figure 2 , is a schematic structural diagram of the functional modeling system of the indoor scene in the present invention.

[0054] The system for functional reconstruction of the indoor scene is mainly composed of a dual-arm mobile robot 10 and a depth camera 20 .

[0055] The dual-arm mobile robot 10 has two arms with 7 degrees of freedom and each is equipped with a two-finger gripper. Its chassis is an omnidirectional mobile platform that can move freely in an indoor environment. In order for the robot 10 to firmly grasp the depth camera 20, we used a 3D printer to design and manufacture a connecting piece that is compatible with the base of the depth camera and is easy to be held by the gripper of the robot 10. The depth camera 20 is fixed on this connection. on file.

[0056] Their mutual cooperation relationship is as follows:

[0057] (1) Acquisition of the functional data of the indoor scene, using a dual-arm mobile robot to move the depth camera in th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a functional modeling method for an indoor scene. The functional modeling method includes the first step of extracting the pose of a depth camera, integrating the pose of the depth camera into an ICP algorithm and carrying out real-time registration reestablishment on three-dimensional surfaces according to the ICP algorithm, the second step of carrying out segmenting and clustering to realize semantic segmentation of the scene, the third step of extracting point-cloud sets with the area larger than a preset threshold value, the fourth step of judging whether point-cloud sets perpendicular to the ground exist, the fifth step of extracting a handle, the sixth step of pulling out the handle, recording the opening process, the closing process and the internal structure and carrying out functional labeling, the seventh step of judging whether point-cloud sets parallel to the ground exist, the eighth step of carrying out Euclid clustering and segmenting to obtain a plurality of individual objects, the ninth step of moving away the individual objects, recording blocked parts and carrying out functional labeling, and the tenth step of carrying out summarizing to obtain a functional model of the indoor scene. According to the method, functional operation can be conducted on the parts with labels, so interactive experience of users is greatly promoted.

Description

technical field [0001] The invention relates to three-dimensional modeling, in particular to a functional modeling method for indoor scenes. Background technique [0002] The digital information of the objective environment can be truly reproduced in the computer, and the environmental information can be processed and analyzed conveniently. The digital representation of the three-dimensional scene information enables the real scene to fully display the details from different perspectives. In recent years, the rapid development of a variety of 3D measurement equipment has also provided more means for 3D scene reconstruction. [0003] There are two traditional methods for 3D modeling of indoor scenes: one is to fix scene data acquisition devices, such as depth cameras, laser radars, binocular vision cameras, etc., on a certain part of the mobile robot, and then the mobile robot Navigate in the indoor environment to complete the scanning work; the other is to directly hold the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00
Inventor 黄惠龙品辛
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products