Scene reconstruction method based on smart phone

A smart phone and scene reconstruction technology, applied in the field of computer vision, can solve the problems of not being portable, too large to be carried around, high cost and difficult to popularize, and achieve fast and convenient 3D reconstruction, easy popularization and low cost

Inactive Publication Date: 2017-08-29
HANGZHOU DIANZI UNIV
View PDF5 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention mainly considers that the existing scene reconstruction system based on RGB-D is relatively large in size and difficult to carry around, high in cost and difficult to popularize. Can not meet the requirements of portability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scene reconstruction method based on smart phone
  • Scene reconstruction method based on smart phone
  • Scene reconstruction method based on smart phone

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present invention will be described in detail below in combination with specific embodiments.

[0044] The smart phone-based scene reconstruction method proposed by the present invention is implemented according to the following steps.

[0045] Step 1. Design a smart phone APP to call the color camera on the smart phone, connect the depth camera structure sensor to the smart phone and fix it, and design a function to start the depth camera and transmit the depth information obtained from the depth camera to the mobile phone. Write specific functions to capture RGB information on the color camera and depth information on the depth camera at a specific point in time. exist figure 1 In , the smartphone camera is tested from state 0 to state 1, i.e. the performance of the color camera gets its resolution. After connecting the depth camera, go from state 1 to state 2, and test the performance of the depth camera to get its resolution.

[0046] Step 2, in figure 1 In ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a scene reconstruction method based on a smart phone. The method comprises: 1) calculating the internal camera parameter matrix of the color camera of a smart phone; 2) connecting and fixing a depth camera with the smart phone; and calculating the internal camera parameter matrix and its zoom factor corresponding to the depth camera; 3) calculating the external parameter matrix of the color camera corresponding to the depth camera; 4) using the panorama videos of the scene photographed by the color camera of the smart phone and the depth camera; then, converting the videos into image sequences; and through the obtained external parameter matrix and the internal parameter matrix, combining the image sequences into an RGB-D four-channel sequence; 5) calculating the transform matrixes corresponding to the adjacent two frames in the RGB-D; and 6) through the RGB-D and the transform matrixes, creating the three-dimensional space point cloud sets for the scene and then, through the affine transformation, displaying the point cloud sets on the display screen of the smart phone. The invention can be portably carried and easily shaped.

Description

technical field [0001] The invention belongs to the field of computer vision, and is especially aimed at three-dimensional scene reconstruction, and in particular relates to a scene reconstruction method based on a smart phone. Background technique [0002] Scene reconstruction is an important field of virtual reality research, and the virtual realization of indoor environment has aroused strong interest of researchers in recent years. Virtual roaming in indoor environments has a strong application background. For example, virtual offices, museums, caves, etc. have been applied to telecommuting, education, entertainment, and tourism industries. The image-based scene reconstruction technology uses a color camera and a depth camera to obtain color information and depth information in the scene at the same time. Compared with traditional 3D scanning equipment, the image-based scene reconstruction technology produces a system with low price, compact structure, and easy to use. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/80G06T7/38G06T7/55
CPCG06T2207/10016G06T2207/10024G06T2207/10028H04M1/72409
Inventor 朱尊杰颜成钢徐枫龚冰剑黄海亮
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap