Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, system and computing device for generating high-resolution depth map

A high-resolution, depth map technology, applied in the field of computer vision, can solve problems such as poor display effect and wrong depth data, and achieve the effect of fast calculation speed, wide application value and good display effect.

Active Publication Date: 2013-12-11
TCL CORPORATION
View PDF5 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to provide a method for generating a high-resolution depth map, aiming at solving the problem of using an up-sampling algorithm to directly convert a low-resolution depth map into a required high-resolution depth map in the prior art. The contour edge in the resolution depth map will produce wrong depth data due to the data smoothing effect, and the display effect is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and computing device for generating high-resolution depth map
  • Method, system and computing device for generating high-resolution depth map
  • Method, system and computing device for generating high-resolution depth map

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] Embodiment 1 of the present invention proposes a method for generating a high-resolution depth map, such as figure 1 shown, including:

[0032] Step S1: collecting a low-resolution depth map and a first low-resolution brightness map of the same scene, where the size of the first low-resolution brightness map and the low-resolution depth map are the same.

[0033] In Embodiment 1 of the present invention, the existing depth image sensor can be used to realize the collection of the low-resolution depth map and the first low-resolution brightness map. For example, the Microsoft kinect depth image sensor can be used to simultaneously collect the same scene with the same size A low-resolution depth map and a first low-resolution luminance map.

[0034] Step S2: Perform up-sampling processing on the low-resolution depth map to obtain a high-resolution rough depth map, calculate the image contour in the high-resolution rough depth map, and obtain a contour map corresponding t...

Embodiment 2

[0064] Embodiment 2 of the present invention proposes a system for generating a high-resolution depth map, such as Figure 5 As shown, for ease of description, only the part related to Embodiment 2 of the present invention is shown.

[0065] In detail, the system for generating a high-resolution depth map proposed in Embodiment 2 of the present invention includes: an image acquisition module 1, configured to acquire a low-resolution depth map and a first low-resolution brightness map of the same scene, and the first low-resolution The size of the high-resolution brightness map is consistent with the size of the low-resolution depth map; the first image processing module 2 is used to perform up-sampling processing on the low-resolution depth map to obtain a high-resolution rough depth map, and calculate the high-resolution rough depth map. Image contour, obtain the contour map corresponding to the high-resolution rough depth map, the size of the high-resolution rough depth map ...

Embodiment 3

[0073] Embodiment 3 of the present invention proposes a computing device, including the system for generating a high-resolution depth map as described in Embodiment 2 above, which will not be repeated here.

[0074] In summary, the method and system for generating a high-resolution depth map proposed by the present invention is to convert the low-resolution depth map into a high-resolution rough depth map by using an upsampling algorithm, and then further obtain the high-resolution rough depth map The contour map of the contour map, and then use the low-resolution brightness map to find the block that is most similar to each overlapping contour block in the contour map in the low-resolution depth map, and then use the weighted splicing method to fill the found blocks. Input the corresponding position of the high-resolution coarse depth map to obtain the high-resolution depth map. Compared with the existing technology, after the high-resolution rough depth map is obtained, the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of computer vision, and provides a method, a system and a computing device for generating a high-resolution depth map. The method and the system adopt an up-sampling algorithm to convert a low-resolution depth map into a high-resolution rough depth map, and then a skeleton map of the high-resolution rough depth map is further obtained. Then a low-resolution brightness map is utilized, and blocks which are most similar to each overlapping skeleton block in the skeleton map are searched in the low-resolution depth map. After that, a weighted stitching mode is adopted to fill the searched blocks into the corresponding positions of the high-resolution rough depth map so that the high-resolution depth map is obtained. As pixel information in the low-resolution depth map is supplemented to the high-resolution rough depth map, error depth data generated on the skeleton edge caused by data smoothing effect is corrected, a defect of simply applying the up-sampling mode is compensated and thus the obtained final high-resolution depth map is great in display effect. Besides, computing speed is fast.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a method, system and computing device for generating a high-resolution depth map. Background technique [0002] In the field of computer vision, the depth map is used to represent the distance of each point in the scene relative to the camera, that is, each pixel in the depth map represents the distance between a point in the scene and the camera. Since the commercial application of Microsoft's kinect depth image sensor, more services and products based on three-dimensional depth images have emerged, such as Microsoft's xbox One somatosensory game console and Leap motion's somatosensory controller. [0003] Most of the depth images collected by current depth image sensors are low-resolution depth maps. In order to obtain high-resolution depth maps, the existing technology uses upsampling algorithms such as bilateral Upscaling is performed to directly convert a low-reso...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/00G06T5/00
Inventor 闫晓林邵诗强谭文伟付东
Owner TCL CORPORATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products