Boundary feature preserved depth image enhancement method

A depth image and boundary feature technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of inaccurate depth value filling in holes, poor edge retention characteristics of objects, inaccurate depth filling, etc., and achieve boundary preservation Feature integrity, feature integrity, and the effect of avoiding blurring of non-void areas

Active Publication Date: 2018-05-04
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current depth image enhancement method mainly has the defects of inaccurate filling of the depth value at the hole and poor object edge preservation characteristics. The similarity between the pixels of the color image corresponding to the image is used as the basis for depth diffusion, and the depth filling of the hole area is completed based on the known depth of the depth image
However, this method fills the sa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Boundary feature preserved depth image enhancement method
  • Boundary feature preserved depth image enhancement method
  • Boundary feature preserved depth image enhancement method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to better illustrate the purpose and advantages of the present invention, the specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings and examples.

[0057] A depth image enhancement method that preserves object boundary features disclosed in this embodiment, the specific implementation steps are as follows:

[0058] Step 1: Calibrate the color camera and the depth sensor respectively, and obtain a color-depth image group corresponding to pixels at the same row and column position in the color image and the depth image.

[0059] Use the color image captured by the color camera and the depth image of the same scene acquired by the depth sensor to calibrate the color camera and depth camera, and obtain a color-depth image group corresponding to the same row and column position pixels in the color image and depth image.

[0060] The preferred Kinect sensor of the depth sensor, such as figure ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a boundary feature preserved depth image enhancement method and belongs to the field of depth image processing. The implementation method includes: calibrating a color camera and a depth camera to acquire color-depth image group with pixels being in one-to-one correspondence; subjecting a depth image to mid-value filtering processing to acquire a depth image reliable in depth value; acquiring a cavity mask of the depth image reliable in the depth value and determining the boundary direction of a cavity by adopting Sobel gradient transformation; subjecting the acquired color image and cavity mask to directional combined bilateral filtering to acquire the enhanced depth image; calculating cavity pixel percentage HPP of the enhanced depth image; subjecting the depth image reliable in depth to interative filtering to acquire depth value of the cavity area of the depth image and filing the cavity area of the depth image. Through iterative condition judgment, denoising and cavity filling of the depth image are realized, and the final enhanced depth image capable of keeping the image quality clear and features complete is outputted.

Description

technical field [0001] The invention belongs to the field of depth image processing, in particular to a depth image enhancement method for preserving boundary features. Background technique [0002] In recent years, stereoscopic imaging technology has developed rapidly. The depth image containing scene depth information is an important clue for environment perception and scene understanding, and has been widely used in the field of computer vision, such as: robot navigation, human-computer interaction, 3D scene reconstruction, etc. At present, there are mainly two types of sensors for obtaining depth information: one is a depth sensor based on ToF technology, and the other is a depth sensor based on structured light technology. Depth sensors based on ToF technology measure spatial distance using the time-of-flight of pulsed light of a specific frequency in space. This technology has the disadvantages of low resolution of the acquired depth image, and the ambient light can s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T7/80
CPCG06T5/002G06T2207/10028G06T2207/20028G06T2207/20032G06T7/80
Inventor 曹杰郝群周自顾徐成强张韶辉
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products