Method for enhancing depth image of Microsoft somatosensory device

A technology of depth image and soft body perception, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of large amount of calculation, inaccurate image sequence motion estimation, etc., to improve quality, solve edge mismatch, estimate accurate effect

Inactive Publication Date: 2012-12-19
HUNAN UNIV
View PDF2 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method needs to perform motion estimation on adjacent images. Due to the influence of image noise and other factors, the motion estimation of image sequences is not very accurate, and the amount of calculation is also large.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for enhancing depth image of Microsoft somatosensory device
  • Method for enhancing depth image of Microsoft somatosensory device
  • Method for enhancing depth image of Microsoft somatosensory device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] see figure 1 , figure 1 It is a flowchart of the present invention, and its specific implementation steps are as follows:

[0038] 1. Perform edge detection on Kinect color image and depth image respectively, and obtain color image edge and depth image edge.

[0039] The color image and depth image collected from Kinect are respectively converted into 8-bit grayscale images, and then edge detection is performed on the two 8-bit grayscale images to obtain color edge images and depth edge images. The edge detection method specifically adopts the Canny edge detection algorithm (the specific implementation details of the Canny edge detection algorithm refer to the paper John Canny, "A computational approach to edge detection", published in IEEE Transactions on Pattern Analysis and Machine Intelligence in 1986. IEEE Trans. Pattern Analysis and Machine Intelligence, vol.8, no.6, pp.679-714.). Among them, the upper threshold and lower threshold of Canny edge detection are 2...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for enhancing a depth image of a Microsoft somatosensory device. The method comprises the following steps of: carrying out an edge detection on a color image and a depth image respectively, and obtaining a region at which an error pixel is located by using a region growing method in a mode of inputting two edge images; moving an error pixel depth value; constructing a smooth region around an invalid pixel by using the region growing method; estimating an invalid pixel depth value in the smooth region by using a bilateral filtering method; and estimating remaining invalid pixel depth values by using the bilateral filtering method so as to obtain the enhanced depth image. The invention points out that the problem that edges of the depth image and the corresponding color image are not matched is caused by error pixels for the first time, then provides a detection method for the error pixels, and can effectively fill cavity of a Kinect depth image; the problem that the edges of depth images are not matched is solved well, and quality of the Kinect depth image is improved greatly.

Description

technical field [0001] The invention relates to a depth image enhancement method, in particular to a depth image enhancement method of a Microsoft somatosensory device. Background technique [0002] Kinect is an inexpensive depth image acquisition device released by Microsoft. It is capable of simultaneously producing color and depth images of size 640×480 at 30fps. Due to this cheap and real-time feature, Kinect was widely used in interactive places such as hospitals, libraries, and lecture halls shortly after its release. [0003] Due to the limitation of the measurement principle, the depth image of Kinect will produce holes near the edge of the object and the surface with poor reflectivity, and the edge of the depth image and the edge of the corresponding color image often do not match. [0004] To solve the hole-filling problem, researchers have tried several filling methods. Traditional methods are mainly divided into pixel-based methods and point cloud-based method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/00
Inventor 李树涛陈理卢婷
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products