Depth camera based on structured light and stereo vision

A technology of structured light and depth camera, applied in the field of image processing

Inactive Publication Date: 2012-03-21
MICROSOFT TECH LICENSING LLC
View PDF6 Cites 86 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, various challenges exist due to variables such as lighting conditions, surface texture and color, and likelihood of occlusion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth camera based on structured light and stereo vision
  • Depth camera based on structured light and stereo vision
  • Depth camera based on structured light and stereo vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] A depth camera is provided for use in tracking one or more objects in the field of view. In an example implementation, the depth camera is used in a motion tracking system to track a human user. The depth camera includes two or more sensors optimized to account for variables such as lighting conditions, surface texture and color, and likelihood of occlusion. This optimization may include optimizing the placement of the sensors with respect to each other and with respect to the illuminators, as well as optimizing the spatial resolution, sensitivity and exposure time of the sensors. The optimization may also include optimizing how the depth map data is acquired, such as by matching frames of pixel data to patterns of structured light and / or by matching one frame of pixel data to another.

[0029] The use of multiple sensors as described herein provides advantages over other methods. For example, real-time depth cameras other than stereo cameras often provide depth maps ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a depth camera based on structured light and stereo vision A depth camera system uses a structured light illuminator and multiple sensors such as infrared light detectors, such as in a system which tracks the Motion of a user in a field of view. One sensor can be optimized for shorter range detection while another sensor is optimized for longer range detection. The sensors can have a different baseline distance from the illuminator, as well as a different spatial resolution, exposure time and sensitivity. In one approach, depth values are obtained from each sensor by matching to the structured light pattern, and the depth values are merged to obtain a final depth map which is provided as an input to an application. The merging can involve unweighted averaging, weighted averaging, accuracy measures and / or confidence measures. In another approach, additional depth values which are included in the merging are obtained using stereoscopic matching among pixel data of the sensors.

Description

technical field [0001] The invention relates to image processing technology, in particular to the acquisition of depth data. Background technique [0002] A real-time depth camera is capable of determining the distance to a human or other object within the camera's field of view and updating that distance in substantially real-time based on the camera's frame rate. Such a depth camera may be used, for example, in a motion capture system to acquire data about the position and movement of a human body or other subject in physical space, and this data may be used as input to an application in a computing system. There can be many applications such as for military, entertainment, sports and medical purposes. Typically, a depth camera includes an illuminator that illuminates a field of view, and an image sensor that senses light from the field of view to form an image. However, various challenges exist due to variables such as lighting conditions, surface texture and color, and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G03B35/08G03B15/05H04N5/232
CPCH04N13/0253G06T2207/30196G01S3/7864G06F3/017G06T7/0057G06T7/0075H04N13/025G06F3/0304H04N13/0271G06T7/521G06T7/593H04N13/254H04N13/271H04N13/25G03B21/14G03B21/20
Inventor S·卡茨A·阿德勒
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap