Mobile camera localization using depth maps

A technology of depth camera and depth map, which is applied in image analysis, image enhancement, image data processing, etc., and can solve problems such as difficulty in detecting depth map features

Active Publication Date: 2012-07-25
MICROSOFT TECH LICENSING LLC
View PDF5 Cites 65 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Detecting features in depth maps can be more difficult due to differences in available information compared to color map images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile camera localization using depth maps
  • Mobile camera localization using depth maps
  • Mobile camera localization using depth maps

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The detailed description provided below in connection with the accompanying drawings is intended as a description of examples of the invention and is not intended to represent the only forms in which examples of the invention may be constructed or used. This description sets forth the functionality of an example of the invention, and a sequence of steps for building and operating the example of the invention. However, the same or equivalent functions and sequences can be implemented by different examples.

[0026] Although the examples are implemented herein in a real-time camera tracking system using depth images obtained from mobile depth cameras emitting and capturing infrared light, the described system is provided as an example and not a limitation. Those skilled in the art will appreciate that this example is suitable for use in a variety of different types of real-time camera tracking systems, including but not limited to systems using depth information obtained ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Mobile camera localization using depth maps is described for robotics, immersive gaming, augmented reality and other applications. In an embodiment a mobile depth camera is tracked in an environment at the same time as a 3D model of the environment is formed using the sensed depth data. In an embodiment, when camera tracking fails, this is detected and the camera is relocalized either by using previously gathered keyframes or in other ways. In an embodiment, loop closures are detected in which the mobile camera revisits a location, by comparing features of a current depth map with the 3D model in real time. In embodiments the detected loop closures are used to improve the consistency and accuracy of the 3D model of the environment.

Description

technical field [0001] The present invention relates to mobile camera localization using depth maps. Background technique [0002] Mobile camera localization involves finding the position and orientation of a camera moving in its environment, and is critical for many applications such as robotics, immersive gaming, augmented reality, architecture, planning, robotics, engineering prototyping, vehicle navigation, medical applications, and other problem domains is useful. Existing schemes are limited in accuracy, robustness, and speed. For many applications, precise camera positioning is required in real time, for example so that a robot can successfully move around its environment. [0003] Many previous mobile camera localization methods have used color video cameras instead of depth cameras. Usually color video cameras give high resolution and accuracy, while rich color information allows detection of visual features in video images. The information that can be obtained ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00
CPCG06T7/20G06T7/0042G06T2207/30244G06T7/0044G06T2207/10016G06T2207/10024G06T2207/10028G06T2207/10021G06T7/00G06T7/74G03B35/00
Inventor R·纽科姆S·伊扎迪D·莫利尼奥克斯O·希利格斯D·金J·D·J·肖顿P·科利A·费茨吉本S·E·豪杰斯D·A·巴特勒
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap