Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Monocular vision mapping and positioning method, device, storage medium and mobile device

A monocular vision and mobile device technology, applied in the field of computer vision, can solve the problems of decreased positioning accuracy and achieve the effects of improving positioning accuracy, reducing inaccurate positioning, and improving positioning accuracy

Active Publication Date: 2021-07-23
CLOUDMINDS SHANGHAI ROBOTICS CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, if the image collected by the monocular camera is lost or the IMU data is noisy, the positioning accuracy of the above method will also decrease.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular vision mapping and positioning method, device, storage medium and mobile device
  • Monocular vision mapping and positioning method, device, storage medium and mobile device
  • Monocular vision mapping and positioning method, device, storage medium and mobile device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0068] In order to solve the problem of sensitivity to monocular camera parameters, IMU parameters, and monocular camera and IMU time synchronization in related technologies, the present disclosure provides a monocular vision mapping and positioning method, device, storage medium and mobile device .

[0069] figure 1 It is a flowchart of a monocular vision mapping and positioning method according to an exemplary embodiment of the present disclosure, the method is applied to a mobile device, and the mobile device includes a monocular camera and an inertial measurement device IMU. Such as figure 1 As shown, the method may include the following steps.

[007...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The disclosure relates to a monocular vision mapping and positioning method, device, storage medium and mobile device. The method includes: respectively acquiring a first depth map and a first optical flow feature corresponding to the monocular image of the current frame, and a second depth map corresponding to the monocular image of the previous frame of the current frame; According to the first RGB image corresponding to the target image, determine the first frame point cloud; according to the second depth image and the second RGB image corresponding to the previous frame monocular image, determine the second frame point cloud; obtain the inertial measurement device in the previous frame The data measured during the time period between the first moment corresponding to the monocular image and the second moment corresponding to the current frame monocular image, and the estimated state of the inertial measurement device at the first moment; according to the data, state, first The optical flow feature determines the first movement trajectory of the mobile device within a time period; generates a dense map based on the first movement trajectory, the first frame point cloud and the second frame point cloud. In this way, the positioning accuracy of the mobile device is improved.

Description

technical field [0001] The present disclosure relates to the field of computer vision, and in particular, to a monocular vision mapping and positioning method, device, storage medium and mobile device. Background technique [0002] In many fields such as robot guidance, unmanned driving, and augmented reality (Augmented Reality, AR), environmental maps are required. In related technologies, the environmental maps mostly use monocular cameras and low-cost inertial measurement units (Inertialmeasurement unit , IMU) synchronous positioning and mapping technology (Simultaneous Localization and Mapping, SLAM) technology). Specifically, a precise odometer system is constructed by calibrating the internal and external parameters of the monocular camera and IMU, and the time synchronization between the monocular camera and IMU. In this system, firstly, the adjacent images are matched in a series of images collected by the monocular camera, and then the IMU data measured by the IMU ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/269G06T7/246G01C21/20
CPCG01C21/20G06T2207/10016G06T2207/10028G06T2207/30241G06T2207/30252G06T7/246G06T7/269
Inventor 韩立明林义闽廉士国
Owner CLOUDMINDS SHANGHAI ROBOTICS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products