Unlock instant, AI-driven research and patent intelligence for your innovation.

Visual positioning method and device, computer readable medium and electronic equipment

A visual positioning and equipment technology, applied in the field of visual positioning, can solve the problems of no acquisition, positioning failure, weak texture, etc., to achieve the effect of improving accuracy and avoiding positioning failure

Pending Publication Date: 2020-10-16
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present disclosure is to provide a visual positioning method, a visual positioning device, a computer-readable medium, and an electronic device, thereby avoiding problems such as repeated textures and weak textures in a single image, or failure to capture a single image in an offline map Corresponding to the real scene, causing the problem of positioning failure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual positioning method and device, computer readable medium and electronic equipment
  • Visual positioning method and device, computer readable medium and electronic equipment
  • Visual positioning method and device, computer readable medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] Taking the first frame in the video data as the initial key frame, and determining the collection pose in the coordinate system of the first device when the first device collects the initial key frame (the first frame).

[0048] Real-time detection of the pose change of the first device relative to the first frame acquisition pose. When the pose change is equal to the preset change, the video frame collected at this moment is the first target key frame and added to the key frame set.

[0049] Then replace the first frame with the first target key frame as the initial key frame, obtain the collection pose of the first device in the coordinate system of the first device when collecting the initial key frame (the first target key frame), and continue to execute The above process of real-time detecting, collecting and adding the key frame set ends when the number of video key frames in the key frame set meets the requirements.

[0050] It should be noted that when detecting...

Embodiment 2

[0066] When establishing the first global feature, DoG features of video key frames at multiple scales can be extracted first, and corresponding SIFT descriptors can be calculated. Among them, the number of scales can be calculated according to the resolution of video key frames through the following formula (3):

[0067]

[0068] Among them, N octave is the number of scales; R img,x The pixel width of the image matrix corresponding to the video key frame in the horizontal direction, R img,y The pixel width in the vertical direction of the image matrix corresponding to the video keyframe.

[0069] After obtaining the SIFT descriptor, the SIFT bag-of-words model features corresponding to the key frames of the video can be calculated through the pre-trained dictionary tree. Specifically, first put each SIFT descriptor in the video key frame into the dictionary tree to find the closest word, then calculate the norm distance between the descriptor and the word, and perform n...

Embodiment 3

[0090] For each first key frame, the first key frame and each candidate key frame are respectively subjected to the following comparison process to obtain a second comparison result between the first key frame and the candidate key frame. The process of comparing a first key frame 1 with a corresponding candidate key frame A is described in detail below:

[0091] The first step is to determine the first matching pair

[0092] The third preset condition may be set as the smallest distance c being less than 0.8 times the second smallest distance d.

[0093] For a first local feature 1 of the first key frame 1, the second distance between the first local feature 1 and all the second local features in the candidate key frame A is calculated to obtain a second distance set. When the second distance in the second distance set satisfies the above-mentioned third preset condition, the first matching pair is generated according to the second local feature A corresponding to the smalle...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The disclosure provides a visual positioning method, a visual positioning device, a computer readable medium and electronic equipment, and relates to the technical field of visual positioning. The method comprises the following steps: acquiring a key frame set from video data acquired by first equipment; performing positioning based on the key frame set to obtain a first pose set, and determininga positioning frame set capable of outputting each first pose in the first pose set; obtaining a reference frame set corresponding to the positioning frame set, and generating a reference point cloudset according to the point cloud data corresponding to the reference frame set; comparing each positioning feature contained in the positioning key frame with the reference point cloud set to obtain afirst matching set corresponding to the positioning frame set; and optimizing the first pose set according to the first matching set to obtain an optimized first pose set. According to the disclosure, the problem of positioning failure caused by single image positioning can be solved, and the accuracy of the first pose can be improved.

Description

technical field [0001] The present disclosure relates to the technical field of visual positioning, and in particular to a visual positioning method, a visual positioning device, a computer-readable medium and electronic equipment. Background technique [0002] Visual positioning refers to the technology of calculating the current location of the user by using a single image collected by the device and a pre-built visual map. This technology can be used in the initialization of augmented reality navigation, real-time positioning and relocation in map construction, etc., to improve the positioning accuracy. [0003] In related technologies, a single monocular image or binocular image is usually used for positioning. However, if there are problems such as repeated textures and weak textures in the image, or the real scene corresponding to the image is not captured in the offline map, positioning failures are likely to occur when a single monocular image or binocular image is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/73G06K9/00G06K9/46G06K9/62
CPCG06T7/73G06T2207/10016G06T2207/10028G06T2207/30244G06V20/46G06V10/462G06F18/22
Inventor 杨宇尘蒋燚马标李姬俊男
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD