Unlock instant, AI-driven research and patent intelligence for your innovation.

Outdoor active camera repositioning method based on skyline matching

A skyline and relocation technology, applied in the fields of computer vision and artificial intelligence, can solve the problems of changes, increase the number of mismatched feature points in the image, change the scene, etc., and achieve the effect of reducing the impact

Active Publication Date: 2021-01-01
TIANJIN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when the lighting conditions (direction and intensity) of previous observations are different, the monitoring results of existing methods are not satisfactory
Significant differences in illumination will change the appearance of the scene (especially the ubiquitous three-dimensional structure scene), and then the feature point descriptors in the image involving pose estimation will change, resulting in the failure of camera pose estimation
In addition, if the background (non-monitoring object area) in the observation scene changes greatly, for example, the vegetation near the monitored ancient building may change drastically in different seasons (even structural changes), which will significantly increase the probability of mis-matching feature points in the image. Quantity, which seriously affects the accuracy of relocation results
The above two situations that are common in actual tasks will seriously damage the accuracy of existing active camera relocation methods, resulting in unreliable actual monitoring results, which cannot support outdoor relocation operations under uncontrollable environmental conditions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Outdoor active camera repositioning method based on skyline matching
  • Outdoor active camera repositioning method based on skyline matching
  • Outdoor active camera repositioning method based on skyline matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Based on the technical solutions in the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] (1) Division of sky area and non-sky area

[0033] During the relocation process, divide the current observation image I T and reference observation image I R The sky area and non-sky area of ​​the scene in the middle. Specific steps are as follows:

[0034] (1) Select RefineNet, a semantic segmentation network with good results at present, and select the open source sky dataset SkyFinder

[0035] (2) Fine-tune the network on the SkyFinder dataset for the RefineNet network, so that the RefineNet network can make two types of predictions for each pixel in the image, belonging to sky pixels or non-sky pi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an outdoor active camera repositioning method based on skyline matching, and the method is characterized in that the method comprises the following steps: dividing a referenceobservation image IR into a sky region and a non-sky region according to semantics, obtaining an interface line of the two regions, i.e., a skyline of a reference image, and discretizing the interface line into key points; obtaining an skyline point set of the reference image; obtaining an skyline point set of the current observation image IT; matching the two skyline point sets to obtain a matching relationship between the reference image and the current image; obtaining a camera relative pose P between the reference observation and the current observation according to the obtained matchingrelationship S; judging whether the repositioning process is completed or not according to the step length information of the camera moving in the translation direction; if the relocation is completed, ending; and if not, repeating the step 2 to the step 5.

Description

technical field [0001] The invention belongs to the fields of artificial intelligence and computer vision, relates to active vision technology, in particular to an outdoor active camera relocation method based on skyline matching. Background technique [0002] Active camera repositioning aims to physically and truly restore the camera's six-degree-of-freedom pose to the same as when the reference image was taken. It plays an important role in environmental monitoring, preventive protection of historical and cultural heritage, small change detection and other fields, and is an important application of active vision technology. The active camera relocalization process includes the relative pose estimation of the camera and the dynamic adjustment of the camera, and the adjustment of the camera is completed by the robot platform. [0003] The current state-of-the-art active camera relocalization algorithms have achieved great success in the task of detecting small changes in cu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/73G06T7/246
CPCG06T7/73G06T7/246G06T2207/10004
Inventor 冯伟李璐凯张乾孟忱
Owner TIANJIN UNIV