Semantic information and vslam fusion method for sweeping robot

A sweeping robot and semantic information technology, applied to manual sweeping machines, geographic information databases, carpet cleaning, etc., can solve problems such as low laser point density, poor stability and accuracy of visual SLAM, single laser data, etc., to strengthen the source of information , improve robustness, improve the effect of accuracy

Active Publication Date: 2022-03-15
YANSHAN UNIV
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The positioning and mapping of indoor robots is mainly realized through SLAM technology. The mainstream solutions of SLAM technology include visual SLAM and laser SLAM. Visual SLAM is a current research hotspot, which has the advantages of low cost and rich information, but the stability and accuracy of visual SLAM are relatively low. Poor, and more complex than laser SLAM; laser SLAM has better results in indoor robot positioning and mapping, but the laser data is single, and it cannot achieve closed-loop detection well, and the low-cost laser radar has a low laser point density. At the same time, there is an occlusion phenomenon, so the constructed map often cannot be closed; and the semantic information of the picture can provide more information for SLAM, and provide more accurate semantic information in the subsequent process, so the combination of semantic information and SLAM is the best choice. a trend

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic information and vslam fusion method for sweeping robot
  • Semantic information and vslam fusion method for sweeping robot
  • Semantic information and vslam fusion method for sweeping robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0044] figure 1 is a schematic diagram of a mapping object in an embodiment of the present invention;

[0045] This embodiment proposes a semantic information and VSLAM fusion method for sweeping robots, including the following steps:

[0046] S1. Integrate semantic information into the VSLAM system to establish an indoor map that integrates semantic information. The map construction algorithm based on semantic information is as follows: figure 2 shown, including the following specific steps:

[0047] S11. Extracting semantic information and identifying the semantic information;

[0048] S111. Since the existing classification model can better extract and identify semantic information, the embodiment of the present invention uses ResNet-18 as the basic network based on the existing classification model, removes the last fully connected layer, and implements semantic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a semantic information and VSLAM fusion method for sweeping robots. The method adds the vector containing voice information in the semantic dictionary to the front of the traditional dictionary vector to generate a fusion dictionary that fuses traditional information and semantic information, and strengthens VSLAM. The information source of the system has changed the shortcoming that the traditional VSLAM cannot obtain the prior information of the environment, and uses the semantic information to improve the accuracy of the VSLAM system to solve the essential matrix; in the loop detection, the semantic information is first matched. If the semantic information cannot complete the matching, then If the point is considered to be a wrong match, there is no need to search in the bag of words, which improves the robustness of the system and the accuracy of building an indoor map.

Description

technical field [0001] The invention belongs to the technical field of synchronous positioning and mapping (SLAM), and in particular relates to a fusion method of semantic information and VSLAM for a sweeping robot. Background technique [0002] Sweeping robots are becoming more and more common in people's lives. The core technology of the sweeping robot includes sweeping, mopping, obstacle avoidance, mapping and human-computer interaction. Among them, in addition to sweeping the floor, there are varying degrees of problems in functions such as mopping the floor, and they are still in the exploratory stage. [0003] Position and map are often closely related, that is, positioning and map are interdependent, and positioning cannot be discussed without a map. However, if you want to build a map suitable for robots through indoor robots, you need to know the position of the robot itself. Since there are often items such as tables, chairs, boxes and cabinets in the room or the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06V10/762G06V10/74G06V10/80G06V10/44G06F17/16G06F16/29A47L11/40A47L11/24
CPCG06F16/29G06F17/16A47L11/24A47L11/40A47L11/4011G06V10/757G06V10/44G06F18/23213G06F18/25
Inventor 金梅张少阔张立国张子豪孙胜春刘博张勇郎梦园王娜
Owner YANSHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products