Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area

A technology of map construction and obstacles, applied in the field of unmanned boats, can solve the problems of high false alarm rate, long baseline stability, poor matching accuracy, etc., and achieve the effect of optimizing training results, enriching diversity, and quickly separating and positioning

Pending Publication Date: 2022-05-06
航天时代(青岛)海洋装备科技发展有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the detection of marine obstacles generally adopts the YOLO series network model, which has good detection results for predictable obstacles, but cannot identify unpredictable obstacles; the positioning method of marine obstacles mostly uses laser radar or Binocular camera positioning method
The laser clustering method is easily affected by noise, has a high false alarm rate, and for large obstacles, using the clustering method takes a lot of time
The binocular positioning method has poor stability due to the long baseline, and poor matching accuracy for reflective objects and weak texture obstacles, and the positioning accuracy is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0081] Such as figure 1 As shown, the implementation steps of a DeeplabV3+-based real-time obstacle location and map construction method in unfamiliar sea areas are as follows:

[0082] A. Through the joint calibration of lidar and visible light camera, the conversion relationship between the lidar coordinate system and the visible light camera coordinate system is obtained, that is, the rotation matrix and translation vector from the lidar coordinate system to the visible light camera coordinate system;

[0083] Use the checkerboard calibration board with white edges to calibrate the camera to obtain the internal parameters of the camera; prepare a checkerboard calibration board with no white edges on the edge, set the acquisition frequency of the lidar and the visible light camera to 10HZ, use the ros The rosbag command synchronously collects the checkerboard data of the visible light camera and the lidar; uses the corner point extraction algorithm to extract the coordinates...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a DeeplabV3 +-based instant positioning and mapping method for obstacles in an unfamiliar sea area, and the method comprises the steps: firstly, projecting a laser point cloud to an image based on a conversion relation between a laser radar coordinate system and a visible light camera coordinate system, and obtaining a laser point cloud projection coordinate in an image coordinate system; performing segmentation prediction on the image based on a Deeplabv3 + semantic segmentation network model to obtain a segmented category image, making an obstacle mask by using an obstacle category to obtain a laser point cloud corresponding to an obstacle, and finally, according to a conversion relation between a laser radar coordinate system and an IMU coordinate system, obtaining a laser point cloud corresponding to the obstacle. And constructing a surrounding obstacle map taking the unmanned ship as the center of the map according to the coordinates of the laser point cloud corresponding to the obstacle in the laser radar coordinate system and the attitude information of the unmanned ship acquired by the IMU. According to the invention, accurate extraction of predictable and unpredictable obstacle contour information is realized by using a Deeplabv3 + semantic segmentation network model, and accurate detection and positioning of offshore predictable and unpredictable obstacles are realized in combination with a visible light camera and a laser radar.

Description

technical field [0001] The invention belongs to the technical field of unmanned boats, and in particular relates to a DeeplabV3+-based real-time obstacle positioning and map construction method in unfamiliar sea areas. Background technique [0002] Unmanned boats have been used more and more widely in recent years. For example, in the military field, unmanned boats can be widely used in ship protection, anti-submarine warfare, logistics supplies, information investigation and other fields. In the civilian field, unmanned boats can be widely used in Marine environmental monitoring, seabed surveying and mapping, emergency response and sea area search and rescue work and other fields. Since the unmanned boat and its equipment are often expensive, if it collides with objects in the ocean during navigation, it will seriously damage the unmanned boat and equipment. If it collides with a ship, the consequences of injuring people may be even more unimaginable. At present, technical...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/05G06T7/73G06T7/90
CPCG06T17/05G06T7/73G06T7/90G06T2207/30244
Inventor 杨长坤刘柳王潇文龙贻彬胡常青李清洲
Owner 航天时代(青岛)海洋装备科技发展有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More