Sea cucumber detection and binocular visual positioning method based on deep learning

A technology of binocular vision positioning and deep learning, which is applied in the field of machine vision and underwater target detection, can solve the problems of low efficiency of three-dimensional positioning time, poor classification accuracy of sea cucumbers, and changing shapes of sea cucumbers, so as to improve the quality of binocular images, Improve the effect of poor classification accuracy and narrow search range

Inactive Publication Date: 2018-11-23
HARBIN ENG UNIV
View PDF2 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Due to the fogging of underwater sea cucumber imaging, the decrease of contrast, the color degradation, and the changeable shape of sea cucumbers, the traditional underwater sea cucumber detection technology often needs to manually screen and extract multiple features, which has the disadvantages of poor sea cucumber classification accuracy and low three-dimensional positioning time efficiency. question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sea cucumber detection and binocular visual positioning method based on deep learning
  • Sea cucumber detection and binocular visual positioning method based on deep learning
  • Sea cucumber detection and binocular visual positioning method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] In order to make the purpose of the present invention, technical solutions and advantages clearer, the following will be combined Figure 1 to Figure 14 The present invention is described in further detail.

[0065] like figure 1 As shown, a sea cucumber detection and binocular vision three-dimensional positioning method based on deep learning includes the following steps:

[0066] (1) By calibrating the binocular camera, the internal and external parameters of the camera are obtained, such as figure 2 shown.

[0067] In a stereo vision system, camera calibration determines the relationship between the pixels in the two-dimensional image collected by the image acquisition device and the three-dimensional coordinates of the target. The invention adopts the Zhang Zhengyou camera calibration method to realize the underwater calibration task. The binocular cameras are all Microsoft HD-3000 720P high-definition cameras. They are fixed and placed in parallel. The binocul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a sea cucumber detection and binocular visual positioning method based on deep learning, and is suitable for a submarine sea cucumber fishing task of an underwater robot of ocean pasture. The method mainly comprises the following steps of calibrating binocular cameras to obtain internal and external parameters of the cameras; correcting the binocular cameras, so that imagingorigin coordinates of left and right views are consistent, optical axes of the two cameras are parallel, left and right imaging planes are coplanar, and bipolar lines are aligned; performing submarine image data collection by utilizing the calibrated binocular cameras; performing image enhancement on the collected image data through a dark channel priority algorithm based on white balance compensation; performing deep learning-based sea cucumber target detection on a submarine image subjected to the image enhancement; and performing a binocular stereo feature point matching algorithm on the image which is subjected to the image enhancement and the deep learning to obtain two-dimensional regression frame information of a target, thereby obtaining three-dimensional positioning coordinate information of the target. According to the method, accurate positioning of underwater sea cucumber treasures can be realized, and manual participation is not needed.

Description

technical field [0001] The invention belongs to the field of machine vision and underwater target detection, and in particular relates to a new method for sea cucumber detection and positioning based on deep learning. Background technique [0002] In recent years, due to the very high nutritional value of sea cucumbers, sea urchins, scallops, abalones and other marine benthic organisms, the demand for the production of marine organisms has been increasing worldwide, and my country's aquaculture industry has continued to develop. Bottom fishing technology is also becoming increasingly important. At present, the most common method of catching seafood is artificial diving fishing. Aiming at the problems of traditional fishing technology, research on the automatic detection method of underwater marine biological targets can improve the problems of high risk factor, short operation time and serious physical injury in manual fishing operations, so that Robots replace humans to co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06T5/00G06K9/62H04N9/73G06N3/04
CPCH04N9/73G06T5/003G06T7/73G06T2207/20081G06T2207/20084G06V2201/07G06N3/045G06F18/24G06F18/214
Inventor 叶秀芬孙晶刘文智贾云鹏王潇洋周瀚文梅新奎陈尚泽肖树国宫垠
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products