Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An automatic counting system of fish passing fish in fishway based on underwater video

An automatic counting and fishway technology, which is applied to the counting of randomly distributed items, counting objects, counting mechanisms/items, etc., can solve problems such as small range of activities, background changes, and invalid counting rules, so as to improve counting accuracy, The effect of simplifying the swimming state and reducing the counting times

Active Publication Date: 2018-11-30
平邑经济开发区投资发展有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the randomness of the time and quantity of fish passing, it is impossible to monitor the fishway manually 24 hours a day, and it is necessary to develop automated and intelligent monitoring and statistical methods
Studies have shown that general magnetic, electric and contact sensors are not suitable for fish counting work, and vision technology has the advantages of non-contact, visualization, and easy signal collection and transmission, which can be applied to the development of fish counting in fishways, but still There are many technical difficulties, which are mainly manifested in: (1) low visibility in natural water environment, strong light scattering and reflection, which makes video contrast poor and makes it difficult for fish target recognition; (2) fish is a flexible body, swimming During the process, the posture is changeable, and there are no obvious distinguishing features between the same fish except the size, which makes it difficult for the fish to lock and track; (3) Fish generally have phototaxis or flow, and the light source and fishway in the field of view Under the current of water, fish tend to hover in the field of view of the camera, shake their fins (causing body changes), roll over, swim back, etc., all of which make it difficult to count
[0003] The published invention patent ("An automatic counting system for live fish based on computer vision", 201510437308.7) proposes a video counting method that can be used for fry counting, but due to the limitations of experimental facilities, conditions, methods, etc., it cannot be used in It is used in the natural water environment, especially in real dam fishways, mainly because of: (1) hardware: the size of the fishway is only tens of centimeters, so the detected fish must be small enough and have a small range of activities. The state is single, and additional water filter tanks, fish suckers, fish dividers, etc. are required. These limiting conditions are impossible to realize in the real dam fishway monitoring environment; (2) counting rules and methods: in this invention, select the For an experimental fishway with a downward slope in the downstream direction, it is considered that when a tracked fish is detected when the center of mass coordinates of the current frame is lower than that of the previous frame, the counter is incremented by 1, but in fact, it is extremely rare for a fish to swim in the fishway. Regularly, common fish swim up and down quickly along the water depth direction in a small area, or hang somewhere and shake their tails, causing the position of the center of mass to change (in fact, there is no obvious shift), especially when there is a light source. Because of the phototaxis, the group tends to swim around the light source in a "vortex" shape. These common situations will invalidate the counting rules of the patent
In addition, the "standard background" used in this patent is to first shoot and extract the scene without fish as the standard background template, and then use the difference between the current frame image and the standard background template to obtain the foreground (fish) during monitoring. It is also unavailable in the dam fishway, because the water quality, flow velocity, and natural environment light in the dam fishway will change, resulting in different visibility, that is, the background will change, and it is not suitable to use a fixed background template

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automatic counting system of fish passing fish in fishway based on underwater video
  • An automatic counting system of fish passing fish in fishway based on underwater video
  • An automatic counting system of fish passing fish in fishway based on underwater video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Such as figure 1 As shown, it includes an underwater camera 2 and a video processing workstation 3, the underwater camera 2 is connected with the image acquisition card in the video processing workstation 3, and is processed and counted by the counting software installed in the video processing workstation 3; An anti-escape net 5 is installed at the entrance of the fishway 1, and the underwater camera 2 is installed on the side wall of the fishway 1, and is close to the exit of the anti-escape net 5, and an illumination source 4 is installed above the shooting scene of the underwater camera 2 to the fishway. 1 Inner underwater lighting.

[0039] Further, a part of the area within the shooting scene 6 of the selected underwater camera 2 is used as an effective counting area 7, and the fish is monitored only when the fish starts to swim into the area.

[0040] Further, a part of the selected effective counting area 7 is marked as an enhanced counting area 9, and the part...

Embodiment 2

[0043] A system for automatically counting the amount of fish passed in a fishway based on underwater video, which comprises the following steps:

[0044] S1: Moving fish or fish target recognition and tracking, including the following steps:

[0045] S11: Anti-interference background modeling: establish a mixed Gaussian background model in the effective counting area 7, which can adaptively eliminate the sundries in the effective counting area 7 including illumination changes, water fluctuations, static backgrounds, and swinging fixed positions (such as being caught inside the fishway 1) Interference with spam intercepted by software, etc.);

[0046] S12: Recognition of the moving target: Differentiate the image in the effective counting area 7 in the current frame and the background model of the established effective counting area, and binarize the difference result to obtain the moving target in the current effective counting area 7, which is Fish or schools of fish detect...

Embodiment 3

[0056] The effectiveness of the present invention will be further described below in conjunction with the typical fishway on-site embodiment:

[0057] Figure 4-7 In order to take a certain fish as the research object (the fish marked by the box in the figure), closely surround image 3 The flow shown reflects the main process and effect of the fish from partially entering the counting buffer until it is counted (other fish that appeared in the effective counting area 7 at the same time as the fish are also being tracked and locked, but during the investigation period At the end, other fish have not yet reached the counting requirements, so this selection is for the convenience of explaining the problem). In the four figures, the area covered by the two blue (thick lines) lines is the effective counting area, and the area covered by the two yellow lines (thin lines) inside is the enhanced counting area. Each yellow line and its adjacent blue line The area between the lines i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an automatic counting system for the amount of fish passed in a fishway based on underwater video, which comprises an underwater camera and a video processing workstation, and the underwater camera is connected with an image acquisition card in the video processing workstation. An anti-escape net is installed at the entrance of the fishway, and the underwater camera is installed on the side wall of the fishway near the exit of the anti-escape net. A light source is installed above the shooting scene to illuminate the fishway underwater. In the process of video processing, first design part of the area in the field of view as a counting buffer through software to reduce the amount of calculation, and further set an enhanced counting area in the counting buffer. When the fish gradually enters the effective counting area from one side, the system automatically and continuously identifies and tracks the fish. When the system tracks a certain fish entering the enhanced counting area from one side and gradually starts to swim out from the other side, it is ready to count After monitoring and confirming in 3 consecutive frames of images, the counting is started, and the all-weather automatic counting of the actual fish passing in the fishway within the counting period is realized.

Description

technical field [0001] The invention relates to the field of underwater target monitoring and counting, in particular to an automatic counting system for the amount of fish passing through a fishway based on underwater video. Background technique [0002] In recent years, a large number of various types of hydropower stations have been built in my country. The dams of these stations have caused difficulties for the free migration of fish, especially seasonal and physiological migration, threatening the survival and reproduction of fish. In order to solve this problem, the newly-built dam is specially designed with a fishway for fish to pass through, and uses light, sound and biochemical fish luring technology to try to induce fish to the entrance of the fishway, guide and help them pass through the fishway. However, different fish have different abilities to pass through the fishway, and different types of fishways also make the fish pass through the dam differently. Therefo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06M11/00G06K9/00G06T5/30G06T7/10
CPCG06M11/00G06T5/30G06T2207/10016G06V20/40G06V20/05
Inventor 陈从平聂葳胡琼黄正李林波郑霞忠石小涛
Owner 平邑经济开发区投资发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products