Robot device for observing feeding condition of fish body

By using robot devices with event cameras and RGB cameras in fish farming, the feeding situation in fish is monitored in real time, the problem of monitoring accuracy of fish feeding situation is solved, and the accuracy of feeding and fish health management is improved to ensure that Sustainable use of fishery resources.

CN221938442UInactive Publication Date: 2024-11-01FISHERY MACHINERY & INSTR RES INST CHINESE ACADEMY OF FISHERY SCI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420596567.9
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-03-26
Publication Date
2024-11-01
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The prior art is difficult to achieve accurate monitoring of fish feeding, resulting in inaccurate feeding in fish farming, affecting fish health and growth.

Method used

Design a robot device including waterproof compartment, power supply component, drive component and observation component. By installing an event camera and an RGB camera in the waterproof compartment, combined with fill lights and transparent observation covers, the feeding situation of fish is monitored in real time. , improve detection accuracy and convenience.

Benefits of technology

Accurate monitoring of fish school feeding situations has been achieved, the accuracy of feeding and fish health management has been improved, the understanding of fish school behavior and ecology has been enhanced, and the sustainable use of fishery resources has been ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN221938442U_ABST
    Figure CN221938442U_ABST
Patent Text Reader

Abstract

The utility model relates to a robot device for observing fish feeding conditions, and relates to the technical field of underwater detection, and the robot device comprises a waterproof cabin which is used for being put underwater; the power supply assembly comprises a storage battery, and the storage battery supplies power for underwater operation of the waterproof cabin; the driving assembly is mounted on the outer side of the waterproof cabin and used for driving the waterproof cabin to move underwater; the observation assembly is installed in the waterproof cabin and used for observing the feeding condition of underwater fish schools. According to the invention, the breeding personnel can feed according to the ingestion condition of the fish school.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of underwater detection technology, and in particular to a robot device for observing the feeding situation of fish. Background Art

[0002] Currently, fish are of great significance in global food security and nutrition initiatives, and many countries and regions rely on fisheries and agriculture as a source of food and economy. The feeding behavior of fish reflects their health status during their growth. Real-time monitoring of their feeding behavior helps to obtain the health status of fish in a timely manner, improve feeding accuracy and increase growth rate, and help scientists to have a deeper understanding of the basic principles of animal behavior, ecology, evolutionary biology and other fields. At the same time, fish testing can help managers understand the population structure, growth status and reproduction number of fish, so as to adopt sustainable fishery management measures, ensure the sustainable use of fishery resources, and provide a scientific basis for the management of aquatic ecosystems.

[0003] Traditional methods include manual observation of fish behavior, appearance, and remaining feed. However, these methods are limited by subjective factors and cannot quantitatively evaluate the hunger and health of fish. Many studies use sonar technology to analyze the feeding sounds and swimming behaviors of fish schools, which helps to understand the structure, ecological habits, and response to environmental changes of fish schools. Some scholars also use computer vision to monitor the swimming paths of individual fish and calculate the swimming speed. However, the detection accuracy of the above methods is poor. For this reason, some scholars formulate feeding strategies based on the growth curve of fish bodies. However, this method is based on the estimation of fish population and the precise measurement of phenotypes.

[0004] Therefore, how to observe the feeding situation of fish schools and accurately feed them has become an urgent problem to be solved in the process of fish farming. Utility Model Content

[0005] The technical problem to be solved by the utility model is to provide a robot device for observing the feeding situation of fish, which solves the technical problem of accurately feeding the fish by observing the feeding situation of the fish.

[0006] In order to achieve the above purpose, the utility model provides the following technical solutions:

[0007] A robot device for observing the feeding situation of fish comprises: a waterproof cabin, which is used to be put into water; a power supply component, which comprises a battery, and the battery supplies power to the waterproof cabin when it operates underwater; a driving component, which is installed on the outside of the waterproof cabin and is used to drive the waterproof cabin to move underwater; and an observation component, which is installed in the waterproof cabin and is used to observe the feeding situation of underwater fish.

[0008] Through the above technical solution, the power supply component, the drive component and the observation component are installed in the waterproof cabin. When in use, the waterproof cabin is placed in the water, and the battery in the power supply component powers the drive component and the observation component. The drive component drives the waterproof cabin to move in the water. During the movement of the waterproof cabin, the observation component observes the feeding situation of the fish in the water, so that the breeders can feed the fish according to the feeding situation of the fish.

[0009] Furthermore, the driving assembly includes propellers, and the propellers are arranged in two groups at intervals, wherein the propellers in one group are arranged vertically, and the propellers in the other group are arranged horizontally.

[0010] Through the above technical solution, the propeller is installed on the waterproof cabin. As the propeller propels the waterproof cabin, the convenience of moving the waterproof cabin in the water is improved.

[0011] Furthermore, the observation component includes an event camera and an RGB camera, and the event camera and the RGB camera are installed in the waterproof cabin.

[0012] Through the above technical solution, the event camera and the RGB camera record the feeding situation of underwater fish schools, which improves the convenience of observing the feeding situation of fish schools.

[0013] Furthermore, a fill light is provided on the waterproof cabin, and the fill light faces one side of the event camera and the RGB camera.

[0014] Through the above technical solution, the fill light is used to fill in the underwater environment, so that the observation effect of the event camera and the RGB camera on the school of fish can be improved.

[0015] Furthermore, a mounting plate is provided on one side of the waterproof cabin, a support rod is provided on the mounting plate, a support plate is mounted on the support rod, and the waterproof cabin is mounted on the support plate.

[0016] Through the above technical solution, the support rod is installed on the mounting plate, the support plate is installed on the support rod, and then the waterproof cabin is installed on the support plate, thereby improving the stability of the installation of the waterproof cabin.

[0017] Furthermore, one end of the waterproof cabin is open, and a connecting sleeve is provided at one end of the waterproof cabin, the connecting sleeve is embedded in the open side of the waterproof cabin, an observation cover is provided on one side of the connecting sleeve, the observation cover is made of transparent material, a pressure ring is provided on the side of the observation cover away from the connecting sleeve, the observation cover is installed between the pressure ring and the connecting sleeve, a connecting bolt is provided on the pressure ring, one end of the connecting bolt passes through the pressure ring and is connected to the connecting sleeve.

[0018] Through the above technical solution, the observation cover is installed between the connecting sleeve and the pressure ring, and the observation cover is made of transparent material, so that the event camera and the RGB camera can better observe the school of fish.

[0019] Furthermore, a rubber ring is sleeved on the connecting sleeve, and the rubber ring is tightly pressed between the connecting sleeve and the waterproof cabin.

[0020] Through the above technical solution, the rubber ring is pressed tightly between the connecting sleeve and the waterproof compartment, thereby improving the sealing between the connecting sleeve and the waterproof compartment.

[0021] In summary, the present application includes at least one of the following beneficial technical effects of a robot device for observing fish feeding conditions:

[0022] 1. The power supply component, the drive component and the observation component are installed in the waterproof cabin. When in use, the waterproof cabin is placed in the water. The battery in the power supply component supplies power to the drive component and the observation component. The drive component drives the waterproof cabin to move in the water. During the movement of the waterproof cabin, the observation component observes the feeding situation of the fish in the water, so that the breeders can feed the fish according to the feeding situation of the fish.

[0023] 2. The setting of fill light and observation cover can improve the observation effect of event camera and RGB camera on fish schools;

[0024] 3. The setting of the rubber ring can reduce the flow of external water into the waterproof cabin, thereby improving the protection of the event camera and RGB camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a schematic diagram of the overall structure of a robot device for observing the feeding situation of fish in this embodiment;

[0026] Figure 2 This is a schematic diagram of the explosion structure of the waterproof cabin in this embodiment;

[0027] Figure 3 This is a schematic diagram of the embodiment mainly showing the opening operation filtering of the underwater event camera image;

[0028] Figure 4 This embodiment mainly embodies an underwater RGB image enhancement network based on event camera images;

[0029] Figure 5 This embodiment mainly embodies the FP module of the image enhancement network;

[0030] Figure 6 This embodiment mainly embodies a two-stage underwater fish detection network;

[0031] Figure 7This embodiment mainly embodies a similar triangle fusion matching method based on cross nodes.

[0032] Figure numerals: 1. waterproof cabin; 11. connecting sleeve; 12. rubber ring; 13. cover plate; 14. observation cover; 15. pressure ring; 151. connecting bolt; 16. mounting plate; 161. support rod; 162. support plate; 17. fill light; 2. power supply assembly; 21. battery; 3. drive assembly; 31. thruster; 4. observation assembly; 41. event camera; 42. RGB camera. DETAILED DESCRIPTION

[0033] In order to make the technical means, creative features, objectives and effects of the present invention easier to understand, the present invention is further described below in conjunction with specific embodiments.

[0034] The following is combined with Figure 1-7 This application is described in further detail.

[0035] The embodiment of the present application discloses a robot device for observing the feeding situation of fish.

[0036] Reference Figure 1-Figure 2 A robot device for observing the feeding situation of fish includes a waterproof cabin 1, on which a power supply component 2, a driving component 3 and an observation component 4 are arranged. The power supply component 2 supplies power to the driving component 3 and the observation component 4. The waterproof cabin 1 is put into water, and the driving component 3 drives the waterproof cabin 1 to move in the water. During the movement of the waterproof cabin 1, the observation component 4 observes the information of the fish school in the water.

[0037] The power supply assembly 2 includes a battery 21, which is installed in the waterproof cabin 1. When in use, the battery 21 is charged before each operation. After charging, the battery 21 supplies power to the waterproof cabin 1 for underwater operations.

[0038] The waterproof cabin 1 is made of transparent glass, and the waterproof cabin 1 is cylindrical as a whole. Connecting sleeves 11 are provided at both ends of the waterproof cabin 1, and the connecting sleeves 11 are sleeved on the waterproof cabin 1. Rubber rings 12 are sleeved on the two connecting sleeves 11, and the rubber rings 12 are pressed tightly between the connecting sleeves 11 and the waterproof cabin 1. The rubber rings 12 are pressed tightly between the connecting sleeves 11 and the waterproof cabin 1, on the one hand, the stability of the connecting sleeves 11 sleeved on the waterproof cabin 1 is improved, and on the other hand, the sealing between the waterproof cabin 1 and the connecting sleeves 11 is improved.

[0039] A cover plate 13 is provided at one end of the waterproof cabin 1 . The cover plate 13 is covered on the connecting sleeve 11 . The cover plate 13 is screwed onto the connecting sleeve 11 by bolts. When in use, one side of the waterproof cabin 1 is closed by the cover plate 13 .

[0040] The observation component 4 is installed in the waterproof cabin 1. In order to improve the protection effect of the observation component 4, an observation cover 14 is provided at one end of the waterproof cabin 1 relative to the cover plate 13. The observation cover 14 is made of transparent glass. When in use, the observation cover 14 is covered on the connecting sleeve 11 on the other side of the waterproof cabin 1. In addition, there is a pressure ring 15 on the observation cover 14. The pressure ring 15 is coaxial with the connecting sleeve 11. When in use, the pressure ring 15 presses the observation cover 14 against the connecting sleeve 11. Further, the pressure ring 15 is provided with connecting bolts 151. Several connecting bolts 151 are evenly spaced around the pressure ring 15. One end of several connecting bolts 151 passes through the pressure ring 15 and is threadedly connected to the connecting sleeve 11. The observation cover 14 made of transparent glass enables the observation component 4 to better observe the feeding situation of the fish school.

[0041] Two waterproof chambers 1 are arranged at intervals, and a mounting plate 16 is arranged between the two waterproof chambers 1. The waterproof chambers 1 are located on both sides of the mounting plate 16 in the thickness direction. The mounting plate 16 is rectangular plate-shaped as a whole, and the length direction of the mounting plate 16 is coaxial with the axis direction of the waterproof chamber 1.

[0042] The mounting plate 16 is provided with support rods 161, and two groups of support rods 161 are arranged at intervals on both sides of the axial direction of the waterproof cabin 1, and the waterproof cabin 1 is located between the two groups of support rods 161. A support plate 162 is arranged between two opposing support rods 161, and the two ends of the support plate 162 are respectively connected to the support rods 161 on both sides. Further, the cover plate 13 and the pressure ring 15 are connected to the support plate 162.

[0043] The driving assembly 3 includes a propeller 31, which is a propeller type, and two groups of propellers 31 are arranged at intervals on both sides of the length direction of the mounting plate 16, one group of propellers 31 is arranged vertically, and the other side of the propellers 31 is arranged horizontally. When in use, the vertically arranged propellers 31 drive the waterproof cabin 1 to move up and down in the water, and the horizontally arranged propellers 31 drive the waterproof cabin 1 to move forward and backward, so that the convenience of moving the waterproof cabin 1 in the water is improved.

[0044] The observation component 4 includes an event camera 41 and an RGB camera 42, which are respectively installed in two waterproof chambers 1. The event camera 41 is a dynamic visual sensor with a resolution of 346*260. It can run at an extremely high frame rate, reaching the level of several thousand frames per second (fps). The photosensitive element used is a CMOS photosensitive chip, which can capture scenes with a high dynamic range. The RGB camera 42 uses a color CMOS type high frame rate camera with a resolution of 346*260, a pixel size of 5.2μmx 5.2μm, and a sampling frequency of 30FPS.

[0045] When observing a school of fish underwater, the underwater environment is relatively dark. In order to improve the observation effect of the event camera 41 and the RGB camera 42 on the school of fish, a fill light 17 is provided on the mounting plate 16 to fill in the light of the underwater school of fish. In the prior art, the fill light 17 uses an LED light source with an adjustable beam angle to meet different shooting requirements and has good waterproof performance.

[0046] When the waterproof cabin 1 moves underwater, the mounting plate 16 is arranged horizontally as a whole, and the left and right sides of the mounting plate 16 are fill lights 17, and the upper and lower sides are RGB cameras 42 and event cameras 41 respectively.

[0047] like Figure 3 As shown, in the prior art, the event camera 41 captures the movement of the fish body to generate event points, and the number of event points at the corresponding position is converted into pixel values ​​by accumulating the thickness of the event points. Affected by environmental noise factors, the image of the event camera 41 has noise, and the image opening operation is used to optimize the noise points of the event camera 41 image. The opening operation can remove isolated small dots and burrs, and enhance the display of the main body of the fish body swimming.

[0048] Reference Figure 4 , the event camera 41 image can extract the fish moving in the low light environment. Therefore, the amplitude frequency of the event camera 41 image is used to enhance the amplitude frequency of the frame-based image. The enhancement of the frequency stage is as follows Figure 3 As shown, the input event camera 41 image is fed into six Fourier processing (FP) blocks with skip connections to estimate the amplitude transform map.

[0049] Reference Figure 5 , shows the Fourier processing module for image enhancement. In this block, the input is first Fourier transformed into Fourier space to obtain the amplitude and phase frequencies. Then, two convolutional layers are combined with ReLU operations to extract features. Finally, these two components are converted back to the spatial domain and the image is resized by up / down sampling through convolution.

[0050] Reference Figure 6 , based on image enhancement, in the first stage of detection, the low brightness based on the frame image is improved by estimating the amplitude transform map in Fourier space. In the second stage of detection, two YOLO networks are used to identify the fish body respectively. Fourier transform can extract global information from the image without introducing a large number of neural network parameters such as multi-layer perception (MLP) or transformer. Recognition through image enhancement operation can significantly improve the detection accuracy.

[0051] Reference Figure 7,Since the sensors have different sampling frequencies and the fish may move quickly, there may be drift in the alignment between the detections of the event camera 41 and the RGB camera 42. To address this issue, a batch matching strategy is implemented using graph nodes. Based on the separate detections, the distribution area nodes of the fish in the two images are simplified respectively.

[0052] Fish may be missed in the event camera 41 and RGB images due to the speed of fish movement. Usually, the number of fish areas in the event camera 41 image is less than that in the frame-based image. Intersecting fish are selected from the two types of images, and the three detected fish with the highest scores are selected. The detected fish between the two images are matched based on the similar triangle method. The fish areas can be matched by establishing similar correspondences between the edges and angles in the two distributions.

[0053] The fish body identified by the RGB image represents the fish body identification score, which is represented by ScoreFish; the fish body identified by the event camera 41 image represents the fish body identification and feeding and swimming amount score, which is represented by ScoreMovement. At the same time, different batches of fry sizes affect the fish body identification score, and the identification score is higher when the fish body is larger; the feeding time interval will affect the feeding and swimming amount score. Establish the feeding desire optimization weight, DesireWeight, as shown in Table 1 below.

[0054] Table 1 Weight coefficients of feeding desire based on developmental indicators and feeding intervals

[0055]

[0056] Score overall =(Score Fish / 3+2*Score Movement / 3)*Desire Weight

[0057] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A robot device for observing the feeding situation of fish, characterized in that: include: A waterproof cabin (1), the waterproof cabin (1) being used for being put underwater; A power supply component (2), the power supply component (2) comprising a storage battery (21), the storage battery (21) providing power to the waterproof cabin (1) during underwater operation; A driving assembly (3), the driving assembly (3) being installed on the outside of the waterproof cabin (1) and being used to drive the waterproof cabin (1) to move underwater; An observation component (4), the observation component (4) being installed in the waterproof cabin (1) and used for observing the feeding situation of the underwater fish school; The driving assembly (3) comprises propellers (31), wherein the propellers (31) are arranged in two groups at intervals, wherein one group of the propellers (31) is arranged vertically, and the other group of the propellers (31) is arranged horizontally; The observation component (4) comprises an event camera (41) and an RGB camera (42), and the event camera (41) and the RGB camera (42) are installed in the waterproof cabin (1).

2. A robot device for observing fish feeding according to claim 1, characterized in that: A fill light (17) is provided on the waterproof cabin (1), and the fill light (17) faces one side of the event camera (41) and the RGB camera (42).

3. A robot device for observing fish feeding according to claim 1, characterized in that: A mounting plate (16) is provided on one side of the waterproof cabin (1), a support rod (161) is provided on the mounting plate (16), a support plate (162) is mounted on the support rod (161), and the waterproof cabin (1) is mounted on the support plate (162).

4. A robot device for observing the feeding situation of fish according to claim 1, characterized in that: One end of the waterproof cabin (1) is open, and a connecting sleeve (11) is provided at one end of the waterproof cabin (1). The connecting sleeve (11) is embedded in the open side of the waterproof cabin (1). An observation cover (14) is provided on one side of the connecting sleeve (11). The observation cover (14) is made of a transparent material. A pressure ring (15) is provided on the side of the observation cover (14) facing away from the connecting sleeve (11). The observation cover (14) is installed between the pressure ring (15) and the connecting sleeve (11). A connecting bolt (151) is provided on the pressure ring (15). One end of the connecting bolt (151) passes through the pressure ring (15) and is connected to the connecting sleeve (11).

5. A robot device for observing the feeding situation of fish according to claim 4, characterized in that: The connecting sleeve (11) is sleeved with a rubber ring (12), and the rubber ring (12) is tightly pressed between the connecting sleeve (11) and the waterproof cabin (1).