Fish body positioning and tracking device and method

Abstract

The embodiment of the invention provides a fish body positioning and tracking device and method, and the device comprises an RFID card reading coil which is used for detecting a tag ID carried by a target fish body; the tag ID and the corresponding timestamp are sent to the control module; the control module is used for receiving and responding to the label ID and the corresponding timestamp, and controlling the camera to collect the image frame of the target fish body; detecting the fish body according to the image frame of the target fish body through a preset fish body target detection model; setting a visual ID according to the detected fish body information; the label ID and the visual ID are bound with each other; and controlling the camera to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm. Through the scheme of the embodiment of the invention, the fish body can be tracked and monitored continuously through the visual ID, and the problems of low efficiency and high cost in the fish body positioning and tracking process are solved.

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to a device and method for locating and tracking fish. Background Art

[0002] In aquaculture, accurately collecting information on the feeding behavior and food intake of individual fish within a school is crucial for optimizing feed formulations, feeding strategies, improving feed utilization, and genetically improving strains that tolerate roughage and are feed-efficient (i.e., independent of high-quality protein sources like fishmeal, resulting in high feed conversion rates). Traditional methods, such as physically separating fish for feeding or restricting individual fish from accessing feeding areas, can accurately capture individual information, but they significantly deviate from the clustering and competition for food characteristic of natural aquaculture environments and are associated with low efficiency and high costs. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a device and method for locating and tracking fish, so as to solve the problems of low efficiency and high cost in the process of locating and tracking fish. The specific technical solution is as follows: In a first aspect of an embodiment of the present application, a fish positioning and tracking device is provided, the device comprising: A background plate is provided at the bottom; an RFID card reader coil is provided on the side wall; a camera is provided at the top, wherein the camera's shooting range includes the area where the background plate and the RFID card reader coil are located; the RFID card reader coil is in communication with the camera and the control module; the device includes an open entrance and an open exit; The RFID card reader coil is used to detect the tag ID carried by the target fish body; and send the tag ID and the corresponding timestamp to the control module; The control module is used to receive and respond to the tag ID and the corresponding timestamp to control the camera to collect the image frame of the target fish body; detect the fish body according to the image frame of the target fish body through a preset fish body target detection model; set the visual ID according to the fish body information obtained by detection; bind the tag ID and the visual ID; and control the camera to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm.

[0004] In one possible embodiment, the control module is specifically used to calculate the distance between each fish and the RFID card reader coil through a preset fish position recognition model when the camera captures an image frame containing multiple fish bodies; based on the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

[0005] In a possible implementation, the control module is further configured to release the binding between the tag ID and the visual ID when the target fish is detected by the camera and leaves the shooting range of the camera.

[0006] In a possible embodiment, the control module is specifically used to collect images of the target fish body at multiple moments through the camera; and identify the behavioral data of the target fish body based on the collected images at multiple moments, wherein the behavioral data includes: visual ID, position, and behavioral trajectory.

[0007] In one possible implementation, the device is a frame-type structure; The background plate is arranged at the bottom of the frame structure; the RFID card reader coil is arranged on the side wall of the frame structure; the camera is arranged on the top of the frame structure; and the frame structure includes an open entrance and an open exit.

[0008] A second aspect of an embodiment of the present application provides a fish positioning and tracking method, which is applied to a control module in a fish positioning and tracking device. The method includes: receiving and responding to the tag ID and the corresponding timestamp, controlling the camera to capture an image frame of the target fish body; By presetting a fish body target detection model, the fish body is detected according to the image frame of the target fish body; Set the visual ID based on the fish body information obtained by detection; Binding the tag ID and the visual ID; The camera is controlled to track and monitor the target fish body through the visual ID and the preset multi-target tracking algorithm.

[0009] In a possible implementation, setting a visual ID for the target fish body according to the image frame of the target fish body includes: When the camera captures an image frame containing multiple fish bodies, the distance between each fish body and the RFID card reader coil is calculated using a preset fish body position recognition model; According to the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

[0010] In one possible implementation, the method further includes: When the target fish body is detected by the camera and leaves the shooting range of the camera, the binding between the tag ID and the visual ID is released.

[0011] In a possible embodiment, the control module is specifically used to collect images of the target fish body at multiple moments through the camera; and identify the behavioral data of the target fish body based on the collected images at multiple moments, wherein the behavioral data includes: visual ID, position, and behavioral trajectory.

[0012] Another aspect of the present application provides an electronic device, including: Memory for storing computer programs; The processor is used to implement any of the above-mentioned fish body positioning and tracking methods when executing the program stored in the memory.

[0013] In another aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, any of the above-mentioned fish body positioning and tracking methods is implemented.

[0014] In another aspect of an embodiment of the present application, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute any of the above-mentioned fish body positioning and tracking methods.

[0015] Beneficial effects of the embodiments of the present application: An embodiment of the present application provides a fish positioning and tracking device and method, the device comprising: a background plate arranged at the bottom; an RFID card reader coil arranged on the side wall; a camera arranged at the top, the shooting range of the camera including the area where the background plate and the RFID card reader coil are located; the RFID card reader coil and the camera and a control module are in communication connection; the device comprises an open entrance and an exit; the RFID card reader coil is used to detect the tag ID carried by the target fish; the tag ID and the corresponding timestamp are sent to the control module; the control module is used to receive and respond to the tag ID and the corresponding timestamp to control the camera to collect image frames of the target fish; the fish body is detected according to the image frames of the target fish body through a preset fish body target detection model; the visual ID is set according to the fish body information obtained by detection; the tag ID and the visual ID are bound; and the camera is controlled to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm. Through the solution of the embodiment of the present application, only a background board, an RFID card reader coil and a camera are needed to read the tag ID of the fish body through the RFID card reader coil, and then set the visual ID for the fish body through the camera, thereby binding the tag ID and the visual ID, and realizing continuous tracking and monitoring of the fish body through the visual ID, thereby solving the problems of low efficiency and high cost in the process of fish positioning and tracking.

[0016] Of course, it is not necessary to achieve all the advantages described above at the same time when implementing any product or method of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0018] Figure 1 Another structural diagram of the fish positioning and tracking device provided in an embodiment of the present application; Figure 2 A flow chart of a fish body positioning and tracking method corresponding to an embodiment of the present application. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of this application.

[0020] In a first aspect of an embodiment of the present application, a fish positioning and tracking device is provided, the device comprising: A background plate is provided at the bottom; an RFID (Radio Frequency Identification) reader coil is provided on the side wall; a camera is provided at the top, wherein the camera's imaging range includes the area where the background plate and the RFID reader coil are located; the RFID reader coil is in communication with the camera and a control module; the device includes an open entrance and an open exit; The RFID card reader coil is used to detect the tag ID carried by the target fish body; and send the tag ID and the corresponding timestamp to the control module; The control module is used to receive and respond to the tag ID and the corresponding timestamp to control the camera to collect the image frame of the target fish body; detect the fish body according to the image frame of the target fish body through a preset fish body target detection model; set the visual ID according to the fish body information obtained by detection; bind the tag ID and the visual ID; and control the camera to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm.

[0021] In the embodiments of the present application, the background plate can be made of a material with a low reflectivity, thereby improving the contrast between the fish image and the background and enhancing the accuracy of subsequent image analysis. The specific color can be selected based on actual conditions. In actual use, multiple RFID reader coils can be arranged around the sidewall to improve the efficiency of reading the ID tags carried by the fish. The camera's imaging range includes the area where the background plate and the RFID reader coils are located, thereby facilitating the camera to capture images of the fish read by the RFID reader coils. The RFID reader coils are in communication with the camera and the control module, facilitating the control module to receive the tag ID read by the RFID reader coils, control the camera, and receive the images captured by the camera. The camera can include one or more cameras, and the imaging range of the one or more cameras can cover the entire three-dimensional structural area corresponding to the device, thereby simultaneously capturing the fish's movement trajectory within the area and its positional relationship with the RFID reader coils. The device includes open entrances and exits to facilitate the entry and exit of fish. During use, the device can be partially submerged in water; specifically, the camera is above the water surface, while the RFID reader coils can be located below the water surface. In one example, in order to simulate a natural breeding environment, the monitoring water tank or specific breeding area in this application is an open structure that allows fish to enter and exit freely. The size of the water tank can be adjusted according to the breeding scale and the size of the fish species. The inner wall of the water tank should be made of low-reflection, non-reflective materials to reduce optical interference. At the same time, the material of the inner wall of the water tank should also be selected according to the color characteristics of the type of fish being raised, with a large contrast color. Multiple channel-type openings of moderate width are set on the side wall or bottom of the water tank as a path for fish to enter and exit the monitoring area. For example, the specifications of the openings can be 20-30 cm. The design of these openings should ensure that the fish can pass smoothly while providing space for the arrangement of the RFID coil. A uniform non-direct light source should be set above the water tank to avoid strong reflections or shadows on the water surface to optimize the recognition effect of machine vision. LED array lights can be used, supplemented by soft light covers.

[0022] When the RFID reader coil detects the tag ID carried by the target fish, it can use radio frequency identification (RFID) technology to conduct contactless, two-way data communication via wireless radio frequency (RF), reading and writing to the recording medium (electronic tag or RFID card) using RF, thereby achieving target identification and data exchange. After the RFID reader coil detects the tag ID carried by the target fish, it can transmit the tag ID to the control module for subsequent processing. Specifically, the RFID module in this application is used to identify the tags carried by fish as they pass through a specific area and obtain their unique IDs. Multiple RFID reader coils are evenly embedded around the inner wall of each entry and exit channel. The specific number and spacing are determined based on the channel width and the effective recognition range of the reader to ensure that at least one coil can reliably read the fish's tag as it passes. The coils should be waterproof. The RFID reader coils in each channel are connected to one or more multi-channel RFID readers / writers. The readers / writers are connected to the control module via wired or wireless means, such as Ethernet or Wi-Fi, and transmit the read RFID tag IDs and read timestamps in real time. The fish is fitted with a passive RFID tag. This tag is compact and lightweight, with no noticeable impact on the fish's movements. The tag can be implanted subcutaneously (for example, in the muscle below the dorsal fin) using biocompatible materials (such as medical silicone) or attached externally to the fish's back (for example, with bio-glue). The tag contains a unique digital ID. For example, a plastic RFID tag measuring 15mm x 15mm can be used.

[0023] The control module can receive the fish tag ID read by the reader coil through a communication connection, and then control the camera in response to the tag ID. When controlling the camera, the control module can send image capture instructions to the camera, causing it to capture one or more images. Because the camera's image capture area includes the area where the RFID reader coil is located, the images captured by the camera can include images of the fish corresponding to the large tag ID read by the RFID reader coil. In actual use, the camera can capture one or more images and perform pre-processing and filtering on the captured images, such as selecting the highest-resolution image for further fish identification. In one example, one or more high-resolution (e.g., 4K or higher) and high-frame-rate (e.g., 30 fps or higher) industrial-grade cameras can be mounted directly above the water tank. The camera's field of view should fully cover the entire monitoring tank / area, ensuring no blind spots. In actual use, multiple cameras can be used. Using multiple cameras can eliminate obstructions and provide more accurate 3D positioning information. The camera should have excellent low-light performance and be waterproof and fog-resistant. The camera is connected to the image acquisition card via a high-speed data line (such as USB3.0 (a USB interface specification) or GigE Vision (a camera interface standard developed based on the Gigabit Ethernet communication protocol)), and the image acquisition card transmits the video stream to the control module.

[0024] When setting a visual ID for the target fish based on the target fish's image frame, the fish can be identified using a preset fish position recognition model. Specifically, the fish recognition model can be implemented using a CNN (convolutional neural network) model, a YOLO (You Only Look Once) model, a PRAM (Position Recognition Anywhere model), or a SpatialLM (an open-source 3D visual model). A corresponding visual ID is then assigned to the identified model. The tag ID and the visual ID are then bound together. The visual ID is then used to control the camera to track and monitor the target fish. During subsequent tracking and detection of the target fish, the detected information can be associated with the visual ID, and the visual ID can be associated with the corresponding tag ID. Compared to solutions that only identify fish using tag IDs but cannot continuously track them, the method of the present embodiment can achieve both fish identification and continuous tracking. Specifically, when the RFID tag carried by the fish enters the effective recognition range of the RFID reader coil, the RFID reader immediately reads its tag ID and sends a read signal and a timestamp to the control module. At the same time, after receiving the RFID signal, the control module synchronously instructs the top camera to capture a sequence of high-definition image frames for the current moment and several seconds before and after (for example, 2 seconds before and after, for a total of 4 seconds). These synchronously captured image frames are then processed in real time. First, a deep learning-based fish object detection model (such as YOLOv8 or Faster R-CNN) is used to accurately detect all fish in the image, identifying the location and size of each fish. For each detected fish, the system generates a unique "visual ID" (e.g., a serial number). This visual ID is assigned based on the fish's appearance characteristics (such as color, texture, shape, etc., if there are minor differences) or its initial position in the image frame. Successfully associated visual IDs and RFID IDs are stored in a database, establishing a unique identity mapping.

[0025] When the camera is controlled to track and monitor the target fish through the visual ID and the preset multi-target tracking algorithm, once the fish enters the monitoring area and completes the initial identity binding, the subsequent tracking mainly relies on machine vision and no longer relies on RFID reading frequently to reduce interference and improve efficiency. The multi-target tracking algorithm (for example, DeepSORT, ByteTrack, etc.) is used to continuously track the motion trajectory of the fish entering the area. These algorithms can maintain the continuity of the visual ID and record the real-time position coordinates of each fish through feature matching and motion prediction between frames, even when the fish are temporarily blocked or intersecting each other. Based on the continuously tracked fish trajectory and position information, the system can further analyze: (1) Activity range and time: the activity area and residence time of each fish in the water tank. (2) The density of the fish school, the distance between individuals, the clustering pattern, etc. (3) By identifying the opening and closing movements of the fish mouth, the residence time of the fish in the feed delivery area, the specific posture of the head on the water surface or near the feed particles, etc., the occurrence of feeding behavior can be judged. This requires a more sophisticated posture estimation or behavior recognition model. (4) Estimate individual food intake by combining feed quantity and the frequency / duration of feeding behavior. This may require additional sensors (e.g., surface feed quantity monitoring) or more complex behavioral models.

[0026] It can be seen that through the device of the embodiment of the present application, only a background board, an RFID card reader coil and a camera are needed to realize reading the tag ID of the fish body through the RFID card reader coil, setting the visual ID for the fish body through the camera, thereby binding the tag ID and the visual ID, and realizing continuous tracking and monitoring of the fish body through the visual ID, thereby solving the problems of low efficiency and high cost in the process of fish positioning and tracking.

[0027] In one possible embodiment, the control module is specifically used to calculate the distance between each fish and the RFID card reader coil through a preset fish position recognition model when the camera captures an image frame containing multiple fish bodies; based on the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

[0028] Since RFID devices are typically installed in the fish's dorsal or abdominal muscles, this ensures that the tag is not affected by the fish's movement while also minimizing the impact on the fish. Therefore, in embodiments of the present application, when calculating the distance between each fish and the RFID reader coil, the distance between the location where the tag is installed and the RFID reader coil can be calculated. Alternatively, the distance between a specific location on the fish and the RFID reader coil can be calculated, such as the center, head, or tail of the fish. When calculating the distance between each fish and the RFID reader coil, the distance can be simply determined by identifying the distance between the fish and the RFID reader coil in the captured image, or by identifying spatial coordinates and performing the calculation based on the identified spatial coordinates. Specifically, this can be performed using a pre-set fish position recognition model. In one example, the position of the RFID reader coil can be a known location during the calculation. In actual use, when there are multiple RFID reader coils, the distance between each fish and the RFID reader coil can be calculated separately for each RFID reader coil. When multiple fish are located around an RFID reader coil, the tag ID corresponding to the first identified fish is often sent to the control module. This first identified fish is typically the one closest to the RFID reader coil. Therefore, the fish closest to the RFID reader coil is selected as the target fish, and a visual ID is assigned to the target fish. This allows the tag ID corresponding to the closest fish to be associated with the visual ID, facilitating subsequent observation. In actual use, if it is difficult to distinguish which fish is closest to the RFID reader coil, the visual ID can be assigned to each fish and then randomly associated. Specifically, the system can calculate the distance from the geometric center of each fish to the center of the RFID reader coil based on the pixel coordinates of the fish in the image and the pre-calibrated physical coordinates of the RFID reader coil (mapped to the image pixel coordinate system via geometric transformation). If multiple fish appear simultaneously within a single RFID reader area in a synchronously captured image frame, the system will preferentially associate the fish closest to the center of the RFID reader with the currently read RFID tag ID. If multiple fish are very close to the center of the RFID reader (for example, within a set threshold, such as 5 pixels), making it difficult to accurately distinguish them by location, the system will temporarily mark the visual IDs and RFID IDs of these fish as "pending association." The system will continue to track these "pending association" fish and, based on their subsequent behavioral patterns (such as which fish leave the area) or clearer image information, make corrections or random assignments.

[0029] In one possible embodiment, the control module is further configured to unbind the tag ID from the visual ID when the target fish is detected by the camera and leaves the camera's range. In this application, the camera's range can be larger than the RFID reader's acquisition range. Therefore, even if the fish leaves the RFID reader's acquisition range, it can continue to be observed using the visual ID. Tracking is performed solely through machine vision based on the initial visual ID, without relying on RFID reading. When the fish leaves the camera's recognition range, further detection is no longer possible. Therefore, the binding between the tag ID and the visual ID can be unbound, allowing reliable access to the fish's identity information the next time the fish reenters the monitoring area. Specifically, when the fish leaves the monitoring area, its identity binding is unbound, allowing it to reenter the monitoring area. When the fish passes through the exit channel again, its RFID tag is re-recognized by the reader. The control module searches for its associated visual ID based on the RFID re-read signal. Once the fish is confirmed to have left the monitoring area, the system unbinds the visual ID from the RFID ID. The visual ID status of the fish is marked as "not in the monitoring area" so that it can be re-identified and bound the next time it enters.

[0030] In one possible embodiment, the control module is specifically configured to capture images of the target fish at multiple moments using the camera; and identify behavioral data of the target fish based on the captured images at multiple moments, where the behavioral data includes visual ID, location, and behavioral trajectory. After capturing images of the target fish at multiple moments using the camera, information such as the fish's position and morphology in each image can be identified. The images are then arranged in chronological order to obtain the behavioral trajectory of the target fish. The "superordinate position" can refer to the current position or the position corresponding to each moment. The fish's position can be calculated using a pre-trained fish position recognition model, such as PRAM (Position Recognition Anywhere Model) or SpatialLM (an open-source 3D visual model). In actual use, the collected fish behavioral data can be used to accurately analyze the feeding behavior and food intake of individual fish in a school, providing a reference for optimizing feed formulations, feeding strategies, improving feed utilization, and cultivating superior strains that tolerate roughage and are feed-efficient through genetic improvement.

[0031] In one possible embodiment, the device is a frame-type structure; the background plate is arranged at the bottom of the frame-type structure; the RFID card reader coil is arranged on the side wall of the frame-type structure; the camera is arranged on the top of the frame-type structure; and the frame-type structure includes an open entrance and an open exit. The fish body positioning and tracking device in this application can be found in Figure 1 , Figure 1 This is a schematic diagram of another structure of the fish positioning and tracking device provided in an embodiment of the present application. This structure can be a frame-like structure, allowing fish to enter and exit freely, and one or more sides can be equipped with RFID coils. In actual use, the device can be submerged in water, making it easy for fish to enter and exit.

[0032] It can be seen that through the device corresponding to the embodiment of the present application, it is possible to achieve freedom of movement of fish in an open breeding environment without restricting it; accurately collect behavioral data of individual fish in complex environments such as optical interference of water bodies and occlusion of fish bodies; and combine the advantages of RFID and machine vision to improve the continuity of tracking and the accuracy of individual identification, reduce system complexity and hardware costs, and have good application and promotion prospects.

[0033] To illustrate the solution of the embodiment of the present application, the following is a description of a specific embodiment. The specific method of using the above device includes: (1) When the fish enters or leaves the RFID coil, the RFID system reads the tag ID carried by the fish and simultaneously captures the image frame by the top camera; (2) The image analysis algorithm assigns a visual ID to the fish that appears in the image based on the captured image; (3) By analyzing the relationship between the position of the fish body in the image and the position of the RFID coil, the visual ID is analyzed and associated with the RFID; (4) If multiple fish appear simultaneously in a single RFID reader area, the fish closest to the center of the RFID reader is selected as the associated object; if they cannot be distinguished, they are randomly associated; (5) After the fish enters the monitoring area, subsequent tracking is only carried out based on the initial visual ID through machine vision, and no longer relies on RFID reading.

[0034] (6) When the fish passes through the RFID coil and leaves the monitoring area, the visual ID is disassociated from the RFID so that its identity information can be reliably obtained the next time the fish enters the monitoring area again.

[0035] The solution of this embodiment has the following advantages: (1) By combining the identity certainty of RFID and the real-time tracking capability of machine vision, the accuracy of identifying and tracking individual fish in complex water environments is significantly improved. (2) It avoids the interference of traditional physical isolation on the natural behavior of fish and more realistically reflects the characteristics of fish such as aggregation and competition for food. (3) Compared with traditional methods that require a lot of manual operation or expensive dedicated equipment, this system can realize automatic and continuous data collection after deployment, reducing long-term operating costs. (4) It can not only identify individual identities, but also accurately collect various data such as their movement trajectory, activity range, and feeding behavior frequency, providing a scientific basis for feed formulation optimization, precise feeding, and breeding strategy adjustment. (5) Long-term tracking data can be used to evaluate key indicators such as feed utilization and growth rate of different fish strains, supporting the genetic improvement and breeding of excellent strains such as those that are tolerant to roughage and save feed.

[0036] The second aspect of the embodiment of the present application provides a method for locating and tracking a fish body, see Figure 2 , Figure 2 This is a flow chart of a method for locating and tracking a fish body corresponding to an embodiment of the present application, which is applied to a control module in a fish body locating and tracking device. The method includes: Step S21, receiving and responding to the tag ID and the corresponding timestamp, controlling the camera to capture the image frame of the target fish body; Step S22, detecting the fish body according to the image frame of the target fish body by using a preset fish body target detection model; Step S23, setting a visual ID based on the detected fish body information; Step S24, binding the tag ID and the visual ID; Step S25: controlling the camera to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm.

[0037] Specifically, in actual use, this method can be applied to and implemented by the control module in the aforementioned fish positioning and tracking device. Furthermore, the control module can be a computer, server, etc., and can receive the tag ID of the target fish captured by the RFID reader coil and the image captured by the camera, and can also control the camera.

[0038] In a possible implementation, setting a visual ID for the target fish body according to the image frame of the target fish body includes: When the camera captures an image frame containing multiple fish bodies, the distance between each fish body and the RFID card reader coil is calculated using a preset fish body position recognition model; According to the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

[0039] In one possible implementation, the method further includes: When the target fish body is detected by the camera and leaves the shooting range of the camera, the binding between the tag ID and the visual ID is released.

[0040] In a possible embodiment, the control module is specifically used to collect images of the target fish body at multiple moments through the camera; and identify the behavioral data of the target fish body based on the collected images at multiple moments, wherein the behavioral data includes: visual ID, position, and behavioral trajectory.

[0041] It can be seen that through the method of the embodiment of the present application, it is possible to read the tag ID of the fish body through the RFID card reader coil, and then set the visual ID for the fish body through the camera, thereby binding the tag ID and the visual ID, and realizing continuous tracking and monitoring of the fish body through the visual ID, thereby solving the problems of low efficiency and high cost in the process of fish positioning and tracking.

[0042] The present application also provides an electronic device, as shown, including: Memory for storing computer programs; The processor is configured to execute the program stored in the memory by performing the following steps: receiving and responding to the tag ID and the corresponding timestamp, controlling the camera to capture an image frame of the target fish body; By presetting a fish body target detection model, the fish body is detected according to the image frame of the target fish body; Set the visual ID based on the fish body information obtained by detection; Binding the tag ID and the visual ID; The camera is controlled to track and monitor the target fish body through the visual ID and the preset multi-target tracking algorithm.

[0043] The communication bus mentioned in the electronic devices mentioned above can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into address buses, data buses, control buses, etc. For ease of illustration, only a single thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0044] The communication interface is used for communication between the above electronic device and other devices.

[0045] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0046] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0047] In another embodiment provided in the present application, a computer-readable storage medium is further provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned fish body positioning and tracking methods are implemented.

[0048] In another embodiment provided by the present application, a computer program product comprising instructions is also provided, which, when executed on a computer, enables the computer to execute any of the fish positioning and tracking methods in the above embodiments.

[0049] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be magnetic media (e.g., floppy disk, hard disk, tape), optical media (e.g., DVD), or solid-state drive (SSD).

[0050] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0051] Each embodiment in this specification is described in a related manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences between the other embodiments. In particular, the method, electronic device, and storage medium embodiments are generally similar to the apparatus embodiments, so their descriptions are relatively simple. For related portions, reference can be made to the descriptions of the method embodiments.

[0052] The above description is only a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application are included in the scope of protection of the present application.

Claims

1. A fish body positioning and tracking device, characterized in that: The device comprises: A background plate is provided at the bottom; an RFID card reader coil is provided on the side wall; a camera is provided at the top, wherein the camera's shooting range includes the area where the background plate and the RFID card reader coil are located; the RFID card reader coil is in communication with the camera and the control module; the device includes an open entrance and an open exit; The RFID card reader coil is used to detect the tag ID carried by the target fish body; and send the tag ID and the corresponding timestamp to the control module; The control module is used to receive and respond to the tag ID and the corresponding timestamp to control the camera to collect the image frame of the target fish body; detect the fish body according to the image frame of the target fish body through a preset fish body target detection model; set the visual ID according to the fish body information obtained by detection; bind the tag ID and the visual ID; and control the camera to track and monitor the target fish body through the visual ID and a preset multi-target tracking algorithm.

2. The device according to claim 1, characterized in that The control module is specifically used to calculate the distance between each fish and the RFID card reader coil through a preset fish position recognition model when the camera captures an image frame containing multiple fish bodies; based on the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

3. The device according to claim 1 or 2, characterized in that The control module is further configured to release the binding between the tag ID and the visual ID when the camera detects that the target fish body leaves the shooting range of the camera.

4. The device according to claim 1 or 2, characterized in that The control module is specifically used to collect images of the target fish body at multiple moments through the camera; and identify the behavioral data of the target fish body based on the images collected at multiple moments, wherein the behavioral data includes: visual ID, position, and behavioral trajectory.

5. The device according to claim 1 or 2, characterized in that The device is a frame-type structure; The background plate is arranged at the bottom of the frame structure; the RFID card reading coil is arranged on the side wall of the frame structure; and the camera is arranged on the top of the frame structure.

6. A fish body positioning and tracking method, characterized in that: The control module used in the fish positioning and tracking device according to claim 1, the method comprising: receiving and responding to the tag ID and the corresponding timestamp, controlling the camera to capture an image frame of the target fish body; By presetting a fish body target detection model, the fish body is detected according to the image frame of the target fish body; Set the visual ID based on the fish body information obtained by detection; Binding the tag ID and the visual ID; The camera is controlled to track and monitor the target fish body through the visual ID and the preset multi-target tracking algorithm.

7. The method according to claim 6, characterized in that The step of setting a visual ID for the target fish body according to the image frame of the target fish body comprises: When the camera captures an image frame containing multiple fish bodies, the distance between each fish body and the RFID card reader coil is calculated using a preset fish body position recognition model; According to the calculated distance, the fish body closest to the RFID card reader coil is used as the target fish body, and the visual ID is set for the target fish body.

8. The method according to claim 6 or 7, characterized in that The method further comprises: When the target fish body is detected by the camera and leaves the shooting range of the camera, the binding between the tag ID and the visual ID is released.

9. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the method described in any one of claims 6 to 8 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 6 to 8 is implemented.

Images