Siniperca chuatsi male and female rapid monitoring system based on ultrasonic image feature recognition

Abstract

The invention relates to a rapid mandarin fish sex monitoring system based on ultrasonic image feature recognition, which comprises a multi-modal data acquisition module, an integrated high-frequency ultrasonic probe (10-15MHz), a near infrared spectrum module (850nm) and a visible light camera, and is used for synchronously acquiring an ultrasonic image, blood oxygen distribution data and a mandibular contour image of a mandarin fish belly gonad area. The rapid mandarin fish sex monitoring system based on the multi-mode ultrasonic image and intelligent analysis has a high-precision identification effect, the ultrasonic texture features are combined with near-infrared blood oxygen distribution data, the sex judgment accuracy is improved to be larger than or equal to 95%, and the misjudgment rate is reduced to be smaller than 3%.

Description

Technical Field

[0001] This invention relates to a rapid monitoring system for the sex of mandarin fish based on ultrasonic image feature recognition, belonging to the field of mandarin fish farming technology. Background Technology

[0002] As an important economic fish species in my country, the sex determination of mandarin fish is of great significance for breeding optimization, population management, and improving economic benefits. However, traditional methods for sex determination of mandarin fish face the following technical bottlenecks: During the non-breeding season, the appearance of male and female mandarin fish is very similar. The accuracy rate of observation based solely on the genital protrusion or lower jaw morphology (e.g., the lower jaw of females is more rounded and blunt, while that of males is more pointed) is less than 60%, and it is easily affected by the subjective bias of the operator. Although the characteristics of the genital opening can be observed by squeezing during the breeding season, this can cause stress or even damage to the parent fish, affecting subsequent reproductive performance. Summary of the Invention

[0003] The purpose of this invention is to overcome the shortcomings of the existing technology and provide a rapid monitoring system for the sex of mandarin fish based on ultrasonic image feature recognition.

[0004] The objective of this invention can be achieved through the following technical solutions: A rapid monitoring system for male and female mandarin fish based on ultrasound image feature recognition includes a multimodal data acquisition module that integrates a high-frequency ultrasound probe (10-15MHz), a near-infrared spectroscopy module (850nm), and a visible light camera to simultaneously acquire ultrasound images of the abdominal gonadal region, blood oxygen distribution data, and mandibular contour images of mandarin fish. The mechanical positioning module includes a six-degree-of-freedom robotic arm and a guide platform. The robotic arm is equipped with the multimodal data acquisition module, and the guide platform has a built-in pressure sensor array for fixing the mandarin fish in a standard detection position (ventral side up, spine at a 15° angle to the horizontal plane) and monitoring the fixing pressure in real time. The intelligent analysis module includes an image processing unit and a gender determination unit. The image processing unit uses an improved U-Net network to segment the gonadal region in the ultrasound image and combines ultrasound texture features with near-infrared blood oxygen distribution features with a multimodal data fusion algorithm. The gender determination unit outputs the gender determination result and confidence level based on a convolutional neural network (CNN) and support vector machine (SVM) classifier. The terminal interaction module includes a portable touch screen terminal and a cloud platform, which is used to display the test results in real time and generate standardized reports that include gender determination, gonadal development level and historical data comparison.

[0005] Furthermore, the surface of the high-frequency ultrasonic probe is coated with a hydrophobic coating, and the probe contact pressure is stabilized within the range of 0.3-0.5N by the force control module at the end of the robotic arm.

[0006] Furthermore, the intelligent analysis module adopts a cascaded decision strategy. When the confidence level of the ultrasound image is lower than 90%, it automatically triggers near-infrared spectral data and mandibular contour optical images for auxiliary verification.

[0007] Furthermore, the guide platform is connected to a constant-temperature holding tank, where the water temperature is maintained within the optimal physiological temperature range for mandarin fish (20-25℃). The pressure sensor array built into the guide platform provides real-time feedback on the fish's fixation status, preventing excessive compression.

[0008] Furthermore, the portable terminal uses a lightweight MobileNetV3 model deployed on a Raspberry Pi 4B hardware platform, supporting the determination of the sex of a single mandarin fish within 10 seconds.

[0009] Furthermore, the cloud platform supports users to upload test data and automatically generates gonadal development trend analysis and breeding optimization suggestions based on historical databases.

[0010] Furthermore, the rapid method for monitoring the sex of mandarin fish includes the following steps: After anesthetizing the mandarin fish in a constant-temperature holding tank, they were transferred to a guide platform and fixed in a standard testing position. The abdomen of the mandarin fish was scanned by a multimodal data acquisition module controlled by a six-degree-of-freedom robotic arm, and ultrasound images, near-infrared spectral data and jaw contour images were acquired simultaneously. An improved U-Net network was used to segment the gonadal region in ultrasound images, extract texture features of the lobulated structure of the ovary or the tubular structure of the testis, and combine it with near-infrared blood oxygen distribution data for multimodal feature fusion. The gender determination result is output based on the CNN+SVM classifier. When the confidence level is lower than 90%, the mandibular contour optical image is called for auxiliary verification. Standardized test reports are output via portable terminals or cloud platforms, including gender determination, gonadal development level, and historical data comparison.

[0011] Furthermore, the ultrasound probe scanning path is adaptively adjusted according to the mandarin fish's body length (15-50cm) to ensure complete coverage of the gonadal region.

[0012] Furthermore, the multimodal data fusion algorithm adopts a weighted feature stitching method, with an ultrasound texture feature weight of 0.7 and a near-infrared blood oxygen feature weight of 0.3.

[0013] Furthermore, the cloud platform automatically identifies individuals with abnormal gonadal development and triggers early warnings by comparing historical data.

[0014] The present invention provides a rapid sex monitoring system for mandarin fish based on multimodal ultrasound images and intelligent analysis, which has a high-precision identification effect. By combining ultrasound texture features with near-infrared blood oxygen distribution data, the accuracy of sex determination is improved to ≥95%, and the false judgment rate is reduced to <3%. Detailed Implementation

[0015] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the shown orientation or positional relationship, or the orientation or positional relationship commonly used when the product of this invention is in use. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention. In addition, the terms "first," "second," and "third," etc., are only used to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0016] Furthermore, terms such as "horizontal" and "vertical" do not imply that components must be absolutely horizontal or suspended, but rather that they can be slightly tilted. For example, "horizontal" simply means that its direction is more horizontal than "vertical," and does not mean that the structure must be completely horizontal, but can be slightly tilted.

[0017] In the description of this invention, it should also be noted that, unless otherwise explicitly specified and limited, the terms "set," "install," "connect," and "link" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0018] A rapid monitoring system for male and female mandarin fish based on ultrasound image feature recognition, comprising a multimodal data acquisition module that integrates a high-frequency ultrasound probe (10-15MHz), a near-infrared spectroscopy module (850nm), and a visible light camera, for simultaneously acquiring ultrasound images of the abdominal gonadal region, blood oxygen distribution data, and mandibular contour images of mandarin fish; The mechanical positioning module includes a six-degree-of-freedom robotic arm and a guide platform. The robotic arm is equipped with the multimodal data acquisition module, and the guide platform has a built-in pressure sensor array for fixing the mandarin fish in a standard detection position (ventral side up, spine at a 15° angle to the horizontal plane) and monitoring the fixing pressure in real time. The intelligent analysis module includes an image processing unit and a gender determination unit. The image processing unit uses an improved U-Net network to segment the gonadal region in the ultrasound image and combines ultrasound texture features with near-infrared blood oxygen distribution features with a multimodal data fusion algorithm. The gender determination unit outputs the gender determination result and confidence level based on a convolutional neural network (CNN) and support vector machine (SVM) classifier. The terminal interaction module includes a portable touch screen terminal and a cloud platform, which is used to display the test results in real time and generate standardized reports that include gender determination, gonadal development level and historical data comparison.

[0019] Furthermore, the surface of the high-frequency ultrasonic probe is coated with a hydrophobic coating, and the probe contact pressure is stabilized within the range of 0.3-0.5N by the force control module at the end of the robotic arm.

[0020] Furthermore, the intelligent analysis module adopts a cascaded decision strategy. When the confidence level of the ultrasound image is lower than 90%, it automatically triggers near-infrared spectral data and mandibular contour optical images for auxiliary verification.

[0021] Furthermore, the guide platform is connected to a constant-temperature holding tank, where the water temperature is maintained within the optimal physiological temperature range for mandarin fish (20-25℃). The pressure sensor array built into the guide platform provides real-time feedback on the fish's fixation status, preventing excessive compression.

[0022] Furthermore, the portable terminal uses a lightweight MobileNetV3 model deployed on a Raspberry Pi 4B hardware platform, supporting the determination of the sex of a single mandarin fish within 10 seconds.

[0023] Furthermore, the cloud platform supports users to upload test data and automatically generates gonadal development trend analysis and breeding optimization suggestions based on historical databases.

[0024] Furthermore, the rapid method for monitoring the sex of mandarin fish includes the following steps: After anesthetizing the mandarin fish in a constant-temperature holding tank, they were transferred to a guide platform and fixed in a standard testing position. The abdomen of the mandarin fish was scanned by a multimodal data acquisition module controlled by a six-degree-of-freedom robotic arm, and ultrasound images, near-infrared spectral data and jaw contour images were acquired simultaneously. An improved U-Net network was used to segment the gonadal region in ultrasound images, extract texture features of the lobulated structure of the ovary or the tubular structure of the testis, and combine it with near-infrared blood oxygen distribution data for multimodal feature fusion. The gender determination result is output based on the CNN+SVM classifier. When the confidence level is lower than 90%, the mandibular contour optical image is called for auxiliary verification. Standardized test reports are output via portable terminals or cloud platforms, including gender determination, gonadal development level, and historical data comparison.

[0025] Furthermore, the ultrasound probe scanning path is adaptively adjusted according to the mandarin fish's body length (15-50cm) to ensure complete coverage of the gonadal region.

[0026] Furthermore, the multimodal data fusion algorithm adopts a weighted feature stitching method, with an ultrasound texture feature weight of 0.7 and a near-infrared blood oxygen feature weight of 0.3.

[0027] Furthermore, the cloud platform automatically identifies individuals with abnormal gonadal development and triggers early warnings by comparing historical data.

[0028] The present invention provides a rapid sex monitoring system for mandarin fish based on multimodal ultrasound images and intelligent analysis, which has a high-precision identification effect. By combining ultrasound texture features with near-infrared blood oxygen distribution data, the accuracy of sex determination is improved to ≥95%, and the false judgment rate is reduced to <3%.

[0029] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A rapid monitoring system for the sex of mandarin fish based on ultrasonic image feature recognition, characterized in that, include: The multimodal data acquisition module integrates a high-frequency ultrasound probe (10-15MHz), a near-infrared spectroscopy module (850nm), and a visible light camera to simultaneously acquire ultrasound images, blood oxygen distribution data, and mandibular contour images of the abdominal gonadal region of mandarin fish. The mechanical positioning module includes a six-degree-of-freedom robotic arm and a guide platform. The robotic arm is equipped with the multimodal data acquisition module, and the guide platform has a built-in pressure sensor array for fixing the mandarin fish in a standard detection position (ventral side up, spine at a 15° angle to the horizontal plane) and monitoring the fixing pressure in real time. The intelligent analysis module includes an image processing unit and a gender determination unit. The image processing unit uses an improved U-Net network to segment the gonadal region in the ultrasound image and combines ultrasound texture features with near-infrared blood oxygen distribution features with a multimodal data fusion algorithm. The gender determination unit outputs the gender determination result and confidence level based on a convolutional neural network (CNN) and support vector machine (SVM) classifier. The terminal interaction module includes a portable touch screen terminal and a cloud platform, which is used to display the test results in real time and generate standardized reports that include gender determination, gonadal development level and historical data comparison.

2. The rapid sex monitoring system for mandarin fish according to claim 1, characterized in that: The surface of the high-frequency ultrasonic probe is coated with a hydrophobic coating, and the probe contact pressure is stabilized within the range of 0.3-0.5N by the force control module at the end of the robotic arm.

3. The rapid sex monitoring system for mandarin fish according to claim 1, characterized in that: The intelligent analysis module adopts a cascaded decision strategy. When the confidence level of the ultrasound image is below 90%, it automatically triggers near-infrared spectral data and mandibular contour optical images for auxiliary verification.

4. The rapid sex monitoring system for mandarin fish according to claim 1, characterized in that: The guide platform is connected to the constant temperature holding tank, and the water temperature in the holding tank is maintained within the optimal physiological temperature range for mandarin fish (20-25℃). The pressure sensor array built into the guide platform provides real-time feedback on the fish's fixation status to avoid excessive compression.

5. The rapid sex monitoring system for mandarin fish according to claim 1, characterized in that: The portable terminal uses a lightweight MobileNetV3 model deployed on a Raspberry Pi 4B hardware platform and supports determining the sex of a single mandarin fish within 10 seconds.

6. The rapid sex monitoring system for mandarin fish according to claim 1, characterized in that: The cloud platform allows users to upload test data and automatically generates gonadal development trend analysis and breeding optimization suggestions based on historical databases.

7. A method for rapid detection of sex in mandarin fish, characterized in that... Includes the following steps: After anesthetizing the mandarin fish in a constant-temperature holding tank, they were transferred to a guide platform and fixed in a standard testing position. The abdomen of the mandarin fish was scanned by a multimodal data acquisition module controlled by a six-degree-of-freedom robotic arm, and ultrasound images, near-infrared spectral data and jaw contour images were acquired simultaneously. An improved U-Net network was used to segment the gonadal region in ultrasound images, extract texture features of the lobulated structure of the ovary or the tubular structure of the testis, and combine it with near-infrared blood oxygen distribution data for multimodal feature fusion. The gender determination result is output based on the CNN+SVM classifier. When the confidence level is lower than 90%, the mandibular contour optical image is called for auxiliary verification. Standardized test reports are output via portable terminals or cloud platforms, including gender determination, gonadal development level, and historical data comparison.

8. The method for rapid monitoring of sex in mandarin fish according to claim 7, characterized in that: The ultrasound probe scanning path is adaptively adjusted according to the mandarin fish's body length (15-50cm) to ensure complete coverage of the gonadal area.

9. The method for rapid monitoring of male and female mandarin fish according to claim 7, characterized in that: The multimodal data fusion algorithm adopts a weighted feature stitching method, with an ultrasound texture feature weight of 0.7 and a near-infrared blood oxygen feature weight of 0.

3.

10. The method for rapid monitoring of sex in mandarin fish according to claim 7, characterized in that: The cloud platform automatically identifies individuals with abnormal gonadal development and triggers early warning alerts by comparing historical data.