Water surface floating object identification and detection method, equipment and product

By using a neural network model of multi-branch backbone network and fusion module in the recognition detection of water surface floating objects, the problem of unstable manual inspection and artificial intelligence detection in the prior art is solved, and higher recognition accuracy and applicability are achieved.

CN119888450AActive Publication Date: 2025-04-25TIANJIN POLYTECHNIC UNIV

Patent Information

Application Number
CN202510354295.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-25
Publication Date
2025-04-25
Estimated Expiration
2045-03-25

AI Technical Summary

Technical Problem

In the prior art, the identification and detection of floating objects on the water surface relies on manual inspection, resulting in missed and missed inspections; while the artificial intelligence-based methods have unstable detection effects due to environmental changes and poor adaptability.

Method used

A multi-branch backbone network based on the RT-DETR neural network model is adopted, combined with shallow spatial feature modules and semantic feature modules, and the fusion modules are used to efficiently fusion features to establish a neural network model that can identify floating objects on the water surface.

Benefits of technology

It improves the accuracy of identification and detection of floating objects on the water surface, enhances the applicability to various application scenarios, and reduces the possibility of missed and missed inspections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119888450A_ABST
    Figure CN119888450A_ABST
Patent Text Reader

Abstract

The invention discloses a water surface floating object identification and detection method, equipment and a product. The method comprises the following steps: establishing a neural network model based on an RT-DETR neural network model; training a neural network model by using the marked water surface floating object image data set; using the trained neural network model to identify and detect the image possibly containing the water surface floaters; the invention discloses a water surface floating object identification and detection method, equipment and a product, a multi-branch backbone network is innovatively used, shallow spatial feature extraction of an input image is ensured, global context fusion semantic features of the input image can be extracted, two types of features can be adaptively and efficiently fused, and the accuracy and the reliability of the detection method are improved. The accuracy of identifying and detecting the floating objects on the water surface is effectively improved, and the applicability to various application scenes is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of artificial intelligence, and in particular relates to a method, device and product for identifying and detecting floating objects on a water surface. Background Art

[0002] Under the existing technology, the identification and detection of floating objects on the water surface still mainly relies on manual inspection methods, including on-site inspections, or using drones, ships and other vehicles to take images or videos of the water surface, and then the operators perform subsequent image analysis and floating object identification. Therefore, in the monitoring of floating objects on the water surface in large areas of water, manual inspections often cannot fully cover the entire water area, which can easily lead to missed detections and false detections, and the response to environmental changes is relatively slow. On the other hand, the existing artificial intelligence-based floating object detection methods are also very unstable and have poor adaptability due to water surface fluctuations, floating object movement, weather changes, floating object types and changes in size. Summary of the invention

[0003] In view of this, the present invention aims to overcome the defects in the prior art and proposes a method, device and product for identifying and detecting floating objects on the water surface.

[0004] To achieve the above object, the technical solution of the present invention is achieved as follows: In a first aspect, the present invention discloses a method for identifying and detecting floating objects on a water surface, comprising: Establishing a neural network model, and using a labeled water surface floating object image data set to train the neural network model, to obtain a neural network model capable of identifying water surface floating objects; Use the trained neural network model to identify and detect images that may contain floating objects on the water surface; Establishing the neural network model includes: establishing the neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model; The multi-branch backbone network includes: using a shallow spatial feature module to extract shallow spatial features of an input image; using a semantic feature module to extract context-fused semantic features of the input image; and using a fusion module to fuse the shallow spatial features and the context-fused semantic features and output them.

[0005] In one embodiment of the present invention, a fusion module is used to fuse shallow spatial features and context fusion semantic features and then output them, including: The shallow spatial features and the context-fused semantic features are convolved separately and then concatenated to obtain the first concatenated features; Perform Sigmoid normalization on the first concatenated feature to generate a dynamic alignment weight; Perform Split weight segmentation on the dynamic alignment weight to obtain weight parameters corresponding to shallow spatial features and context fusion semantic features respectively; The fused output of shallow spatial features and context-fused semantic features is the weighted sum of the two according to the corresponding weight parameters.

[0006] In one embodiment of the present invention, after replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model, it also includes: replacing the attention image feature fusion AIFI module of the neural network model with a dynamic range histogram self-attention DHSA module or a cascade group attention CGA module.

[0007] In one embodiment of the present invention, the shallow spatial feature module is composed of a cascade stack of a Conv module and a C2f module.

[0008] In one embodiment of the present invention, the semantic feature module is composed of a cascade stack of a DWConv module and a HGBlock module.

[0009] In one embodiment of the present invention, the fusion module is a multi-scale adaptive spatial attention gate MASAG module.

[0010] In one embodiment of the present invention, the HGStem module is used to obtain basic features of the input image, and the shallow spatial feature module and the semantic feature module both extract features of the input image based on the basic features.

[0011] In a second aspect, the present invention discloses a device for identifying and detecting floating objects on a water surface, the device comprising: The model building module is used to build a neural network model, and use the labeled water surface floating object image data set to train the neural network model to obtain a neural network model that can identify water surface floating objects; building the neural network model includes: building a neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network; the multi-branch backbone network includes: using a shallow spatial feature module to extract shallow spatial features of the input image; using a semantic feature module to extract context fusion semantic features of the input image; using a fusion module to fuse the shallow spatial features and the context fusion semantic features and then output; The recognition and detection module is used to use the trained neural network model to recognize and detect images that may contain floating objects on the water surface.

[0012] In a third aspect, the present invention discloses an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors execute the above method.

[0013] In a fourth aspect, the present invention discloses a computer program product, including a computer program, which implements the above method when executed by a processor.

[0014] Compared with the prior art, the present invention has the following advantages: The present invention discloses a method, device and product for identifying and detecting floating objects on water surface, comprising: establishing a neural network model based on an RT-DETR neural network model; training the neural network model using a labeled data set of floating object images on water surface; identifying and detecting images that may contain floating objects on water surface using the trained neural network model; The present invention discloses a method, device and product for identifying and detecting floating objects on water surface, innovatively using a multi-branch backbone network, which not only ensures the shallow spatial feature extraction of an input image, but also can extract the global context fusion semantic features of the input image, and can adaptively and efficiently fuse the two types of features, effectively improving the accuracy of identifying and detecting floating objects on water surface, and improving the applicability to various application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The accompanying drawings, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0016] In the attached picture: Figure 1 This is a schematic diagram of an application scenario of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 2 This is a schematic diagram of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 3 This is a schematic diagram of a neural network model of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 4 This is a schematic diagram of a shallow space feature module of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 5 This is a schematic diagram of a semantic feature module of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 6 This is a schematic diagram of a SCFB module of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 7 This is a schematic diagram of a fusion module of a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Figure 8 This is a schematic diagram of an electronic device for a method for identifying and detecting floating objects on a water surface according to an embodiment of the present invention; Fig. 9The present invention is a schematic diagram of a device for identifying and detecting floating objects on the water surface according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0018] In the description of the present invention, it should be further explained that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0019] The present invention discloses a method for identifying and detecting floating objects on the water surface, a device and an application scenario of the product. Figure 1 As shown, under the existing technical conditions, the recognition and detection of floating objects on the water surface, on the one hand, still mainly relies on manual inspection methods, which is prone to missed detection and wrong detection; on the other hand, the existing detection methods of floating objects on the water surface based on artificial intelligence are also very unstable and have poor adaptability due to reasons such as water surface fluctuations, movement of floating objects, weather changes, changes in the types and volume of floating objects. The present invention discloses a method, device and product for the recognition and detection of floating objects on the water surface, which innovatively uses a multi-branch backbone network, which not only ensures the shallow spatial feature extraction of the input image, but also can extract the global context fusion semantic features of the input image, and can adaptively and efficiently fuse the two types of features, effectively improving the accuracy of the recognition and detection of floating objects on the water surface, and improving the applicability to various application scenarios.

[0020] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0021] In one embodiment of the present invention, Figure 2 As shown, the present invention discloses a method for identifying and detecting floating objects on a water surface, comprising: Step S201, establishing a neural network model, and using the labeled water surface floating object image data set to train the neural network model, to obtain a neural network model capable of identifying water surface floating objects; In this embodiment, a labeling tool, such as LabelImg or VGG Image Annotator, is used to manually label the captured images. The positions of floating objects on the water surface are framed and assigned category labels, such as "plastic bottle", "wood block", etc., to obtain a labeled water surface floating object image dataset.

[0022] In this embodiment, the annotated images are transformed, such as rotated, cropped, scaled, and color-changed, to increase the diversity of the data set, so as to help the model perform more robustly in different environments, so that the neural network model can stably detect floating objects under different lighting, angles, and backgrounds, avoid overfitting of the neural network model, and improve the generalization ability of the neural network model.

[0023] The neural network model can be trained using any one of the DioU loss function, the CioU loss function or the EioU loss function. Preferably, this embodiment uses the DioU loss function for training.

[0024] Step S202, using the trained neural network model to identify and detect images that may contain floating objects on the water surface; In this embodiment, the trained neural network model is deployed on the edge device for water surface floating object detection, which can significantly improve the real-time performance, reliability, cost-effectiveness, privacy protection and network independence of the system. Especially in scenarios where large-scale data needs to be processed efficiently and the continuous operation of the system is guaranteed, edge computing provides a powerful solution. By optimizing hardware and using dedicated AI accelerators, edge devices can efficiently handle water surface floating object detection tasks with lower power consumption, less latency and lower operating costs.

[0025] In this embodiment, the detected floating objects on the water surface are visualized in real time on the input image, and the bounding boxes are drawn on the image and the category labels are annotated to display the detection results. OpenCV or other graphics rendering libraries can be used to achieve real-time display of the image. Furthermore, the results detected by the edge device can be uploaded to the cloud for storage or further analysis through efficient data transmission protocols, such as HTTP or WebSocket. The cloud server can perform in-depth analysis, historical data storage or cross-regional collaboration based on these data, providing more powerful support for the task of detecting floating objects on the water surface.

[0026] Step S203, establishing a neural network model includes: establishing a neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model; Step S204, the multi-branch backbone network includes: using the shallow spatial feature module to extract the shallow spatial features of the input image; using the semantic feature module to extract the context fusion semantic features of the input image; using the fusion module to fuse the shallow spatial features and the context fusion semantic features and output them.

[0027] In this embodiment, the HGStem module is used to obtain basic features of the input image, and the shallow spatial feature module and the semantic feature module both extract features of the input image based on the basic features.

[0028] The shallow spatial feature module and the semantic feature module share a HGStem module, which can effectively reduce the amount of calculation.

[0029] In this embodiment, the shallow spatial feature module is mainly responsible for extracting shallow spatial features, retaining high-resolution information, and achieving efficient feature expression while lightweight design. The semantic feature module captures semantic features through global context modeling and integrates multi-scale information to achieve expression that focuses on contextual semantics.

[0030] In another embodiment of the present invention, Figure 7 As shown in the figure, the fusion module is used to fuse the shallow spatial features and the contextual fusion semantic features and output them, including: The shallow spatial features and the context-fused semantic features are convolved separately and then concatenated to obtain the first concatenated features; Perform Sigmoid normalization on the first concatenated feature to generate a dynamic alignment weight; Perform Split weight segmentation on the dynamic alignment weight to obtain weight parameters corresponding to shallow spatial features and context fusion semantic features respectively; The fused output of shallow spatial features and context-fused semantic features is the weighted sum of the two according to the corresponding weight parameters.

[0031] In this embodiment, the fusion module uses adaptively adjustable weight parameters to dynamically adjust the feature weights of the two paths of shallow spatial features and context fusion semantic features, thereby enhancing the adaptability of the model to diverse features, avoiding feature loss, ensuring efficient combination of global features, and providing higher detection performance and reasoning efficiency for target detection tasks.

[0032] In another embodiment of the present invention, the fusion module may also directly use the multi-scale adaptive spatial attention gate MASAG module.

[0033] The multi-scale adaptive spatial attention gate MASAG module can effectively highlight key features while suppressing redundant information, thereby improving the model's target recognition ability in complex scenes.

[0034] In another embodiment of the present invention, Figure 3As shown, after replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model, it also includes: replacing the attention image feature fusion AIFI module of the neural network model with a dynamic range histogram self-attention DHSA module or a cascade group attention CGA module.

[0035] Dynamic range histogram self-attention DHSA dynamically adjusts the self-attention weight based on the pixel value distribution in the image, helping the model adapt to different pixel ranges and visual features. The accuracy of the self-attention mechanism is improved through dynamic adjustment of the histogram, especially in scenes with large brightness changes. Dynamic range histogram self-attention DHSA can better capture long-term dependencies in the image away from the area of ​​interest, effectively suppress background noise, and improve the detection performance of the model.

[0036] In another embodiment of the present invention, Figure 4 As shown in FIG, the shallow spatial feature module is composed of a cascade stack of a Conv module and a C2f module, including a Conv module and a C2f module.

[0037] In another embodiment of the present invention, Figure 5 As shown in FIG. 1 , the semantic feature module is composed of a cascade stack of a DWConv module and a HGBlock module, including a DWConv module and a HGBlock module.

[0038] In another embodiment of the present invention, Figure 6 As shown in FIG. 1 , the semantic feature module can also be composed of a DWConv module and three HGBlock modules cascaded and stacked.

[0039] In one embodiment of the present invention, Figure 3 As shown in the figure, the multi-branch backbone network is represented as DuoAlignNet, the shallow spatial feature module is represented as LEB module, and the fusion module is represented as AFA module; when the semantic feature module is composed of a DWConv module and a HGBlock module cascaded and stacked, it is represented as CFB module; when the semantic feature module is composed of a DWConv module and three HGBlock modules cascaded and stacked, it is represented as SCFB module; like Figure 3 As shown, in this embodiment, the multi-branch backbone network includes three cascaded and stacked feature extraction and fusion modules: The first feature extraction and fusion module includes: after the input image is processed by the HGStem module to extract basic features, it is processed by the C2f module and the HGBlock module respectively, and then input into the corresponding LEB module and CFB module; after the AFA module fuses the two features output by the LEB module and the CFB module, it is input into the Neck module of the neural network model and the second feature extraction and fusion module of the next layer respectively; The second feature extraction and fusion module includes: the fusion features output by the first feature extraction and fusion module are respectively input into the LEB module and the SCFB module, and the AFA module fuses the two features output by the LEB module and the SCFB module, and then respectively inputs them into the Neck module of the neural network model and the third feature extraction and fusion module of the next layer; The third feature extraction and fusion module includes: the fusion features output by the second feature extraction and fusion module are respectively input into the LEB module and the CFB module, and the MASAG module fuses the two features output by the LEB module and the CFB module, and then inputs them into the Neck module of the neural network model; In this embodiment, the MASAG module may also be replaced by an AFA module.

[0040] The present invention also discloses an electronic device, such as Figure 8 As shown, an embodiment is disclosed, which is a block diagram of an electronic device suitable for identifying and detecting the above-mentioned floating objects on the water surface.

[0041] The electronic device 80 of this embodiment includes a processor 801, which can perform various appropriate actions and processes according to the program stored in the ROM 802 or the program loaded from the storage part 808 to the RAM 803. The processor 801 may include, for example, a general-purpose microprocessor, an instruction set processor and / or a related chipset and / or a dedicated microprocessor, etc. The processor 801 may also include an onboard memory for caching purposes. The processor 801 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present invention.

[0042] In RAM803, various programs and data required for the operation of electronic device 80 are stored. Processor 801, ROM802 and RAM803 are connected to each other via bus 804, and processor 801 performs various operations of the method flow according to the embodiment of the present invention by executing the program in ROM802 and / or RAM803. It should be noted that the program can also be stored in one or more memories other than ROM802 and RAM803, and processor 801 can also perform various operations of the method flow according to the embodiment of the present invention by executing the program stored in one or more memories.

[0043] According to an embodiment of the present invention, the electronic device 80 may further include an I / O interface 805, which is also connected to the bus 804. The electronic device 80 may further include one or more of the following components connected to the I / O interface 805: an input portion 806 including a keyboard, a mouse, etc.; an output portion 807 including a cathode ray tube, a liquid crystal display, and a speaker; a storage portion 808 including a hard disk, etc.; and a communication portion 809 including a network interface card such as a LAN card, a modem, etc. The communication portion 809 performs communication processing via a network such as the Internet. A drive 8010 is also connected to the I / O interface 805 as needed. A removable medium 8011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 8010 as needed, so that a computer program read therefrom is installed into the storage portion 808 as needed.

[0044] like Fig. 9 As shown, the present invention also discloses a device for identifying and detecting floating objects on the water surface, the device comprising: The model building module 901 is used to build a neural network model, and train the neural network model using a labeled water surface floating object image data set to obtain a neural network model that can identify water surface floating objects; building the neural network model includes: building a neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model; the multi-branch backbone network includes: using a shallow spatial feature module to extract shallow spatial features of an input image; using a semantic feature module to extract context-fused semantic features of the input image; using a fusion module to fuse shallow spatial features and context-fused semantic features and then output them; The recognition and detection module 902 is used to use the trained neural network model to recognize and detect images that may contain floating objects on the water surface.

[0045] The present invention also provides a computer-readable storage medium.

[0046] The computer-readable storage medium may be included in the electronic device / device system described in the above embodiment; or it may exist independently without being assembled into the electronic device / device. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present invention is implemented.

[0047] According to an embodiment of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory RAM, a read-only memory ROM, an erasable programmable read-only memory EPROM or a flash memory, a portable compact disk read-only memory CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0048] Embodiments of the present invention also include a computer program product.

[0049] The computer program product includes a computer program, which contains program codes for executing the method provided by the embodiment of the present invention. When the computer program product runs on an electronic device, the program codes are used to enable the electronic device to implement the method provided by the embodiment of the present invention.

[0050] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium. The program code included in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0051] According to an embodiment of the present invention, the program code for executing the computer program provided by the embodiment of the present invention can be written by any combination of one or more programming languages, and specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages. Programming languages ​​include but are not limited to programming languages ​​such as Java, C++, python, C language or similar. The program code can be executed completely on the user computing device, partially on the user device, partially on the remote computing device, or completely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network or a wide area network, or can be connected to an external computing device.

[0052] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments and / or claims of the present invention can be combined and / or combined in various ways, even if such a combination or combination is not explicitly recorded in the present invention. In particular, without departing from the spirit and teaching of the present invention, the features described in the various embodiments and / or claims of the present invention may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present invention.

[0053] The embodiments of the present invention are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present invention. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination. The scope of the present invention is limited by the attached claims and their equivalents. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A method for identifying and detecting floating objects on a water surface, characterized in that: include: Establishing a neural network model, and using a labeled water surface floating object image data set to train the neural network model, to obtain the neural network model capable of identifying water surface floating objects; Using the trained neural network model to identify and detect images that may contain floating objects on the water surface; The establishing of the neural network model comprises: establishing the neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model; The multi-branch backbone network includes: using a shallow spatial feature module to extract shallow spatial features of an input image; using a semantic feature module to extract context-fused semantic features of the input image; and using a fusion module to fuse the shallow spatial features and the context-fused semantic features and then output them.

2. A method for identifying and detecting floating objects on a water surface according to claim 1, characterized in that: The utilizing a fusion module to fuse the shallow spatial features and the context fusion semantic features and then output them includes: Convolving the shallow spatial features and the context fusion semantic features respectively and then concatenating them to obtain a first concatenated feature; Performing Sigmoid normalization processing on the first splicing feature to generate a dynamic alignment weight; Performing Split weight segmentation on the dynamic alignment weight to obtain weight parameters corresponding to the shallow spatial features and the context fusion semantic features respectively; The fused output of the shallow spatial features and the context fused semantic features is a weighted sum of the two according to the corresponding weight parameters.

3. A method for identifying and detecting floating objects on a water surface according to claim 1, characterized in that: After replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model, it also includes: replacing the attention image feature fusion AIFI module of the neural network model with a dynamic range histogram self-attention DHSA module or a cascade group attention CGA module.

4. A method for identifying and detecting floating objects on a water surface according to claim 1, characterized in that: The shallow spatial feature module is composed of a cascade stack of a Conv module and a C2f module.

5. The method for identifying and detecting floating objects on the water surface according to claim 1, characterized in that: The semantic feature module is composed of a cascade stack of a DWConv module and a HGBlock module.

6. A method for identifying and detecting floating objects on a water surface according to claim 1, characterized in that: The fusion module is a multi-scale adaptive spatial attention gate MASAG module.

7. A method for identifying and detecting floating objects on a water surface according to claim 1, characterized in that: Also includes: The HGStem module is used to obtain basic features of the input image, and the shallow spatial feature module and the semantic feature module both extract features of the input image based on the basic features.

8. A device for identifying and detecting floating objects on the water surface, characterized in that: The device comprises: A model building module is used to build a neural network model, and use a labeled water surface floating object image data set to train the neural network model to obtain the neural network model that can identify water surface floating objects; the building of the neural network model includes: building the neural network model based on the RT-DETR neural network model, replacing the backbone network of the RT-DETR neural network model with a multi-branch backbone network as the neural network model; the multi-branch backbone network includes: using a shallow spatial feature module to extract shallow spatial features of an input image; using a semantic feature module to extract context fusion semantic features of the input image; using a fusion module to fuse the shallow spatial features and the context fusion semantic features and then output them; The recognition and detection module is used to use the trained neural network model to recognize and detect images that may contain floating objects on the water surface.

9. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are caused to perform the method according to any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Remote sensing image semantic segmentation method based on double-branch feature fusion

    CN115797931A

  • Low-resolution real-time gesture recognition method

    CN115797976A

  • Water area unmanned cleaning ship target lightweight detection method

    CN117746233A

  • Underwater target detection robot based on deep learning

    CN118411593A

  • Improved target detection method in automatic driving scene based on RT-DETR

    CN118644824A

Cited By

  • Method and system for detecting dense leaves under complex illumination in field and computer equipment

    CN120374965A