Cage net damage detection method, device and storage medium based on mathematical twin
By installing tension sensors on the fishing net rope and combining with artificial neural network model, real-time damage monitoring of fishing nets is achieved, solving the problems of low efficiency and poor accuracy of fishing net damage detection in the existing technology, and providing efficient and accurate fishing net damage detection method.
Patent Information
- Application Number
- CN202111555038.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-17
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2041-12-17
AI Technical Summary
The existing fishing net damage detection methods have high labor intensity, low efficiency, increased net clothing load or inaccurate inspection results, making it difficult to monitor damage in real time under complex sea conditions.
Using a method based on digital twin technology, by installing a tension sensor on the fishing net rope and combining an artificial neural network model, the damage of fishing nets under different sea conditions is simulated, and the fishing nets are monitored and judged in real time, and the location and degree of damage are determined.
Real-time damage monitoring of fishing nets under complex sea conditions is realized, quickly judges the damage situation, and reduces economic losses. The sensor does not increase the load of the net clothes, has high detection accuracy, and adapts to changes in water quality.
Smart Images

Figure CN114218864B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of aquaculture engineering and marine engineering disaster prevention and mitigation, and in particular to a method, device and storage medium for detecting damage of cage nets based on mathematical twin technology. Background Art
[0002] Fishing nets are an important part of fishery facilities. As a complex flexible structure, they are easily damaged in the deep-sea environment with harsh sea conditions. If not discovered in time, it will cause economic losses to the aquaculture industry. Therefore, net damage detection is one of the key technologies in the development of deep-sea fishery.
[0003] At present, the main method for detecting damaged fishing nets is for staff to dive into the water for manual inspection. In addition, domestic and foreign scholars have mainly proposed three relatively new methods: one is the buried wire detection method, which detects the damage of the net by the on-off of the metal wire. When the net is damaged, the metal wire will form a closed loop with the seawater, triggering the alarm device and reporting the net cage number and net number; the second is the sonar detection method, the working principle of this method is that when the net system is damaged and fish escape, there will be obvious differences in the sound wave images inside and outside the net cage; the third is the image analysis method, this method is to install an underwater camera on the AUV / ROV to collect images and detect whether the net is damaged.
[0004] Manual inspection is labor-intensive and inefficient. The buried wire detection method requires the installation of metal wires around the net, which increases the load on the net and easily causes fatigue damage, thus shortening the service life of the net. The sonar detection method cannot determine the location of the damage and the extent of the damage. At the same time, if there are schools of fish swimming around the net cage, the sonar will also detect the damage, resulting in inaccurate detection results. The image analysis method has extremely high requirements on the pixel quality of the camera and the turbidity of the water, and it is not easy to determine whether the net in turbid water is damaged. Summary of the invention
[0005] In order to realize real-time damage monitoring of fishing nets and save labor costs, improve detection efficiency, and overcome the limitations of the net itself or environmental interference, the purpose of the present invention is to provide a cage net damage detection method, device and storage medium based on mathematical twin technology.
[0006] To this end, the present invention provides the following technical solutions:
[0007] On the one hand, the present invention provides a method for detecting damage of cage nets based on digital twin technology, comprising:
[0008] Obtaining tension data detected by a tension sensor installed on the rope of the fishing net;
[0009] Inputting the tension data into a pre-constructed net clothing digital twin, and obtaining a net clothing damage recognition result output by the net clothing digital twin;
[0010] Among them, the pre-built digital twin of the mesh clothing includes:
[0011] According to the size of the cage net to be tested, an equivalent net numerical model is established, and the dynamic response of the fishing net when intact and damaged is simulated;
[0012] According to the environment where the fishing net is located, combined with various wave ranges and the damage of the net under different pre-designed sea conditions, the tension simulation of the rope is carried out using the numerical model of the net to obtain a simulation data set;
[0013] Establishing an artificial neural network damage recognition model and using the simulation data set to perform net damage recognition training on the artificial neural network damage recognition model;
[0014] The trained artificial neural network damage recognition model constitutes the digital twin of the clothing.
[0015] Furthermore, the artificial neural network model uses a BP neural network.
[0016] Furthermore, the structure number of the BP neural network is set to 3 layers, including an input layer, a hidden layer and an output layer, and the number of neurons in the hidden layer is set to 9.
[0017] Furthermore, the artificial neural network damage recognition model is trained for net damage recognition using the simulation data set, including:
[0018] The error back propagation training method is adopted, and the four values of effective wave height Hs, spectrum peak period Tp and tension value of horizontal and vertical bars are taken as input, and the complete state and damaged state of the net are taken as output.
[0019] Furthermore, the tension sensor installed on the fishing net ropes includes: a tension sensor is arranged every other rope on the transverse ropes and the longitudinal ropes of the net.
[0020] Furthermore, the measuring range of the tension sensor is 10-1000N.
[0021] Furthermore, it also includes: installing a wave and tide meter on the wave-facing side of the cage to collect wave parameters, inputting the wave parameters into the digital twin of the net in real time, and the digital twin of the net determines whether the net is damaged according to the wave parameters and the tension data.
[0022] In another aspect, the present invention further provides a cage net damage detection device based on digital twin technology, comprising:
[0023] A mesh digital twin construction unit, used to pre-construct a mesh digital twin;
[0024] A tension detection unit, used to obtain tension data detected by a tension sensor installed on the rope of the fishing net;
[0025] A net damage identification unit, used for inputting the tension data detected by the tension detection unit into the net digital twin constructed by the net digital twin construction unit, to obtain a net damage identification result output by the net digital twin;
[0026] Wherein, the net clothing digital twin construction unit includes:
[0027] The net numerical model establishment subunit is used to establish an equivalent net numerical model according to the size of the net cage to be tested, and simulate the dynamic response of the fishing net when it is intact and damaged;
[0028] The simulation subunit is used to simulate the tension of the fishing net rope using the numerical model of the fishing net according to the environment in which the fishing net is located, combined with various wave ranges and the damage of the fishing net in different pre-designed sea conditions, to obtain a simulation data set;
[0029] The training subunit is used to establish an artificial neural network damage recognition model and use the simulation data set to perform net clothing damage recognition training on the artificial neural network damage recognition model; the trained artificial neural network damage recognition model constitutes a net clothing digital twin.
[0030] On the other hand, the present invention also provides a computer-readable storage medium, which stores a computer instruction set. When the computer instruction set is executed by a processor, the above-mentioned cage net damage detection method based on mathematical twin technology is implemented.
[0031] Advantages and positive effects of the present invention:
[0032] (1) The present invention can be used for damage detection of flat fishing nets under complex sea conditions. The fishing nets can be monitored in real time, and whether the fishing nets are damaged can be quickly determined based on the tension sensor data. The degree of damage can also be evaluated based on the tension sensor data, and the location of the damage can be determined.
[0033] (2) The present invention utilizes a tension sensor installed on the fishing net rope to monitor the fishing net in real time. The sensor will not increase the load of the fishing net and affect the service life of the fishing net. The sensor is little affected by water quality and is less disturbed by the fishing net itself and environmental factors.
[0034] (3) The present invention has high computational efficiency. After inputting sensor data and sea condition parameters, it can output the status of the fishing net within 1 second, determine whether the fishing net is damaged, find the damaged location of the fishing net in time, and issue an alarm so that remedial measures can be taken in time to reduce the economic losses caused by the damage of the fishing net. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0036] Figure 1 It is a flow chart of a method for detecting damage of a cage net based on mathematical twin technology in an embodiment of the present invention;
[0037] Figure 2 4 is a neural network structure diagram for flexible fishing net damage detection in an embodiment of the present invention. DETAILED DESCRIPTION
[0038] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0039] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0040] The present invention provides a method for detecting damage of cage nets based on mathematical twin technology. The method uses a combination of numerical simulation and artificial neural network to develop a digital twin for detecting damage of nets. The recognition model can quickly identify damage according to environmental parameters and sensor data. First, an equivalent numerical model of a fishing net is used to simulate the integrity and damage of the fishing net to obtain a large amount of simulated sensor data. Then, these data are used to train an artificial neural network. The artificial neural network can identify whether the net is damaged according to different simulated sensor signals. Finally, according to the actual sensor data, the recognition model can quickly identify whether the net is damaged.
[0041] like Figure 1 As shown, it shows the overall framework of a cage net damage detection method based on digital twin technology in an embodiment of the present invention, including a construction stage and a real-time monitoring stage. In the construction stage, a digital twin is established. First, a numerical model of the net is established and various wave conditions are considered to simulate and obtain numerical sensor signals. Secondly, an artificial neural network algorithm is established to train net damage recognition. Finally, the artificial neural network damage recognition model obtained by simulation data training constitutes the digital twin of the net. In the real-time monitoring stage, according to the real-time sensor data generated by the physical entity of the net, the digital twin can quickly identify whether the net is damaged.
[0042] 1. Numerical simulation of net clothing
[0043] According to the size of the net to be tested, an equivalent net numerical model is established, and the dynamic response of the fishing net when intact and damaged is simulated. According to the environment where the fishing net is located, a suitable wave range is selected for simulation, and the tension simulation data set of the rope is collected as the training set for training the artificial neural network. Before being used for detection, the possible damage scenarios of the fishing net under different sea conditions are designed and simulated. Obtaining a large amount of simulation sensor data is the first step in the key technology of net detection.
[0044] 2. Digital Twin
[0045] The artificial neural network method is used to establish a digital twin for net damage identification. The artificial neural network model uses a BP neural network. The artificial neural network uses the error back propagation training method, takes the effective wave height Hs, the spectrum peak period Tp, and the tension value of the horizontal and vertical frames as input, and takes the complete state and damaged state of the net as output, marked as (1,0) and (0,1) respectively. Some literature points out that a neural network with a hidden layer with a limited number of neurons can approximate any function, so the number of neural network structures is set to 3 layers. The number of hidden layer neurons can be determined according to the formula m=2n+1, so it is set to 9. The neural network structure is as follows Figure 2As shown in the figure. Under the same environment, the tension sensing data obtained from the intact state and the damaged state of the net are different. The digital twin developed based on the artificial neural network can be well classified, so a digital twin model that can identify damaged nets can be constructed. Using a large amount of simulation data to train and obtain the recognition model is the second step of the key technology of net detection.
[0046] 3. Real-time monitoring
[0047] Tension sensors are used to monitor the tension on the ropes of the net cage net in real time. Through a lot of research and analysis, it is found that the wave and current loads on the net will be transferred to the ropes. Therefore, the method provided by the present invention only requires the installation of tension sensors on the ropes of the fishing net. In order to reduce the number of sensors used and ensure the measurement accuracy, in the specific implementation, a sensor can be arranged on each rope of the transverse and longitudinal ropes of the net, thereby forming a tension sensor data monitoring network. According to the spacing of the ropes, the sensor's range can be selected from 10-1000N; in addition, a wave tide meter is installed on the wave-facing side of the net cage to collect wave parameters, and the collected waves and wave periods are input into the digital twin in real time. The digital twin will quickly determine whether the net is damaged based on the wave parameters and sensor tension data.
[0048] The detection method based on digital twin technology only needs to install tension sensors on the ropes of the fishing nets to monitor the fishing nets in real time. The sensors installed on the ropes will not increase the load on the fishing nets and reduce the life of the fishing nets. Compared with cameras, water quality has less impact on sensors. Sensors can replace manual labor to monitor fishing nets efficiently.
[0049] For ease of understanding, the new method for net damage detection based on digital twin technology is specifically explained below with a specific example.
[0050] First, a physical model test was conducted in a wave test tank. The size of the fishing net used for damage detection was 0.76m wide and 0.76m high, the diameter of the net wire was 3mm, and the mesh size was 20mm*20mm. An equivalent numerical simulation was performed on the fishing net, and appropriate environmental conditions were selected. The model was scaled according to a scale of 1:10, that is, the effective wave height (Hs) was 0.1m, 0.2m, and 0.3m, and the spectral peak period (Tp) was 1.0s, 2.0s, and 3.0s. The training sample data consisted of 9 groups of sea conditions obtained by combining the effective wave height and the spectral peak period in pairs. The simulated tension sensor data was collected and the artificial neural network was trained to obtain a digital twin for net damage detection.
[0051] The wave tank creates waves with an effective wave height Hs of 0.1-0.3m and a spectral peak period Tp in the range of 1.0s-3.0s, collects tension sensor data, and inputs the data into the digital twin. After testing and analysis, the digital twin recognition model has an average accuracy of more than 94% in identifying whether the net is damaged based on the sensor data. This shows that the digital twin technology can accurately detect damage to fishing nets and can be used as a new method for detecting net damage.
[0052] Corresponding to the cage net damage detection method based on digital twin technology in the above embodiment, the present invention also provides a cage net damage detection device based on digital twin technology, the device comprising:
[0053] A mesh digital twin construction unit, used to pre-construct a mesh digital twin;
[0054] A tension detection unit, used to obtain tension data detected by a tension sensor installed on the rope of the fishing net;
[0055] A net damage identification unit, used for inputting the tension data detected by the tension detection unit into the net digital twin constructed by the net digital twin construction unit, to obtain a net damage identification result output by the net digital twin;
[0056] Wherein, the net clothing digital twin construction unit includes:
[0057] The net numerical model establishment subunit is used to establish an equivalent net numerical model according to the size of the net cage to be tested, and simulate the dynamic response of the fishing net when it is intact and damaged;
[0058] The simulation subunit is used to simulate the tension of the fishing net rope using the numerical model of the fishing net according to the environment in which the fishing net is located, combined with various wave ranges and the damage of the fishing net in different pre-designed sea conditions, to obtain a simulation data set;
[0059] The training subunit is used to establish an artificial neural network damage recognition model and use the simulation data set to perform net clothing damage recognition training on the artificial neural network damage recognition model; the trained artificial neural network damage recognition model constitutes a net clothing digital twin.
[0060] For a cage net damage detection device based on digital twin technology in an embodiment of the present invention, since it corresponds to a cage net damage detection method based on digital twin technology in the above embodiment, the description is relatively simple. For relevant similarities, please refer to the description of a cage net damage detection method based on digital twin technology in the above embodiment, which will not be described in detail here.
[0061] An embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer instruction set. When the computer instruction set is executed by a processor, a cage net damage detection method based on mathematical twin technology as provided in any of the above embodiments is implemented.
[0062] In the several embodiments provided by the present invention, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0063] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0064] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0065] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for detecting damage of cage nets based on digital twin technology, characterized in that: include: Obtaining tension data detected by a tension sensor installed on the rope of the fishing net; Inputting the tension data into a pre-constructed net clothing digital twin, and obtaining a net clothing damage recognition result output by the net clothing digital twin; Among them, the pre-built digital twin of the mesh clothing includes: According to the size of the cage net to be tested, an equivalent net numerical model is established, and the dynamic response of the fishing net when intact and damaged is simulated; According to the environment where the fishing net is located, combined with various wave ranges and the damage of the net under different pre-designed sea conditions, the tension simulation of the rope is carried out using the numerical model of the net to obtain a simulation data set; Establishing an artificial neural network damage recognition model and using the simulation data set to perform net damage recognition training on the artificial neural network damage recognition model; The trained artificial neural network damage recognition model constitutes the digital twin of the clothing.
2. According to the method for detecting damage of cage nets based on digital twin technology in claim 1, it is characterized in that: The artificial neural network model uses BP neural network.
3. According to claim 2, a method for detecting damage of cage nets based on digital twin technology is characterized in that: The structure number of the BP neural network is set to 3 layers, including an input layer, a hidden layer and an output layer, and the number of neurons in the hidden layer is set to 9.
4. The method for detecting damage of cage nets based on digital twin technology according to claim 3 is characterized in that: Using the simulation data set to train the artificial neural network damage recognition model for net clothing damage recognition includes: The error back propagation training method is adopted, and the four values of effective wave height Hs, spectrum peak period Tp and tension value of horizontal and vertical bars are taken as input, and the complete state and damaged state of the net are taken as output.
5. The method for detecting damage of cage nets based on digital twin technology according to claim 1 is characterized in that: The tension sensor installed on the fishing net ropes comprises: a tension sensor is arranged every other rope on the transverse ropes and the longitudinal ropes of the net.
6. The method for detecting damage of cage nets based on digital twin technology according to claim 5 is characterized in that: The measuring range of the tension sensor is 10-1000N.
7. The method for detecting damage of cage nets based on digital twin technology according to claim 1, characterized in that: Also includes: A wave and tide meter is installed on the wave-facing side of the net cage to collect wave parameters, and the wave parameters are input into the digital twin of the net in real time. The digital twin of the net determines whether the net is damaged based on the wave parameters and the tension data.
8. A net cage net damage detection device based on digital twin technology, characterized in that: include: A mesh digital twin construction unit, used to pre-construct a mesh digital twin; A tension detection unit, used to obtain tension data detected by a tension sensor installed on the rope of the fishing net; A net damage identification unit, used for inputting the tension data detected by the tension detection unit into the net digital twin constructed by the net digital twin construction unit, to obtain a net damage identification result output by the net digital twin; Wherein, the net clothing digital twin construction unit includes: The net numerical model establishment subunit is used to establish an equivalent net numerical model according to the size of the net cage to be tested, and simulate the dynamic response of the fishing net when it is intact and damaged; The simulation subunit is used to simulate the tension of the fishing net rope using the numerical model of the fishing net according to the environment in which the fishing net is located, combined with various wave ranges and the damage of the fishing net in different pre-designed sea conditions, to obtain a simulation data set; The training subunit is used to establish an artificial neural network damage recognition model and use the simulation data set to perform net clothing damage recognition training on the artificial neural network damage recognition model; the trained artificial neural network damage recognition model constitutes a net clothing digital twin.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer instruction set, and when the computer instruction set is executed by the processor, the cage net damage detection method based on mathematical twin technology as provided in any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Netting detection method, device and equipment based on deep learning and storage medium
CN111882555A
Aircraft structure strength digital twinning method based on combination of load and state
CN113688465A
Cited By
Aquaculture net cage damage monitoring method based on multi-sensor information fusion
CN120804930A
