Intelligent inspection method and system for ship

Abstract

The embodiment of the invention provides an intelligent inspection method and system for a ship. The method comprises the following steps: performing inspection shooting on a plurality of target inspection positions on a ship deck through an intelligent inspection helmet to obtain a plurality of target inspection images; sending the plurality of target inspection images to a ship server according to an inspection time sequence, and determining a ship inspection result based on the plurality of target inspection images; sending the ship inspection result to a ship intelligent inspection rear end through the ship server, and adding an inspection mark on the target inspection image according to the ship inspection result to obtain an inspection image processing result; based on the ship inspection result and the inspection image processing result, an inspection route and an inspection report are generated through the intelligent ship inspection front end. According to the scheme, the damage conditions of the ship decks and the pipeline systems on the ship decks at different positions are accurately identified in combination with the digital panorama technology, and the efficiency and accuracy of ship inspection are improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of ship inspection technology, and in particular to a ship intelligent inspection method and system. Background Art

[0002] The shipping industry has shown a trend of rapid development in recent years. Ships play a core role in maritime transportation, and their safety performance is directly related to the efficiency and safety of maritime transportation. In the current ship deck inspection operations, the traditional inspection mode is generally adopted to rely on manual inspection. However, this inspection method has many defects. From the perspective of accuracy, since the inspection results are highly dependent on the experience of the inspectors, people with different experience levels may make different judgments on the same deck condition, making it difficult to ensure the accuracy of the inspection. In addition, subjective factors such as the mood swings of the inspectors will also interfere with the inspection process and affect the consistency of the inspection results. In addition, during the operation of the ship, there is a serious lack of information exchange between the onshore operators and the ship. In an emergency, the time for handling may be delayed due to untimely communication, posing a serious threat to the safe operation of the ship. Summary of the invention

[0003] The present invention provides a method and system for intelligent ship inspection, so as to improve the efficiency, accuracy and safety of ship inspection while reducing labor costs and human errors.

[0004] In a first aspect, an embodiment of the present invention provides a ship intelligent inspection method, comprising:

[0005] A plurality of target inspection images are obtained by inspecting and photographing a plurality of target inspection positions on a ship deck through an intelligent inspection helmet, wherein the plurality of target inspection positions include a plurality of inspection position points passed through by circling the ship deck for one round of inspection, and each target inspection image is obtained by photographing a panoramic image at each target inspection position through a panoramic camera carried by the intelligent inspection helmet;

[0006] Send multiple target inspection images to the ship server in the order of inspection time, and detect the ship deck through the ship server based on the multiple target inspection images to determine the ship inspection result, and the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck;

[0007] The ship inspection results are sent to the ship intelligent inspection backend through the ship server, and the inspection mark is added to the target inspection image through the ship intelligent inspection backend according to the ship inspection results to obtain the inspection image processing result. The inspection mark is used to locate and identify the areas with corrosion or cracks on the ship deck and pipeline system;

[0008] The ship inspection results and inspection image processing results are sent to the ship intelligent inspection front end through the ship intelligent inspection back end, and the inspection route and inspection report are generated through the ship intelligent inspection front end based on the ship inspection results and inspection image processing results, so as to be supplied to the shore-based server for monitoring.

[0009] In a second aspect, an embodiment of the present invention further provides a ship intelligent inspection system, including:

[0010] The intelligent inspection helmet is configured to obtain multiple target inspection images by inspecting and photographing multiple target inspection positions on the ship deck through the intelligent inspection helmet, and to send the multiple target inspection images to the ship server in the order of inspection time, wherein the multiple target inspection positions include multiple inspection position points passed through by circling the ship deck for one round of inspection, and each target inspection image is obtained by taking a panoramic image at each target inspection position through a panoramic camera carried by the intelligent inspection helmet;

[0011] The ship server is configured to detect the ship deck through the ship server based on multiple target inspection images to determine the ship inspection result, and send the ship inspection result to the ship intelligent inspection backend through the ship server, and the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck;

[0012] The ship intelligent inspection backend is configured to add inspection marks to the target inspection image through the ship intelligent inspection backend according to the ship inspection result to obtain the inspection image processing result, and send the ship inspection result and the inspection image processing result to the ship intelligent inspection frontend through the ship intelligent inspection backend, and the inspection mark is used to locate and identify the area with corrosion or cracks on the ship deck and pipeline system;

[0013] The ship intelligent inspection front end is configured to generate inspection routes and inspection reports based on the ship inspection results and inspection image processing results through the ship intelligent inspection front end, so as to supply them to the shore-based server for monitoring.

[0014] The technical solution provided by the embodiment of the present invention is to obtain multiple target inspection images by inspecting and photographing multiple target inspection positions on the ship deck through an intelligent inspection helmet, thereby realizing detection of different positions on the ship deck in combination with digital panoramic technology, reducing interference from human factors, and improving the accuracy of ship inspection; based on the multiple target inspection images, the ship deck is detected by the ship server to determine the ship inspection result, and according to the ship inspection result, the inspection mark is added to the target inspection image through the ship intelligent inspection back end to obtain the inspection image processing result, thereby realizing accurate identification of damage to the ship deck and the pipeline system on the ship deck, and improving the efficiency and accuracy of ship inspection; based on the ship inspection result and the inspection image processing result, the ship intelligent inspection front end is used to generate an inspection route and an inspection report, which is supplied to the shore-based server for monitoring, thereby realizing the timely generation of the inspection route and the inspection report and feeding it back to the shore-based server, so that the shore-based manager can provide the ship with timely and effective rectification or maintenance suggestions based on the inspection route and the inspection report fed back to the shore-based server. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other features, advantages and aspects of the embodiments of the present invention will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0016] Figure 1 A flow chart of a ship intelligent inspection method provided by an embodiment of the present invention;

[0017] Figure 2 A schematic diagram of the structure of an intelligent inspection helmet provided by an embodiment of the present invention;

[0018] Figure 3 A schematic diagram of the structure of a microcontroller configured in an intelligent inspection helmet provided by an embodiment of the present invention;

[0019] Figure 4 A schematic diagram of the structure of a ship intelligent inspection system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] Embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.

[0021] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0022] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0023] It should be noted that the concepts such as "first" and "second" mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0024] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0025] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

[0026] It is understandable that before using the technical solutions disclosed in the embodiments of the present invention, the type, scope of use, usage scenarios, etc. of the personal information involved in the present invention should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0027] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present invention according to the prompt message.

[0028] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0029] It is understandable that the above notification and user authorization process is only illustrative and does not constitute a limitation on the implementation of the present invention. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present invention.

[0030] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0031] Figure 1 The flowchart of a ship intelligent inspection method provided by an embodiment of the present invention. The embodiment of the present invention is applicable to the case of intelligent comprehensive safety inspection of ship decks and pipeline systems on ship decks. The method can be applied to ship intelligent inspection systems, which can be implemented in the form of software and / or hardware. Figure 1 As shown, the method includes:

[0032] S101. A plurality of target inspection images are obtained by performing inspection and photographing at a plurality of target inspection positions on a ship deck using a smart inspection helmet. The plurality of target inspection positions include a plurality of inspection position points traversed by performing a round of inspection on the ship deck. Each target inspection image is obtained by photographing a panoramic image at each target inspection position using a panoramic camera mounted on the smart inspection helmet.

[0033] In the embodiment of the present invention, the smart inspection helmet refers to a smart helmet equipped with a panoramic camera, which is used to obtain a panoramic image on the ship deck at each inspection position during the ship inspection process. Figure 2 As shown, the intelligent inspection helmet includes a safety helmet 21, a panoramic camera 22, a panoramic camera connecting rod 23, a microcontroller 24 and a microcontroller mounting seat 25. The safety helmet and the panoramic camera are fixedly connected through the panoramic camera connecting rod. Figure 3 As shown, the microcontroller 24 includes a controller upper housing 241 , a controller lower housing 242 , a micro control unit 243 , a GPS module 244 , a battery pack 245 and a circuit board 246 .

[0034] The inspection position may refer to the position of the smart inspection helmet when taking a panoramic image of the ship during the ship inspection process. The inspection image may refer to the panoramic image data obtained during the ship inspection process, which is used to record the actual situation of the ship deck and the pipeline system on the ship deck. A panoramic camera is a device that can capture 360-degree panoramic images.

[0035] Specifically, the smart inspection helmet is worn on the crew's head area and follows the crew to circle the ship deck according to the ship inspection regulations. During the process of the smart inspection helmet following the crew, the panoramic camera carried by the smart inspection helmet takes real-time photos at multiple target inspection positions, collects panoramic images of the ship deck and the pipeline system on the ship deck at each target inspection position, and uses the collected panoramic images as the target inspection images corresponding to each target inspection position.

[0036] S102, sending multiple target inspection images to the ship server in the order of inspection time, and determining the ship inspection result by inspecting the ship deck through the ship server based on the multiple target inspection images, the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the piping system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck.

[0037] In the embodiment of the present invention, the inspection time sequence refers to the time sequence of each target inspection position when the smart inspection helmet follows the crew to circumvent during the ship inspection process. The ship server refers to a server system specially designed for ships, which is deployed with an artificial intelligence image recognition algorithm to analyze and process each target inspection image to obtain the ship inspection result. The ship inspection result refers to the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to each target inspection position during the ship inspection process.

[0038] Specifically, the smart inspection helmet is equipped with a microcontroller. After the smart inspection helmet acquires all target inspection images, the microcontroller sends all target inspection images to the ship server in the time sequence when all target inspection images are acquired. The ship server performs a deep visual analysis on all received target inspection images, and analyzes the corrosion and cracks of the ship deck and the pipeline system on the ship deck in each target inspection image to determine the ship inspection results.

[0039] As an optional method, multiple target inspection images are sent to the ship server in the order of inspection time, including the following steps A1-A2:

[0040] Step A1: for each target inspection image among the multiple target inspection images, the shooting time and shooting position coordinates corresponding to the target inspection image are written into the target inspection image through the microcontroller configured in the intelligent inspection helmet.

[0041] Step A2: The microcontroller configured in the intelligent inspection helmet sends each target inspection image carrying the shooting time and shooting position coordinates to the ship server in the order of the inspection time.

[0042] Specifically, during the process of the smart inspection helmet following the crew members around the ship deck to take pictures, the microcontroller configured in the smart inspection helmet writes the shooting time and shooting position coordinates corresponding to each target inspection image into the captured target inspection image. Finally, the microcontroller configured in the smart inspection helmet sends all the target inspection images carrying the shooting time and shooting position coordinates to the ship server in the order of the shooting time of each target inspection image.

[0043] As an optional method, during the photo-taking process when the smart inspection helmet follows the crew around the deck of the ship, the microcontroller configured in the smart inspection helmet will write the shooting time and shooting position coordinates corresponding to each target inspection image into the taken target inspection image, and at the same time send the target inspection image carrying the shooting time and shooting position coordinates to the ship server. The microcontroller can write the shooting time and shooting position coordinates into the target inspection image and send the target inspection image to the ship server at the same time without affecting each other.

[0044] As an option, based on multiple target inspection images, the ship deck is detected by the ship server to determine the ship inspection result, including the following steps B1-B2:

[0045] Step B1: for each target inspection image, input each target inspection image into the inspection detection model built into the ship server; wherein the inspection detection model is used to perform image segmentation on the input panoramic image and to extract features of the image portion involving the ship deck and the piping system on the ship deck in the panoramic image, and to determine the degree of damage to the ship deck and the piping system on the ship deck by identifying the pixel ratio of the corroded area and / or cracked area of ​​the ship deck and the piping system on the ship deck through flaw detection analysis.

[0046] Step B2: Output the ship inspection results corresponding to each target inspection image through the inspection detection model.

[0047] In the embodiment of the present invention, the inspection model refers to a detection model obtained by performing image analysis and deep learning training on panoramic images using a convolutional neural network model and big data technology, and is used to identify the degree of corrosion and damage of the ship deck and the piping system on the ship deck. Flaw detection analysis refers to a non-destructive detection technology used by the inspection model to detect the degree of damage of the corroded area, cracked area, or corroded and cracked area of ​​the ship deck and the piping system on the ship deck.

[0048] Specifically, the inspection and detection model trained in the ship server is used to perform image segmentation on each input target inspection image, and extract the partial image involving the ship deck and the pipeline system on the ship deck. Feature extraction is performed on this partial image to identify the pixel ratio of the corroded area, cracked area, or corroded and cracked area of ​​the ship deck and the pipeline system on the ship deck. Then, the degree of damage to the ship deck and the pipeline system on the ship deck is judged according to the size of the pixel ratio. According to the corroded area, cracked area, or corroded and cracked area of ​​the ship deck and the pipeline system on the ship deck and the corresponding degree of damage, the ship inspection results corresponding to each target inspection image are output to ensure that the artificial intelligence deployed on the ship server can accurately identify the corroded area or cracked area of ​​the ship deck and the pipeline system on the ship deck.

[0049] S103, sending the ship inspection result to the ship intelligent inspection backend through the ship server, and adding inspection marks to the target inspection image through the ship intelligent inspection backend according to the ship inspection result to obtain the inspection image processing result, and the inspection marks are used to locate and mark the areas with corrosion or cracks on the ship deck and pipeline system.

[0050] In the embodiment of the present invention, the ship intelligent inspection backend refers to a backend facility used to process the acquired image data and output the image processing results during the ship inspection process. The ship intelligent inspection backend processes the image data by adding marks to the images, analyzing the images, etc. The inspection mark refers to the identification information added to the corrosion or crack areas of the ship deck and pipeline system in each target inspection image.

[0051] Specifically, the ship server transmits the ship inspection results obtained by artificial intelligence image recognition to the back end of the intelligent inspection system, and the back end of the intelligent inspection system processes each target inspection image according to the ship inspection results to obtain the inspection image processing results. For example, the back end of the intelligent inspection system adds inspection marks to the areas with corrosion or cracks on the ship deck and the pipeline system on the ship deck on each target inspection image according to the damage of the ship deck and the pipeline system on the ship deck indicated by the obtained ship inspection results, and uses each target inspection image after the inspection mark is added as the inspection image processing result.

[0052] As an optional method, according to the ship inspection result, an inspection mark is added to the target inspection image through the ship intelligent inspection backend, including the following steps C1-C2:

[0053] Step C1: using a rectangular wireframe to mark the corroded area or cracked area of ​​the ship deck and the pipeline system on the ship deck in the target inspection image indicated by the ship inspection result.

[0054] Step C2: Mark the rectangular wireframes of the corroded areas or cracked areas with different colors according to the corrosion degree of the corroded areas of the ship deck and the pipeline system on the ship deck or the crack depth of the cracked areas in the target inspection image indicated by the ship inspection result.

[0055] Specifically, according to the corroded areas or cracked areas of the ship deck and the pipeline system on the ship deck included in the ship inspection results, a rectangular wireframe is added to the corresponding area in each target inspection image as an inspection mark. According to the corrosion degree of the corroded areas of the ship deck and the pipeline system on the ship deck or the crack depth of the cracked areas included in the ship inspection results, different colored rectangular wireframes are used to mark each corroded area or cracked area in each target inspection image to ensure the efficiency of ship operation. For example, the red rectangular wireframe mark indicates that there are serious hidden dangers on the ship deck and the pipeline system on the ship deck, and the ship needs to be stopped for maintenance; the yellow rectangular wireframe mark indicates that there are hidden dangers on the ship deck and the pipeline system on the ship deck, which need to be repaired in time; the green rectangular wireframe mark indicates that the risk probability of the ship deck and the pipeline system on the ship deck is extremely low, and no maintenance is required in the short term.

[0056] S104, sending the ship inspection results and inspection image processing results to the ship intelligent inspection front end through the ship intelligent inspection back end, and generating inspection routes and inspection reports based on the ship inspection results and inspection image processing results through the ship intelligent inspection front end, so as to supply them to the shore-based server for monitoring.

[0057] In an embodiment of the present invention, the intelligent ship inspection front end refers to equipment and systems that are in direct contact with various parts of the ship and display in real time. It is mainly used to display the ship's inspection route and inspection report, which can intuitively reflect the real-time situation of the ship. The inspection route refers to the route for inspecting the corroded areas or cracked areas of the ship according to a certain position sequence and standard. The inspection report refers to a document that records the results of ship inspections in detail, which is used to ensure the safety of the ship so that ship managers can understand the inspection situation in real time. The inspection report includes the type, location, severity, and maintenance recommendations of hidden dangers corresponding to each target inspection location of the ship. The shore-based server refers to a server set up on land, which is used to receive the actual situation of the ship inspection at sea and display it on the shore, and transmit decision-making information or suggestions to the ship at sea. Through the shore-based server, integrated ship-shore management can be achieved to improve the operational efficiency and safety of the ship.

[0058] Specifically, the ship intelligent inspection backend sends the ship inspection results and inspection image processing results to the ship intelligent inspection frontend. The ship intelligent inspection frontend generates an actual inspection route and inspection report based on the ship inspection results and inspection image processing results, and sends the inspection route and inspection report to the shore-based server.

[0059] As an option, based on the ship inspection results and the inspection image processing results, the inspection route and inspection report are generated by the ship intelligent inspection front end, including the following steps D1-D3:

[0060] Step D1: Based on the inspection image processing results, a number of target inspection images that need to be inspected are determined from multiple target inspection images through the ship intelligent inspection front end.

[0061] Step D2: Generate an inspection route based on the shooting position coordinates carried in the inspection images of several targets to be inspected, and mark the positions in the plane map used for ship operation.

[0062] Step D3: Generate an inspection report of the ship deck and the piping system on the ship deck according to the corrosion degree and crack depth of the ship deck and the piping system on the ship deck indicated by the ship inspection result.

[0063] Specifically, the ship intelligent inspection front end determines several target inspection images with hidden dangers or serious hidden dangers from each target inspection image based on the inspection mark of each target inspection image in the inspection image processing result, and these several target inspection images need to be inspected. The inspection route is generated according to the shooting position coordinates carried in the several target inspection images, and the corresponding positions are marked in the plane map used for ship operation. At the same time, the ship intelligent inspection front end generates a corresponding inspection report based on the corrosion degree and crack depth of the ship deck and the pipeline system on the ship deck corresponding to each target inspection position in the ship inspection result.

[0064] As an option, after the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection results and the inspection image processing results, it also includes:

[0065] The inspection route and inspection report of the ship deck and the piping system on the ship deck are sent to the shore-based server through the satellite network on the ship server, so as to send timely and effective rectification or maintenance suggestions for the corrosion or cracks of the ship deck and the piping system on the ship deck of the ocean-going ship through the shore-based server.

[0066] Specifically, after the inspection route and inspection report are generated, the ship server sends the inspection route and inspection report of the ship deck and the pipeline system on the ship deck to the shore-based server through the satellite network. The shore-based server displays the received inspection route and inspection report, so that the shore-based regulatory department can understand the actual situation of the ship deck and the pipeline system on the ship deck in real time. At the same time, the shore-based regulatory department can send timely and effective rectification or maintenance opinions on the corrosion or cracks of the ship deck and the pipeline system on the ship deck to the ocean-going ship through the shore-based server based on the inspection route and inspection report.

[0067] As an option, after the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection results and the inspection image processing results, it also includes:

[0068] The inspection route and inspection report of the ship deck and the piping system on the ship deck are displayed through the ship intelligent inspection front end, so that the ship manager can check the inspection route and inspection report to obtain a panoramic image of the corroded area or cracked area.

[0069] Specifically, after the inspection route and inspection report are generated, the inspection route and inspection report of the ship deck and the pipeline system on the ship deck are displayed through the ship intelligent inspection front end, so that the ship manager can check the inspection route and inspection report in real time. The panoramic image of the corroded area or the cracked area has been completed, thereby ensuring that the ship manager can formulate maintenance plans more scientifically and effectively.

[0070] The technical solution provided by the embodiment of the present invention is to obtain multiple target inspection images by inspecting and photographing multiple target inspection positions on the ship deck through an intelligent inspection helmet, thereby realizing detection of different positions on the ship deck in combination with digital panoramic technology, reducing interference from human factors, and improving the accuracy of ship inspection; based on the multiple target inspection images, the ship deck is detected by the ship server to determine the ship inspection result, and according to the ship inspection result, the inspection mark is added to the target inspection image through the ship intelligent inspection back end to obtain the inspection image processing result, thereby realizing accurate identification of damage to the ship deck and the pipeline system on the ship deck, and improving the efficiency and accuracy of ship inspection; based on the ship inspection result and the inspection image processing result, the ship intelligent inspection front end is used to generate an inspection route and an inspection report, which is supplied to the shore-based server for monitoring, thereby realizing the timely generation of the inspection route and the inspection report and feeding it back to the shore-based server, so that the shore-based manager can provide the ship with timely and effective rectification or maintenance suggestions based on the inspection route and the inspection report fed back to the shore-based server.

[0071] Figure 4 The structure diagram of a ship intelligent inspection system provided by an embodiment of the present invention is shown in FIG. The embodiment of the present invention is applicable to the case of intelligent comprehensive safety inspection of ship decks and pipeline systems on ship decks. The system can be implemented in the form of software and / or hardware. Figure 4 As shown, the system includes:

[0072] The intelligent inspection helmet 201 is configured to obtain multiple target inspection images by inspecting and photographing multiple target inspection positions on the ship deck through the intelligent inspection helmet, and to send the multiple target inspection images to the ship server in the order of inspection time. The multiple target inspection positions include multiple inspection position points passed through by circling the ship deck for one round of inspection. Each target inspection image is obtained by taking a panoramic image at each target inspection position through a panoramic camera carried by the intelligent inspection helmet;

[0073] The ship server 202 is configured to detect the ship deck through the ship server based on multiple target inspection images to determine the ship inspection result, and send the ship inspection result to the ship intelligent inspection backend through the ship server, and the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck;

[0074] The ship intelligent inspection backend 203 is configured to add inspection marks to the target inspection image through the ship intelligent inspection backend according to the ship inspection result to obtain the inspection image processing result, and send the ship inspection result and the inspection image processing result to the ship intelligent inspection frontend through the ship intelligent inspection backend, and the inspection mark is used to locate and identify the area with corrosion or cracks on the ship deck and pipeline system;

[0075] The ship intelligent inspection front end 204 is configured to generate inspection routes and inspection reports based on the ship inspection results and inspection image processing results through the ship intelligent inspection front end, so as to supply them to the shore-based server for monitoring.

[0076] As an option, multiple target inspection images are sent to the ship server in the order of inspection time, including:

[0077] For each target inspection image among the multiple target inspection images, the shooting time and shooting position coordinates corresponding to the target inspection image are written into the target inspection image through a microcontroller configured in the intelligent inspection helmet;

[0078] The microcontroller configured in the intelligent inspection helmet sends each target inspection image carrying the shooting time and shooting position coordinates to the ship server in the order of the inspection time.

[0079] As an optional option, the smart inspection helmet includes a safety helmet, a panoramic camera, a panoramic camera connecting rod, a microcontroller and a microcontroller mounting seat. The safety helmet and the panoramic camera are fixedly connected through the panoramic camera connecting rod. The microcontroller includes a controller upper shell, a controller lower shell, a micro control unit, a GPS module, a battery pack and a circuit board.

[0080] As an option, based on multiple target inspection images, the ship server detects the ship deck to determine the ship inspection result, including:

[0081] For each target inspection image, each target inspection image is input into the inspection detection model built into the ship server; wherein the inspection detection model is used to perform image segmentation on the input panoramic image and to extract features of the image portion involving the ship deck and the piping system on the ship deck in the panoramic image, and to determine the degree of damage to the ship deck and the piping system on the ship deck by identifying the pixel ratio of the corroded area and / or cracked area of ​​the ship deck and the piping system on the ship deck through flaw detection analysis;

[0082] The inspection detection model outputs the ship inspection results corresponding to each target inspection image.

[0083] As an option, according to the ship inspection results, the ship intelligent inspection backend adds inspection marks on the target inspection image, including:

[0084] A rectangular wireframe is used to mark the corroded area or cracked area of ​​the ship deck and the piping system on the ship deck in the target inspection image indicated by the ship inspection result;

[0085] According to the corrosion degree of the corroded area of ​​the ship deck and the pipeline system on the ship deck or the crack depth of the crack area in the target inspection image indicated by the ship inspection result, the rectangular wireframes used for each corroded area or crack area are marked with different colors.

[0086] As an option, based on the ship inspection results and inspection image processing results, the ship intelligent inspection front end generates inspection routes and inspection reports, including:

[0087] Based on the inspection image processing results, a number of target inspection images that need to be inspected are determined from multiple target inspection images through the ship intelligent inspection front end;

[0088] Generate an inspection route based on the shooting position coordinates carried in the inspection images of several targets that need to be inspected, and mark the positions in the plane map used for ship operation;

[0089] An inspection report of the ship deck and the piping system on the ship deck is generated according to the corrosion degree and crack depth of the ship deck and the piping system on the ship deck indicated by the ship inspection results.

[0090] As an option, after the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection results and the inspection image processing results, it also includes:

[0091] The inspection route and inspection report of the ship deck and the piping system on the ship deck are sent to the shore-based server through the satellite network on the ship server, so as to send timely and effective rectification or maintenance suggestions for the corrosion or cracks of the ship deck and the piping system on the ship deck of the ocean-going ship through the shore-based server.

[0092] As an option, after the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection results and the inspection image processing results, it also includes:

[0093] The inspection route and inspection report of the ship deck and the piping system on the ship deck are displayed through the ship intelligent inspection front end, so that the ship manager can check the inspection route and inspection report to obtain a panoramic image of the corroded area or cracked area.

[0094] The intelligent ship inspection system provided by the embodiment of the present invention uses an intelligent inspection helmet to inspect and shoot at multiple target inspection positions on the ship deck to obtain multiple target inspection images, thereby realizing detection of different positions on the ship deck in combination with digital panoramic technology, reducing interference from human factors, and improving the accuracy of ship inspections; based on the multiple target inspection images, the ship deck is detected by the ship server to determine the ship inspection result, and according to the ship inspection result, an inspection mark is added to the target inspection image by the ship intelligent inspection back end to obtain the inspection image processing result, thereby realizing accurate identification of damage to the ship deck and the pipeline system on the ship deck, and improving the efficiency and accuracy of ship inspections; based on the ship inspection result and the inspection image processing result, an inspection route and an inspection report are generated by the ship intelligent inspection front end to be supplied to the shore-based server for monitoring, thereby realizing timely generation of the inspection route and the inspection report and feeding them back to the shore-based server, so that the shore-based manager can provide the ship with timely and effective rectification or maintenance suggestions based on the inspection route and the inspection report fed back to the shore-based server. The ship intelligent inspection system provided by the embodiment of the present invention can execute the ship intelligent inspection method provided by any embodiment of the present invention, and has the corresponding functions and beneficial effects of the execution method.

[0095] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the disclosure scope involved in the present invention is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present invention (but not limited to) by each other.

[0096] In addition, although each operation is described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present invention. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0097] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A ship intelligent inspection method, characterized in that: The method comprises: A plurality of target inspection images are obtained by performing inspection and shooting at a plurality of target inspection positions on a ship deck by using an intelligent inspection helmet, wherein the plurality of target inspection positions include a plurality of inspection position points passed through by circling the ship deck for one round of inspection, and each of the target inspection images is obtained by performing panoramic image shooting at each target inspection position by using a panoramic camera carried on the intelligent inspection helmet; Sending multiple target inspection images to a ship server in the order of inspection time, and detecting the ship deck through the ship server based on the multiple target inspection images to determine the ship inspection result, wherein the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck; The ship inspection results are sent to the ship intelligent inspection backend through the ship server, and inspection marks are added to the target inspection image through the ship intelligent inspection backend according to the ship inspection results to obtain the inspection image processing results. The inspection marks are used to locate and identify the areas with corrosion or cracks on the ship deck and pipeline system; The ship inspection results and inspection image processing results are sent to the ship intelligent inspection front end through the ship intelligent inspection back end, and based on the ship inspection results and inspection image processing results, the ship intelligent inspection front end generates an inspection route and an inspection report to be supplied to the shore-based server for monitoring.

2. The method according to claim 1, characterized in that Send multiple target inspection images to the ship server in the order of inspection time, including: For each target inspection image among the multiple target inspection images, the shooting time and shooting position coordinates corresponding to the target inspection image are written into the target inspection image through a microcontroller configured in the intelligent inspection helmet; The microcontroller configured in the intelligent inspection helmet sends each of the target inspection images carrying the shooting time and shooting position coordinates to the ship server in the order of the inspection time.

3. The method according to claim 2, characterized in that The intelligent inspection helmet includes a safety helmet, a panoramic camera, a panoramic camera connecting rod, a microcontroller and a microcontroller mounting seat. The safety helmet and the panoramic camera are fixedly connected via the panoramic camera connecting rod. The microcontroller includes a controller upper shell, a controller lower shell, a microcontroller unit, a GPS module, a battery pack and a circuit board.

4. The method according to claim 1, characterized in that Based on multiple target inspection images, the ship deck is inspected through the ship server to determine the ship inspection results, including: For each target inspection image, each of the target inspection images is input into the inspection detection model built into the ship server; wherein the inspection detection model is used to perform image segmentation on the input panoramic image and to extract features from the image portion of the panoramic image involving the ship deck and the piping system on the ship deck, and to determine the degree of damage to the ship deck and the piping system on the ship deck by identifying the pixel ratio of the corroded area and / or cracked area of ​​the ship deck and the piping system on the ship deck through flaw detection analysis; The ship inspection results corresponding to each target inspection image are outputted through the inspection detection model.

5. The method according to claim 1, characterized in that: According to the ship inspection result, an inspection mark is added to the target inspection image through the ship intelligent inspection backend, including: Using a rectangular wireframe to mark the corroded area or cracked area of ​​the ship deck and the piping system on the ship deck in the target inspection image indicated by the ship inspection result; According to the corrosion degree of the corroded area of ​​the ship deck and the pipeline system on the ship deck or the crack depth of the crack area in the target inspection image indicated by the ship inspection result, the rectangular wireframes used for each corroded area or crack area are marked with different colors.

6. The method according to claim 1, characterized in that Based on the ship inspection results and the inspection image processing results, an inspection route and an inspection report are generated through the ship intelligent inspection front end, including: Based on the inspection image processing results, a number of target inspection images that need to be inspected are determined from multiple target inspection images through the ship intelligent inspection front end; Generate an inspection route based on the shooting position coordinates carried in the inspection images of several targets that need to be inspected, and mark the positions in the plane map used for ship operation; An inspection report of the ship deck and the piping system on the ship deck is generated according to the corrosion degree and crack depth of the ship deck and the piping system on the ship deck indicated by the ship inspection results.

7. The method according to claim 1, characterized in that After the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection result and the inspection image processing result, the method further includes: The inspection route and inspection report of the ship deck and the piping system on the ship deck are sent to the shore-based server through the satellite network on the ship server, so as to send timely and effective rectification or maintenance suggestions for the corrosion or cracks of the ship deck and the piping system on the ship deck of the ocean-going ship through the shore-based server.

8. The method according to claim 1, characterized in that: After the inspection route and inspection report are generated by the ship intelligent inspection front end based on the ship inspection result and the inspection image processing result, the method further includes: The inspection route and inspection report of the ship deck and the piping system on the ship deck are displayed through the ship intelligent inspection front end, so that the ship manager can check the inspection route and inspection report to obtain a panoramic image of the corroded area or cracked area.

9. A ship intelligent inspection system, characterized in that: The system comprises: The intelligent inspection helmet is configured to obtain multiple target inspection images by inspecting and photographing multiple target inspection positions on a ship deck through the intelligent inspection helmet, and to send the multiple target inspection images to a ship server in the order of inspection time, wherein the multiple target inspection positions include multiple inspection position points passed through by circling the ship deck for one round of inspection, and each of the target inspection images is obtained by taking a panoramic image at each target inspection position through a panoramic camera carried by the intelligent inspection helmet; The ship server is configured to detect the ship deck through the ship server based on multiple target inspection images to determine the ship inspection result, and send the ship inspection result to the ship intelligent inspection backend through the ship server, wherein the ship inspection result is used to indicate the corrosion and crack conditions of the ship deck and the pipeline system on the ship deck corresponding to the inspection position when inspecting each inspection position on the ship deck; The ship intelligent inspection backend is configured to add inspection marks to the target inspection image through the ship intelligent inspection backend according to the ship inspection result to obtain the inspection image processing result, and send the ship inspection result and the inspection image processing result to the ship intelligent inspection frontend through the ship intelligent inspection backend, wherein the inspection mark is used to locate and identify the area where corrosion or cracks exist on the ship deck and pipeline system; The ship intelligent inspection front end is configured to generate an inspection route and an inspection report through the ship intelligent inspection front end based on the ship inspection results and the inspection image processing results, so as to supply them to the shore-based server for monitoring.

10. The system according to claim 9, characterized in that Based on multiple target inspection images, the ship deck is inspected through the ship server to determine the ship inspection results, including: For each target inspection image, each of the target inspection images is input into the inspection detection model built into the ship server; wherein the inspection detection model is used to perform image segmentation on the input panoramic image and to extract features from the image portion of the panoramic image involving the ship deck and the piping system on the ship deck, and to determine the degree of damage to the ship deck and the piping system on the ship deck by identifying the pixel ratio of the corroded area and / or cracked area of ​​the ship deck and the piping system on the ship deck through flaw detection analysis; The ship inspection results corresponding to each target inspection image are outputted through the inspection detection model.

Images