Underwater operation and maintenance work intelligent service platform based on virtual reality technology

Abstract

The invention relates to the technical field of underwater operation and maintenance, in particular to an underwater operation and maintenance operation intelligent service platform based on a virtual reality technology, which comprises an acquisition module, a communication module, a visualization module and an intelligent management module, the communication module is connected with the acquisition module, the visualization module is connected with the communication module, and the intelligent management module is respectively connected with the communication module and the visualization module; the acquisition module acquires underwater data; the communication module transmits the acquired underwater data; the visualization module generates a dynamic three-dimensional model of the underwater environment; and the intelligent management module monitors the underwater operation state in real time, carries out deep analysis on the data by using an artificial intelligence algorithm, provides operation guidance, risk early warning and decision suggestions, and forms a real-time three-dimensional visual image literal information database. The blank that the artificial intelligence technology, VR / AR / MR and other presentation technologies are combined and applied to construction, operation and maintenance of underwater engineering is filled.

Description

Technical Field

[0001] The present invention relates to the field of underwater operation and maintenance technology, and in particular to an intelligent service platform for underwater operation and maintenance based on virtual reality technology. Background Art

[0002] Underwater assets, including underwater entities and related data of water-related production and living equipment, transportation equipment, municipal road traffic facilities, such as offshore oil and gas field platforms and production facilities, offshore wind power foundations and cables, etc., their full life cycle management involves multiple links such as construction project establishment, design, procurement, construction and installation, operation and maintenance, and abandonment. The safety, risk and data management of these links are crucial to the safe and reliable operation of underwater assets. Traditional underwater operation and maintenance operations mainly rely on manual diving operations, which have complex operating environments, high operating difficulties, high operating costs and low operating efficiency.

[0003] Presentation technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR) have been introduced into underwater operation and maintenance. These technologies can reproduce the actual underwater environment, provide a three-dimensional visual operation interface, enhance the operator's spatial perception ability, reduce the difficulty of operation and improve operation efficiency. At the same time, combined with advanced technologies such as artificial intelligence, big data and 5G communications, real-time monitoring, intelligent analysis and decision support of underwater assets can be achieved, thereby further improving the intelligence level of underwater operation and maintenance.

[0004] However, there is still a gap in China in the combination of artificial intelligence technology, VR / AR / MR and other presentation technologies and their application in the construction and operation and maintenance of underwater projects. Summary of the invention

[0005] The purpose of the present invention is to provide an intelligent service platform for underwater operation and maintenance based on virtual reality technology, which solves the problem that there is still a gap in the domestic application of artificial intelligence technology, VR / AR / MR and other presentation technologies in the construction and operation of underwater projects.

[0006] To achieve the above-mentioned purpose, the present invention provides an intelligent service platform for underwater operation and maintenance based on virtual reality technology, including a collection module, a communication module, a visualization module and an intelligent management module;

[0007] The communication module is connected to the acquisition module, the visualization module is connected to the communication module, and the intelligent management module is connected to the communication module and the visualization module respectively;

[0008] The acquisition module is used to collect underwater data using an underwater robot and underwater intelligent sensing equipment;

[0009] The communication module is used to transmit the collected underwater data using private 5G cellular network technology;

[0010] The visualization module is used to receive and process underwater data and generate a dynamic three-dimensional model of the underwater environment using virtual reality technology;

[0011] The intelligent management module is used to monitor the underwater operation status in real time, use artificial intelligence algorithms to conduct in-depth analysis of data, provide operation guidance, risk warnings and decision-making suggestions, and form a real-time three-dimensional visual image and text data database.

[0012] Wherein, the visualization module includes a layer unit and a scene unit, and the scene unit is connected to the layer unit and the communication module respectively;

[0013] The scene unit is used to construct three-dimensional point cloud data and two-dimensional vector data of pipelines using GIS terrain data, and to construct a virtual simulation scene of inspection operations through BIM modeling, three-dimensional point cloud modeling, and three-dimensional reconstruction based on two-dimensional views to form a 3D map, and provide resource catalogs, specific scenes, animation navigation, navigation maps, three-dimensional roaming, and real-scene browsing functions;

[0014] The layer unit is used to classify and control data according to the layer.

[0015] Wherein, the intelligent management module includes a query unit and an analysis unit, the query unit is connected to the communication module and the visualization module respectively; the analysis unit is connected to the communication module and the visualization module respectively;

[0016] The query unit is used to perform query functions, including spatial query, attribute query, coordinate query and on-map statistics;

[0017] The analysis unit is used for must-inspect point analysis, must-inspect pipe section analysis, and generating task orders, as well as automatically analyzing and summarizing inspection tasks, including route coverage analysis, must-inspect point detection rate analysis, must-inspect pipe detection rate analysis, and hidden danger analysis.

[0018] Wherein, the intelligent management module further comprises a report generating unit, and the report generating unit is connected to the analyzing unit;

[0019] The report generating unit is used to automatically generate a report based on the result obtained by the analyzing unit.

[0020] Wherein, the intelligent management module further comprises a printing unit, and the printing unit is connected to the visualization module and the report generation unit respectively;

[0021] The printing unit is used to provide current range printing, proportional printing, range printing and map sheet printing functions.

[0022] Wherein, the intelligent management module further comprises a task management unit, and the task management unit is connected to the analysis unit and the report generation unit respectively;

[0023] The task management unit is used to generate a task list based on the analysis result, monitor the task execution process, and provide task execution information to the report generation unit.

[0024] The present invention relates to an intelligent service platform for underwater operation and maintenance based on virtual reality technology. The acquisition module uses underwater robots and underwater intelligent sensing equipment such as acoustics, optics, and electromagnetics, and combines underwater engineering detection big data technology and artificial intelligence deep learning technology to improve the recognition rate and accuracy of underwater targets and collect underwater data. The communication module uses a system platform transmission architecture built on the basis of a private 5G cellular network for data transmission. Private 5G services can provide ultra-high transmission rates, highly reliable and low-latency connections, and transmission links for massive Internet of Things. They have unparalleled alternatives in controlling transmission stability, security, and flexibility. The visualization module can also be used to detect underwater objects and collect underwater data. The multi-source heterogeneous data fusion technology and digital technologies such as AR / VR / MR integrate various sensor data such as acoustic, optical, and electromagnetic, and combine the three-dimensional images, text and other information of the historical database to build a dynamic three-dimensional database of underwater detection target features, realize the visualization of detection target features, and reduce the error of underwater terrain matching and positioning. The intelligent management module forms an intelligent analysis service platform for underwater engineering detection, which integrates the information of various links in the whole life cycle of various facilities such as design, procurement, construction, installation, commissioning, production, operation and maintenance, and abandonment, and forms a real-time three-dimensional visualization image and text data database to support the decision-making of the whole life cycle management of underwater assets. The comprehensive use of simulation, data visualization and interaction technologies of three-dimensional virtual environment models, using underwater robots as equipment integration platforms, reproducing the actual underwater environment, etc., is of great significance to the realization of underwater engineering data decision-making and intelligent operation and maintenance, and fills the gap in the combination of artificial intelligence technology, VR / AR / MR and other presentation technologies and their application in the construction and operation of underwater projects. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0026] Figure 1 It is a principle block diagram of the intelligent service platform for underwater operation and maintenance based on virtual reality technology of the present invention.

[0027] Figure 2 It is a principle block diagram of the visualization module of the present invention.

[0028] Figure 3 It is a principle block diagram of the intelligent management module of the present invention.

[0029] In the figure: 101-acquisition module, 102-communication module, 103-visualization module, 104-intelligent management module, 105-layer unit, 106-scene unit, 107-query unit, 108-analysis unit, 109-report generation unit, 110-printing unit, 111-task management unit. DETAILED DESCRIPTION

[0030] Embodiments of the present invention are described in detail below. Examples of the embodiments are shown in the accompanying drawings. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, but should not be construed as limiting the present invention.

[0031] See also Figures 1 to 3 ,in, Figure 1 It is a principle block diagram of the intelligent service platform for underwater operation and maintenance based on virtual reality technology of the present invention. Figure 2 It is a principle block diagram of the visualization module 103 of the present invention. Figure 3 It is a principle block diagram of the intelligent management module 104 of the present invention. The present invention provides an intelligent service platform for underwater operation and maintenance based on virtual reality technology: comprising a collection module 101, a communication module 102, a visualization module 103 and an intelligent management module 104, wherein the visualization module 103 comprises a layer unit 105 and a scene unit 106, and the intelligent management module 104 comprises a query unit 107, an analysis unit 108, a report generation unit 109, a printing unit 110 and a task management unit 111.

[0032] According to this specific implementation, the communication module 102 is connected to the acquisition module 101, the visualization module 103 is connected to the communication module 102, and the intelligent management module 104 is connected to the communication module 102 and the visualization module 103 respectively;

[0033] The acquisition module 101 is used to collect underwater data using an underwater robot and underwater intelligent sensing equipment;

[0034] The communication module 102 is used to transmit the collected underwater data using private 5G cellular network technology;

[0035] The visualization module 103 is used to receive and process underwater data and generate a dynamic three-dimensional model of the underwater environment using virtual reality technology;

[0036] The intelligent management module 104 is used to monitor the underwater operation status in real time, use artificial intelligence algorithms to conduct in-depth analysis of data, provide operation guidance, risk warnings and decision-making suggestions, and form a real-time three-dimensional visual image and text data database.

[0037] The acquisition module 101 uses underwater robots and underwater intelligent sensing equipment such as acoustics, optics, and electromagnetics, combined with underwater engineering detection big data technology and artificial intelligence deep learning technology to improve the recognition rate and accuracy of underwater targets and collect underwater data. The communication module 102 uses a system platform transmission architecture built on the basis of a private 5G cellular network for data transmission. Private 5G services can provide ultra-high transmission rates, highly reliable and low-latency connections, and transmission links for massive Internet of Things. They have unparalleled alternatives in terms of control transmission stability, security, and flexibility. The visualization module 103 uses multi-source heterogeneous data fusion technology As well as digital technologies such as AR / VR / MR, it integrates various sensor data such as sound, light, and electromagnetics, and combines the three-dimensional images, text and other information in the historical database to build a dynamic three-dimensional database of underwater detection target features, realize the visualization of detection target features, and reduce the error of underwater terrain matching and positioning. The intelligent management module 104 forms an intelligent analysis service platform for underwater engineering detection, which integrates information on all aspects of the entire life cycle of various facilities, such as design, procurement, construction, installation, commissioning, production, operation, maintenance and abandonment, to form a real-time three-dimensional visualization image and text data database to provide decision support for the full life cycle management of underwater assets.

[0038] Wherein, the scene unit 106 is connected to the layer unit 105 and the communication module 102 respectively;

[0039] The scene unit 106 is used to construct three-dimensional point cloud data and two-dimensional vector data of pipelines using GIS terrain data, and to construct a virtual simulation scene of inspection operations through BIM modeling, three-dimensional point cloud modeling, and three-dimensional reconstruction based on two-dimensional views to form a 3D map, and provide resource catalogs, specific scenes, animation navigation, navigation maps, three-dimensional roaming, and real-scene browsing functions;

[0040] The layer unit 105 is used to classify and control data according to the layer.

[0041] The scene unit 106 obtains underwater data, and uses GIS terrain data, pipelines and their accessories to construct three-dimensional point cloud data, pipeline two-dimensional vector data, and constructs a virtual simulation scene for inspection operations through BIM modeling, three-dimensional point cloud modeling, and three-dimensional reconstruction based on two-dimensional views to form a 3D map to provide visual protection for pipeline inspection. It provides functions such as resource directory, specific scenes, animation navigation, navigation map, three-dimensional roaming, and real-scene browsing. The data loaded by the layer unit 105 in the simulation platform view space can be classified by layer: terrain layer, pipeline layer, pipeline accessory construction layer, and abnormal point layer. This function realizes the switch control of the layer, which is convenient for users to view certain specific types of objects on the map, close the types of objects that are not needed, and reduce visual interference.

[0042] Secondly, the query unit 107 is connected to the communication module 102 and the visualization module 103 respectively; the analysis unit 108 is connected to the communication module 102 and the visualization module 103 respectively;

[0043] The query unit 107 is used to perform query functions, including spatial query, attribute query, coordinate query and on-map statistics;

[0044] The analysis unit 108 is used for analysis of must-inspect points and must-inspect pipe sections, and for generating task orders, as well as for automatically analyzing and summarizing inspection tasks, including route coverage analysis, must-inspect point detection rate analysis, must-inspect pipe detection rate analysis, and hidden danger analysis.

[0045] The query unit 107 includes spatial query: spatial query provides box selection and polygon selection tools, which facilitates users to query pipelines, affiliated structures, and hidden danger points through range selection on the map. Attribute query: by entering attribute conditions, query pipeline facilities and locate the facilities. Coordinate query: enter longitude and latitude coordinates, query the nearest pipeline and locate it. On-map statistics: this function can realize the selection range on the map and the whole map range to count the number of any pipeline facilities, and classify and summarize them according to the different health conditions of the pipeline. This function takes advantage of the geographic information system, solves the difficulty that the application personnel could not count the facilities within the specified range on the map before, and improves the work efficiency of the operators. The analysis unit 108 re-inspects the discovered hidden danger points, and the re-inspection frequency of hidden danger points of different levels is different. Different weights are assigned to hidden danger points of different levels, and the priority level of re-inspection is intelligently analyzed in combination with historical detection records to form the data of must-check points. Pipelines in different health states have different detection frequencies. Different weights are assigned to pipelines with different health levels. Combined with historical inspection records, the priority level of re-inspection is intelligently analyzed to form the data of the pipe section that must be inspected. After the inspection task of the task management unit 111 is issued, the optimal inspection path plan is given by using the intelligent recommendation algorithm according to the pipeline line data, the data of the inspection point, and the data of the pipe section that must be inspected. It also supports modification based on the recommended route, so that the inspection route can be loaded and displayed on the virtual simulation platform; click to view the information; the inspection point can be loaded and displayed on the virtual simulation platform; click to view the information; the inspection line can be loaded and displayed on the virtual simulation platform; click to view the information; during the inspection operation, the underwater inspection status is displayed in real time on the virtual simulation platform. By performing image recognition on the high-resolution image generated by the underwater three-dimensional imaging sonar system, the defects and hidden dangers such as pipeline siltation and cracks are automatically identified, and basic points, lines, and surfaces are used to draw them on the image; the detection values ​​of various sensors are automatically analyzed, and the pipeline defects are judged in combination with the pre-set thresholds; the detected crack defects form a data table, including the time, type, alarm reason, and crack screenshot display of the defect detection, and clicking the corresponding figure will display the enlarged picture. At the same time, the homepage has a filtering function. You can filter by the corresponding type or camera code. If it is empty, click OK to return to all information. Click the dam crack intelligent detection label, the front end will interact with the back end, and the back end will send the detected video to the front end for real-time display. The staff can manage the dam defect detection according to the detection information. To close, click the label at the top of the page. After the robot identifies the hidden danger point, it automatically records the coordinates of the hidden danger point and marks it with symbols on the navigation map; associates the space and attribute information of the hidden danger point to facilitate the subsequent generation of detection reports for further management; reminds the inspection personnel to re-inspect the must-inspect points and must-inspect sections.Display the number of inspected and remaining mandatory inspection points and mandatory inspection sections in real time; load the mandatory inspection point and mandatory inspection section data in a striking style on the 3D navigation map, and can be updated dynamically; for mandatory inspection points, regardless of whether there are abnormalities, their images and other detection data values ​​must be collected for subsequent comparative analysis; automatically analyze and summarize this inspection task. Route coverage analysis: compare the ROV track with the planned route to measure the completion of the task. Mandatory inspection point detection rate analysis: compare and analyze the coordinates of the mandatory inspection points with the ROV track, and calculate the detection rate of the mandatory inspection points in this task to measure the completion of the task. Mandatory inspection pipeline detection rate analysis: compare and analyze the coordinates of the mandatory inspection pipeline with the ROV track, and calculate the detection rate of the mandatory inspection pipeline in this task to measure the completion of the task. Hidden danger analysis: summarize the hidden danger points and abnormal points found in this inspection task.

[0046] At the same time, the report generating unit 109 is connected to the analyzing unit 108;

[0047] The report generating unit 109 is used to automatically generate a report based on the result obtained by the analyzing unit 108 .

[0048] The report generation unit 109 automatically generates a report based on the task analysis results, and supports outputting to PDF.

[0049] In addition, the printing unit 110 is connected to the visualization module 103 and the report generation unit 109 respectively;

[0050] The printing unit 110 is used to provide current range printing, proportional printing, range printing and map sheet printing functions.

[0051] The printing unit 110 includes map printing: the map printing function provides current range printing and proportional printing, and the printing function can meet the daily simple printing application. Range printing: supports map printing output according to the range. By drawing a rectangle or polygon and setting the scale of the output, the pipeline, hidden danger point and other data within the rectangular range are output according to the scale of the output. Sheet printing: supports map printing output according to the sheet.

[0052] Finally, the task management unit 111 is connected to the analysis unit 108 and the report generation unit 109 respectively;

[0053] The task management unit 111 is used to generate a task list based on the analysis result, monitor the task execution process, and provide the report generation unit 109 with task execution information.

[0054] The task management unit 111 generates an inspection task list based on the pipeline company information, inspection team information, pipeline line information, must-inspect point data, and must-inspect pipe section data, and monitors the real-time operating status of each module, and fully integrates the monitoring data into the platform so as to understand the platform operating status in real time, and escort the permanent and efficient inspection of the entire inspection platform. ROV operation terminal operation status: Monitor the ROV operation terminal to view the terminal power supply, communication connection, etc. in real time. Communication base station operation status: Monitor the communication base station to view the base station power supply, communication connection, etc. in real time. ROV operation status: Monitor the ROV to view the ROV power supply, communication connection, etc. in real time. Record and display the ROV's position, heading, attitude, track, and other information in real time and intuitively on the virtual simulation platform.

[0055] An intelligent underwater operation and maintenance service platform based on virtual reality technology is used in this embodiment. The acquisition module 101 uses underwater robots and underwater intelligent sensing equipment such as acoustics, optics, and electromagnetics, and combines underwater engineering detection big data technology and artificial intelligence deep learning technology to improve the recognition rate and accuracy of underwater targets and collect underwater data. The communication module 102 uses a system platform transmission architecture built on the basis of a private 5G cellular network for data transmission. Private 5G services can provide ultra-high transmission rates, highly reliable and low-latency connections, and transmission links for massive Internet of Things. It has unparalleled alternatives in controlling transmission stability, security, and flexibility. The visualization module Block 103 uses multi-source heterogeneous data fusion technology and digital technologies such as AR / VR / MR to integrate various sensor data such as acoustic, optical, and electromagnetic, and combines the three-dimensional images, text, and other information of the historical database to build a dynamic three-dimensional database of underwater detection target features, realize the visualization of detection target features, and reduce the error of underwater terrain matching and positioning. The intelligent management module 104 forms an intelligent analysis service platform for underwater engineering detection, and integrates information and data from all aspects of the entire life cycle of various facilities such as design, procurement, construction, installation, commissioning, production, operation, maintenance, and abandonment to form a real-time three-dimensional visualization image and text data database to support decision-making for the full life cycle management of underwater assets. Comprehensively using simulation, data visualization, and interaction technologies of three-dimensional virtual environment models, using underwater robots as equipment integration platforms, and reproducing the actual underwater environment, etc., is of great significance to the realization of underwater engineering data decision-making and intelligent operation and maintenance, and fills the gap in the combination of artificial intelligence technology, VR / AR / MR and other presentation technologies and their application in the construction and operation of underwater projects.

[0056] What is disclosed above is only one or more preferred embodiments of the present application, and cannot be used to limit the scope of rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of implementing the above embodiments and equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. An intelligent service platform for underwater operation and maintenance based on virtual reality technology, characterized by: Including acquisition module, communication module, visualization module and intelligent management module; The communication module is connected to the acquisition module, the visualization module is connected to the communication module, and the intelligent management module is connected to the communication module and the visualization module respectively; The acquisition module is used to collect underwater data using an underwater robot and underwater intelligent sensing equipment; The communication module is used to transmit the collected underwater data using private 5G cellular network technology; The visualization module is used to receive and process underwater data and generate a dynamic three-dimensional model of the underwater environment using virtual reality technology; The intelligent management module is used to monitor the underwater operation status in real time, use artificial intelligence algorithms to conduct in-depth analysis of data, provide operation guidance, risk warnings and decision-making suggestions, and form a real-time three-dimensional visual image and text data database.

2. The intelligent service platform for underwater operation and maintenance based on virtual reality technology according to claim 1, characterized in that: The visualization module includes a layer unit and a scene unit, and the scene unit is connected to the layer unit and the communication module respectively; The scene unit is used to construct three-dimensional point cloud data and two-dimensional vector data of pipelines using GIS terrain data, and to construct a virtual simulation scene of inspection operations through BIM modeling, three-dimensional point cloud modeling, and three-dimensional reconstruction based on two-dimensional views to form a 3D map, and provide resource catalogs, specific scenes, animation navigation, navigation maps, three-dimensional roaming, and real-scene browsing functions; The layer unit is used to classify and control data according to the layer.

3. The intelligent service platform for underwater operation and maintenance based on virtual reality technology according to claim 1, characterized in that: The intelligent management module includes a query unit and an analysis unit, wherein the query unit is connected to the communication module and the visualization module respectively; the analysis unit is connected to the communication module and the visualization module respectively; The query unit is used to perform query functions, including spatial query, attribute query, coordinate query and on-map statistics; The analysis unit is used for must-inspect point analysis, must-inspect pipe section analysis, and generating task orders, as well as automatically analyzing and summarizing inspection tasks, including route coverage analysis, must-inspect point detection rate analysis, must-inspect pipe detection rate analysis, and hidden danger analysis.

4. The intelligent service platform for underwater operation and maintenance based on virtual reality technology according to claim 3, characterized in that: The intelligent management module further comprises a report generating unit, and the report generating unit is connected to the analyzing unit; The report generating unit is used to automatically generate a report based on the result obtained by the analyzing unit.

5. The underwater operation and maintenance intelligent service platform based on virtual reality technology according to claim 4 is characterized in that: The intelligent management module further comprises a printing unit, and the printing unit is connected to the visualization module and the report generation unit respectively; The printing unit is used to provide current range printing, proportional printing, range printing and map sheet printing functions.

6. The intelligent service platform for underwater operation and maintenance based on virtual reality technology according to claim 5, characterized in that: The intelligent management module further comprises a task management unit, and the task management unit is connected to the analysis unit and the report generation unit respectively; The task management unit is used to generate a task list based on the analysis result, monitor the task execution process, and provide task execution information to the report generation unit.

Images