5G industrial internet ship remote inspection platform

Abstract

The invention discloses a 5G industrial internet ship remote inspection platform which comprises a remote inspection end and a ship end. The remote inspection end comprises equipment for receiving and checking data information sent by the ship end, and the equipment at least has a video playing function and an audio playing function; the ship end comprises a ground station and a data acquisition system, and the data acquisition system is used for acquiring various ship information required in the ship inspection process; the 5G industrial internet ship remote inspection platform provided by the invention fully meets the requirements of ship inspection on a network in a complex ship environment; the service requirements of ship inspection are met, and various flexible and convenient inspection modes such as remote online real-time interaction, on-ship non-contact and off-line self-inspection are supported; through connection with the smart phone, the smart glasses and the unmanned aerial vehicle, visual field sharing, real-time communication and file transmission between the ship and the shore are realized, the inspection cost is remarkably reduced, and the inspection efficiency is improved.

Description

Technical Field

[0001] The present invention relates to a ship inspection platform, in particular to a 5G industrial Internet ship remote inspection platform. Background Art

[0002] Ship inspection: Inspection is carried out to prove that the technical status of the ship meets the requirements of relevant laws, regulations and specifications, to ensure the safety of ship operation and to avoid damage to the marine environment.

[0003] Ship inspection is the general term for the inspection, review, testing and appraisal of the technical condition of a ship and its equipment by a ship inspection agency. A ship's technical certificate is a document that proves the ship's technical condition. Only after a ship passes the corresponding inspection can it obtain the necessary technical certificate or keep the technical certificate valid.

[0004] The purpose of ship inspection is to urge shipping companies to maintain good technical conditions of ships through inspection of ships and their equipment, so as to ensure the safe operation of ships and prevent pollution and damage to the marine environment; to ensure that flag states and port state governments exercise effective management and control over ships; at the same time, it also helps ship owners improve their competitiveness in the shipping market and reduce insurance premiums; and to provide the necessary technical basis for notarization, claims, maritime affairs, etc.

[0005] According to the nature of the inspection, ship inspection can be divided into three basic types: classification inspection, statutory inspection and notarization inspection.

[0006] Classification inspection (also known as entry inspection) is to inspect and issue classification certificates according to the inspection rules and technical standards of the classification society; statutory inspection is to inspect and issue statutory certificates according to international conventions, national decrees and laws; notarized inspection is an inspection of the items applied for inspection by surveyors assigned by the classification society at the request of the customer to prove the objective technical conditions. Notarized inspection includes marine damage inspection, claim inspection, lease-in and lease-out inspection, ship condition inspection, cargo damage inspection, etc.

[0007] Classification inspection is usually carried out by a classification society selected by the ship owner, while statutory inspection must be carried out by the government authority or its authorized organizations or individuals. Statutory inspection is mostly carried out by classification societies authorized by the government; classification inspection is voluntarily carried out by the ship owner for the convenience of insurance, claims and handling of maritime disputes, while statutory inspection is mandatory by the government to ensure the safety of ships; classification inspection is an inspection of technical appraisal nature, while statutory inspection is a technical supervisory inspection of the ship's structure, stability, boilers and other pressure vessels, main and auxiliary engines, electrical equipment, radio communication equipment, life-saving and fire-fighting equipment, navigation equipment, signal equipment, pollution prevention equipment and load lines, etc., carried out by the national competent authorities in accordance with the international conventions to which the country is a party. It is an effective means of managing and controlling ships.

[0008] At present, ship inspections mostly rely on on-site inspections. When it is impossible to board the ship to carry out on-site inspections, supervision, inspections, audits and other activities due to various complex conditions (such as epidemics, risks of war and riots, remote ports, etc.), hundreds of thousands of ships are facing the expiration of ship inspection certificates and surveyors are unable to board the ship to carry out annual inspections. Therefore, there is an urgent need for a ship remote inspection platform to carry out ship inspections in a timely and effective manner and ensure the normal operation and safety of ships. Summary of the invention

[0009] The purpose of the present invention is to provide a 5G industrial Internet ship remote inspection platform to solve the problems raised in the above-mentioned background technology.

[0010] To achieve the above object, the present invention provides the following technical solutions:

[0011] 5G Industrial Internet Ship Remote Inspection Platform, including remote inspection terminal and ship terminal;

[0012] The remote inspection terminal includes a device for receiving and viewing data information sent by the ship terminal, and the device has at least a video playback function and an audio playback function;

[0013] The ship terminal includes a ground station and a data acquisition system, and the data acquisition system is used to collect various ship information required during the ship inspection process;

[0014] The ground station is used to be installed on the inspected ship, and is used to receive the ship information collected by the data acquisition system and send the ship information to the remote inspection terminal;

[0015] The data acquisition system includes smart phones, tablet computers, smart glasses, drones, scanners, digital cameras, and video cameras.

[0016] As a further solution of the present invention: the ground station accesses the ad hoc network, 5G and Internet links based on multimedia network transmission technology, uses H.265 and SFDV encoding and decoding technology, and accesses smart phones, tablets, smart glasses, and drones through a multi-point control unit.

[0017] As a further solution of the present invention: the self-organizing network is a centerless self-organizing network based on the 802.11s protocol, and the centerless self-organizing network realizes rapid connection with computers, smart glasses, smart phones, tablet computers, drones and 5G network integration based on the universal IP external connection protocol.

[0018] As a further solution of the present invention: the drone is equipped with a camera via an anti-shake gimbal, and a laser radar sensor is installed on the drone.

[0019] As a further solution of the present invention: the UAV perceives the surrounding environment through a lidar sensor based on real-time positioning and mapping technology, and sends the perception data to a ground station. The ground station constructs a ship environment map based on the perception data, and compresses the environment map through semantic abstraction and de-sparseness technology. The ground station transmits the environment map to a remote inspection end with low latency through optical fiber, self-organizing network, and 5G communication technology.

[0020] Compared with the prior art, the present invention has the following beneficial effects:

[0021] 1. The 5G Industrial Internet ship remote inspection platform provided by the present invention fully meets the network requirements for ship inspection in a complex ship environment; meets the business needs of ship inspection, supports various flexible and convenient inspection methods such as remote online real-time interaction, "contactless" on board, and offline self-inspection; through connection with smart phones, smart glasses, and drones, it realizes vision sharing, real-time communication and file transfer between ship and shore, embodies compatibility, scalability and practicality, significantly reduces inspection costs and improves inspection efficiency.

[0022] 2. The "5G+Industrial Internet" remote ship inspection method proposed in the present invention is not restricted by time and region, and can realize real-time and effective information sharing and communication between surveyors and crew members. In special circumstances such as epidemic prevention and control, ship inspections can be carried out in a timely and effective manner, which plays an important role in ensuring the normal operation and safe operation of ships. It has a significant role in promoting the resumption of work and production of shipping companies, shipyards and other enterprises, and can effectively improve production efficiency, optimize resource allocation, save personnel travel expenses, reduce ship operating costs, improve the level of informatization, and promote the continuous improvement of business and quality improvement. Compared with traditional inspection methods, it can reduce about 60% of inspection time and cost, and has obvious economic and social benefits.

[0023] 3. The present invention gives full play to the technical advantages of new technologies and equipment such as 5G, industrial Internet, cloud computing, wearable devices and drones, promotes the innovation and upgrading of existing ship inspection models, meets the development trend of the shipping / shipbuilding industry, meets the development trend of ship intelligence, large-scale and intelligent manufacturing, and meets the industry's demand for high-quality development of ship inspection. It will change the traditional ship inspection methods, promote the shift and upgrade of inspection technology research and development and application levels, and change the ship inspection model. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present invention are described clearly and completely below. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0025] In the embodiment of the present invention, the platform deeply integrates new technologies and equipment such as 5G, industrial Internet, cloud computing, wearable devices and drones with the traditional ship inspection mode, and proposes the "5G+Industrial Internet" ship remote inspection platform for the first time in the field of ship inspection.

[0026] The ship remote inspection platform integrates the ship 5G+self-organizing network deployment module, "5G+drone" ship remote inspection module and other modules, and carries out demonstration applications to effectively ensure the quality of ship inspection and maintain the safety of water transportation. In order to achieve the same effect of "remote inspection" mode and "on-site inspection" mode in inspection quality and efficiency, the ship remote inspection platform divides the ship inspection items into scenarios according to the inspection location / area, and combines the application of "5G+Industrial Internet" technology to realize the scenario-based ship inspection mode.

[0027] According to the scenario-based remote ship inspection mode, it has functions such as structured inspection items, inspection information collection, inspection prompts, and inspection evidence output. It can remotely collect information required for ship inspection by connecting smart glasses, high-definition external video acquisition equipment, smart phones, drones and other devices, thereby improving the operability and interactivity of remote inspection. It supports 4K ultra-high-definition real-time remote AR inspection mode. It also supports scenario-based AR inspection, offline operation, and online sending in offline mode. It has the functions of starting inspection as soon as the all-in-one machine in the self-organizing network is turned on, and automatically synchronizing inspection data to the cloud platform after connecting to the public network.

[0028] The "Ship Self-organizing Network Deployment Module" mentioned in this platform can realize multi-point rapid networking through portable devices in complex ship environments. It has high bandwidth, high anti-interference, and strong transmission stability. It can meet the "contactless" ship inspection audio and video communication requirements in the self-organizing network. After connecting to the 5G public network, it can meet the remote inspection audio and video communication requirements between the remote inspection center and the ship inspection area.

[0029] The "5G+UAV" ship remote inspection solution module mentioned in this platform makes full use of the high-altitude easy passability and flexible maneuverability of the drone to transmit ultra-high-definition images of inaccessible hull structures, intelligent obstacle perception and avoidance information, and other information to the monitoring end in real time; the surveyor can conduct real-time remote inspection of the hull structure through the ship remote inspection platform, and through remote real-time control of the drone gimbal, the surveyor can adjust the remote inspection perspective in real time.

[0030] In the past year and a half of research and development in the field of ship inspection, it was found that the main problem at present comes from the limitations of the high-definition camera used for front-end acquisition. Due to the development of hardware technology, although some acquisition devices (smart glasses or mobile phones) have reached 4K resolution, the video acquisition window has a maximum resolution of 4096×2160 and a 3:4 (ratio) or 9:16 (ratio) frame, which cannot be used to capture video at a wide angle (non-fisheye) like the eyes and then transmit it to the back end. In addition, the camera of the acquisition device (smart glasses or mobile phone) is fixed-focus and cannot achieve micro-precision optical zoom technology.

[0031] Secondly, video stabilization is a defect. Currently, the stabilization problem of video captured by smart glasses on the market has not been effectively solved. The effect of improving video stabilization through developing software codecs is not obvious. Currently, the best effect is combined with mechanical stabilization. Something like DJI gimbal can solve the stabilization problem of some front-end devices such as mobile phones.

[0032] In order to achieve the same effect of inspection quality and efficiency between the "remote inspection" mode and the "on-site inspection" mode, this 5G Industrial Internet Ship Remote Inspection Platform divides the ship inspection items into scenes according to the inspection location / area, and combines the application of "5G+Industrial Internet" technology to innovatively propose multi-agent modeling optimization technologies such as AR voice, video and graphic prompts to ensure the accuracy of the inspection. A scenario-based ship inspection mode is realized.

[0033] This platform fully considers the network conditions of different ports, docks, and anchorages, develops high-bandwidth, low-latency 5G technology and the integration technology between ship self-organizing networks, and innovatively proposes various flexible and convenient inspection modes such as remote online real-time interaction, "contactless" inspection on board, and offline inspection. According to the requirements of ship inspection standards, it optimizes multi-party real-time communication, remote control, and collaboration technologies, realizes connection with computers, smart glasses, high-definition external video acquisition equipment, smart phones, drones and other equipment, and realizes 1080P, 4K, 30 frames, anti-shake and other audio and video indicators.

[0034] This platform is based on the integrated ship inspection model of "UAV-ground station-ship remote inspection platform". It develops an environmental perception module on the UAV side to realize intelligent perception of the environment around the UAV, intelligent data compression and real-time transmission, and provide environmental data support for remote inspection interaction; it realizes process control and data management on the ship remote inspection platform, realizes task scheduling, data synchronization, and status push on the ground station, and realizes accurate inspection information collection on the UAV side.

[0035] During the inspection process, this platform uses a scenario-based ship remote inspection mode, proposes structured ship inspection items, inspection information collection, inspection prompts, inspection evidence output and other functions, and carries out platform architecture and function design based on the requirements of online real-time interaction, "contactless" on board, and offline inspection modes.

[0036] Based on multimedia network transmission technology, this platform accesses ad hoc networks, 5G and Internet links, uses H.265, SFDV codecs and many other auxiliary technologies, integrates multi-party communication protocols, and effectively connects smart glasses, multi-party smart terminals, drones and other devices through multi-point control units, realizing the overall technical design of remote ship inspection functions.

[0037] This platform adopts C / S architecture, cloud-based and virtualized server deployment, and the system is connected to various network forms such as ad hoc networks and 5G. It adopts cloud + terminal solutions to achieve effective access to computers, smart glasses, high-definition external video acquisition equipment, smart phones, drones and other devices, real-time video, and remote control, allowing surveyors to efficiently complete remote inspection tasks.

[0038] This platform proposes for the first time a 5G technology and self-organizing network integration solution that is suitable for complex ship environments. It targets scenarios and task characteristics such as a large number of cabins, complex structures, closed spaces, metal interference, and short network preparation time, and is oriented to the requirements of remote ship inspections. It uses centerless self-organizing network technology to cover the ship inspection environment. The self-organizing network protocol is improved and optimized based on the 802.11s protocol, and based on the general IP external connection protocol, it achieves rapid connection with computers, smart glasses, high-definition external video acquisition equipment, smart phones, drones and other types of ship inspection equipment and 5G network integration.

[0039] This platform is based on the multi-level management architecture of cloud, fog and edge. It has designed for the first time a three-end ship data interaction solution of "drone end-ground station-ship remote inspection platform". Facing the complex cabin environment, it is the first time that drones can perceive the surrounding environment through lidar sensors based on real-time positioning and composition technology. At the same time, the constructed environmental map is compressed through semantic abstraction and de-sparseness technology, and transmitted to the remote inspection platform with low latency through optical fiber, self-organizing network, and 5G communication technology. The remote inspection personnel send remote control commands to the drone gimbal, which are transmitted to the ground station through encoding and multi-level network, and then transmitted to the drone core control unit through optical fiber. After decoding, the drone gimbal is controlled.

[0040] The "5G+Industrial Internet" ship remote inspection platform was jointly developed with China Classification Society, deeply integrating new technologies and equipment such as 5G, industrial Internet, cloud computing, wearable devices and drones with traditional ship inspection models. When it is impossible to board the ship for on-site inspection, supervision, inspection, audit and other activities due to various complex conditions (such as epidemics, risks of war and riots, remote ports, etc.), hundreds of thousands of ships are facing the expiration of ship inspection certificates and the surveyor is unable to board the ship to carry out annual inspections. The establishment of the platform plays an important role in timely and effective ship inspections and ensuring the normal operation and safety of ships. It provides a demonstration for all parties in the industry, such as flag states, port states, shipping companies, shipyards, and marine product factories, to carry out in-depth ship remote business.

[0041] The proposed platform solution fully meets the network requirements for ship inspections in complex ship environments; it meets the business needs of ship inspections, and supports various flexible and convenient inspection methods such as remote online real-time interaction, "contactless" on board, and offline self-inspection; through connection with smart phones, smart glasses, and drones, it realizes vision sharing, real-time communication, and file transfer between ship and shore, embodies compatibility, scalability, and practicality, significantly reduces inspection costs, and improves inspection efficiency.

[0042] The "5G+Industrial Internet" ship remote inspection method is not restricted by time and region, and can realize real-time and effective information sharing and communication between surveyors and crew members. In special circumstances such as epidemic prevention and control, ship inspections can be carried out in a timely and effective manner, which plays an important role in ensuring the normal operation and safe operation of ships. It has a significant role in promoting the resumption of work and production of shipping companies, shipyards and other enterprises, and can effectively improve production efficiency, optimize resource allocation, save personnel travel expenses, reduce ship operating costs, improve the level of informatization, and promote the continuous improvement of business and quality improvement. Compared with traditional inspection methods, it can reduce inspection time and cost by about 60%, with obvious economic and social benefits.

[0043] We will leverage the technological advantages of new technologies and equipment such as 5G, industrial Internet, cloud computing, wearable devices and drones to promote the innovative upgrading of existing ship inspection models, meet the development trends of the shipping / shipbuilding industry, meet the development trends of ship intelligence, large-scale and intelligent manufacturing, and meet the industry's demand for high-quality development of ship inspection. This will change the traditional ship inspection methods, promote the shift and upgrade of inspection technology research and development and application levels, and transform the ship inspection model.

[0044] In addition to being applied to remote inspection of ships, the present invention can also be directly applied to supervision and inspection by flag states, ship management and crew training of shipping companies, ship inspections by bulk cargo owners such as oil companies, safety and quality audits by third-party auditing agencies, and remote maintenance support by ship equipment manufacturers. On the one hand, it will reshape the operating model of the shipping industry / ship industry and improve operating efficiency and quality; on the other hand, the research results of the project will promote the development of related equipment manufacturers, integrators, and service companies, and drive the development of a series of industries such as R&D, production, training, and services in the field of ship inspection by related technology-based enterprises. Generate new economic growth points and help promote high-quality economic and social development.

[0045] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. 5G Industrial Internet Ship Remote Inspection Platform, characterized by: Including remote inspection end and ship end; The remote inspection terminal includes a device for receiving and viewing data information sent by the ship terminal, and the device has at least a video playback function and an audio playback function; The ship terminal includes a ground station and a data acquisition system, and the data acquisition system is used to collect various ship information required during the ship inspection process; The ground station is used to be installed on the inspected ship, and is used to receive the ship information collected by the data acquisition system and send the ship information to the remote inspection terminal; The data acquisition system includes smart phones, tablet computers, smart glasses, drones, scanners, digital cameras, and video cameras.

2. The 5G industrial Internet ship remote inspection platform according to claim 1 is characterized in that: The ground station accesses ad hoc networks, 5G and Internet links based on multimedia network transmission technology, uses H.265 and SFDV encoding and decoding technologies, and accesses smartphones, tablets, smart glasses and drones through a multi-point control unit.

3. The 5G industrial Internet ship remote inspection platform according to claim 2 is characterized in that: The self-organizing network is a centerless self-organizing network based on the 802.11s protocol. The centerless self-organizing network realizes rapid connection with computers, smart glasses, smart phones, tablet computers, drones and 5G network integration based on the general IP external connection protocol.

4. The 5G industrial Internet ship remote inspection platform according to claim 1 is characterized in that: The drone is equipped with a camera via an anti-shake gimbal, and a laser radar sensor is installed on the drone.

5. The 5G industrial Internet ship remote inspection platform according to claim 4 is characterized in that: The drone uses a lidar sensor to perceive the surrounding environment based on real-time positioning and mapping technology, and sends the perception data to a ground station. The ground station constructs a ship environment map based on the perception data, and compresses the environment map data through semantic abstraction and de-sparseness technology. The ground station transmits the environment map to a remote inspection terminal with low latency through optical fiber, self-organizing network, and 5G communication technology.