Intelligent ship driving system based on large model

Abstract

The invention relates to an intelligent ship driving system based on a large model. The intelligent ship driving system comprises a navigation information acquisition module, a voice interaction module, a central processing module and a control module. The navigation information acquisition module and the voice interaction module are respectively connected with the central processing module; the central processing module is connected with the control module; a central processing module based on a large model is used for processing information from a navigation information acquisition module and a voice interaction module, and then control over a ship is achieved. The method has the advantages of accurate judgment and prediction of complex maritime scenes, complex navigation instructions, query requests and the like.

Description

Technical Field

[0001] The present invention relates to the field of intelligent ship driving, and in particular to a system capable of processing navigation information based on a large model to achieve intelligent ship driving. Background Art

[0002] Traditional ship driving systems mainly rely on manual monitoring and operation, and face many challenges, including but not limited to misjudgment of personnel fatigue, reaction speed limitations under complex sea conditions, and insufficient sensitivity to changes in environmental factors. Therefore, the intelligent ship driving system combined with current information technology, especially artificial intelligence and big data analysis, has become an inevitable trend in the development of the industry. The progress of artificial intelligence technology mainly lies in deep learning and large models, and has made breakthrough progress in image recognition, natural language processing, predictive analysis and other fields. These technologies provide powerful data processing and decision support capabilities for intelligent ship driving. At the same time, large models can process complex navigation data, such as historical navigation records, real-time meteorological information, ocean current data, etc. By learning these data, the model can predict the best navigation, identify potential dangers and plan avoidance strategies in advance. Summary of the invention

[0003] Aiming at the problem that traditional ship driving systems are difficult to cope with complex sea conditions due to human factors, a ship intelligent driving system based on a large model is proposed, which can achieve a safer, more efficient and intelligent driving method.

[0004] The technical solution of the present invention is:

[0005] A large-scale model-based ship intelligent driving system comprises a navigation information collection module (1), a voice interaction module (2), a central processing module (3), and a control module (4);

[0006] The navigation information collection module (1) is connected to the central processing module (3) and is used to collect information about the navigation process and output the collected navigation information to the central processing module (3);

[0007] The voice interaction module (2) is connected to the central processing module (3) and is used to output the recognized voice information to the central processing module (3) and play the information from the central processing module (3);

[0008] The central processing module (3) is connected to the voice interaction module (2) and the control module (4) and is used to output processed voice interaction information and control information to the voice interaction module (2) and the control module (4) respectively;

[0009] The control module (4) is connected to the central processing module (3) and is used to receive control information from the central processing module (3) to realize the driving control of the ship.

[0010] Furthermore, the navigation information acquisition module (1) comprises a plurality of information acquisition units, including: a video information acquisition unit (12), a radar information acquisition unit (11), and other information acquisition units (13); the video information acquisition unit (12) is used to acquire video information during the navigation process of the ship, and output the video information to the central processing module (3); the radar information acquisition unit (11) is used to acquire radar information during the navigation process, and output the radar information to the central processing module (3); the other information acquisition unit (13) is used to acquire other information, and output the other information to the central processing module (3).

[0011] Furthermore, the voice interaction module (2) includes a plurality of voice interaction units, including: a voice information collection unit (21) and an information playback unit (22); the voice information collection unit (21) is used to collect voice information and output the voice information to the central processing module (3); the information playback unit (22) is used to play the information from the central processing module (3).

[0012] Furthermore, the central processing module (3) is a module using a multimodal large model, which is used to process information from the video information acquisition unit (12), the radar information acquisition unit (11), the other information acquisition unit (13) and the voice information acquisition unit (21), and output the processed information to the information playback unit (22) and the control module (4).

[0013] Furthermore, the control module (4) is used to centrally receive control information from the central processing module (3) to further control the navigation of the ship.

[0014] Furthermore, other information includes the ship's own performance, navigation mission, and weather.

[0015] Furthermore, the video acquisition unit is composed of a visible light camera and an infrared camera, the radar information acquisition unit is composed of a navigation radar, a millimeter-wave radar and a lidar, and other information acquisition units mainly rely on different equipment on the ship to provide information and output it after integration. The above units are all connected to the central processing module and output their respective information to the central processing module.

[0016] Furthermore, the voice collection unit is a microphone with a noise reduction processing function, which can be arranged in the driving cab and the captain's room; the information playback unit is a speaker with a voice playback function, which can be arranged in the driving cab, the captain's room and other places where needed; the above units are all connected to the central processing module to realize their respective output information and reception information.

[0017] Furthermore, the central processing module is a cloud-end collaborative multimodal big model, which can adopt the multimodal big model deployed in the cloud when the network is good, and adopt the multimodal big model deployed on the end side when the network is not good. It is mainly composed of a computer vision big model, a speech recognition big model and a natural language processing big model.

[0018] Furthermore, the control module is a rudder and engine system of the ship; it is connected to the central processing module and receives information from the central processing module to realize the steering and forward control of the ship.

[0019] The beneficial effects of the present invention are:

[0020] 1) The large model of this system can learn deeper navigation patterns and rules, and achieve accurate judgment and prediction of complex maritime scenarios. At the same time, it combines advanced technologies such as deep learning and reinforcement learning to efficiently process and intelligently analyze the massive amount of navigation data collected, ensuring the real-time and accuracy of data processing.

[0021] 2) The natural language processing and speech recognition technologies of this system integrate the latest speech recognition engine and natural language understanding capabilities, support complex navigation instructions and query requests, and improve the naturalness and efficiency of human-computer interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic diagram of the system principle of the present invention. DETAILED DESCRIPTION

[0023] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is implemented based on the technical solution of the present invention, and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to the following embodiments.

[0024] Under the above technical background, the present invention is a system designed to process navigation information based on a large model to achieve intelligent ship driving. It aims to overcome the limitations of traditional driving modes and promote ship navigation towards a safer, more efficient and intelligent direction.

[0025] See attached Figure 1 ,This embodiment is a ship intelligent driving system based on a large model, including: a navigation information collection module, a voice interaction module, a central processing module, and a control module.

[0026] The navigation information collection module includes a video information collection unit, a radar information collection unit and other information collection units. The video collection unit is composed of a visible light camera and an infrared camera, wherein the visible light camera is easy to acquire the target and the acquired target is clear, and the infrared camera is easy to acquire the target through edge features, and both cameras can output video information; the radar information collection unit is composed of a navigation radar, a millimeter wave radar and a laser radar, which meet the characteristics of long measurement distance, little influence by rain and fog weather, 360° no dead angle scanning, high ranging accuracy, etc., and can output relevant radar information; other information collection units mainly rely on different equipment on the ship to provide information, such as: the engine room provides the main engine operation status information, the power station provides the power load information and the damage control equipment provides the damage control information, and other information collection units integrate the above information and output it. All of the above units are connected to the central processing module and output their respective information to the central processing module.

[0027] The voice interaction module includes a voice information collection unit and an information playback unit. The voice collection unit is a microphone with a noise reduction function to ensure the accuracy of voice information collection, and can be placed in the cab and the captain's room; the information playback unit is a speaker with a voice playback function, which can be placed in the cab, the captain's room and any other place where it is needed. All of the above units are connected to the central processing module to realize their respective output information and reception information.

[0028] The central processing module is a cloud-end collaborative multimodal large model, which can use the multimodal large model deployed in the cloud when the network is good (such as: when the ship is docking or leaving the port), and use the multimodal large model deployed on the end side when the network is poor (such as: when the ship is sailing in remote sea areas). It is mainly composed of a computer vision large model (Inception), a speech recognition large model (WaveNet) and a natural language processing large model (GPT-4), which are used to process information from the navigation information collection module and the voice interaction module respectively, and can output the processed information to the voice interaction module and the control module.

[0029] The control module is the rudder and engine system of the ship. It is connected to the central processing module and receives information from the central processing module to realize the control of the ship's steering, forward movement, etc.

[0030] The above-mentioned embodiment only expresses one implementation mode of the present invention, and its description is relatively specific and detailed, but it cannot be understood as limiting the scope of the invention patent. It should be pointed out that for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be based on the attached claims.

Claims

1. A ship intelligent driving system based on a large model, characterized in that: It includes a navigation information collection module (1), a voice interaction module (2), a central processing module (3), and a control module (4); The navigation information collection module (1) is connected to the central processing module (3) and is used to collect information about the navigation process and output the collected navigation information to the central processing module (3); The voice interaction module (2) is connected to the central processing module (3) and is used to output the recognized voice information to the central processing module (3) and play the information from the central processing module (3); The central processing module (3) is connected to the voice interaction module (2) and the control module (4) and is used to output processed voice interaction information and control information to the voice interaction module (2) and the control module (4) respectively; The control module (4) is connected to the central processing module (3) and is used to receive control information from the central processing module (3) to realize the driving control of the ship.

2. A ship intelligent driving system based on a large model according to claim 1, characterized in that: The navigation information acquisition module (1) comprises a plurality of information acquisition units, including: a video information acquisition unit (12), a radar information acquisition unit (11), and other information acquisition units (13); the video information acquisition unit (12) is used to acquire video information during the navigation process of the ship, and output the video information to the central processing module (3); the radar information acquisition unit (11) is used to acquire radar information during the navigation process, and output the radar information to the central processing module (3); the other information acquisition unit (13) is used to acquire other information, and output the other information to the central processing module (3).

3. The ship intelligent driving system based on a large model according to claim 1 is characterized in that: The voice interaction module (2) comprises a plurality of voice interaction units, including: a voice information collection unit (21) and an information playback unit (22); the voice information collection unit (21) is used to collect voice information and output the voice information to the central processing module (3); the information playback unit (22) is used to play the information from the central processing module (3).

4. The large model-based ship intelligent driving system according to claim 1, characterized in that: The central processing module (3) is a module using a multi-modal large model, and is used to process information from a video information acquisition unit (12), a radar information acquisition unit (11), other information acquisition units (13) and a voice information acquisition unit (21), and output the processed information to an information playback unit (22) and a control module (4).

5. The large model-based ship intelligent driving system according to claim 1, characterized in that: The control module (4) is used to centrally receive control information from the central processing module (3) to further control the navigation of the ship.

6. The large model-based ship intelligent driving system according to claim 2, characterized in that: Other information includes the ship's own performance, navigation mission, and weather.

7. The large model-based ship intelligent driving system according to claim 2, characterized in that: The video acquisition unit is composed of a visible light camera and an infrared camera. The radar information acquisition unit is composed of a navigation radar, a millimeter-wave radar and a lidar. Other information acquisition units mainly rely on different equipment on the ship to provide information and output it after integration. The above units are all connected to the central processing module and output their respective information to the central processing module.

8. The large model-based ship intelligent driving system according to claim 3, characterized in that: The voice collection unit is a microphone with noise reduction processing function, which can be placed in the cockpit and the captain's room; the information playback unit is a speaker with voice playback function, which can be placed in the cockpit, the captain's room and other places where needed; the above units are all connected to the central processing module to realize their respective output information and reception information.

9. The large model-based ship intelligent driving system according to claim 4, characterized in that: The central processing module is a cloud-end collaborative multimodal large model, which can use the multimodal large model deployed in the cloud when the network is good, and use the multimodal large model deployed on the end side when the network is poor. It is mainly composed of a computer vision large model, a speech recognition large model and a natural language processing large model.

10. The large model-based ship intelligent driving system according to claim 5, characterized in that: The control module is the rudder and unit system of the ship; it is connected to the central processing module and receives information from the central processing module to realize the steering and forward control of the ship.

Images