Autonomous watercraft and method for operating an autonomous watercraft

The autonomous watercraft's integrated drive, sensor, and data processing units enable it to autonomously detect and respond to unforeseen events, ensuring safer navigation by overriding manual control when necessary, thus addressing the challenge of reacting to obstacles and adhering to maritime rules.

WO2024227774A1PCT designated stage expired Publication Date: 2024-11-07ATLAS ELEKTRONIK GMBH +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/061884
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-02
Filing Date
2024-04-30
Publication Date
2024-11-07

AI Technical Summary

Technical Problem

Autonomous watercraft face challenges in independently reacting to unforeseen events and obstacles during route planning, especially when manually controlled, as operators may overlook potential dangers.

Method used

The autonomous watercraft is equipped with a drive and control unit, sensor system, and data processing unit that allows for independent evasive maneuvers based on sensor data analysis, overriding manual control if necessary to avoid collisions or mitigate risks, and can switch to automatic operation if an operator fails to recognize obstacles.

Benefits of technology

Enables the autonomous watercraft to automatically detect and respond to unplanned events and obstacles more effectively than human operators, ensuring safer navigation and adherence to maritime rules, even during remote control or signal loss scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024061884_07112024_PF_FP_ABST
    Figure EP2024061884_07112024_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating an autonomous watercraft (20) having a drive and control unit (28) for maneuvering the autonomous watercraft (20), comprising the following steps: a) detecting information about the environment of the autonomous watercraft by means of a sensor system (24) comprising a sensor or a plurality of sensors, b) outputting one sensor signal (26) corresponding to the information about the environment per sensor (24'); c) controlling the drive and control unit (28) such that the watercraft (20) travels along a pre-planned route; d) detecting an event on the basis of the sensor signal or the sensor signals and determining a risk of the event for the watercraft (20); e) controlling the drive and control unit (28) such that the watercraft performs an evasive maneuver in order to avoid or mitigate the event, if the risk exceeds a threshold value; f) receiving, from a control center, speed information and / or direction information for the remote control of the autonomous watercraft; g) controlling the drive and control unit with said speed information and / or direction information in order to manually maneuver the autonomous watercraft by means of a control center by the use of the external commands; h) detecting an additional event during the remote control by the control center on the basis of the sensor signal or the sensor signals; i) determining a risk of the additional event for the watercraft; j) transferring the autonomous watercraft from a manual operating mode to an automatic operating mode, if the risk exceeds a threshold value; k) controlling the drive and control unit such that the watercraft performs an evasive maneuver in order to avoid or mitigate the additional event.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Autonomous watercraft and method for operating an autonomous watercraft

[0002] Description

[0003] The invention relates to the autonomy of an autonomous watercraft.

[0004] Autonomous watercraft can move in the water completely independently, i.e., without remote control. Remote control, i.e., manual control of the autonomous watercraft, is often possible as a supplement. It is known that autonomous watercraft can follow a pre-planned route. However, the problem is the watercraft's independent reaction to unforeseen and unforeseeable events during route planning, especially during manual control of the autonomous watercraft, or to obstacles overlooked by the operator manually controlling the autonomous watercraft remotely.

[0005] The object of the present invention is therefore to create an improved concept for autonomous watercraft.

[0006] This problem is solved by the subject matter of the independent patent claims. Further advantageous embodiments are the subject matter of the dependent patent claims.

[0007] Embodiments show an autonomous watercraft. The watercraft comprises a drive and control unit, a sensor system and a data processing unit. The drive and control unit can maneuver the autonomous watercraft. This means that a speed, a direction of travel and optionally a diving depth of the autonomous watercraft can be set by means of the drive and control unit. The design of the drive and control unit can have a common component for drive and control or separate components for drive and control. A drive and control unit with common components comprises, for example, one or more propellers or one or more nozzles for propulsion, wherein the control is achieved by pivoting the propeller(s) or nozzles or by different drive power of the propellers or nozzles relative to one another. A drive and control unit with separate components has, for example,In addition to a drive, for example, a rudder for steering. Furthermore, the drive and control unit can include one or more trim systems for adjusting the buoyancy force, heeling, and / or pitch. In other words, the drive and control unit can also influence the attitude of the autonomous watercraft, for example, by means of a trim system.

[0008] The sensor system comprises a sensor or typically a plurality of sensors. The sensor(s) detect environmental information of the autonomous watercraft and output a sensor signal for each sensor corresponding to the environmental information. This means, for example, that a camera records (in particular continuously) images of the environment, an infrared sensor (in particular continuously) records heat signatures of the environment, a sonar (in particular continuously) detects underwater noise, an AIS receiver (in particular continuously) receives position data from ships, and a radar (in particular continuously) transmits radio waves and receives their echo. Other sensors can also be used. The sensors can form the sensor system as a single sensor or in any combination. The sensor system can further comprise sensors that monitor an internal status of the autonomous underwater vehicle.

[0009] The data processing unit can control the propulsion and control unit, particularly by means of control signals, so that the vessel travels along a pre-planned route. The data processing unit represents one option for controlling the autonomous vessel during regular operation. However, a sensor of the sensor system can also temporarily assume regular control, particularly via suitable interfaces, or an external control center can temporarily assume regular control.

[0010] The data processing unit can further detect an event based on the sensor signal or signals and determine the risk of the event for the watercraft. The event can be an environmental event such as a thunderstorm front or a storm area. Furthermore, the event can also be a (moving or stationary) obstacle such as a moving or anchored ship. The risk in this respect is, for example, a collision or potential damage to the autonomous watercraft caused by the environmental event. If the risk exceeds a threshold value, the drive and control unit is controlled by the data processing unit such that the watercraft performs an evasive maneuver to avoid or at least mitigate the event. The evasive maneuver can comprise a change in speed and / or a change in direction of travel, i.e. a change in the current route of the autonomous watercraft.The evasive maneuver also optionally includes returning to the pre-planned route as soon as this is reasonable and possible. Alternatively, the data processing unit can calculate an alternative route to the pre-planned route to reach the destination.

[0011] Preferably, during remote control, i.e., manual control of the autonomous watercraft by the control center, the data processing unit can detect an event based on the sensor signal(s) and determine the risk of the event for the watercraft. If the risk exceeds a threshold, the data processing unit can control the drive and control unit in such a way that the watercraft performs an evasive maneuver to avoid or mitigate the event, thus overriding the manual control of the autonomous watercraft. This means that the data processing unit can also take over control in the case of remote control by the control center if there is a danger to the autonomous watercraft. In particular, a sensor that detects the potential collision can transfer the watercraft from manual remote control mode to automatic mode. This enables, for example,the rescue of the autonomous watercraft if the operator in the base station does not detect an obstacle. Control can also be taken over if a signal loss occurs during remote control by the control center and the connection is interrupted. In this case, the watercraft can take measures to re-establish the connection or alternatively wait for a reconnection. These options can optionally be excluded by the control center. The idea is therefore to be able to automatically react to unforeseeable events during manual operation or to obstacles not detected by an operator using sensor-based environmental monitoring and automatic evaluation of the sensor data by the data processing unit. In this way, the sensors can sometimes detect and react to an obstacle sooner than an operator remotely controlling the autonomous watercraft.The evaluation of the sensor data can be carried out using suitable data processing methods or image processing methods.

[0012] Embodiments show that the sensor system comprises at least one optical sensor. The optical sensor is, for example, a camera or a Lidar sensor (Lidar: Light Detection and Ranging).

[0013] Further embodiments show that the sensor system comprises at least one acoustic sensor and / or a radio wave-based sensor. The acoustic sensor is, for example, a sonar. The radio wave-based sensor is, for example, a radar.

[0014] In embodiments, the data processing unit is designed to detect, based on a plurality of successive sensor signals, whether the event is an obstacle and whether the obstacle is static or moving. Static obstacles are, for example, (possibly unrecorded) buoys or anchored ships. In the case of underwater vehicles, an obstacle can also be (possibly unrecorded) sunken ships or reefs. In particular, an obstacle can be an object that is not recorded on a nautical chart to which the watercraft has access. Moving obstacles are, for example, ships. In the case of underwater vehicles, moving obstacles can also be living beings, in particular large ones, such as whales or sharks, or other underwater vehicles.For example, when a moving obstacle has been detected, the data processing unit may perform a course prediction and / or depth prediction and / or speed prediction of the moving obstacle and estimate the risk of a collision based on the course and speed prediction.

[0015] This means that, based on knowledge of the vessel's own speed and direction and the speed and direction of the moving obstacle, the data processing unit can, for example, estimate an intersection point of both routes and / or a minimum distance that the unmanned vessel maintains from the moving obstacle. In particular, it is thus possible to maintain a prescribed minimum distance from the moving obstacle at all times, which can be regarded here as a threshold value for the risk of a collision. The drive and control unit can be controlled by the data processing unit with the aim of ensuring that, in particular at all times, a prescribed minimum distance is maintained between the autonomous vessel and the moving obstacle.

[0016] In further embodiments, the data processing unit can access and evaluate nautical chart information. This means that the information recorded in the nautical chart, such as buoys, is known to the autonomous watercraft. The data processing unit can compare a detected static obstacle with the nautical chart information. This enables navigation support, in particular by comparing the current position relative to the surrounding recorded stationary (static) obstacles. Furthermore, by detecting obstacles that are not recorded in the nautical chart, it is possible to draw attention to obstacles that could not be taken into account during the initial route specification and thus potentially lie in the route of the unmanned watercraft.

[0017] In exemplary embodiments, the data processing unit is configured to specify the evasive maneuver in such a way that generally applicable maritime regulations are observed. General maritime regulations can be considered to be the "International Regulations for Preventing Collisions at Sea of ​​1972," or the "Collision Prevention Rules" (COLREG) for short, or other, for example, locally applicable maritime regulations. This enables the autonomous vessel to navigate maritime traffic like a manned vessel. This is advantageous for the approval of the autonomous vessel by the maritime authorities.

[0018] In exemplary embodiments, the autonomous watercraft has a signaling device. These can be audio signals (e.g., ship's whistle, bell, or horn) or visual signals such as flags or lights. The signaling devices enable the implementation of general maritime regulations. The data processing unit can control the signaling device in such a way that the signaling device indicates an operating mode of the watercraft, in particular the evasive maneuver. This is specified at least for certain maneuvers according to general maritime regulations.

[0019] In further embodiments, the data processing unit determines a plurality of alternative changes of direction in order to carry out the evasive maneuver and, based on an optimization criterion, determines the evasive maneuver of the plurality of evasive maneuvers that is carried out. In this way, different possible routes of the autonomous watercraft can be compared with one another. The optimization criterion for evaluating the comparison can be, for example, the travel time, the distance of the route or the number of possible further evasive maneuvers to be carried out or any combination thereof. Alternatively, it is also possible, e.g. in order to save computing capacity, to use the first possible evasive route according to the trial-and-error principle. Artificial intelligence methods can also advantageously be used to determine the behavior.

[0020] Embodiments further show that the data processing unit can compare an alternative course for the evasive maneuver with other system variables of the autonomous watercraft. The system variables include, for example, the existing energy storage device for driving the autonomous watercraft. Furthermore, the maneuverability of the autonomous watercraft or the maximum speed of the autonomous watercraft can be regarded as a system variable. For example, a route that is too long can be rejected due to insufficient energy reserves. A route can also be rejected if a change of course is necessary that cannot be carried out by the autonomous watercraft due to insufficient maneuverability. The same applies to an evasive maneuver in which the speed cannot be increased enough to prevent or mitigate a collision or the impact of the event on the watercraft.can be reduced sufficiently.

[0021] In exemplary embodiments, the data processing unit is further configured to specify the pre-planned route to the drive and control unit in the absence of a continuous or regularly recurring route marking. A regular route marking is considered to be a marking at regular intervals that is a maximum of 10 times the length of the autonomous watercraft. Thus, the navigation of an autonomous watercraft differs fundamentally from the navigation of an autonomous vehicle on the road. Here, continuous or at least regular road markings are present, which the sensors of the autonomous road vehicle can orient themselves by.

[0022] Further embodiments show that the data processing unit is designed such that it has one or more external interfaces that are configured to receive external commands. Such commands can represent, among other things, movement specifications (e.g., speed, direction of travel, and / or diving depth), maneuver specifications, sensor settings, or waypoints to be approached. The external commands can be generated by a data processing system integrated in the watercraft that is not originally assigned to the autonomous watercraft. Alternatively, such commands can also be transmitted via communication systems and made accessible to the data processing unit. The data processing unit is configured to replace the commands generated by adhering to the pre-planned route with the external commands in order to control the drive and control unit based on the external commands. This meansDepending on the type of external commands, the data processing unit may completely or partially suspend monitoring of compliance with the predetermined route or overwrite the specific commands with the corresponding external commands.

[0023] In exemplary embodiments, however, the data processing unit is further configured to continuously monitor the sensor signals for the events and, if the risk of the event for the watercraft exceeds the threshold, to control the drive and control unit such that the watercraft executes an evasive maneuver to avoid the collision. This means that the data processing unit continues to monitor the autonomous watercraft, even if it does not currently have control sovereignty, and assumes control if unusual events, such as a potential collision or an approaching storm, may occur.

[0024] In further embodiments, the data processing unit can receive speed and / or direction information for remotely controlling the autonomous watercraft from a control center and control the drive and control unit with this speed and / or direction information. Optionally, the watercraft, in particular the data processing unit, can also send the sensor data to the control center. This gives the control center the ability to remotely control the autonomous watercraft.

[0025] For this purpose, communication can be established using electromagnetic waves, e.g., radio communication with an autonomous surface vehicle. For communication with an autonomous underwater vehicle, the use of a cable, particularly an optical fiber, or acoustic waves (e.g., an acoustic modem) is suitable.

[0026] Communication between the autonomous watercraft and the control center, in particular the transmission of video images, can be carried out via Ethernet, for example, and automatically select the best route between various available connection types. Connection types that are typically available are WiFi, IP over VHF, LTE, or SATcom. Embodiments further show that the autonomous watercraft is an autonomous underwater vehicle, and the data processing unit can control the drive and control unit such that the autonomous underwater vehicle follows a three-dimensional route in space. This means that, in contrast to an autonomous surface vehicle, which follows a two-dimensional route on a plane, the data processing unit for an autonomous underwater vehicle should determine a three-dimensional route that also includes the diving depth.

[0027] Similarly, a method for operating an autonomous watercraft with a drive and control unit for maneuvering the autonomous watercraft is disclosed, comprising the following steps: a) detecting environmental information of the autonomous watercraft by means of a sensor system comprising one sensor or a plurality of sensors; b) outputting at least one sensor signal corresponding to the environmental information per sensor; c) controlling the drive and control unit such that the watercraft travels along a pre-planned route; d) detecting an event based on the sensor signal or signals and determining a risk of the event for the watercraft; e) controlling the drive and control unit such that the watercraft performs an evasive maneuver to avoid or mitigate the event if the risk exceeds a threshold value;f) Obtaining speed and / or direction information for remote control of the autonomous watercraft from a control center; g) Controlling the propulsion and steering unit with this speed and / or direction information in order to manually maneuver the autonomous watercraft from a control center using the external commands; h) Detecting a further event during remote control by the control center based on the sensor signal(s); i) Determining a risk of the further event for the watercraft; j) Switching the autonomous watercraft from a manual operating mode to an automatic operating mode if the risk exceeds a threshold;k) controlling the drive and control unit such that the watercraft performs an evasive maneuver to avoid or mitigate the further event. Also disclosed is a corresponding computer program comprising commands that, when executed by a computer of an autonomous watercraft with a drive and control unit for maneuvering the autonomous watercraft, cause the computer to execute the method.

[0028] Preferred embodiments of the present invention are explained below with reference to the accompanying drawings. In the drawings:

[0029] Fig. 1 : a schematic block diagram of an autonomous watercraft with a data processing device.

[0030] Before exemplary embodiments of the present invention are explained in more detail below with reference to the drawings, it is pointed out that identical, functionally equivalent or equivalent elements, objects and / or structures in the different figures are provided with the same reference numerals, so that the description of these elements shown in different exemplary embodiments is interchangeable or can be applied to one another.

[0031] Fig. 1 shows a schematic block diagram of an autonomous watercraft 20 with a data processing device 22. The autonomous watercraft further comprises a sensor system 24, which is connected to the autonomous watercraft by means of lines 26 in order to be able to send the sensor signal(s) to the data processing device 22. The sensor system comprises at least one sensor 24', optionally at least one further sensor 24", but preferably a plurality of sensors. The autonomous watercraft further comprises a drive and control unit 28. The data processing device 22 is connected to the drive and control unit by means of further lines 30 for the purpose of controlling the autonomous watercraft 20. Optionally, the sensor system 24 further has a direct line 32 for controlling the autonomous watercraft 20 to the sensor system 24.Further optionally, the autonomous watercraft 20 has a signaling device 34 which is connected to the data processing unit 22 by means of a further line 36.

[0032] Although some aspects have been described in connection with a device, it is understood that these aspects also represent a description of the corresponding method, so that a block or component of a device can also be understood as a corresponding method step or as a feature of a method step. Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block, detail, or feature of a corresponding device.

[0033] The above-described embodiments are merely illustrative of the principles of the present invention. It is understood that modifications and variations of the arrangements and details described herein will be apparent to others skilled in the art. Therefore, it is intended that the invention be limited only by the scope of the following claims and not by the specific details presented in the description and explanation of the embodiments herein.

[0034] List of reference symbols:

[0035] 20 autonomous watercraft

[0036] 22 Data processing device 24 Sensor system

[0037] 26 (electrical) line

[0038] 28 Drive and control unit

[0039] 30 (electrical) line

[0040] 32 (electrical) line 34 signaling device

[0041] 36 (electrical) line

Claims

Patent claims 1 . Autonomous watercraft (20) having the following characteristics: - a drive and control unit (28) designed to maneuver the autonomous watercraft (20), - a sensor system (24) comprising a sensor (24') or a plurality of sensors (24', 24"), wherein the sensor system (24) is designed to detect environmental information of the autonomous watercraft (20) and to output a corresponding sensor signal (26) for each sensor (24'); - a data processing unit (22) which is designed to control the drive and control unit (28) in such a way that the watercraft (20) travels along a pre-planned route; - wherein the data processing unit (22) is designed to detect an event based on the sensor signal or the sensor signals (26) and to determine a risk of the event for the watercraft (20) and, if the risk exceeds a threshold value, to control the drive and control unit (28) such that the watercraft (20) performs an evasive maneuver to avoid or mitigate the event; - wherein the data processing unit (22) comprises an interface for receiving external commands; - wherein the data processing unit (22) is designed to receive speed and / or direction information for remote control of the autonomous watercraft from a control center and to control the drive and control unit with this speed and / or direction information in order to manually maneuver the autonomous watercraft from a control center by means of the external commands; and - wherein the data processing unit is designed to detect an event during remote control by the control center based on the sensor signal or the sensor signals and to determine a risk of the event for the watercraft and, if the risk exceeds a threshold value, to switch the autonomous watercraft from a manual operating mode to an automatic operating mode and To control the propulsion and steering unit in such a way that the watercraft performs an evasive maneuver to avoid or mitigate the event.

2. Autonomous watercraft (20) according to claim 1, wherein the sensor system (24) comprises an optical sensor.

3. Autonomous watercraft (20) according to one of the preceding claims, wherein the sensor system (24) comprises an acoustic sensor and / or a radio wave-based sensor.

4. Autonomous watercraft (20) according to one of the preceding claims, wherein the data processing unit (22) is designed to detect, based on a plurality of successive sensor signals, whether the event is an obstacle and whether the obstacle is static or moving.

5. Autonomous watercraft (20) according to claim 4, wherein the data processing unit (22) is configured, when a moving obstacle has been detected, to make a course prediction and / or depth prediction and / or speed prediction of the moving obstacle and to estimate the risk of a collision based on the course and speed prediction.

6. Autonomous watercraft (20) according to one of claims 4 or 5, wherein the data processing unit (22) is designed to control the drive and control unit (28) with the aim of maintaining a predetermined minimum distance between the autonomous watercraft and the movable obstacle.

7. Autonomous watercraft (20) according to one of claims 4 to 6, - wherein the data processing unit (22) is designed to access and evaluate nautical chart information; - wherein the data processing unit is designed to compare a detected static obstacle with the nautical chart information.

8. Autonomous watercraft (20) according to one of the preceding claims, wherein the data processing unit (22) is designed to specify the evasive maneuver in such a way that generally applicable maritime rules are observed.

9. Autonomous watercraft (20) according to one of the preceding claims, - wherein the autonomous watercraft (20) has a signaling device; - wherein the data processing unit (22) is designed to control the signaling device (34) in such a way that the signaling device indicates an operating mode of the vehicle, in particular an evasive maneuver.

10. Autonomous watercraft (20) according to one of the preceding claims, wherein the data processing unit (22) is designed to determine a plurality of alternative changes of direction in order to carry out the evasive maneuver and to determine the evasive maneuver of the plurality of evasive maneuvers that is carried out based on an optimization criterion.

11. Autonomous watercraft (20) according to one of the preceding claims, wherein the data processing unit (22) is designed to compare an alternative course for the evasive maneuver with further system variables of the autonomous watercraft (20).

12. Autonomous watercraft (20) according to one of the preceding claims, wherein the data processing unit (22) is designed to specify the pre-planned route in the absence of a continuous or regularly recurring route marking of the drive and control unit, wherein the regular intervals are a maximum of 10 times the length of the autonomous watercraft (20).

13. Autonomous watercraft (20) according to one of the preceding claims, wherein the autonomous watercraft is an autonomous underwater vehicle and wherein the data processing unit (22) is designed to control the propulsion and Control unit (28) in such a way that the autonomous underwater vehicle travels a three-dimensional route in space.

14. A method for operating an autonomous watercraft (20) with a drive and control unit (28) for maneuvering the autonomous watercraft (20), comprising the following steps: a) detecting environmental information of the autonomous watercraft by means of a sensor system (24) comprising one or more sensors; b) outputting a sensor signal (26) corresponding to the environmental information for each sensor (24'); c) controlling the drive and control unit (28) such that the watercraft (20) travels along a pre-planned route; d) detecting an event based on the sensor signal or signals and determining a risk of the event for the watercraft (20); e) controlling the drive and control unit (28) such that the watercraft performs an evasive maneuver to avoid or mitigate the event if the risk exceeds a threshold value;f) Obtaining speed and / or direction information for remote control of the autonomous watercraft from a control center; g) Controlling the propulsion and control unit with this speed and / or direction information in order to manually maneuver the autonomous watercraft from a control center using the external commands; h) Detecting a further event during remote control by the control center based on the sensor signal or signals i) Determining a risk of the further event for the watercraft; j) Switching the autonomous watercraft from a manual operating mode to an automatic operating mode if the risk exceeds a threshold; k) Controlling the propulsion and control unit such that the watercraft performs an evasive maneuver to avoid or mitigate the further event.

15. A computer program comprising instructions which, when executed by a computer of an autonomous watercraft having a drive and control unit for maneuvering the autonomous watercraft, cause the computer to execute the method according to claim 14.

Citation Information

Patent Citations

  • Systems and methods for enhanced functionality for remote operation of robotic vehicles

    JP2020529079A

  • Multi-stage operation of autonomous vehicles

    US20200050190A1

  • Seafloor Harvesting With Autonomous Drone Swarms

    US20220145756A1