Automatic positioning arrangement system
The automated positioning system addresses the challenges of conventional docking systems by enabling precise, weather-independent vessel navigation and docking through an interactive monitor and processor control, reducing operator dependency and risk.
Patent Information
- Application Number
- JP2025091477
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2016-03-29
- Filing Date
- 2025-05-30
- Publication Date
- 2025-08-26
AI Technical Summary
Conventional docking systems for large vessels require skilled operators and multiple assistants, are prone to risks in adverse weather conditions, and lack interactive systems for precise vessel positioning without human intervention.
An automated positioning system using a vision ranging and photography system, transducers, and a processor control unit to generate a map of the vessel's surroundings, allowing automatic navigation and docking without human intervention, maintaining position despite wind and currents.
The system enables safe and precise docking and collision avoidance in adverse conditions, eliminating the need for skilled operators and reducing damage risks by maintaining the vessel's position relative to an external object.
Smart Images

Figure 2025124792000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an automatic docking and vessel collision avoidance system for marine vessels, and more particularly to an automatic positioning system between a powered marine vessel and a dock or external object. [Background technology]
[0002] Steering a large vessel to a desired position is a precision maneuver that, if dependent on the operator's judgment, can result in damage to the vessel and surrounding area. Maintaining the vessel's final position traditionally requires the assistance of multiple fixed devices. Hazardous weather conditions, such as wind, currents, fog, and darkness, greatly increase the risks associated with mobile operations.
[0003] Conventional docking systems typically require additional assistance to assist in measuring the effects of these uncertainties and to provide visual assistance to aid the operator's decisions to manually move the vessel to the desired location. However, steering a vessel in a congested area typically requires a skilled operator and multiple assistants to assist with steering. Conventional systems typically do not provide an interactive system to view the area surrounding the vessel or to receive commands to steer the vessel via the interactive system without human assistance. Furthermore, the larger the vessel, the greater the risk present during conventional steering, especially in congested areas, increasing the need for a skilled operator, a local harbor pilot, multiple assistants, and tugboats. Summary of the Invention [Problem to be solved by the invention]
[0004] The methods and systems described herein generally relate to an automated positioning system between a powered vessel and a dock or external object, the automated positioning system incorporating a touch screen interactive monitor that displays an overlay of surrounding geometry on an optical feed from a vision system that allows an operator to select a target location on the interactive monitor. The present invention has been made in consideration of the above-mentioned problems in the conventional art, and an object of the present invention is to provide an automatic positioning system and a method for automatically moving a ship using the automatic positioning system. [Means for solving the problem]
[0005] In order to achieve the above object, one aspect of the present invention provides a method for automatically navigating a vessel to a lateral position adjacent to a stored lateral reference point on an external object, the method comprising the steps of: generating an optical feed with a vision ranging and photography system; sensing a sensed lateral reference point on the external object using at least one transducer; transmitting information indicative of the sensed lateral reference point on the external object to a processor control unit; and, in the processor control unit: receiving the optical feed from the vision ranging and photography system; deriving a map of the area surrounding the vessel from the optical feed; displaying the map of the area surrounding the vessel on an interactive monitor; receiving target position data from the interactive monitor indicating the stored lateral reference point; receiving the information indicative of the sensed lateral reference point on the external object; storing the information indicative of the sensed lateral reference point on the external object as stored lateral reference point information, whereby the stored lateral reference point is the same point as the sensed lateral reference point; displaying the map of the area surrounding the vessel including the stored lateral reference point on the interactive monitor; directing a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object; and directing a propulsion system of the vessel to automatically stop the vessel at the lateral position adjacent the stored lateral reference point on the external object.
[0006] In order to achieve the above object, one aspect of the present invention provides a system for automatically navigating a vessel to a lateral position adjacent to a stored lateral reference point on an external object, the system including a processor control unit, the processor control unit receiving an optical feed from a vision ranging and photography system, deriving from the optical feed a map of an area surrounding the vessel, displaying the map of the area surrounding the vessel on an interactive monitor, receiving from the interactive monitor target position data indicative of the stored lateral reference point, receiving from at least one transducer information indicative of a sensed lateral reference point on the external object, storing the information indicative of the sensed lateral reference point on the external object as stored lateral reference point information, whereby the stored lateral reference point is the same point as the sensed lateral reference point, displaying the map of the area surrounding the vessel including the stored lateral reference point on the interactive monitor, and controlling a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent to the stored lateral reference point on the external object. and orienting a propulsion system of the vessel to automatically stop the vessel at the lateral position adjacent the stored lateral reference point on the external object. [Effects of the Invention]
[0007] The present invention provides a programmable automatic docking system capable of operating effectively in adverse weather conditions without the requirement for a human operator to perform the docking operation or even without the need for a human operator himself. The programmable automatic docking system of the present invention can also eliminate the risk of damage to the vessel and / or external object by allowing the vessel to automatically move laterally toward the external object and maintain a preselected position away from the external object upon initiation of the programmable automatic docking system. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating a programmable automatic docking system that includes a set of lateral position transducers on the vessel, as well as multiple port and starboard transducers, and a programmable control panel that initiates various automatic functions via a processor control unit designed to perform selected automatic functions. [Figure 2] FIG. 1 is a schematic diagram illustrating an embodiment of a programmable automatic docking system used during collision avoidance maneuvers. [Figure 3] FIG. 1 is a schematic diagram illustrating an embodiment of a programmable automatic docking system used during docking operations into a slip. [Figure 4] FIG. 1 is a schematic diagram illustrating one embodiment of a programmable automatic docking system in use, showing automatic placement of floating buoys and / or moorings. [Figure 5A] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a docking operation between an external object and a vessel. [Figure 5B] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a docking operation between an external object and a vessel. [Figure 5C] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a docking operation between an external object and a vessel. [Figure 6] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a collision avoidance maneuver between an external object and a vessel. [Figure 7A] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a vessel docking operation upon entering a slip. [Figure 7B] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a vessel docking operation upon entering a slip. [Figure 7C] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during a vessel docking operation upon entering a slip. [Figure 8] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during automatic location of buoys and / or moorings relative to a vessel. [Figure 9A] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during departure and departure of a vessel from an external object. [Figure 9B] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during departure and departure of a vessel from an external object. [Figure 9C] 1 is a flow chart illustrating an embodiment of a method of operating a programmable automatic docking system during departure and departure of a vessel from an external object. [Figure 10A] 1 shows a schematic diagram illustrating an embodiment of an automatic positioning system. [Figure 10B] 1 illustrates an embodiment of an automatic positioning system for automatically positioning the stern of a vessel between two external objects. [Figure 11A] 1 is a flow chart depicting one embodiment of a method for automatically moving a vessel by an automatic positioning system. [Figure 11B] 1 is a flow chart illustrating an embodiment of a method for determining a path. [Figure 12A] FIG. 1 is a block diagram of a computer used to implement one embodiment of the present invention. [Figure 12B] FIG. 1 is a block diagram of a computer used to implement one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0009] Both port and starboard operation of a vessel are described herein with reference to the vessel and external objects. Furthermore, the only operational difference between "port" or "starboard" operation is the selection of a "port" or "starboard" button on a control panel. This selection determines the activation of a set of "port" or "starboard" transducers and the "port" or "starboard" direction of the vessel's lateral movement. Finally, while Figures 1-4 show the starboard side of the vessel in detail for illustrative purposes, operation from the port side of the vessel will also be readily understood by those skilled in the art.
[0010] The present invention provides a programmable automatic docking system, which primarily includes, but is not limited to, a programmable processor control unit ("PCU") for automatically docking and navigating a vessel to a final location relative to an external object, including a dock. Furthermore, the programmable automatic docking system operates independently and without the use or need for any human operator upon initiation of the programmable automatic docking system.
[0011] The present invention provides a programmable automatic docking system that includes a plurality of transducers that detect and transmit a set of distance information between a vessel and an external object.
[0012] The set of distance information is fed back to a processor control unit to provide a programmable automatic docking system that enables the multiple thrusters in conjunction with the vessel's main drive train to drive the vessel laterally, fore and aft towards an external object at a controlled lateral path and speed.
[0013] The present invention provides a programmable automatic docking system that maintains the position of a vessel once it reaches a preselected position relative to an external object, and the system maintains that position indefinitely during operation regardless of wind and water currents.
[0014] The present invention provides a programmable automatic docking system that automatically positions a vessel at a slip location regardless of wind and current.
[0015] The present invention provides a programmable automatic docking system that maintains a preselected position of a vessel without the assistance of multiple ropes and fenders indefinitely while the programmable automatic docking system is in operation.
[0016] The present invention provides a programmable automatic docking system that includes a programmable processor control unit that enables a vessel to remain a preselected distance to the side of an external object.
[0017] The present invention provides a programmable automatic docking system that includes a programmable processor control unit that allows for efficient operation regardless of vessel length.
[0018] That is, once activated, the programmable automatic docking system operates fully automatically without a human operator by controlling the precise movement and position of the vessel relative to external objects until the vessel reaches a preselected final position, and then maintains the vessel's final position regardless of wind and water currents while the programmable automatic docking system is in operation.
[0019] 1 is a schematic diagram illustrating a programmable automatic docking system according to one embodiment of the present invention. Once activated, the programmable automatic docking system 10 provides automated control of docking operations and other related functions of a vessel 60, as well as integrated, interactive, proximity-sensing feedback of the vessel's 60 heading, lateral position, and speed.
[0020] In this embodiment, the programmable automatic docking system 10 includes a set of port-side transducers 40P and a set of starboard-side transducers 40S. Specifically, the set of port-side transducers 40P includes four distance-sensing transducers (41P, 42P, 44P, 45P) and one port-side lateral position transducer 43P, and the set of starboard-side transducers 40S includes four distance-sensing transducers (41S, 42S, 44S, 45S) and one starboard-side lateral position transducer 43S. In this embodiment, the set of port-side transducers 40P and the set of starboard-side transducers 40S provide distance, speed, and position information between five spaced apart positions on the port and starboard sides of the vessel 60.
[0021] In another embodiment of the programmable automatic docking system 10, the set of portside transducers 40P includes a pair of distance-sensing transducers 41P and 42P mounted on the port side bow of the vessel 60 and a pair of distance-sensing transducers 44P and 45P mounted on the port side stern of the vessel 60, each portside transducer (41P, 42P, 44P, 45P) detecting and transmitting a set of distance and speed information regarding the distance between the port side of the vessel 60 and an external object 70. In this embodiment, the external object 70 includes, but is not limited to, a dock, another vessel, or other similar structure. Additionally, the portside lateral position transducer 43P establishes the lateral position of the vessel 60 from the port side relative to a precise lateral reference point on the port external object 70. In this embodiment, the precise lateral reference point detected is a random reference point located at 90 degrees to the side of the vessel 60 on the external object 70, which transmits any lateral movement of the vessel 60 to the programmable processor control unit 30 (see discussion below).
[0022] In another embodiment of the programmable automatic docking system 10, the set of starboard transducers 40S includes a pair of distance-sensing transducers 41S and 42S mounted on the starboard bow of the vessel 60 and a pair of distance-sensing transducers 44S and 45S mounted on the starboard stern of the vessel 60, each starboard transducer (41S, 42S, 44S, 45S) detecting and transmitting a set of distance and speed information relating to the distance between the starboard side of the vessel 60 and an external object 70. In this embodiment, the external object 70 includes, but is not limited to, a dock or other similar structure. Additionally, the starboard lateral position transducer 43S establishes the lateral position of the vessel 60 from the starboard side relative to a precise lateral reference point on the starboard external object 70.
[0023] The programmable automatic docking system 10 further comprises a propulsion system including a bow thruster 51 and a stern thruster 52, each of which drives the vessel 60 laterally relative to the orientation of the external object 70 to align and then maintain the side of the vessel 60 at a final preselected distance from the external object 70. The propulsion system further comprises a forward / reverse drive selector 62 and a main drive propeller 63 in conjunction with the bow thruster 51 and the stern thruster 52.
[0024] Additionally, the programmable automatic docking system 10 includes a programmable processor control unit ("PCU") 30 that includes an automatic processor operating in real time to communicate and transmit a set of range and speed information provided by a set of port side transducers 40P and starboard side transducers 40S, as well as the propulsion system, each element of the propulsion system operating independently or together as determined by the programmable processor control unit 30.
[0025] In this embodiment, a set of port side transducers 40P are used to transmit distance, position, and speed information of the port side of the vessel 60 relative to the port side external object 70 to the programmable processor control unit 30. A set of starboard side transducers 40S are used to transmit distance, position, and speed information of the starboard side of the vessel 60 relative to the starboard side external object 70 to the programmable processor control unit 30.
[0026] The programmable automatic docking system 10 further includes a control panel 20 that enables the programmable automatic docking system 10 to perform a series of predetermined functions through the selection of specific inputs. In this embodiment, the control panel 20 includes an ON button 21 that activates the programmable automatic docking system 10 and an OFF button 22 that deactivates the programmable automatic docking system 10. The control panel 20 further includes a port button 66 and a starboard button 67, and in this embodiment, when the port button 66 is selected on the control panel 20, the port side transducer set 40P wirelessly transmits a set of distance, position, and speed information to the programmable processor control unit 30, the set including real-time distance, position, and speed measurements of the port side of the vessel 60 relative to an external object 70. Upon receiving the set of distance and speed information, the programmable processor control unit 30 engages the bow thruster 51 in response to the real-time distance and speed information provided by the port side bow transducer set 41P and 42P during a docking operation.
[0027] Additionally, a distance setting for a final preselected distance between the vessel 60 and the external object 70 is entered by selecting the plus button 24 or minus button 25 on the control panel 20. The final preselected distance setting is then transmitted to the programmable processor control unit 30 for use when the programmable automatic docking system 10 is in operation. As noted above, the system is activated by selecting the ON button 21 on the control panel 20 and deactivated by selecting the OFF button 22 on the control panel 20.
[0028] In this embodiment, when the port button 66 is selected on the control panel, the set of port side transducers 40P wirelessly transmits a set of position information, including real-time distance and speed measurements of the port side hull of the vessel 60 relative to an external object 70, to the programmable processor control unit 30. Upon receiving the set of position information, the programmable processor control unit 30 engages the bow thruster 51 and the stern thruster 52 in response to the real-time distance transducer distance and speed information provided by the set of port side transducers (41P, 42P, 44P, 45P) during docking operations.
[0029] The starboard lateral position transducer 43S and the port lateral position transducer 43P are mounted approximately amidships on the starboard and port sides, respectively, to sense a precise lateral reference point of the external object 70. Each lateral position transducer (43P, 43S) is capable of sensing, detecting, and wirelessly transmitting real-time lateral reference point information to the programmable processor control unit 30. The lateral reference point information is stored and utilized during subsequent lateral movement of the vessel 60 to determine the orientation of the vessel 60. Furthermore, the programmable processor control unit 30 automatically compensates for lateral movement of the vessel 60's bow or stern by controlling a plurality of actuators 53 coupled to the main drive 62 to maintain the vessel 60 on a controlled lateral path toward the stored precise lateral reference point of the external object 70.
[0030] Additionally, the programmable processor control unit 30 is in electronic communication with and automatically controls the bow thruster 51 and stern thruster 52 to position the side of the vessel 60 adjacent to the external object 70 at a preselected distance from the external object 70 and automatically maintain the side of the vessel 60 at the preselected distance, thereby providing a fully programmable automatic docking system 10 with integrated interactive proximity sensing feedback of vessel positioning and automatic control that does not require an operator after setting the system up in operation.
[0031] FIG. 2 illustrates the automatic collision avoidance feature of the present invention in a marina or other similar docking area. In this embodiment, when the forward / reverse drive selector 62 is activated, the ON button 21 is selected on the control panel 20, and this selection is electronically communicated to the programmable processor control unit 30. Following activation of the programmable automatic docking system 10 by selecting the ON button 21, the programmable processor control unit 30 signals the bow distance, speed, and position transducer 46 to be activated. When the bow distance, speed, and position transducer 46 is activated, real-time distance and speed information is detected and wirelessly transmitted to the programmable processor control unit 30 distance and speed information of the bow 69 of the vessel 60 relative to an external object 70 (i.e., an environment such as a marina, another vessel, or a reef). In this embodiment, the programmable processor control unit 30 is in electronic communication with a plurality of actuators 53 that control the forward / reverse drive selector 62 to maintain the speed of the vessel 60 at a maximum speed of 5 knots. On the other hand, if an external object 70 is detected by bow distance transducer 46 immediately ahead of vessel 60 at a distance of 100 feet or less, distance and speed information is transmitted to processor control unit 30. Programmable processor control unit 30, which is in electronic communication with a plurality of actuators 53, then automatically controls the plurality of actuators 53 to engage main drive 62 to reduce forward speed at 0.06 knots per foot of travel and automatically avoid a collision by stopping vessel 60 at a default distance of 20 feet from external object 70. Programmable automatic docking system 10 maintains this final position relative to external object 70 until an operator assumes manual control of vessel 60.
[0032] 3 is a diagram illustrating the automatic slip operation of the programmable automatic docking system 10. In this embodiment, the slip position for the vessel 60 is described as follows: The dock is a fixed, flat structure that is above the waterline and in contact with the motionless water. The slip walkway is attached to the dock at approximately 90 degrees to the dock, extending above the water a distance necessary to accommodate vessels 60 of various lengths. There are typically two walkways 71, one on each side of the vessel 60, attached to the adjacent dock; this structure provides a safe, U-shaped location for the vessel to be docked, typically with the assistance of ropes.
[0033] A feature of the slip of the present invention is that it can operate in both a forward (forward) or reverse (aft) direction, as well as port or starboard. When the slip operates in reverse, the stern distance, speed, and position transducer 47 is engaged. In this embodiment, the control panel 20 further includes a slip forward button 64 and a slip reverse button 65; upon selection of either the slip forward button 64 or the slip reverse button 65, the programmable processor control unit 30 maintains the speed of the vessel 60 at approximately 2 knots and defaults to a 2-foot side clearance between the side of the vessel 60 and the port or starboard slip walkway 71.
[0034] In this embodiment, the slip operation of the present invention occurs as follows (the example below describes a forward starboard selection as shown in FIG. 3).
[0035] Once the vessel's bow 69 is in the slip, the operator selects the slip order button 64 on the control panel 20 .
[0036] Thereafter, the starboard button 67 on the control panel 20 is selected.
[0037] Following the operator's selection of the slip order button 64 and the starboard button 67, all subsequent operations are maintained and controlled by the programmable automatic docking system 10, ignoring further operator intervention.
[0038] In this embodiment (e.g., assuming the starboard button 67 is selected on the control panel 20), when the bow 69 of the vessel enters the slip, a pair of starboard transducers, i.e., a pair of distance sensing transducers 41S and 42S mounted on the starboard bow of the vessel 60 and a pair of distance sensing transducers 44S and 45S mounted on the starboard stern of the vessel 60, transmit a set of distance and speed information to the programmable processor control unit 30, where the set of distance and speed information relates to the distance between the starboard side of the vessel 60 and the slip walkway 71. In response to the distance and speed information detected and transmitted by the pair of starboard transducers (41S, 42S, 44S, 45S), the programmable processor control unit 30 engages the bow thruster 51 and the stern thruster 52 via electronic communications to maintain the starboard side of the vessel 60 at a default distance setting of approximately two feet between the vessel 60 and the slip walkway 71.
[0039] Operating simultaneously and independently, bow distance transducer 46 wirelessly transmits distance and speed information to programmable processor control unit 30 regarding bow 69 and dock 70, while distance and speed information is transmitted by a set of starboard transducers (41S, 42S, 44S, 45S). Programmable processor control unit 30 is further in electronic communication with and controls a plurality of actuators 53, which in turn control forward / reverse drive selector 62. Thus, vessel 60 automatically navigates to dock 70 and maintains a maximum speed of 2 knots until bow distance transducer 46 transmits to programmable processor control unit 30 a minimum distance of 3 feet between dock 70 and bow 69 of vessel 60. Once the vessel's bow 69 is 3 feet from the dock 70, the programmable processor control unit 30 controls the forward / reverse drive selector 62 to engage the multiple actuators 53 to stop the vessel 60 3 feet from the dock 70 and maintain this final position indefinitely while the programmable automatic docking system 10 is in operation.
[0040] 4 is a diagram illustrating floating buoy / mooring operation of the present invention, which involves the use of at least one bow distance, speed and position transducer 46 to sense the position, speed and distance of the floating buoy / mooring 73.
[0041] In this embodiment, floating buoy / mooring operations occur as follows.
[0042] The bow 69 of the vessel 60 is moved into approximate alignment with the floating buoy / mooring 73 up to 200 feet ahead of the bow 69 of the vessel 60. Once this approximate position is reached, the buoy button 68 is selected on the control panel 20. When the buoy button 68 is selected, the programmable processor control unit 30 wirelessly transmits to activate the bow distance, speed, and position transducer 46. When the bow distance transducer 46 is activated, the bow distance transducer 46 detects and transmits a set of distance, position, and speed information to the programmable processor control unit 30. The set of position information includes the distance and position of the bow 69 of the vessel 60 relative to the position of the floating buoy / mooring 73, along with the current speed of the vessel 60. Furthermore, the programmable processor control unit 30 remains in electronic communication with, and automatically engages, the plurality of actuators 53 that control the forward / reverse drive selector 62. The programmable processor control unit 30 maintains a maximum speed of the vessel 60 at approximately 2 knots and, in response to real-time information from the bow distance, speed, and position transducer, controls the bow thruster 51 via electronic communications to maintain the heading of the bow 69 of the vessel 60 toward the floating buoy / mooring 73. When the bow distance, speed, and position transducer 46 transmits a distance of 3 feet between the bow 69 of the vessel 60 and the floating buoy / mooring 73, the programmable processor control unit 30 activates the plurality of actuators 53, which in turn controls the forward / reverse drive selector 62 to stop the vessel 60 and the forward / reverse drive selector 62 and the bow thruster 51 to continue to maintain the bow 69 approximately 3 feet from the floating buoy / mooring 73 indefinitely until the off button 22 is selected on the control panel 20.
[0043] 5A-5C are flow charts illustrating one embodiment of a method of operation of the programmable automatic docking system 10 during a docking operation. In this embodiment, the vessel is assumed to be docked at an external object 70 on starboard, as shown in FIG.
[0044] First, in step 100A, the operator moves the vessel 60 and stops it adjacent to the external object 70, approximately 60 feet or less, with the vessel 60 parallel to the external object 70. Once the vessel 60 is stopped, the operator then selects the ON button 21 located on the control panel 20 in step 102A. Selection of the ON button 21 activates the programmable processor control unit 30 in step 104A. Following activation of the programmable processor control unit 30, in step 106A, a final desired distance between the starboard side of the vessel 60 and the external object 70 is preselected so that the programmable automatic docking system 10 will stop moving the vessel upon reaching the preselected position. In this embodiment, the preselected distance is entered into the control panel 20 by pressing the plus button 24 to increase the distance or the minus button 25 to decrease the distance, and the currently selected distance is displayed on the display 23. Once the final distance is selected, in step 108A, the port button 66 or the starboard button 67 is selected on the control panel 20 (in this embodiment, the starboard button 67 is selected). In step 110A, the programmable processor control unit 30 automatically sends signals to activate a pair of starboard transducers 40S and starboard lateral position transducers 43S, which include a pair of distance sensing transducers 41S and 42S mounted on the starboard bow of the vessel 60 and a pair of distance sensing transducers 44S and 45S mounted on the starboard stern of the vessel 60.
[0045] Following the activation of the pair of starboard transducers 40S, in step 112B, the programmable processor control unit 30 responds to a set of real-time distance and speed information transmitted from a pair of distance-sensing transducers 41S and 42S installed at the starboard bow of the vessel 60 by actuating the bow thruster 51 via electronic communication to move the vessel 60 in the starboard direction. Simultaneously, in step 114B, the programmable processor control unit 30 responds to a set of real-time distance and speed information transmitted from a pair of distance-sensing transducers 44S and 45S installed at the starboard stern of the vessel 60 by actuating the stern thruster 52 via electronic communication to move the vessel 60 in the starboard direction. In step 116B, the programmable processor control unit 30 automatically controls the bow thruster 51 and the stern thruster 52 to move the vessel 60 in the starboard direction toward the external object 70 at a rate of one foot every two seconds. Once the vessel 60 is within approximately 10 feet of the preselected final distance to the external object 70, in step 118B, the programmable processor control unit 30 communicates with the bow thruster 51 and stern thruster 52 to slow the vessel 60; for example, if the preselected final distance from the external object 70 is 5 feet, the vessel 60 will begin to slow its travel speed at 0.03 knots per foot at 15 feet from the external object 70. Then, in step 120B, upon reaching the preselected final position, the programmable processor control unit 30 engages the bow thruster 51 and stern thruster 52 to stop the vessel 60. Once the vessel 60 has reached the preselected final distance to the external object 70, in step 122B, the final preselected position is maintained indefinitely while the programmable automatic docking system 10 is in operation.
[0046] While the starboard transducers (41S, 42S, 44S, 45S) are operating and transmitting real-time distance and speed information to the programmable processor control unit 30 to move the vessel 60 in the starboard direction, the starboard lateral position transducer 43S operates independently of and simultaneously with the set of starboard transducers (41S, 42S, 44S, 45S) to detect and transmit the real-time lateral position of the vessel 60.
[0047] Thus, in step 112C, the starboard lateral position transducer 43S detects the lateral reference point of the external object 70 and wirelessly transmits this lateral reference point to the programmable processor control unit 30. In step 114C, the programmable processor control unit 30 stores the lateral reference point, after which any future lateral movements of the vessel 60 from the lateral reference point are processed. In step 116C, the programmable processor control unit 30 automatically compensates for any lateral movements of the vessel 60 by controlling the plurality of actuators 53 in response to the real-time lateral position information transmitted from the starboard lateral position transducer 43S. In step 118C, the plurality of actuators 53 engage the forward / reverse drive selector 62 to maintain the vessel 60 on a controlled lateral course toward the precise lateral reference point stored by the programmable processor control unit 30. In step 120C, once the vessel 60 reaches the final preselected position described in step 118C, the starboard lateral position transducer 43S continues to transmit real-time lateral position information of the vessel 60 relative to the precise lateral reference point stored in the programmable processor control unit 30, thereby maintaining the lateral position of the vessel 60 while the programmable automatic docking system 10 is in operation in step 122C.
[0048] 6 is a flow chart illustrating one embodiment of a method for operating the programmable automatic docking system during a collision avoidance maneuver between an external object and the vessel. Initially, in step 200, the operator of the vessel 60 engages the forward / reverse drive selector 62. In step 202, the ON button 21 on the control panel 20 is selected by the operator of the vessel 60. Following the selection of the ON button 21, in step 204, the programmable processor control unit 30 of the programmable automatic docking system 10 is activated. In step 206, the programmable processor control unit 30 transmits a signal to activate the bow distance, speed, and position transducer 46. In step 208, upon activation of the bow distance, speed, and position transducer 46, the bow distance, speed, and position transducer 46 detects and transmits real-time distance and speed information between the bow 69 of the vessel 60 and the external object 70. After transmitting the initial distance information, in step 210, the forward / reverse drive selector 62 is controlled via the plurality of actuators 53 in electronic communication with the programmable processor control unit 30. In step 212, the programmable processor control unit 30 controls the forward / reverse drive selector 62 to maintain the vessel 60 at a default speed of 5 knots. In step 214, the bow distance, speed, and position transducer 46 continues to transmit real-time distance information, and when an external object 70 is detected within 100 feet of the bow 69 of the vessel 60, the programmable processor control unit 30 electronically communicates with the plurality of actuators 53. In step 216, the plurality of actuators 53 controls the forward / reverse drive selector 62 to reduce the forward speed at 0.06 knots per foot, stopping the vessel 60 20 feet from the external object 70. Finally, in step 218, once the distance between the bow 69 of the vessel 60 and the external object 70 reaches 20 feet, the vessel 60 is maintained in that position indefinitely.On the other hand, if the bow distance, speed, and position transducer 46 does not detect an external object 70 within 100 feet of the vessel's bow 69 in step 218, the system returns to step 212 and continues to send real-time distance information from the bow distance, speed, and position transducer 46 to the programmable processor control unit 30.
[0049] 7A-7C are flowcharts illustrating one embodiment of a method of operation of a programmable automatic docking system during a vessel docking operation as the vessel's bow enters a slip, the flowchart illustrating the forward motion and starboard selection example shown previously in FIG. 3.
[0050] Initially, in step 300A, the system operator selects the slip order button 64 on the control panel 20. In step 302A, the programmable processor control unit 30 is activated to operate in slip order mode. In step 304A, the operator selects either the port button 66 or the starboard button 67 on the control panel 20 (for purposes of illustration, the starboard button 67 is selected below). In step 306A, the programmable processor control unit 30 automatically transmits to the simultaneously operating starboard transducers (41S, 42S, 44S, 45S) and the bow distance, speed, and position transducer 46. In step 308B, the bow distance, speed, and position transducer 46 transmits real-time distance and speed information between the vessel's bow 69 and the dock 70 to the programmable processor control unit 30. In step 310B, in response to receiving real-time distance and speed information from the bow distance, speed, and position transducer 46, the programmable processor control unit 30 communicates with the actuator 53 controlling the forward / reverse drive selector 62. In step 312B, the programmable processor control unit 30 communicates with the actuator controlling the forward / reverse drive control 62 to maintain the speed of the vessel 60 at the programmable processor control unit 30's default setting of 2 knots. In step 314B, when the bow distance, speed, and position transducer 46 transmits a distance of 3 feet between the vessel's bow 69 and the dock 70, the programmable processor control unit 30 controls the actuator 53 and the forward / reverse drive selector 62 to stop the vessel 60 at the default setting of 3 feet from the dock 70. In step 308C, the starboard distance sensing transducers (41S, 42S, 44S, 45S) transmit real-time distance information between the vessel 60 and the slipway 71 to the programmable processor control unit 30.At step 310C, the programmable processor control unit 30 engages the bow thruster 51 in response to the distance information from the forward transducers 41S and 42S, and at step 312C, simultaneously engages the stern thruster 52 in response to the distance information from the aft transducers 44S and 45S, maintaining a default distance of 2 feet between the vessel 60 and the slipway 71 at step 314C. At step 316C, the programmable processor control unit 30 maintains control of the bow thruster 51, stern thruster 52, actuator 53, and forward / reverse drive selector 62 to maintain the position of the vessel 60 indefinitely regardless of wind or current.
[0051] 8 is a flowchart illustrating a method of operating the programmable automatic docking system 10 during automatic positioning of a floating buoy and / or mooring relative to a vessel. Initially, in step 400, the operator of the programmable automatic docking system 10 maneuvers the bow 69 of the vessel 60 into approximate alignment with a floating buoy / mooring 73 immediately ahead of the vessel's bow 69 at a distance of approximately 200 feet or less. Once the vessel 60 is in approximate alignment, continuing in step 402, the operator selects the buoy button 68 on the control panel 20 to activate the programmable processor control unit 30 in buoy mode. In step 404, the programmable processor control unit 30 wirelessly transmits the bow's distance, speed, and position to the next active transducer 46. Following operation, in step 406, the bow distance, speed, and position transducer 46 detects and transmits real-time distance, position, and speed information to the programmable processor control unit 30 on the vessel's bow 69 relative to the floating buoy / mooring 73. In step 408, the programmable processor control unit 30 electronically communicates with the plurality of actuators 53 as it engages the forward / reverse drive selector 62 in step 410 to maintain a forward speed of the vessel 60 at a default speed of approximately 2 knots. Then, in step 412, the programmable processor control unit 30 communicates with the bow thruster 51 in response to the real-time distance and position information detected and transmitted by the bow distance, speed, and position transducer 46 to engage the bow thruster 51 to maintain the vessel on a direct course toward the floating buoy / mooring 73. In step 414, when the distance between the bow 69 of the vessel 60 and the floating buoy / mooring 73 is 3 feet, the vessel 60 is stopped in step 416 by the programmable processor control unit 30 which communicates with and engages a plurality of actuators 53 which control the forward / reverse drive selector 62 to maintain the vessel's position indefinitely.In step 418, so long as the programmable automatic docking system 10 is in operation, the plurality of actuators 53 controls the forward / reverse drive selector 62 and the programmable processor control unit 30, responsive to the bow distance, speed and position transducer 46, controls the bow thruster 51 to maintain the final position of the vessel 60.
[0052] 9A to 9C are flowcharts showing an operation method for departing the ship 60 from an automatically controlled external object 70 (in this embodiment, the ship 60 departs from the external object 70 on the starboard side).
[0053] First, in step 500A, the operator selects the on button 21 located on the control panel 20 to activate the programmable processor control unit in step 502A. Next, in step 504A, the operator selects the plus button 24 or minus button 25 on the control panel 20 to input the distance to move the vessel 60 away from the external object 70, and the selected distance is displayed on the display 23 on the control panel 20. Here, a distance of up to 60 feet can be selected. In step 506A, the operator selects the starboard button 67 on the control panel 20 to move the vessel 60 away from the starboard external object 70 (in another embodiment, to move away from the port external object 70, the port button 66 is selected). In step 508A, the programmable processor control unit 30 activates the set of starboard transducers 40S, including the starboard lateral position transducer 43S.
[0054] Following activation of the pair of starboard transducers 40S, in step 510B, the programmable processor control unit 30, in response to the set of real-time distance and speed information transmitted from the pair of bow-side distance-sensing transducers 41S and 42S mounted on the starboard bow of the vessel 60, activates the bow thruster 51 via electronic communications to move the vessel 60 a preselected distance away from the external object. Simultaneously, in step 512B, the programmable processor control unit 30, in response to the set of real-time distance and speed information transmitted from the pair of distance-sensing transducers 44S and 45S mounted on the starboard stern of the vessel 60, activates the stern thruster 52 via electronic communications to move the vessel 60 a preselected distance away from the external object 70. A set of starboard transducers (41S, 42S, 44S, 45S) detects and records a set of distance and speed information between the starboard side of the vessel 60 and the external object 70. In step 514B, the programmable processor control unit 30 controls the bow thruster 51 and the stern thruster 52 to move the vessel 60 to a preselected distance away from the external object 70 at a default speed of 1 foot every 2 seconds. In step 516B, if the vessel 60 is within approximately 10 feet of the preselected distance to the external object 70, the programmable processor control unit 30 communicates with the bow thruster 51 and the stern thruster 52 to slow the vessel 60's forward speed to 0.03 knots per foot; for example, if the preselected distance from the external object 70 is 50 feet, the vessel 60 will then slow down when 40 feet from the external object 70. Next, in step 518B, once the preselected final position is reached, the programmable processor control unit 30 engages the bow thruster 51 and stern thruster 52 to stop the vessel 60. Once the vessel 60 is within a preselected distance relative to the external object 70, in step 520B, the preselected position relative to the external object 70 is maintained while the programmable automatic docking system 10 is in operation.
[0055] While the set of starboard transducers (41S, 42S, 44S, 45S) is operational and transmits real-time distance and speed information to the programmable processor control unit 30 to move the vessel 60 a preselected distance away from the external object, the starboard lateral position transducer 43S operates independently of and simultaneously with the set of starboard transducers (41S, 42S, 44S, 45S) to detect and transmit the real-time lateral position of the vessel 60. Thus, upon activation of the starboard lateral position transducer 43S in step 510C, the starboard lateral position transducer 43S detects an accurate lateral reference point on the external object 70, and in step 512C the programmable processor control unit 30 stores this lateral reference point for processing any future lateral movements of the vessel 60 from that lateral reference point. In step 514C, the programmable processor control unit 30 automatically compensates for any lateral movement of the vessel 60 by controlling the plurality of actuators 53 in response to real-time lateral position information transmitted from the starboard lateral position transducer 43S. In step 516C, the plurality of actuators 53 engage the forward / reverse drive selector 62 to maintain the vessel 60 on a controlled lateral course relative to a precise lateral reference point stored by the programmable processor control unit 30.
[0056] Once the vessel 60 reaches a preselected distance away from the external object 70, in step 518C, the preselected position is maintained while the programmable automatic docking system 10 is in operation.
[0057] Although described above with respect to the use of programmable automatic docking systems, the methods and systems described herein may, in some embodiments, include other components to provide functionality that provides an automatic positioning system instead of or in addition to these systems.
[0058] The technologies described herein include capabilities for automated vessel-based positioning, collision-free path planning, and automated guidance operations. These technologies are integrated into vessels to provide target position, automated vessel approach, and position selection capabilities.
[0059] In this embodiment, the automatic positioning system includes mapping generated by a central processing unit (CPU) from data received via an optical feed from a vision ranging and infrared vision system, as well as from a high-precision inertial measurement unit (IMU), a global positioning system (GPS), and a central processing unit (CPU), to automatically position the vessel at a target position relative to an external object, including, for example, a dock or other external object. In some embodiments, the automatic positioning system automatically positions the vessel between two external objects regardless of wind and water currents. Once activated, the automatic positioning system operates fully automatically without a human operator by controlling the precise movement and position of the vessel relative to the external objects until the vessel reaches its final target position, after which the automatic positioning system maintains the vessel's final position regardless of wind and water currents while the system is in operation.
[0060] In some embodiments, the automated positioning system uses photographic and infrared area mapping of distance and speed information to provide feedback to a central processing unit, enabling multiple drive systems on the vessel to move the vessel at a controlled course and speed to a final target position relative to an external object.
[0061] Another feature of the embodiments of the automated positioning system disclosed herein is the ability to operate effectively and accurately in darkness and inclement weather without requiring or requiring a human operator to manually steer to a target position relative to an external object.
[0062] Yet another feature of the automatic positioning system is the ability to maintain the vessel's targeted position once it reaches a targeted location on the touch screen monitor relative to an external object, and to maintain that position indefinitely regardless of wind and currents while the positioning system is in operation.
[0063] Referring now to Figure 10A, Figure 10A is a schematic diagram illustrating one embodiment of an automatic positioning system of the present invention. In this embodiment, the system 1000 includes an integrated, interactive automatic positioning system that senses feedback of the vessel's position relative to the nearby environment, position, and speed, as well as automatic control of the vessel's movement, including speed and course, to a target position relative to external objects. Referring now to Figure 10B, this figure illustrates an embodiment of an automatic positioning system that automatically positions the stern of a vessel between two external objects.
[0064] The photographic and infrared system functions to continuously map the area surrounding the vessel and transmit real-time (or near real-time) distance, speed, and visual information between the vessel and the surrounding area to the central processing unit 1003 for use in automatically steering the vessel to a final target position (e.g., alongside an external object such as a dock 1004) and automatically maintaining that position.
[0065] System 1000 includes a vision ranging photograph system that generates at least one optical feed. Vision ranging photograph systems include vision systems for navigation that also provide depth information. Such systems include multiple cameras (e.g., two cameras per direction) mounted at fixed or variable positions, as will be understood by those skilled in the art.
[0066] The optical data (e.g., video) generated by the vision ranging and photography system is updated periodically. In one example, the optical data is continuously updated, allowing the system to provide a real-time or near-real-time updated view of an area via the optical feed. In such an embodiment, the system is said to include a live feed.
[0067] The vision ranging and photography system includes a photo optical / infrared day / night ranging sensor vision system 1002. The system 1000 includes at least one infrared vision system provided by the photo optical / infrared day / night ranging sensor vision system 1002. The photo optical / infrared day / night ranging sensor vision system 1002 includes one or more subcomponents. For example, the photo optical / infrared day / night ranging sensor vision system 1002 includes one or more night vision sensors to provide optical (including infrared) feed (e.g., without limitation, video) during nighttime or other low light or low visibility conditions. The vision ranging and photography system includes one or more cameras mounted at one or more locations on the vessel.
[0068] The system 1000 includes at least one ranger laser scanner 1008. In this embodiment, the at least one ranger laser scanner 1008 generates a point cloud representing depth information associated with objects in proximity to the at least one ranger laser scanner (and, by extension, in proximity to the vessel). As will be appreciated by those skilled in the art, such sensors are referred to as scanning range finders. As will be described in further detail below, the at least one ranger laser scanner 1008 has functionality for hazard detection. As will be appreciated by those skilled in the art, the one or more 270-degree laser scanners provide the functionality of a vision, ranging, and photography system, such as, by way of example, a ranging sensor of the type manufactured by Hokuyo Automatic Co., Ltd. of Osaka, Japan, or Velodyne LiDAR, Inc. of Morgan Hill, California.
[0069] System 1000 includes at least one inertial measurement unit (IMU). System 1000 includes at least one global positioning system (GPS) unit. The inertial measurement unit and the global positioning system unit may be provided as a single unit (IMU / GPS unit 1010). The inertial measurement unit and the global positioning system unit may also be provided as separate components.
[0070] The IMU provides acceleration information, for example, the IMU provides information (e.g., measurements) in the X, Y, and Z axes, such as the vessel's current angular velocity in X, Y, and Z coordinates. The central processing unit 103 applies a fusion algorithm to the measurements received from the IMU. As will be appreciated by those skilled in the art, the IMU may be provided by any form or type of inertial sensor, including, by way of example, inertial sensors manufactured by Robert Bosch GmbH of Germany.
[0071] The GPS provides the vessel's global coordinates, including, for example, longitude and altitude. The central processing unit 1003 uses the GPS data in conjunction with other received inputs when applying sensor fusion algorithms and generating the underlying mapping or overlays on the mapping. In some embodiments, using the GPS data results in improved accuracy of the position estimates the system uses to position the vessel. The GPS may be of any form or type, including, for example, GPS manufactured by SparkFun Electronics of Newot, Colorado, or Garmin International, Inc. of Olathe, Kansas.
[0072] The system 1000 includes a touchscreen control monitor 1007. The touchscreen control monitor 1007 communicates with a central processing unit 1003, which receives data from an optical feed for display to a user, for example. The touchscreen control monitor 1007 includes a capacitive touchscreen that allows a user to interact with a graphical user interface displayed by the touchscreen control monitor 1007 by touching the screen of the touchscreen control monitor 1007. The touchscreen monitor 1007 displays an overlay of the geometry of the environment surrounding the vessel, which is generated from data received via the optical feed from the vision system using optical ranging photography by a daytime, nighttime, all-weather infrared vision system, as well as a high-precision inertial measurement unit (IMU) and global positioning system (GPS) unit, over various distances, and by initiating various automatic functions via a central processing unit (CPU) 1003 designed to perform selected automatic functions in response to the acquired data. The touchscreen monitor 1007 provides functionality that allows the user to interact with the system, and as a result, the touchscreen monitor is referred to as an interactive touchscreen monitor.
[0073] The system 1000 comprises a propulsion system for the vessel 1001, including at least one thruster, at least one drive train, and at least one actuator. The at least one thruster is a bow thruster 1005A. The at least one thruster is a stern thruster 1005B. The at least one drive train is a main drive thruster (1006A, 1006B). The vessel includes a steering system 1012, including a rudder or mechanism for adjusting the variable direction of the thrust to control the vessel's course.
[0074] The system 1000 includes a central processing unit installed on the vessel and operably connected to at least one element of the propulsion system. The central processing unit 1003 is operable to receive at least one optical feed from a vision ranging and imaging system, the feed including data providing a mapping of the environment surrounding the vessel. The central processing unit 1003 receives the optical feed from the vision ranging and imaging system, for example, via a wired or wireless connection. The central processing unit 1003 receives multiple inputs from one or more sensors (e.g., from sensors forming part of the vision ranging system), including video data and LIDAR data, and the central processing unit 1003 uses these inputs to derive a map of the area surrounding the vessel. The central processing unit 1003 encodes the free and occupied areas of the map with the probability that an obstacle is detected in that particular area. For example, the central processing unit 1003 assigns a probability within a range (e.g., 0 to 255), where the higher the probability, the more likely the area contains an obstacle.
[0075] The central processing unit 1003 is operable to receive target position data from the touchscreen monitor. The target position data includes an identification of a target location where a user wants the automatic positioning system to dock the vessel. For example, the touchscreen monitor 1007 determines that the user has touched the touchscreen monitor 1007 at a particular point on the capacitive touchscreen. The central processing unit 1003 uses information identifying the location touched by the user (e.g., a point identified by an X, Y coordinate system) to identify a physical location relative to a mapping of the environment surrounding the vessel.
[0076] The central processing unit 1003 has the functionality to direct at least one element of the vessel's propulsion system to move the vessel to the target location using the mapping and target location data. This functionality provided by the central processing unit 1003 is referred to as an automatic positioning system.
[0077] In some embodiments, the methods and systems described herein generally relate to an automatic positioning system between a powered vessel and a dock or external object. The automatic positioning system incorporates a touchscreen interactive monitor that displays a geometric overlay of the environment surrounding the vessel via a live feed from a vision system that allows the vessel operator to select a target location on a touchscreen control monitor 1007.
[0078] The present invention is not limited in its application to the vessel size, vessel type, or construction details and component arrangements set forth in the following description.
[0079] 11A in conjunction with FIG. 10A-10B, a method 1100 of automatically moving a marine vessel by an automatic positioning system includes receiving, by a central processing unit, at least one optical feed from a vision ranging and photography system (1102) including data providing a mapping of an environment surrounding the marine vessel. The method 1100 includes displaying, by the central processing unit, on a touchscreen monitor (1104). The method 1100 includes receiving, by the central processing unit, target position data from the touchscreen monitor (1106). The method 1100 includes directing, by the central processing unit, at least one element of the marine vessel's propulsion system to move the marine vessel to the target position using the mapping (1108).
[0080] The method 1100 includes receiving (1102), by a central processing unit, at least one optical feed from a vision ranging and photography system, the optical feed including data providing a mapping of the environment surrounding the vessel. The central processing unit 1003 receives a plurality of images from the ranging and photography system, after which the central processing unit 1003 calculates a disparity level between each of the plurality of images, resulting in a point cloud representing distances to objects in the area surrounding the vessel. In this embodiment, the central processing unit 1003 generates the mapping using the received data. In other embodiments, the vision ranging and photography system is capable of generating a mapping from the visual data and providing the mapping to the central processing unit 1003.
[0081] The central processing unit 1003 receives at least one update of data providing a mapping of the environment surrounding the vessel via the optical feed, for example, the central processing unit 1003 receives a continuous stream of updates that the central processing unit 1003 uses to generate a continually updated mapping.
[0082] In some embodiments, the central processing unit 1003 receives data (e.g., sensor data and imaging data) related to the environment surrounding the vessel from multiple sources. For example, because the infrared vision system operates in low light or low or zero visibility conditions, the central processing unit receives transmitted data from the infrared vision system that includes a second mapping of the environment surrounding the vessel. The additional data is also provided in a continuous (e.g., continuously updated) stream. The additional data is also representative of a relationship between the vessel and target positions adjacent to external targets.
[0083] As another example of an embodiment in which the central processing unit 1003 receives optical data from multiple sources, the central processing unit 1003 receives information from one or more optical laser scanners 1008. An automated positioning system executed by the central processing unit 1003 uses the optical laser scanners 1008 to determine the proximity of the vessel 1001 to adjacent vessels, docks, and / or other obstacles 1004. For example, the optical laser scanner determines the distance between the vessel 1001 and the external object 1004 by sending out a laser beam and measuring the time-of-flight (TOF) of the reflected beam returning to the sensing unit. The scanner rotates 360° horizontally and several degrees vertically to provide many of these measurements, and based on the TOF, the distance is accurately calculated.
[0084] In some embodiments, the day and night vision system and optical photo scanner 1002 are visually recording the same environment while the automated location system receives data from the optical laser scanner 1008. The central processing unit 1003 uses the information it receives from the optical laser scanner 1008 and the day and night vision system and optical photo scanner 1002 to generate a visual representation of the data (e.g., displaying a "live" or substantially real-time video feed) on the touchscreen monitor 1007 for display to the operator.
[0085] In some embodiments, the central processing unit 1003 applies a sensor fusion algorithm to integrate inputs received from multiple sensors (e.g., sensors that form part of the optical laser scanner 1008, the day / night vision system, the optical photo scanner 1002, and any other data sources related to the environment surrounding the vessel). The result of such integration is a multidimensional array of measurements (referred to as a "point cloud"). In one of these embodiments, the sensor fusion algorithm uses different filters to combine the data received from the sensors (including the IMU and GPS) into a single map and filter out erroneous reflections (e.g., waves, water surfaces, etc.). For the creation of the occupancy grid map, in other embodiments, the method 1100 includes the application of probabilistic techniques and multi-resolution scan matching to complete a map useful for route planning.
[0086] 11A , method 1100 includes displaying (1104), by a central processing unit, a mapping of the environment on a touchscreen monitor. The central processing unit 1003 forwards the mapping, or the optical feed data, or both, to the touchscreen monitor 1007. The touchscreen monitor 1007 displays the mapping of the environment (e.g., to an operator of the vessel 1001). The central processing unit 1003 uses data received via the vision system's optical feed to generate an overlay of the geometry of the environment surrounding the vessel 1001 for display by the touchscreen monitor 1007. The touchscreen monitor 1007 displays the surrounding environment relative to the vessel and target locations adjacent to external objects. In embodiments in which the central processing unit 1003 receives optical data from multiple sources (e.g., from an infrared vision system and other sources), the touchscreen monitor 1007 similarly displays the output received from each of the other multiple sources (e.g., as an overlay on the initial mapping). In embodiments in which central processing unit 1003 receives the second mapping, touchscreen monitor 1007 similarly displays the second mapping.
[0087] The method 1100 includes receiving (1106), by a central processing unit, target position data from a touchscreen monitor. The touchscreen monitor 1007 generates a graphical user interface and allows an operator to interactively specify a target position for the vessel 1001 by touching user interface elements displayed in the graphical user interface, where the user interface elements are positioned corresponding to the target position or otherwise indicate the target position. Touchscreen technology allows for intuitive, versatile, and simpler input for specifying the target position for the vessel 1001. For example, the touchscreen monitor 1007 displays a continuously updated video of an area surrounding the vessel 1001 (e.g., including any docks or other external objects 1004), and the operator touches the screen at a location within the video display where the operator wants to position the vessel 1001. This location may be relative to a single external object (e.g., a dock) or multiple external objects (e.g., a slip between two portions of a dock or between two other vessels). The method 1100 derives target position data from the location of the operator touch.
[0088] The target position data specifies a location adjacent to the external object. The target position data includes an identification of a target position of the vessel, the target position being between two aft external objects.
[0089] When the above location is targeted on the touchscreen monitor 1007, the optical feed of the vision ranging and infrared vision system maps the surrounding environment aft of the vessel and sends data to the central processing unit 1003 to render a mapping on the touchscreen monitor 1007 showing the surrounding environment aft of the vessel and the target location between one or more external objects. In this embodiment, when the target location is entered on the touchscreen monitor 1007, the central processing unit 1003 engages two 270 degree ranging laser scanners which transmit surrounding environment information back to the central processing unit 1003. The central processing unit 1003 updates the previously generated point cloud as it receives additional sensor input from the cameras.
[0090] In this embodiment, the central processing unit 1003 validates the target locations identified in the target location data to ensure that the target locations are large enough to accommodate the vessel. For example, the automated positioning system calculates one or more dimensions of the target location that confirm that the target location area is large enough to accommodate the vessel's dimensions. The central processing unit 1003 validates the operator's input and matches the input to the mapping generated by the optical ranging sensor 1002.
[0091] The method 1100 includes directing (1108), by the central processing unit, at least one element of the vessel's propulsion system using the mapping to move the vessel to the target location. Upon receiving the target location data from the touchscreen monitor 1007, the central processing unit 1003 automatically provides at least one element of the vessel's propulsion system, i.e., a course to the selected target location. Upon receiving the target location data from the touchscreen monitor 1007, the central processing unit 1003 automatically controls at least one steering system of the vessel to move the vessel to the target location. Upon receiving the target position data from the touchscreen monitor 1007, the central processing unit 1003 automatically controls at least one drive system of the vessel 1001 to steer the vessel 1001 into the target position and activate thrusters 1005A and 1005B and main drive thrusters 1006A and 1006B, while controlling the vessel's steering system, as required to move the vessel 1001 on the fastest possible controlled path to the target position, as described in more detail below.
[0092] 11B is a flow chart illustrating one embodiment of a method 1150 for determining a course. The central processing unit 1003 updates the mapping and any overlays before determining a course. The central processing unit 1003 determines the position of the vessel (e.g., relative to a target location). Position information for the vessel 1001 is constantly transferred (e.g., from a GPS) to the central processing unit 1003, which responds by controlling the vessel's steering system if required to maintain the vessel's course to a selected target location on the interactive monitor, and the central processing unit 1003 receives periodic updates of the position information. The central processing unit 1003 performs one or more updates to incorporate any obstacle-related data and then calculates one or more routes. In this embodiment, to detect the position of the vessel 1001, the central processing unit 1003 receives a GPS position and scans of the area surrounding the vessel 1001 (e.g., from the photo vision systems 1002 and 1008), and the central processing unit 1003 calculates the travel distance and angle to an obstacle (e.g., the nearest obstacle) and generates a mapping of the desired stopping position relative to the position (x position, y position, associated angle) of the vessel 1001.
[0093] As shown in FIG. 11B, method 1150 includes merging (1152) scans (e.g., data from one or more scanning systems, GPS, and / or IMU). This merging results in the generation or update of a 3D point cloud (e.g., including a 3D point cloud coordinate transformation) by the central processing unit 1003. Method 1150 includes refining (1154) the 3D point cloud, including rejecting outliers and extracting regions of interest, which includes another 3D point cloud coordinate transformation. Method 1150 includes generating (1156) a 2D scan projection, including a 2D scan coordinate transformation. Method 1150 also includes performing (1158) a SLAM (e.g., simultaneous localization and mapping) update, including generating a 3D pose occupancy grid and incorporating GPS pose data (including, without limitation, latitude, longitude, and altitude). Fusing data from GPS with data from other sensors improves accuracy. The method 1150 includes calculating (1160) a safe area to navigate incorporating data related to a model of the vessel's hull, which includes generating a 3D pose cost map. The method 1150 includes calculating (1162) a global path and a local path, which includes generating or updating the 3D pose cost map. The method 1150 includes executing (1164) the path and updating the local path.
[0094] Returning to FIG. 11A , the central processing unit 1003 calculates a path of vessel movement that incorporates information about one or more obstacles detected by the LIDAR hazard detection and avoidance system. The central processing unit 1003 engages at least one stern Ranger laser scanner and receives data including at least one of distance, speed, and dimensional area information from at least one stern Ranger laser scanner 1008. The automatic location and positioning system includes a light detection and ranging (LIDAR) hazard detection and avoidance system that uses input from at least one stern Ranger laser scanner 1008. In this embodiment, the LIDAR hazard detection and avoidance system performs data fusion on sensor-level data. For example, the LIDAR hazard detection and avoidance system uses navigation motion states to reconstruct point clouds acquired from a scanning LIDAR unit (e.g., as part of a vision ranging and photography system) that corrects images for motion compensation using IMU data acquired from successive LIDAR images, achieving high accuracy and resolution maps while enabling relative positioning. In another embodiment, the LIDAR hazard detection and avoidance system performs data fusion on decision-level data (e.g., fusing hazard maps from multiple sensors into a single image space at a single grid orientation and spacing).
[0095] After determining the position of the vessel 1001 and calculating at least one path, the central processing unit 1003 calculates the required directional torque values for each individual thruster on board the vessel 1001. The required force and torque at time t are calculated, controlled by a PID algorithm, based on the following equations: TIFF2025124792000002.tif17130η=position, v=velocity
[0096] The vessel 1001 position required for the control algorithm is calculated from acquired sensor data based on GPS 1010 information provided by the GPS 1010 device. The PID parameters are collected during the initial teach-in of the system, which is part of the initial installation procedure for this system.
[0097] The total amount of force in the required direction is then allocated to the individual thrusters 1005A and 1005B due to the fact that each thruster has different timing behavior as well as maximum possible force limits. The goal of this part of the algorithm is to keep all thrusters 1005A and 1005B within their optimal operating ranges. The next optimization is calculated as follows: TIFF2025124792000003.tif38130
[0098] Propeller 1006A and propeller 1006B are the main drive thrusters (providing thrust in the bow and stern directions mounted at the stern position of vessel 1001, and are referred to as (-ly1, -ly2) in the optimization equations above). Bow thruster 1005A and stern thruster 1005B are lateral movement thrusters mounted at the (bow) and (stern) positions of vessel 1001, and are referred to as (-lx3 and -lx4) in the optimization equations. They are responsible for generating thrust in the lateral direction. The values calculated in this step are limited to ensure that the values are within the specifications of the thrusters used, ensuring stable control operation.
[0099] In some embodiments, based on the location position of the vessel 1001, the central processing unit 1003 determines at least one directional torque and required torque per drive of the vessel 1001. Based on the location position of the vessel 1001, the central processing unit 1003 generates actuator 1011 signals for at least one individual drive. The central processing unit 1003 evaluates the movement of the vessel 1001.
[0100] The central processing unit is responsible for the thrusters of the vessel 1001. The central processing unit can be responsible for the drive train of the vessel 1001. The central processing unit 1003 determines to engage multiple elements of the vessel's propulsion system substantially simultaneously. For example, the central processing unit 1003 may engage the drive train and thrusters to automatically move the vessel to a target position preselected on the touch screen monitor for a final position between two external objects.
[0101] The central processing unit determines instructions to provide to at least one element in response to the received mapping, for example, the central processing unit (CPU) 1003 sends signals representing a desired rudder angle or thrust angle to a responsive steering control system to achieve movement of the vessel along a desired course to a target location selected on the interactive monitor.
[0102] In some embodiments, during the movement of the vessel 1001 and when the vessel 1001 is positioned at its final position, the central processing unit 1003 continuously evaluates sensor data received from the optical sensor 1002, as well as from a high-precision inertial measurement unit (IMU) and global positioning system (GPS) unit 1010. In this embodiment, the central processing unit 1003 directs at least one element of the vessel's propulsion system to maintain the vessel's position at the target position. For example, upon reaching the final position, the central processing unit 1003 operates one or more actuators 1011 required to control all of the propulsion system to maintain the vessel's 1001 position.
[0103] Manual intervention during automatic operation results in immediate disengagement of the automatic system. When the central processing unit 1003 detects that a human operator has manually interfered with the operation of the vessel, the central processing unit 1003 disengages the automatic positioning system based on the detection of the manual interference.
[0104] The automatic location system operates independently without the use or need for any human operator at the initiation of the automatic location system.
[0105] 12A and 12B show block diagrams of a computing device 1200 useful for implementing embodiments of a CPU. As shown in FIGS. 12A and 12B, computing device 1200 includes a central processing unit 1221 and a main memory unit 1222. As shown in FIG. 12A, computing device 1200 also includes a storage device 1228, an installation device 1216, a network interface 1218, an I / O controller 1223, display devices (1224a-1224n), a keyboard 1226, a pointing device 1227, such as a mouse, and one or more other I / O devices (1230a-1230n). Storage device 1228 includes, but is not limited to, an operating system and software. As shown in FIG. 12B, each computing device 1200 includes additional optional elements such as a memory port 1203, a bridge 1270, one or more I / O devices (1230a-1230n) (generally referred to using reference numeral 1230), and a cache memory 1240 in communication with a central processing unit 1221.
[0106] Central processing unit 1221 is any logic circuitry that processes instructions in response to instructions fetched from main memory unit 1222. In many embodiments, central processing unit 1221 is provided by a microprocessor unit, such as a microprocessor unit manufactured by Intel Corporation of Mountain View, California, a microprocessor unit manufactured by Motorola Corporation of Schaumburg, Illinois, a microprocessor unit manufactured by International Business Machines of White Plains, New York, or a microprocessor unit manufactured by Advanced Micro Devices of Sunnyvale, California. Computing device 1200 may be based on any of these processors or any other processor capable of operating as described herein.
[0107] The main memory unit 1222 is comprised of one or more memory chips that store data and have any storage location directly accessible by the microprocessor 1221. The main memory 1222 may be comprised of any available memory chips capable of operating as described herein. In the embodiment shown in FIG. 12A, the processor 1221 communicates with the main memory 1222 via a system bus 1250. FIG. 12B illustrates an embodiment of a computing device 1200 in which the processor communicates directly with the main memory 1222 via a memory port 1203. FIG. 12B illustrates an embodiment in which the cache memory 1240 and the main processor 1221 communicate directly via a secondary bus referred to as a backside bus. In another embodiment, the main processor 1221 communicates with the cache memory 1240 using the system bus 1250.
[0108] In the embodiment shown in Figure 12A, the processor 1221 communicates with various I / O devices 1230 via a local system bus 1250. The central processing unit 1221 may be connected to any of the I / O devices 1230 using a variety of buses, including an ISA bus, an EISA bus, a PCI bus, a PCI-X bus, or a PCI-Express bus. In an embodiment in which the I / O device is a video display 1224, the processor 1221 communicates with the display 1224 using an Advanced Graphics Port (AGP). Figure 12B shows an embodiment of a computer 1200 in which the main processor 1221 communicates directly with an I / O device 1230b, for example, via HYPERTRANSPORT, RAPIDIO, or INFINIBAND communications technologies.
[0109] A wide variety of I / O devices (1230a-1230n) are present on computing device 1200. Input devices include keyboards, mice, trackpads, trackballs, microphones, scanners, cameras, and drawing tablets. Output devices include video displays, speakers, inkjet printers, laser printers, and dye-sublimation printers. The I / O devices are controlled by I / O controller 1223, as shown in FIG. 12A. Additionally, the I / O devices provide storage and / or installation media 1216 for computing device 1200. In some embodiments, computing device 1200 provides a USB connection (not shown) to receive a handheld USB storage device, such as the USB flash drive line of devices manufactured by Twintech Industry, Inc. of Los Alamitos, California.
[0110] 12A, computing device 1200 supports any suitable installation device 1216, such as a CD-ROM drive, a CD-R / RW drive, a DVD-ROM drive, tape drives of various formats, a USB device, a hard drive, or any other device suitable for installing software and programs. Computing device 1200 further includes a storage device, such as one or more hard disk drives or a redundant array of independent disks, for storing an operating system and other software.
[0111] Computing device 1200 further includes a network interface 1218 for interfacing to a network connection to one or more other computing devices (not shown) via various connections, including, but not limited to, a standard telephone line, a LAN or WAN link (e.g., 802.11, T1, T3, 56kb, X.25, SNA, DECNET), a broadband connection (e.g., ISDN, Frame Relay, ATM, Gigabit Ethernet, Ethernet over SONET), a wireless connection, or some combination of any or all of the above. Connections may be established using a variety of communication protocols (e.g., TCP / IP, IPX, SPX, NetBIOS, Ethernet, ARCNET, SONET, SDH, Fiber Distributed Data Interface (FDDI), RS232, IEEE 802.11, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, IEEE 802.15.4, Bluetooth, ZIGBEE, CDMA, GSM, WiMax, and direct asynchronous connections). In this embodiment, computing device 1200 communicates with other computing devices via any type and / or form of gateway or tunneling protocol, such as Secure Sockets Layer (SSL) or Transport Layer Security (TLS). Network interface 1218 includes a built-in network adapter, a network interface card, a PCMCIA network card, a card bus network adapter, a wireless network adapter, a USB network adapter, a modem, or any other device suitable for interfacing computing device 1200 to any type of network over which it can communicate and for performing the operations described herein.
[0112] Any of the I / O devices (1230a-1230n) and / or I / O controller 1223 may include any type and / or form of suitable hardware, software, or combination of hardware and software to support, enable, or provide for the connection and use of multiple display devices (1224a-1224n) by computing device 1200. Those skilled in the art will recognize and understand the various ways and embodiments in which computing device 1200 may be configured to include multiple display devices (1224a-1224n).
[0113] In a further embodiment, I / O device 1230 is a bridge between system bus 1250 and an external communications bus, such as a USB bus, an Apple® Desktop Bus, an RS-232 serial connection, a SCSI bus, a FireWire bus, a FireWire 800 bus, an Ethernet bus, an AppleTalk® bus, a Gigabit Ethernet® bus, an Asynchronous Transfer Mode bus, a HIPPI bus, a Super HIPPI bus, a SerialPlus bus, an SCI / LAMP bus, a Fibre Channel bus, or a Serial Attached Small Computer System Interface bus.
[0114] 12A and 12B typically operate under the control of an operating system, which controls the scheduling of tasks and access to system resources. Computing device 1200 may run any operating system capable of running on a computing device and performing the operations described herein, such as any version of the Microsoft Windows operating system, different releases of Unix and Linux operating systems, any version of MAC OS for Macintosh computers, any embedded operating system, any real-time operating system, any open source operating system, any proprietary operating system, any operating system for a mobile computing device, or any other operating system.Exemplary operating systems include, but are not limited to, WINDOWS® 3.x, WINDOWS® 95, WINDOWS® 98, WINDOWS® 2000, WINDOWS® NT 3.51, WINDOWS® NT 4.0, WINDOWS® CE, WINDOWS® XP, WINDOWS® 7, WINDOWS® 8, WINDOWS® 10, and WINDOWS® VISTA, among others, manufactured by Microsoft® Corporation of Redmond, Washington; MAC OS®, manufactured by Apple® Inc. of Cupertino, California; Red Hat Enterprise LINUX®, a Linus-variant operating system distributed by Red Hat, Inc. of Raleigh, North Carolina; or Ubuntu®, a freely available operating system distributed by Canonical Ltd. of London, England; or any type and / or form of UNIX operating system.
[0115] The computing device 1200 has been modified to address challenges that arise in a marine environment, including addressing conditions including increased risk of shock or vibration, or the need to provide additional cooling or power systems that are isolated from the vessel's main power system.
[0116] Computing device 1200 may be any workstation, desktop computer, laptop or notebook computer, server, portable computer, mobile phone or other portable telecommunications device, media playback device, gaming system, mobile computing device, or any other type and / or form of communications-capable computing, telecommunications, or media device having sufficient processing power and memory capacity to perform the operations described herein.
[0117] In this regard, before describing at least one embodiment of the present invention in detail, it is to be understood that the present invention is not limited in its application to the arrangement of components set forth in the following description or illustrated in the drawings. The present invention is capable of other embodiments and of being practiced and carried out in various ways, including for applications involving other forms of mobile vehicles. Additionally, the phraseology and terminology used herein is for purposes of explanation and not limitation.
[0118] The above description is merely illustrative and does not limit the present invention, and various modifications can be made without departing from the scope of the present invention. [Explanation of symbols]
[0119] 10 Programmable Automatic Berthing System 20 Control Panel 21 On button 22 Off button 23 Display 24 Plus button 25 Minus button 30 Programmable Processor Control Unit 40P port side transducer 40S starboard transducer 41P, 42P, 44P, 45P, 41S, 42S, 44S, 45S (distance sensing) transducers 43P Port Side Lateral Position Transducer 43S Starboard Lateral Position Transducer 46 Heading (distance, speed, and position) transducer (heading distance transducer) 47 Stern (distance, speed, and position) transducer 51, 1005A Bow Thruster 52, 1005B Stern Thruster 53 Actuator 60, 1001 ships 62 Forward / reverse drive selector (main drive) 63 Main drive propeller 64 Slip order button 65 Slip Reverse Button 66 Port Button 67 Starboard button 68 V Button 69 Bow 70, 1004 External objects (docks, obstacles) 71 Slip Sidewalk 72 Stern 73 Floating Buoys / Moorings 1000 systems 1002 Photographic / Infrared Day / Night Ranging Sensor Vision System (Day / Night Vision System and Optical Photo Scanner) 1003, 1221 Central Processing Unit (CPU) 1006A, 1006B Main driving thrust 1007 Touchscreen (control) monitor 1008 (Ranger Laser Scanner) Optical Laser Scanner 1010 IMU / GPS unit 1011 Actuator 1012 Steering system 1200 computing devices 1203 memory port 1216 Install Device 1218 Network Interface 1221 Processor (Central Processing Unit) 1222 Main Memory Unit 1223 I / O Controller 1224 video display 1224a~1224n Display device 1226 keyboard 1227 Pointing Device 1228 Storage Devices 1230, 1230a~1230n I / O devices 1240 cache memory 1250 (local) system bus 1270 Bridge
Claims
1. 1. A method of automatically navigating a vessel to a lateral position adjacent to a stored lateral reference point on an external object, comprising: generating an optical feed with a vision ranging and photography system; sensing a sensed lateral reference point on said external object using at least one transducer; sending information indicative of the sensed lateral reference point on the external object to a processor control unit; In the processor control unit: receiving the optical feed from the vision ranging and photography system; deriving a map of an area surrounding the vessel from the optical feed; displaying the map of the area surrounding the vessel on an interactive monitor; receiving target position data from the interactive monitor indicating the stored lateral reference points; receiving the information indicative of the sensed lateral reference point on the external object; storing the information indicative of the sensed lateral reference point on the external object as stored lateral reference point information, whereby the stored lateral reference point is the same point as the sensed lateral reference point; displaying on the interactive monitor the map of the area surrounding the vessel including the stored lateral reference points; orienting a propulsion system of the marine vessel to automatically navigate the marine vessel to the lateral position adjacent the stored lateral reference point on the external object; and orienting a propulsion system of the vessel to automatically stop the vessel at the lateral position adjacent the stored lateral reference point on the external object.
2. 2. The method of claim 1, further comprising the step of: in the processor control unit, orienting a propulsion system of the vessel to automatically maintain the vessel at the lateral position adjacent the stored lateral reference point on the external object.
3. 10. The method of claim 1, wherein the interactive monitor comprises a touchscreen monitor.
4. 10. The method of claim 1, wherein the vision ranging and photography system includes at least one sensor, and generating the optical feed includes generating the optical feed using the at least one sensor.
5. The method of claim 4 , wherein the at least one sensor includes at least one LIDAR sensor.
6. 10. The method of claim 1, wherein the vision ranging and photography system includes at least one video sensor, and generating the optical feed includes generating the optical feed using the at least one video sensor.
7. the target position data includes data for selecting one of port, starboard, forward, and aft docking directions; 2. The method of claim 1, wherein orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object comprises orienting a propulsion system of the vessel to automatically navigate the vessel in the selected direction.
8. the target position data includes data for selecting one of port, starboard, stern, and bow docking directions; 2. The method of claim 1, wherein orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object comprises orienting a propulsion system of the vessel to automatically navigate the vessel in the selected direction.
9. the target position data includes data for selecting one of the port side and the starboard side, 2. The method of claim 1, wherein orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object comprises orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object on a selected side of the vessel.
10. The target position data is Data for selecting one of port, starboard, forward, and aft docking directions; and data for selecting either the port side or the starboard side; 2. The method of claim 1, wherein orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object comprises orienting a propulsion system of the vessel to automatically navigate the vessel in the selected direction to the lateral position adjacent the stored lateral reference point on the external object on the selected side of the vessel.
11. orienting a propulsion system of the marine vessel to automatically navigate the marine vessel to the lateral position adjacent the stored lateral reference point on the external object comprises automatically moving the marine vessel at a controlled speed to the lateral position adjacent the stored lateral reference point on the external object; The moving step includes: sensing the position of the vessel relative to the external object; receiving, by the processor control unit, a set of distance, position, and velocity information in real time regarding distance, position, and velocity between the vessel and the lateral position adjacent the stored lateral reference point on the external object; and 2. The method of claim 1, further comprising the step of automatically controlling, by the processor control unit, the propulsion system of the vessel to navigate the vessel at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object.
12. 12. The method of claim 11, wherein automatically controlling the propulsion system includes automatically controlling, by the processor control unit, the propulsion system of the marine vessel to navigate at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object in real time.
13. 12. The method of claim 11, wherein stopping the vessel at the lateral position adjacent the stored lateral reference point on the external object includes automatically engaging, in the processor control unit, the propulsion system to reduce the controlled velocity and stop the vessel at the lateral position adjacent the stored lateral reference point on the external object.
14. 10. The method of claim 1, further comprising the step of automatically engaging, in the processor control unit, the propulsion system to maintain the vessel in the lateral position adjacent the stored lateral reference point on the external object.
15. automatically controlling, by the processor control unit, the propulsion system of the marine vessel to navigate the marine vessel at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object, calculating, in said processor control unit, a path of movement for said vessel incorporating information about at least one obstacle detected by a hazard detection and avoidance system; determining, by the processor control unit, a required directional force to be applied to the marine vessel's propulsion system based on the marine vessel's current position relative to the external object; and 12. The method of claim 11, including the step of engaging, in the processor control unit, the propulsion system to perform collision-free path planning and automatic guidance maneuvers to guide the marine vessel to the lateral position adjacent the stored lateral reference point on the external object.
16. 1. A system for automatically navigating a vessel to a lateral position adjacent to a stored lateral reference point on an external object, comprising: a processor control unit, the processor control unit comprising: Receives optical feed from the vision ranging and photography system, deriving a map of an area surrounding the vessel from the optical feed; displaying the map of the area surrounding the vessel on an interactive monitor; receiving target position data from the interactive monitor indicative of the stored lateral reference points; receiving information from at least one transducer indicative of a sensed lateral reference point on the external object; storing the information indicating the sensed lateral reference point on the external object as stored lateral reference point information, whereby the stored lateral reference point is the same point as the sensed lateral reference point; displaying on the interactive monitor the map of the area surrounding the vessel including the stored lateral reference points; orienting a propulsion system of the marine vessel to automatically navigate the marine vessel to the lateral position adjacent the stored lateral reference point on the external object; and 10. A system configured to orient a propulsion system of the vessel to automatically stop the vessel at the lateral position adjacent the stored lateral reference point on the external object.
17. The processor control unit further comprises:
17. The system of claim 16, configured to orient a propulsion system of the vessel to automatically maintain the vessel in the lateral position adjacent the stored lateral reference point on the external object.
18. 17. The system of claim 16, wherein the vision ranging and photography system includes at least one sensor, and generating the optical feed in the vision ranging and photography system includes generating the optical feed using the at least one sensor.
19. 20. The system of claim 18, wherein the at least one sensor includes at least one LIDAR sensor.
20. 17. The system of claim 16, wherein the vision ranging and photography system includes at least one video sensor, and generating the optical feed includes generating the optical feed using the at least one video sensor.
21. the target position data includes data for selecting one of port, starboard, forward, and aft docking directions; 17. The system of claim 16, wherein the processor control unit is configured to orient a propulsion system of the vessel to automatically navigate the vessel in the selected direction as part of orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object.
22. the target position data includes data for selecting one of a port, starboard, stern, and bow docking direction; 17. The system of claim 16, wherein the processor control unit is configured to orient a propulsion system of the vessel to automatically navigate the vessel in the selected direction as part of orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object.
23. the target position data includes data for selecting one of the port side and the starboard side, 17. The system of claim 16, wherein the processor control unit is configured to orient a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object on a selected side of the vessel as part of orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object.
24. The target position data is Data for selecting one of port, starboard, forward, and aft docking directions; and data for selecting either the port side or the starboard side; 17. The system of claim 16, wherein the processor control unit is configured to orient a propulsion system of the vessel to automatically navigate the vessel in the selected direction to the lateral position adjacent the stored lateral reference point on the external object on a selected side of the vessel as part of orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object.
25. The processor control unit is configured to automatically move the vessel at a controlled speed to the lateral position adjacent the stored lateral reference point on the external object as part of orienting a propulsion system of the vessel to automatically navigate the vessel to the lateral position adjacent the stored lateral reference point on the external object, the movement comprising: sensing the position of the vessel relative to the external object; receiving, by the processor control unit, a set of distance, position, and velocity information in real time regarding distance, position, and velocity between the vessel and the lateral position adjacent the stored lateral reference point on the external object; 17. The system of claim 16, further comprising automatically controlling, by the processor control unit, the propulsion system of the vessel to navigate the vessel at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object.
26. 26. The system of claim 25, wherein automatically controlling the propulsion system includes automatically controlling, by the processor control unit, the propulsion system of the vessel to navigate the vessel at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object in real time.
27. 26. The system of claim 25, wherein stopping the vessel at the lateral position adjacent the stored lateral reference point on the external object includes, in the processor control unit, automatically engaging the propulsion system to reduce the controlled velocity and stop the vessel at the lateral position adjacent the stored lateral reference point on the external object.
28. 17. The system of claim 16, wherein the processor control unit is further configured to automatically engage the propulsion system to maintain the vessel in the lateral position adjacent the stored lateral reference point on the external object.
29. The processor control unit, as part of automatically controlling the propulsion system of the marine vessel to navigate the marine vessel at the controlled speed to the lateral position adjacent the stored lateral reference point on the external object. calculating, in the processor control unit, a path of movement for the vessel incorporating information regarding at least one obstacle detected by a hazard detection and avoidance system; determining, by the processor control unit, a required directional force to be applied to a propulsion system of the marine vessel based on a current position of the marine vessel relative to the external object; 26. The system of claim 25, wherein the processor control unit is configured to engage the propulsion system to perform collision-free path planning and automatic guidance maneuvers to guide the marine vessel to the lateral position adjacent the stored lateral reference point on the external object.
30. The system of claim 16 further comprising the interactive monitor.
31. 31. The system of claim 30, wherein the interactive monitor comprises a touchscreen monitor.
32. The system of claim 16 , further comprising the vision ranging and imaging system, the vision ranging and imaging system configured to generate the optical feed.
33. The method further includes the at least one transducer, wherein the at least one transducer comprises: sensing the sensed lateral reference point on the external object; and The system of claim 16 , further configured to transmit the information indicative of the sensed lateral reference point on the external object to the processor control unit.
34. further comprising the interactive monitor, the vision ranging and photography system, and the at least one transducer; the vision ranging and imaging system is configured to generate the optical feed; The at least one transducer comprises: sensing the sensed lateral reference point on the external object; and 17. The system of claim 16, configured to transmit the information indicative of the sensed lateral reference point on the external object to the processor control unit.
Citation Information
Patent Citations
Automatic positioning arrangement system
JP2023156443A
Automatic Positioning System
JP6925363B2
Automatic Positioning System
JP7258062B2
Automatic Positioning System
JP7596412B2