Ship operation management system and ship operation management program

Abstract

To provide a remote maneuvering system, a ship operation management system, a remote maneuvering program, and a ship operation management program for enabling remote maneuvering of different ships.SOLUTION: An operation management device 3 displays a VR operation management center in a manager terminal 5 of an operation manager O and remote maneuvering devices 2A-2C of remote maneuvering persons Rc1-Rc3, and displays ship information of ships S1-S3 in the VR operation management center. The operation management device 3 allocates the remote maneuvering persons Rc1-Rc3 to the ships S1-S3. The remote maneuvering devices 2A-2C of the remote maneuvering persons Rc1-Rc3 to which the ships are allocated display a VR pilothouse. The remote maneuvering persons Rc1-Rc3 remotely maneuver the ships S1-S3 with the use of the VR pilothouse.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a remote control system and a remote control program for remotely controlling a ship capable of remote control, and a ship operation management system and a ship operation management program for managing the operation of a ship capable of remote control.

Background Art

[0002] A remote control system that can perform remote control from a location away from the ship without boarding the ship has been disclosed (for example, see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional remote control system for ships, since one remote control device is provided for one ship, it is not possible to control other ships with the remote control device.

[0005] Therefore, an object of the present invention is to provide a remote control system, a ship operation management system, a remote control program, and a ship operation management program capable of remotely controlling different ships.

Means for Solving the Problems

[0007] To solve the above problems, The invention according to claim 1 is a ship operation management system for managing the operations of a plurality of ships capable of remote control, comprising an administrator terminal operated by an operation manager of the ship, at least one remote control device operated by a remote operator of the ship, and the management person's endA ship operation management system comprising: a ship operation management device that manages the operation of the ship in accordance with the operation of the ship, wherein the ship operation management device comprises: a ship assignment means that assigns the remote operator to the ship; and a VR operation management center display means that displays a VR operation management center, which is a virtual reality space for managing the operation of the ship, on the administrator terminal and the remote operator, wherein the VR operation management center displays ship information relating to at least one of the ships and assignment information indicating the assignment status between the ship and the remote operator.

[0008] Claim 2 The invention described in the claim 1 The ship operation management system described above is characterized in that the assignment information includes an avatar of the remote operator and status information displayed near the avatar, and the status information includes the operation status of the remote operator and identification information of the assigned ship.

[0009] Claim 3 The invention described in the claim 1 or 2 The ship operation management system described above is characterized in that the ship allocation means includes a function to change the assignment of the remote operator to the ship.

[0010] Claim 4 The invention described in the claim 1 or 2 The ship operation management system described above is characterized in that the operation management device includes a priority determination means that determines and notifies the priority for which the assignment of the remote operator to the ship is necessary, based on operation information relating to the operating status of the ship.

[0011] Claim 5 The invention described in the claim 2 The ship operation management system described above is characterized in that the VR operation management center display means has a function to notify the remote operator of the ship's operation status by changing the display state of the avatar.

[0012] Claim 6 The invention described in the claim 1 or 2 The ship operation management system described above is characterized in that the ship assignment means transmits the ship information to the remote operation device of the remote operator to whom the ship has been assigned, and the remote operation device displays a VR wheelhouse, which is a virtual reality space of the ship's wheelhouse, based on the ship information received from the ship assignment means.

[0013] Claim 7 The invention described in the claim 6 In the ship operation management system described above, the remote operation device is characterized in that it acquires an image of the surroundings of the other ship, which has been captured by the other ship's camera, from the operation management device and displays it in the VR wheelhouse.

[0014] Claim 8 The invention described in the claim 6 The ship operation management system described above is characterized in that it includes a VR wheelhouse acquisition and display means that acquires an image of the VR wheelhouse from the remote operation device and displays it on the administrator terminal.

[0016] Claim 9 The invention described is a ship operation management program for managing the operation of multiple ships capable of remote operation, comprising a computer, an administrator terminal operated by the ship's operation manager, at least one remote operation device operated by the ship's remote operator, and the management person's endFunction as an operation management device that manages the operation of the ship according to the last operation. The operation management device functions as a ship allocation means for allocating the remote operator to the ship, and a VR operation management center display means for displaying a VR operation management center, which is a virtual reality space for managing the operation of the ship, on the administrator terminal and the remote control device. At least one ship information related to the ship and allocation information indicating the allocation status between the ship and the remote operator are displayed in the VR operation management center. A ship operation management program characterized by this.

Effect of the Invention

[0018] Claim 1 And 9 According to the invention described in, since the VR operation management center can be displayed on the administrator terminal and the remote control device, the VR operation management center can be provided to the operation manager and the remote operator located remotely, and the operation of the ship can be managed and confirmed. In addition, since a remote operator can be assigned to the ship, it is possible to assign a ship according to the steering ability of the remote operator and perform remote steering. Furthermore, since at least one ship information is displayed in the VR operation management center, it is possible to check the operation status of the ship and perform appropriate operation management. In addition, since the allocation information indicating the correspondence between the assigned ship and the remote operator is displayed in the VR operation management center, it is possible to easily grasp which ship is being remotely steered by whom, and appropriate operation management can be performed.

[0019] Claim 2 According to the invention described in, as the allocation information, an avatar of the remote operator and status information displayed near the avatar are displayed, and the status information displays the steering status of the remote operator and the identification information of the assigned ship, so it is possible to easily grasp which ship is being remotely steered by whom.

[0020] Claim 3According to the invention described in [reference], since the assignment of remote operators to ships can be changed, it is possible to assign more appropriate remote operators to ships according to the type of ship, operating conditions, etc., and to perform appropriate operation management.

[0021] Claim 4 According to the invention described in [reference], based on the operation information of the ship, the priority of the assignment of remote operators to the ship is determined and notified, so that remote operators can be preferentially assigned to ships with high priority, and appropriate operation management can be performed.

[0022] Claim 5 According to the invention described in [reference], by changing the display state of the avatar, the operation status of the remote operator can be notified. Therefore, the operation status of the remote operator can be grasped from the display state of the avatar, and measures such as changing or adding remote operators can be taken quickly, and appropriate operation management can be performed.

[0023] Claim 6 According to the invention described in [reference], in the remote control device, the VR steering room of the assigned ship can be displayed, so that remote control can be performed in a state as if actually boarding the ship.

[0024] Claim 7 According to the invention described in [reference], the surrounding image of the ship taken by another ship can be acquired and displayed in the VR steering room. Therefore, for example, by referring to the surrounding image of another ship nearby, the movement of one's own ship can be objectively grasped, and safer and more appropriate remote control can be performed.

[0025] [[ID=Z7]] Claim 8 According to the invention described in [reference], an image of the VR steering room can be acquired from the remote control device and displayed on the administrator terminal. Therefore, the operation manager can supervise the operation status of the remote operator. Thereby, appropriate operation management can be performed. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] [Figure 1] This is a schematic diagram of a ship operation management system according to an embodiment of the present invention. [Figure 2] This is a functional block diagram showing the functional configuration of the flight control system. [Figure 3] This diagram shows the configuration of the VR operation management center as displayed on the administrator terminal and the remote operation device. [Figure 4] This diagram shows the configuration of the VR wheelhouse as displayed by the remote control system. [Figure 5] This figure shows the VR wheelhouse displaying images of the surroundings of other ships. [Figure 6] This flowchart shows the procedure from the VR flight management center display to remote operation. [Modes for carrying out the invention]

[0027] The present invention will be described below based on the illustrated embodiments.

[0028] Figure 1 is a schematic diagram showing a ship operation management system 1 according to an embodiment of the present invention, and a plurality of ships S1, S2, and S3 whose operation is managed and remotely operated by this ship operation management system 1. The ship operation management system 1 includes the remote operation system of the present invention.

[0029] Vessels S1 to S3 are unmanned vessels equipped with autonomous navigation systems S1a, S2a, and S3a, respectively. The autonomous navigation systems S1a to S3a autonomously control the main engines, rudders, etc., of vessels S1 to S3 and autonomously operate vessels S1 to S3 according to a set route and schedule. The autonomous navigation systems S1a to S3a are equipped with communication functions and are connected to the ship operation management system 1 via a communication network NW using satellite communication or the like.

[0030] The autonomous navigation systems S1a to S3a are equipped with an autonomous navigation mode in which the main engine, rudder, etc. are autonomously controlled to perform autonomous navigation, and a remote navigation mode in which the main engine, rudder, etc. are controlled in response to remote navigation from a distance. Under normal circumstances, ships S1 to S3 are autonomously operated by the autonomous navigation systems S1a to S3a, and their operation status is monitored by the ship operation management system 1. In emergencies such as rough weather, dragging anchor, or navigating through areas with heavy traffic, the autonomous navigation systems S1a to S3a are switched from autonomous navigation mode to remote navigation mode by the ship operation management system 1, and the ships are remotely operated. It should be noted that the ship operation management system 1 is not limited to ships S1 to S3, and it is possible to manage the operation of one or more ships simultaneously.

[0031] The ship operation management system 1 provides a VR operation management center, which represents the ship operation management center where ship operation management is performed, in a virtual reality space (hereinafter also referred to as VR space) to the operation manager O who gives instructions and performs operations for the operation management of ships S1 to S3, and to multiple remote operators Rc1, Rc2, and Rc3 who remotely operate ships S1 to S3. The VR operation management center displays a wide range of ship information related to ships S1 to S3 in an integrated manner. In addition, in the event of an emergency involving ships S1 to S3, ships S1 to S3 are assigned to remote operators Rc1 to Rc3, and remote operation is performed. The VR operation management center displays assignment information showing the assignment status of remote operators Rc1 to Rc3 to ships S1 to S3. This allows the operations manager O to monitor the operational status of vessels S1-S3 based on vessel information in the VR operations management center, just as in an actual operations management center, and to manage and supervise remote operation by remote operators Rc1-Rc3.

[0032] The ship operation management system 1 provides remote operators Rc1 to Rc3, to whom ships S1 to S3 are assigned, with a VR wheelhouse that represents the wheelhouse of ships S1 to S3 in a VR space. By operating the ship within the VR wheelhouse, remote operators Rc1 to Rc3 can perform remote operation as if they were actually on board ships S1 to S3.

[0033] The ship operation management system 1 includes an administrator terminal 5 operated by an operations manager O to manage the operation of ships S1 to S3, remote operation devices 2A, 2B, and 2C operated by remote operators Rc1, Rc2, and Rc3 to remotely operate ships S1 to S3, and an operation management device 3 that manages the operation of ships S1 to S3 in accordance with the operation of the administrator terminal 5.

[0034] The operation management device 3, although not shown in detail, is a computer device equipped with a central processing unit such as a CPU, a storage unit for storing programs and various data, a memory for temporarily storing information and data generated when the central processing unit executes various processes, various input / output interfaces, and a communication unit. Based on a ship operation management program (not shown), the central processing unit of the operation management device 3 operates, and as shown in Figure 2, it functions as a VR operation management center display unit (VR operation management center display means) 31, a ship allocation unit (ship allocation means) 32, a priority determination unit (priority determination means) 33, a ship operation status determination unit 34, and a VR wheelhouse acquisition / display unit (VR wheelhouse acquisition / display means) 35.

[0035] The VR Operation Management Center display unit 31 transmits VR Operation Management Center display information to the administrator terminal 5 and remote control devices 2A to 2C, and displays the VR Operation Management Center, thereby providing the VR Operation Management Center to the operation manager O and remote control operators Rc1 to Rc3. The VR Operation Management Center display information is image (video) information of the VR Operation Management Center generated by computer graphics.

[0036] Figure 3 shows an example of a VR operation management center 6 displayed by the administrator terminal 5 and the remote control devices 2A-2C. The VR operation management center 6 displays an information display unit 65, avatars 61, 62, and 63 of the remote operators Rc1-Rc3, and the avatar 64 of the operations manager O. Avatars 61-63 can be moved within the VR operation management center 6 in response to operations by the remote operators Rc1-Rc3 on the remote control devices 2A-2C. Avatar 64 can also be moved within the VR operation management center 6 in response to operations by the operations manager O on the administrator terminal 5. For remote operators Rc1-Rc3 and operations manager O, an image of the entire VR operation management center 6, including their own avatars, may be provided, or, to provide a more realistic experience, an image of the area visible to each person's avatar 61-64 may be provided.

[0037] The information display unit 65 is equipped with multiple display areas 65a, 65b, etc. These display areas 65a, 65b display ship information related to ships S1 to S3 and operator information related to remote operators Rc1 to Rc3. The number of display areas in the information display unit 65 can be arbitrarily increased or decreased depending on the amount of information to be displayed.

[0038] Ship information includes, for example, basic ship information and operational information. Basic ship information is information about various specifications of ships S1 to S3, such as ship name, flag, ship type, overall length, overall width, gross tonnage, and deadweight tonnage. Operational information is information about the operational status of ships S1 to S3, such as ship status, route, sailing schedule, cargo, current position, heading, speed, route chart, radar information, weather information, operation mode, and surrounding images. Ship status includes the current state of ships S1 to S3, such as anchored, departed, sailing, entered port, or dragging anchor. Operation mode includes whether ships S1 to S3 are in autonomous operation mode or remote operation mode. If ships S1 to S3 are in remote operation mode, it includes information about the remote operator in charge of operation. Surrounding images are images of the area around ships S1 to S3 taken by cameras installed on ships S1 to S3.

[0039] The operator information includes, for example, the names, ages, types of marine engineer licenses, operating history (names, types, operating time, operating distance, etc.) of remote operators Rc1 to Rc3, and the current operating status (on standby, remotely operating, etc.). This ship information and operator information is stored in the memory unit of the operation management device 3, and is also acquired and collected as needed from each ship S1 to S3, remote operating devices 2A to 2C, and the administrator terminal 5.

[0040] The VR Operation Management Center display unit 31 displays various information on the information display unit 65 in response to operations performed by the operation manager O on the administrator terminal 5, either selectively or as a list. In the example shown in Figure 3, the main ship information (e.g., ship name, route, etc.) for ships S1 to S3 is displayed in a list in the display area 65a. In addition, detailed ship information, including a route map for the selected ship, for example, ship S1, is displayed comprehensively in the display area 65b. Similarly, operator information can also be displayed in a list or in detail. This allows the operation manager O to check the operating status of each ship S1 to S3 in the VR Operation Management Center 6, just as if he were in the actual operation management center.

[0041] Near the avatars 61-63 of remote operators Rc1-Rc3, status information 61a-63a, including the operating status of remote operators Rc1-Rc3, is displayed. In other words, the avatars 61-63 and the status information 61a-63a correspond to assignment information showing the assignment status of remote operators Rc1-Rc3 to vessels S1-S3. If remote operators Rc1-Rc3 are operating a vessel remotely, the status information 61a-63a displays "Operating" and also displays the name (identification information) of the vessel being operated. If remote operators Rc1-Rc3 are on standby, the status information 61a-63a displays "On standby". This allows the operations manager O to easily check which remote operator is operating a vessel, and if so, to quickly check which vessel the remote operator is operating.

[0042] The ship assignment unit 32 assigns remote operators Rc1 to Rc3 to ships S1 to S3 according to the operation of the administrator terminal 5 by the operations manager O. For example, when the operations manager O operates the administrator terminal 5 to instruct the start of remote operator assignment, the ship assignment unit 32 displays a list of ship information for ships S1 to S3 so that it can be selected. Once the operations manager O selects any of the ships S1 to S3, the ship assignment unit 32 then displays a list of operator information for remote operators Rc1 to Rc3 so that it can be selected. The operations manager O can check the operator information and select a remote operator Rc1 to Rc3 that is suitable for operating ships S1 to S3.

[0043] When the operations manager O selects one of the remote operators Rc1 to Rc3, the ship allocation unit 32 transmits remote operation request information to the remote operation devices 2A to 2C of the selected remote operators Rc1 to Rc3. When the remote operators Rc1 to Rc3 confirm the remote operation request information and transmit acceptance information from the remote operation devices 2A to 2C to the operations management unit 3, the ship allocation unit 32 transmits ship information to the remote operation devices 2A to 2C. The remote operation devices 2A to 2C display the VR wheelhouse based on the received ship information and accept the operation commands from the remote operators Rc1 to Rc3. As a result, the remote operators Rc1 to Rc3 can remotely operate the ship using the remote operation devices 2A to 2C.

[0044] When the assignment of remote operators to vessels is complete, the vessel assignment unit 32 updates the assignment information showing the assignment status of remote operators Rc1 to Rc3 to vessels S1 to S3. The assignment information is stored in a memory unit or the like. The VR operation management center display unit 31 updates the display of status information 61a to 63a in the VR operation management center 6 based on the stored assignment information.

[0045] Furthermore, the ship assignment unit 32 can change the remote operators Rc1 to Rc3 assigned to ships S1 to S3 according to the instructions of the operations manager O. In this case, the ship assignment unit 32 first removes the assignment of remote operators Rc1 to Rc3 to ships S1 to S3 and then displays a list of operator information so that the operations manager O can select new remote operators Rc1 to Rc3. When remote operators Rc1 to Rc3 are changed, the assignment information and status information 61a to 63a are updated. This makes it possible to assign the most suitable remote operators Rc1 to Rc3 to ships S1 to S3 and operate them remotely. In addition, the ship assignment unit 32 can assign multiple remote operators Rc1 to Rc3 to a single ship according to the instructions of the operations manager O. Furthermore, it is also possible to add remote operators Rc1 to Rc3 later. This makes it possible for multiple remote operators to operate the ship complementaryly when remote operation is difficult. Furthermore, it is possible to operate the system so that less experienced remote operators are assisted by more experienced remote operators.

[0046] The priority determination unit 33 determines the priority for assigning remote operators Rc1 to Rc3 and remotely operating the vessel (hereinafter also referred to as the assignment priority) based on the vessel's operational information, and displays the determination result. In other words, the priority determination unit 33 can notify the operations manager O of the situation in which a remote operator should be assigned to the vessel.

[0047] The priority determination unit 33 determines that a vessel has a high assignment priority based on, for example, the vessel's status, current position, and weather information from the operational information, such as when the vessel is dragging anchor, when the vessel's current position is in a busy area, or when weather conditions in the vessel's area are deteriorating. The VR operational management center display unit 31 notifies the operational manager O of vessels that have been determined to have a high assignment priority by changing the display status of the vessel information. In the example shown in Figure 3, the notification is made by changing the display color of the vessel information or the display frame of the vessel information displayed in the display area 65a, or by making the display blink.

[0048] The ship handling status determination unit 34 determines the ship handling status (whether the ship is being handled with ample margin or whether the ship is being handled with difficulty, etc.) based on the ship handling information from remote operators Rc1 to Rc3, and notifies the determination result if it determines that the ship handling status has deteriorated (meaning that the ship is being handled with no margin or is being handled with difficulty, etc.). The ship handling information from remote operators Rc1 to Rc3 is the information transmitted from the remote operation devices 2A to 2C to the autonomous ship handling devices S1a to S3a via the operation management device 3 when remote operators Rc1 to Rc3 operate the remote operation devices 2A to 2C to remotely handle the ships S1 to S3. Based on this ship handling information, the autonomous ship handling devices S1a to S3a control the main engine and rudder, etc., to remotely handle the ships S1 to S3. The ship handling condition determination unit 34 determines the ship handling condition based, for example, on the number of operations performed on the remote ship handling devices 2A to 2C within a predetermined time period, and determines that the ship handling condition has deteriorated if the number of operations exceeds a predetermined value. In other words, the ship handling condition determination unit 34 determines that the ship handling condition has deteriorated if the steering handles, throttle levers, etc., of the ships S1 to S3 are being operated remotely frequently.

[0049] If the VR operation management center display unit 31 determines that the ship's operation condition is deteriorating, it notifies the operations manager O by changing the display status of the avatars 61-63 of the remote operators Rc1-Rc3. In the example shown in Figure 3, the notification is given by changing the display color of the avatar 62 of the remote operator Rc2 or by making the display blink.

[0050] The VR wheelhouse acquisition and display unit 35, in response to operations by the operations manager O on the administrator terminal 5, displays information from the remote control devices 2A to 2C to the VR wheelhouse 4 (Figure) during remote control operation. 4 and figure 5 The image (see reference) is acquired and displayed on the administrator terminal 5. The acquired image of the VR bridge 4 may be displayed on the administrator terminal 5 instead of the VR operation management center 6, or the VR bridge 4 may be displayed within the VR operation management center 6. This allows the operations manager O to check and supervise the remote operation status of remote operators Rc1 to Rc3.

[0051] Next, the operations manager O and the administrator terminal 5 will be described. The operations manager O is, for example, a person with experience in ship operations management at an actual operations management center. The operations manager O operates the operations management device 3 via the administrator terminal 5 to manage the operations of ships S1 to S3 and supervise the remote operation by remote operators Rc1 to Rc3. The operations manager O can remotely manage the operations of ships S1 to S3 and remotely supervise the remote operation by remote operators Rc1 to Rc3, whether domestically or overseas, as long as the administrator terminal 5 can connect to the communication network NW. Note that the number of operations managers is not limited to one person; multiple operations managers may collaborate in managing operations.

[0052] The administrator terminal 5 comprises a VR control unit 5a that is communicably connected to the flight management device 3 via a communication network NW, a VR goggle 5b worn on the head of the flight manager O, and two VR controllers 5c held in the hands of the flight manager O. The VR control unit 5a, the VR goggle 5b, and the VR controllers 5c are connected by wire or wireless means.

[0053] The VR control unit 5a, although not shown in detail, is a computer device equipped with a central processing unit such as a CPU, a memory unit for storing programs and various data, a memory for temporarily storing information and data generated when the central processing unit executes various processes, various input / output interfaces, and a communication unit. The VR control unit 5a functions as an administrator terminal 5 when the central processing unit operates based on a remote management program (not shown).

[0054] The VR control unit 5a displays the VR flight management center 6 on the VR goggles 5b based on the VR flight management center display information transmitted from the flight management device 3. The VR control unit 5a also detects flight management operations performed by the flight manager O within the VR flight management center 6 using the VR controller 5c, and transmits management operation information generated based on the detection results to the flight management device 3. The flight management device 3 performs flight management based on the management operation information.

[0055] The VR goggles 5b are a so-called HMD (Head Mounted Display) that displays a three-dimensional VR flight management center 6 by displaying right-eye and left-eye images with parallax. The VR goggles 5b also have a head tracking function that detects the head movements of the flight manager O, a position tracking function that detects changes in the position and posture of the flight manager O, and an eye tracking function that detects the movement of the flight manager O's gaze. Furthermore, the VR goggles 5b are equipped with a microphone and speaker. The flight manager O can use the microphone and speaker to communicate with remote operators Rc1~Rc3 and crew members on ships S1~S3.

[0056] The VR controller 5c is equipped with motion tracking functionality that detects the movements of the operations manager O's right and left hands, as well as various control switches (control buttons, control levers, control dials). These control switches are used to grasp and release virtual objects (VR objects) within the VR operations management center. By operating the VR controller 5c, operations manager O can display and switch various information within the VR operations management center 6, assign, change, and add vessels and remote operators.

[0057] Remote operator Rc 1 ~Rc 3 These are individuals with a marine engineer's license and experience operating vessels. Remote operators Rc1 to Rc3 control the autonomous ship handling devices S1a to S3a by operating the remote ship handling devices 2A to 2C, thereby remotely operating vessels S1 to S3. Remote operators Rc1 to Rc3 can remotely operate vessels S1 to S3 both domestically and internationally, as long as the remote ship handling devices 2A to 2C can connect to the communication network NW. Furthermore, the remote operators and remote ship handling devices are not limited to remote operators Rc1 to Rc3 and remote ship handling devices 2A to 2C; it is possible to manage and operate one or more remote operators and one or more remote ship handling devices.

[0058] The remote control device 2A comprises a VR control unit 2A1 that is communicably connected to the operation management device 3 via a communication network NW, VR goggles 2A2 worn on the head of the remote operator Rc1, and two VR controllers 2A3 held in the hands of the remote operator Rc1. The VR control unit 2A1, the VR goggles 2A2, and the VR controllers 2A3 are connected by wire or wireless means.

[0059] The VR control unit 2A1, although not shown in detail, is a computer device equipped with a central processing unit such as a CPU, a memory unit for storing programs and various data, a memory for temporarily storing information and data generated when the central processing unit executes various processes, various input / output interfaces, and a communication unit. The VR control unit 2A1 functions as a remote ship control device when the central processing unit operates based on a remote ship control program (not shown). The VR goggles 2A2 and VR controller 2A3 have the same configuration and functions as the VR goggles 5b and VR controller 5c of the administrator terminal 5 described above, so a detailed explanation is omitted.

[0060] The VR control unit 2A1 displays the VR operation management center 6 on the VR goggles 2A2 based on the information displayed by the VR operation management center. The VR control unit 2A1 also pre-stores VR wheelhouse display information for displaying the VR wheelhouses of ships S1 to S3 in a memory unit or similar. When ship information regarding ships S1 to S3 is transmitted from the operation management device 3, the VR control unit 2A1 displays the VR wheelhouse on the VR goggles 2A2 based on this ship information and the VR wheelhouse display information.

[0061] The VR goggles 2A2 display the VR wheelhouse based on the right-eye and left-eye images of the VR wheelhouse output from the VR control unit 2A1. As shown in Figure 4, the VR wheelhouse 4 displays a steering panel 41 equipped with a steering wheel 41a and a throttle lever 41b, an instrument panel 42 equipped with radar images, a speedometer and a rudder angle meter, and an image 43 of the ship's surroundings taken by a camera mounted on the ship. The steering wheel 41a and throttle lever 41b are displayed in the VR wheelhouse 4 as VR objects that can be operated by the VR controller 2A3.

[0062] Computer graphics (CG) images are used for the steering panel 41 and instrument panel 42. The surrounding image 43 displays an image of the view from the actual wheelhouse window. If the ship is equipped with multiple cameras and each camera captures different directions around the ship, the images from each camera may be switched or displayed side by side. In addition, images of the actual wheelhouse interior captured by the cameras may be used for the steering panel 41 and instrument panel 42.

[0063] Furthermore, surrounding images captured by the cameras of other vessels may be acquired via the navigation management device 3 and displayed in the VR wheelhouse 4. As shown in Figure 5, for example, by acquiring surrounding images 44 showing the vessel from another vessel located nearby and displaying them in the VR wheelhouse 4, the vessel's navigation status can be objectively assessed. In addition, by acquiring surrounding images of other vessels at the planned port of entry and displaying them in the VR wheelhouse 4, it is possible to check the conditions at the planned port of entry and prepare for entry.

[0064] The VR goggles 2A2 detect the head movements, position and posture changes, and gaze movements of the remote operator Rc1, and transmit the detection results to the VR control unit 2A1. The VR control unit 2A1 changes the VR wheelhouse 4 displayed on the VR goggles 2A2 in accordance with the head movements, position and posture changes, and gaze movements of the remote operator Rc1. In other words, it changes the image of the VR wheelhouse 4 so that the direction that the remote operator Rc1 is looking is displayed on the VR goggles 2A2.

[0065] The VR controller 2A3 detects the steering operations performed by the remote operator Rc1 within the VR wheelhouse 4, such as operations on the steering wheel 41a and throttle lever 41b, and transmits the direction and amount of these operations to the VR control unit 2A1. The VR control unit 2A1 changes the VR wheelhouse 4 displayed on the VR goggles 2A2 according to the detection results of the VR controller 2A3. The VR control unit 2A1 also generates steering information based on the detection results of the VR controller 2A3 and transmits the generated steering information to the operation management device 3. The autonomous steering devices S1a to S3a control the main engine and rudder, etc., based on the received steering information, and remotely steer the ships S1 to S3. Note that the remote steering devices 2B and 2C have the same configuration and functions as the remote steering device 2A, so a detailed explanation is omitted.

[0066] Figure 6 shows the flow from the display on the VR Operation Management Center 6 to the remote operation of vessels S1 to S3. The VR Operation Management Center display unit 31 of the Operation Management Device 3 transmits VR Management Center display information to the administrator terminal 5 and the remote operation devices 2A to 2C (step S1). The administrator terminal 5 displays the VR Operation Management Center 6 on the VR goggles 5b (step S2). The remote operation devices 2A to 2C also display the VR Operation Management Center 6 on the VR goggles 2A2 to 2C3 (step S3). The operation manager O displays vessel information for vessels S1 to S3 on the information display unit 65 within the VR Operation Management Center 6 and performs operation management. The operation manager O also checks the avatars 61 to 63 and status information 61a to 63a of the remote operators Rc1 to Rc3 to confirm and supervise the status of remote operation.

[0067] When the priority determination unit 33 notifies the operator of a vessel requiring remote operation, the operations manager O performs the operation to assign vessels S1 to S3 to remote operators Rc1 to Rc3 (step S4). The vessel assignment unit 32 of the operations management device 3 displays vessel information and operator information in the VR operations management center 6 displayed on the administrator terminal 5, and assigns vessels S1 to S3 to remote operators Rc1 to Rc3 in response to the operations manager O's operation (step S5).

[0068] When the assignment of remote operators Rc1 to Rc3 to vessels S1 to S3 is completed, the ship assignment unit 32 of the operation management device 3 updates the assignment information based on the assignment results and also updates the display of status information 61a to 63a in the VR operation management center 6 (step S6). The ship assignment unit 32 also transmits the ship information of the assigned vessels S1 to S3 to the remote operation devices 2A to 2C (step S7).

[0069] The remote control devices 2A to 2C display the VR wheelhouse 4 on the VR goggles 2A2 to 2C2 of the remote operators Rc1 to Rc3 based on the received ship information and the VR wheelhouse display information stored in advance (step S8). When remote control is performed in the VR wheelhouse 4 (step S9), the remote control devices 2A to 2C transmit the control information to the navigation management device 3 (step S10). The control information is also transmitted to the autonomous control devices S1a to S3a of the ships S1 to S3 via the navigation management device 3 (step S11).

[0070] The remote control devices 2A to 2C change the display in the VR wheelhouse 4 based on the steering operations performed within the VR wheelhouse 4 (step S12). The autonomous steering devices S1a to S3a control the main engine, rudder, etc., based on the steering information, thereby remotely steering the vessels S1 to S3 (step S13). By repeating steps S7 to S13, the vessels S1 to S3 can be remotely steered.

[0071] As described above, the ship operation management system 1 according to this embodiment can display the VR wheelhouse 4 of ships S1 to S3 corresponding to the selected ship information, making it possible to select different ships S1 to S3 and remotely operate them. Furthermore, since the VR wheelhouse 4, which is a virtual reality space of the wheelhouse of ships S1 to S3, is used for remote operation, it is possible to perform remote operation in a state as if actually being on board ships S1 to S3.

[0072] Furthermore, according to the ship operation management system 1 of this embodiment, the VR operation management center 6 can be displayed on the administrator terminal 5 and the remote operation devices 2A to 2C. This allows the VR operation management center 6 to be provided to the operation manager O and remote operators Rc1 to Rc3 who are in remote locations, enabling them to manage and confirm the operation of ships S1 to S3. In addition, since remote operators can be assigned to ships S1 to S3, it is possible to assign ships S1 to S3 and have them remotely operated according to the operation capabilities of the remote operators Rc1 to Rc3. Moreover, since the VR operation management center 6 displays information for at least one ship, it is possible to check the operating status of ships S1 to S3 and perform appropriate operation management. Furthermore, since the VR operation management center 6 displays assignment information showing the correspondence between the assigned ships S1 to S3 and the remote operators Rc1 to Rc3, it is possible to easily understand which ship is being remotely operated by whom, enabling appropriate operation management.

[0073] Furthermore, according to the ship operation management system 1 of this embodiment, the assignment information includes avatars 61 to 63 of the remote operators Rc1 to Rc3 and status information 61a to 63a displayed near the avatars 61 to 63. The status information 61a to 63a displays the operation status of the remote operators Rc1 to Rc3 and the identification information of the assigned ships S1 to S3, making it easy to understand which ship is being remotely operated by whom.

[0074] Furthermore, according to the ship operation management system 1 of this embodiment, the assignment of remote operators Rc1 to Rc3 to ships S1 to S3 can be changed. Therefore, depending on the type of ship S1 to S3 and its operating status, more appropriate remote operators Rc1 to Rc3 can be assigned to ships S1 to S3, enabling proper operation management.

[0075] Furthermore, according to the ship operation management system 1 of this embodiment, the system determines and notifies the priority for which remote operators Rc1 to Rc3 should be assigned based on the operation information of ships S1 to S3. Therefore, remote operators Rc1 to Rc3 can be preferentially assigned to ships S1 to S3 with higher priority, enabling appropriate operation management.

[0076] Furthermore, according to the ship operation management system 1 of this embodiment, avatar 61 ~ 63 By changing the display status, the operating status of remote operators Rc1 to Rc3 can be reported, allowing for a clear understanding of their operating status and enabling prompt action such as changes or additions to Rc1 to Rc3, thereby facilitating appropriate operational management.

[0077] Furthermore, according to the ship operation management system 1 of this embodiment, the remote ship operation devices 2A to 2C can display the VR wheelhouse 4 of the assigned ship S1 to S3, making it possible to perform remote ship operation as if actually being on board the ship S1 to S3.

[0078] Furthermore, according to the ship operation management system 1 of this embodiment, it is possible to acquire images of the ship's surroundings taken by other ships and display them in the VR wheelhouse 4. For example, by referring to images of other ships nearby, it is possible to objectively understand the movements of one's own ship, enabling safer and more appropriate remote operation.

[0079] Furthermore, according to the ship operation management system 1 of this embodiment, images of the VR wheelhouse 4 can be acquired from the remote operation devices 2A to 2C and displayed on the administrator terminal 5, so that the operations manager O can supervise the operation status of the remote operators Rc1 to Rc3. This makes it possible to perform appropriate operation management.

[0080] Although embodiments of this invention have been described above, the specific configuration is not limited to the embodiments described above, and any design changes, etc., that do not depart from the spirit of this invention are also included.

[0081] In the above embodiment, remote operators Rc1 to Rc3 are assigned to vessels S1 to S3 according to the instructions of the operations manager O. However, for example, machine learning may be performed based on the vessel information of vessels S1 to S3, the operator information of remote operators Rc1 to Rc3, and past assignment records, and the assignment of remote operators Rc1 to Rc3 may be optimized using the trained model generated by machine learning.

[0082] Furthermore, in the above embodiment, the display state of avatars 61 to 63 was changed according to the operation status of the remote operators Rc1 to Rc3. However, if the remote operators Rc1 to Rc3 want someone to take over the operation or want assistance in operation, the display state of avatars 61 to 63 may be changed based on a declaration from the remote operators Rc1 to Rc3.

[0083] Furthermore, in the above embodiment, the VR wheelhouse 4 is displayed on the administrator terminal 5 in response to the operation of the operations manager O. However, the VR wheelhouse 4 of each remote control device 2 may be displayed on the administrator terminal 5 periodically and sequentially, so that the operations manager O can monitor the operation status of each remote operator Rc1 to Rc3.

[0084] 1. Ship Operation Management System (Remote Ship Operation System) 2A~2C Remote control ship handling system 3. Flight control system 31 VR Flight Management Center Display Unit (VR Flight Management Center Display Means) 32. Ship allocation section (ship allocation means) 33 Priority judgment unit (priority judgment means) 34. Ship Maneuvering Status Determination Unit 35 VR Wheelhouse Acquisition and Display Unit (VR Wheelhouse Acquisition and Display Means) 4 VR Wheelhouse 5. Administrator terminal 6 VR Flight Management Center 61 ~64 Avatars 65 Information display section S1~S3 Ship S1a~S3a Autonomous ship steering system Rc1 ~ Rc3 Remote Operator

Claims

1. A ship operation management system for managing the operation of multiple ships capable of remote operation, An administrator terminal operated by the ship's operator, At least one remote control device operated by the remote operator of the aforementioned vessel, A navigation management device that manages the operation of the vessel in response to the operation of the administrator terminal, Equipped with, The aforementioned flight management device is A ship assignment means for assigning the remote operator to the aforementioned ship, A VR operation management center, which is a virtual reality space for managing the operation of the aforementioned vessel, is displayed on the administrator terminal and the remote operation device by a VR operation management center display means. Equipped with, The VR operation management center displays ship information relating to at least one of the vessels, and assignment information indicating the assignment status between the vessel and the remote operator. A ship operation management system characterized by the following features.

2. The assignment information includes the avatar of the remote operator and status information displayed near the avatar, wherein the status information includes the operating status of the remote operator and identification information of the assigned vessel. The ship operation management system according to feature 1.

3. The ship allocation means includes a function to change the assignment of the remote operator to the ship. A ship operation management system according to claim 1 or 2, characterized by the above.

4. The aforementioned flight management device is The system includes a priority determination means that determines and notifies the priority for which the assignment of the remote operator to the said vessel is necessary, based on operational information relating to the operating status of the said vessel. A ship operation management system according to claim 1 or 2, characterized by the above.

5. The VR operation management center display means includes a function to notify the remote operator of the ship's operation status by changing the display state of the avatar. The ship operation management system according to feature 2.

6. The ship allocation means transmits the ship information to the remote control device of the remote operator to whom the ship has been assigned. The remote control device displays a VR wheelhouse, which is a virtual reality space of the wheelhouse of the ship, based on the ship information received from the ship assignment means. A ship operation management system according to claim 1 or 2, characterized by the above.

7. The remote control device acquires images of the surroundings of the other vessel, captured by the other vessel's camera, from the operation management device and displays them in the VR wheelhouse. The ship operation management system according to claim 6.

8. The aforementioned ship management device includes a VR wheelhouse acquisition and display means that acquires an image of the VR wheelhouse from the remote ship handling device and displays it on the administrator terminal. The ship operation management system according to claim 6.

9. A ship operation management program for managing the operation of multiple ships capable of remote operation, Computers, Administrator terminal operated by the ship's operator, At least one remote control device operated by the remote operator of the aforementioned vessel, In response to the operation of the administrator terminal, the operation management device manages the operation of the vessel. To make it function as, The aforementioned flight management device is Ship assignment means for assigning the remote operator to the aforementioned vessel, A VR operation management center, which is a virtual reality space for managing the operation of the aforementioned vessel, is displayed on the administrator terminal and the remote operation device by a VR operation management center display means. It functions as, The VR operation management center displays ship information relating to at least one of the vessels, and assignment information indicating the assignment status between the vessel and the remote operator. A ship operation management program characterized by the following features.

Images