Information processing method and program

Abstract

To provide a technique that is able to enhance operability when remotely operating a ship.SOLUTION: In an information processing method for remotely operating a ship by using a mobile terminal, the mobile terminal outputs a user interface screen including a first operation region and a second operation region, to a touch panel display. The mobile terminal transmits a first command for translating the ship to the ship in response to detection of a slide touch operation in the first operation region. Further, the mobile terminal transmits a second command for turning the ship to the ship in response to detection of a slide touch operation in the second operation region.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method and a program. [Background technology]

[0002] There is known a technique for controlling the course, thrust, and the like of a ship on an operation screen displayed on a tablet terminal (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-132095 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to provide a technology that can improve operability when remotely operating a vessel. [Means for solving the problem]

[0005] One aspect of the present disclosure is an information processing method for remotely operating a vessel using a mobile terminal equipped with a touch panel display. The mobile terminal, outputting a user interface screen including a first operation area and a second operation area to the touch panel display; transmitting a first command to the vessel in response to detecting a slide touch operation in the first operation area, for causing the vessel to translate; transmitting a second command to the vessel in response to detecting a slide touch operation in the second operation area, for turning the vessel; The following may be executed.

[0006] Another aspect of the present disclosure may be an information processing program for causing a computer to execute the information processing method described above, or a non-transitory storage medium for storing the information processing program. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a technique that can improve operability when remotely operating a vessel. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a configuration of a remote ship maneuvering system according to an embodiment; [Figure 2] 2A and 2B are diagrams illustrating exemplary configurations of a vessel and a mobile terminal according to an embodiment; [Figure 3] FIG. 10 is a diagram illustrating an example of a remote control screen according to the embodiment. [Figure 4] FIG. 10 is a diagram for explaining an example of a procedure for remotely operating a vessel on a remote operation screen in an embodiment. [Figure 5] 10A and 10B are diagrams for explaining an example of a method for setting the magnitude of a propulsive force in the embodiment. [Figure 6] 10 is a flowchart illustrating an example of a processing routine executed by the mobile terminal according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Technologies for remotely operating a ship using a mobile device such as a smartphone or tablet are being developed. One known example of such technology involves displaying an operation screen on a mobile device that includes a wide variety of GUI components, such as multiple display fields for information indicating the ship's status, multiple buttons for selecting the ship's thrust, and multiple buttons for selecting the ship's course. The thrust and course selected by a user on the operation screen are then transmitted wirelessly from the mobile device to the ship. This technology allows a user to operate the ship while visually monitoring the conditions around the ship from a location away from the cockpit (e.g., a deck). However, in the example described above, the operation screen displays a wide variety of GUI components, requiring the user to closely monitor the operation screen while remotely operating the ship, leaving room for improvement in terms of operability.

[0010] One aspect of the present disclosure is an information processing method for remotely operating a vessel using a mobile terminal equipped with a touch panel display. In the information processing method according to the present disclosure, the mobile terminal outputs a user interface screen including a first operation area and a second operation area to the touch panel display. In one example, the user interface screen may be a screen in which the display screen of the touch panel display is divided into the first operation area and the second operation area. In this case, it is desirable that the user interface screen is configured so that the first operation area and the second operation area can be visually distinguished. Furthermore, each of the first operation area and the second operation area is a screen area in which a user remotely operating the vessel inputs a slide touch operation. In one example, the first operation area may include an icon corresponding to the vessel. Furthermore, in one example, the second operation area may include a GUI component that allows the turning direction of the vessel to be selected by a slide touch operation.

[0011] In an information processing method according to the present disclosure, a mobile terminal transmits a first command to the vessel in response to detecting a sliding touch operation in a first operation area. Here, in a case where the first operation area is configured to include an icon corresponding to the vessel, the mobile terminal may detect a first sliding touch operation in which the icon is touched and slid, determine a translational direction of the vessel in response to a sliding direction of the first sliding touch operation, determine a magnitude of a thrust force in the translational direction in response to a sliding distance of the first sliding touch operation, and transmit a first command including the determined translational direction and magnitude of the thrust force to the vessel.

[0012] In addition, in the information processing method according to the present disclosure, the mobile terminal transmits a second command to the vessel in response to detecting a sliding touch operation in the second operation area. Here, if the second operation area is configured to include a GUI component for selecting a direction for turning the vessel, the mobile terminal may detect a second sliding touch operation in which the GUI component is touched and slid, determine the direction for turning the vessel in response to the sliding direction of the second sliding touch operation, determine the magnitude of the thrust force in the turning direction in response to the amount of sliding of the second sliding touch operation, and transmit a second command including the determined direction of turning and the magnitude of the thrust force to the vessel.

[0013] According to the information processing method of the present disclosure, a user can remotely perform translational and / or rotational operations on a vessel by inputting a slide touch operation in a first operation area and / or a second operation area on a user interface screen displayed on a touch panel display of a mobile terminal. This eliminates the need for the user to focus on the display screen of the touch panel display when remotely operating the vessel, thereby improving the operability of remote operation.

[0014] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configurations, module configurations, functional configurations, and the like described in the following embodiments are not intended to limit the technical scope of the disclosure to those configurations alone.

[0015] <Embodiment> In this embodiment, an example in which the present disclosure is applied to a remote ship maneuvering system will be described. The remote ship maneuvering system in this embodiment is a system that remotely controls a ship using a mobile terminal. (Outline of the remote ship maneuvering system) 1 is a diagram showing an overview of a remote ship maneuvering system according to the present disclosure. As shown in FIG. 1, the remote ship maneuvering system according to the present disclosure includes a ship 1 and a mobile terminal 2.

[0016] The vessel 1 includes a bow thruster 110 mounted on the bow of the hull 10, two engines 120-130 mounted on the stern of the hull 10, and an onboard device 140. The bow thruster 110 is a propulsion unit that generates propulsive force to propel the bow of the hull 10 in the left-right direction. The engines 120-130 are propellers that generate propulsive force to propel the stern of the hull 10 in the fore-aft direction. In the following, of the two engines 120-130, the engine 120 installed on the right side of the hull 10 will be referred to as the right engine 120, and the engine 130 installed on the left side of the hull 10 will be referred to as the left engine 130. In the description of this embodiment, the bow thruster 110, the right engine 120, and the left engine 130 may also be collectively referred to as the "engines." The onboard device 140 is a computer that controls the engines in accordance with a remote signal transmitted from the mobile terminal 2. The remote signal is a signal that includes a command that specifies the propulsion direction of the vessel 1 and a command that specifies the magnitude of the propulsive force in the propulsion direction.

[0017] The configuration of the boat 1 is not limited to the example shown in Figure 1, and the arrangement and number of engines may be changed as appropriate depending on the embodiment as long as the configuration allows translation in the forward / backward and left / right directions and turning in the left / right direction.

[0018] The vessel 1 configured as described above moves forward (translates forward) when the bow thruster 110 is stopped, by the right engine 120 and the left engine 130 generating a propulsive force that propels the stern forward. The vessel 1 moves backward (translates backward) when the bow thruster 110 is stopped, by the right engine 120 and the left engine 130 generating a propulsive force that propels the hull 10 rearward. The vessel 1 moves backward (translates backward) when the bow thruster 110 generates a propulsive force that propels the bow leftward, and the right engine 120 and the left engine 130 generate a propulsive force that propels the stern rightward (the right engine 120 generates a propulsive force that propels the hull 10 rearward, and the left engine 130 generates a propulsive force that propels the hull 10 forward). The vessel 1 moves parallel to the right as the bow thruster 110 generates a propulsive force that propels the bow to the right, and the right engine 120 and the left engine 130 generate a propulsive force that propels the stern to the left (the right engine 120 generates a propulsive force that propels the hull 10 forward, and the left engine 130 generates a propulsive force that propels the hull 10 backward). The vessel 1 turns left as the bow thruster 110 generates a propulsive force that propels the bow to the left, and the right engine 120 and the left engine generate a propulsive force that propels the stern to the right (the right engine 120 generates a propulsive force that propels the hull 10 forward, and the left engine 130 generates a propulsive force that propels the hull 10 backward). The vessel 1 turns to the right as the bow thruster 110 generates a propulsive force that propels the bow to the right, and the right engine 120 and the left engine generate a propulsive force that propels the stern to the left (the right engine 120 generates a propulsive force that propels the hull 10 backward, and the left engine 130 generates a propulsive force that propels the hull 10 forward).

[0019] The mobile terminal 2 is a portable computer, such as a smartphone or tablet terminal, used by a user who remotely operates the boat 1. The mobile terminal 2 in this embodiment is equipped with a touch panel display 240 as an input / output device. In the following, the left-right direction when the surface of the mobile terminal 2 on which the touch panel display 240 is provided is viewed from the front is referred to as the X axis. The vertical direction is referred to as the Y-axis.

[0020] The mobile terminal 2 of this embodiment has a function of outputting (displaying) a user interface screen for remote operation on the touch panel display 240, a function of detecting a slide touch operation input on the user interface screen, and a function of transmitting a signal including a command corresponding to the detected slide touch operation to the ship 1 (onboard device 140). Details of the user interface screen, detection of the slide touch operation, and transmission of the remote signal will be described later.

[0021] According to the remote ship maneuvering system of this embodiment, the user can remotely control the ship 1 by inputting a slide touch operation on the user interface screen displayed on the touch panel display 240 of the mobile terminal 2.

[0022] (Configuration of remote ship control system) The configurations of the ship 1 and the portable terminal 2 included in the remote ship maneuvering system will now be described with reference to Fig. 2. Fig. 2 is a diagram schematically illustrating an example of the configuration of each of the ship 1 and the portable terminal 2.

[0023] As described above, the boat 1 in this embodiment includes the bow thruster 110, the right engine 120, the left engine 130, and the onboard equipment 140. The onboard equipment 140 is a communication system that uses a controller area network (CAN), a local interconnect network (LIN), or a FlexRay The bow thruster 110, the right engine 120, and the left engine 130 are connected via an in-ship network based on standards such as IEEE 802.11b / g.

[0024] The shipboard device 140 in this embodiment is configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.). As shown in Fig. 2, such a shipboard device 140 includes a control unit 141, a memory unit 142, and a communication I / F 143.

[0025] The control unit 141 realizes various functions, which will be described later, by executing dedicated programs stored in the storage unit 142. As an example, the control unit 141 may be implemented by a hardware processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 14 may further include a RAM, a ROM, a cache memory, and the like.

[0026] The storage unit 142 includes an auxiliary storage device and stores various types of information. The storage unit 142 may be a storage area built in the auxiliary storage device. The information stored in the storage unit 142 includes the OS, a remote control program, data used by the program, and the like.

[0027] The communication I / F 143 is a communication interface for connecting the onboard device 140 to an in-ship network, and for connecting the onboard device 140 to an outside network (for example, a WAN (Wide Area Network), which is a global public communication network such as the Internet, and Wi-Fi (registered trademark), etc.). The communication I / F 143 includes a wireless communication interface for connecting to a wireless communication network (e.g., wireless communication network). In one example, the communication I / F 143 may include a communication interface for mobile communication (e.g., 3G, LTE, 5G, 6G, etc.) and a wireless communication interface for short-range wireless communication. The communication I / F 143 of this embodiment communicates with the bow thruster 110, the right engine 120, and the left engine 130 through an inboard network. Furthermore, the communication I / F 143 of this embodiment connects to an outboard network using wireless communication and communicates with the portable terminal 2 through the outboard network.

[0028] In the vessel 1 configured as described above, the onboard device 140 controls the bow thruster 110, the right engine 120, and the left engine 130 in response to a remote signal transmitted from the mobile terminal 2. Here, when the remote signal includes a command specifying the forward (or rearward) direction as the propulsion direction and a command specifying the magnitude of the forward (or rearward) propulsive force, the control unit 141 of the onboard device 140 controls the engines to generate a propulsive force for moving the hull 10 forward (or rearward) in translation (control such that the bow thruster 110 stops and the right engine 120 and the left engine 130 generate a propulsive force for propelling the stern section forward (or rearward)). Furthermore, if the remote signal includes a command specifying the leftward (or rightward) propulsion direction and a command specifying the magnitude of the leftward (or rightward) propulsive force, the control unit 141 of the onboard device 140 controls the engines to generate propulsive force for moving the hull 10 in the leftward (or rightward) direction (controlling the bow thruster 110 to generate propulsive force for propelling the bow section in the leftward (or rightward) direction, and controlling the right engine 120 and the left engine 130 to generate propulsive force for propelling the stern section in the rightward (or leftward) direction). Furthermore, if the remote signal contains a command specifying the left turning direction (or right turning direction) as the propulsion direction and a command specifying the magnitude of the propulsive force in the left turning direction (or right turning direction), the control unit 141 of the onboard device 140 controls the engines to generate propulsive force for turning the hull 10 to the left (or right) (controlling the bow thruster 110 to generate propulsive force for propelling the bow to the left (or right), and controlling the right engine 120 and the left engine to generate propulsive force for propelling the stern to the right (or left)).

[0029] Next, we will explain the configuration of the mobile terminal 2. The mobile terminal 2 is configured as a mobile computer having a processor (CPU, GPU, etc.), a main storage device (RAM, ROM, etc.), and an auxiliary storage device (EPROM, hard disk drive, removable media, etc.). As shown in Fig. 2, such a mobile terminal 2 includes a control unit 21, a storage unit 22, a communication I / F 23, and an input / output unit 24.

[0030] The control unit 21 realizes various functions, which will be described later, by executing dedicated programs stored in the storage unit 22. As an example, the control unit 21 includes a hardware processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 21 may further include a RAM, a ROM, a cache memory, and the like.

[0031] The storage unit 22 includes an auxiliary storage device and stores various types of information. The storage unit 22 may be a storage area constructed in the auxiliary storage device. The information stored in the storage unit 22 includes an OS, an application program for remote control, and data used by the program. The application program for remote control stored in the storage unit 22 of the mobile terminal 2 corresponds to the "program" according to the present disclosure.

[0032] The communication I / F 23 includes a wireless communication interface for connecting the portable terminal 2 to a network. In one example, the communication I / F 23 may include a communication interface for mobile communication and a wireless communication interface for short-range wireless communication. The communication I / F 23 of this embodiment connects to the network using wireless communication and communicates with the onboard device 140 of the vessel 1 through the network.

[0033] The input / output unit 24 receives input operations from a user who remotely operates the boat 1, and presents information to the user. The input / output unit 24 in this embodiment includes a touch panel display 240 that is capable of inputting and outputting information.

[0034] In the mobile terminal 2 configured as described above, the control unit 21 executes the application of the storage unit 22. By executing the application program, the following functions are realized. Below, the functions realized by the mobile terminal 2 will be described with reference to Figs. 3 to 5. Fig. 3 is a diagram showing an example of a user interface screen for remote operation (hereinafter, also referred to as "remote operation screen") output on the touch panel display 240 of the mobile terminal 2. Fig. 4 is a diagram for explaining an example of a procedure for remotely operating the vessel 1 on the remote operation screen. Fig. 5 is a diagram showing an example of a method for setting the magnitude of the propulsive force during remote operation.

[0035] When a user of the mobile terminal 2 performs an operation to start an application program through the input / output unit 24, the control unit 21 executes the application program and outputs a remote operation screen to the touch panel display 240 of the input / output unit 24. As shown in FIG. 3 , the remote operation screen includes a first operation area OA31 and a second operation area OA32. The first operation area OA31 is a screen area for specifying the translational direction of the vessel 1 and the magnitude of its thrust by a slide touch operation, and may include, for example, an icon G31 that is a GUI component representing the vessel 1. The second operation area OA32 is a screen area for specifying the turning direction of the vessel 1 and the magnitude of its thrust by a slide touch operation, and may include, for example, a dial G32 that is a GUI component with a scale arranged in an arc shape.

[0036] 3, when an operation to slide an icon in the first operation area OA31 in the Y-axis direction (the up and down direction in FIG. 3) (i.e., a slide touch operation to slide the icon G31 in the Y-axis direction while touching it) is input, the control unit 21 detects the amount of sliding of the icon G31 in the Y-axis direction via the touch panel display 240. The control unit 21 sets the translation direction and propulsion amount in the fore-aft direction of the vessel 1 according to the detected amount of sliding.

[0037] 5 (A51), the touch panel display 240 in this embodiment is configured to output the amount of sliding when the icon G31 is slid upward along the Y axis as a positive value, and to output the amount of sliding when the icon G31 is slid downward along the Y axis as a negative value. Therefore, in this embodiment, if the amount of sliding of the icon G31 in the Y axis direction detected by the touch panel display 240 is a positive value, the control unit 21 sets the translation direction to the forward direction of the boat 1, and sets the propulsive force to a larger value as the absolute value of the amount of sliding increases. On the other hand, if the amount of sliding of the icon G31 in the Y axis direction detected by the touch panel display 240 is a negative value, the control unit 21 sets the translation direction to the rearward direction of the boat 1, and sets the propulsive force to a larger value as the absolute value of the amount of sliding increases.

[0038] Once the translational direction in the fore-aft direction of the vessel 1 and the magnitude of the propulsive force are set by the above-described method, the control unit 21 transmits a remote signal to the onboard device 140 to translate the vessel 1 in the forward or backward direction, as shown in (A41) in FIG. 4. The remote signal at that time includes a command to specify the forward or backward direction as the translational direction and a command to specify the magnitude of the propulsive force. The remote signal in this case corresponds to the "first command" according to the present disclosure.

[0039] 3, when an operation of sliding the icon G31 in the first operation area OA31 in the X-axis direction (left and right direction in FIG. 3) (i.e., a slide touch operation of touching and sliding the icon G31 in the X-axis direction), the control unit 21 detects the amount of sliding of the icon G31 in the X-axis direction via the touch panel display 240. The control unit 21 sets the translation direction and propulsion amount in the left and right directions of the vessel 1 according to the detected amount of sliding.

[0040] Here, as shown in (A52) of FIG. 5, the touch panel display 240 in this embodiment calculates the slide amount when the icon G31 is slid rightward along the X axis. The control unit 21 is configured to output the translation direction as a positive value, and to output the sliding amount when the icon G31 is slid downward along the X axis as a negative value. Therefore, in this embodiment, if the sliding amount of the icon G31 in the X axis direction detected by the touch panel display 240 is a positive value, the control unit 21 sets the translation direction to the right of the vessel 1, and sets the propulsive force to a value that increases as the absolute value of the sliding amount increases. On the other hand, if the sliding amount of the icon G31 in the X axis direction detected by the touch panel display 240 is a negative value, the control unit 21 sets the translation direction to the left of the vessel 1, and sets the propulsive force to a value that increases as the absolute value of the sliding amount increases.

[0041] Once the translation direction in the left-right direction of the vessel 1 and the magnitude of the propulsive force are set by the above-described method, the control unit 21 transmits a remote signal to the onboard device 140 to translate the vessel 1 to the right or left, as shown in (A42) in FIG. 4. The remote signal at that time includes a command to specify the right or left direction as the translation direction and a command to specify the magnitude of the propulsive force. The remote signal in this case corresponds to the "first command" according to the present disclosure.

[0042] Note that the slide touch operation of sliding the icon G31 in the XY axis direction in the first operation area OA31 corresponds to the "first slide touch operation" according to the present disclosure.

[0043] 3, when an operation to rotate the dial G32 in the second operation area OA32 in a circumferential direction (i.e., a slide touch operation to slide the dial G32 in a circumferential direction while touching it) is input, the control unit 21 detects the amount of rotation (slide amount) of the dial G32 through the touch panel display 240. The control unit 21 sets the turning direction and propulsion amount in the left-right direction of the vessel 1 according to the detected slide amount of the dial G32.

[0044] 5 (A53), the touch panel display 240 in this embodiment is configured to output the sliding amount when the dial G32 is slid clockwise as a positive value, and to output the sliding amount when the dial G32 is slid counterclockwise as a negative value. Therefore, in this embodiment, if the sliding amount of the dial G32 detected by the touch panel display 240 is a positive value, the control unit 21 sets the turning direction to the right of the boat 1, and sets the propulsive force to a larger value as the absolute value of the sliding amount increases. On the other hand, if the sliding amount of the dial G32 detected by the touch panel display 240 is a negative value, the control unit 21 sets the turning direction to the left of the boat 1, and sets the propulsive force to a larger value as the absolute value of the sliding amount increases.

[0045] Once the turning direction in the left-right direction of the vessel 1 and the magnitude of the propulsive force are set by the above-described method, the control unit 21 transmits a remote signal to the onboard device 140 to turn the vessel 1 to the right or left, as shown in (A43) in FIG. 4. The remote signal at this time includes a command to specify the right or left direction as the turning direction and a command to specify the magnitude of the propulsive force. The remote signal in this case corresponds to the "second command" according to the present disclosure.

[0046] The slide touch operation of sliding the dial G32 in the circumferential direction in the second operation area OA32 corresponds to the "second slide touch operation" according to the present disclosure.

[0047] In setting the magnitude of the propulsive force, the propulsive force may be set to a value greater than zero on the condition that the absolute value of the slide amount of the icon G31 and the dial G32 is greater than zero, as shown by the thick solid line in Fig. 5. Alternatively, the propulsive force may be set to a value greater than zero on the condition that the absolute value of the slide amount of the icon G31 and the dial G32 is greater than a predetermined value dz1, as shown by the thick dashed dotted line in Fig. 5. In other words, a dead band of the predetermined value dz1 is set for the slide amount of the icon G31 and the dial G32. It is fine to do so.

[0048] Furthermore, to translate the boat 1 in a diagonal direction (for example, right front, right rear, left front, and left rear), the user simply slides the icon G31 in the first operation area OA31 diagonally. In this case, the control unit 21 of the mobile terminal 2 detects the amount of sliding in the X-axis direction and the amount of sliding in the Y-axis direction via the touch panel display 240, and sets the translation direction of the boat 1 and the magnitude of the propulsive force according to the detected amount of sliding in the X-axis direction and the Y-axis direction.

[0049] Furthermore, when remotely controlling the translation and rotation of the vessel 1 simultaneously, the user can simultaneously perform an operation to slide the icon G31 in the first operation area OA31 in the XY axis directions and an operation to slide the dial G32 in the second operation area OA32 in the circumferential direction. In this case, the control unit 21 of the terminal can set the translation direction and the magnitude of the translational thrust force according to the amount of sliding of the icon G31, and can also set the rotation direction and the magnitude of the rotational thrust force according to the amount of sliding of the dial G32.

[0050] In addition, when one remote operation is performed and then another remote operation is performed, the control unit 21 of the mobile terminal 2 may return the position of the icon G31 in the first operation area OA31 and the position of the dial G32 in the second operation area OA32 to their default positions after one remote operation is performed.

[0051] (Processing flow) Here, the flow of processing executed by the portable terminal 2 in this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of a processing routine executed by the portable terminal 2 in response to the launch of an application program for remote control.

[0052] 6, the control unit 21 of the mobile terminal 2 first outputs the remote operation screen described above in the description of FIG. 3 to the touch panel display 240 of the input / output unit 24 (step S101). After completing the process of step S101, the control unit 21 executes the process of step S102.

[0053] In step S102, the control unit 21 determines whether a slide touch operation has been input on the remote operation screen. At that time, if a slide touch operation has not yet been input on the remote operation screen (negative determination in step S102), the control unit 21 waits until a slide touch operation is input. On the other hand, if a slide touch operation has been input on the remote operation screen (positive determination in step S102), the control unit 21 executes the process of step S103.

[0054] In step S103, the control unit 21 determines whether the input slide touch operation is an operation performed in the first operation area OA31 (an operation of sliding the icon G31 in the X-axis direction and the Y-axis direction) via the touch panel display 240. If the input slide touch operation is an operation of sliding the icon G31 in the X-axis direction and the Y-axis direction (positive determination in step S103), the control unit 21 executes the processes of steps S104-S105. On the other hand, if the input slide touch operation is not an operation performed in the first operation area OA31 but an operation performed in the second operation area OA32 (an operation of sliding the dial G32 in the circumferential direction) (negative determination in step S103), the control unit 21 executes the processes of steps S106-S107.

[0055] Here, the processing of steps S104-S105 will be described first. In step S104, the control unit 21 sets the translational direction of the boat 1 in accordance with the output value of the touch panel display 240. In detail, the control unit 21 first Depending on the output value, it is determined whether the sliding direction of the icon G31 is the Y-axis direction or the X-axis direction.

[0056] When the sliding direction of the icon G31 is the Y-axis direction, the control unit 21 determines whether the sliding amount in the Y-axis direction detected by the touch panel display 240 is a positive value or a negative value. When the sliding amount in the Y-axis direction detected by the touch panel display 240 is a positive value, the control unit 21 sets the translation direction to the forward direction of the boat 1. On the other hand, when the sliding amount in the Y-axis direction detected by the touch panel display 240 is a negative value, the control unit 21 sets the translation direction to the rearward direction of the boat 1.

[0057] Furthermore, when the sliding direction of the icon G31 is the X-axis direction, the control unit 21 determines whether the amount of sliding in the X-axis direction detected by the touch panel display 240 is a positive value or a negative value. When the amount of sliding in the X-axis direction detected by the touch panel display 240 is a positive value, the control unit 21 sets the translation direction to the right of the vessel 1. On the other hand, when the amount of sliding in the X-axis direction detected by the touch panel display 240 is a negative value, the control unit 21 sets the translation direction to the left of the vessel 1.

[0058] After completing the process of step S104, control unit 21 executes the process of step S105. In step S105, control unit 21 sets the magnitude of the thrust in the translation direction according to the absolute value of the amount of sliding detected by touch panel display 240. In one example, as described with reference to FIG. 5, control unit 21 sets the thrust to be larger the greater the absolute value of the amount of sliding. In this case, the magnitude of the thrust may be set to be proportional to the absolute value of the amount of sliding, or may be set to a value that increases stepwise as the absolute value of the amount of sliding increases, or may be set to a value that increases exponentially as the absolute value of the amount of sliding increases.

[0059] Next, the processing of steps S106-S107 will be described. In step S106, the control unit 21 sets the turning direction of the vessel 1 in accordance with the output value of the touch panel display 240. That is, the control unit 21 sets the turning direction of the vessel 1 in accordance with the slide amount of the dial G32 detected by the touch panel display 240. Here, if the slide amount of the dial G32 detected by the touch panel display 240 is a positive value, the control unit 21 sets the turning direction to the right of the vessel 1. On the other hand, if the slide amount of the dial G32 detected by the touch panel display 240 is a negative value, the control unit 21 sets the turning direction to the left of the vessel 1. After completing the processing of step S106, the control unit 21 executes the processing of step S107.

[0060] In step S107, control unit 21 sets the magnitude of the propulsive force in the turning direction according to the absolute value of the amount of sliding detected by touch panel display 240. In this example, as described with reference to Fig. 5, control unit 21 sets the propulsive force to be larger the greater the absolute value of the amount of sliding. In this case, the magnitude of the propulsive force may be set to be proportional to the absolute value of the amount of sliding, or may be set to a value that increases stepwise as the absolute value of the amount of sliding increases, or may be set to a value that increases exponentially as the absolute value of the amount of sliding increases.

[0061] After completing the process of step S105 or step S107, the control unit 21 executes the process of step S108. In step S108, the control unit 21 generates a remote signal including a command specifying the translation direction set in step S104 or the rotation direction set in step S106, and a command specifying the magnitude of the thrust in the translation direction set in step S105 or the magnitude of the thrust in the rotation direction set in step S107. After completing the process of step S108, the control unit 21 executes the process of step S109. .

[0062] In step S109, the control unit 21 transmits the remote signal generated in step S108 to the onboard device 140 of the vessel 1 that is the target of remote operation via the communication I / F 23. After completing the processing of step S109, the control unit 21 ends the execution of this processing routine. Note that after executing the processing of step S108, the control unit 21 may repeatedly execute the processing from step S101 onwards.

[0063] According to the remote vessel maneuvering system described above, a user can remotely control the translation and rotation of the vessel 1 by inputting a slide touch operation in the first operation area OA31 and the second operation area OA32 on the remote operation screen displayed on the mobile terminal 2. The slide touch operation in this case is sufficient to slide the icon G31 or the dial G32, so the user does not need to focus on the remote operation screen. As a result, the operability when remotely operating the vessel 1 can be improved.

[0064] <Other> The above-described embodiment and modified examples are merely examples, and the present disclosure may be modified and implemented as appropriate within the scope of the present disclosure. For example, the dials G32 in the second operation area OA32 are not limited to being arranged in an arc shape and may be arranged in a linear shape. Furthermore, instead of the dials G32, a slider GUI component may be displayed in the second operation area OA32. In this case, the slider may be shaped to extend in an arc shape or a linear shape. Furthermore, the icon G31 and the dial G32 may not be displayed in the first operation area OA31 and the second operation area OA32. In this case, the user may simply perform a slide touch operation at any position in the first operation area OA31 and the second operation area OA32. The control unit 21 of the portable terminal 2 may then set the translation direction, rotation direction, and magnitude of the propulsive force according to the slide direction and slide amount of the slide touch operation.

[0065] The present disclosure can also be realized by supplying a computer program (information processing program) that implements the functions described in the above embodiments to a computer, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus, or via a network. A non-transitory computer-readable storage medium is a recording medium that stores information such as data and programs through electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer or the like. Examples of such a recording medium include any type of disk, such as a magnetic disk (such as a floppy disk or HDD) or an optical disk (such as a CD-ROM, DVD disk, or Blu-ray disk). Furthermore, the recording medium may be a ROM, RAM, EPROM, EEPROM, magnetic card, flash memory, optical card, or solid-state drive (SSD). The medium may be other media. [Explanation of symbols]

[0066] 1. Ship, 10. Hull, 110. Bow thruster, 120. Right engine, 130. Left engine, 140. Onboard equipment, 2. Mobile terminal, 21. Control unit, 22. Memory unit, 23. Communication I / F, 24. Input / output unit, 240. Touch panel display

Claims

1. An information processing method for remotely operating a vessel using a mobile terminal equipped with a touch panel display, comprising: The mobile terminal, outputting a user interface screen including a first operation area and a second operation area to the touch panel display; transmitting a first command to the marine vessel in response to detecting a slide touch operation in the first operation area; and transmitting a second command to the marine vessel in response to detecting a slide touch operation in the second operation area; and To execute Information processing methods.

2. the first operation area includes an icon corresponding to the vessel; transmitting the first command to the vessel detecting a first slide touch operation of touching and sliding the icon; determining a translation direction of the marine vessel in accordance with a sliding direction of the first sliding touch operation; determining a magnitude of a thrust force in the translation direction in accordance with a slide amount of the first sliding touch operation; transmitting the first command to the vessel, the first command including the translational direction and the magnitude of the propulsive force; Including, The information processing method according to claim 1 .

3. the second operation area includes a GUI component for selecting a turning direction of the vessel; transmitting the second command to the vessel detecting a second slide touch operation of touching and sliding the GUI component; determining the rotation direction according to a sliding direction of the second sliding touch operation; determining a magnitude of the propulsive force in the turning direction in accordance with a slide amount of the second sliding touch operation; transmitting the second command to the vessel, the second command including the turning direction and the magnitude of the propulsive force; Including, The information processing method according to claim 1 .

4. A program for causing a computer to execute the information processing method according to any one of claims 1 to 3.

Images