Information processing method and program

Abstract

To provide a technique that is able to enhance operability when remotely operating a ship.SOLUTION: In an information processing method for remotely operating a ship by using a mobile terminal, the mobile terminal outputs a user interface screen including a first operation region and a second operation region, to a touch panel display. The mobile terminal transmits a first command for translating the ship to the ship in response to detection of a slide touch operation in the first operation region. Further, the mobile terminal transmits a second command for turning the ship to the ship in response to detection of a slide touch operation in the second operation region.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present disclosure relates to an information processing method and a program.

Background Art

[0002] A technology is known that performs operation of the course, thrust and the like of a ship on an operation screen displayed on a tablet terminal (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] An object of the present disclosure is to provide a technology capable of improving operability when remotely operating a ship.

Means for Solving the Problem

[0005] One aspect of the present disclosure is an information processing method for remotely operating a ship using a mobile terminal provided with a touch panel display. The information processing method in this case is, for example, the mobile terminal: outputting a user interface screen including a first operation area and a second operation area to the touch panel display; transmitting a first command for translating the ship to the ship in response to detecting a slide touch operation in the first operation area; transmitting a second command for turning the ship to the ship in response to detecting a slide touch operation in the second operation area; may be configured to execute the above steps.

[0006] Other embodiments of this disclosure may include an information processing program for causing a computer to execute the information processing method described above, or a non-temporary storage medium for storing said information processing program. [Effects of the Invention]

[0007] This disclosure provides a technology that can improve the operability when remotely controlling a vessel. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram schematically shows an example of the configuration of a remote ship handling system in an embodiment. [Figure 2] This diagram schematically shows an example of the configuration of the ship and the portable terminal in the embodiment. [Figure 3] This figure shows an example of a remote control screen in an embodiment. [Figure 4] This figure illustrates an example of the procedure for remotely controlling a vessel using a remote control screen in an embodiment. [Figure 5] This figure illustrates an example of a method for setting the magnitude of the thrust force in an embodiment. [Figure 6] This flowchart shows an example of a processing routine executed on a mobile terminal in the embodiment. [Modes for carrying out the invention]

[0009] Development is underway on technologies that allow for the remote control of vessels using mobile devices such as smartphones or tablets. As an example, a known technology involves displaying an operation screen on a mobile device that includes a large number of GUI components, such as display fields for multiple pieces of information indicating the vessel's status, multiple buttons for selecting the magnitude of the vessel's thrust, and multiple buttons for selecting the vessel's course. The thrust magnitude and course selected by the user on this operation screen are then transmitted wirelessly from the mobile device to the vessel. Such technology allows a user to operate the vessel while visually monitoring the surrounding conditions from a location away from the cockpit (e.g., the deck). However, in the above example, because a wide variety of GUI components are displayed on the operation screen, the user needs to keep their eyes on the operation screen while performing remote operation, leaving room for improvement in terms of usability.

[0010] One aspect of this disclosure is an information processing method for remotely controlling a vessel using a mobile terminal equipped with a touch panel display. In the information processing method according to this disclosure, the mobile terminal outputs a user interface screen including a first operation area and a second operation area to the touch panel display. In one example, the user interface screen may be a screen obtained by dividing the display screen of the touch panel display into a first operation area and a second operation area. In this case, it is desirable that the user interface screen be configured so that the first operation area and the second operation area can be distinguished by sight. Furthermore, each of the first operation area and the second operation area is a screen area for a user remotely controlling the vessel to input slide-touch operations. In one example, the first operation area may include an icon corresponding to the vessel. Furthermore, in one example, the second operation area may include a GUI component that allows the user to select the turning direction of the vessel by slide-touch operation.

[0011] In the information processing method relating to this disclosure, a mobile terminal transmits a first command to a vessel to translate the vessel in response to the detection of a slide-touch operation in a first operation area. Here, if the first operation area is configured to include an icon corresponding to a vessel, the mobile terminal may perform the following actions: detect a first slide-touch operation in which the mobile terminal slides while touching the icon; determine the translational direction of the vessel according to the sliding direction of the first slide-touch operation; determine the magnitude of the thrust in the translational direction according to the amount of the slide of the first slide-touch operation; and transmit a first command to the vessel including the determined translational direction and the magnitude of the thrust.

[0012] Furthermore, in the information processing method relating to this disclosure, when a mobile terminal detects a slide-touch operation in the second operation area, it transmits a second command to the vessel to turn the vessel. Here, if the second operation area is configured to include a GUI component for selecting the turning direction of the vessel, the mobile terminal may perform the following actions: detect a second slide-touch operation in which the mobile terminal slides while touching the GUI component; determine the turning direction of the vessel according to the sliding direction of the second slide-touch operation; determine the magnitude of the thrust force in the turning direction according to the amount of sliding of the second slide-touch operation; and transmit a second command to the vessel including the determined turning direction and the magnitude of the thrust force.

[0013] According to the information processing method described herein, the translation and / or turning operations of a vessel can be performed remotely by inputting slide-touch operations into the first operation area and / or the second operation area on the user interface screen displayed on the touch panel display of a mobile terminal. This eliminates the need for the user to constantly monitor the display screen of the touch panel display when remotely operating the vessel, thereby improving the operability of remote operation.

[0014] Hereinafter, specific embodiments of the present disclosure will be described with reference to the drawings. Unless otherwise stated, the hardware configuration, module configuration, functional configuration, etc. described in the following embodiments are not intended to limit the technical scope of the present disclosure only thereto.

[0015] <Embodiment> In the present embodiment, an example in which the present disclosure is applied to a remote ship maneuvering system will be described. The remote ship maneuvering system in the present embodiment is a system for remotely operating a ship using a mobile terminal. (Outline of Remote Ship Maneuvering System) Figure 1 is a diagram showing an outline of the remote ship maneuvering system according to the present disclosure. As shown in Figure 1, the remote ship maneuvering system according to the present disclosure includes a ship 1 and a mobile terminal 2.

[0016] The ship 1 includes a bow thruster 110 mounted on the bow of a hull 10, two engines 120-130 mounted on the stern of the hull 10, and an on-board device 140. The bow thruster 110 is a propulsion device that generates propulsive force for propelling the bow of the hull 10 in the left-right direction. The engines 120-130 are propellers that generate propulsive force for propelling the stern of the hull 10 in the front-rear direction. Hereinafter, of the two engines 120-130, the engine 120 installed on the right side of the hull 10 is referred to as the right engine 120, and the engine 130 installed on the left side of the hull 10 is referred to as the left engine 130. In the description of the present embodiment, the bow thruster 110, the right engine 120, and the left engine 130 may also be collectively referred to as "engines". The on-board device 140 is a computer that controls the engines in accordance with remote signals transmitted from the mobile terminal 2. The remote signal is a signal including a command specifying the propulsion direction of the ship 1 and a command specifying the magnitude of the propulsive force in the propulsion direction.

[0017] The configuration of the ship 1 is not limited to the example shown in Figure 1. As long as the configuration enables translation in the front-rear and left-right directions and turning in the left-right direction, the arrangement and number of engines may be appropriately changed according to the embodiment.

[0018] The ship 1 configured as described above moves forward (translates forward) when the bow thruster 110 is stopped, and the right engine 120 and the left engine 130 generate a propulsive force that propels the stern forward. The ship 1 moves backward (translates backward) when the bow thruster 110 is stopped, and the right engine 120 and the left engine 130 generate a propulsive force that propels the hull 10 backward. The ship 1 translates leftward when the bow thruster 110 generates a propulsive force that propels the bow leftward, and the right engine 120 and the left engine 130 generate a propulsive force that propels the stern rightward (the right engine 120 generates a propulsive force that propels the hull 10 backward, and the left engine 130 generates a propulsive force that propels the hull 10 forward). The ship 1 translates rightward when the bow thruster 110 generates a propulsive force that propels the bow rightward, and the right engine 120 and the left engine 130 generate a propulsive force that propels the stern leftward (the right engine 120 generates a propulsive force that propels the hull 10 forward, and the left engine 130 generates a propulsive force that propels the hull 10 backward). The ship 1 turns leftward when the bow thruster 110 generates a propulsive force that propels the bow leftward, and the right engine 120 and the left engine generate a propulsive force that propels the stern rightward (the right engine 120 generates a propulsive force that propels the hull 10 forward, and the left engine 130 generates a propulsive force that propels the hull 10 backward). The ship 1 turns rightward when the bow thruster 110 generates a propulsive force that propels the bow rightward, and the right engine 120 and the left engine generate a propulsive force that propels the stern leftward (the right engine 120 generates a propulsive force that propels the hull 10 backward, and the left engine 130 generates a propulsive force that propels the hull 10 forward).

[0019] The mobile terminal 2 is a portable computer used by a user who remotely operates the ship 1, such as a smartphone or a tablet terminal. The mobile terminal 2 in the present embodiment is equipped with a touch panel display 240 as an input / output device. In the following description, the left-right direction when the surface of the mobile terminal 2 provided with the touch panel display 240 is viewed from the front is defined as the X-axis The vertical direction will be referred to as the Y-axis.

[0020] The mobile terminal 2 of this embodiment has the function of outputting (displaying) a user interface screen for remote operation on a touch panel display 240, the function of detecting slide touch operations entered on the user interface screen, and the function of transmitting a signal including a command corresponding to the detected slide touch operation to the ship 1 (onboard equipment 140). Details of the user interface screen, slide touch operation detection, and remote signal transmission will be described later.

[0021] According to the remote operation system of this embodiment, the user can remotely operate the vessel 1 by inputting slide-touch operations on the user interface screen displayed on the touch panel display 240 of the mobile terminal 2.

[0022] (Configuration of the remote control system) Here, the configuration of the ship 1 and the mobile terminal 2 included in the remote operation system will be explained based on Figure 2. Figure 2 is a schematic diagram showing an example of the configuration of each of the ship 1 and the mobile terminal 2.

[0023] As described above, the vessel 1 in this embodiment is equipped with a bow thruster 110, a right engine 120, a left engine 130, and onboard equipment 140. The onboard equipment 140 is equipped with CAN (Controller Area Network), LIN (Local Interconnect Network), or FlexRay It is connected to the bow thruster 110, the right engine 120, and the left engine 130 via an onboard network based on standards such as those mentioned above.

[0024] In this embodiment, the onboard device 140 is configured as a computer having a processor (CPU or GPU, etc.), main memory (RAM and ROM, etc.), and auxiliary memory (EPROM, hard disk drive, and removable media, etc.). As shown in Figure 2, such an onboard device 140 is configured to include a control unit 141, a storage unit 142, and a communication interface 143, etc.

[0025] The control unit 141 implements various functions, as described later, by executing a dedicated program stored in the memory unit 142. For example, the control unit 141 is a hardware processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 14 is configured to include the following: Furthermore, the control unit 14 may further include RAM, ROM, and cache memory, etc.

[0026] The memory unit 142 is configured to include an auxiliary storage device and stores various types of information. The memory unit 142 may also be a memory area constructed within the auxiliary storage device. The information stored in the memory unit 142 includes the OS, a remote control program, and data used by that program.

[0027] Communication I / F143 is a communication interface for connecting the onboard equipment 140 to the shipboard network, and for connecting the onboard equipment 140 to an external network (for example, a global public communication network such as the Internet, a WAN (Wide Area Network), and Wi-Fi (registered trademark), etc.). It includes a wireless communication interface for connecting to a wireless communication network (such as a wireless communication network). In one example, the communication I / F 143 may include a communication interface for mobile communication (e.g., 3G, LTE, 5G, 6G, etc.) and a wireless communication interface for short-range wireless communication. The communication I / F 143 of this embodiment communicates with the bow thruster 110, the right engine 120, and the left engine 130 through the onboard network. Furthermore, the communication I / F 143 of this embodiment connects to an offboard network using wireless communication and communicates with the mobile terminal 2 through the offboard network.

[0028] In the vessel 1 configured as described above, the onboard equipment 140 controls the bow thruster 110, the right engine 120, and the left engine 130 in response to remote signals transmitted from the mobile terminal 2. When the remote signals include a command specifying the forward (or aft) direction of propulsion and a command specifying the magnitude of the forward (or aft) thrust, the control unit 141 of the onboard equipment 140 controls the engines to generate a thrust force that moves the hull 10 forward (or aft) (the bow thruster 110 stops, and the right engine 120 and the left engine 130 generate a thrust force that propels the stern forward (or aft). Furthermore, if the remote signal includes a command specifying the leftward (or rightward) direction of propulsion and a command specifying the magnitude of the leftward (or rightward) thrust, the control unit 141 of the shipboard equipment 140 controls the engines to generate thrust that will move the hull 10 to the leftward (or rightward) direction (controlling the bow thruster 110 to generate thrust that propels the bow to the leftward (or rightward) direction, and the right engine 120 and the left engine 130 to generate thrust that propels the stern to the rightward (or leftward) direction). Furthermore, if the remote signal includes a command specifying a left turn (or right turn) as the direction of propulsion and a command specifying the magnitude of the thrust in the left turn (or right turn), the control unit 141 of the onboard equipment 140 controls the engines to generate thrust to turn the hull 10 to the left (or right) (controlling the bow thruster 110 to generate thrust to propel the bow to the left (or right), and the right engine 120 and the left engine to generate thrust to propel the stern to the right (or left)).

[0029] Next, the configuration of the mobile terminal 2 will be described. The mobile terminal 2 is configured as a portable computer having a processor (CPU or GPU, etc.), main memory (RAM and ROM, etc.), and auxiliary memory (EPROM, hard disk drive, and removable media, etc.). As shown in Figure 2, such a mobile terminal 2 is configured to include a control unit 21, a storage unit 22, a communication interface 23, and an input / output unit 24.

[0030] The control unit 21 implements various functions, as described later, by executing a dedicated program stored in the memory unit 22. As an example, the control unit 21 includes a hardware processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). It is composed of the above. The control unit 21 may also be configured to include RAM, ROM, and cache memory, etc.

[0031] The memory unit 22 is configured to include an auxiliary storage device and stores various types of information. The memory unit 22 may also be a storage area constructed within the auxiliary storage device. The information stored in the memory unit 22 includes the OS, an application program for remote control, and data used by that program. The application program for remote control stored in the memory unit 22 of the mobile terminal 2 corresponds to the "program" in this disclosure.

[0032] The communication interface 23 includes a wireless communication interface for connecting the mobile terminal 2 to the network. In one example, the communication interface 23 may include a communication interface for mobile communication and a wireless communication interface for short-range wireless communication. The communication interface 23 in this embodiment connects to the network using wireless communication and communicates with the onboard equipment 140 of the ship 1 through the network.

[0033] The input / output unit 24 receives input operations from a user remotely controlling the vessel 1 and presents information to the user. In this embodiment, the input / output unit 24 includes an input / output capable touch panel display 240.

[0034] In the mobile terminal 2 configured as described above, the control unit 21 controls the application of the storage unit 22. By executing the program, the following functions are realized. Below, the functions realized on the mobile terminal 2 will be explained with reference to Figures 3-5. Figure 3 is a diagram showing an example of a user interface screen for remote control (hereinafter sometimes referred to as the "remote control screen") output to the touch panel display 240 of the mobile terminal 2. Figure 4 is a diagram illustrating an example of the procedure for remotely controlling the ship 1 on the remote control screen. Figure 5 is a diagram showing an example of a method for setting the magnitude of the thrust force in remote control.

[0035] In the mobile terminal 2, when a user performs an operation to launch an application program through the input / output unit 24, the control unit 21 outputs a remote control screen to the touch panel display 240 of the input / output unit 24 through the execution of the application program. The remote control screen includes a first operation area OA31 and a second operation area OA32, as shown in Figure 3. The first operation area OA31 is a screen area for specifying the translational direction of the vessel 1 and the magnitude of its thrust by slide-touch operation, and in one example, it may include an icon G31, which is a GUI component representing the vessel 1. The second operation area OA32 is a screen area for specifying the turning direction of the vessel 1 and the magnitude of its thrust by slide-touch operation, and in one example, it may include a dial G32, which is a GUI component with scales arranged in an arc shape.

[0036] On the remote control screen as illustrated in Figure 3, when an operation to slide the icon in the first operation area OA31 in the Y-axis direction (up and down direction in Figure 3) is input (i.e., a slide-touch operation in which the icon G31 is touched and slid in the Y-axis direction), the control unit 21 detects the amount of slide of the icon G31 in the Y-axis direction via the touch panel display 240. The control unit 21 sets the translational direction and propulsion amount in the longitudinal direction of the ship 1 according to the detected slide amount.

[0037] In this embodiment, the touch panel display 240 is configured to output a positive value for the amount of slide when the icon G31 slides upward along the Y-axis, as shown in Figure 5 (A51), and a negative value for the amount of slide when the icon G31 slides downward along the Y-axis. Therefore, in this embodiment, if the amount of slide of the icon G31 in the Y-axis direction detected by the touch panel display 240 is positive, the control unit 21 sets the translation direction to the forward direction of the ship 1 and sets the thrust force to a larger value the larger the absolute value of the slide. On the other hand, if the amount of slide of the icon G31 in the Y-axis direction detected by the touch panel display 240 is negative, the control unit 21 sets the translation direction to the rearward direction of the ship 1 and sets the thrust force to a larger value the larger the absolute value of the slide.

[0038] Once the translational direction and thrust magnitude of the vessel 1 in the longitudinal direction are set by the method described above, the control unit 21 transmits a remote signal to the onboard device 140 to move the vessel 1 forward or backward, as shown in Figure 4 (A41). The remote signal includes a command specifying the forward or backward direction as the translational direction, and a command specifying the thrust magnitude. In this case, the remote signal corresponds to the "first command" in this disclosure.

[0039] Furthermore, when an operation to slide the icon G31 of the first operation area OA31 in the X-axis direction (left-right direction in Figure 3) is input on the remote control screen as illustrated in Figure 3 (i.e., a slide-touch operation in which the icon G31 is touched and slid in the X-axis direction), the control unit 21 detects the amount of slide of the icon G31 in the X-axis direction via the touch panel display 240. The control unit 21 sets the translational direction and propulsion amount of the ship 1 in the left-right direction according to the detected slide amount.

[0040] Here, in this embodiment, the touch panel display 240, as shown in Figure 5 (A52), determines the amount of slide when the icon G31 is slid to the right along the X axis. The system is configured to output a positive value and a negative value for the amount of slide when icon G31 slides downward along the X-axis. Therefore, in this embodiment, if the amount of slide of icon G31 in the X-axis direction detected by the touch panel display 240 is positive, the control unit 21 sets the translation direction to the right of the ship 1 and sets the thrust force to a larger value the larger the absolute value of the slide. On the other hand, if the amount of slide of icon G31 in the X-axis direction detected by the touch panel display 240 is negative, the control unit 21 sets the translation direction to the left of the ship 1 and sets the thrust force to a larger value the larger the absolute value of the slide.

[0041] Once the translational direction and thrust magnitude of the vessel 1 in the left-right direction are set by the method described above, the control unit 21 transmits a remote signal to the onboard device 140 to translate the vessel 1 to the right or left, as shown in Figure 4 (A42). The remote signal includes a command specifying the right or left direction as the translational direction, and a command specifying the thrust magnitude. In this case, the remote signal corresponds to the "first command" in this disclosure.

[0042] Furthermore, a slide-touch operation in which icon G31 is slid in the XY axis direction within the first operation area OA31 corresponds to the "first slide-touch operation" described herein.

[0043] Furthermore, when an operation to rotate the dial G32 of the second operation area OA32 in the circumferential direction is input on the remote control screen as illustrated in Figure 3 (i.e., a slide-touch operation in which the dial G32 is touched and slid in the circumferential direction), the control unit 21 detects the amount of rotation (slide amount) of the dial G32 through the touch panel display 240. The control unit 21 sets the turning direction and propulsion amount of the vessel 1 in the left-right direction according to the detected slide amount of the dial G32.

[0044] In this embodiment, the touch panel display 240 is configured to output a positive value for the amount of slide when the dial G32 is slid clockwise, and a negative value for the amount of slide when the dial G32 is slid counterclockwise, as shown in Figure 5 (A53). Therefore, in this embodiment, if the amount of slide of the dial G32 detected by the touch panel display 240 is positive, the control unit 21 sets the turning direction to the right of the vessel 1 and sets the thrust force to a larger value the larger the absolute value of the slide. On the other hand, if the amount of slide of the dial G32 detected by the touch panel display 240 is negative, the control unit 21 sets the turning direction to the left of the vessel 1 and sets the thrust force to a larger value the larger the absolute value of the slide.

[0045] Once the turning direction and thrust magnitude of the vessel 1 in the left-right direction are set by the method described above, the control unit 21 transmits a remote signal to the onboard device 140 to turn the vessel 1 to the right or left, as shown in Figure 4 (A43). The remote signal includes a command specifying the right or left direction as the turning direction, and a command specifying the thrust magnitude. In this case, the remote signal corresponds to the "second command" in this disclosure.

[0046] Furthermore, a slide-touch operation in which the dial G32 is circumferentially slid in the second operating area OA32 corresponds to the "second slide-touch operation" described herein.

[0047] Furthermore, when setting the magnitude of the thrust, as shown by the thick solid line in Figure 5, the thrust may be set to a value greater than zero, provided that the absolute value of the slide amount of icon G31 and dial G32 is greater than zero. Alternatively, as shown by the thick dashed line in Figure 5, the thrust may be set to a value greater than zero, provided that the absolute value of the slide amount of icon G31 and dial G32 is greater than a predetermined value dz1. In other words, a dead zone of a predetermined value dz1 is set for the slide amount of icon G31 and dial G32. You may do that.

[0048] Furthermore, to move the vessel 1 diagonally (for example, forward right, rear right, forward left, and rear left), the user simply slides the icon G31 in the first operation area OA31 diagonally. In this case, the control unit 21 of the mobile terminal 2 detects the amount of slide in the X-axis direction and the Y-axis direction through the touch panel display 240, and sets the translation direction of the vessel 1 and the magnitude of the thrust according to the detected amount of slide in the X-axis direction and the Y-axis direction.

[0049] Furthermore, when remotely controlling the translation and turning of the vessel 1 simultaneously, the user only needs to simultaneously slide the icon G31 in the first operation area OA31 in the XY axis direction and slide the dial G32 in the second operation area OA32 in the circumferential direction. In this case, the terminal control unit 21 should set the translation direction and the magnitude of the translational thrust according to the amount the icon G31 is slid, and set the turning direction and the magnitude of the turning thrust according to the amount the dial G32 is slid.

[0050] Furthermore, if another remote operation is performed after one remote operation has been performed, the control unit 21 of the mobile terminal 2 may reset the position of the icon G31 in the first operation area OA31 and the position of the dial G32 in the second operation area OA32 to their default positions after the first remote operation has been performed.

[0051] (Process flow) Here, the processing flow executed on the mobile terminal 2 in this embodiment will be explained with reference to Figure 6. Figure 6 is a flowchart showing an example of a processing routine executed on the mobile terminal 2 in response to the launch of the remote control application program.

[0052] In the processing routine shown in Figure 6, the control unit 21 of the mobile terminal 2 first outputs the remote control screen described in Figure 3 above to the touch panel display 240 of the input / output unit 24 (step S101). After completing the processing in step S101, the control unit 21 executes the processing in step S102.

[0053] In step S102, the control unit 21 determines whether a slide touch operation has been input on the remote control screen. If no slide touch operation has been input on the remote control screen (negative determination in step S102), the control unit 21 waits until a slide touch operation is input. If a slide touch operation has been input on the remote control screen (positive determination in step S102), the control unit 21 executes the process in step S103.

[0054] In step S103, the control unit 21 determines, via the touch panel display 240, whether the input slide touch operation is an operation performed in the first operation area OA31 (an operation to slide icon G31 in the XY axis direction). If the input slide touch operation is an operation to slide icon G31 in the XY axis direction (affirmative determination in step S103), the control unit 21 executes the processes in steps S104-S105. On the other hand, if the input slide touch operation is not an operation performed in the first operation area OA31 but an operation performed in the second operation area OA32 (an operation to slide dial G32 in the circumferential direction) (negative determination in step S103), the control unit 21 executes the processes in steps S106-S107.

[0055] Here, we will first explain the process in steps S104-S105. In step S104, the control unit 21 sets the translational direction of the ship 1 according to the output value of the touch panel display 240. In detail, the control unit 21 first... Based on the output value, it is determined whether the sliding direction of icon G31 is along the Y-axis or the X-axis.

[0056] If the sliding direction of icon G31 is the Y-axis direction, the control unit 21 determines whether the amount of sliding in the Y-axis direction detected by the touch panel display 240 is positive or negative. If the amount of sliding in the Y-axis direction detected by the touch panel display 240 is positive, the control unit 21 sets the translation direction to the forward direction of the ship 1. On the other hand, if the amount of sliding in the Y-axis direction detected by the touch panel display 240 is negative, the control unit 21 sets the translation direction to the rearward direction of the ship 1.

[0057] Furthermore, if the sliding direction of icon G31 is the X-axis direction, the control unit 21 determines whether the amount of sliding in the X-axis direction detected by the touch panel display 240 is positive or negative. If the amount of sliding in the X-axis direction detected by the touch panel display 240 is positive, the control unit 21 sets the translation direction to the right of the ship 1. On the other hand, if the amount of sliding in the X-axis direction detected by the touch panel display 240 is negative, the control unit 21 sets the translation direction to the left of the ship 1.

[0058] After completing the process in step S104, the control unit 21 executes the process in step S105. In step S105, the control unit 21 sets the magnitude of the thrust force in the translational direction according to the absolute value of the slide amount detected by the touch panel display 240. In one example, as explained with reference to Figure 5, the control unit 21 sets the thrust force to be larger the larger the absolute value of the slide amount. In this case, the magnitude of the thrust force may be set to be proportional to the absolute value of the slide amount, or it may be set to a value that increases in stages as the absolute value of the slide amount increases, or it may be set to a value that increases exponentially as the absolute value of the slide amount increases.

[0059] Next, the processes in steps S106-S107 will be explained. In step S106, the control unit 21 sets the turning direction of the vessel 1 according to the output value of the touch panel display 240. That is, the control unit 21 sets the turning direction of the vessel 1 according to the amount of slide of the dial G32 detected by the touch panel display 240. If the amount of slide of the dial G32 detected by the touch panel display 240 is a positive value, the control unit 21 sets the turning direction of the vessel 1 to the right. On the other hand, if the amount of slide of the dial G32 detected by the touch panel display 240 is a negative value, the control unit 21 sets the turning direction of the vessel 1 to the left. After completing the process in step S106, the control unit 21 executes the process in step S107.

[0060] In step S107, the control unit 21 sets the magnitude of the thrust force in the turning direction according to the absolute value of the slide amount detected by the touch panel display 240. In the example, as explained with reference to Figure 5, the control unit 21 sets the thrust force to be larger the larger the absolute value of the slide amount. In this case, the magnitude of the thrust force may be set to be proportional to the absolute value of the slide amount, or it may be set to a value that increases in stages as the absolute value of the slide amount increases, or it may be set to a value that increases exponentially as the absolute value of the slide amount increases.

[0061] After completing the processing in step S105 or step S107, the control unit 21 executes the processing in step S108. In step S108, the control unit 21 generates a remote signal that includes a command specifying the translational direction set in step S104 or the turning direction set in step S106, and a command specifying the magnitude of the thrust force in the translational direction set in step S105 or the magnitude of the thrust force in the turning direction set in step S107. After completing the processing in step S108, the control unit 21 executes the processing in step S109. .

[0062] In step S109, the control unit 21 transmits the remote signal generated in step S108 to the onboard equipment 140 of the ship 1 to be remotely controlled via the communication interface 23. After completing the processing in step S109, the control unit 21 terminates the execution of this processing routine. Note that the control unit 21 may repeatedly execute the processes from step S101 onwards after executing the processing in step S108.

[0063] According to the remote control system described above, the user can remotely control the translation and turning of the vessel 1 by inputting slide-touch operations into the first operation area OA31 and the second operation area OA32 on the remote control screen displayed on the mobile terminal 2. Since the slide-touch operation only requires sliding the icon G31 or dial G32, the user does not need to keep their eyes on the remote control screen. As a result, the operability when remotely controlling the vessel 1 can be improved.

[0064] <Other> The embodiments and modifications described above are merely examples, and this disclosure can be modified as appropriate without departing from its essence. For example, the dial G32 in the second operation area OA32 is not limited to an arc-shaped arrangement, but may also be arranged in a straight line. In addition, a slider GUI component may be displayed in the second operation area OA32 instead of the dial G32. In that case, the slider may be shaped to extend in an arc or to extend in a straight line. Furthermore, the icon G31 and dial G32 do not need to be displayed in the first operation area OA31 and the second operation area OA32. In that case, the user can perform a slide-touch operation at any position in the first operation area OA31 and the second operation area OA32. The control unit 21 of the mobile terminal 2 can then set the translational direction, rotational direction, and thrust force magnitude according to the slide direction and slide amount of the slide-touch operation.

[0065] This disclosure can also be realized by supplying a computer program (information processing program) implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer by a non-temporary computer-readable storage medium that can be connected to the computer's system bus, or it may be provided to the computer via a network. A non-temporary computer-readable storage medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical means and can be read from a computer or the like. Examples of such recording media include any type of disk, such as magnetic disks (floppy disks or HDDs, etc.), optical disks (CD-ROMs, DVD disks, or Blu-ray disks, etc.). Furthermore, recording media can be ROM, RAM, EPROM, EEPROM, magnetic cards, flash memory, optical cards, or SSDs (Solid State Drives). Other media are also acceptable. [Explanation of Symbols]

[0066] 1...Ship, 10...Hull, 110...Bow thruster, 120...Right engine, 130...Left engine, 140...Onboard equipment, 2...Mobile terminal, 21...Control unit, 22...Storage unit, 23...Communication interface, 24...Input / output unit, 240...Touch panel display

Claims

1. An information processing method for remotely controlling a ship using a mobile terminal equipped with a touch panel display, The aforementioned mobile device Outputting a user interface screen including a first operation area and a second operation area to the touch panel display, In response to detecting a slide-touch operation in the first operating area, a first command to move the vessel is transmitted to the vessel. Upon detecting a slide-touch operation in the second operating area, a second command to turn the vessel is transmitted to the vessel. This is an information processing method that performs the following: The second operating area includes a GUI component for selecting the turning direction of the vessel, Transmitting the second command to the ship means The system detects a second slide-touch operation in which the GUI component is touched and slid, The rotational direction is determined according to the sliding direction of the second slide touch operation, The magnitude of the thrust force in the turning direction is determined according to the amount of slide of the second slide touch operation, Transmitting the second command, including the turning direction and the magnitude of the thrust, to the vessel, including, Information processing methods.

2. The first operating area includes an icon corresponding to the ship, Transmitting the first command to the vessel means The system detects a first slide-touch operation in which the user touches and slides the aforementioned icon, The translational direction of the vessel is determined according to the sliding direction of the first slide touch operation. to, The magnitude of the thrust force in the translational direction is determined according to the amount of slide of the first slide touch operation, Transmitting the first command, including the translational direction and the magnitude of the thrust, to the vessel, including, The information processing method according to claim 1.

3. A program for causing a computer to execute the information processing method described in claim 1 or 2.

Images