Remote control method, remote control device, and remote control system

Abstract

The objective is to provide a remote control method, remote control device, and remote control system that can shorten the time required for processing necessary for remote control after receiving a request for remote control in a vehicle. [Solution] When a first operation is input, the controller sends a preparation signal to the vehicle requesting preparation for remote control of the vehicle, and when a second operation different from the first operation is input after the first operation, the controller sends a remote control signal to the vehicle requesting remote control of the vehicle.

Description

Technical Field

[0004] ,

[0001] The present invention relates to a remote control method, a remote control device, and a remote control system.

Background Art

[0002] There is known a technique for remotely operating a specific drive unit such as a vehicle lock mechanism or a power window via a center for transmission and reception by a remote signal which is a remote operation request signal wirelessly communicated from a mobile terminal (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique described in Patent Document 1, since a user makes a plurality of operations such as tapping an icon of an application for remote operation and tapping a confirmation screen of the application to request a remote operation for the vehicle for the first time, there is a problem that it takes time to perform processing necessary for the remote operation after receiving a remote operation request in the vehicle.

[0005] The problem to be solved by the present invention is to provide a remote control method, a remote control device, and a remote control system capable of shortening the time required for processing necessary for remote control after receiving a remote control request in a vehicle.

Means for Solving the Problems

[0006] The present invention solves the above problem by transmitting a preparation signal to the vehicle requesting preparation for remote control of the vehicle when a first operation is input, and transmitting a remote control signal to the vehicle requesting remote control of the vehicle when a second operation different from the first operation is input after the first operation. [Effects of the Invention]

[0007] According to the present invention, the time required for processing necessary for remote operation after receiving a request for remote operation in a vehicle can be reduced. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a block diagram showing an example of an embodiment of the remote control system according to the present invention. [Figure 2] Figure 2 shows an example of screen transitions in the display device according to this embodiment. [Figure 3] Figure 3 shows an example of screen display in the display device according to this embodiment. [Figure 4] Figure 4 shows an example of screen display in the display device according to this embodiment. [Figure 5] Figure 5 shows an example of screen display in the display device according to this embodiment. [Figure 6] Figure 6 shows an example of screen display in the display device according to this embodiment. [Figure 7] Figure 7 shows an example of a sequence chart of the control process of the remote control method performed by the remote control system in this embodiment. [Figure 8] Figure 8 shows an example of a sequence chart of the control process for the information display method executed by the remote control system in this embodiment. [Modes for carrying out the invention]

[0009] Figure 1 is a block diagram showing an example of an embodiment of the remote control system according to the present invention. The remote control system according to this embodiment is a system for remotely controlling a vehicle by an operator outside the vehicle. "Outside the vehicle" is not particularly limited as long as it is a location away from the vehicle body. The operator is, for example, the vehicle user. The vehicle user may be the vehicle owner or a user of a ride-hailing service, etc. When the user is at a location away from the vehicle, such as before the user gets in the vehicle or after the user gets out of the vehicle, the user remotely controls the vehicle using the remote control system. In addition, if a vehicle that is driving under autonomous driving control becomes unable to continue driving under autonomous driving control, the operator outside the vehicle may remotely control the vehicle using the remote control system. The operator is an operator located in a management center that centrally manages the vehicle's operation.

[0010] Remote control refers to controlling the operation of a vehicle using its controller by transmitting instruction signals from a distance. The operation of the vehicle is the operation of the onboard equipment installed in the vehicle. The vehicle controller controls the operation using the vehicle's onboard equipment according to the remote control. Onboard equipment includes door locking mechanisms, air conditioning systems, drive systems and steering systems that control the vehicle's driving operation, etc. This driving operation includes all driving operations such as acceleration, deceleration, starting, stopping, and steering. The vehicle may be an autonomous driving vehicle that operates under autonomous driving control, or it may be a vehicle that is driven by a driver's manual operation. In autonomous driving control, the controller controls these driving operations within a predetermined range, and driving operations that are not controlled by the controller are operated manually by the driver. When the vehicle is driven by a driver's manual operation without autonomous driving control, the controller does not perform autonomous control of the driving operation, and the vehicle's driving operation is controlled by the driver's operation.

[0011] As shown in Figure 1, the remote control system 1 comprises a vehicle 10, a remote control device 20, and a server 30. The vehicle 10 and the remote control device 20 exchange information with each other via the server 30. The remote control device 20 is a terminal device operated by an operator, such as a portable information terminal carried by the operator. More specifically, the remote control device 20 can be a mobile phone such as a smartphone, a tablet terminal, or a portable personal computer. The remote control device 20 is a device located outside the vehicle, such as in a remote location far from the vehicle. In the following explanation, the case in which a smartphone is used as the remote control device 20 will be described as an example. The remote control device 20, which consists of a smartphone, is equipped with a touch panel type display panel that functions as an information input device and display device, as will be described later.

[0012] Server 30 is, for example, a cloud server. The vehicle 10, the remote control device 20, and the server 30 are connected to a network for exchanging information with each other. The network refers to a telecommunications network such as the Internet, and wired communication, wireless communication, mobile communication, etc., can be used for communication. In this embodiment, the remote control system 1 may not have a server 30, and information may be sent and received directly between the vehicle 10 and the remote control device 20.

[0013] Vehicle 10 is the target of remote control and controls the operation of various in-vehicle equipment in response to instruction signals such as remote control signals received from the remote control device 20. Vehicle 10 is equipped with a first controller 11 and a vehicle control device 12. These devices are connected by CAN (Controller Area Network) or other in-vehicle LAN and can exchange information with each other. Hereinafter, vehicle 10 will also be referred to as the target vehicle 10. The first controller 11 will also be referred to as the in-vehicle controller. Vehicle 10 may be equipped with various sensors (not shown). Various sensors include, for example, an imaging device and a distance measuring device. The imaging device is a device for imaging objects around vehicle 10, and is, for example, a camera equipped with an image sensor such as a CCD, or an infrared camera. The distance measuring device includes a millimeter-wave radar, a LiDAR (light detection and ranging) unit, etc. Detection results obtained by the various sensors are acquired by the first controller 11 as needed. The first controller 11 recognizes objects and the driving environment around the vehicle 10 based on the acquired detection results, and controls the movement of the vehicle 10.

[0014] The first controller 11 is a device for controlling various operations of the vehicle 10, including the movement of the vehicle 10, by controlling and coordinating each device of the vehicle 10. The first controller 11 is, for example, a computer and comprises a CPU (Central Processing Unit) which is a processor, ROM (Read Only Memory) which stores programs, and RAM (Random Access Memory) which functions as an accessible storage device. The CPU is an operating circuit that executes the programs stored in ROM and realizes the functions of the first controller 11.

[0015] In this embodiment, when the first controller 11 receives instruction signals such as a preparation signal and a remote operation signal from the remote operation device 20 via the server 30, it outputs a control signal to the vehicle control device 12 in accordance with the instruction signal. Details of the processing content of the first controller 11 during remote operation will be described later.

[0016] The vehicle control device 12 is an in-vehicle computer such as an electronic control unit, and electronically controls in-vehicle devices that regulate the operation of the vehicle 10. The vehicle control device 12 autonomously controls the operation of the in-vehicle devices of the vehicle 10 according to the control signal input from the first controller 11. Note that the vehicle 10 only needs to be a vehicle capable of remotely operating various in-vehicle devices by an instruction signal transmitted from the remote operation device 20, and the configuration of the vehicle 10 is not particularly limited.

[0017] Hereinafter, when the in-vehicle device to be remotely operated is the door lock mechanism of the vehicle 10, an example in which the user of the vehicle 10 performs a remote operation as an operator will be described. For example, when the first controller 11 receives a remote operation signal for operating the door lock mechanism, the first controller 11 outputs a control signal for operating the door lock mechanism to the vehicle control device 12. The vehicle control device 12 operates the door lock mechanism according to the control signal. The door lock mechanism operates so as to change from the locked state to the unlocked state and from the unlocked state to the locked state.

[0018] The remote operation device 20 is a device used by an operator outside the vehicle 10 for remotely operating the vehicle 10, and includes a second controller 21, a display device 22, and an input device 23. These devices are connected by a LAN or the like so that they can exchange information with each other. The second controller 21 is an example of the "controller" in the claims.

[0019] The second controller 21 is a device that controls and cooperates with each device of the remote operation device 20 to provide the operator with necessary information and execute the remote operation of the vehicle 10 by the operator. The object of the remote operation is the in-vehicle device of the vehicle 10. For example, the in-vehicle device includes the door lock mechanism of the vehicle 10. The operator can remotely operate the door lock mechanism of the vehicle 10 via the remote operation device 20. The second controller 21 is, for example, a computer, and includes a CPU, a ROM, and a RAM similar to the first controller 11. The CPU is an operation circuit that executes the program stored in the ROM and realizes the functions of the second controller 21.

[0020] The display device 22 is a device for displaying images to the operator operating the remote control device 20, and examples include liquid crystal displays. The images include both moving images and still images. Examples of display screens shown on the display device 22 will be described later. The input device 23 is a device for the operator of the remote control device 20 to input various operation information. For example, the input device 23 is composed of a touch panel. The input device 23 and the display device 22 are touchscreens in which a touch panel is superimposed on a display. The operator views the images displayed on the display of the display device 22 and inputs operations on the touch panel.

[0021] The input device 23 receives a predetermined operation input from the user and outputs an operation signal related to the operation input to the second controller 21. User operations are distinguished into several different types depending on the input method. User operations include a first operation and a second operation that is different from the first operation. The first operation is a touch operation in which the user touches a target icon displayed on the screen of the display device 22. The target icon is, for example, an in-vehicle equipment icon that represents an in-vehicle equipment that is to be remotely controlled. The in-vehicle equipment icon includes, for example, a door lock mechanism icon that represents the door lock mechanism of the vehicle 10. The user performs the first operation by touching the target icon with their finger. The first operation may be one in which the user maintains a touch on the target icon, or one in which the user touches the target icon and then releases their finger from the target icon (a so-called tap operation). When the first operation is input, the input device 23 outputs a first operation input signal to the second controller 21 indicating that the first operation has been input.

[0022] The second operation is an operation that is entered after the first operation. More specifically, the second operation is entered immediately after the first operation. The second operation is an operation in which the user touches the screen of the display device 22 and slides the touch position on the screen from the position of the target icon touched in the first operation to a predetermined position. The user performs the second operation by sliding the finger that is touching the target icon to the predetermined position. The second operation is, for example, an operation (flick operation) in which the finger that has been slid to the predetermined position is lifted from the screen. The predetermined position is the position of the selection icon if selection icons are displayed around the target icon. Selection icons will be described later. When the second operation is entered, the input device 23 outputs a second operation input signal to the second controller 21 indicating that the second operation has been entered. The second operation is an operation in which the user requests remote control of the vehicle 10. The remote control device 20 can confirm the user's intention to request remote control by inputting the second operation.

[0023] The second controller 21 has a remote control function that transmits instruction signals to the vehicle 10 via the server 30 to remotely control the vehicle 10. The program stored in the ROM of the second controller 21 is a program for realizing the remote control function, and the remote control function is realized when the CPU of the second controller 21 executes the program stored in the ROM. Figure 1 shows, for convenience, the operation signal acquisition unit 24, the receiving unit 25, the display unit 26, and the remote control unit 27, which are functional blocks that realize the remote control function.

[0024] The operation signal acquisition unit 24 acquires operation signals related to user operation input from the input device 23. The operation signals include a first operation input signal and a second operation input signal. When the user performs an operation input to the input device 23, the operation signals are output from the input device 23 to the second controller 21.

[0025] The receiving unit 25 receives various signals from the vehicle 10 via the server 30. The received signals include a reply signal containing the result of a pre-preparation request and an execution completion signal indicating that the remote operation has been completed. The result of the pre-preparation request includes a readiness complete signal indicating that the pre-preparation has been completed. The pre-preparation performed in the vehicle 10 is, for example, a process to make the vehicle 10 active. The active state is a state in which it can be remotely operated. The state in which the vehicle 10 can be remotely operated may be a state in which the entire vehicle 10 can be remotely operated, or it may be a state in which some of the onboard equipment of the vehicle 10 can be remotely operated. An example of onboard equipment of the vehicle 10 that can be remotely operated is the door locking mechanism of the vehicle 10.

[0026] After the pre-preparation signal is transmitted to the vehicle 10, the receiving unit 25 receives a reply signal from the vehicle 10. After the remote control signal is transmitted to the vehicle 10, the receiving unit 25 receives an execution completion signal from the vehicle 10. For example, if a remote control signal is transmitted to lock or unlock the door locking mechanism of the vehicle 10, the execution completion signal is a signal indicating that the door locking mechanism has been locked or unlocked.

[0027] The display unit 26 displays various information on the display device 22. The display unit 26 displays information necessary for the operator to perform remote control on the screen of the display device 22. First, the display unit 26 displays an image containing the target icon on the screen of the display device 22. For example, an image containing an in-vehicle equipment icon representing the in-vehicle equipment to be remotely controlled is displayed on the screen of the display device 22. This screen is also referred to as the first operation screen. The in-vehicle equipment icon is an icon used by the user to select the target to be remotely controlled. The displayed in-vehicle equipment icon may be multiple in-vehicle equipment icons or a single in-vehicle equipment icon.

[0028] When a first operation is input for a target icon displayed on the first operation screen, the display unit 26 displays multiple selection icons on the display device 22 screen around the target icon, each icon indicating a different function to be executed. The screen of the display device 22 that displays an image including the selection icons is also called the second operation screen. The second operation screen is a confirmation screen that confirms the user's intention to remotely operate the vehicle. The selection icons include an on icon to turn the vehicle 10 on, an off icon to turn the vehicle 10 off, an instruction manual icon to display a description of the vehicle 10, and a setting icon to configure the vehicle 10.

[0029] The on and off icons are displayed in a point-symmetrical position with respect to the target icon. For example, the on and off icons are positioned above and below the target icon on the screen of the display device 22, respectively. The instruction manual icon and settings icon are displayed in a point-symmetrical position with respect to the target icon. For example, the instruction manual icon and settings icon are positioned to the right and left of the target icon on the screen of the display device 22, respectively.

[0030] If the target icon is an in-vehicle device icon, the selection icons include an on icon to turn on the in-vehicle device of vehicle 10, an off icon to turn off the in-vehicle device of vehicle 10, an instruction manual icon to display a description of the in-vehicle device, and a settings icon to configure the in-vehicle device.

[0031] Here, an example of screen display in this embodiment will be explained using Figures 2 to 6. Figure 2 is a diagram showing an example of screen transitions in the display device according to this embodiment. In the display device 22, the screen transitions by executing different screen displays depending on the type of user operation. In the left side of Figure 2, an image V of the vehicle 10 to be remotely controlled and a plurality of in-vehicle equipment icons are displayed on the screen D of the display device 22. The in-vehicle equipment icons displayed are the charging device icon E1, the door lock mechanism icon E2, and the air conditioning system icon E3. The door lock mechanism icon E2 is an icon with an illustration of a lock. The user performs a first operation by touching the icon they want to select from the plurality of in-vehicle equipment icons. That is, the first operation is an input operation for selecting an in-vehicle equipment. The icon touched by the user in the first operation can be moved on the screen by a sliding operation. In the example of Figure 2, the user touches the door lock mechanism icon E2 as the first operation. When the user performs the first operation, the remote control device 20 sends a pre-preparation signal to the vehicle 10 to make the door lock mechanism ready for remote control.

[0032] As a second operation, the user moves the position of the door lock mechanism icon E2 by sliding their touch on the screen. As shown in the right-hand diagram of Figure 2, the user moves the door lock mechanism icon E2 on the screen and overlays it on the image V of the vehicle 10. The movement of icon E2 ends and the position of icon E2 is finalized when the user lifts their finger from the screen. The second operation is an input operation for remotely locking and unlocking the door lock mechanism. When the user performs the second operation, the remote control device 20 transmits a remote control signal to the vehicle 10 to activate the door lock mechanism.

[0033] The second operation is not limited to the slide operation described above; it may be any other operation. The second operation may be, for example, tapping the in-car device icon. The second operation may be, for example, a firm tap on the in-car device icon. The second operation may be a double tap on the in-car device icon. The second operation may be a long press on the in-car device icon. The second operation may be a flick operation, sliding the touch position on the screen upwards while the in-car device icon is touched by the first operation. The second operation may be an operation to input voice information to identify the action while the in-car device icon is touched by the first operation. For example, if the in-car device is a door locking mechanism, the user inputs voice information to identify the action, such as "lock" or "unlock".

[0034] Furthermore, the second operation may be an input operation on an image of a physical key displayed on the screen of the display device 22. Figure 3 is a diagram showing an example of the screen display in the display device according to this embodiment. When the icon of the door lock mechanism is touched by the first operation, the image shown in Figure 3 is displayed on the screen. In the example of Figure 3, the image K of the remote key is superimposed on the screen D shown in the example of Figure 2. The remote key shown in the image K has buttons that represent each function of the door lock mechanism. For example, the buttons include a button for locking the door lock mechanism and a button for unlocking the door lock mechanism. When the image K of the remote key is displayed by the first operation, the second operation is an operation to move the position of the icon E2 of the door lock mechanism to the position of one of the buttons included in the image K of the remote key by sliding the touch position on the screen D. When the icon E2 of the door lock mechanism is slid, the function corresponding to the button at the slid position is executed.

[0035] Furthermore, the second operation may be an operation in which, while touching the door lock mechanism icon as a result of the first operation, the touch position is slid from the position of the door lock mechanism icon to the lock icon or the unlock icon. Figure 4 is a diagram showing an example of the screen display in the display device according to this embodiment. When the first operation of touching the door lock mechanism icon is input on the screen D of the display device 22, as shown in Figure 4, a plurality of selection icons for executing different functions are displayed around the position of the door lock mechanism icon E2 on the screen D of the display device 22. The selection icons include an unlock icon S1 for unlocking the door lock mechanism, a lock icon S2 for locking the door lock mechanism, an instruction manual icon S3 for displaying an explanation of the door lock mechanism, and a setting icon S4 for setting the door lock mechanism. Note that the door lock mechanism icon may be hidden as in the example in Figure 4, or it may remain displayed.

[0036] The unlock icon S1 and the lock icon S2 are displayed in a point-symmetrical position with respect to the position of the door lock mechanism icon E2. For example, the unlock icon S1 is positioned above the door lock mechanism icon E2 on screen D. The lock icon S2 is positioned below the door lock mechanism icon E2 on screen D. The instruction manual icon S3 and the settings icon S4 are displayed in a point-symmetrical position with respect to the position of the door lock mechanism icon E2. For example, the instruction manual icon S3 is positioned to the left of the door lock mechanism icon E2 on screen D. The settings icon S4 is positioned to the right of the door lock mechanism icon E2 on screen D.

[0037] The user can select a function to execute from these four selection icons by sliding their touch position on the screen. When the touch position is slid to the position of one of the selection icons as a second operation, the remote control device 20 executes a function corresponding to the selection icon at the slid touch position. More specifically, the remote control device 20 executes a function corresponding to the selected icon. In the example in Figure 4, the user has slid their touch position to the lock icon S2, so the remote control device 20 sends a remote control signal to the vehicle 10 to lock the door lock mechanism. This allows the remote control signal to be sent without displaying a pop-up such as "Turn ON?" when the user selects the lock icon (or unlock icon).

[0038] Figure 5 is a diagram showing an example of screen display in the display device according to this embodiment. Figure 5 shows an example in which a second operation is performed on a screen similar to the left-hand diagram in Figure 2. In the example in Figure 5, the first operation is to touch the icon E2 of the door lock mechanism with two fingers (for example, the index finger and thumb). As shown in the left-hand diagram of Figure 5, after the first operation is performed, the user may perform a second operation by spreading the two fingers that are touching the screen D. Spreading the two fingers is an operation in which the two touch positions on the screen are slid so that the distance between the two touch positions gradually increases. When the operation of spreading the two fingers is input as the second operation, the remote control device 20 sends a remote control signal to the vehicle 10 to unlock the door lock mechanism. After sending the remote control signal, if the remote control device 20 receives an execution completion signal from the vehicle 10, it displays an animation on the screen D in which the circular icon C1 expands outward, as shown in the circular icon C1 in Figure 5. The animation of the circular icon C1 may be repeated while the door locking mechanism is in operation. Additionally, when the remote control device 20 receives an execution completion signal from the vehicle 10, it may be controlled to vibrate a vibration device (not shown) provided in the remote control device 20.

[0039] Furthermore, as shown in the right-hand diagram of Figure 5, after the first operation is performed, the user may perform a second operation by closing the two fingers that are touching the screen D. The operation of closing the two fingers is an operation in which the two touch positions on the screen are slid so that the distance between the two touch positions gradually decreases. When the operation of closing the two fingers is input as the second operation, the remote control device 20 sends a remote control signal to the vehicle 10 to lock the door lock mechanism. After sending the remote control signal, if the remote control device 20 receives an execution completion signal from the vehicle 10, it displays an animation on the screen D of a circular icon C2 closing inward, as shown in the circular icon C2 of Figure 5. The animation of the circular icon C2 may be repeated while the door lock mechanism is operating. Also, if the remote control device 20 receives an execution completion signal from the vehicle 10, it may control a vibration device (not shown) provided in the remote control device 20 to vibrate.

[0040] Figure 6 is a diagram showing an example of a screen display in the display device according to this embodiment. Figure 6 shows an example of a screen waiting for the completion of a lock or unlock operation. When the second operation is performed, the image shown in Figure 6 is displayed on screen D. The image shown in Figure 6 is an image of the screen waiting for the completion of a lock or unlock operation, and is displayed while the door lock mechanism is in the process of locking or unlocking. Specifically, an animation is repeatedly performed in which the icon E2 of the door lock mechanism moves to the position of the vehicle V image as indicated by an arrow. This creates the effect that a remote operation instruction is being given to the vehicle 10. Examples of animations on the completion waiting screen include an animation in which the icon of the door lock mechanism changes from an icon indicating a locked state to an icon indicating an unlocked state, an animation in which a band is added as an effect around the circumference of the icon of the door lock mechanism, an animation in which a gradient is added as an effect around the icon of the door lock mechanism, an animation in which an upward-pointing arrow is displayed above the icon of the door lock mechanism, and an animation in which the frame portion of the icon of the door lock mechanism is colored.

[0041] Furthermore, when the display unit 26 receives a reply signal from the vehicle 10, it notifies the user of the result of the requested preparation. For example, the display unit 26 displays an image on the screen of the display device 22 indicating that the preparation for remote operation has been completed in the vehicle 10. Also, if the second operation is input within a predetermined time after the first operation is input, the display unit 26 stops notifying the user of the result of the requested preparation.

[0042] The remote control unit 27 performs the control necessary for the remote operation of the vehicle 10. More specifically, the remote control unit 27 has the function of transmitting instruction signals to the first controller 11 via the server 30. An instruction signal is a signal that instructs the processing necessary to operate the vehicle 10 by remote control, and includes, for example, a preparation signal that requests the preparation for remote operation of the vehicle 10, and a remote operation signal that requests the remote operation of the vehicle 10. The preparation signal is a signal that puts the vehicle 10 into an active state that can be remotely operated, and more specifically, a signal that puts the in-vehicle equipment into a state that can be operated by remote control. The remote operation signal is a signal that puts the vehicle 10 into operation by remote control, and more specifically, a signal that requests the operation of the in-vehicle equipment. For example, the remote operation signal includes a signal that requests the operation of the door lock mechanism of the vehicle 10. The door lock mechanism operates from the locked state to the unlocked state when it is locked. The door lock mechanism operates from the unlocked state to the locked state when it is unlocked.

[0043] When a first operation is input, the remote control unit 27 transmits a pre-preparation signal to the vehicle 10 via the server 30. Specifically, the remote control unit 27 transmits a pre-preparation signal to the vehicle 10 when a first operation input signal is input from the input device 23 to the second controller 21. Furthermore, after transmitting the pre-preparation signal to the vehicle 10, if the selection icon selected by the second operation is an instruction manual icon or a setting icon, the remote control unit 27 transmits a preparation cancellation signal to the vehicle 10 to cancel the pre-preparation request. In this embodiment, since the pre-preparation signal is transmitted when the first operation is input, processing to make the vehicle 10 capable of remote operation begins before the second operation is input and the remote control signal is transmitted. Therefore, the vehicle 10 does not need to start processing to make it capable of remote operation after receiving a request for remote operation by receiving the remote control signal, thus it is possible to shorten the time required for processing necessary for remote operation while confirming the user's intention to operate.

[0044] When a second operation is input, the remote control unit 27 transmits a remote control signal to the vehicle 10 via the server 30. Specifically, the remote control unit 27 transmits a remote control signal to the vehicle 10 when a second operation input signal is input from the input device 23 to the second controller 21. When the second operation selects the unlock icon from among multiple selection icons, the remote control unit 27 transmits a remote control signal to the vehicle 10 to unlock or lock the door lock mechanism of the vehicle 10. When the second operation selects the lock icon from among multiple selection icons, the remote control unit 27 transmits a remote control signal to the vehicle 10 to lock the door lock mechanism of the vehicle 10.

[0045] When the first controller 11 receives an instruction signal from the second controller 21, it controls the in-vehicle equipment based on the instruction signal. When a pre-preparation signal is transmitted to the first controller 11, the first controller 11 performs activation, which puts the vehicle 10 into an active state that can be remotely controlled. In this embodiment, in-vehicle equipment such as a door lock mechanism becomes remotely controllable. The first controller 11 outputs a control signal to the vehicle control device 12 to perform activation. If the in-vehicle equipment is a door lock mechanism, the control signal is a signal that puts the door lock mechanism into an active state. When the first controller 11 has put the vehicle 10 into an active state, it transmits a ready signal to the remote control device 20 via the server 30. Also, when the first controller 11 receives a preparation cancellation signal from the remote control device 20, it cancels the activation.

[0046] When a remote control signal is transmitted to the first controller 11, the first controller 11 operates the in-vehicle equipment in response to the remote control signal. Specifically, the first controller 11 outputs a control signal to the vehicle control device 12 that operates the in-vehicle equipment. If the in-vehicle equipment is a door locking mechanism, the control signal is a signal that operates the door locking mechanism. When the operation of the in-vehicle equipment is complete, the first controller 11 transmits an execution completion signal to the remote control device 20 via the server 30.

[0047] Here, the procedure for the control process of the remote control method executed by the remote control system in this embodiment will be described. Figure 7 is a diagram showing an example of a sequence chart of the control process of the remote control method executed by the remote control system in this embodiment. In the example in Figure 7, the door lock mechanism is used as an example of the in-vehicle equipment to be remotely controlled. That is, the target icon is the icon for the door lock mechanism of vehicle 10.

[0048] In step S1, the remote control device 20 receives input for a first operation from the operator. The first operation is a touch operation on the icon for the door lock mechanism. In step S2, the remote control device 20 sends a preparation signal to the server 30. In step S3, the server 30 receives the preparation signal. In step S4, the server 30 sends a preparation signal to the vehicle 10. In step S5, the vehicle 10 receives the preparation signal.

[0049] In step S6, the vehicle 10 is activated as a preparatory step. Specifically, the vehicle 10 makes the door lock mechanism remotely controllable. That is, once the preparatory step is complete, the door lock mechanism of the vehicle 10 can be locked or unlocked remotely. In step S7, the vehicle 10 sends a ready signal to the server 30 indicating that the preparatory step is complete. In step S8, the server 30 receives the ready signal. In step S9, the server 30 sends the ready signal to the remote control device 20. In step S10, the remote control device 20 receives the ready signal. Note that in Figure 7, the second operation is input after the remote control device 20 receives the ready signal, but this is not limited to this, and the second operation may be input before receiving the ready signal.

[0050] In step S11, the remote control device 20 receives input for a second operation. The second operation is a flick operation that requests remote operation from the operator. For example, the operator, with the icon for the door lock mechanism touched by the first operation, performs a flick operation to slide the touch position to the position of the lock icon or the unlock icon. In step S12, the remote control device 20 transmits a remote operation signal to the server 30. In step S13, the server 30 receives the remote operation signal. In step S14, the server 30 transmits a remote operation signal to the vehicle 10. In step S15, the vehicle 10 receives the remote operation signal.

[0051] In step S16, the vehicle 10 controls the in-vehicle equipment in response to the remote control signal. For example, the vehicle 10 operates the door lock mechanism so that the door lock mechanism is in a locked or unlocked state. In step S17, the vehicle 10 sends an execution completion signal to the server 30 indicating that the remote control is complete. In step S18, the server 30 receives the execution completion signal. In step S19, the server 30 sends the execution completion signal to the remote control device 20. In step S20, the remote control device 20 receives the execution completion signal.

[0052] Furthermore, in this embodiment, as a second operation, if the operator selects the instruction manual icon from the selection icons, the remote operation may not be performed, and instruction manual information for the door lock mechanism may be displayed. Now, the procedure for the control processing of the information display method executed by the remote operation system in this embodiment will be described. Figure 8 is a diagram showing an example of a sequence chart of the control processing of the information display method executed by the remote operation system in this embodiment. In the example of Figure 8, the door lock mechanism is used as an example of the in-vehicle equipment to be operated. That is, the target icon is the icon for the door lock mechanism of the vehicle 10.

[0053] In step S21, the remote control device 20 receives input for a first operation from the operator. The first operation is a touch operation on the icon for the door lock mechanism. In step S22, the remote control device 20 sends a preparation signal to the server 30. In step S23, the server 30 receives the preparation signal.

[0054] In step S24, the server 30 begins preparing to display instruction manual information. Specifically, the server 30 begins downloading instruction manual information regarding the door locking mechanism. In step S25, the server 30 sends a preparation start signal to the remote control device 20 indicating that the preparation has begun. In step S26, the remote control device 20 receives the preparation start signal.

[0055] In step S27, the remote control device 20 receives input for a second operation. The second operation is a flick operation that requests the operator to display the instruction manual. For example, the operator, with the door lock mechanism icon touched by the first operation, performs a flick operation to slide the touch position to the instruction manual icon. In step S28, the remote control device 20 sends an instruction signal to the server 30. In step S29, the server 30 receives the instruction signal.

[0056] In step S30, the server 30 completes the preparation for displaying the instruction manual information. Specifically, the server 30 completes the download of instruction manual information regarding the door lock mechanism. In step S31, the server 30 transmits the instruction manual information to the remote control device 20. In step S32, the remote control device 20 receives the instruction manual information. In step S33, the remote control device 20 displays the instruction manual information to the operator via the display device 22. In this embodiment, the control processes in the flowcharts of Figures 7 and 8 may be executed in parallel. For example, if the server 30 receives a pre-preparation signal from the remote control device 20, it may start preparing to display the instruction manual information and transmit a pre-preparation signal to the vehicle 10. The remote control device 20 then changes the type of signal it transmits to the server 30 (remote control signal or instruction signal) according to the type of second operation input (remote control of the door lock mechanism or display of instruction manual information). This allows the user to change the processing content requested by the second operation.

[0057] As described above, in the remote control method, remote control device, and remote control system according to this embodiment, when a first operation is input, the controller sends a preparation signal to the vehicle requesting preparation for remote control of the vehicle, and when a second operation different from the first operation is input after the first operation, the controller sends a remote control signal to the vehicle requesting remote control of the vehicle. This makes it possible to shorten the time required for processing necessary for remote control after the vehicle receives a request for remote control.

[0058] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the pre-preparation signal includes a signal to put the vehicle into an active state where it can be remotely controlled. This makes it possible to put the vehicle into a state where remote control can be performed before sending a signal to the vehicle requesting remote control.

[0059] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the controller transmits a pre-preparation signal to the vehicle, receives a reply signal from the vehicle containing the result of the pre-preparation request, and notifies the user of the result upon receiving the reply signal. This allows the user performing the remote control to understand that the vehicle has been prepared for remote control.

[0060] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the controller stops notifying the result if the second operation is input within a predetermined time after the first operation is input. This makes it possible to omit notification of the results of the preparations when the user performs the second operation immediately after the first operation.

[0061] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the first operation is a touch operation in which the user touches a target icon displayed on the screen of the display device, and the second operation is an operation in which the user, while touching the screen, slides the touch position on the screen from the position of the target icon touched in the first operation to a predetermined position. This makes it possible to perform remote control with simple operations on icons displayed on the display.

[0062] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the second operation is a flick operation. This allows remote control to be performed by simple operations on icons displayed on the display.

[0063] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, when a first operation is input, the controller displays a plurality of selection icons for executing different functions around the target icon, and when the touch position is slid to the position of one of the plurality of selection icons by a second operation, the controller executes a function according to the selection icon at the slid position. This makes it possible to remotely control the execution of functions with simple operations on icons displayed on the display.

[0064] Furthermore, in the remote control method, remote control device, and remote control system according to this embodiment, the selection icons include an ON icon for turning the vehicle ON, an OFF icon for turning the vehicle OFF, an instruction manual icon for displaying the vehicle's instruction manual, and a setting icon for configuring the vehicle. The ON icon and OFF icon are positioned on the screen in a point-symmetric position with respect to the position of the target icon, and the instruction manual icon and setting icon are positioned on the screen in a point-symmetric position with respect to the position of the target icon. If the selection icon at the position where the touch position has been slid by the second operation is the instruction manual icon or the setting icon, the controller sends a preparation cancellation signal to the vehicle to cancel the request for preparation. This allows the preparation for remote operation to be canceled if the user performs an operation other than remote operation. [Explanation of Symbols]

[0065] 1…Remote control system 10... Vehicles 20…Remote control device 21…Second controller 24...Operation signal acquisition section 25... Receiver 26…Display section 27…Remote Control Unit 22...Display device 23…Input device 30… Server

Claims

1. A remote control method performed by a controller, The aforementioned controller, When the first operation is input, a pre-preparation signal is transmitted to the vehicle requesting pre-preparation for remote control of the vehicle. A remote control method that transmits a remote control signal to the vehicle requesting remote control of the vehicle when a second operation different from the first operation is input after the first operation.

2. A remote control method according to claim 1, The aforementioned pre-preparation signal is a remote control method that includes a signal for putting the vehicle into an active state that allows for remote control.

3. A remote control method according to claim 1 or 2, The aforementioned controller, After transmitting the pre-preparation signal to the vehicle, a reply signal containing the result of the pre-preparation request is received from the vehicle. A remote control method for notifying the user of the result upon receiving the aforementioned reply signal.

4. A remote control method according to claim 3, The aforementioned controller, A remote operation method that cancels notification of the result if the second operation is input within a predetermined time after the first operation is input.

5. A remote control method according to claim 1 or 2, The first operation is a touch operation in which the user touches a target icon displayed on the screen of the display device, The second operation is a remote operation method in which, while touching the screen, the user slides the touch position on the screen from the position of the target icon touched in the first operation to a predetermined position.

6. A remote control method according to claim 5, The second operation is a flick operation, which is a remote control method.

7. A remote control method according to claim 5, The aforementioned controller, When the first operation is input, multiple selection icons for executing different functions are displayed around the target icon. A remote operation method in which, when the touch position is slid to the position of one of the multiple selection icons by the second operation, the function is executed according to the selection icon at the position where the touch position was slid.

8. A remote control method according to claim 7, The selection icons include an ON icon for turning the vehicle ON, an OFF icon for turning the vehicle OFF, an instruction manual icon for displaying the vehicle's instruction manual, and a settings icon for configuring the vehicle's settings. The aforementioned on icon and the aforementioned off icon are positioned on the screen in a point-symmetrical position with respect to the position of the target icon. The instruction manual icon and the settings icon are arranged on the screen in a point-symmetrical position with respect to the position of the target icon. The aforementioned controller, A remote operation method that, if the selection icon located at the position where the touch position has been slid by the second operation is the instruction manual icon or the setting icon, transmits a preparation cancellation signal to the vehicle to cancel the request for the pre-preparation.

9. A remote control device equipped with a controller, The aforementioned controller, When the first operation is input, a pre-preparation signal is transmitted to the vehicle requesting pre-preparation for remote control of the vehicle. A remote control device that, when a second operation different from the first operation is input after the first operation, transmits a remote control signal to the vehicle requesting remote control of the vehicle.

10. A remote control system comprising a vehicle and a remote control device equipped with a controller, The aforementioned controller, When the first operation is input, a pre-preparation signal is transmitted to the vehicle requesting pre-preparation for remote control of the vehicle. A remote control system that, when a second operation different from the first operation is input after the first operation, transmits a remote control signal to the vehicle requesting remote control of the vehicle.

Images