Vehicle remote control system

Abstract

This system provides a remote vehicle control system that improves safety by allowing anyone who notices a danger, even if they are not the designated driver, to emergency stop the vehicle using voice commands. [Solution] The vehicle is equipped with a remote control device 10 that can set an automatic driving mode or a remote control mode. The remote control device 10 is equipped with a voice-to-command conversion unit 19 that converts specific voices into control commands and transmits them to the vehicle. If a specific voice indicates an emergency stop, the vehicle is controlled to perform an emergency stop, regardless of whether it is in automatic driving mode or remote control mode.

Description

Technical Field

[0001] The present invention relates to a system for remotely controlling a vehicle, and particularly to a remote control system for a vehicle that improves safety by controlling the vehicle by voice in case of emergency, whether in the automatic driving mode or the remote operation mode.

Background Art

[0002] [Conventional Technology] Conventionally, there has been a remote control system for remotely controlling a vehicle. [Overview of Remote Control System: FIG. 6] The overview of the remote control system will be described with reference to FIG. 6. FIG. 6 is an explanatory diagram showing the overview of the remote control system. As shown in FIG. 6, the remote control system is configured such that a device provided on the vehicle side and a device on the remote control side provided in a control center or the like communicate with each other via a network to drive the vehicle.

[0003] As the device on the vehicle side, there are a camera for acquiring video and audio, and a control device for monitoring the state of the vehicle and controlling each part. Camera video, audio, vehicle running information, etc. are sent to the remote control side. As the device on the remote control side, there are a monitor and a speaker for outputting camera video and audio, a terminal for displaying the vehicle state and monitoring information, a controller for inputting a command for controlling the vehicle, etc. As the network, there are a public line 5G (5th Generation) line, an LTE line, or a local network 5G line, etc.

[0004] The remote control system has two operation modes: an automatic driving mode (automatic operation mode) and a remote control driving mode (remote operation mode). In the automatic driving mode, the vehicle side performs autonomous control and runs on the set route, while the remote control side monitors it. In the remote operation mode, control information is transmitted from the remote control side to the vehicle side, and the vehicle side device drives the vehicle based on the received control information.

[0005] [Conventional remote control system configuration: Figure 7] The configuration of a conventional remote control system will be explained using Figure 7. Figure 7 is an explanatory diagram showing the configuration of a conventional remote control system. As shown in Figure 7, a conventional remote control system has a configuration in which a vehicle-side device 20 and a remote control device 40 are connected via a network 30. Network 30 refers to general public telephone networks, as well as network networks independently constructed by companies or local governments.

[0006] [Vehicle-side device 20] The vehicle-side device 20 includes a camera 21, an encoder 22, routers 23a and 23b, an ECU (Electronic Control Unit) 24, a vehicle monitoring unit 25, a command conversion unit 26, and a vehicle control unit 27.

[0007] Camera 21 is equipped with a microphone and acquires and transmits the surrounding conditions of the vehicle (video and audio) and the conditions inside the vehicle, such as passengers (video and audio). Typically, four cameras 21 are installed to capture video of the area around the vehicle, one each capturing the front, one rear, one left, and one right. The encoder 22 compresses the video and audio from the camera 21 and transmits them to the remote control device 40 via the router 23a.

[0008] The ECU24 is a control unit located inside the vehicle that controls various functions of the vehicle. The specifications of the ECU24 vary depending on the vehicle manufacturer. The ECU24 monitors the status of various parts of the vehicle, outputs the monitoring information to the vehicle monitoring unit 25, and controls various parts of the vehicle based on remote control data from the vehicle control unit 27.

[0009] Furthermore, the vehicle monitoring unit 25, the command conversion unit 26, and the vehicle control unit 27 constitute a vehicle monitoring and control unit that monitors and controls the vehicle. The vehicle monitoring unit 25 acquires monitoring information from the ECU 24 and outputs it to the command conversion unit 26. The command conversion unit 26 converts the monitoring information from the vehicle monitoring unit 25 into remote monitoring data that can be analyzed by the remote control device 40, and transmits it to the remote control device 40 via the router 23b.

[0010] Furthermore, the command conversion unit 26 converts the control information from the remote control device 40 into remote control data that conforms to the specifications of the ECU 24 and outputs it to the vehicle control unit 27. The vehicle control unit 27 outputs remote control data from the command conversion unit 26 to the ECU 24.

[0011] [Remote control device 40] The remote control device 40 includes a decoder 41, a monitor 42, routers 43a and 43b, a vehicle information analysis unit 44, a button-to-command conversion unit 45, a monitor (vehicle status display unit) 46, and a control controller (controller) 47. The decoder 41 receives and restores compressed video and audio data from the vehicle-side device 20 via the router 43a and outputs it to the monitor 42. Monitor 42 displays images from the front, rear, left, and right-side in-vehicle cameras. It can also switch to display images from the interior camera.

[0012] The vehicle information analysis unit 44 receives remote monitoring data from the vehicle-side device 20 via the router 43a, converts it into data for monitor display, and displays the vehicle status on the monitor 46. The button-to-command conversion unit 45 includes a table that associates operation information from the controller 47 with control information (commands) for the vehicle, and converts the operation information input from the controller 47 into commands. The controller 47 is operated by a specific operator (driver) and performs operations to control the vehicle.

[0013] The remote control system then transmits the video captured by the camera 21 on the vehicle-side device 20 to the remote control device 40 via the communication network 30, and displays the video on the monitor 46 of the remote control device 40. When remote control mode is set, "Remote Control Mode" is displayed on monitor 46, and the operator controls the vehicle at a remote location by operating the controller 47 while viewing the image displayed on monitor 46.

[0014] Furthermore, when the automatic driving mode is set, "Automatic Driving Mode" is displayed on the monitor 46, and the controller 47 does not accept control. The vehicle-side device 20 then automatically drives the vehicle based on pre-registered map information. Specifically, the button-to-command conversion unit 45 of the remote control device 40 does not send commands to the vehicle-side device 20 even if there is input from the controller 47. However, as will be explained later, even in automatic driving mode, the system is designed to accept "emergency stop instructions" from the controller 47.

[0015] Furthermore, when the vehicle-side device 20 is powered on, neither "automatic driving mode" nor "remote control mode" is selected. Therefore, the remote control device 20 must first be selected and set using the controller 47.

[0016] [Controller configuration: Figure 8] Next, the configuration of the controller 47 will be explained using Figure 8. Figure 8 is an explanatory diagram showing the configuration of the controller, where (a) is a top view and (b) is a rear view. As shown in Figures 8(a) and 8(b), the controller 47 is an input device equipped with buttons operated by the user. On its top surface, it has a directional pad 51, a back button 52, a start button 53, an X button 54, an A button 55, a B button 56, and a Y button 57. On its back surface, it has an L button 58 and an R button 59. Then, when the operator presses each button, operation information corresponding to the operation is output.

[0017] [Controller Button-Command Conversion Table: Figure 9] Next, the controller button-command conversion table provided in the button-command conversion unit 45 will be described with reference to FIG. 9. FIG. 9 is an explanatory diagram of the controller button-command conversion table. As shown in FIG. 9, the controller button-command conversion table stores, in association with each other, the content (item) of the button operation in the controller 47, the corresponding bit mask (equivalent to a command), the content, and the remarks.

[0018] When a button operation is performed on the controller 47, the button-command conversion unit 45 outputs the command corresponding to the operation to the vehicle-side device 20. For example, when the "up" of the cross key 51 is pressed, an instruction to set the tire direction to the upward (front) tire angle of 0 degrees is output, and when the L button 58 is pressed, an instruction to blink the left turn signal is output.

[0019] In FIG. 9, the operation of the Y button 57 at No. 12 is an emergency stop instruction, and it is an effective command not only when the remote operation mode is set but also when the automatic driving mode is set. Similarly, the operation of the START button at No. 5 is also effective in the automatic driving mode.

[0020] [Related Art] As related prior arts, there are Japanese Patent Application Laid-Open No. 11-046256 "Telemetry System" (Patent Document 1), Japanese Patent Application Laid-Open No. 2003-274443 "Wireless Mobile Communication System" (Patent Document 2), and Japanese Patent Application Laid-Open No. 2010-041594 "Remote Control Device" (Patent Document 3).

[0021] Patent Document 1 shows a configuration in which, at the master station of a telemetry system, the input of control command information to a slave station can be performed remotely by voice. Patent Document 2 describes a system in which a first control device that controls the call initiation / termination of a control station and a second control device that controls the call initiation / termination of a terminal are connected by a communication line, and the first control device remotely controls the second control device. Furthermore, Patent Document 3 describes a remote control device that detects an incoming call from a mobile station, outputs a specific audio signal, and thereby resets the operating state of an external device. [Prior art documents] [Patent Documents]

[0022] [Patent Document 1] Japanese Patent Application Publication No. 11-046256 [Patent Document 2] Japanese Patent Publication No. 2003-274443 [Patent Document 3] Japanese Patent Publication No. 2010-041594 [Overview of the Initiative] [Problems that the invention aims to solve]

[0023] However, conventional remote control systems require emergency stop operations to be performed via a controller, meaning only a specific operator can input the stop command. This presents a problem: even if a dangerous situation occurs while the operator is looking away from the monitor, others cannot immediately stop the vehicle, thus failing to avoid the danger.

[0024] Furthermore, Patent Documents 1 to 3 do not describe a configuration in which voice is converted into a control command and transmitted to the vehicle, and if the voice instructs an emergency stop, the vehicle is brought to an emergency stop regardless of whether it is in automatic driving mode or remote control mode.

[0025] This invention has been made in view of the above circumstances, and aims to provide a remote vehicle control system that can improve safety by allowing anyone who notices danger, even if they are not a designated driver, to make an emergency stop of the vehicle by voice. [Means for solving the problem]

[0026] To solve the problems of the above-mentioned conventional examples, the present invention provides a remote control system for a vehicle that includes a remote control device for setting an automatic driving mode in which the vehicle is driven by automatic control and a remote control mode in which the vehicle is driven by manual control, wherein the remote control device converts specific voices into control commands and transmits them to the vehicle, and when a specific voice specifies an emergency stop, the system performs control to bring the vehicle to an emergency stop, regardless of whether it is in automatic driving mode or remote control mode.

[0027] Furthermore, the present invention is characterized in that, in the above-mentioned remote control system, the remote control device converts only the voice specifying an emergency stop into a control command when in automatic driving mode, and converts voices for operations other than the voice specifying an emergency stop into a control command and transmits them to the vehicle to control the vehicle when in remote operation mode.

[0028] Furthermore, the present invention is characterized in that, in the above-mentioned remote control system, when the remote control device receives vehicle status information from the vehicle indicating that the vehicle has been stopped in an emergency, it displays "vehicle emergency stop" on the display unit.

[0029] Furthermore, the present invention is characterized in that, in the above-mentioned remote control system, when the remote control device converts an audio message specifying an emergency stop into a control command, it displays the content of the control command on the display unit.

[0030] Furthermore, the present invention is characterized in that, in the above-mentioned remote control system, if the remote control device makes an emergency stop in response to a voice command specifying an emergency stop while in automatic driving mode, it changes the automatic driving mode to remote control mode. [Effects of the Invention]

[0031] According to the present invention, a vehicle remote control system is provided which includes a remote control device that sets an automatic driving mode for driving the vehicle by automatic control and a remote control mode for driving the vehicle by manual control. The remote control device converts specific voice commands into control commands and transmits them to the vehicle. If a specific voice command specifies an emergency stop, the remote control system will perform emergency stop control on the vehicle regardless of whether it is in automatic driving mode or remote control mode. As a result, anyone who notices danger, even someone other than the designated operator, can perform an emergency stop on the vehicle by voice command, thereby improving safety.

[0032] Furthermore, according to the present invention, the remote control device is a remote control system that displays the content of a control command on the display unit when an emergency stop instruction voice is converted into a control command. This allows the person who voiced the emergency stop instruction to recognize whether their instruction has been converted into an accurate command. If it has not been converted accurately, they can give the instruction again by voice or by operating the controller to reliably input the emergency stop instruction and stop the vehicle, thereby further improving safety. [Brief explanation of the drawing]

[0033] [Figure 1] This is an explanatory diagram showing the configuration of this system. [Figure 2] This is an explanatory diagram of the voice command conversion table. [Figure 3] This is an example sequence (1) in the remote control mode of this system. [Figure 4] This is an example sequence (2) in the remote control mode of this system. [Figure 5] This is an example sequence (3) in the remote control mode of this system. [Figure 6] This is an explanatory diagram showing an overview of the remote control system. [Figure 7] This is an explanatory diagram showing the configuration of a conventional remote control system. [Figure 8] This is an explanatory diagram showing the configuration of the controller. [Figure 9] This is an explanatory diagram of the controller button-command conversion table. [Modes for carrying out the invention]

[0034] Embodiments of the present invention will be described with reference to the drawings. [Summary of the Embodiment] The vehicle remote control system according to an embodiment of the present invention (this system) includes a remote control device that sets an automatic driving mode or a remote control mode. The remote control device converts specific voice commands into control commands and transmits them to the vehicle. If a specific voice command specifies an emergency stop, the system controls the vehicle to make an emergency stop, regardless of whether it is in automatic driving mode or remote control mode. This allows anyone other than the designated driver to stop the vehicle by giving an emergency stop command via voice if they notice danger, thus enabling the avoidance of danger in an emergency.

[0035] Furthermore, this system is designed so that when the remote control device converts a voice command specifying an emergency stop into a control command, the content of the control command (emergency stop instruction) is displayed on the display unit. This allows the person who made the voice emergency stop instruction to know whether or not it was accurately converted into a command. If it was not converted into an emergency stop command, the vehicle can be stopped reliably by inputting the instruction again by voice or controller, thereby improving safety.

[0036] [Configuration of this system: Figure 1] The configuration of this system will be explained with reference to Figure 1. Figure 1 is an explanatory diagram showing the configuration of this system. As shown in Figure 1, this system is configured such that the vehicle-side device 20 and the remote control device 10 communicate via the network 30. The vehicle-side equipment 20 and the network 30 are the same as the conventional ones shown in Figure 7, so their explanation will be omitted. This system, like previous models, features both an automatic driving mode and a remote control mode.

[0037] The remote control device 10 has the same configuration as conventional devices, comprising a decoder 11, a monitor (vehicle camera image display unit) 12, routers 13a and 13b, a button-to-command conversion unit 15, a monitor (vehicle status display unit) 16, and a control controller (controller) 17. A distinctive feature of this system is the inclusion of a microphone 18 and a voice-to-command conversion unit 19. Furthermore, the operation of the vehicle information analysis unit 14 differs in some respects from the conventional model.

[0038] The distinctive features of the remote control device 10 of this system will be described below. Microphone 18 takes audio as input and converts it into an electrical signal. In this system, it acquires audio from the vicinity of the remote control device 10. In other words, microphone 18 can acquire audio spoken by people other than the operator of the controller 17.

[0039] The voice-to-command conversion unit 19 converts voice data into commands equivalent to those issued by controller buttons. As will be described later, the voice-to-command conversion unit 19 is equipped with a voice-to-command conversion table and outputs a command corresponding to the voice input from the microphone 18.

[0040] [Operation in this system: Figure 1] The operation of this system will be explained using Figure 1. Furthermore, the operation of transmitting vehicle status information indicating the vehicle's status from the vehicle-side device 20 to the remote control device 10, and monitoring the vehicle on the monitor 16 of the remote control device 10, is the same as in the conventional method, so a detailed explanation will be omitted. Furthermore, the operation of converting instructions from the controller 17 of the remote control device 10 into commands using the button-to-command conversion unit 15 and transmitting them to the vehicle-side device 20 to control the vehicle is the same as in the conventional method, so an explanation will be omitted.

[0041] [Voice-controlled remote control] In this system, when voice instructions are input from the microphone 18 of the remote control device 10, the voice-to-command conversion unit 19 converts them into commands equivalent to those of the controller 17 and transmits them to the vehicle-side device 20 via the router 13b. In the vehicle-side device 20, the command conversion unit 26 of the vehicle monitoring control unit converts them into commands corresponding to the ECU 24, and the vehicle control unit 27 outputs these commands to the ECU 24, thereby controlling the vehicle.

[0042] Here, the voice-to-command conversion unit 19 of the remote control device 10 of this system converts all voices into commands when the remote control mode is set, but when the automatic driving mode is set, it converts only the voice indicating "emergency stop" into a command. In other words, when the remote control device 10 receives the voice command "emergency stop," it converts it into a command to instruct the vehicle to perform an emergency stop, regardless of whether it is in remote control mode or automatic driving mode, and sends it to the vehicle-side device 20.

[0043] As a result, in this system, even if the operator controlling the controller 17 does not notice the danger, another person nearby watching the monitor 16 can say "Emergency stop!", the voice will be input to the microphone 18, and a command corresponding to an emergency stop will be sent to the vehicle-side device 20, making it possible to bring the vehicle to an emergency stop and avoid danger.

[0044] Since anyone from an unspecified group can make the call, the chances of overlooking a danger are reduced, and emergency stop instructions can be transmitted quickly. Furthermore, even people with disabilities or injuries that make it difficult to operate the vehicle with their hands can easily control it.

[0045] [Display of command content via voice input] Furthermore, in this system, when voice input is performed, the voice-to-command conversion unit 19 outputs the converted command to the vehicle information analysis unit 14 to verify whether the content of the voice has been accurately converted into a command. The vehicle information analysis unit 14 then analyzes the command and displays its contents on the monitor 16. The display on monitor 16 should show the content of the voice command, for example, "Voice command: Emergency stop."

[0046] This allows the monitor 16 to verify whether the voice uttered in a panic during an emergency has been converted into the correct emergency stop command. If it has not been converted correctly, the user can re-utter "emergency stop" or operate the controller 17 to reliably send the emergency stop instruction to the vehicle-side device 20.

[0047] [Operating mode after emergency stop] Furthermore, in this system, if an emergency stop command is received from the remote control device 10, whether the command is given by the controller 17 or by voice, the operating mode is set to remote control mode. Specifically, when the button-to-command conversion unit 15 or voice-to-command conversion unit 19 of the remote control device 10 receives the command "emergency stop," it then sends a command to set the operating mode to remote control mode.

[0048] This means that even if the automatic driving mode was previously set, after an emergency stop, it will switch to remote control mode, preventing automatic driving from being performed when the cause of the dangerous situation is unknown. This allows the operator to confirm safety on the monitor 16 and drive the vehicle, thereby improving safety. Furthermore, after operation has resumed in remote control mode, if safety has been confirmed, the operator may switch to automatic driving mode.

[0049] [Voice-to-Command Conversion Table: Figure 2] Next, the voice-to-command conversion table will be explained using Figure 2, which is an explanatory diagram of the voice-to-command conversion table. As shown in Figure 2, the voice-to-command conversion table stores the voice data, the conversion bits, their content, and notes in an associated manner. The conversion bit is a bit signal that is equivalent to the command input by the controller 17.

[0050] For example, the voice command "Start remote control" is converted into a command (conversion bit) to control the start of remote control or the disengagement of automatic driving, the voice command "Forward" is converted into a command to instruct forward, and the voice command "Emergency stop" is converted into an emergency stop command. The emergency stop command is valid not only in remote control mode but also when automatic driving mode is set, and is transmitted to the vehicle-side device 20.

[0051] [Sequence in remote control mode: Figures 3-5] Next, we will explain the sequence examples in the remote control mode of this system using Figures 3 to 5. Figure 3 is sequence example (1) in the remote control mode of this system, Figure 4 is sequence example (2) in the remote control mode of this system, and Figure 5 is sequence example (3) in the remote control mode of this system. Figures 3 to 5 represent a continuous sequence, but are shown in separate sections.

[0052] [Example of remote control mode sequence (1): Figure 3] First, we will explain the sequence from power-on using Figure 3. As shown in Figure 3, first, when the vehicle's power is turned on (or the engine is turned on) (S1), the ECU 24 sends vehicle status information to the vehicle monitoring unit 25 of the vehicle monitoring control unit (S2), and the vehicle monitoring unit 25 outputs the vehicle status information to the command conversion unit 26 (S3). The command conversion unit 26 converts the vehicle status information into a remote monitoring format and transmits it to the remote control device 10 (S4).

[0053] In the remote control device 10, the vehicle information analysis unit 14 of the remote monitoring control unit receives the remote monitoring format and displays the received content as vehicle status information on the monitor (vehicle status display unit) 16 (S6). Then, when the START button is pressed on the controller 17 and an instruction for remote control mode (remote driving mode in the diagram) is input (S7), the controller information is output to the button-command conversion unit 15 (S8), the button-command conversion unit 15 converts it to a remote control format and transmits it to the vehicle-side device 20 (S9).

[0054] In the vehicle-side device 20, the command conversion unit 26 analyzes the received control information, converts it into vehicle control data suitable for the ECU 24, and outputs it to the vehicle control unit 27 (S10). The vehicle control unit 27 outputs vehicle control information to the ECU 24 (S11), and the ECU 24 sets a remote operation mode (indicated as remote driving mode in the diagram) based on the vehicle control information and operates accordingly. Furthermore, the remote control device 10 displays "Remote control mode" (remote control mode in the diagram) on the monitor 16 (S12).

[0055] When the ECU24 starts operating, it periodically transmits vehicle status information, and the vehicle status is displayed on the monitor 16 on the remote control device 10 side (S13~S17). Here, the ECU 24 periodically notifies the latest vehicle status, but the vehicle monitoring unit 25 does not transmit to the remote control device 10 if there is no change in the vehicle status.

[0056] [Example of remote control mode sequence (2): Figure 4] An example sequence following Figure 3 will be explained using Figure 4. When remote control mode is set, as shown in Figure 4, when a key operation is performed from the controller 17 (S21), controller information is output to the button-command conversion unit 15 (S22), the controller information is converted to a remote control format by the button-command conversion unit 15 and transmitted to the vehicle-side device 20 (S23). In the example shown in Figure 4, during process S21, the controller 17 receives the instruction to "move straight + move forward" by pressing the "up" button on the directional pad and the X button.

[0057] In the vehicle-side device 20, vehicle control information is output to the ECU 24 via the command conversion unit 26 and the vehicle control unit 27 (S24, S25), and the ECU 24 controls the vehicle to move "straight + forward" according to the vehicle control information (S26). Then, the ECU24 notifies the vehicle status information as "straight + forward," and the monitor 16 of the remote control device 10 displays that a straight + forward instruction has been given (S28~S31). In the sequences shown in Figures 3 and 4, a specific operator (operator A) controlling the controller 17 is in control of the vehicle.

[0058] [Example of remote control mode sequence (3): Figure 5] An example sequence following Figure 4 will be explained using Figure 5. As shown in Figure 5, when any person (person B) who notices a danger during operation says "emergency stop" (S41), the microphone 18 receives the voice input and outputs the voice-to-command conversion unit 19, which converts the voice data into a command in remote control format and outputs it to the vehicle information analysis unit 14 (S43) and also transmits it to the vehicle-side device 20 (S46).

[0059] The vehicle information analysis unit 14 analyzes the remote control format command before or in parallel with the emergency stop operation initiated by the vehicle-side device 20, outputs the contents of the command to the monitor 16 (S44), and the monitor 16 displays "Emergency Stop Instruction" (S45). This allows person B, who issued the emergency stop command, to recognize that their command was correctly interpreted. If "Emergency Stop Instruction" is not displayed on the monitor 16 even after an emergency stop command is spoken, it indicates that the voice-to-command conversion unit 19 did not recognize the command correctly. The emergency stop instruction can then be spoken again to ensure that the emergency stop instruction is reliably transmitted.

[0060] Furthermore, when the vehicle-side device 20 receives a command in remote control format, the command conversion unit 26 converts it into vehicle control information and outputs it to the vehicle control unit 27 (S47). The vehicle control unit 27 then outputs the vehicle control information to the ECU 24 (S48), and the ECU 24 controls the vehicle to perform an emergency stop (S49).

[0061] Then, when vehicle status information indicating that the vehicle has made an emergency stop is notified from the ECU24 (S50), it is transmitted to the remote control device 10 via the vehicle monitoring unit 25 and the command conversion unit 26 (S51, S52), analyzed by the vehicle information analysis unit 14 of the remote control device 10, and the monitor 16 displays that the vehicle is in an emergency stop state (S53, S54). In this way, an example of the remote control mode sequence in this system is performed.

[0062] Furthermore, although not shown in the diagram, regardless of whether the operating mode is remote control mode or automatic driving mode, when the vehicle information analysis unit 14 detects that the vehicle has made an emergency stop (processing S52 in Figure 5), it instructs the button-to-command conversion unit 15 (or voice-to-command conversion unit 19) to output a command to set the remote control mode. Upon receiving the instruction, the button-to-command conversion unit 15 converts the command for setting the remote control mode into a remote control format and transmits it to the vehicle-side device 20.

[0063] This means that if an emergency stop occurs, a remote control mode will be activated, thereby improving safety. This control is particularly effective when the automatic driving mode is set; therefore, if the remote control mode is already set, the system may be configured not to perform any control.

[0064] [Effects of the embodiment] According to this system, a remote control device 10 is provided to set either an automatic driving mode or a remote control mode. The remote control device 10 is equipped with a voice-to-command conversion unit 19 that converts specific voices into control commands and transmits them to the vehicle. If a specific voice indicates an emergency stop, the system will control the vehicle to an emergency stop, regardless of whether it is in automatic driving mode or remote control mode. This means that even someone other than the designated driver can stop the vehicle by giving an emergency stop command by voice if they notice danger, thus avoiding danger in an emergency and improving safety.

[0065] Furthermore, according to this system, when the remote control device 10 converts an audio command specifying an emergency stop into a control command, the content of the control command (emergency stop instruction) is displayed on the monitor 16. This allows the person making the emergency stop instruction to know whether or not it was accurately converted into a command. If it was not converted into an emergency stop command, they can re-enter the instruction by voice or controller to stop the vehicle reliably, thereby further improving safety. [Industrial applicability]

[0066] The present invention is suitable for a vehicle remote control system that can improve safety by allowing anyone who notices a danger, even if they are not a designated driver, to make an emergency stop of the vehicle by voice command. [Explanation of Symbols]

[0067] 10…Remote control device, 11,41…Decoder, 12,42…Monitor (in-vehicle camera image display unit), 13,23,43…Router, 14,44…Vehicle information analysis unit, 15,45…Button-command conversion unit, 16,46…Monitor (vehicle status display unit), 17,47…Controller, 18…Microphone, 19…Vehicle-command conversion unit, 20…Vehicle-side device, 21…Camera, 22…Encoder, 24…ECU, 25…Vehicle monitoring unit, 26…Command conversion unit, 27…Vehicle control unit, 30…Network, 51…Cross buttons, 52…BACK button, 53…START button, 54…X button, 55…A button, 56…B button, 57…Y button, 58…L button, 59…R button

Claims

1. A remote control system for a vehicle, comprising a remote control device that sets an automatic driving mode for driving the vehicle by automatic control and a remote control mode for driving the vehicle by manual control, The remote control device converts specific voice commands into control commands and transmits them to the vehicle, and if the specific voice specifies an emergency stop, the system is characterized in that it performs control to bring the vehicle to an emergency stop, whether in the automatic driving mode or the remote control mode.

2. The remote control device is characterized in that, in the automatic driving mode, it converts only the voice specifying the emergency stop into a control command, and in the remote operation mode, it converts voices for operations other than the voice specifying the emergency stop into a control command and transmits them to the vehicle to control the vehicle, as described in claim 1.

3. The remote control system according to claim 1 or 2, characterized in that when the remote control device receives vehicle status information from the vehicle indicating that the vehicle has been stopped in an emergency, it displays "emergency stop" on the display unit.

4. The remote control system according to claim 3, characterized in that when the remote control device converts the voice specifying the emergency stop into a control command, it displays the contents of the control command on the display unit.

5. The remote control system according to claim 1 or 2, characterized in that when the vehicle is brought to an emergency stop by a voice command specifying an emergency stop while the remote control device is in the automatic driving mode, the remote control device changes the automatic driving mode to the remote control mode.

Images