Remote control system, moving body, controller, and remote control method
The remote control system for vehicles ensures safe operation by enabling remote control only under authorized conditions and automatically disabling unauthorized attempts, enhancing safety and preventing inappropriate use.
Patent Information
- Application Number
- JP2023074214
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2043-04-28
AI Technical Summary
Existing remote control systems for vehicles lack the ability to prevent unauthorized or inappropriate remote control operations, which can lead to unsafe conditions.
A remote control system with a command reception unit that can switch between enabled and disabled states, and a determination unit that ensures remote control is only enabled under predetermined permission conditions, including device, location, and personnel authorization, with additional safety measures to revert to disabled state if conditions are not met.
Prevents unauthorized remote control and ensures safe operation by ensuring remote control is only enabled when appropriate conditions are met, and automatically disabling or notifying of unsafe attempts.
Smart Images

Figure 2024158734000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a remote control system, a moving object, a control device, and a remote control method. [Background technology]
[0002] 2. Description of the Related Art In a vehicle manufacturing process, a technique is known for running a vehicle by remote control (for example, see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2017-538619 Summary of the Invention [Problem to be solved by the invention]
[0004] In order to improve user convenience, it is preferable that the remote control of a moving object can be switched between enabled and disabled. However, if the remote control can be switched from disabled to enabled unconditionally, there is a possibility that the remote control may be performed under inappropriate circumstances. [Means for solving the problem]
[0005] The present disclosure can be realized in the following forms.
[0006] (1) According to a first aspect of the present disclosure, there is provided a remote control system, comprising: a remotely controllable mobile body, the mobile body including a command receiving unit for switching an operation state between an effective state in which a remote control command supplied from an external source is received and an ineffective state in which the remote control command is not received, a first communication unit for transmitting at least one of first information indicating that the operation state may be switched to the effective state and second information indicating that the operation state has been switched to the effective state, and a control device for determining whether or not the operation state should be switched to the effective state, the control device including a second communication unit for receiving the at least one of the information, and a determination unit for permitting the switching of the operation state to the effective state when the at least one of the information is received by the second communication unit and it is determined that a predetermined permission condition is satisfied. According to the remote control system of this embodiment, it is possible to prevent remote control of a moving object from being performed under inappropriate circumstances. (2) In the remote control system of the above form, when the determination unit determines that the first information is received by the second communication unit and that the permission condition is satisfied, the determination unit may send a permission notification to the mobile body indicating that switching of the operating state to the valid state is permitted, and the command receiving unit may restrict the switching of the operating state to the valid state if it does not receive the permission notification within a predetermined period after the first information is transmitted from the first communication unit. According to this form of remote control system, if the permission conditions are not met, the operating state of the command receiving unit can be restricted from being switched from an disabled state to an enabled state, thereby preventing remote control of a moving object from being performed under inappropriate circumstances. (3) In the remote control system of the above aspect, when the determination unit determines that the second information is received by the second communication unit and that the permission condition is not satisfied, the determination unit may send a disable command to the mobile body to cause the operating state to be switched to the disabled state. According to this form of remote control system, if the permission conditions are not met, the operating state of the command receiving unit can be reverted from an enabled state to an disabled state, thereby preventing remote control of a moving object from being performed under inappropriate circumstances. (4) In the remote control system of the above form, if the determination unit determines that the operating state has not been switched to the disabled state after transmitting the disable command to the moving body, the determination unit may transmit a stop command to the moving body to restrict movement of the moving body. According to this form of remote control system, if the operating state of the command receiving unit does not return from an enabled state to an disabled state, the movement of the moving body can be restricted, thereby preventing remote control of the moving body from being performed under inappropriate circumstances. (5) The remote control system of the above embodiment may further include an alarm unit that notifies that an abnormality has occurred, and if the determination unit determines that the operating state has not been switched to the disabled state after transmitting the disable command to the mobile body, the determination unit may cause the alarm unit to notify that an abnormality has occurred. According to the remote control system of this aspect, if the operation state of the command receiving unit does not return from the enabled state to the disabled state, it is possible to notify that an abnormality has occurred. (6) In the remote control system of the above aspect, the permission conditions may include that the moving object is stopped. According to this form of remote control system, it is possible to improve safety when remote control of a moving object is enabled. (7) In the remote control system of the above aspect, the permission condition may include that the operation state is switched to the valid state by a predetermined device. According to the remote control system of this aspect, it is possible to prevent remote control of the moving body from being performed by an unauthorized device after the operating state of the command receiving unit is switched to the enabled state. (8) In the remote control system of the above aspect, the permission condition may include that the operating state is switched to the valid state in a predetermined location. According to the remote control system of this aspect, it is possible to prevent remote control of a moving object from being performed in an unauthorized location after the operating state of the command receiving unit is switched to an enabled state. (9) In the remote control system of the above aspect, the permission condition may include that the operational state is switched to the valid state by a predetermined person. According to the remote control system of this aspect, it is possible to prevent an unauthorized person from remotely controlling a moving object after the operating state of the command receiving unit is switched to the enabled state. (10) According to a second aspect of the present disclosure, there is provided a remotely controllable moving body, comprising: a command receiving unit that switches an operation state between an effective state in which a remote control command supplied from an external source is received and an ineffective state in which the remote control command is not received, and a communication unit that transmits at least one of first information indicating that the operation state may be switched to the effective state and second information indicating that the operation state has been switched to the effective state. According to the moving body of this embodiment, it is possible to prevent the moving body from being remotely controlled under inappropriate circumstances. (11) According to a third aspect of the present disclosure, there is provided a control device comprising: a communication unit for receiving at least one of first information indicating that the operational state may be switched to the effective state and second information indicating that the operational state has been switched to the effective state from a remotely controllable mobile body having a command receiving unit that switches an operational state between an effective state in which a remote control command supplied from an outside is received and an invalid state in which the remote control command is not received, and a determination unit that permits switching of the operational state to the effective state when it is determined that the at least one of the information is received by the communication unit and satisfies a predetermined permission condition. According to the control device of this embodiment, it is possible to prevent remote control of the moving body from being performed under inappropriate circumstances. (12) According to a fourth aspect of the present disclosure, there is provided a remote control method, which includes receiving, from a remotely controllable mobile body having a command receiving unit capable of switching an operation state between an effective state in which a remote control command supplied from an outside is received and an ineffective state in which the remote control command is not received, at least one of first information indicating that the operation state may be switched to the effective state and second information indicating that the operation state has been switched to the effective state, and permitting the switching of the operation state to the effective state when it is determined that the at least one of the information has been received and a predetermined permission condition is satisfied. According to the remote control method of this aspect, it is possible to prevent remote control of a moving object from being performed under inappropriate circumstances. The present disclosure may be realized in various forms other than a remote control system, a moving object, a control device, and a remote control method, for example, a computer program, a recording medium on which a computer program is recorded, or the like. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is an explanatory diagram showing a configuration of a remote control system. [Diagram 2] FIG. 1 is an explanatory diagram showing a configuration of a vehicle. [Diagram 3] FIG. 1 is an explanatory diagram showing a geofence area. [Figure 4] FIG. 2 is an explanatory diagram showing a state in which a vehicle runs under remote control. [Diagram 5] 11 is a flowchart showing the contents of post-validation processing. [Figure 6] 11 is a flowchart showing the contents of a post-validation determination process. [Figure 7] FIG. 13 is an explanatory diagram showing a state in which remote control of the vehicle is returned from enabled to disabled; [Figure 8] 11 is a flowchart showing the contents of a pre-validation process. [Figure 9] 11 is a flowchart showing the contents of a pre-validation determination process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] A. First embodiment: FIG. 1 is an explanatory diagram showing the configuration of a remote control system 10 in the first embodiment. FIG. 2 is an explanatory diagram showing the configuration of a vehicle 100 in the first embodiment. The remote control system 10 is used to remotely control a moving object. In this embodiment, the moving object is the vehicle 100. More specifically, the moving object is an electric vehicle (BEV: Battery Electric Vehicle). Note that the moving object is not limited to an electric vehicle, and may be, for example, a gasoline vehicle, a hybrid vehicle, or a fuel cell vehicle. The moving object is not limited to the vehicle 100, and may be, for example, an electric vertical take-off and landing aircraft (a so-called flying car).
[0009] 1, in this embodiment, a remote control system 10 includes a remotely controllable vehicle 100, a remote control device 200 for remotely controlling the vehicle 100, and a management device 300. The remote control device 200 may also be simply referred to as a control device.
[0010] As shown in FIG. 2, the vehicle 100 includes a vehicle control device 110 for controlling each part of the vehicle 100, an actuator group 120 that operates under the control of the vehicle control device 110, a communication device 130 for communicating with a remote control device 200 by wireless communication, a connector 140 to which a switching device TL for switching between enabling and disabling the remote control of the vehicle 100 is connected, a GSNN (Global Navigation Satellite System) receiver 150 for acquiring position information of the vehicle 100, and an in-vehicle camera 160 for photographing the interior of the vehicle 100. In this embodiment, the actuator group 120 includes an actuator of a drive device for accelerating the vehicle 100, an actuator of a steering device for changing the traveling direction of the vehicle 100, and an actuator of a braking device for decelerating the vehicle 100. The drive device includes a battery, a running motor driven by the power of the battery, and a drive wheel rotated by the running motor. The actuator of the drive device includes a running motor. The connector 140 is disposed in the interior of the vehicle 100. The in-vehicle camera 160 can capture an image of the worker WK connecting the switching device TL to the connector 140. The communication device 130 may be referred to as a first communication unit.
[0011] The vehicle control device 110 is configured by a computer including a processor 111, a memory 112, an input / output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input / output interface 113 are connected via the internal bus 114 to enable bidirectional communication. The input / output interface 113 is connected to an actuator group 120, a communication device 130, a connector 140, a GSNN receiver 150, and an in-vehicle camera 160. The memory 112 stores a computer program PG1.
[0012] The processor 111 executes the computer program PG1 to function as a vehicle control unit 115, a command receiving unit 116, and an information acquisition unit 117. The vehicle control unit 115 controls the actuator group 120. The command receiving unit 116 receives a remote control command supplied from outside the vehicle 100. The remote control command is a control command for driving the actuator group 120. In this embodiment, the remote control command indicates, for example, a target value of the acceleration and a target value of the steering angle of the vehicle 100. The remote control command may indicate a target route of the vehicle 100. In this case, the vehicle control unit 115 may determine a target value of the acceleration and a target value of the steering angle of the vehicle 100 from the target route. The remote control command received by the command receiving unit 116 is supplied to the vehicle control unit 115. When a driver is on board the vehicle 100, the vehicle control unit 115 controls the actuator group 120 in response to an operation by the driver to drive the vehicle 100. The vehicle control unit 115 can also drive the vehicle 100 by controlling the actuator group 120 in response to remote control commands received by the command receiving unit 116, regardless of whether a driver is on board the vehicle 100 or not.
[0013] The command reception unit 116 can switch its own operation state between an enabled state in which a remote control command is received and an disabled state in which a remote control command is not received. In the following description, switching the operation state of the command reception unit 116 from an disabled state to an enabled state is called enabling the remote control, and switching the operation state of the command reception unit 116 from an enabled state to an disabled state is called disabling the remote control. The command reception unit 116 disables the remote control when it receives a disable command, which is a command for disabling the remote control, and enables the remote control when it receives an enable command, which is a command for disabling the remote control. In this embodiment, the disable command is supplied from the remote control device 200 via the communication device 130. The enable command is supplied from the switching device TL via the connector 140.
[0014] The information acquisition unit 117 acquires information used to determine whether or not remote control of the vehicle 100 is enabled, and transmits the acquired information to the remote control device 200. In this embodiment, the information acquisition unit 117 acquires information indicating whether the start switch of the vehicle 100 is on or off, identification information of the switching device TL connected to the connector 140, location information indicating the current location of the vehicle 100 obtained from the GSNN receiver 150, and an image obtained from the in-vehicle camera 160. The start switch corresponds to an ignition switch in a gasoline-powered vehicle. If the start switch is off, the vehicle 100 cannot run by itself.
[0015] As shown in FIG. 1, the remote control device 200 is configured by a computer including a processor 201, a memory 202, an input / output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input / output interface 203 are connected via the internal bus 204 so as to be able to communicate bidirectionally. The input / output interface 203 is connected to a communication device 205 for communicating with the vehicle 100 and the management device 300 by wireless communication. The communication device 205 may communicate with the vehicle 100 by wireless communication and with the management device 300 by wired communication. The memory 202 stores a computer program PG2 and a database DB. The communication device 205 may be referred to as a second communication unit.
[0016] The processor 201 executes the computer program PG2 to function as a remote control unit 210 and a determination unit 220. The remote control unit 210 generates a remote control command for remotely controlling the vehicle 100, and supplies the remote control command to the vehicle 100. The determination unit 220 determines whether or not it is appropriate to enable remote control of the vehicle 100.
[0017] In the database DB, identification information of a device permitted to be used to activate the remote control of the vehicle 100, identification information of a person permitted to activate the remote control of the vehicle 100, and information indicating the range of a geofence area permitted to activate the remote control of the vehicle 100 are registered. The device permitted to be used to activate the remote control includes, for example, a switching device TL manufactured by the manufacturer of the vehicle 100. The person permitted to activate the remote control includes, for example, an employee of the manufacturer of the vehicle 100 and an employee of a dealer of the vehicle 100. The geofence area is an area surrounded by a geofence, which is a virtual fence. The geofence area is set so as to include a specific facility or a specific area.
[0018] The management device 300 is a device for managing the remote control system 10. The management device 300 is, for example, a desktop personal computer. The management device 300 may be a tablet terminal. The management device 300 is operated by an administrator of the remote control system 10. The management device 300 includes a communication device (not shown) for communicating with the remote control device 200 by wired communication or wireless communication, and a notification unit 310 for notifying the administrator that an abnormality has occurred in the remote control system 10. In this embodiment, the notification unit 310 is a display, and notifies the administrator of the abnormality by, for example, a text message. The notification unit 310 may be a speaker that notifies the abnormality by sound, or a lamp that notifies the abnormality by light.
[0019] Fig. 3 is an explanatory diagram showing a geofence area RG. Three geofence areas RG1 to RG3 are shown in Fig. 3. The geofence area RG1 is provided to include a factory KJ where the vehicle 100 is manufactured, the geofence area RG2 is provided to include a dealer DR where the vehicle 100 is sold, and the geofence area RG3 is provided to include a port PT where the vehicle 100 is shipped. In the following description, when the geofence areas RG1 to RG3 are described without any particular distinction, they are simply referred to as geofence areas RG.
[0020] FIG. 4 is an explanatory diagram showing a state in which the vehicle 100 runs by remote control. FIG. 4 shows a state in which two vehicles 100A, 100B run in a factory KJ. In the following description, when the vehicles 100A, 100B are not particularly distinguished from each other, they are simply called the vehicle 100. In this embodiment, the factory KJ includes a first location PL1 where the assembly work of the vehicle 100 is performed, and a second location PL2 where the inspection of the vehicle 100 is performed. The first location PL1 and the second location PL2 are connected by a running path SR on which the vehicle 100 can run. The vehicle 100 assembled in the first location PL1 is inspected in the second location PL2. The vehicle 100 that passes the inspection in the second location PL2 is shipped from the factory KJ.
[0021] When the assembly work at the first location PL1 is completed, the vehicle 100 is in a state in which it can be moved by remote control. The state in which the vehicle 100 can be moved by remote control means that the vehicle 100 is equipped with the vehicle control device 110, the drive device, the steering device, the braking device, and the communication device 130, and can perform three functions of "running," "turning," and "stopping" by remote control. Therefore, at the time when the vehicle 100 moves by remote control, at least a part of the interior parts such as the driver's seat and the dashboard may not be attached to the vehicle 100, at least a part of the exterior parts such as the bumper and the fender may not be attached to the vehicle 100, and the vehicle 100 may not have a body shell. In this case, the remaining parts such as the body shell may be attached to the vehicle 100 before the vehicle 100 is shipped from the factory KJ, or the remaining parts such as the body shell may be attached to the vehicle 100 after the vehicle 100 is shipped from the factory KJ.
[0022] The locations PL1, PL2 may be provided in the same building, or in different buildings on the same premises. The locations PL1, PL2 may be provided outdoors, not indoors. The locations PL1, PL2 may be provided distributed across multiple premises. For example, the locations PL1, PL2 may be provided distributed across a first factory and a second factory adjacent to each other across a public road or a private road. In this case, the first factory and the second factory are collectively referred to as the factory KJ, and the travel path SR may include a part of the public road or a part of the private road.
[0023] A method in which the remote control unit 210 makes the vehicle 100 travel by remote control will be described by taking as an example a case in which the vehicle 100 travels from a first location PL1 to a second location PL2. The remote control unit 210 determines a target route for the vehicle 100 to travel to a destination along a travel path SR. A plurality of cameras CM that capture the travel path SR are installed in the factory KJ, and the remote control unit 210 can obtain the relative position and orientation of the vehicle 100 with respect to the target route in real time by analyzing the images captured by each camera CM. The remote control unit 210 generates a remote control command for causing the vehicle 100 to travel along the target route, and transmits the remote control command to the vehicle 100. The vehicle control device 110 mounted on the vehicle 100 controls the actuator group 120 according to the received remote control command to cause the vehicle 100 to travel. Therefore, the remote control system 10 can move the vehicle 100 from the first location PL1 to the second location PL2 by remote control without using a transport device such as a crane or a conveyor. In this embodiment, the remote control unit 210 can remotely control a plurality of vehicles 100A, 100B to run simultaneously in parallel.
[0024] In this embodiment, after the vehicle 100 moves to the second location PL2, the remote control of the vehicle 100 is disabled. Thereafter, the remote control of the vehicle 100 can be enabled. For example, when the remote control of the vehicle 100 transported from the factory KJ to the dealer DR is enabled, the vehicle 100 can be moved by remote control even if the worker at the dealer DR does not drive the vehicle 100. Alternatively, when the remote control of the vehicle 100 transported from the factory KJ to the port PT is enabled, the vehicle 100 can be loaded onto a ship by remote control even if the worker at the port PT does not drive the vehicle 100.
[0025] Fig. 5 is a flowchart showing the contents of post-activation processing executed in the vehicle 100. Fig. 6 is a flowchart showing the contents of post-activation determination processing executed in the remote control device 200. A method executed in the remote control system 10 when remote control of the vehicle 100 is activated will be described with reference to Figs. 5 and 6. The method executed in the remote control system 10 may be referred to as a remote control method.
[0026] The post-activation process shown in FIG. 5 is repeatedly executed by the vehicle control device 110 of the vehicle 100. When the post-activation process is started, in step S110, the command receiving unit 116 determines whether or not the remote control of the vehicle 100 has been activated. If it is not determined in step S110 that the remote control of the vehicle 100 has been activated, the command receiving unit 116 skips the process after step S110 and ends the post-activation process. If it is determined in step S110 that the remote control of the vehicle 100 has been activated, the command receiving unit 116 transmits an activation notification to the remote control device 200 via the communication device 130 in step S120. The activation notification is a notification indicating that the remote control has been activated. The activation notification may be referred to as second information.
[0027] In step S130, the command receiving unit 116 determines whether or not a disable command has been received from the remote control device 200. When it is not determined in step S130 that a disable command has been received from the remote control device 200, the command receiving unit 116 determines in step S140 whether or not a predetermined time has elapsed since the activation notification was transmitted. When it is not determined in step S140 that a predetermined time has elapsed since the activation notification was transmitted, the command receiving unit 116 returns to step S130 and determines again whether or not a disable command has been received from the remote control device 200. When it is determined in step S140 that a predetermined time has elapsed since the activation notification was transmitted, the command receiving unit 116 ends the post-activation process.
[0028] If it is determined in step S130 that a disable command has been received from the remote control device 200, the command receiving unit 116 executes disablement of the remote control of the vehicle 100 in step S150. In step S160, the command receiving unit 116 determines whether or not the disablement of the remote control of the vehicle 100 has been successful. If it is determined in step S160 that the disablement of the remote control of the vehicle 100 has been successful, the command receiving unit 116 transmits a disable success notification to the remote control device 200 in step S170. The disable success notification is a notification indicating that the disablement has been successful. Thereafter, the vehicle control device 110 ends the post-enablement process.
[0029] If it is determined in step S160 that the deactivation of the remote control of the vehicle 100 is not successful, the command receiving unit 116 transmits a deactivation failure notification to the remote control device 200 in step S180. The deactivation failure notification is a notification indicating that the deactivation has failed. In step S190, the vehicle control unit 115 stops the vehicle 100 by turning off the start switch of the vehicle 100. In this embodiment, the vehicle control unit 115 turns off the start switch of the vehicle 100 in accordance with the stop command received from the remote control device 200 via the communication device 130. Thereafter, the vehicle control device 110 ends the post-activation process.
[0030] 6 is repeatedly executed by the remote control device 200. When the post-activation determination process is started, in step S210, the determination unit 220 determines whether or not an activation notification has been received from the vehicle 100 via the communication device 205. If it is not determined in step S210 that an activation notification has been received from the vehicle 100, the determination unit 220 skips the process after step S210 and ends the post-activation determination process.
[0031] When it is determined in step S210 that the validation notification has been received from the vehicle 100, the determination unit 220 determines in step S220 whether or not a predetermined permission condition is satisfied. In this embodiment, the determination unit 220 determines that the permission condition is satisfied when at least one of the following conditions A to D is satisfied. Condition A: Remote control activation is performed with the start switch of vehicle 100 turned off. Condition B: The remote control is enabled by a switching device TL registered in the database DB. · Condition C: The remote control activation is performed by a worker WK who is registered in the database DB. Condition D: The remote control activation is performed within a geofence area RG registered in the database DB. The permission condition may be that any one of conditions A to D is satisfied, or that two or more of conditions A to D are satisfied, or that three or more of conditions A to D are satisfied, or that all of conditions A to D are satisfied.
[0032] Regarding condition A, in this embodiment, the determination unit 220 acquires, together with the activation notification, information indicating the on / off state of the start switch at the time when the activation is performed from the vehicle 100. When condition A is included in the permission conditions, it is possible to improve safety when the remote control of the vehicle 100 is activated.
[0033] Regarding condition B, in this embodiment, the switching device TL transmits identification information of the switching device TL together with an activation command to the vehicle 100 via the connector 140. The determination unit 220 acquires the identification information of the switching device TL together with the activation notification from the vehicle 100. The determination unit 220 determines whether or not the switching device TL used for activation is registered in the database DB. When condition B is included in the permission conditions, it is possible to prevent the activation of remote control of the vehicle 100 by an unauthorized switching device TL.
[0034] Regarding condition C, in this embodiment, the face of the worker WK who connects the switching device TL to the connector 140 is captured by the in-vehicle camera 160. The determination unit 220 acquires an image of the worker WK captured by the in-vehicle camera 160 together with the activation notification. The determination unit 220 determines whether the worker WK captured in the image is a person registered in the database DB by face recognition using the image. When condition C is included in the permission conditions, it is possible to prevent an unauthorized person from activating remote control of the vehicle 100.
[0035] Regarding condition D, in this embodiment, the determination unit 220 acquires the position information of the vehicle 100 obtained from the GSNN receiver 150 together with the activation notification. The determination unit 220 determines whether or not the position information of the vehicle 100 is located within a geofence area RG registered in the database DB. When condition D is included in the permission conditions, it is possible to prevent remote control of the vehicle 100 from being activated in an unauthorized location.
[0036] If it is determined in step S220 that the permission conditions are satisfied, the determination unit 220 skips the processes after step S220 and ends the post-activation determination process. In other words, if it is determined in step S220 that the permission conditions are satisfied, the determination unit 220 ends the post-activation determination process without doing anything. If it is determined in step S220 that the permission conditions are satisfied, the determination unit 220 may transmit a notification to the vehicle 100 indicating that activation of the remote control is permitted.
[0037] If it is determined in step S220 that the permission conditions are not satisfied, then in step S230, the determination unit 220 transmits an invalidation command to the vehicle 100. In step S240, the determination unit 220 determines whether or not a successful invalidation notification has been received from the vehicle 100. If it is determined in step S240 that a successful invalidation notification has been received from the vehicle 100, the determination unit 220 skips the processing after step S240 and ends the post-validation determination processing.
[0038] If it is not determined in step S240 that the invalidation success notification has been received from the vehicle 100, the determination unit 220 determines in step S250 whether a predetermined time has elapsed since the invalidation command was transmitted. If it is not determined in step S250 that the predetermined time has elapsed, the determination unit 220 returns to step S240 and determines whether a invalidation success notification has been received. If it is determined in step S250 that the predetermined time has elapsed, the determination unit 220 transmits a stop command, which is a command to turn off the start switch of the vehicle 100, in step S260. In step S270, the determination unit 220 transmits a notification to the management device 300 indicating that the invalidation of the remote control of the vehicle 100 has failed. The management device 300 notifies the administrator via the notification unit 310 that the invalidation of the remote control of the vehicle 100 has failed. Thereafter, the determination unit 220 ends the post-validation determination process.
[0039] FIG. 7 is an explanatory diagram showing a state in which the remote control of the vehicle 100 is returned from enabled to disabled. Two vehicles 100A and 100B are shown in FIG. 7. In the example shown in FIG. 7, the permission condition is that the remote control is enabled using a switching device TL registered in the database DB (condition B). The switching device TL1 shown in FIG. 7 is a switching device TL registered in the database DB, while the switching device TL2 is a switching device TL that is not registered in the database DB. When the worker WK1 enables the remote control of the vehicle 100A using the switching device TL1, the vehicle 100A transmits the identification information of the switching device TL1 together with the activation notification TE to the remote control device 200. The identification information of the switching device TL1 is registered in the database DB, in other words, the activation of the remote control of the vehicle 100A satisfies the permission condition, so the remote control device 200 does not transmit the disable command to the vehicle 100A. In response to this, when the worker WK2 activates the remote control of the vehicle 100B using the switching device TL2, the vehicle 100B transmits the identification information of the switching device TL2 together with the activation notification TE to the remote control device 200. Since the identification information of the switching device TL2 is not registered in the database DB, in other words, the activation of the remote control of the vehicle 100B does not satisfy the permission condition, the remote control device 200 transmits a disable command SD to the vehicle 100B, and the remote control of the vehicle 100B is returned from enabled to disabled. If the remote control of the vehicle 100B does not return from enabled to disabled due to a communication error or the like, a notification is transmitted from the remote control device 200 to the management device 300. The management device 300, which has received the notification from the remote control device 200, activates the notification unit 310 to notify the administrator that an abnormality has occurred. Therefore, the administrator can grasp that the remote control of the vehicle 100B has not returned from enabled to disabled.
[0040] According to the remote control system 10 in the present embodiment described above, when remote control of the vehicle 100 is activated, an activation notification is transmitted from the vehicle 100 to the remote control device 200, and when the determination unit 220 of the remote control device 200 receives the activation notification and determines that the permission conditions are satisfied, it permits activation of the remote control of the vehicle 100. When the determination unit 220 receives the activation notification and determines that the permission conditions are not satisfied, it transmits a disable command to the vehicle 100. Therefore, it is possible to prevent remote control of the vehicle 100 from being performed under inappropriate circumstances.
[0041] Furthermore, in this embodiment, when the remote control of the vehicle 100 is not disabled even after the disable command is transmitted, the determination unit 220 transmits a stop command to the vehicle 100 to turn off the power switch. This makes it possible to prevent the remote control of the vehicle 100 from being performed under inappropriate circumstances.
[0042] Furthermore, in this embodiment, when the remote control of the vehicle 100 is not disabled even after the determination unit 220 transmits the disable command, the determination unit 220 transmits a notification to the management device 300 to cause the notification unit 310 to perform notification. Therefore, it is possible to prevent the remote control of the vehicle 100 from being performed under inappropriate circumstances.
[0043] B. Second embodiment: Fig. 8 is a flowchart showing the contents of pre-activation processing executed in the remote control system 10b of the second embodiment. Fig. 9 is a flowchart showing the contents of pre-activation determination processing executed in the remote control system 10b. The remote control system 10b of the second embodiment differs from the first embodiment in that the pre-activation processing shown in Fig. 8 and the pre-activation determination processing shown in Fig. 9 are executed prior to activation of the remote control of the vehicle 100. The other configurations are the same as those of the first embodiment unless otherwise described.
[0044] The pre-activation process shown in FIG. 8 is repeatedly executed by the vehicle control device 110 of the vehicle 100 while the remote control of the vehicle 100 is disabled. When the pre-activation process is started, in step S310, the command reception unit 116 determines whether or not there is a possibility that the remote control of the vehicle 100 will be activated. In this embodiment, when the command reception unit 116 detects a predetermined operation, it determines that there is a possibility that the remote control of the vehicle 100 will be activated. In this embodiment, when the switching device TL is connected to the connector 140, the command reception unit 116 determines that there is a possibility that the remote control of the vehicle 100 will be activated. In a form in which a cover is provided on the connector 140, the command reception unit 116 may determine that there is a possibility that the remote control of the vehicle 100 will be activated when the cover of the connector 140 is removed. The command reception unit 116 may determine that there is a possibility that the remote control of the vehicle 100 will be activated when the in-vehicle camera 160 detects that the worker WK is about to perform an operation to activate the remote control.
[0045] If it is not determined in step S310 that the remote control of the vehicle 100 may be enabled, the command receiving unit 116 skips the processing after step S310 and ends the pre-enabled processing. If it is determined in step S310 that the remote control of the vehicle 100 may be enabled, the command receiving unit 116 transmits, in step S320, to the remote control device 200 an advance notification indicating that the remote control of the vehicle 100 may be enabled. The advance notification may be referred to as first information.
[0046] In step S330, it is determined whether or not a permission notification has been received from the remote control device 200. The permission notification is a notification indicating that the activation of remote control is permitted. When it is determined in step S330 that the permission notification has been received from the remote control device 200, the command receiving unit 116 ends the activation pre-processing. When it is determined in step S330 that the permission notification has not been received from the remote control device 200, the command receiving unit 116 determines in step S340 whether or not a predetermined time has elapsed since the advance notification was transmitted. When it is determined in step S340 that the predetermined time has elapsed since the advance notification was transmitted, the command receiving unit 116 returns to step S330 and determines whether or not a permission notification has been received from the remote control device 200. When it is determined in step S340 that the predetermined time has elapsed since the advance notification was transmitted, the command receiving unit 116 restricts the activation of the remote control of the vehicle 100. For example, the command receiving unit 116 restricts the activation of the remote control of the vehicle 100 by refusing to accept an activation command for a predetermined period of time. Thereafter, the command receiving unit 116 ends the pre-validation process.
[0047] 9 is repeatedly executed by the remote control device 200 while the remote control of the vehicle 100 is in an invalid state. When the pre-validation determination process is started, in step S410, the determination unit 220 determines whether or not a prior notification has been received from the vehicle 100. If it is not determined in step S410 that a prior notification has been received from the vehicle 100, the determination unit 220 skips the process after step S410 and ends the pre-validation determination process.
[0048] When it is determined in step S410 that a prior notification has been received from vehicle 100, the determination unit 220 determines in step S420 whether or not the permission conditions are satisfied. In this embodiment, the determination unit 220 determines that the permission conditions are satisfied when at least one of the following conditions E to H is satisfied. Condition E: The start switch of the vehicle 100 is in the off state. Condition F: The remote control is enabled by a switching device TL registered in the database DB. · Condition G: Remote control activation is performed by a worker WK who is registered in the database DB. · Condition H: Remote control activation is performed within a geofence area RG registered in the database DB. The permission condition may be that any one of conditions E through H is satisfied, or that two or more of conditions E through H are satisfied, or that three or more of conditions E through H are satisfied, or that all of conditions E through H are satisfied.
[0049] If it is determined in step S420 that the permission conditions are not satisfied, the determination unit 220 ends the pre-validation determination process. If it is determined in step S420 that the permission conditions are satisfied, the determination unit 220 transmits a permission notification to the vehicle 100 in step S430. Thereafter, the determination unit 220 ends the pre-validation determination process.
[0050] According to the remote control system 10b in the present embodiment described above, when it is determined that a predetermined time has elapsed since the advance notification was transmitted without receiving a permission notification, the command receiving unit 116 restricts the activation of the remote control of the vehicle 100. Therefore, compared to the first embodiment, it is possible to more reliably prevent remote control of a moving body from being performed under inappropriate circumstances.
[0051] C. Other embodiments: (C1) In the remote control systems 10 to 10b of the above-described embodiments, the vehicle 100 includes a connector 140 to which the switching device TL is connected. In contrast, the vehicle 100 does not necessarily have to include the connector 140. In this case, an activation command may be supplied from the switching device TL via wireless communication.
[0052] (C2) In the remote control systems 10 to 10b of the above-described embodiments, the vehicle 100 is equipped with a GSNN receiver 150. On the other hand, if the above-described conditions D and H are not included in the permission conditions, the vehicle 100 does not need to be equipped with the GSNN receiver 150.
[0053] (C3) In the remote control systems 10 to 10b of the above-described embodiments, the vehicle 100 is equipped with an in-vehicle camera 160. In contrast, if the above-described conditions C and G are not included in the permission conditions, the vehicle 100 does not need to be equipped with an in-vehicle camera 160. It may be determined that the person performing the activation operation is authorized to perform the activation operation, for example, by an employee of the manufacturer of the vehicle 100 or an employee of the dealer DR of the vehicle 100.
[0054] (C4) In the remote control systems 10 to 10b of the above-described embodiments, the determination unit 220 is provided on the remote control device 200. In contrast, the determination unit 220 may be provided on a computer separate from the remote control device 200. In this case, the computer on which the determination unit 220 is provided may be referred to as a control device.
[0055] (C5) In the remote control systems 10 to 10b of the above-described embodiments, in step S190 of the post-validation processing, the vehicle control unit 115 turns off the start switch of the vehicle 100 in accordance with the stop command received from the remote control device 200 via the communication device 130. In contrast, the vehicle control unit 115 may be programmed to turn off the start switch of the vehicle 100 in step S190 of the post-validation processing even if it does not receive a stop command.
[0056] (C6) In the remote control systems 10 to 10b of the above-described embodiments, the remote control unit 210 acquires the relative position and orientation of the vehicle 100 with respect to the target route using the camera CM installed in the factory KJ. In contrast, the remote control unit 210 may acquire the relative position and orientation of the vehicle 100 with respect to the target route using a LiDAR installed in the factory KJ. Alternatively, the remote control unit 210 may acquire the relative position and orientation of the vehicle 100 with respect to the target route using the GSNN receiver 150 mounted on the vehicle 100. The remote control unit 210 may generate a remote control command according to the operation of an operator outside the vehicle 100, rather than automatically generating a remote control command. For example, the operator may operate a driving device that includes a display that displays the position and orientation of the vehicle 100, a steering wheel for operating the vehicle 100, an accelerator pedal, and a brake pedal, and the remote control unit 210 may generate a remote control command according to the operation applied to the driving device.
[0057] (C7) In each of the above-described embodiments, the first location PL1 is a location where assembly work is performed on the vehicle 100. In contrast, the first location PL1 may be, for example, a location where work is performed to adjust the optical axis of the headlamps of the vehicle 100 or to adjust the wheel alignment of the vehicle 100, or may be a location where inspection of the vehicle 100 is performed.
[0058] (C8) In each of the above-described embodiments, the second location PL2 is a location where an inspection of the vehicle 100 is performed. In contrast, the second location PL2 may be, for example, a location where an operation for adjusting the optical axis of the headlights of the vehicle 100 or an operation for adjusting the wheel alignment of the vehicle 100 is performed, or may be a location for storing the vehicle 100 before shipment.
[0059] (C9) In the remote control system 10b of the second embodiment described above, the pre-validation process and the pre-validation determination process are executed, and then the post-validation process and the post-validation determination process are executed. In contrast, in the remote control system 10b, the pre-validation process and the pre-validation determination process are executed, and then the post-validation process and the post-validation determination process do not have to be executed. Even in this case, the pre-validation process and the pre-validation determination process can prevent remote control of a moving object from being performed under inappropriate circumstances.
[0060] The present disclosure is not limited to the above-mentioned embodiment, and can be realized in various configurations without departing from the spirit of the present disclosure. For example, the technical features in the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention column can be appropriately replaced or combined to solve some or all of the above-mentioned problems or to achieve some or all of the above-mentioned effects. Furthermore, if the technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]
[0061] 10, 10b... remote control system, 100... vehicle (mobile body), 110... vehicle control device, 111... processor, 112... memory, 113... input / output interface, 114... internal bus, 115... vehicle control unit, 116... command reception unit, 117... information acquisition unit, 120... actuator group, 130... communication device, 140... connector, 150... GSNN receiver, 160... in-vehicle camera, 200... remote control device, 201... processor, 202... memory, 203... input / output interface, 204... internal bus, 205... communication device, 210... remote control unit, 220... determination unit, 300... management device, 310... notification unit
Claims
1. 1. A remote control system comprising: a remotely controllable mobile body, the mobile body including: a command receiving unit that switches an operating state between an effective state in which a remote control command supplied from an outside is received and an ineffective state in which the remote control command is not received; and a first communication unit that transmits at least one of first information indicating that the operating state may be switched to the effective state and second information indicating that the operating state has been switched to the effective state; a control device including a second communication unit for receiving the at least one piece of information, and a determination unit that permits switching of the operation state to the valid state when it is determined that the at least one piece of information is received by the second communication unit and satisfies a predetermined permission condition; A remote control system comprising:
2. 2. The remote control system of claim 1, when it is determined that the first information is received by the second communication unit and that the permission condition is satisfied, the determination unit transmits, to the mobile object, a permission notification indicating that switching of the operation state to the enabled state is permitted; A remote control system, wherein the command receiving unit restricts switching of the operating state to the enabled state if the permission notification is not received within a predetermined period after the first information is transmitted from the first communication unit.
3. 2. The remote control system of claim 1, A remote control system in which, when the determination unit determines that the second information is received by the second communication unit and the permission condition is not satisfied, the determination unit sends a disable command to the mobile body to switch the operating state to the disabled state.
4. 4. The remote control system according to claim 3, A remote control system in which, if the determination unit determines that the operating state has not been switched to the disabled state after sending the disable command to the mobile body, the determination unit sends a stop command to the mobile body to restrict the movement of the mobile body.
5. 4. The remote control system according to claim 3, Further comprising a notification unit that notifies the occurrence of an abnormality, A remote control system, wherein if the determination unit determines that the operating state has not been switched to the disabled state after sending the disable command to the mobile body, the determination unit notifies the notification unit that an abnormality has occurred.
6. 2. The remote control system of claim 1, A remote control system, wherein the permission conditions include the moving object being stopped.
7. 2. The remote control system of claim 1, A remote control system, wherein the permission conditions include switching of the operating state to the valid state by a predetermined device.
8. 2. The remote control system of claim 1, A remote control system, wherein the permission conditions include switching of the operating state to the valid state in a predetermined location.
9. 2. The remote control system of claim 1, A remote control system, wherein the permission conditions include switching of the operating state to the valid state by a predetermined person.
10. A remotely controllable mobile object, a command receiving unit whose operation state is switched between an effective state in which a remote control command supplied from an external source is received and an ineffective state in which the remote control command is not received; a communication unit for transmitting at least one of first information indicating that the operation state may be switched to the enabled state and second information indicating that the operation state has been switched to the enabled state; A mobile body comprising:
11. A control device, a communication unit for receiving, from a remotely controllable mobile body having a command receiving unit that switches an operating state between an effective state in which a remote control command supplied from an outside is received and an ineffective state in which the remote control command is not received, at least one of first information indicating that the operating state may be switched to the effective state and second information indicating that the operating state has been switched to the effective state; a determination unit that permits switching of the operation state to the enabled state when the communication unit receives the at least one piece of information and determines that a predetermined permission condition is satisfied; and A control device comprising:
12. A remote control method, comprising: receiving at least one of first information indicating that the operational state may be switched to the effective state and second information indicating that the operational state has been switched to the effective state from a remotely controllable mobile body having a command receiving unit that can switch an operational state between an effective state in which a remote control command supplied from an outside is received and an invalid state in which the remote control command is not received; receiving at least one of the pieces of information and, when it is determined that a predetermined permission condition is satisfied, permitting switching of the operation state to the valid state; Remote control method.
Citation Information
Patent Citations
Method for operating a vehicle and method for operating a manufacturing system
JP2017538619A
Cited By
Oil-resistant paper and method for manufacturing the same
JP7946864B1
