Remote autonomous driving system and method for controlling a mobile object

The control device for remotely controlled moving bodies addresses the challenge of varying responsiveness by switching to alert modes with reduced speed, increased light, or sound when detecting individuals with low responsiveness, improving safety in diverse environments.

JP7835185B2Active Publication Date: 2026-03-25TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-03-17
Publication Date
2026-03-25

AI Technical Summary

Technical Problem

Existing remote control systems for moving bodies do not adequately account for the presence of individuals with varying levels of responsiveness, such as unskilled workers and visitors, who may approach the moving area, necessitating a more appropriate control technology.

Method used

A control device for a remotely controlled automatic driving system that includes a location detection unit, a mobile body identification unit, and a signal transmission unit to switch moving objects to an alert mode by reducing speed, increasing light intensity, or sound volume when a target person is detected.

Benefits of technology

Enables more appropriate control of moving objects by alerting them to individuals with low responsiveness, reducing the risk of accidents and enhancing safety in environments with diverse personnel.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007835185000001
    Figure 0007835185000001
  • Figure 0007835185000002
    Figure 0007835185000002
  • Figure 0007835185000003
    Figure 0007835185000003
Patent Text Reader

Abstract

To provide a more appropriate control technology of a moving body which assumes that various people may approach an area where the moving body moves through remote control.SOLUTION: A controller employed in a remote automatic driving system that moves a moving body through remote control includes: a whereabouts detection unit that, when an object person is detected by a first detection unit included in the remote automatic driving system, detects the whereabouts of the object person on the basis of a result of detection of the object person by the first detection unit; a moving body identification unit that identifies a moving body which can approach the object person among remotely controlled moving bodies on the basis of the detected whereabouts; and a signal transmission unit that transmits to the identified moving body a control signal which changes driving modes of the moving body into an alert mode for taking precautions on the object person.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a control device, a remote automatic driving system, and a method for controlling a moving body.

Background Art

[0002] Patent Document 1 discloses a technique for automatically driving a vehicle by remote control in a vehicle manufacturing process.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the area where a moving body moves by remote control, various people may approach. For example, in a factory where a moving body moves, not only skilled workers with a relatively high level of response to the moving body but also people with a relatively low level of response, such as unskilled workers and visitors, usually enter and exit. Therefore, a more appropriate control technology for the moving body that assumes the approach of various people to the moving area of the moving body has been desired.

Means for Solving the Problems

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to a first embodiment of the present disclosure, a control device is provided for use in a remotely controlled automatic driving system that moves a mobile body by remote control. The control device includes: a location detection unit that detects the location of a target person based on the detection result of the first detection unit provided in the remotely controlled automatic driving system when the target person is detected by the first detection unit; a mobile body identification unit that identifies a mobile body among the remotely controlled mobile bodies that can approach the target person based on the detected location; and a signal transmission unit that transmits a control signal to the identified mobile body to change the driving mode of the mobile body to a warning mode for keeping watch for the target person. In this configuration, if a target person is detected in the remote autonomous driving system, the moving object that could approach that person can be switched to alert mode. Therefore, in areas where various people may approach, the moving object can be moved more appropriately by remote control. (2) In the control device of the above form, the moving object identification unit may identify a moving object that can approach the target person by performing at least one of the following: identifying a moving object that is moving inside the building where the target person is located; identifying a moving object that is approaching the target person; or identifying a moving object whose distance from the target person is less than or equal to a predetermined distance. With this form, a moving object that can approach the target person can be appropriately identified. (3) In the control device of the above form, the signal transmitting unit may transmit a signal to reduce the speed of the moving body as the control signal. With this form, in the alert mode, the moving body can be alerted to the target person by reducing the speed of the moving body. (4) In the control device of the above form, the signal transmitting unit may transmit, as the control signal, at least one of the following: a signal to increase the light intensity emitted from the mobile body and a signal to increase the volume of sound emitted from the mobile body. With this form, in the alert mode, the mobile body can be alerted to a target person by increasing the light intensity or volume of sound emitted from the mobile body. (5) According to a second embodiment of the present disclosure, a remotely automated driving system is provided. This remotely automated driving system comprises a control device as described above, the moving body, the first detection unit, and a remote control unit that moves the moving body by performing the remote control. (6) In the above-described form of remote automatic driving system, a remote control sensor is provided for use in the remote control and for detecting the position of the moving object, and the first detection unit may detect the target person using the remote control sensor. In this form, the remote control sensor can also be used for detecting the target person. (7) In the above-described form of remote automatic driving system, the remote control sensor may consist of a camera that takes images for detecting the position of the moving object. In this form, the camera used for remotely controlling the moving object can also be used for detecting the target person. (8) In the above-described form of remote automatic driving system, the first detection unit may detect the target person using the image captured by the camera and a learning model that has been trained to determine whether or not the input image contains a person that satisfies predetermined detection conditions. With this form, the target person can be detected more appropriately using the captured image and the learning model. (9) In the above-described form of remote automatic driving system, the location detection unit may detect the location based on the detection result of the target person and the location information of the remote control sensor. With this form, the location of the target person can be easily detected using the location information of the remote control sensor. (10) In the above-described form of remote automatic driving system, the mobile body is a vehicle, and the remote control unit, by performing the remote control, causes the mobile body to travel between a first location and a second location within a factory for manufacturing the mobile body, where a first process relating to the manufacturing of the mobile body is performed at the first location, and a second process, which is a process later than the first process, is performed at the second location. With this form, the mobile body can be efficiently moved by remote control between locations where each process relating to the manufacturing of the mobile body is performed. Furthermore, even if various people enter and exit the factory where the mobile body is manufactured, the mobile body can be moved more appropriately by remote control within the factory. (11) In the above-described form of remote automatic driving system, the mobile body has a second detection unit that detects the conditions around the mobile body, and the signal transmission unit may transmit a signal as the control signal to increase the sensitivity of detection by the second detection unit. With this form, in the alert mode, the mobile body can be alerted to a target person by increasing the sensitivity of detection by the second detection unit provided on the mobile body. (12) In the above-described form of the remote automatic driving system, the moving body has a state change unit that performs a change process to change the driving state of the moving body when a target person is detected by the second detection unit, and the change process may include at least one of the following: a process to reduce the speed of the moving body, a process to increase the amount of light emitted from the moving body, and a process to increase the volume of sound emitted from the moving body. With this form, the vehicle can detect the target person on its own with the second detection unit, and when the vehicle detects the target person, the vehicle can perform the change process on its own. (13) In the above-described form of remote automatic driving system, if the state change unit has executed the change process and the second detection unit no longer detects a person, the state change unit may execute a process to cancel the state in which the driving state was changed by the change process. With this form, if the second detection unit no longer detects a person to be detected after the change process has been executed, the moving body can cancel the state in which its driving state was changed by itself.

[0007] This disclosure can be implemented in various forms other than the control devices and remote automatic driving systems described above, such as mobile devices and methods for controlling mobile devices. [Brief explanation of the drawing]

[0008] [Figure 1] An explanatory diagram showing the schematic configuration of the remote automatic driving system in the first embodiment. [Figure 2] A diagram illustrating the automatic driving control of a vehicle in the first embodiment. [Figure 3] A flowchart of the detection process. [Figure 4] Flowchart of the warning instruction processing in the first embodiment. [Figure 5] A schematic diagram illustrating the warning instruction processing in the first embodiment. [Figure 6] Flowchart of the warning process in the first embodiment. [Figure 7] A schematic diagram illustrating the warning instruction processing in the second embodiment. [Figure 8] A diagram illustrating the automated driving control of a vehicle in the third embodiment. [Figure 9] A schematic diagram illustrating the warning instruction processing in the third embodiment. [Figure 10] A schematic diagram illustrating the warning instruction processing in the fourth embodiment. [Figure 11] A schematic diagram illustrating the warning instruction processing in the fifth embodiment. [Figure 12] An explanatory diagram showing the schematic configuration of the remote automatic driving system in the sixth embodiment. [Figure 13] Flowchart of the warning process in the sixth embodiment. [Figure 14] A schematic diagram illustrating the warning process in the sixth embodiment. [Modes for carrying out the invention]

[0009] A. First Embodiment: FIG. 1 is an explanatory diagram showing a schematic configuration of a remote automatic driving system 10 in the first embodiment. In the present embodiment, as will be described later, the remote automatic driving system 10 is used to move a moving body by remote control in a factory that manufactures the moving body. The moving body in the present embodiment is a vehicle 100, and more specifically, a battery electric vehicle (BEV). The moving body is not limited to an electric vehicle, and may be, for example, other vehicles such as a gasoline vehicle, a hybrid vehicle, or a fuel cell vehicle. In this specification, the state of being completed as a product and the state of semi-finished products and work-in-progress during manufacturing are collectively referred to as "vehicle". Further, the moving body is not limited to a vehicle, and may be, for example, a mobile robot or an electric vertical take-off and landing aircraft (so-called flying car).

[0010] The remote automatic driving system 10 in the present embodiment includes the vehicle 100 as the moving body described above, a control device 200, and a vehicle detection unit 300.

[0011] The vehicle 100 includes a driving device 110 for accelerating the vehicle 100, a steering device 120 for changing the traveling direction of the vehicle 100, a braking device 130 for decelerating the vehicle 100, a communication device 140 for communicating with the control device 200 by wireless communication, and a vehicle control device 150 for controlling each part of the vehicle 100. In the present embodiment, the driving device 110 includes a battery, a motor driven by the power of the battery, and drive wheels rotated by the motor. The vehicle control device 150 includes one or more ECUs (Electronic Control Unit). The objects of control by the vehicle control device 150 include, in addition to the above driving device 110, steering device 120, braking device 130, and communication device 140, various equipment such as lights, horns, and sensors provided in the vehicle 100.

[0012] The vehicle detection unit 300 has a plurality of cameras 302 used for remote control of the vehicle 100. Each camera 302 has an imaging unit 308 equipped with an image sensor and optical system for capturing images Pi, and a camera control unit 303 that controls the imaging unit 308. The camera control unit 303 is composed of a computer comprising a processor 304, a storage unit 305, and an input / output interface (not shown). The storage unit 305 stores a detection program 260 and a learning model 270. A communication device 306 for communicating with the control device 200 is connected to the input / output interface of the camera control unit 303. The communication device 306 transmits the captured images Pi to the control device 200 by communicating with the communication device 205.

[0013] Camera 302 functions as a remote control sensor. A remote control sensor is used for the remote control of vehicle 100 and is used to detect the position of a moving object. More specifically, camera 302 captures an image, known as image Pi, for detecting the position of vehicle 100. As will be described later, the captured image Pi is analyzed by the control device 200 to detect the position and orientation of vehicle 100. In addition, for the remote control of vehicle 100, various on-board cameras mounted on vehicle 100, as well as various sensors such as LiDAR (Light Detection And Ranging), millimeter-wave radar, ultrasonic sensors, and infrared sensors may be used as auxiliary sensors. In this case, for example, these on-board cameras and sensors can be used to adjust the distance between vehicles. Furthermore, in other embodiments, the remote control sensor may consist of detectors such as LiDAR, millimeter-wave radar, ultrasonic sensors, and infrared sensors in addition to, or instead of, camera 302, as long as they can be used to detect the position and orientation of vehicle 100.

[0014] In this embodiment, the camera control unit 303 functions as a first detection unit 250 when the processor 304 executes the detection program 260. The first detection unit 250 detects a target person. In this embodiment, the first detection unit 250 detects a person who satisfies predetermined detection conditions as a target person. The detection conditions are defined, for example, as conditions that enable the detection of a person who has a relatively low level of reaction to a vehicle 100 that is remotely controlled and moving around inside the factory. Hereinafter, a person who is the target of detection by the first detection unit 250 will also be referred to as a target person.

[0015] In this embodiment, the camera control unit 303 detects a target person based on the captured image Pi. More specifically, the camera control unit 303 inputs the captured image Pi to the learning model 270 to determine whether or not the captured image Pi contains a target person. The learning model 270 is, for example, a model that has been trained on whether or not an input image to the learning model 270 contains a person that satisfies the detection conditions. The learning model 270 can be, for example, various neural networks, support vector machines, random forests, etc., and is generated using any machine learning algorithm such as supervised learning, unsupervised learning, or reinforcement learning. In other embodiments, the first detection unit 250 may detect a target person using, for example, a rule-based model instead of the learning model 270.

[0016] Detection conditions can be defined, for example, as conditions that enable the detection of unskilled workers, visitors, or people who are unwell. In this case, the detection conditions may be defined as conditions that enable the direct detection of unskilled workers, etc., or as conditions related to clothing, face, physique, presence or absence of identification marks (e.g., badges), behavioral patterns, etc., that enable the indirect detection of unskilled workers, etc. For example, the detection conditions for unskilled workers may be defined as being unskilled, not being skilled, not wearing clothing or badges designated to be worn only by skilled workers, and having a low degree of matching with the facial features of a pre-registered skilled worker. Also, for example, the detection conditions for detecting visitors visiting a factory FC (Farm Center) may be defined as being a visitor, being a child, wearing visitor clothing or badges, and having a high degree of matching with the facial features of a pre-registered visitor. Whether or not someone is a child may be determined, for example, based on their height. Furthermore, for example, the detection conditions for detecting a person who is unwell may be defined as: the person is unwell; the person's movements include abnormal movement patterns; and the parameters representing the person's unsteadiness are not within a predetermined normal range.

[0017] The control device 200 is comprised of a computer comprising a processor 201, a storage unit 202, an input / output interface 203, and an internal bus 204. The processor 201, the storage unit 202, and the input / output interface 203 are connected via the internal bus 204 to enable bidirectional communication. A communication device 205 for communicating with the vehicle 100 and the vehicle detection unit 300 via wireless communication is connected to the input / output interface 203. The storage unit 202 stores a remote automatic driving program PG1 and a database DB. The control device 200 realizes various functions, including those of a remote control unit 210, a location detection unit 220, a mobile object identification unit 230, and a signal transmission unit 240, by having the processor 201 execute the remote automatic driving program PG1. The database DB is a database that stores identification information of a remote control sensor and its installation location information in association with each remote control sensor. In other words, the database DB in this embodiment is a database that stores the identification information of each camera 302 and its installation location information in association with each camera 302.

[0018] As will be described later, the remote control unit 210 makes the vehicle 100 move by remotely controlling the vehicle 100.

[0019] If the first detection unit 250 detects the target person, the location detection unit 220 detects the target person's location based on the detection result.

[0020] The mobile object identification unit 230 identifies mobile objects that are remotely controlled and capable of approaching the detected target person, based on the location detected by the location detection unit 220. The term "approaching" here includes not only the mobile object moving towards the target person, but also the target person moving towards the mobile object. Hereafter, the vehicle 100 identified by the mobile object identification unit 230 as a mobile object capable of approaching the target person will also be referred to as the target vehicle.

[0021] The signal transmission unit 240 transmits a control signal to the mobile object identified by the mobile object identification unit 230 to change the operating mode of that mobile object to the alert mode. The alert mode refers to an operating mode for keeping an eye on a target person. More specifically, a mobile object in alert mode is alert for approach between that mobile object and the target person. The target vehicle mentioned above can also be said to be the vehicle 100 to which the control signal is transmitted. The target person can also be said to be the person who is the target of the alert by the target vehicle. Hereafter, the operating mode of vehicle 100 before it is changed to alert mode will also be referred to as the normal mode.

[0022] Figure 2 illustrates the automated driving control of vehicle 100 via remote control. Figure 2 shows how vehicle 100 is automated driving controlled in a factory FC where vehicle 100 is produced. The factory FC includes a first location PL1 where the first process related to the manufacturing of vehicle 100 is carried out, and a second location PL2 where the second process related to the manufacturing of vehicle 100 is carried out. The second process is a process that follows the first process. For example, the first process is an assembly process in which vehicle 100 is assembled, and the second process is an inspection process in which vehicle 100 is inspected. The first location PL1 and the second location PL2 may be located in the same building, or in different buildings on the same site. Also, the first location PL1 and the second location PL2 may be located outdoors instead of indoors. Furthermore, the first location PL1 and the second location PL2 may be dispersed across multiple sites, for example, they may be dispersed between a first factory and a second factory adjacent to each other, separated by a public or private road. In this case, the first and second factories are collectively referred to as the factory FC, and the track RT may include a portion of a public road or a portion of a private road.

[0023] In other embodiments, the first and second steps do not have to be assembly or inspection steps, and may be various processes related to the manufacture of the vehicle 100, as long as the vehicle 100 can be driven by remote control after the completion of the first step. In this embodiment, the first step is performed on the vehicle 100, which makes the vehicle 100 capable of being driven by remote control. More specifically, the state in which the vehicle 100 is capable of being driven by remote control means that the vehicle 100 can perform the three functions of driving, turning, and stopping by remote control, and in this embodiment, this corresponds to the state in which the vehicle 100 is equipped with a drive unit 110, a steering unit 120, a braking unit 130, a communication unit 140, and a vehicle control unit 150.

[0024] Vehicle 100 travels between the first location PL1 and the second location PL2 by traveling along the track RT via remote control. In the example in Figure 2, the track RT is a track connecting the first location PL1 and the second location PL2, and includes the first track RT1, the second track RT2, and the third track RT3, which are continuous with each other. In the example in Figure 2, the control device 200, which functions as a remote control unit 210, causes vehicle 100 to travel along the track RT from the first location PL1 to the loading position PG for the second process. The loading position PG is located on the track RT before the second location PL2. In other embodiments, the track RT does not have to be a series of tracks as shown in Figure 2, but may be, for example, a track that branches into multiple tracks along the way and then rejoins.

[0025] The aforementioned camera 302 acquires images of the track RT from above. The number and placement of the cameras 302 are set, for example, taking into account the field of view of the cameras 302, so that the entire track RT can be imaged. In the example in Figure 2, the cameras 302 include camera 302a, which can image the area RG1 including the entire first track RT1; camera 302b, which can image the area RG2 including the entire second track RT2; and camera 302c, which can image the area RG3 including the entire third track RT3. Note that the cameras 302 may acquire images not only from above the vehicle 100, but also from the front, rear, and sides of the vehicle 100. Furthermore, cameras that acquire these images may be combined as appropriate.

[0026] The track RT has a pre-set target route that the vehicle 100 should travel. The control device 200, which functions as a remote control unit 210, analyzes the images of the track RT and the vehicle 100 contained in the captured image Pi at predetermined time intervals. By analyzing the captured image Pi in this way, the control device 200 acquires the relative position and orientation of the vehicle 100 with respect to the target route in real time. The control device 200 generates a control command to drive the vehicle 100 along the target route according to the acquired position and orientation of the vehicle 100, and transmits the control command to the vehicle 100. The vehicle control device 150 installed in the vehicle 100 drives the vehicle 100 by controlling the drive unit 110, steering unit 120, and braking unit 130 according to the control command received from the control device 200. In this embodiment, the control device 200 can remotely control multiple vehicles 100 simultaneously and in parallel. When remotely controlling multiple vehicles 100 simultaneously and in parallel, the control device 200 transmits control commands to each vehicle 100 according to the target route, current position, and orientation of each vehicle 100. For remote control, an image of the entire vehicle 100 may be used, or an image of a part of the vehicle 100 (for example, an image of alignment marks provided on the vehicle 100) may be used.

[0027] As shown in Figure 2, at position P1, the fields of view of the cameras 302 corresponding to each connected track overlap at the connection point of each track. In the example of position P1, the field of view of camera 302a corresponding to the first track RT1 and the field of view of camera 302b corresponding to the second track RT2 overlap. The control device 200 remotely controls the vehicle 100 by switching the cameras 302 used for remote control depending on the position of the vehicle 100 as it travels along the track RT. More specifically, when the vehicle 100 travels along the first track RT1 from the first location PL1 to position P1, remote control is performed using the image Pi captured by camera 302a. When the vehicle 100 reaches position P1, the remote control switches to using the image Pi captured by camera 302b, and the vehicle 100 travels along the second track RT2 using remote control with the image Pi captured by camera 302b. Similarly, images Pi captured by camera 302c are used for driving on the third track, RT3.

[0028] Figure 3 is a flowchart of the detection process in this embodiment. In this embodiment, the detection process is performed at predetermined time intervals by the camera control unit 303 of each camera 302. The method for controlling the moving object in this embodiment is realized by this detection process and the warning instruction process and warning process described later.

[0029] In step S110, the camera control unit 303, which functions as the first detection unit 250, detects whether or not the target person is included in the image Pi captured by the camera 302 which it owns. If the target person is included in the image Pi in step S110, in step S120, the camera control unit 303 transmits the detection result indicating that the target person is included in the image Pi, along with the identification information of the camera 302 which it owns, to the control device 200.

[0030] Figure 4 is a flowchart of the warning instruction processing in this embodiment. Figure 5 is a schematic diagram illustrating the warning instruction processing in this embodiment. In this embodiment, the warning instruction processing shown in Figure 4 is executed by the control device 200 at predetermined time intervals. Figure 5 shows an example of the warning instruction processing when a child Ps1 is detected as the target person. Figure 5 schematically shows the surroundings of the first track RT1. In Figure 5, child Ps1 is standing next to the first track RT1 within the range RG1. In Figure 5, vehicles 100a to 100d are shown as vehicles 100. Vehicles 100a, 100b, 100c, and 100d are arranged in this order from rear to front in the direction of travel d1 of vehicle 100 on the first track RT1.

[0031] In step S210, the control device 200 determines whether or not it has received a detection result from the camera control unit 303 of any of the cameras 302. If the control device 200 determines that it has received a detection result, in step S220, it obtains the location information of the camera 302 that detected the target person based on the identification information received along with the detection result. More specifically, in step S220, the control device 200 obtains the location information of the camera 302 that detected the target person by referring to the database DB in the storage unit 202 based on the identification information. In the example in Figure 5, the control device 200 obtains the location information of camera 302a.

[0032] In step S230, the control device 200, which functions as a location detection unit 220, detects the location of the target person based on the detection result and the location information of the camera 302 acquired in step S220. More specifically, in step S230 in this embodiment, the control device 200 analyzes the captured image Pi and detects the location coordinates of the target person based on the analysis result of the captured image Pi and the location information of the camera 302. In the example in Figure 5, the control device 200 detects the location coordinates of child Ps1 based on the analysis result of the captured image Pi by camera 302a and the location information of camera 302a.

[0033] In step S240, the control device 200, which functions as a mobile object identification unit 230, identifies vehicles 100 (target vehicles) that can approach the target person based on the location of the target person identified in step S230. The process of identifying a mobile object, as in step S240, is also called the mobile object identification process. In this embodiment, in step S240, the control device 200 identifies target vehicles by identifying vehicles 100 whose distance from the target person is less than or equal to a predetermined reference distance. More specifically, all vehicles 100 that are remotely controlled and whose distance from the target person is less than or equal to the reference distance are identified as target vehicles. In the example in Figure 5, vehicles 100b and 100c that are moving within a range r1 where the distance from child Ps1 is less than or equal to the reference distance are identified as target vehicles. In Figure 5, vehicles 100 that are identified in this way are marked with upward-sloping hatching.

[0034] In step S250, the control device 200, which functions as a signal transmission unit 240, transmits a control signal AS to each target vehicle identified in step S240 to change the vehicle's driving mode to the alert mode. In this embodiment, the control device 200 transmits a signal to reduce the driving speed of the target vehicle as the control signal AS. The process of transmitting a control signal AS to a target vehicle, as in step S250, is also called the signal transmission process. In the example in Figure 5, the control device 200 transmits a control signal AS to vehicle 100b and vehicle 100c, which have been identified as target vehicles.

[0035] Figure 6 is a flowchart of the warning process in this embodiment. In this embodiment, the warning process is performed at predetermined time intervals by the vehicle control device 150 of each vehicle 100.

[0036] In step S310, the vehicle control device 150 determines whether or not it has received a control signal AS from the control device 200. If it determines that it has received a control signal AS, in step S320, the vehicle control device 150 changes the driving mode of the vehicle 100 from normal mode to alert mode by controlling various parts of the vehicle 100 based on the received control signal AS. More specifically, in step S310, the vehicle control device 150 reduces the driving speed of the vehicle 100 by controlling the drive unit 110. In other words, in this embodiment, when the driving mode of the vehicle 100 is alert mode, the driving speed of the vehicle 100 is slower compared to when the driving mode is normal mode. By reducing the driving speed of the vehicle 100 in this way, the approach of the vehicle 100 to the target person is further suppressed. In addition, by reducing the driving speed of the vehicle 100, the target person and other people around them can see the vehicle 100 for a longer period of time, and the recognition of the vehicle 100 is improved. Therefore, for example, it becomes easy for a person who has recognized vehicle 100 to move away from track RT in advance, or for another person who has recognized vehicle 100 to instruct the person to move away from track RT in advance.

[0037] According to the control device 200 of this embodiment described above, when a target person is detected by the first detection unit 250, the location detection unit 220 detects the location of the target person based on the detection result, the moving object identification unit 230 identifies a target vehicle that may approach the target person based on the detected location, and the signal transmission unit 240 transmits a control signal AS to the target vehicle to change its driving mode to alert mode. With this configuration, for example, by defining conditions for detecting a target person that allow for the detection of people with a relatively low level of response level to a remotely controlled vehicle 100, such as inexperienced persons, visitors, or people who are unwell, the driving mode of a vehicle 100 that may approach such a person can be changed to alert mode. Therefore, in areas where various people with different levels of response level to the vehicle 100 may approach, the vehicle 100 can be driven more appropriately by remote control.

[0038] Furthermore, in this embodiment, the mobile object identification unit 230 identifies the target vehicle by identifying a vehicle 100 whose distance from the target person is less than or equal to a reference distance. Therefore, the target vehicle can be identified more appropriately.

[0039] Furthermore, in this embodiment, the signal transmission unit 240 transmits a signal as a control signal AS to reduce the speed of the target vehicle. Therefore, in alert mode, by reducing the speed of the vehicle 100, the vehicle 100 can be alerted to the target person.

[0040] Furthermore, in the remote-controlled automatic driving system 10 of this embodiment, the first detection unit 250 detects the target person using a remote control sensor. In this configuration, the remote control sensor can also be used to detect the target person. Therefore, compared to, for example, a case where a sensor for detecting the target person is provided separately from the remote control sensor, the cost required to construct the remote-controlled automatic driving system 10 can be reduced.

[0041] Furthermore, in this embodiment, the remote control sensor is comprised of a camera 302 that captures an image to detect the position of the vehicle 100, and the first detection unit 250 detects the target person based on the image Pi captured by the camera 302. Therefore, the camera 302 used for remotely controlling the vehicle 100 can also be used for detecting the target person.

[0042] Furthermore, in this embodiment, the location detection unit 220 detects the target person using the captured image Pi and the learning model 270, thus enabling more accurate detection of the target person.

[0043] Furthermore, in this embodiment, the location detection unit 220 detects the location of the target person based on the detection result from the first detection unit 250 and the location information of the remote control sensor. Therefore, the location of the target person can be easily detected using the location information of the remote control sensor.

[0044] Furthermore, in this embodiment, the remote control unit 210 performs remote control to make the vehicle 100 travel between the first location PL1, where the first process related to the manufacturing of the vehicle 100 is performed, and the second location PL2, where the second process is performed, within the factory FC. Therefore, the vehicle 100 can be efficiently moved between the locations where each process related to the manufacturing of the vehicle 100 is performed by remote control. In addition, even when various people enter and exit the factory FC, the vehicle 100 can be driven more appropriately by remote control within the factory FC.

[0045] B. Second Embodiment: Figure 7 is a schematic diagram illustrating the warning instruction processing in the second embodiment. Similar to Figure 5, Figure 7 schematically shows the surroundings of the first track RT1. In this embodiment, unlike the first embodiment, the control device 200, which functions as a mobile object identification unit 230, identifies the target vehicle by identifying the vehicle 100 that is approaching the target person. The configuration of the control device 200 and the remote automatic driving system 10 in the second embodiment is the same as in the first embodiment unless otherwise described.

[0046] In this embodiment, in step S240 of Figure 4, the control device 200 identifies a vehicle 100 that is approaching the target person as a target vehicle. In the example of Figure 7, vehicles 100a and 100b that are approaching the target person, child Ps1, are identified as target vehicles. "Vehicle 100 is approaching the target person" means that the vehicle 100 is moving in a direction that reduces the distance between it and the target person. Therefore, in the example of Figure 7, vehicles 100c and 100d that are moving away from child Ps1 are not identified. The control device 200 identifies vehicles 100 that are approaching the target person in this way based, for example, on the location of the target person and the position and direction of movement of the vehicle 100. The direction of movement of the vehicle 100 is detected, for example, based on the change in the position of the vehicle 100 over time and the orientation of the vehicle 100.

[0047] According to the second embodiment described above, the mobile object identification unit 230 identifies the target vehicle by identifying the vehicle 100 that is approaching the target person. Therefore, the target vehicle can be identified more appropriately.

[0048] C. Third Embodiment: Figure 8 illustrates the automatic driving control of vehicle 100 in the third embodiment. Similar to Figure 2, Figure 8 shows how vehicle 100 is automatically driven in factory FCb. In this embodiment, unlike the first and second embodiments, the control device 200, which functions as a moving object identification unit 230, identifies the target vehicle by identifying the vehicle 100 moving within the building where the target person is located. The configuration of the control device 200 and the remote automatic driving system 10 in the third embodiment is the same as in the first embodiment unless otherwise described.

[0049] In Figure 8, unlike in Figure 2, the factory TCb has the first location PL1 and a portion of the first track RT1 located within building BL1. In Figure 8, building BL1 is hatched.

[0050] Figure 9 is a schematic diagram illustrating the warning instruction processing in the third embodiment. Similar to Figure 5, Figure 9 schematically shows the surroundings of the first track RT1. Figure 9 schematically shows the wall WL1 and ceiling RF1 that separate the inside and outside of the building BL1. Also, Figure 9 schematically shows the area ir within the building BL1 of the track RT. In the example of Figure 9, vehicle 100 can move from the inside to the outside of the building BL1 while traveling along the first track RT1 via a gate Gt provided in the wall WL1. In the example of Figure 9, the target vehicles are identified as vehicles 100a to 100c, which are moving inside the building BL1 where the target person, child Ps1, is located.

[0051] According to the third embodiment described above, the mobile object identification unit 230 identifies the target vehicle by identifying the vehicle 100 that is moving inside the building where the target person is located. Therefore, the target vehicle can be appropriately identified.

[0052] In other embodiments, the mobile object identification unit 230 may identify the mobile object to which the control signal AS is transmitted by performing any two or all of the following actions, as described in the first to third embodiments: identifying a mobile object whose distance from the target person is less than or equal to a reference distance, identifying a mobile object approaching the target person, and identifying a mobile object moving within the building where the target person is located. For example, when identifying a mobile object whose distance from the target person is less than or equal to a reference distance and identifying a mobile object approaching the target person, each mobile object may be identified as a target mobile object, or a mobile object whose distance from the target person is less than or equal to a reference distance and is approaching the target person may be identified as a target mobile object.

[0053] D. Fourth Embodiment: Figure 10 is a schematic diagram illustrating the warning instruction processing in the fourth embodiment. Similar to Figure 5, Figure 10 schematically shows the surroundings of the first track RT1. In this embodiment, the control device 200, which functions as a signal transmission unit 240, transmits a signal to increase the light intensity emitted from the vehicle 100 as a control signal AS, unlike in the first embodiment. In other words, in this embodiment, when the driving mode of the vehicle 100 is the warning mode, the light intensity emitted from the vehicle 100 is greater than when the driving mode is the normal mode. The configuration of the control device 200 and the remote automatic driving system 10 in the fourth embodiment is the same as in the first embodiment unless specifically described.

[0054] In the example shown in Figure 10, the control device 200 transmits a control signal AS to the identified vehicles 100b and 100c, which is a signal to turn on the headlights HL installed on vehicle 100. In this embodiment, the headlights HL on each vehicle 100 are normally turned off. Upon receiving the control signal AS, the vehicle control device 150 of each vehicle 100 turns on the headlights HL. In other embodiments, the signal to increase the light intensity may be, for example, a signal to further increase the light intensity of already illuminated headlights HL, or a signal to increase the light intensity of various lights such as fog lights, taillights, and other decorative lights in addition to, or in place of, the headlights HL.

[0055] According to the fourth embodiment described above, the signal transmission unit 240 transmits a signal AS to increase the light intensity emitted from the vehicle 100. By increasing the light intensity emitted from the vehicle 100 by the control signal AS, the vehicle 100 becomes more visible to the target person and other people around them, improving the recognizability of the vehicle 100. Therefore, for example, it becomes easier for the target person who has recognized the vehicle 100 to move away from the track RT in advance, or for other people who have recognized the vehicle 100 to instruct the target person to move away from the track RT in advance. In this way, in alert mode, the vehicle 100 can be alerted to the target person by increasing the light intensity emitted from the vehicle 100.

[0056] E. Fifth Embodiment: Figure 11 is a schematic diagram illustrating the warning instruction processing in the fifth embodiment. Similar to Figure 5, Figure 11 schematically shows the surroundings of the first track RT1. In this embodiment, the control device 200, which functions as a signal transmission unit 240, transmits a signal to increase the volume of sound emitted from the vehicle 100 as a control signal AS, unlike in the first embodiment. In other words, in this embodiment, when the driving mode of the vehicle 100 is the warning mode, the volume of sound emitted from the vehicle 100 is louder compared to when the driving mode is the normal mode. The "signal to increase volume" refers to a signal to increase the volume of a sound different from the sound produced by the operation of the drive unit 110 accompanying the acceleration of the vehicle 100. The configuration of the control device 200 and the remote automatic driving system 10 in the fifth embodiment is the same as in the first embodiment unless specifically described.

[0057] In the example shown in Figure 11, the control device 200 transmits a control signal AS to the identified vehicles 100b and 100c, which is a signal to sound the horn CH installed in the vehicle 100 continuously or intermittently for a predetermined period of time. In this embodiment, the horn CH of each vehicle 100 is normally not sounded. Upon receiving the control signal AS, the vehicle control device 150 of each vehicle 100 sounds the horn CH as described above. In other embodiments, the signal to increase the volume may be, for example, a signal to further increase the volume of a horn CH that is already sounding, or a signal to increase the volume of a warning sound or background music from a speaker installed inside or outside the vehicle 100, in addition to or instead of the horn CH.

[0058] According to the fifth embodiment described above, the signal transmission unit 240 transmits a signal AS to increase the volume of sound emitted from the vehicle 100. By increasing the volume of sound emitted from the vehicle 100 due to the control signal AS, the target person and other people around them can more easily recognize the vehicle 100 by hearing, thereby improving the recognizability of the vehicle 100. For example, it becomes easier for the target person who has recognized the vehicle 100 to move away from the track RT in advance, or for other people who have recognized the vehicle 100 to instruct the target person to move away from the track RT in advance. In this way, in alert mode, the vehicle 100 can be made to alert the target person by increasing the volume of sound emitted from the vehicle 100.

[0059] In other embodiments, the signal transmission unit 240 may transmit any two or all of the signals described in the first to third embodiments as control signals AS: a signal to reduce the speed of movement, a signal to increase the light intensity, and a signal to increase the volume. For example, if a signal to increase the light intensity and a signal to increase the volume are transmitted as control signals AS, the visual and auditory recognizability of the target vehicle will be improved. In this case, for example, even if the target person has relatively low vision or hearing, the target person will be able to recognize the target vehicle more easily. When two or all of the above signals are transmitted as control signals AS, for example, one signal may serve multiple purposes. For example, the signal transmission unit 240 may transmit a single signal as a control signal AS that serves as both a signal to increase the light intensity and a signal to increase the volume. In this case, the vehicle control device 150 of the vehicle 100 should be configured to perform the processes of increasing the light intensity and increasing the volume when it receives that signal.

[0060] F. Sixth Embodiment: Figure 12 is an explanatory diagram showing the schematic configuration of the remote automatic driving system 10b in the sixth embodiment. Unlike the first embodiment, the vehicle 100 in this embodiment has a second detection unit 170. Furthermore, the control device 200, which functions as a signal transmission unit 240, transmits a signal AS as a control signal to increase the sensitivity of detection by the second detection unit 170, as will be described later. In other words, in this embodiment, when the driving mode of the vehicle 100 is in alert mode, the sensitivity of the second detection unit 170 provided in the vehicle 100 is higher compared to when the driving mode is in normal mode. The configuration of the control device 200 and the remote automatic driving system 10b in the sixth embodiment is the same as in the first embodiment unless specifically described.

[0061] The second detection unit 170 controls the surrounding sensor 160 and uses the surrounding sensor 160 to detect the conditions around the vehicle 100. The surrounding sensor 160 is configured as, for example, various in-vehicle cameras such as a front camera, side camera, and rear camera, various sensors such as LiDAR, millimeter-wave radar, ultrasonic sensor, and infrared sensor, or a sensor system that combines these as appropriate. In this embodiment, the processor provided in the vehicle control device 150 executes a program stored in the storage unit of the vehicle control device 150, thereby enabling the vehicle control device 150 to function as the second detection unit 170.

[0062] In this embodiment, in step S250 of Figure 4, the control device 200 transmits a signal AS as a control signal to increase the sensitivity of detection by the second detection unit 170. This signal is, for example, a signal to turn on the ambient sensor 160 which is turned off, a signal to increase the resolution of the ambient sensor 160, a signal to shorten the time interval at which the second detection unit 170 acquires the sensor value of the ambient sensor 160, or a signal to amplify the sensor value of the ambient sensor 160 acquired by the second detection unit 170. Also, for example, if the ambient sensor 160 is configured as a camera, this signal may be a signal to increase the resolution of the image captured by the camera.

[0063] The state change unit 180 shown in Figure 12 executes a change process when the target person is detected by the second detection unit 170. The change process refers to the process of changing the driving state of the moving object detected by the detection process. More specifically, "changing the driving state" means changing the driving state of the vehicle 100b to a driving state different from the driving state when the target person is not detected by the second detection unit 170. The change process preferably includes at least one of the following: a process to reduce the speed of the moving object, a process to increase the amount of light emitted from the moving object, and a process to increase the volume of sound emitted from the movement. In other words, the change process preferably includes a process to improve the identifiability of the moving object, and in this embodiment, it includes a process to reduce the speed of the moving object. The state change unit 180 in this embodiment, like the second detection unit 170, is a functional unit realized by a processor provided in the vehicle control device 150 executing a program. Hereinafter, the state in which the driving state of the vehicle 100 has been changed by the change process will also be referred to as the changed state.

[0064] In this embodiment, the state change unit 180 performs a release process in addition to the change process. The release process is performed after the change process has been executed when the target person is no longer detected by the second detection unit 170, and it is a process that releases the changed state.

[0065] Figure 13 is a flowchart of the warning process in this embodiment. Figure 14 is a schematic diagram illustrating the warning process in this embodiment. Figure 14 schematically shows the surroundings of the first track RT1, similar to Figure 5. However, unlike Figure 5, Figure 14 shows a single vehicle 100 (specifically, vehicle 100a) traveling along the first track RT1 in the direction of travel d1. For example, position Rp2 is ahead of position Rp1, and the time when vehicle 100 is traveling at position Rp2 is later than the time when vehicle 100 is traveling at position Rp1. Of positions Rp1 to Rp5 of the first track RT1 shown in Figure 14, positions Rp2 to Rp4 are within range r1.

[0066] In step S410 of Figure 13, the vehicle control device 150 determines whether or not it has received a control signal AS, similar to step S310 of Figure 6. For example, in the example of Figure 14, when vehicle 100a is traveling at position Rp1, vehicle 100a has not been identified by the control device 200, so no control signal AS has been transmitted to vehicle 100a. Subsequently, when vehicle 100a continues traveling and approaches range r1, vehicle 100a is identified by the control device 200 and receives a control signal AS at position Rp2, for example.

[0067] If the vehicle control device 150 determines that it has received a control signal AS, in step S420, it increases the detection sensitivity of the second detection unit 170 based on the received control signal AS. In step S420 of this embodiment, the vehicle control device 150 turns on the surrounding sensor 160, which is normally turned off. Figure 14 schematically shows the detection range DR in which the target person can be detected by the second detection unit 170 with increased sensitivity. In step S430, the vehicle control device 150 starts a timer (not shown) and begins measuring time using the timer.

[0068] In step S440, the vehicle control device 150 determines whether or not the target person has been detected by the second detection unit 170. The method for detecting the target person by the second detection unit 170 may be the same as the method for detecting the target person by the first detection unit 250. For example, if the surrounding sensor 160 is a camera, it may be the same as the method for detecting the target person based on the captured image Pi. In this case, for example, a learning model similar to the learning model 270 may be pre-stored in the memory unit of the vehicle control device 150, and this learning model may be used for detecting the target person by the second detection unit 170. In other words, in this case, the detection conditions by the first detection unit 250 and the detection conditions by the second detection unit 170 are the same. In the example in Figure 14, when the vehicle 100a is traveling at position Rp3, the child Ps1 is located within the detection range DR. Therefore, in this case, the vehicle control device 150 determines that the target person has been detected by the second detection unit 170.

[0069] If it is determined in step S440 that a target person has been detected, in step S450, the vehicle control device 150, which functions as a state change unit 180, executes a change process. In step S450 in this embodiment, the vehicle control device 150 executes a deceleration process to change the vehicle 100b to a deceleration state as a change process. A deceleration state refers to a state in which the travel speed of the vehicle 100 is lower than the travel speed when the target person is not detected by the second detection unit 170. More specifically, the vehicle control device 150 reduces the travel speed of the vehicle 100 by controlling the drive unit 110. In the example in Figure 14, when the vehicle 100a is traveling at position Rp3, the vehicle 100a is decelerated.

[0070] If it is determined in step S440 that no target person was detected, then in step S460, it is determined whether the measurement time set by the timer started in step S430 has exceeded a predetermined time. If the vehicle control device 150 determines that the measurement time has not exceeded a predetermined time, it returns to step S440.

[0071] If it is determined in step S460 that the measurement time has exceeded a predetermined time, in step S470 the vehicle control device 150 determines whether or not the vehicle is in a changed state. If it is determined that the vehicle is in a changed state, in step S480 the vehicle control device 150, which functions as a state change unit 180, executes a release process. In the example in Figure 14, when the vehicle 100a is traveling at position Rp4, the child Ps1 is not detected by the second detection unit 170, and the measurement time has exceeded a predetermined time. Therefore, in this case, the vehicle control device 150 executes a release process to release the changed state, that is, the deceleration state. More specifically, the vehicle control device 150 accelerates the vehicle 100a by controlling the drive unit 110. In step S490, the vehicle control device 150 stops the timer that was started in step S430 and resets the measurement time by the timer.

[0072] In Figure 14, an example is shown where the target person detected by the first detection unit 250 and the target person detected by the second detection unit 170 are the same child Ps1. The target person detected by the first detection unit 250 and the target person detected by the second detection unit 170 may be the same person, or they may be different people. For example, in the detection process, child Ps1 may be detected as a target person by the first detection unit 250, and in step S440 of Figure 13, a different child may be detected as a target person by the second detection unit 170.

[0073] According to the sixth embodiment described above, the signal transmission unit 240 transmits a signal as a control signal AS to increase the detection sensitivity of the second detection unit 170, which detects the surrounding conditions of the vehicle 100. Therefore, in alert mode, by increasing the detection sensitivity of the second detection unit 170 provided in the vehicle 100, the vehicle 100 can be alerted to the target person.

[0074] Furthermore, in this embodiment, the state change unit 180 executes a change process to change the driving state of the vehicle 100 when the target person is detected by the second detection unit 170. The change process includes at least one of the following: a process to reduce the driving speed of the vehicle 100, a process to increase the amount of light emitted from the vehicle 100, and a process to increase the volume of sound emitted from the vehicle 100. Therefore, the vehicle 100 can detect the target person on its own, and when the vehicle 100 detects the target person, the vehicle 100 can execute the change process on its own.

[0075] Furthermore, in this embodiment, the state change unit 180 executes a release process to cancel the changed state if the target person is no longer detected by the second detection unit 170 after the change process has been executed. In this way, if the target person is no longer detected by the second detection unit 170 after the change process has been executed, the vehicle 100 can cancel the changed state on its own. In addition, this method can suppress the decrease in the vehicle's mobility efficiency and energy efficiency caused by the vehicle 100 continuing to drive while maintaining the changed state.

[0076] In other embodiments, the signal transmission unit 240 may transmit, as a control signal AS, to the target vehicle, for example, in addition to the signal for increasing sensitivity as described in the sixth embodiment, at least one of the signals for decreasing the travel speed, increasing the light intensity, and increasing the volume, as described in the first to third embodiments, respectively. In this case, the state change unit 180 can further change the driving state that has been changed based on the control signal AS during the change process. For example, if a signal for increasing sensitivity and a signal for decreasing travel speed are transmitted to the vehicle 100 as control signals AS, the state change unit 180 can further decrease the travel speed of the vehicle 100 from the state in which the travel speed of the vehicle 100 has been reduced by the control signals AS during the deceleration process.

[0077] G. Other embodiments: (G1) In the above embodiment, the signal transmission unit 240 transmits at least one of the following as control signals AS to the target vehicle: a signal to reduce the speed of movement, a signal to increase the light intensity, and a signal to increase the volume. In contrast, the signal transmission unit 240 may, in addition to the above, or in place of the above, transmit a signal as a control signal AS, for example, a signal to change the driving route of the vehicle 100 to a route that passes further away from the target person, or a signal to change the threshold distance at which the pre-collision brake activates so that the pre-collision brake activates earlier. Furthermore, the modification process described in the sixth embodiment may include, for example, a process to change the driving route or a process to change the distance threshold of the pre-collision brake, in substantially the same manner as described above.

[0078] (G2) In the above embodiment, the location detection unit 220 obtains the location information of the camera 302 by referring to the database DB based on the identification information of the camera 302. However, it is not necessary to obtain the location information of the camera 302 in this way. For example, the camera control unit 303 may transmit its own location information to the control device 200 along with the detection result, and the location detection unit 220 may obtain the transmitted location information in this manner. Even if the remote control sensor is configured as a sensor different from the camera 302, the location information of the remote control sensor may be obtained in the same manner as described above.

[0079] (G3) In the above embodiment, the location detection unit 220 detects the location of the target person based on the detection result of the first detection unit 250 and the location information of the camera 302. In contrast, the location detection unit 220 does not have to detect the location of the target person in this way, and for example, it may detect the location of the target person without using the location information of the camera 302. For example, the location detection unit 220 may detect the location based on the background or location markers included in the captured image Pi in which the target person was detected. In this case, for example, the coordinates of the target person may be detected based on the relationship between the position of the target person in the captured image Pi and the positions of the background or location markers.

[0080] (G4) In the above embodiment, the first detection unit 250 detects the target person based on the captured image Pi taken by the camera 302 which functions as a remote control sensor. In contrast, if the remote control sensor is composed of detectors such as LiDAR, millimeter-wave radar, ultrasonic sensor, or infrared sensor, the first detection unit 250 may use these detectors to detect the target person. For example, when an infrared sensor is used to detect the target person, a temperature-related condition can be used as a detection condition that indirectly detects a person who is unwell. In this case, the detection condition can be set, for example, to be that the body temperature is higher than a predetermined temperature. Furthermore, the remote control sensor and the sensor used by the first detection unit 250 to detect the target person may be provided separately. For example, the camera used by the first detection unit 250 to detect the target person may be provided separately from the remote control camera 302.

[0081] (G5) In the sixth embodiment described above, the state change unit 180 performs the release process itself, but it is not necessary to perform the release process in this manner. For example, when the target person is no longer detected by the first detection unit 250, the control device 200 may send a signal to the vehicle 100b to release the changed state.

[0082] (G6) In the above embodiment, the location detected by the location detection unit 220 does not have to be the coordinates of the target person, but can be any location information that allows the moving object identification unit 230 to identify the target vehicle. For example, as in the third embodiment, when the moving object identification unit 230 identifies a vehicle 100 moving inside a building where the target person is located as the target vehicle, the location of the target person only needs to be detected as information that allows at least the building in which the target person is located to be detected. Therefore, in this case, the location of the target person may be detected as information representing the building in which the target person is located. Alternatively, the location of the target person may be detected as, for example, the location information of the camera 302 that took the captured image Pi including the target person, or as location information of the range that can be captured by the camera 302. For example, when the target person is detected by the camera 302a in Figure 2, the location of the target person may be information regarding the installation location of the camera 302a or location information representing the range RG1 that can be captured by the camera 302a. In this case, for example, if the range RG1 is within the interior of a building, the information regarding the installation location of camera 302a and the location information representing range RG1 correspond to information that can detect the building in which the target person is located. In this case, the target vehicle may also be identified as, for example, a vehicle 100 moving within range RG1 or a vehicle 100 approaching range RG1.

[0083] (G7) In the above embodiment, the first detection unit 250 does not need to be separate from the moving object that can be identified by the moving object identification unit 230. For example, the control device 200 may have the first detection unit 250. In this case, for example, the vehicle detection unit 300 may transmit the captured image Pi and sensor values ​​from other sensors provided in the vehicle detection unit 300 to the control device 200 without analysis, and the first detection unit 250 provided in the control device 200 may detect the target person by analyzing the transmitted captured image Pi and sensor values.

[0084] This disclosure is not limited to the embodiments described above, and can be implemented in various configurations without departing from its spirit. For example, the technical features in the embodiments corresponding to the technical features in each form described in the summary of the invention can be replaced or combined as appropriate in order to solve some or all of the above-described problems, or to achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate. [Explanation of symbols]

[0085] 10,10b…Remote automatic driving system, 100,100a,100b,100c,100d…Vehicle, 110…Drive system, 120…Steering system, 130…Braking system, 140…Communication device, 150…Vehicle control device, 160…Surrounding sensor, 170…Second detection unit, 180…State change unit, 200…Control device, 201…Processor, 202…Storage unit, 203…Input / output interface, 20 4…Internal bus, 205…Communication device, 210…Remote control unit, 220…Location detection unit, 230…Moving object identification unit, 240…Signal transmission unit, 250…First detection unit, 260…Detection program, 270…Learning model, 300…Vehicle detection unit, 302, 302a, 302b, 302c…Camera, 303…Camera control unit, 304…Processor, 305…Storage unit, 306…Communication device, 308…Shooting unit

Claims

1. A remote automatic driving system for moving a mobile object by remote control, The system includes a control device used in the aforementioned remote automatic driving system, The control device is When a target person is detected by the first detection unit provided in the remote automatic driving system, a location detection unit detects the location of the target person based on the detection result of the first detection unit, A mobile body identification unit identifies the mobile body among the remotely controlled mobile bodies that can approach the target person, based on the detected location. The system includes a signal transmitting unit that transmits a control signal to the identified mobile body to change the operating mode of the mobile body to a warning mode for keeping watch for the target person, The aforementioned remote automatic driving system further, The aforementioned moving body, The first detection unit and, The system comprises a remote control unit that moves the mobile body by performing the aforementioned remote control, The moving body has a second detection unit that detects the conditions around the moving body, The signal transmission unit transmits a signal as the control signal to increase the sensitivity of detection by the second detection unit, in a remote automatic driving system.

2. A remote automatic driving system according to claim 1, The remote automatic driving system includes a mobile object identification unit that identifies a mobile object that can approach the target person by performing at least one of the following: identifying a mobile object that is moving inside the building where the target person is located; identifying a mobile object that is approaching the target person; and identifying a mobile object whose distance from the target person is less than or equal to a predetermined distance.

3. A remote automatic driving system according to claim 1, The signal transmission unit transmits a signal as the control signal to reduce the speed of the moving object, in this remote automatic driving system.

4. A remote automatic driving system according to claim 1, The signal transmission unit transmits, as the control signals, at least one of the following: a signal to increase the light intensity emitted from the moving body and a signal to increase the volume of sound emitted from the moving body.

5. A remote automatic driving system according to claim 1, A remote control sensor is used for the aforementioned remote control and is equipped with a remote control sensor for detecting the position of the moving object. The first detection unit is a remote-controlled automatic driving system that detects the target person using the remote control sensor.

6. A remote automatic driving system according to claim 5, The remote control sensor comprises a camera that captures images to detect the position of the moving object, in this remote automatic driving system.

7. A remote automatic driving system according to claim 6, The first detection unit detects the target person using the image captured by the camera and a learned model that has been trained to determine whether or not the input image contains a person that satisfies predetermined detection conditions, in this remote automatic driving system.

8. A remote automatic driving system according to claim 5, The location detection unit detects the location of the target person based on the detection result of the target person and the location information of the remote control sensor, in a remote automatic driving system.

9. A remote automatic driving system according to claim 1, The aforementioned moving object is a vehicle, The remote control unit, by performing the remote control, causes the mobile body to travel between a first location and a second location within the factory for manufacturing the mobile body. A remotely automated driving system in which a first process relating to the manufacture of the mobile body is performed at the first location, and a second process, which is a process that follows the first process, is performed at the second location.

10. A remote automatic driving system according to claim 1, The moving body has a state change unit that performs a change process to change the operating state of the moving body when the target person is detected by the second detection unit. A remote automatic driving system in which the modification process includes at least one of the following: a process to reduce the speed of the moving body; a process to increase the amount of light emitted from the moving body; and a process to increase the volume of sound emitted from the moving body.

11. A remote automatic driving system according to claim 10, The state change unit, after executing the change process, executes a process to cancel the state changed by the change process if the target person is no longer detected by the second detection unit, in this remote automatic driving system.

12. A method for controlling a mobile object in a remotely controlled automatic driving system, wherein the mobile object is moved by remote control, The process involves detecting a target person using a first detection unit provided in the aforementioned remote automatic driving system, A step of detecting the location of the target person based on the detection result of the first detection unit, A step of identifying, based on the detected location, the mobile body that is remotely controlled and capable of approaching the target person, The process includes a step of changing the driving mode of the identified mobile body to a warning mode for keeping watch over the target person, The moving body has a second detection unit that detects the conditions around the moving body, A method for controlling a mobile body, wherein in the modification step, a signal is transmitted to the identified mobile body as a control signal to change the operating mode of the identified mobile body to the warning mode, the signal being used to increase the sensitivity of detection by the second detection unit.

Citation Information

Patent Citations

  • Control method for unmanned carrying car

    JP1991163607A

  • Vehicle with outside user protecting function

    JP2008065381A

  • Method for operating a vehicle and method for operating a manufacturing system

    JP2017538619A

  • Transportation system

    JP2020064388A

  • Method for operating a vehicle and for operating a manufacturing system

    US20170320529A1