Control device and control method
Through the control devices and methods in the unmanned driving system, the situation where the vehicle fails to operate according to the command is determined and the problem of the vehicle failing to operate according to the command is solved, and higher response capabilities and judgment accuracy are achieved to ensure the stable operation of the system.
Patent Information
- Application Number
- CN202410654601.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-17
- Filing Date
- 2024-05-24
- Publication Date
- 2024-12-03
AI Technical Summary
In the prior art, if the vehicle fails to operate according to the command, it fails to respond effectively, resulting in increased control difficulty and difficulty in determining the moving body that performs the action, which may lead to contact with the moving body or other abnormal situations.
Provided is a control device and a method to determine whether the controlled moving object is executed if it is performed without execution, such as stopping, such as stopping, by an unmanned driving system. Or change the speed to ensure the correct operation of the moving body.
When the moving body does not perform actions according to the control command, it can be appropriately responded to avoid contact and other abnormal situations, improve the judgment accuracy, and ensure the stable operation of the system.
Smart Images

Figure CN119071759A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a control device and a control method. Background Art
[0002] A technique is known in which a command for moving the wipers of a vehicle by remote control is sent and the wipers of the vehicle are observed to see whether the wipers of the vehicle move according to the command, thereby confirming whether the intended vehicle is being remotely controlled (for example, Patent Document 1).
[0003] Prior art literature
[0004] Patent Document 1: U.S. Patent No. 10532771 Summary of the invention
[0005] Problems to be solved by the invention
[0006] Patent Document 1 does not consider how to deal with a vehicle when the vehicle does not operate according to an instruction.
[0007] Means for solving problems
[0008] The present disclosure can be implemented as the following aspects.
[0009] (1) According to the first aspect of the present disclosure, a control device is provided. The control device comprises: a determination unit that determines an action to be performed by a mobile body that can be operated by unmanned driving; a control unit that causes a controlled mobile body to perform the above-mentioned action, wherein the above-mentioned controlled mobile body is a mobile body that is moving by the above-mentioned unmanned driving; an action information acquisition unit that acquires action information related to the above-mentioned action observed from the outside of the mobile body; and a determination unit that uses the above-mentioned action information to determine whether the above-mentioned controlled mobile body has performed the above-mentioned action. When the above-mentioned determination unit determines that the above-mentioned controlled mobile body has not performed the above-mentioned action, the above-mentioned control unit performs at least one of the following processes: reporting that an abnormality has occurred, stopping the above-mentioned controlled mobile body, and changing the moving speed of the above-mentioned controlled mobile body.
[0010] According to the control device of this aspect, when the moving object does not operate according to the control, it is possible to appropriately deal with the situation.
[0011] (2) In the control device of the above-mentioned method, it may also be that the above-mentioned controlled mobile body is a part of multiple mobile bodies that can be operated through the above-mentioned unmanned driving, and the above-mentioned control device further includes a determination unit. When the above-mentioned determination unit determines that the above-mentioned controlled mobile body has not performed the above-mentioned action, the above-mentioned determination unit uses the above-mentioned action information to determine the above-mentioned controlled mobile body from the above-mentioned multiple mobile bodies.
[0012] According to the control device of this aspect, since it is possible to identify a moving body that has performed an operation according to control, it is possible to deal with the situation more appropriately when the moving body has not performed an operation according to control.
[0013] (3) In the control device of the above-mentioned method, it may also be that the above-mentioned controlled mobile body is a part of a plurality of mobile bodies that can be operated by the above-mentioned unmanned driving, and when the above-mentioned determination unit determines that the above-mentioned controlled mobile body has not performed the above-mentioned action, the above-mentioned control unit moves the above-mentioned controlled mobile body to a predetermined retreat place.
[0014] According to the control device of this aspect, when a moving body to be operated does not operate according to control, other moving bodies around the moving body to be operated can be moved to a retreat location, thereby preventing moving bodies from contacting each other.
[0015] (4) The control device of the above aspect may further include a process information acquisition unit that acquires process information, wherein the process information is information indicating a progress of a manufacturing process of the movable body, and the determination unit may determine the operation based on the progress indicated by the process information.
[0016] According to the control device of this aspect, it is possible to improve the accuracy of determining whether or not a desired moving object is being controlled.
[0017] (5) According to the second aspect of the present disclosure, a control method is provided. The control method determines an action to be performed by a mobile body capable of being operated by unmanned driving, causes a controlled mobile body to perform the action, the controlled mobile body is a mobile body that is being moved by the unmanned driving, obtains action information related to the action observed from the outside of the mobile body, uses the action information to determine whether the controlled mobile body has performed the action, and when it is determined that the controlled mobile body has not performed the action, performs at least one of a process of reporting that an abnormality has occurred, a process of stopping the controlled mobile body, and a process of changing the moving speed of the controlled mobile body.
[0018] According to the control method of this aspect, when the moving object does not operate according to the control, it is possible to appropriately deal with it.
[0019] The present disclosure can also be implemented in various forms other than the control device and the control method, for example, in the form of an unmanned driving system, a mobile body, a method for manufacturing a mobile body, a vehicle, a method for manufacturing a vehicle, a computer program, and a recording medium having the computer program recorded thereon. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 It is an explanatory diagram showing the configuration of the unmanned driving system according to the first embodiment.
[0021] Figure 2 It is an explanatory diagram showing the structure of the vehicle according to the first embodiment.
[0022] Figure 3A This is an explanatory diagram showing a situation in which a vehicle moves by remote control in a factory.
[0023] Figure 3B This is a flowchart showing a process procedure of driving control of a vehicle according to the first embodiment.
[0024] Figure 4 This is a flowchart showing the contents of the confirmation process according to the first embodiment.
[0025] Figure 5 This is a flowchart showing the contents of the confirmation action execution process according to the first embodiment.
[0026] Figure 6 It is an explanatory diagram showing the contents of a table showing the relationship between vehicle manufacturing processes and confirmation operations.
[0027] Figure 7 It is an explanatory diagram showing a situation in which a remote control target is confirmed.
[0028] Figure 8 It is an explanatory diagram showing the configuration of an unmanned driving system according to a second embodiment.
[0029] Fig. 9 It is an explanatory diagram showing the structure of a vehicle according to the second embodiment.
[0030] Fig.10 This is a flowchart showing a process procedure of driving control of a vehicle according to the second embodiment.
[0031] Fig.11 This is a flowchart showing the contents of the confirmation process according to the second embodiment. DETAILED DESCRIPTION
[0032] A. First Implementation Method:
[0033] Figure 1 It is an explanatory diagram showing the configuration of the unmanned driving system 10 in the first embodiment. Figure 2 1 is an explanatory diagram showing the structure of a vehicle 100 in the first embodiment. The unmanned driving system 10 is used to move a mobile body by unmanned driving. In this embodiment, the unmanned driving system 10 is used to move a mobile body by unmanned driving in a factory that manufactures mobile bodies. In addition, the unmanned driving system 10 may be used not in a factory that manufactures mobile bodies, but may be used to move a mobile body by unmanned driving in, for example, commercial facilities, universities, parks, etc.
[0034] In the present disclosure, a "mobile body" refers to an object that can move, such as a vehicle or an electric vertical take-off and landing machine (a so-called flying car). The vehicle can be a vehicle that runs on wheels or a vehicle that runs on an infinite track, such as a passenger car, a truck, a bus, a two-wheeled vehicle, a four-wheeled vehicle, a chariot, a construction vehicle, etc. Vehicles include electric vehicles (BEV: Battery Electric Vehicle), gasoline vehicles, hybrid vehicles, and fuel cell vehicles. In the case where the mobile body is other than a vehicle, the expression "vehicle" or "car" in the present disclosure can be appropriately replaced with "mobile body", and the expression "running" can be appropriately replaced with "moving".
[0035] The vehicle 100 is configured to be operable by unmanned driving. "Unmanned driving" refers to driving that does not rely on the driving operation of the passengers. Driving operation refers to operations related to at least any one of "driving", "turning" and "stopping" of the vehicle 100. Unmanned driving is achieved by automatic or manual remote control using a device located outside the vehicle 100, or by autonomous control of the vehicle 100. In the vehicle 100 that travels by unmanned driving, passengers who do not perform driving operations can also ride. Passengers who do not perform driving operations include, for example, people who only sit in the seats of the vehicle 100 and people who perform operations other than driving operations such as assembly, inspection, and switch operations while riding in the vehicle 100. In addition, driving based on the driving operations of the passengers is sometimes referred to as "manned driving".
[0036] In this specification, “remote control” includes “full remote control” in which all actions of the vehicle 100 are completely determined from outside the vehicle 100, and “partial remote control” in which part of the actions of the vehicle 100 are determined from outside the vehicle 100. In addition, “autonomous control” includes “full autonomous control” in which the vehicle 100 autonomously controls its own actions without receiving any information from a device outside the vehicle 100, and “partial autonomous control” in which the vehicle 100 autonomously controls its own actions using information received from a device outside the vehicle 100.
[0037] like Figure 1 As shown, in this embodiment, the unmanned driving system 10 includes: at least one vehicle 100, a remote control device 200 for remotely controlling the vehicle 100, an external sensor group 300 installed in a factory, a reporting device 400 for reporting abnormalities occurring in the factory, and a process management device 500 for managing the manufacturing process of the vehicle 100 in the factory. In addition, the remote control device 200 is sometimes referred to as a control device. In this embodiment, the remote control device 200 is equivalent to the "control device" of the present disclosure.
[0038] like Figure 2As shown, in this embodiment, the vehicle 100 is an electric vehicle configured to be movable by remote control. The vehicle 100 includes: a vehicle control device 110 for controlling each part of the vehicle 100, a driving device 120 for accelerating the vehicle 100, a steering device 130 for changing the traveling direction of the vehicle 100, a braking device 140 for decelerating the vehicle 100, a communication device 150 for communicating with the remote control device 200 by wireless communication, a horn 160 for generating a warning sound, a headlamp 170 for irradiating light to the front of the vehicle 100, and a wiper 180 for wiping water droplets attached to the window of the vehicle 100. In this embodiment, the driving device 120 includes a battery, a motor driven by the power of the battery, and a driving wheel rotated by the motor.
[0039] The vehicle control device 110 is composed of a computer including a processor 111, a memory 112, an input / output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input / output interface 113 are connected via the internal bus 114 in a manner capable of bidirectional communication. The input / output interface 113 is connected to a drive device 120, a steering device 130, a brake device 140, a communication device 150, a horn 160, a headlamp 170, and a wiper 180. The memory 112 stores a computer program PG1.
[0040] The processor 111 functions as a vehicle control unit 115 by executing the computer program PG1. The vehicle control unit 115 controls the drive device 120, the steering device 130, the brake device 140, the horn 160, the headlight 170, and the wiper 180. When the driver is on the vehicle 100, the vehicle control unit 115 can drive the vehicle 100 by controlling the drive device 120, the steering device 130, and the brake device 140 according to the operation of the driver. Regardless of whether the driver is on the vehicle 100, the vehicle control unit 115 can control the drive device 120, the steering device 130, and the brake device 140 according to the control command supplied from the remote control device 200, thereby driving the vehicle 100.
[0041] like Figure 1As shown, the remote control device 200 is composed of a computer including a processor 201, a memory 202, an input / output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input / output interface 203 are connected via the internal bus 204 in a manner capable of bidirectional communication. A communication device 205 for communicating with the vehicle 100 by wireless communication is connected to the input / output interface 203. In the present embodiment, the communication device 205 can communicate with the external sensor group 300, the reporting device 400, and the process management device 500 by wired communication or wireless communication. The computer program PG2 and the table TB are stored in the memory 202.
[0042] The processor 201 functions as a remote control unit 210, a process information acquisition unit 220, a determination unit 230, an action information acquisition unit 240, a determination unit 250, and a determination unit 260 by executing the computer program PG2. The remote control unit 210 causes the vehicle 100 to travel by remotely controlling the vehicle 100. The process information acquisition unit 220 acquires process information, which is information indicating the progress of the manufacturing process of the vehicle 100, from the process management device 500. The determination unit 230 determines the content of the confirmation action to be executed by the vehicle 100. The confirmation action is an action for confirming whether the desired vehicle 100 is remotely controlled. The confirmation action includes, for example, the sounding of the horn 160, the lighting of the headlights 170, and the swinging of the wipers 180. The action information acquisition unit 240 acquires action information, which is information related to the confirmation action, from the external sensor group 300. The determination unit 250 determines whether the desired vehicle 100 is remotely controlled. When determining that the desired vehicle 100 is not being remotely controlled, the identification unit 260 identifies the remote control unit 210 as the vehicle 100 that is erroneously remotely controlled. In addition, the remote control unit 210 and the identification unit 250 may be collectively referred to as a control unit.
[0043] The external sensor group 300 is composed of at least one external sensor. An external sensor refers to a sensor installed outside the vehicle 100. The external sensor is used for observing and confirming actions of the vehicle 100. External sensors include, for example, cameras, LiDAR (Light Detection and Ranging), and microphones. The lighting of the headlights 170 and the swing of the wipers 180 can be observed by using a camera or LiDAR. The sounding of the horn 160 can be observed by using a microphone. In this embodiment, the external sensor group 300 is composed of a plurality of cameras installed in a factory and a plurality of microphones installed in a factory. Each camera and each microphone is equipped with a communication device not shown in the figure, and can communicate with the remote control device 200 through wired communication or wireless communication.
[0044] The notification device 400 is a device for notifying the manager of the unmanned driving system 10 or the operator of the factory that an abnormality has occurred in the factory. In the following description, the manager of the unmanned driving system 10 or the operator of the factory is referred to as the manager, etc. The notification device 400 is, for example, a warning buzzer installed in the factory or a warning light installed in the factory. The notification device 400 can also be a tablet terminal carried by the manager, etc. The reporting device 400 has a communication device not shown in the figure, and can communicate with the remote control device 200 through wired communication or wireless communication.
[0045] The process management device 500 is a device for managing the manufacturing process of the vehicle 100 in the factory. The process management device 500 is composed of at least one computer. The process management device 500 is equipped with a communication device (not shown) and can communicate with the remote control device 200 and various devices in the factory through wired communication or wireless communication. The process management device 500 communicates with various devices in the factory to understand when, where, who is scheduled to perform what operation on which vehicle 100, and when, who has performed what operation on which vehicle 100.
[0046] Figure 3A 1 is an explanatory diagram showing a situation in which the vehicle 100 moves by remote control in the factory KJ. Figure 3A 6 vehicles 100A to 100F are shown in the figure. In the following description, when the six vehicles 100A to 100F are described without particular distinction, they are simply referred to as vehicles 100. In the present embodiment, the factory KJ includes a first place PL1, a second place PL2, a third place PL3, and a fourth place PL4. The first place PL1, the second place PL2, and the third place PL3 are places where the work of assembling the vehicle 100 is performed, and the fourth place PL4 is a place where the work of inspecting the vehicle 100 is performed. The first place PL1, the second place PL2, the third place PL3, and the fourth place PL4 are connected by a travel road SR on which the vehicle 100 can travel.
[0047] The vehicle 100 assembled at the first location PL1 is equipped with a vehicle control device 110, a drive device 120, a steering device 130, a brake device 140, a communication device 150, and a horn 160. The vehicle 100 assembled at the first location PL1 travels from the first location PL1 to the second location PL2 by remote control. At the second location PL2, a headlamp 170 is installed on the vehicle 100. The vehicle 100 equipped with the headlamp 170 travels from the second location PL2 to the third location PL3 by remote control. At the third location PL3, a wiper 180 is installed on the vehicle 100. The vehicle 100 equipped with the wiper 180 travels from the third location PL3 to the fourth location PL4 by remote control. At the fourth location PL4, the vehicle 100 is inspected. Then, the vehicle 100 is shipped from the factory KJ. In the following description, the work performed at the first location PL1 is referred to as the first process, the work performed at the second location PL2 is referred to as the second process, the work performed at the third location PL3 is referred to as the third process, and the work performed at the fourth location PL4 is referred to as the fourth process. The first process, the second process, the third process, and the fourth process are included in the manufacturing process of the vehicle 100.
[0048] A method for the remote control unit 210 to move the vehicle 100 by remote control is described. The remote control unit 210 determines a target route for the vehicle 100 to travel to the destination via the travel road SR. In the present embodiment, the target route is a reference route RR. A plurality of cameras CM for photographing the travel road SR are provided in the factory KJ, and the remote control unit 210 can obtain the relative position and orientation of the vehicle 100 relative to the target route in real time by analyzing the images photographed by each camera CM. In the present embodiment, each camera CM is included in the above-mentioned external sensor group 300. The remote control unit 210 generates a control command for causing the vehicle 100 to travel along the target route, and sends the control command to the vehicle 100. In the present embodiment, the control command includes a travel control signal described later. The vehicle control device 110 mounted on the vehicle 100 controls the drive device 120, the steering device 130, and the brake device 140 according to the received control command, thereby causing the vehicle 100 to travel. Therefore, the vehicle 100 can be moved without using a transport device such as a crane or a conveyor. In the present embodiment, the control command indicates, for example, a target value of acceleration and a target value of a steering angle of the vehicle 100. In other embodiments, the control command may also indicate a target route of the vehicle 100. In this case, the vehicle control unit 115 may also determine the target value of acceleration and the target value of a steering angle of the vehicle 100 based on the target route.
[0049] In the present embodiment, the remote control unit 210 can make the multiple vehicles 100A to 100F travel one by one through remote control. For example, after the remote control unit 210 makes the vehicle 100C travel from the third location PL3 to the fourth location PL4 through remote control, the remote control unit 210 can switch the remote control target from the vehicle 100C to the vehicle 100B, and move the vehicle 100B from the second location PL2 to the third location PL3 through remote control, and switch the remote control target from the vehicle 100B to the vehicle 100A, so that the vehicle 100A moves from the first location PL1 to the second location PL2 through remote control. The remote control unit 210 can also make the multiple vehicles 100A to 100F travel simultaneously and in parallel through remote control. For example, the remote control unit 210 can remotely control the vehicle 100C to travel from the third point PL3 to the fourth point PL4, remotely control the vehicle 100B to move from the second point PL2 to the third point PL3, and remotely control the vehicle 100A to move from the first point PL1 to the second point PL2.
[0050] Figure 3B 1 is a flowchart showing the processing steps of the driving control of the vehicle 100 in the first embodiment. Steps S1 to S4 are repeatedly executed by the processor 201 of the remote control device 200, and steps S5 to S6 are repeatedly executed by the processor 111 of the vehicle control device 110. In step S1, the remote control device 200 uses the detection result output from the external sensor group 300 to obtain the vehicle position information. The vehicle position information is the position information that becomes the basis for generating the driving control signal. In this embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the reference coordinate system of the factory KJ. In this embodiment, the reference coordinate system of the factory KJ is the global coordinate system GC, and any position in the factory KJ is expressed by the coordinates of X, Y, and Z in the global coordinate system GC. In this embodiment, the external sensor group 300 includes a camera CM, and a captured image is output from the camera CM as the detection result. That is, in step S1, the remote control device 200 uses the captured image obtained from the camera CM of the external sensor group 300 to obtain the vehicle position information.
[0051] Specifically, in step S1, the remote control device 200 detects the outer shape of the vehicle 100 from the captured image, calculates the coordinates of the positioning point of the vehicle 100 in the coordinate system of the camera CM, that is, the local coordinate system, and converts the calculated coordinates into coordinates in the global coordinate system GC, thereby acquiring the position of the vehicle 100. The outer shape of the vehicle 100 contained in the captured image can be detected by, for example, inputting the captured image to a detection model DM that makes use of artificial intelligence. The detection model DM is prepared, for example, in the unmanned driving system 10 or outside the unmanned driving system 10 and is pre-stored in the memory 202 of the remote control device 200. As the detection model DM, for example, a machine learning model that has been learned in a manner that realizes either semantic segmentation or instance segmentation can be cited. As the machine learning model, for example, a convolutional neural network (hereinafter referred to as CNN) learned by supervised learning using a learning data set can be used. The learning data set, for example, includes a plurality of training images containing the vehicle 100 and labels indicating whether each region in the training image is a region representing the vehicle 100 or a region other than the vehicle 100. When learning CNN, it is preferred to update the parameters of CNN in a manner that reduces the error between the output result of the detection model DM and the label by back propagation (error back propagation method). In addition, the remote control device 200 estimates the direction of the movement vector of the vehicle 100 calculated based on the position change of the feature point of the vehicle 100 between frames of the captured image, for example, using the optical flow method, thereby being able to obtain the direction of the vehicle 100.
[0052] In step S2, the remote control device 200 determines the target position to which the vehicle 100 should go next. In the present embodiment, the target position is represented by the coordinates of X, Y, and Z in the global coordinate system GC. The path that the vehicle 100 should travel, i.e., the reference path RR, is pre-stored in the memory 202 of the remote control device 200. The path is represented by a node representing a departure point, a node representing a passing point, a node representing a destination, and a road segment connecting each node. The remote control device 200 uses the vehicle position information and the reference path RR to determine the target position to which the vehicle 100 should go next. The remote control device 200 determines the target position on the reference path RR that is ahead of the current position of the vehicle 100.
[0053] In step S3, the remote control device 200 generates a driving control signal for driving the vehicle 100 toward the determined target position. In the present embodiment, the driving control signal includes the acceleration and steering angle of the vehicle 100 as parameters. The remote control device 200 calculates the driving speed of the vehicle 100 according to the change of the position of the vehicle 100, and compares the calculated driving speed with the target speed. In general, the remote control device 200 determines the acceleration in a manner to accelerate the vehicle 100 when the driving speed is lower than the target speed, and determines the acceleration in a manner to decelerate the vehicle 100 when the driving speed is higher than the target speed. In addition, the remote control device 200 determines the steering angle and acceleration in a manner that the vehicle 100 does not deviate from the reference path RR when the vehicle 100 is located on the reference path RR, and determines the steering angle and acceleration in a manner that the vehicle 100 returns to the reference path RR when the vehicle 100 is not located on the reference path RR, in other words, when the vehicle 100 deviates from the reference path RR.
[0054] In step S4, the remote control device 200 transmits the generated travel control signal to the vehicle 100. The remote control device 200 repeatedly acquires the position of the vehicle 100, determines the target position, generates and transmits the travel control signal in a predetermined cycle.
[0055] In step S5, the vehicle control device 110 receives the travel control signal transmitted from the remote control device 200. In step S6, the vehicle control device 110 uses the received travel control signal to control the drive device 120, the steering device 130, and the brake device 140, thereby causing the vehicle 100 to travel at the acceleration and steering angle indicated by the travel control signal. The vehicle control device 110 repeatedly receives the travel control signal and controls the various devices 120 to 140 at a predetermined cycle.
[0056] Figure 4 2 is a flowchart showing the contents of the confirmation process executed in the remote control device 200 . Figure 5 1 is a flowchart showing the contents of the confirmation operation execution process executed in the vehicle 100 . Figure 6 1 is an explanatory diagram showing the contents of table TB showing the relationship between the manufacturing process of vehicle 100 and the confirmation operation. Figures 4 to 6 The control method executed in the unmanned driving system 10 will be described.
[0057] Figure 4The confirmation process shown is repeatedly executed by the processor 201 of the remote control device 200. When the confirmation process starts, in step S110, the remote control unit 210 determines whether the movement of the vehicle 100 based on the remote control is being executed. In the following description, the vehicle 100 recognized by the remote control unit 210 as the target of remote control is referred to as the target vehicle 100. In the case where it is determined in step S110 that the movement of the target vehicle 100 is not being executed by remote control, the remote control unit 210 skips the processing after step S110 and ends the confirmation process.
[0058] If it is determined in step S110 that the movement of the target vehicle 100 is being performed by remote control, the decision unit 230 decides the content of the confirmation action to be performed by the target vehicle 100 in step S120. In the present embodiment, the decision unit 230 decides the content of the confirmation action to be performed by the target vehicle 100 based on the progress of the manufacturing process of the target vehicle 100. Figure 6 As shown, in the table TB stored in the memory 202, the progress of the manufacturing process of the vehicle 100 and the content of the confirmation action are recorded in correspondence. The process information acquisition unit 220 acquires the process information indicating the progress of the manufacturing process of the target vehicle 100 from the process management device 500, and the determination unit 230 determines the content of the confirmation action to be executed by the target vehicle 100 using the process information acquired by the process information acquisition unit 220 and the table TB. For example, when the manufacturing process of the target vehicle 100 is in progress between the first process and the second process, the determination unit 230 determines the content of the confirmation action to be executed by the target vehicle 100 to be the sounding of the horn 160. When the manufacturing process of the target vehicle 100 is in progress between the second process and the third process, the determination unit 230 determines the content of the confirmation action to be executed by the target vehicle 100 to be the lighting of the headlight 170. When the manufacturing process of the target vehicle 100 is in progress after the third process, the determination unit 230 determines the content of the confirmation action to be executed by the target vehicle 100 to be the swinging of the wiper 180.
[0059] In step S130, the remote control unit 210 transmits a control command for executing the confirmation operation to the target vehicle 100. In the following description, the control command for causing the target vehicle 100 to execute the confirmation operation is referred to as a confirmation operation command.
[0060] In step S140, the motion information acquisition unit 240 acquires motion information related to the confirmation motion from the external sensor group 300. In this embodiment, the external sensor group 300 includes a plurality of microphones MP and a plurality of cameras CM, and the motion information includes information indicating sound obtained from each microphone MP and information indicating an image obtained from each camera CM.
[0061] In step S150, the determination unit 250 determines whether the target vehicle 100 has performed the confirmation action according to the confirmation action instruction. In the present embodiment, the determination unit 250 determines that the target vehicle 100 has performed the confirmation action according to the confirmation action instruction when the action information indicates that the target vehicle 100 has performed the confirmation action according to the confirmation action instruction, and determines that the target vehicle 100 has not performed the confirmation action according to the confirmation action instruction when the action information does not indicate that the target vehicle 100 has performed the confirmation action according to the confirmation action instruction.
[0062] If it is determined in step S150 that the target vehicle 100 has executed the confirmation operation in accordance with the confirmation operation command, the remote control unit 210 continues the movement of the target vehicle 100 by remote control in step S160. Then, the remote control device 200 ends the confirmation process.
[0063] If it is determined in step S150 that the target vehicle 100 has not performed the confirmation action according to the confirmation action instruction, the remote control unit 210 uses the reporting device 400 to report the abnormality to the administrator or the like in step S165. In the present embodiment, the determination unit 260 uses the action information to determine the vehicle 100 that has performed the confirmation action at the time when the confirmation action instruction is sent, in other words, to determine the vehicle 100 that the remote control unit 210 is mistakenly remotely controlling. In addition to the abnormality, the remote control unit 210 may also report the identification number and current location of the vehicle 100 that is mistakenly remotely controlled to the administrator or the like. In step S168, the remote control unit 210 stops the movement of the vehicle 100 that is mistakenly remotely controlled by sending a control instruction for braking the vehicle 100. The order of steps S165 and S168 may also be reversed. Then, the remote control device 200 ends the confirmation process.
[0064] Figure 5 The confirmation action execution process shown is repeatedly executed in the vehicle 100. When the confirmation action execution process starts, in step S210, the vehicle control unit 115 determines whether a confirmation action instruction is received from the remote control device 200. In the case where it is not determined in step S210 that a confirmation action instruction is received from the remote control device 200, the vehicle control unit 115 skips the processing after step S210 and ends the confirmation action execution process. In the case where it is determined in step S210 that a confirmation action instruction is received from the remote control device 200, the vehicle control unit 115 performs a confirmation action according to the confirmation action instruction in step S220. Then, the vehicle control unit 115 ends the confirmation action execution process.
[0065] Figure 7This is an explanatory diagram showing a situation of confirming whether or not the desired object is being remotely controlled. For example, when the vehicle 100A is being moved from the second place PL2 to the third place PL3 by remote control, in other words, when the manufacturing process of the vehicle 100A is in progress between the second process and the third process, during the confirmation process, a confirmation action command SS for lighting the headlight 170 is sent from the remote control device 200. When the image obtained from the camera CM shows that the headlight 170 of the vehicle 100A is lit according to the confirmation action command SS, it can be confirmed that the remote control device 200 is remotely controlling the vehicle 100A as the appropriate object. In this case, the remote control device 200 continues the movement of the vehicle 100A. In contrast, when the headlight 170 of the vehicle 100A is not lit according to the confirmation action command SS, the remote control device 200 may be mistakenly remotely controlling a vehicle 100 other than the vehicle 100A. For example, if the headlight 170 of the vehicle 100B is on at the time when the confirmation operation command SS is sent, the remote control device 200 may be erroneously remote controlling the vehicle 100B. In this case, the remote control device 200 reports the abnormality to the manager or the like through the reporting device 400, and stops the movement of the vehicle 100 that is erroneously remotely controlled through remote control.
[0066] According to the unmanned driving system 10 in the present embodiment described above, the remote control device 200 continues the movement of the vehicle 100 when the object of remote control is appropriate, and reports the occurrence of an abnormality to the manager or the like through the reporting device 400 when the object of remote control is inappropriate, and on this basis, stops the movement of the vehicle 100 that is being remotely controlled incorrectly through remote control. Therefore, when the object of remote control is inappropriate, appropriate response can be taken.
[0067] In addition, in the present embodiment, when the remote control target is inappropriate, the identification unit 260 can identify the vehicle 100 that the remote control device 200 is erroneously remotely controlling. Therefore, when the remote control target is inappropriate, appropriate and prompt measures can be taken.
[0068] In addition, in the present embodiment, the content of the confirmation operation is determined according to the progress of the manufacturing process of the vehicle 100. Therefore, it is possible to improve the accuracy of determining whether the object of remote control is appropriate.
[0069] In addition, when the remote control device 200 remotely controls a plurality of vehicles 100, a control instruction is sent from the communication device 205 to a vehicle 100 that does not correspond to the control instruction. Here, sending a control instruction from the communication device 205 to a vehicle 100 that does not correspond to the control instruction means that a control instruction generated for remotely controlling one of the plurality of vehicles 100 is sent from the communication device 205 to other vehicles 100 other than the one vehicle 100. Such a phenomenon is sometimes referred to as confusion of the vehicle 100 that is the object of remote control. When the remote control device 200 remotely controls a plurality of vehicles 100, confusion of the vehicle 100 that is the object of remote control may occur due to a malfunction of the unmanned driving system 10 or human error of the staff of the factory KJ. For example, Figure 3A As shown, when the remote control device 200 remotely controls six vehicles 100A to 100F in the order of vehicle 100F, vehicle 100E, vehicle 100D, vehicle 100C, vehicle 100B, and vehicle 100A, a control command is sent from the communication device 205 to a vehicle 100 that does not correspond to the control command. Specifically, after the remote control of the vehicle 100F by the remote control device 200 ends, although the communication device 150 removed from the vehicle 100F is scheduled to be installed in the vehicle 100B, if the communication device 150 removed from the vehicle 100F is mistakenly installed in the vehicle 100A, the control command generated for remotely controlling the vehicle 100B is sent to the vehicle 100A. Even in such a case, in the present embodiment, the remote control device 200 can detect that the control command is sent from the communication device 205 to the vehicle 100 that does not correspond to the control command by performing the confirmation process. Therefore, the communication device 150 erroneously mounted on the vehicle 100A can be removed from the vehicle 100A and mounted on the vehicle 100B, and the remote control of the vehicle 100B can be started.
[0070] B. Second Implementation Method:
[0071] Figure 8 It is an explanatory diagram showing the configuration of an unmanned driving system 10b in the second embodiment. Fig. 9 1 is an explanatory diagram showing the structure of the vehicle 100 in the second embodiment. In the second embodiment, the unmanned driving system 10b does not have the remote control device 200 and the vehicle 100 is not driven by remote control but by autonomous control, which is different from the first embodiment. As for other structures, unless otherwise specified, they are the same as the first embodiment. In addition, in this embodiment, the vehicle control device 110 is equivalent to the "control device" of the present disclosure.
[0072] like Figure 8As shown, in this embodiment, the vehicle 100 is configured to be able to travel by autonomous control. The vehicle 100 can communicate with the external sensor group 300 , the reporting device 400 , and the process management device 500 by wireless communication using the communication device 150 .
[0073] like Fig. 9 As shown, the processor 111 of the vehicle control device 110 functions as a vehicle control unit 115, a process information acquisition unit 191, a determination unit 192, an action information acquisition unit 193, and a determination unit 194 by executing a computer program PG1 pre-stored in the memory 112. The process information acquisition unit 191 acquires process information from the process management device 500. The determination unit 192 determines the content of the confirmation action to be executed by the vehicle. In the present embodiment, the confirmation action is executed to confirm whether the detection result obtained from the camera CM of the external sensor group 300 is the detection result of the vehicle. In other words, in the present embodiment, the confirmation action is executed to confirm whether the position of the vehicle recognized by the vehicle control device 110 is correct. The action information acquisition unit 193 acquires action information from the external sensor group 300. The determination unit 194 determines whether the position of the vehicle recognized by the vehicle control device 110 is correct. In the present embodiment, the table TB, the reference path RR, and the detection model DM are pre-stored in the memory 112. In addition, the vehicle control unit 115 and the determination unit 194 are sometimes collectively referred to as a control unit.
[0074] Fig.10 1 is a flowchart showing the processing steps of the driving control of the vehicle 100 in the present embodiment. In step S11, the vehicle control unit 115 uses the detection result output from the camera CM of the external sensor group 300 to obtain the vehicle position information. In step S21, the vehicle control unit 115 determines the target position to which the vehicle 100 should go next. In step S31, the vehicle control unit 115 generates a driving control signal for driving the vehicle 100 toward the determined target position. In step S41, the vehicle control unit 115 uses the generated driving control signal to control various devices including the drive device 120, the steering device 130 and the brake device 140, so as to drive the vehicle 100 according to the parameters represented by the driving control signal. The vehicle control unit 115 repeatedly obtains the vehicle position information, determines the target position, generates the driving control signal and controls the various devices 120~140 at a predetermined period.
[0075] Fig.11 This is a flowchart showing the contents of the confirmation process in this embodiment. Fig.11The confirmation process shown is repeatedly executed by the processor 111 of the vehicle control device 110. When the confirmation process starts, in step S310, the vehicle control unit 115 determines whether the movement of the host vehicle based on autonomous control is being executed. If it is determined in step S310 that the movement of the host vehicle is not being executed, the vehicle control unit 115 skips the process after step S310 and ends the confirmation process.
[0076] When it is determined in step S310 that the movement of the vehicle is being performed, the decision unit 192 determines the content of the confirmation action to be performed by the vehicle in step S320. In the present embodiment, the decision unit 192 determines the content of the confirmation action to be performed by the vehicle based on the progress of the manufacturing process of the vehicle. In the table TB stored in the memory 112, the progress of the manufacturing process of the vehicle 100 and the content of the confirmation action are recorded in correspondence. The process information acquisition unit 191 acquires process information indicating the progress of the manufacturing process of the vehicle from the process management device 500, and the decision unit 192 uses the process information acquired by the process information acquisition unit 191 and the table TB to determine the content of the confirmation action to be performed by the vehicle.
[0077] In step S330, the vehicle control unit 115 controls each part of the vehicle to make the vehicle perform the confirmation action determined by the determination unit 192. In step S340, the action information acquisition unit 193 acquires action information related to the confirmation action from the external sensor group 300. The action information acquisition unit 193 determines, for example, based on the vehicle position information of the vehicle identified by the vehicle control unit 115, an external sensor that is estimated to have observed the confirmation action of the vehicle from a plurality of external sensors included in the external sensor group 300, and acquires action information from the external sensor. In step S350, the determination unit 194 determines whether the vehicle has performed the confirmation action. In the present embodiment, the determination unit 194 determines that the vehicle has performed the confirmation action when the action information indicates that the vehicle has performed the confirmation action, and determines that the vehicle has not performed the confirmation action when the action information does not indicate that the vehicle has performed the confirmation action.
[0078] If it is determined in step S350 that the vehicle has performed a confirmation action, the vehicle control unit 115 continues the movement based on the autonomous control of the vehicle in step S360. Then, the vehicle control device 110 ends the confirmation process. On the other hand, if it is determined in step S350 that the vehicle has not performed a confirmation action, the vehicle control unit 115 uses the reporting device 400 to report the occurrence of an abnormality to the manager, etc. in step S365. In step S368, the vehicle control unit 115 brakes the vehicle. The order of steps S365 and S368 may also be reversed. Then, the vehicle control device 110 ends the confirmation process.
[0079] According to the unmanned driving system 10b in the present embodiment described above, the vehicle 100 can be driven by autonomous control of the vehicle 100 even if the vehicle 100 is not remotely controlled from the outside. In addition, in the present embodiment, the vehicle 100 can confirm whether the position information of the vehicle obtained by the camera CM of the external sensor group 300 is correct by executing the confirmation process.
[0080] C. Other implementations:
[0081] (C1) In the unmanned driving systems 10 and 10b of the above-mentioned embodiments, the remote control device 200 and the vehicle control device 110 cause the vehicle 100 to perform a confirmation action while the vehicle 100 is moving. Alternatively, the remote control device 200 and the vehicle control device 110 may cause the vehicle 100 to perform a confirmation action while the vehicle 100 is stopped.
[0082] (C2) In the unmanned driving systems 10 and 10b of the above-mentioned embodiments, the decision units 230 and 192 determine the content of the confirmation action based on the progress of the manufacturing process of the vehicle 100. In contrast, the decision units 230 and 192 may determine the content of the confirmation action based on the progress and time of the manufacturing process of the vehicle 100. For example, when the vehicle 100 travels from the second place PL2 to the third place PL3, the decision units 230 and 192 may determine the sounding of the horn 160 as the confirmation action during the daytime period and the lighting of the headlights 170 as the confirmation action during the nighttime period. Alternatively, the decision units 230 and 192 may determine the content of the confirmation action based on the progress of the manufacturing process of the vehicle 100 and the weather at the factory location. For example, when the vehicle 100 travels from the third location PL3 to the fourth location PL4 outdoors, the decision unit 230, 192 may determine the swing of the wiper 180 as the confirmation action in sunny weather, and determine the lighting of the headlight 170 as the confirmation action in rainy weather. The decision unit 230, 192 may determine the lighting of the headlight 170 or the swing of the wiper 180 as the confirmation action instead of the sounding of the horn 160 in a process with a large working sound. In addition, the decision unit 230, 192 may determine the content of the confirmation action regardless of the progress of the manufacturing process of the vehicle 100. For example, the decision unit 230, 192 may determine the content of the confirmation action based on at least one of the weather and the time of day regardless of the progress of the manufacturing process of the vehicle 100.
[0083] (C3) In the unmanned driving systems 10 and 10b of the above-mentioned embodiments, the remote control unit 210 and the vehicle control unit 115 stop the movement of the vehicle 100 in steps S168 and S368 of the confirmation process. In contrast, the remote control unit 210 and the vehicle control unit 115 may not stop the movement of the vehicle 100 in the confirmation process. For example, the remote control unit 210 and the vehicle control unit 115 may decelerate the vehicle 100 within a range in which the vehicle 100 does not stop in steps S168 and S368 of the confirmation process. The remote control unit 210 and the vehicle control unit 115 may lower the upper limit value of the moving speed of the vehicle 100 compared to before in steps S168 and S368 of the confirmation process and continue the movement of the vehicle 100.
[0084] (C4) In the unmanned driving system 10 of the first embodiment described above, when the remote control unit 210 remotely controls a plurality of vehicles 100 simultaneously and in parallel, in step S168 of the confirmation process, the remote control unit 210 stops the movement of all the vehicles 100 under remote control simultaneously. Alternatively, the remote control unit 210 may stop the movement of only the vehicle 100 identified by the identification unit 260.
[0085] (C5) In the unmanned driving system 10 of the first embodiment described above, the remote control unit 210 may remotely control a plurality of vehicles 100 in parallel, and in step S168 of the confirmation process, the vehicles 100 located around the target vehicle 100 may be moved to a predetermined retreat location by remote control. The retreat location may be set at the end of the driving road SR, or may be set at a branch from the driving road SR.
[0086] (C6) In the unmanned driving system 10 of the first embodiment described above, the remote control device 200 includes the identification unit 260 . On the other hand, the remote control device 200 may not include the identification unit 260 .
[0087] (C7) In the unmanned driving system 10 of the first embodiment described above, the motion information acquisition unit 240 and the determination unit 250 are provided in the remote control device 200. In contrast, the motion information acquisition unit 240 and the determination unit 250 may be provided in the vehicle control device 110. In this case, the remote control device 200 may also obtain the determination result from the vehicle control device 110, and perform different processing on the vehicle 100 according to the obtained determination result.
[0088] (C8) In each of the above-mentioned embodiments, the external sensor for obtaining the vehicle position information is a camera CM. In contrast, the external sensor for obtaining the vehicle position information may not be a camera CM, and may be, for example, a LiDAR (Light Detection And Ranging). In this case, the detection result output from the external sensor may also be three-dimensional point group data representing the vehicle 100. In this case, the remote control device 200 or the vehicle control device 110 may also obtain the vehicle position information by template matching of the three-dimensional point group data as the detection result and the reference point group data prepared in advance.
[0089] (C9) In the first embodiment, the remote control device 200 performs the processing from the acquisition of the vehicle position information to the generation of the travel control signal. In contrast, at least a part of the processing from the acquisition of the vehicle position information to the generation of the travel control signal may be performed by the vehicle 100. For example, the following (1) to (3) may be used.
[0090] (1) The remote control device 200 may also obtain vehicle position information, determine the target position to which the vehicle 100 should go next, and generate a path from the current location of the vehicle 100 indicated by the obtained vehicle position information to the target position. The remote control device 200 may generate a path to the target position between the current location and the destination, or may generate a path to the destination. The remote control device 200 may also send the generated path to the vehicle 100. The vehicle 100 may also generate a travel control signal in such a way that the vehicle 100 travels on the path received from the remote control device 200, and use the generated travel control signal to control the drive device 120, the steering device 130, and the brake device 140.
[0091] (2) The remote control device 200 may also obtain vehicle position information and transmit the obtained vehicle position information to the vehicle 100. The vehicle 100 may also determine a target position to which the vehicle 100 should go next, generate a path from the current position of the vehicle 100 indicated by the received vehicle position information to the target position, generate a travel control signal in such a way that the vehicle 100 travels on the generated path, and control the drive device 120, the steering device 130, and the brake device 140 using the generated travel control signal.
[0092] (3) In the above-mentioned methods (1) and (2), the vehicle 100 may be equipped with an internal sensor, and the detection result outputted from the internal sensor may be used in at least one of the generation of the route and the generation of the driving control signal. The internal sensor is a sensor mounted on the vehicle 100. The internal sensor may include, for example, a sensor for detecting the motion state of the vehicle 100, a sensor for detecting the operation state of each part of the vehicle 100, and a sensor for detecting the environment around the vehicle 100. Specifically, the internal sensor may include, for example, a camera, a LiDAR, a millimeter wave radar, an ultrasonic sensor, a GPS sensor, an acceleration sensor, a gyroscope sensor, etc. For example, in the above-mentioned method (1), the remote control device 200 may also obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. In the above-mentioned method (1), the vehicle 100 may also obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the driving control signal when generating the driving control signal. In the above-mentioned method (2), the vehicle 100 may also obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. In the above-mentioned aspect (2), the vehicle 100 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor on the traveling control signal when generating the traveling control signal.
[0093] (C10) In the second embodiment, the vehicle 100 may be equipped with an internal sensor, and the detection result outputted from the internal sensor may be used in at least one of the generation of the route and the generation of the travel control signal. For example, the vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. The vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the travel control signal when generating the travel control signal.
[0094] (C11) In the second embodiment described above, the vehicle 100 uses the detection results of the camera CM as an external sensor to obtain the vehicle position information. In contrast, the vehicle 100 may be equipped with an internal sensor, and the vehicle 100 may use the detection results of the internal sensor to obtain the vehicle position information, determine the target position to which the vehicle 100 should go next, generate a path from the current position of the vehicle 100 indicated by the obtained vehicle position information to the target position, generate a travel control signal for traveling on the generated path, and use the generated travel control signal to control the drive device 120, the steering device 130, and the brake device 140. In this case, the vehicle 100 can travel without using the detection results of the external sensor at all. In addition, the vehicle 100 may also obtain the target arrival time and congestion information from the outside of the vehicle 100, so that the target arrival time and congestion information are reflected in at least one of the path and the travel control signal.
[0095] (C12) In the first embodiment described above, the remote control device 200 automatically generates a driving control signal to be sent to the vehicle 100. In contrast, the remote control device 200 may generate a driving control signal to be sent to the vehicle 100 in accordance with an operation of an external operator located outside the vehicle 100. For example, an external operator may operate an operating device including a display for displaying a captured image output from a camera CM as an external sensor, a steering wheel for remotely operating the vehicle 100, an accelerator pedal, a brake pedal, and a communication device for communicating with the remote control device 200 through wired communication or wireless communication, and the remote control device 200 may generate a driving control signal corresponding to the operation applied to the operating device. In this embodiment, the captured image of the target vehicle 100 may be displayed on the display of the operating device, and confirmation of whether the target vehicle 100 in the confirmation process has executed the confirmation action may be performed by visual confirmation by the operator.
[0096] (C13) In each of the above embodiments, the vehicle 100 only needs to have a structure that can be moved by unmanned driving, for example, it can also be a platform having the structure described below. Specifically, in order to exert the three functions of "driving", "turning" and "stopping" by unmanned driving, the vehicle 100 only needs to have at least a vehicle control device 110, a drive device 120, a steering device 130 and a brake device 140. In the case where the vehicle 100 obtains information from the outside for unmanned driving, the vehicle 100 can also have a communication device 150. That is, the vehicle 100 that can be moved by unmanned driving may not be equipped with at least a part of the interior parts such as the driver's seat and the instrument panel, may not be equipped with at least a part of the exterior parts such as the bumper and the fender, and may not be equipped with a body shell. In this case, the remaining parts such as the body shell can be installed on the vehicle 100 before the vehicle 100 is shipped from the factory KJ, or the remaining parts such as the body shell can be installed on the vehicle 100 after the vehicle 100 is shipped from the factory KJ in a state where the remaining parts such as the body shell are not installed on the vehicle 100. Each component can be installed from any direction such as the upper side, lower side, front side, rear side, right side or left side of the vehicle 100, can be installed from the same direction, or can be installed from different directions. In addition, the platform can also be positioned in the same manner as the vehicle 100 in the first embodiment.
[0097] (C14) The vehicle 100 can also be manufactured by combining a plurality of modules. A module refers to a unit composed of a plurality of components assembled according to the location or function of the vehicle 100. For example, the platform of the vehicle 100 can be manufactured by combining a front module constituting the front part of the platform, a central module constituting the central part of the platform, and a rear module constituting the rear part of the platform. In addition, the number of modules constituting the platform is not limited to three, and may be two or less or four or more. In addition, in addition to or instead of the components constituting the platform, the components constituting the parts of the vehicle 100 that are different from the platform may also be modularized. In addition, the various modules may also include any exterior components such as bumpers and grilles, and any interior components such as seats and consoles. In addition, not limited to the vehicle 100, any type of mobile body may also be manufactured by combining a plurality of modules. Such a module may be manufactured, for example, by joining a plurality of components by welding or fixings, or by molding at least a portion of the components constituting the module as one component by casting. The molding method of molding a component, especially a relatively large component, as a whole is also called integrated die casting or large integrated die casting. For example, the front module, the central module, and the rear module mentioned above may also be manufactured by integrated die casting.
[0098] (C15) The transportation of the vehicle 100 by the driving of the unmanned vehicle 100 is also referred to as "automatic driving and transportation". In addition, the structure for realizing automatic driving and transportation is also referred to as "vehicle remote control autonomous driving and transportation system". In addition, the production method of producing the vehicle 100 by autonomous transportation is also referred to as "self-production". In self-production, for example, in the factory KJ that manufactures the vehicle 100, at least a part of the transportation of the vehicle 100 is realized by autonomous transportation.
[0099] (C16) In the above-mentioned embodiments, part or all of the functions and processes implemented by software may be implemented by hardware. In addition, part or all of the functions and processes implemented by hardware may be implemented by software. As hardware for implementing the various functions in the above-mentioned embodiments, various circuits such as integrated circuits or discrete circuits may be used.
[0100] The present disclosure is not limited to the above-mentioned embodiments, and can be implemented in various structures without departing from its main purpose. For example, the technical features in the embodiments corresponding to the technical features in each mode recorded in the invention content can be appropriately replaced or combined in order to solve part or all of the above-mentioned problems, or to achieve part or all of the above-mentioned effects. In addition, if the technical features are not described as necessary features in this specification, they can be appropriately deleted.
[0101] Description of Reference Numerals
[0102] 10… unmanned driving system, 100… vehicle, 110… vehicle control device, 111… processor, 112… memory, 113… input / output interface, 114… internal bus, 115… vehicle control unit, 120… drive device, 130… steering device, 140… brake device, 150… communication device, 160… horn, 170… headlight, 180… wiper, 191… process information acquisition unit, 192… determination unit, 193… action Information acquisition unit, 194...judgment unit, 200...remote control device, 201...processor, 202...memory, 203...input and output interface, 204...internal bus, 205...communication device, 210...remote control unit, 220...process information acquisition unit, 230...determination unit, 240...action information acquisition unit, 250...judgment unit, 260...determination unit, 300...external sensor group, 400...reporting device, 500...process management device.
Claims
1. A control device comprising: a determination unit that determines an action to be performed by a mobile body that can be operated by unmanned driving; A control unit that causes a controlled moving object to perform the action, wherein the controlled moving object is a moving object that is being moved by the unmanned driving; a motion information acquisition unit that acquires motion information related to the motion observed from outside the moving body; and a determination unit, using the action information to determine whether the controlled moving body has performed the action, The control unit performs at least one of reporting occurrence of an abnormality, stopping the controlled moving body, and changing a moving speed of the controlled moving body when the determination unit determines that the controlled moving body has not performed the action.
2. The control device according to claim 1, wherein: The controlled moving object is a part of a plurality of moving objects that can be operated by the unmanned driving. The control device further includes a specifying unit configured to specify the controlled moving object from among the plurality of moving objects using the motion information when the determining unit determines that the controlled moving object has not performed the motion.
3. The control device according to claim 1, wherein: The controlled moving object is a part of a plurality of moving objects that can be operated by the unmanned driving. When the determination unit determines that the controlled moving body has not performed the action, the control unit moves the controlled moving body to a predetermined retreat location.
4. The control device according to claim 1, wherein: The control device further includes a process information acquisition unit for acquiring process information, wherein the process information is information indicating the progress of a manufacturing process of the movable body. The determination unit determines the operation based on the progress indicated by the process information.
5. A control method, Determine the action to be performed by the mobile body capable of being operated unmanned, causing a controlled moving object to perform the action, wherein the controlled moving object is a moving object that is being moved by the unmanned driving, obtaining motion information related to the motion observed from outside the moving body, Using the action information to determine whether the controlled moving object has performed the action, When it is determined that the controlled moving body has not performed the action, at least one of a process of reporting the occurrence of an abnormality, a process of stopping the controlled moving body, and a process of changing the moving speed of the controlled moving body is performed.
