Control device, moving body, and control method

By installing a detector on the unmanned mobile body, detecting external marks and determining control actions, the problem of control judgment errors caused by the same action being performed at the same time by the vehicle and the non-object vehicle, precise control of the intended object is achieved and control is improved Accuracy and security.

CN119065363APending Publication Date: 2024-12-03TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410645266.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-01-17
Filing Date
2024-05-23
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the prior art, when the vehicle and the non-object vehicle perform the same action simultaneously, it may lead to an error in determining the control of the intended object.

Method used

By installing a detector on the unmanned mobile body, detecting external marks, and determining whether to perform control actions based on the detection results, it is ensured that only the intent objects are controlled. The system includes a detector, a decision unit and a control unit. Through unmanned driving, the moving body performs corresponding processing when a mark is detected to avoid unintentional movement.

Benefits of technology

It effectively suppresses errors in the control judgment of non-intention objects, ensures that the mobile object is controlled only under the intention objects, and improves control accuracy and security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065363A_ABST
    Figure CN119065363A_ABST
Patent Text Reader

Abstract

The purpose of the present invention is to suppress continuation of remote control on unintended objects. The control device includes: an acquisition unit that acquires a detection result of a detector mounted on a moving body that can be moved by unmanned driving; a determination unit that determines a mark that is to be detected by the detector and that is located outside the moving body; and a control unit that moves the moving body by unmanned driving, and that differs processing relating to the movement of the moving body when the mark determined by the determination unit is included in the detection result and when the mark is not included in the detection result.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a control device, a moving object, and a control method. Background Art

[0002] A technique is known in which a command for operating the wipers of a vehicle by remote control is sent, and whether the wipers of the vehicle operate in response to the command is observed to thereby confirm whether the intended vehicle is being controlled (eg, Patent Document 1). Prior art literature Patent Literature

[0003] Patent Document 1: U.S. Patent No. 10532771 Summary of the invention Problems to be solved by the invention

[0004] In the above-described technique, when the target vehicle and the non-target vehicle perform the same action at the same time, there is a possibility that an error will occur in the determination of whether the intended target is being controlled. Means for solving problems

[0005] The present disclosure can be implemented as the following aspects.

[0006] (1) According to a first aspect of the present disclosure, a control device is provided. The control device includes: an acquisition unit that acquires a detection result of a detector mounted on a mobile body that can be moved by unmanned driving; a determination unit that determines a mark that is located outside the mobile body and should be detected by the detector; and a control unit that moves the mobile body by unmanned driving, and performs different processing related to the movement of the mobile body when the mark determined by the determination unit is included in the detection result and when the mark is not included. According to the control device of this aspect, it is possible to suppress the occurrence of errors in the determination of whether or not the intended object is being controlled. (2) In the control device of the above-mentioned method, it may be that, when the mark determined by the determination unit is not included in the detection result, the control unit performs at least one of a process of notifying that an abnormality has occurred, a process of changing the speed of the moving body, and a process of stopping unmanned driving of the moving body. According to the control device of this aspect, it is possible to suppress unintended movement of the mobile object. (3) In the control device of the above aspect, the detector may be a camera, and the mark may be a two-dimensional code. According to the control device of this aspect, it is possible to determine whether the intended object is being controlled using the detection result of the two-dimensional code by the camera. (4) In the control device of the above aspect, the determination unit may determine the marker to be detected by the detector using position information used as information indicating the position of the moving body and position information indicating the position of the marker. According to the control device of this aspect, the mark detected by the detector can be estimated with high accuracy. (5) In the control device of the above aspect, the mark may be a projection image projected by a projection device located outside the movable body, and the control device may further include a projection control unit that controls the projection device. According to the control device of this aspect, the projection image projected by the projection device can be used as a marker. (6) In the control device of the above-mentioned method, the determination unit may determine the mark to be detected by the detector and the orientation of the mark to be detected by the detector relative to the moving body. When the mark determined by the determination unit is included in the detection result, the control unit performs different processing related to the movement of the moving body depending on whether the mark included in the detection result is located at the orientation determined by the determination unit. According to the control device of this aspect, it is possible to determine with higher accuracy whether or not the intended object is being controlled. (7) According to a second aspect of the present disclosure, there is provided a mobile body capable of moving by unmanned driving. The mobile body comprises: a detector for detecting a mark located outside the mobile body; an acquisition unit for acquiring information of the mark that should be detected by the detector, which is determined by a remote control device that controls the mobile body from the outside of the mobile body; and a control unit for moving the mobile body according to a command sent from the remote control device, and performing different processing related to the movement of the mobile body when the mark that should be detected by the detector is included in the detection result of the detector and when it is not included. According to the moving object of this aspect, it is possible to suppress the occurrence of errors in the determination of whether or not the intended object is being controlled. (8) According to a third aspect of the present disclosure, there is provided a mobile body capable of moving by unmanned driving. The mobile body comprises: a detector for detecting a mark located outside the mobile body; a determination unit for determining the mark to be detected by the detector; and a control unit for moving the mobile body by unmanned driving, and for making different processing related to the movement of the mobile body when the mark determined by the determination unit is included in the detection result of the detector and when the mark is not included. According to the moving object of this aspect, it is possible to suppress the occurrence of errors in the determination of whether or not the intended object is being controlled. (9) According to a fourth aspect of the present disclosure, a control method is provided. In the control method, a detection result of a detector mounted on a mobile body capable of moving unmanned is obtained, a mark located outside the mobile body and to be detected by the detector is determined, and processing related to the movement of the mobile body is different when the determined mark is included in the detection result and when the determined mark is not included. According to the control method of this aspect, it is possible to suppress the occurrence of errors in the determination of whether or not the intended object is being controlled. The present disclosure can also be implemented in various forms other than the control device, the mobile body, and the control method. For example, it can be implemented in the form of an unmanned driving system, a computer program, and a recording medium recording the computer program. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 It is an explanatory diagram showing the configuration of the unmanned driving system according to the first embodiment. Figure 2 It is an explanatory diagram showing the structure of the vehicle according to the first embodiment. Figure 3A It is an explanatory diagram showing a situation in which a vehicle moves by remote control in a factory. Figure 3B This is a flowchart showing the processing procedure of the travel control of the vehicle according to the first embodiment. Figure 4 This is a flowchart showing the contents of the confirmation process according to the first embodiment. Figure 5 This is a flowchart showing the content of the detection process according to the first embodiment. Figure 6 It is an explanatory diagram showing a situation in which a remote control target is confirmed. Figure 7 It is an explanatory diagram showing the configuration of an unmanned driving system according to a second embodiment. Figure 8 It is an explanatory diagram showing the configuration of an unmanned driving system according to a third embodiment. Fig. 9 It is an explanatory diagram showing the structure of a vehicle according to the third embodiment. Fig.10 This is a flowchart showing the contents of the confirmation process according to the third embodiment. Fig.11 It is a flowchart showing the content of the detection process of the third embodiment. Fig.12 It is an explanatory diagram showing the configuration of an unmanned driving system according to a fourth embodiment. Fig.13 It is an explanatory diagram showing the structure of a vehicle according to a fourth embodiment. Fig.14 This is a flowchart showing a processing procedure of driving control of a vehicle according to the fourth embodiment. Fig.15 This is a flowchart showing the contents of the confirmation process according to the fourth embodiment. DETAILED DESCRIPTION

[0008] A. First Implementation Method: Figure 1 It is an explanatory diagram showing the configuration of the unmanned driving system 10 in the first embodiment. Figure 2 1 is an explanatory diagram showing the configuration of a vehicle 100 in the first embodiment. The unmanned driving system 10 is used to move a mobile body by unmanned driving. In the present embodiment, the unmanned driving system 10 is used to move a mobile body by unmanned driving in a factory that manufactures mobile bodies. In addition, the unmanned driving system 10 may also be used to move a mobile body by unmanned driving in, for example, commercial facilities, universities, parks, etc., instead of in a factory that manufactures mobile bodies.

[0009] In the present disclosure, "mobile body" means an object that can move, such as a vehicle, an electric vertical take-off and landing aircraft (so-called flying car). A vehicle may be a vehicle that runs on wheels or a vehicle that runs on tracks, such as a passenger car, a truck, a bus, a two-wheeled vehicle, a four-wheeled vehicle, a tank, an engineering vehicle, etc. Vehicles include electric vehicles (BEV: Battery Electric Vehicle), gasoline vehicles, hybrid vehicles, and fuel cell vehicles. In the case where the mobile body is other than a vehicle, the expressions "vehicle" and "car" in the present disclosure can be appropriately replaced with "mobile body", and the expression "running" can be appropriately replaced with "moving".

[0010] The vehicle 100 is configured to be able to travel by unmanned driving. "Unmanned driving" means driving that does not rely on the driving operation of the passengers. The driving operation means an operation related to at least one of "driving", "steering" and "stopping" of the vehicle 100. Unmanned driving is achieved by automatic or manual remote control using a device located outside the vehicle 100, or autonomous control of the vehicle 100. In the vehicle 100 that travels by unmanned driving, there may also be passengers who do not perform driving operations. Passengers who do not perform driving operations include, for example, people who only sit on the seats of the vehicle 100, and people who perform operations other than driving operations such as assembly, inspection, and operation of switch groups while riding in the vehicle 100. In addition, driving based on the driving operation of the passengers is sometimes referred to as "manned driving".

[0011] In this specification, “remote control” includes “full remote control” in which all actions of the vehicle 100 are determined completely from outside the vehicle 100, and “partial remote control” in which part of the actions of the vehicle 100 are determined from outside the vehicle 100. In addition, “autonomous control” includes “full autonomous control” in which the vehicle 100 autonomously controls its own actions without receiving any information from a device outside the vehicle 100, and “partial autonomous control” in which the vehicle 100 autonomously controls its own actions using information received from a device outside the vehicle 100.

[0012] like Figure 1 As shown, in this embodiment, the unmanned driving system 10 includes: at least one vehicle 100, a remote control device 200 for remotely controlling the vehicle 100, a notification device 300 for notifying that an abnormality has occurred in the factory, a process management device 400 for managing the manufacturing process of the vehicle 100 in the factory, and at least one external sensor 500. In addition, the remote control device 200 is sometimes referred to as a control device. In this embodiment, the remote control device 200 is equivalent to the "control device" of the present disclosure.

[0013] like Figure 2 As shown, in the present embodiment, the vehicle 100 is an electric vehicle configured to be movable by remote control. The vehicle 100 includes a vehicle control device 110 for controlling each part of the vehicle 100, a drive device 120 for accelerating the vehicle 100, a steering device 130 for changing the traveling direction of the vehicle 100, a braking device 140 for decelerating the vehicle 100, a communication device 150 for communicating with the remote control device 200 by wireless communication, and a camera 160 for detecting a mark LM located outside the vehicle 100. The drive device 120 includes a battery, a motor driven by the power of the battery, and a drive wheel rotated by the motor. In addition, the camera 160 is sometimes referred to as a detector.

[0014] The vehicle control device 110 is composed of a computer including a processor 111, a memory 112, an input / output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input / output interface 113 are connected to each other via the internal bus 114 so as to enable bidirectional communication. The input / output interface 113 is connected to a drive device 120, a steering device 130, a brake device 140, a communication device 150, and a camera 160. The memory 112 stores a computer program PG1.

[0015] The processor 111 functions as a vehicle control unit 115 and a camera control unit 116 by executing the computer program PG1. The vehicle control unit 115 controls the driving device 120, the steering device 130, and the braking device 140. When a driver is on the vehicle 100, the vehicle control unit 115 can control the driving device 120, the steering device 130, and the braking device 140 according to the driver's operation, thereby driving the vehicle 100. Regardless of whether a driver is on the vehicle 100, the vehicle control unit 115 can control the driving device 120, the steering device 130, and the braking device 140 according to the remote control command supplied from the remote control device 200, thereby driving the vehicle 100. The camera control unit 116 controls the camera 160. The camera control unit 116 performs detection of the marker LM by the camera 160 and sends the detection result of the marker LM to the remote control device 200.

[0016] like Figure 1 As shown, the remote control device 200 is composed of a computer including a processor 201, a memory 202, an input / output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input / output interface 203 are connected via the internal bus 204 so as to be able to communicate bidirectionally. The input / output interface 203 is connected to a communication device 205 for communicating with the vehicle 100 by wireless communication. In the present embodiment, the communication device 205 can also communicate with the notification device 300, the process management device 400, and the external sensor 500 by wired communication or wireless communication. The computer program PG2 and the database DB are stored in the memory 202.

[0017] The database DB records information related to the mark LM in the factory. In the present embodiment, the mark LM is a two-dimensional code attached to the equipment in the factory. More specifically, the mark LM is a QR code (registered trademark) attached to the equipment in the factory. The database DB records the location information of the two-dimensional code and the content of the two-dimensional code. In addition, the mark LM may be a two-dimensional code other than a QR code, such as DataMatrix, PDF417, or a barcode.

[0018] The processor 201 functions as a remote control unit 210, an acquisition unit 220, a determination unit 230, and a determination unit 240 by executing the computer program PG2. The remote control unit 210 causes the vehicle 100 to travel by remotely controlling the vehicle 100. The remote control unit 210 causes the camera 160 to detect the mark LM and send the detection result of the mark LM by remotely controlling the vehicle 100. The acquisition unit 220 acquires the detection result sent from the vehicle 100. The detection result of the camera 160 may also be an image output from the camera 160. The image may be a still image or a dynamic image. The detection result of the camera 160 may also be the content of a two-dimensional barcode read from the image output from the camera 160. The determination unit 230 determines the mark LM that should be detected by the camera 160. The determination unit 240 determines whether the mark LM that should be detected by the camera 160 is included in the detection result of the camera 160. When the detection result of the camera 160 is an image, the determination unit 240 determines whether the mark LM to be detected is included in the detection result by analyzing the image. When the detection result of the camera 160 is the content of the two-dimensional barcode, the determination unit 240 determines whether the mark LM to be detected is included in the detection result by comparing the content of the two-dimensional barcode to be detected with the detection result. In addition, the remote control unit 210 is sometimes referred to as a control unit.

[0019] The notification device 300 is a device for notifying the manager of the unmanned driving system 10 and the factory workers that an abnormality has occurred in the factory. In the following description, the manager of the unmanned driving system 10 and the factory workers are referred to as managers, etc. The notification device 300 is, for example, a warning buzzer installed in the factory or a warning light installed in the factory. The notification device 300 can also be a tablet terminal carried by the manager, etc. The notification device 300 has a communication device not shown in the figure, and can communicate with the remote control device 200 through wired communication or wireless communication.

[0020] The process management device 400 is a device for managing the manufacturing process of the vehicle 100 in the factory. The process management device 400 is composed of a computer. The process management device 400 is equipped with a communication device (not shown) and can communicate with the remote control device 200 and various devices in the factory through wired communication or wireless communication. The process management device 400 manages, for example, information indicating when, where, and who is scheduled to perform what operation on which vehicle 100, and information indicating when, where, and who has performed what operation on which vehicle 100.

[0021] The external sensor 500 is a sensor disposed outside the vehicle 100. The external sensor 500 is used to detect the position and orientation of the vehicle 100. In the present embodiment, the external sensor 500 is a camera installed in a factory. The external sensor 500 is provided with a communication device (not shown) and communicates with the remote control device 200 through wired communication or wireless communication.

[0022] Figure 3A 1 is an explanatory diagram showing a situation in which the vehicle 100 moves by remote control in the factory KJ. Figure 3A , five vehicles 100A to 100E are shown. In the following description, when the five vehicles 100A to 100E are described without being particularly distinguished, they are simply referred to as vehicles 100. In the present embodiment, the factory KJ includes a first place PL1 for assembling the vehicle 100, a second place PL2 for inspecting the vehicle 100, and a third place PL3 for storing the vehicles 100 that have passed the inspection. The first place PL1, the second place PL2, and the third place PL3 are connected by a travel road SR on which the vehicle 100 can travel.

[0023] A marker LM1 is provided at the first location PL1, and a marker LM2 is provided at the second location PL2. As described above, in the present embodiment, each of the markers LM1 and LM2 is a two-dimensional code. The content of the two-dimensional code of the marker LM1 and the content of the two-dimensional code of the marker LM2 are different from each other. In the following description, when the marker LM1 and the marker LM2 are described without being particularly distinguished, they are simply referred to as the marker LM.

[0024] The vehicle 100 assembled at the first location PL1 is equipped with a vehicle control device 110, a drive device 120, a steering device 130, a brake device 140, a communication device 150, and a camera 160. The vehicle 100 assembled at the first location PL1 is remotely controlled by the remote control device 200 and travels from the first location PL1 to the second location PL2. The vehicle 100 that has passed the inspection at the second location PL2 is remotely controlled by the remote control device 200 and travels from the second location PL2 to the third location PL3. Thereafter, the vehicle 100 is shipped from the factory KJ.

[0025] The method of moving the vehicle 100 by the remote control unit 210 through remote control is described. The remote control unit 210 determines a target route for the vehicle 100 to travel to the destination through the travel road SR. The target route referred to here refers to the reference path RR described later. A plurality of external sensors 500 are arranged around the travel road SR. In the present embodiment, the external sensor 500 is a camera. The remote control unit 210 can obtain the relative position and orientation of the vehicle 100 relative to the target route in real time by analyzing the image captured by the camera as the external sensor 500. Any position in the factory KJ can be represented by the X, Y, and Z coordinates of the global coordinate system GC. The position of each external sensor 500 is fixed, the relative relationship between the global coordinate system GC and the device coordinate system of each external sensor 500 is known, and the coordinate transformation array for mutually transforming the coordinates of the global coordinate system GC and the coordinates of the device coordinate system of each external sensor 500 is also known. The remote control unit 210 generates a remote control command for causing the vehicle 100 to travel along the target route and sends the remote control command to the vehicle 100. The remote control command mentioned here refers to the driving control signal described later. The vehicle control device 110 mounted on the vehicle 100 controls the driving device 120, the steering device 130, and the braking device 140 according to the received remote control command, thereby driving the vehicle 100. Therefore, the vehicle 100 can be moved without using a conveying device such as a crane or a conveyor. The remote control command shows, for example, a target value of the acceleration of the vehicle 100 and a target value of the steering angle. In addition, the remote control command can also show the target route of the vehicle 100. In this case, the vehicle control unit 115 can also determine the target value of the acceleration of the vehicle 100 and the target value of the steering angle according to the target route. The remote control unit 210 can remotely control multiple vehicles 100A~100E. Specifically, the remote control unit 210 generates remote control commands for remotely controlling multiple vehicles 100A~100E respectively. The remote control unit 210 transmits remote control commands corresponding to the plurality of vehicles 100A to 100E respectively via the input / output interface 203 and the communication device 205. The remote control unit 210 can remotely control the plurality of vehicles 100A to 100E one by one or simultaneously in parallel.

[0026] Figure 3B1 is a flowchart showing the processing sequence of the driving control of the vehicle 100 in the first embodiment. In step S1 to step S4, the processor 201 of the remote control device 200 is repeatedly executed, and in step S5 to step S6, the processor 111 of the vehicle control device 110 is repeatedly executed. In step S1, the remote control device 200 uses the detection result output from the external sensor 500 to obtain the vehicle position information. The vehicle position information is the position information that becomes the basis for generating the driving control signal. In this embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the reference coordinate system of the factory KJ. In this embodiment, the reference coordinate system of the factory KJ is the global coordinate system GC, and any position in the factory KJ is expressed by the coordinates of X, Y, and Z in the global coordinate system GC. In this embodiment, the external sensor 500 is a camera, and the captured image is output from the external sensor 500 as the detection result. That is, in step S1, the remote control device 200 uses the captured image obtained from the camera as the external sensor 500 to obtain the vehicle position information.

[0027] Specifically, in step S1, the remote control device 200 detects the shape of the vehicle 100 from the captured image, calculates the coordinates of the positioning point of the vehicle 100 in the camera's coordinate system, that is, the local coordinate system, and transforms the calculated coordinates into coordinates in the global coordinate system GC, thereby obtaining the position of the vehicle 100. The shape of the vehicle 100 contained in the captured image can be detected by, for example, inputting the captured image into a detection model DM using artificial intelligence. The detection model DM is prepared, for example, inside or outside the unmanned driving system 10 and is pre-stored in the memory 202 of the remote control device 200. As the detection model DM, for example, a machine learning model that has been learned in a manner that realizes either semantic segmentation or instance segmentation can be cited. As the machine learning model, for example, a convolutional neural network (hereinafter referred to as CNN) that has been learned by supervised learning using a learning data set can be used. The learning data set, for example, has a plurality of training images containing the vehicle 100, and labels indicating whether each region in the training image is a region representing the vehicle 100 or a region other than the vehicle 100. When learning CNN, it is preferred to update the parameters of CNN by back propagation (error back propagation method) to reduce the error between the output result of the detection model DM and the label. In addition, the remote control device 200 estimates the direction of the movement vector of the vehicle 100 calculated from the position change of the feature point of the vehicle 100 between the frames of the captured image, for example, using the optical flow method, so that the orientation of the vehicle 100 can be obtained.

[0028] In step S2, the remote control device 200 determines the target position to which the vehicle 100 should go next. In the present embodiment, the target position is represented by the coordinates of X, Y, and Z in the global coordinate system GC. In the memory 202 of the remote control device 200, a reference path RR is pre-stored as the path on which the vehicle 100 should travel. The path is represented by a node showing a departure point, a node showing a passing point, a node showing a destination, and a link connecting each node. The remote control device 200 uses the vehicle position information and the reference path RR to determine the target position to which the vehicle 100 should go next. The remote control device 200 determines the target position on the reference path RR that is further ahead than the current position of the vehicle 100.

[0029] In step S3, the remote control device 200 generates a travel control signal for causing the vehicle 100 to travel toward the determined target position. In the present embodiment, the travel control signal includes the acceleration and steering angle of the vehicle 100 as parameters. The remote control device 200 calculates the travel speed of the vehicle 100 according to the change in the position of the vehicle 100, and compares the calculated travel speed with the target speed. In general, the remote control device 200 determines the acceleration in a manner to accelerate the vehicle 100 when the travel speed is lower than the target speed, and determines the acceleration in a manner to decelerate the vehicle 100 when the travel speed is higher than the target speed. In addition, when the vehicle 100 is located on the reference path RR, the remote control device 200 determines the steering angle and acceleration in a manner to prevent the vehicle 100 from deviating from the reference path RR, and when the vehicle 100 is not located on the reference path RR, in other words, when the vehicle 100 deviates from the reference path RR, determines the steering angle and acceleration in a manner to return the vehicle 100 to the reference path RR.

[0030] In step S4, the remote control device 200 transmits the generated travel control signal to the vehicle 100. The remote control device 200 repeatedly acquires the position of the vehicle 100, determines the target position, generates the travel control signal, transmits the travel control signal, etc. at a predetermined cycle.

[0031] In step S5, the vehicle control device 110 receives the travel control signal transmitted from the remote control device 200. In step S6, the vehicle control device 110 uses the received travel control signal to control the drive device 120, the steering device 130, and the brake device 140, so that the vehicle 100 travels at the acceleration and steering angle indicated by the travel control signal. The vehicle control device 110 repeatedly receives the travel control signal and controls the various devices 120 to 140 at a predetermined cycle.

[0032] Figure 42 is a flowchart showing the content of the confirmation process executed in the remote control device 200 . Figure 5 is a flowchart showing the contents of the detection process executed in the vehicle 100. Figure 4 and Figure 5 , a control method of the vehicle 100 executed in the unmanned driving system 10 is described.

[0033] Figure 4 The confirmation process shown is repeatedly executed in the remote control device 200. When the confirmation process starts, in step S110, the remote control unit 210 determines whether there is a vehicle 100 scheduled to start movement based on remote control. In the following description, the vehicle 100 scheduled to start movement based on remote control is referred to as the target vehicle 100. In the present embodiment, the target vehicle 100 is arranged at a starting point set at the first place PL1 of the factory KJ or at a starting point set at the second place PL2 of the factory KJ in a predetermined position and orientation. When the remote control unit 210 receives information indicating that the vehicle 100 is located at the starting point set at the first place PL1 or information indicating that the vehicle 100 is located at the starting point set at the second place PL2 from the process management device 400, it determines that the target vehicle 100 exists. When it is determined in step S110 that there is no target vehicle 100, the remote control unit 210 skips the processing after step S110 and ends the confirmation process.

[0034] When it is determined in step S110 that the target vehicle 100 exists, the remote control unit 210 transmits a remote control command for causing the target vehicle 100 to detect the marker LM using the camera 160 in step S120. In the following description, the remote control command for causing the marker LM to be detected is referred to as a detection command.

[0035] In step S130, the decision unit 230 decides the mark LM to be detected by the camera 160 of the target vehicle 100. In the present embodiment, the position information of the start point of each place PL1, PL2, the position information of the mark LM set at each place PL1, PL2, and the content of the mark LM set at each place PL1, PL2 are recorded in the database DB stored in the memory 202. The decision unit 230 uses the database DB to decide the mark LM to be detected by the camera 160 of the target vehicle 100. In addition, the process of step S130 may be performed before step S120 or after step S140.

[0036] In step S140, the acquisition unit 220 acquires the detection result of the camera 160 from the target vehicle 100. In step S150, the determination unit 240 determines whether the marker LM to be detected determined by the determination unit 230 is included in the detection result. The determination unit 240 may determine whether the marker LM to be detected is included in the detection result using the database DB.

[0037] When it is determined in step S150 that the mark LM to be detected is included in the detection result, the remote control unit 210 starts the movement of the target vehicle 100 by remote control in step S160. Thereafter, the remote control device 200 ends the confirmation process.

[0038] If it is determined in step S150 that the mark LM that should be detected is not included in the detection result, the remote control unit 210 stops the movement of the target vehicle 100 by remote control in step S165. In step S168, the remote control unit 210 notifies that an abnormality has occurred using the notification device 300. Thereafter, the remote control device 200 ends the confirmation process.

[0039] Figure 5 The detection process shown is repeatedly executed by the camera control unit 116 of the target vehicle 100. When the detection process starts, in step S210, the camera control unit 116 determines whether a detection command is received from the remote control device 200. If it is determined in step S210 that a detection command is not received from the remote control device 200, the camera control unit 116 skips the process after step S210 and ends the detection process.

[0040] If it is determined in step S210 that the detection command has been received from the remote control device 200, the camera control section 116 detects the marker LM with the camera 160 in step S220. In step S230, the camera control section 116 transmits the detection result of the camera 160 to the remote control device 200. Thereafter, the camera control section 116 ends the detection process.

[0041] Figure 6: is an explanatory diagram showing a situation of confirming whether or not the intended object is being remotely controlled. When the remote control device 200 intends to move the vehicle 100A located at the first place PL1 by remote control, a detection instruction SS is sent from the remote control device 200 to the vehicle 100A during the confirmation process. Since the vehicle 100A is recognized to be located at the first place PL1, the remote control device 200 determines that the mark LM1 set at the first place PL1 should be detected in the detection result RT returned from the destination of the detection instruction SS. Through the detection process in the vehicle 100A which is the destination of the detection instruction SS, the detection result RT indicating that the mark LM1 is detected is sent from the vehicle 100A to the remote control device 200. Therefore, when the intended object is remotely controlled, the mark LM1 that should be detected is included in the detection result RT.

[0042] On the other hand, when the remote control device 200 intends to move the vehicle 100A located at the first place PL1 by remote control, but the remote control device 200 mistakenly remotely controls the vehicle 100B located at the second place PL2, the detection command SS is transmitted to the vehicle 100B instead of the vehicle 100A in the confirmation process. In this case, through the detection process in the vehicle 100B which is the transmission destination of the detection command SS, the detection result RT indicating that the mark LM2 is detected is transmitted from the vehicle 100B to the remote control device 200. When the remote control device 200 intends to move the vehicle 100A located at the first place PL1 by remote control, but the remote control device 200 mistakenly remotely controls the vehicle 100B located at the second place PL2, the detection command SS is transmitted to the vehicle 100C instead of the vehicle 100A in the confirmation process. In this case, the detection result RT indicating that the marker LM is not detected is transmitted from the vehicle 100C to the remote control device 200 through the detection processing in the vehicle 100C as the transmission destination of the detection command SS. Therefore, when the unintended object is remotely controlled, the marker LM1 that should be detected is not included in the detection result RT.

[0043] According to the unmanned driving system 10 in the present embodiment described above, the remote control device 200 starts the movement of the target vehicle 100 by remote control when it is determined that the mark LM to be detected is included in the detection result RT, and stops the movement of the target vehicle 100 by remote control when it is determined that the mark LM to be detected is not included in the detection result RT. That is, the remote control device 200 starts the movement of the target vehicle 100 by remote control after confirming whether the intended vehicle 100 is being remotely controlled. Therefore, it is possible to suppress the movement of an unintended vehicle 100 by remote control.

[0044] In this embodiment, when the remote control device 200 determines that the marker LM to be detected is not included in the detection result RT, it notifies the administrator of the occurrence of abnormality using the notification device 300. Therefore, the administrator can recognize the occurrence of abnormality in advance and take countermeasures.

[0045] In addition, when the remote control device 200 remotely controls a plurality of vehicles 100, a control instruction may be sent from the communication device 205 to a vehicle 100 that does not correspond to the control instruction. Here, the control instruction is sent from the communication device 205 to a vehicle 100 that does not correspond to the control instruction, which means that the control instruction generated for remotely controlling one of the plurality of vehicles 100 is sent from the communication device 205 to other vehicles 100 except the one vehicle 100. Such a phenomenon is sometimes referred to as a mistake in the vehicle 100 that is the object of remote control. When the remote control device 200 remotely controls a plurality of vehicles 100, a mistake in the vehicle 100 that is the object of remote control may occur due to a malfunction of the unmanned driving system 10, human error by a factory operator, or the like. For example, in a case such as Figure 3A As shown, when the remote control device 200 remotely controls five vehicles 100A to 100E in the order of vehicle 100E, vehicle 100D, vehicle 100C, vehicle 100B, and vehicle 100A, a control command may be sent from the communication device 205 to a vehicle 100 that does not correspond to the control command. Specifically, when the communication device 150 removed from the vehicle 100C is supposed to be mounted on the vehicle 100B after the remote control of the vehicle 100C by the remote control device 200 ends, but the communication device 150 removed from the vehicle 100C is mistakenly mounted on the vehicle 100A, the control command generated for remotely controlling the vehicle 100B is sent to the vehicle 100A. Even in such a case, in the present embodiment, by determining whether the mark LM that should be detected by the camera 160 mounted on the vehicle 100B is detected, it is possible to detect that the control command is sent from the communication device 205 to the vehicle 100 that does not correspond to the control command. Therefore, the communication device 150 erroneously mounted on the vehicle 100A can be removed from the vehicle 100A and mounted on the vehicle 100B, making it possible to start the remote control of the vehicle 100B.

[0046] B. Second Implementation Method: Figure 71 is an explanatory diagram showing the structure of the unmanned driving system 10b in the second embodiment. The unmanned driving system 10b in the second embodiment is different from the first embodiment in that it has a projection device 600 for projecting an image of a two-dimensional code used as a marker LM. As for other structures, unless otherwise specified, they are the same as the first embodiment. In addition, in this embodiment, the remote control device 200 is equivalent to the "control device" of the present disclosure.

[0047] The projection device 600 is fixed to, for example, a wall or ceiling of the factory KJ, and projects an image of a two-dimensional code on the wall or floor of the factory KJ. In the present embodiment, the projection device 600 is installed at the first place PL1 and the second place PL2. The projection device 600 installed at the first place PL1 projects an image of a two-dimensional code used as a mark LM1, and the projection device 600 installed at the second place PL2 projects an image of a two-dimensional code used as a mark LM2. In addition, the image projected by the projection device 600 is sometimes referred to as a projection image.

[0048] In the present embodiment, the processor 201 of the remote control device 200 functions as the remote control unit 210, the acquisition unit 220, the determination unit 230, and the determination unit 240 by executing the computer program PG2 pre-stored in the memory 202, and also functions as the projection control unit 250. The projection control unit 250 controls the projection device 600. During the execution of the detection process in the target vehicle 100, the projection control unit 250 causes the projection device 600 to project the image of the two-dimensional code.

[0049] According to the unmanned driving system 10b in the present embodiment described above, even if the two-dimensional code as the mark LM is not attached to the wall surface or floor surface of the factory KJ, the two-dimensional code as the mark LM can be displayed on the wall surface or floor surface of the factory KJ. Therefore, the two-dimensional code can be displayed even in a place where it is difficult to attach the two-dimensional code.

[0050] C. Third Implementation Method: Figure 8 It is an explanatory diagram showing the configuration of an unmanned driving system 10c in the third embodiment. Fig. 9 1 is an explanatory diagram showing the structure of the vehicle 100 in the third embodiment. In the unmanned driving system 10c of the third embodiment, the determination of whether the marker LM to be detected is included in the detection result is performed on the vehicle 100, which is different from the first embodiment. As for other structures, unless otherwise specified, they are the same as the first embodiment. In addition, in this embodiment, the remote control device 200 is equivalent to the "control device" of the present disclosure.

[0051] like Figure 8As shown, in this embodiment, the processor 201 of the remote control device 200 functions as the remote control unit 210 and the determination unit 230 by executing the computer program PG2 pre-stored in the memory 202. In this embodiment, the remote control device 200 does not include the acquisition unit 220 and the determination unit 240.

[0052] like Fig. 9 As shown, in this embodiment, the processor 111 of the vehicle control device 110 functions as a vehicle control unit 115 and a camera control unit 116 by executing a computer program PG1 pre-stored in the memory 112, and also functions as an acquisition unit 117 and a determination unit 119. The acquisition unit 117 acquires information related to the marker LM to be detected from the remote control device 200. The determination unit 119 determines whether the marker LM to be detected by the camera 160 is included in the detection result of the camera 160.

[0053] Fig.10 This is a flowchart showing the contents of the confirmation process in the third embodiment. Fig.11 It is a flowchart showing the content of the detection process in the third embodiment. Fig.10 The confirmation process shown is repeatedly executed in the remote control device 200. When the confirmation process starts, in step S310, the remote control unit 210 determines whether there is a vehicle 100 scheduled to start movement by remote control, in other words, whether there is a target vehicle 100. If it is determined in step S310 that there is no target vehicle 100, the remote control unit 210 skips the process after step S310 and ends the confirmation process.

[0054] If it is determined in step S310 that the target vehicle 100 exists, in step S320, the determination unit 230 determines the marker LM to be detected by the camera 160 of the target vehicle 100, similarly to the first embodiment. In step S330, the remote control unit 210 transmits a detection command and information related to the marker LM to be detected to the target vehicle 100. Thereafter, the remote control device 200 ends the confirmation process.

[0055] Fig.11 The detection process shown is repeatedly executed in the vehicle control device 110. When the detection process starts, in step S410, the acquisition unit 117 determines whether a detection command and information related to the marker LM to be detected are received from the remote control device 200. If it is determined in step S410 that a detection command is not received from the remote control device 200, the camera control unit 116 skips the process after step S410 and ends the detection process.

[0056] When it is determined in step S410 that the detection instruction is received from the remote control device 200, the camera control unit 116 executes detection of the marker LM by the camera 160 in step S420. In step S430, the determination unit 119 uses the information on the marker LM to be detected received from the remote control device 200 to determine whether the detection result of the marker LM by the camera 160 includes the marker LM to be detected.

[0057] If it is determined in step S430 that the marker LM that should be detected is included in the detection result, the vehicle control unit 115 starts the movement of the vehicle 100 based on the remote control in step S440. If it is determined in step S430 that the marker LM that should be detected is not included in the detection result, the vehicle control unit 115 terminates the movement of the vehicle 100 based on the remote control in step S445. The vehicle control unit 115 terminates the movement based on the remote control, for example, by cutting off the communication with the remote control device 200. In step S448, the vehicle control unit 115 notifies that an abnormality has occurred using the notification device 300. After step S440 or step S448, the vehicle control device 110 ends the detection process.

[0058] According to the unmanned driving system 10 c in the present embodiment described above, it is possible to confirm whether the remote control device 200 is remotely controlling the intended vehicle 100 , not on the vehicle 100 .

[0059] D. Fourth Implementation Method: Fig.12 1 is an explanatory diagram showing the structure of the unmanned driving system 10d in the fourth embodiment. In the fourth embodiment, the unmanned driving system 10d does not have a remote control device 200, and the vehicle 100 travels by autonomous control rather than remote control, which is different from the first embodiment. As for other structures, unless otherwise specified, they are the same as the first embodiment. In addition, in this embodiment, the vehicle control device 110 is equivalent to the "control device" of the present disclosure.

[0060] In the present embodiment, the vehicle 100 is configured to be able to travel by autonomous control. The vehicle 100 can communicate with the notification device 300 , the process management device 400 , and the external sensor 500 by wireless communication using the communication device 150 .

[0061] The processor 111 of the vehicle control device 110 functions as a vehicle control unit 115 and a camera control unit 116 by executing a computer program PG1 pre-stored in the memory 112, and also functions as an acquisition unit 117, a determination unit 118, and a determination unit 119. The acquisition unit 117 acquires the detection result of the camera 160 on the marker LM. The determination unit 118 determines the marker LM that should be detected by the camera 160. The determination unit 119 determines whether the marker LM that should be detected by the camera 160 is included in the detection result obtained by the acquisition unit 117. In this embodiment, a database DB, a reference path RR, and a detection model DM are pre-stored in the memory 112. In addition, the vehicle control unit 115 is sometimes simply referred to as a control unit.

[0062] Fig.14 1 is a flowchart showing the processing order of the driving control of the vehicle 100 in the present embodiment. In step S11, the vehicle control unit 115 obtains the vehicle position information using the detection result output from the camera as the external sensor 500. In step S21, the vehicle control unit 115 determines the target position to which the vehicle 100 should go next. In step S31, the vehicle control unit 115 generates a driving control signal for driving the vehicle 100 toward the determined target position. In step S41, the vehicle control unit 115 controls various devices including the drive device 120, the steering device 130, and the brake device 140 by using the generated driving control signal, and drives the vehicle 100 according to the parameters represented by the driving control signal. The vehicle control unit 115 repeatedly obtains the vehicle position information, determines the target position, generates the driving control signal, and controls various devices 120 to 140 at a predetermined cycle.

[0063] Fig.15 This is a flowchart showing the contents of the confirmation process in this embodiment. Fig.15 The confirmation process shown is performed by the vehicle control device 110 before the movement of the vehicle 100 based on the autonomous control is started. When the confirmation process is started, in step S510, the vehicle control unit 115 determines whether to start the movement based on the autonomous control. For example, when the vehicle control unit 115 receives information indicating that the vehicle itself is located at the start point of the first place PL1 or the start point of the second place PL2 from the process management device 400, it determines that the movement based on the autonomous control is started. If it is determined in step S510 that the movement based on the autonomous control is not started, the vehicle control unit 115 skips the processing after step S510 and ends the confirmation process.

[0064] When it is determined in step S510 that the movement based on the autonomous control is started, the decision unit 118 decides the mark LM to be detected by the camera 160 of the own vehicle in step S520. In the present embodiment, the position information of the starting point of each place PL1, PL2, the position information of the mark LM set at each place PL1, PL2, and the content of the mark LM set at each place PL1, PL2 are recorded in the database DB stored in the memory 112. The decision unit 118 uses the database DB to decide the mark LM to be detected by the camera 160 of the own vehicle. In addition, the decision unit 118 can also use the position information of the own vehicle obtained by the vehicle control unit 115 using the external sensor 500 and the database DB to decide the mark LM to be detected by the camera 160.

[0065] In step S530, the camera control unit 116 performs detection of the marker LM by the camera 160, and the acquisition unit 117 acquires the detection result of the marker LM by the camera 160. In step S540, the determination unit 119 determines whether the marker LM determined by the determination unit 118, in other words, the marker LM that should be detected, is detected by the camera 160. In a case where it is determined in step S540 that the marker LM that should be detected is detected, the vehicle control unit 115 starts the movement of the vehicle 100 based on autonomous control in step S550. On the other hand, in a case where it is determined in step S540 that the marker LM that should be detected is not detected, the vehicle control unit 115 stops the movement of the vehicle 100 based on autonomous control in step S555. In step S558, the vehicle control unit 115 uses the notification device 300 to notify that an abnormality has occurred. After step S550 or step S558, the vehicle control device 110 ends the confirmation process.

[0066] According to the unmanned driving system 10d in the present embodiment described above, the vehicle 100 can be driven by autonomous control of the vehicle 100 even if the vehicle 100 is not remotely controlled from the outside. In addition, in the present embodiment, the vehicle 100 can confirm whether the position information of the own vehicle obtained from the outside of the own vehicle is correct by confirming whether the marker LM that should be detected by the camera 160 mounted on the own vehicle is detected.

[0067] E. Other implementation methods: (E1) In the unmanned driving systems 10 to 10d of the first to fourth embodiments described above, the confirmation process is performed before the movement of the unmanned driving vehicle 100 begins. In contrast, in other embodiments E1, the confirmation process may be performed during the movement of the unmanned driving vehicle 100. In this case, the termination of the unmanned driving movement may also include stopping the vehicle 100 by braking the vehicle 100 without the driver. In the confirmation process performed during the movement of the unmanned driving vehicle 100, if it is determined that the marker LM that should be detected is not included in the detection result, the unmanned driving movement may not be terminated but the vehicle 100 may be decelerated within the range where the vehicle 100 does not stop, or the upper limit of the moving speed of the vehicle 100 may be reduced instead of decelerating the vehicle 100.

[0068] (E2) In the unmanned driving systems 10 to 10d of the above-mentioned first to fourth embodiments, the vehicle 100 is provided with a camera 160, and the camera 160 is used to detect the marker LM. In contrast, in other embodiments E2, the vehicle 100 may also be provided with a detector such as LiDAR (Light Detection and Ranging) for detecting the shape of the marker LM and the distance to the marker LM. In this case, the marker LM can be identified using the shape of the marker LM and the distance to the marker LM. In addition, the vehicle 100 may also be provided with a detector such as a millimeter wave radar, an ultrasonic sonar, etc. for detecting the distance to the marker LM. In this case, the marker LM can be identified using the distance to the marker LM.

[0069] (E3) In the unmanned driving systems 10 to 10d of the first to fourth embodiments, the determination units 240 and 119 determine whether the marker LM to be detected is included in the detection result during the confirmation process, and the remote control unit 210 or the vehicle control unit 115 makes the content of the subsequent process different according to the determination results of the determination units 240 and 119. In contrast, in another embodiment E3, the determination units 240 and 119 may determine whether the marker LM to be detected is included in the detection result and the marker LM to be detected is detected at the position to be detected, and the remote control unit 210 or the vehicle control unit 115 makes the content of the subsequent process different according to the determination results of the determination units 240 and 119. In this case, it is possible to accurately determine whether the intended vehicle 100 is being controlled.

[0070] (E4) In the unmanned driving systems 10 to 10d of the first to fourth embodiments, the remote control unit 210 and the vehicle control unit 115 use the notification device 300 located outside the vehicle 100 to notify the occurrence of an abnormality. In contrast, in another embodiment E4, the remote control unit 210 may sound the horn of the vehicle 100 through remote control to notify the occurrence of an abnormality, or may flash the headlights of the vehicle 100 through remote control to notify the occurrence of an abnormality. In another embodiment E4, the vehicle control unit 115 may sound the horn of the own vehicle to notify the occurrence of an abnormality, or may flash the headlights of the own vehicle to notify the occurrence of an abnormality.

[0071] (E5) In another embodiment E5, the camera 160 mounted on the vehicle 100 of the fourth embodiment may detect the mark LM projected by the projection device 600. In this case, the vehicle control device 110 may be provided with a projection control unit that controls the projection device 600 by wireless communication.

[0072] (E6) In the first to fourth embodiments described above, the external sensor 500 is a camera. In contrast, in another embodiment E6, the external sensor 500 may not be a camera, and may be, for example, LiDAR (Light Detection And Ranging). In this case, the detection result output from the external sensor 500 may be three-dimensional point cloud data representing the vehicle 100. In this case, the remote control device 200 or the vehicle control device 110 may also obtain the vehicle position information by template matching using the three-dimensional point cloud data as the detection result and the reference point cloud data prepared in advance.

[0073] (E7) In the first to third embodiments described above, the remote control device 200 performs the processing from the acquisition of the vehicle position information to the generation of the travel control signal. In contrast, in another embodiment E7, at least a part of the processing from the acquisition of the vehicle position information to the generation of the travel control signal may be performed by the vehicle 100. For example, the following (1) to (3) may be used.

[0074] (1) The remote control device 200 may obtain vehicle position information, determine the target position to which the vehicle 100 should go next, and generate a path from the current position of the vehicle 100 indicated by the obtained vehicle position information to the target position. The remote control device 200 may generate a path to the target position between the current position and the destination, or may generate a path to the destination. The remote control device 200 may send the generated path to the vehicle 100. The vehicle 100 may generate a travel control signal in such a way that the vehicle 100 travels on the path received from the remote control device 200, and use the generated travel control signal to control the drive device 120, the steering device 130, and the brake device 140.

[0075] (2) The remote control device 200 may obtain the vehicle position information and transmit the obtained vehicle position information to the vehicle 100. The vehicle 100 may determine the target position to which the vehicle 100 should go next, generate a path from the current position of the vehicle 100 indicated by the received vehicle position information to the target position, generate a travel control signal so that the vehicle 100 travels on the generated path, and control the drive device 120, the steering device 130, and the brake device 140 using the generated travel control signal.

[0076] (3) In the above-mentioned methods (1) and (2), the vehicle 100 may be equipped with an internal sensor, and the detection result outputted from the internal sensor may be used in at least one of the generation of the route and the generation of the driving control signal. The internal sensor is a sensor mounted on the vehicle 100. The internal sensor may include, for example, a sensor for detecting the motion state of the vehicle 100, a sensor for detecting the action state of each part of the vehicle 100, and a sensor for detecting the environment around the vehicle 100. Specifically, the internal sensor may include, for example, a camera, a LiDAR, a millimeter wave radar, an ultrasonic sensor, a GPS sensor, an acceleration sensor, a gyroscope sensor, etc. For example, in the above-mentioned method (1), the remote control device 200 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. In the above-mentioned method (1), the vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the driving control signal when generating the driving control signal. In the above-mentioned method (2), the vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. In the above-mentioned aspect (2), the vehicle 100 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor in the traveling control signal when generating the traveling control signal.

[0077] (E8) In the fourth embodiment, the vehicle 100 may be equipped with an internal sensor, and the detection result outputted from the internal sensor may be used in at least one of the generation of the route and the generation of the travel control signal. For example, in another embodiment E8, the vehicle 100 may obtain the detection result of the internal sensor, and when generating the route, the detection result of the internal sensor may be reflected in the route. Alternatively, the vehicle 100 may obtain the detection result of the internal sensor, and when generating the travel control signal, the detection result of the internal sensor may be reflected in the travel control signal.

[0078] (E9) In the fourth embodiment, the vehicle 100 obtains the vehicle position information using the detection result of the camera as the external sensor 500. In contrast, in another embodiment E9, the vehicle 100 may be equipped with an internal sensor, and the vehicle 100 obtains the vehicle position information using the detection result of the internal sensor, determines the target position to which the vehicle 100 should go next, generates a path from the current position of the vehicle 100 indicated by the obtained vehicle position information to the target position, generates a travel control signal for traveling on the generated path, and controls the drive device 120, the steering device 130, and the brake device 140 using the generated travel control signal. In this case, the vehicle 100 can travel without using the detection result of the external sensor 500 at all. In addition, the vehicle 100 may obtain the target arrival time and / or congestion information from outside the vehicle 100, and reflect the target arrival time and / or congestion information on at least one of the path and the travel control signal.

[0079] (E10) In the first to third embodiments described above, the remote control device 200 automatically generates a travel control signal to be sent to the vehicle 100. In contrast, in another embodiment E10, the remote control device 200 may generate a travel control signal to be sent to the vehicle 100 according to an operation of an external operator located outside the vehicle 100. For example, the external operator may operate an operating device including a display for displaying a captured image output from a camera as an external sensor 500, a steering wheel for remotely operating the vehicle 100, an accelerator pedal, a brake pedal, and a communication device for communicating with the remote control device 200 through wired communication or wireless communication, and the remote control device 200 may generate a travel control signal in accordance with the operation applied to the operating device. In this embodiment, the image of the mark LM captured by the camera 160 mounted on the vehicle 100 may be displayed on the display of the operating device, and the operator may confirm the mark LM.

[0080] (E11) In the above-mentioned first to fourth embodiments and other embodiments E1 to other embodiments E10, the vehicle 100 only needs to have a structure that can be moved by unmanned driving, for example, it can also be a platform with the structure described below. Specifically, in order to perform the three functions of "driving", "steering" and "stopping" by unmanned driving, the vehicle 100 only needs to have at least a vehicle control device 110, a drive device 120, a steering device 130, and a braking device 140. In the case where the vehicle 100 obtains information from the outside for unmanned driving, the vehicle 100 also needs to have a communication device 150. That is, the vehicle 100 that can be moved by unmanned driving may not be equipped with at least a part of the internal parts such as the driver's seat and the instrument panel, may not be equipped with at least a part of the external parts such as the bumper and the fender, and may not be equipped with a body shell. In this case, the remaining parts such as the body shell may be assembled to the vehicle 100 before the vehicle 100 is shipped from the factory KJ, or the remaining parts such as the body shell may be assembled to the vehicle 100 after the vehicle 100 is shipped from the factory KJ without being assembled to the vehicle 100. Each part may be assembled from any direction such as the upper side, the lower side, the front side, the rear side, the right side, or the left side of the vehicle 100, and may be assembled from the same direction or from different directions. In addition, the position of the pedestal may be determined in the same manner as the vehicle 100 in the first embodiment.

[0081] (E12) The vehicle 100 can be manufactured by combining a plurality of modules. A module means a unit composed of a plurality of parts assembled according to the location and function of the vehicle 100. For example, the rack of the vehicle 100 can be manufactured by combining a front module constituting the front part of the rack, a central module constituting the central part of the rack, and a rear module constituting the rear part of the rack. In addition, the number of modules constituting the rack is not limited to 3, and may be 2 or less or 4 or more. In addition, in addition to the parts constituting the rack, the parts constituting the parts of the vehicle 100 that are different from the rack may also be modularized, or the parts constituting the parts of the vehicle 100 that are different from the rack may be modularized instead of the parts constituting the rack. In addition, the various modules may also include any exterior parts such as a bumper and a grille, and any interior parts such as a seat and a console. In addition, not limited to the vehicle 100, any type of mobile body may be manufactured by combining a plurality of modules. Such a module may be manufactured, for example, by joining a plurality of parts by welding or fixings, or by integrally molding at least a portion of the parts constituting the module into one part by casting. The molding method of integrally molding a part, especially a relatively large part, is also called Giga-casting or Mega-casting. For example, the front module, the center module, and the rear module mentioned above can also be manufactured using Giga-casting.

[0082] (E13) Transporting the vehicle 100 by driving the vehicle 100 without human intervention is also referred to as "self-propelled transport". In addition, the configuration for realizing self-propelled transport is also referred to as "vehicle remote-controlled autonomous driving transport system". In addition, the production method of producing the vehicle 100 by self-propelled transport is also referred to as "self-propelled production". In self-propelled production, for example, in the factory KJ that manufactures the vehicle 100, at least a portion of the transport of the vehicle 100 is realized by self-propelled transport.

[0083] (E14) In the above-mentioned embodiments, part or all of the functions and processes implemented by software may also be implemented by hardware. In addition, part or all of the functions and processes implemented by hardware may also be implemented by software. As hardware for implementing the various functions in the above-mentioned embodiments, various circuits such as integrated circuits and discrete circuits may be used.

[0084] The present disclosure is not limited to the above-mentioned embodiments, and can be implemented in various configurations within the scope of the main purpose. For example, the technical features in the embodiments corresponding to the technical features in each method recorded in the "Contents of the Invention" column can be appropriately replaced or combined in order to solve part or all of the above-mentioned problems, or to achieve part or all of the above-mentioned effects. In addition, as long as the technical feature is not described as a necessary part in this specification, it can be appropriately deleted. Description of Reference Numerals

[0085] 10~10d…Unmanned driving system, 100…Vehicle, 110…Vehicle control device, 111…Processor, 112…Memory, 113…Input / output interface, 114…Internal bus, 115…Vehicle control unit, 116…Camera control unit, 117…Acquisition unit, 118…Determination unit, 119…Judgment unit, 120…Drive device, 130…Steering device, 140…Braking device, 150…Communication device, 160…Camera, 200…Remote control device, 201…Processor, 202…Memory, 203…Input / output interface, 204…Internal bus, 205…Communication device, 210…Remote control unit, 220…Acquisition unit, 230…Determination unit, 240…Judgment unit, 250…Projection control unit, 300…Notification device, 400…Process management device, 500…External sensor, 600…Projection device

Claims

1. A control device comprising: an acquisition unit that acquires a detection result of a detector mounted on a mobile body that can move unmanned; a determination unit that determines a mark that is located outside the moving body and should be detected by the detector; and The control unit moves the mobile body without human control, and performs different processing related to the movement of the mobile body depending on whether the mark determined by the determination unit is included in the detection result or not.

2. The control device according to claim 1, wherein: When the flag determined by the determination unit is not included in the detection result, the control unit performs at least one of a process of notifying that an abnormality has occurred, a process of changing a speed of the moving object, and a process of stopping unmanned driving of the moving object.

3. The control device according to claim 1, wherein: The detector is a camera, The mark is a QR code.

4. The control device according to claim 1, wherein: The determination unit determines the marker to be detected by the detector using position information used as information indicating the position of the moving object and position information indicating the position of the marker.

5. The control device according to claim 1, wherein: The mark is a projection image projected by a projection device located outside the moving body, The control device further includes a projection control unit that controls the projection device.

6. The control device according to claim 1, wherein: The determination unit determines the marker to be detected by the detector and the orientation of the marker to be detected by the detector relative to the moving object. When the mark determined by the determination unit is included in the detection result, the control unit makes the process related to the movement of the moving body different depending on whether the mark included in the detection result is located at the orientation determined by the determination unit.

7. A mobile object capable of moving without human intervention, comprising: a detector for detecting a marker located outside the moving body; an acquisition unit that acquires information of the marker that should be detected by the detector, which is determined by a remote control device that controls the moving body from outside the moving body; and The control unit moves the moving body according to a command sent from the remote control device, and performs different processing related to the movement of the moving body depending on whether the marker to be detected by the detector is included in the detection result of the detector or not.

8. A mobile object capable of moving without human intervention, comprising: a detector for detecting a marker located outside the moving body; a determination unit that determines the mark that should be detected by the detector; and The control unit moves the mobile body without human control, and performs different processing related to the movement of the mobile body depending on whether the mark determined by the determination unit is included in the detection result of the detector or not.

9. A control method, wherein: Obtaining a detection result of a detector mounted on a mobile body capable of moving unmanned; determining a marker located outside the moving body that should be detected by the detector; Processing related to the movement of the moving object is made different between a case where the determined mark is included in the detection result and a case where the mark is not included.