Vehicle manufacturing system and vehicle manufacturing method

Abstract

The present invention provides a vehicle manufacturing system and a vehicle manufacturing method that enable workers to quickly control the vehicle. [Solution] The vehicle manufacturing system 50 according to this embodiment is a vehicle manufacturing system that controls multiple vehicles to travel in a convoy during the manufacturing process or transport process, and comprises a camera that takes images of the travel area and its surroundings in which the multiple vehicles travel, a worker detection unit 252 that detects workers based on the images captured by the camera, a posture detection unit 254 that detects the posture of workers by performing image processing on the images captured by the camera, a comparison unit 256 that compares the posture of workers with a preset reference posture, and a travel control unit 257 that controls the travel of the vehicles according to the comparison result.

Description

Technical Field

[0001] The present disclosure relates to a vehicle manufacturing system and a vehicle manufacturing method.

Background Art

[0002] Patent Document 1 discloses a vehicle manufacturing system. The vehicle travels within the system for manufacturing the vehicle by autonomous control or remote control.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a vehicle manufacturing factory, a plurality of vehicles autonomously travel along a conveyance path and are sequentially manufactured. Therefore, productivity can be improved. On the other hand, it is also desired to control the vehicle from the outside. For example, in an emergency, an operator may want to stop or decelerate the vehicle. In such a case, operating devices such as switches and buttons are installed near the manufacturing line so that the operator can easily operate. However, installing devices in the conveyance path will hinder the running of the vehicle and the work of the operator. Therefore, there is a problem that an operator working cannot quickly stop the vehicle.

[0005] Therefore, an object of the present disclosure is to provide a vehicle manufacturing system and a vehicle manufacturing method that enable an operator to quickly control a vehicle.

Means for Solving the Problems

[0006] The vehicle manufacturing system according to this disclosure is a vehicle manufacturing system that controls multiple vehicles to travel in a convoy during a manufacturing process or a transport process, and comprises: a camera that takes images of a travel area and its surroundings in which the multiple vehicles travel; a worker detection unit that detects workers based on images taken by the camera; a posture detection unit that detects the posture of the workers by performing image processing on the images taken by the camera; a comparison unit that compares the posture of the workers with a preset reference posture; and a travel control unit that controls the travel of the vehicles according to the comparison result of the comparison unit.

[0007] The vehicle manufacturing method according to this disclosure is a vehicle manufacturing method that controls a plurality of vehicles to travel in a convoy during a manufacturing process or a transport process, and comprises the steps of: capturing images of a travel area and its surroundings on which the plurality of vehicles travel using a camera; detecting a worker based on the images captured by the camera; detecting the posture of the worker by performing image processing on the images captured by the camera; comparing the posture of the worker with a preset reference posture; and controlling the movement of the vehicles according to the comparison result in the comparison unit. [Effects of the Invention]

[0008] This disclosure provides a vehicle manufacturing system and a vehicle manufacturing method that enable workers to quickly control the vehicle. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram showing the overall configuration of the vehicle manufacturing system. [Figure 2] This is a schematic diagram showing a part of the vehicle manufacturing system. [Figure 3] This is a schematic plan view showing a portion of the track layout of the vehicle manufacturing system. [Figure 4] This is a schematic side view showing a portion of the track layout of a vehicle manufacturing system. [Figure 5] This is a block diagram of the control system for a vehicle manufacturing system. [Figure 6]This is a schematic diagram illustrating the position in which a worker is looking. [Figure 7] This is a flowchart showing the vehicle manufacturing process. [Figure 8] This is a diagram illustrating the vehicle's driving control. [Figure 9] This is a control block diagram illustrating example 1 of the driving control system. [Figure 10] This is a flowchart to explain example 1 of the driving control system. [Figure 11] This is a control block diagram illustrating example 2 of the driving control system. [Figure 12] This is a flowchart to explain example 2 of the driving control system. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to the drawings. However, the invention claimed is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential for solving the problem. For clarity of explanation, the following descriptions and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are denoted by the same reference numerals, and redundant explanations have been omitted where necessary.

[0011] Embodiment 1 Vehicle manufacturing system The vehicle manufacturing system 50 according to this embodiment will be described with reference to Figures 1 and 2. Figure 1 is a schematic diagram showing the configuration of the vehicle manufacturing system 50. Figure 2 is a schematic diagram showing two vehicles 100 in motion. Note that in Figure 1, an XY Cartesian coordinate system is shown for illustrative purposes.

[0012] A vehicle manufacturing system (simply referred to as a system) 50 is used in a vehicle manufacturing factory that manufactures vehicles 100. Alternatively, the vehicle manufacturing system 50 is also used at a transportation location where transportation processes such as transportation to a yard and loading are carried out. As shown in FIG. 1, the vehicle manufacturing system 50 includes a server 200, a sensor 300, and a robot 600. A plurality of vehicles 100 are self-propelled vehicles that can move during the manufacturing process. The vehicle manufacturing system 50 controls the plurality of vehicles 100 to travel in a queue.

[0013] The sensor 300 includes a communication device 330 that transmits and receives data to and from the server 200. The server 200 includes a communication device 230 that transmits and receives data to and from the sensor 300. Further, as shown in FIG. 2, the communication device 230 has a function of transmitting and receiving data to and from the vehicle 100. The vehicle 100 includes a communication device 130 that receives data from the server 200. Each vehicle 100 includes the communication device 130.

[0014] The communication device 130, the communication device 230, and the communication device 330 may each be general-purpose devices such as a network hub or a router device. The communication device 130, the communication device 230, and the communication device 330 use, for example, general-purpose wireless communication such as WiFi (registered trademark). An address for identifying a communication partner is set for each of the communication device 130, the communication device 230, and the communication device 330. The communication address is, for example, an IP (Internet Protocol) address.

[0015] Each vehicle 100 is a vehicle before completion. As shown in FIG. 1, the vehicle 100 travels along a preset driving path TR. As the vehicle 100 travels along the driving path TR, the vehicle 100 is manufactured. Specifically, during the travel of the vehicle 100 on the driving path, an operator W or a robot 600 or the like executes operations such as part assembly, switch operation, welding, and inspection. Thereby, the operations of each manufacturing process are executed. Then, the vehicle 100 is manufactured by performing the operations of each manufacturing process in a predetermined order.

[0016] A plurality of vehicles 100 travel in a formation. Specifically, the vehicles 100 travel at a constant speed such that the vehicle distance remains constant at a predetermined distance. Further, the speeds of the plurality of vehicles 100 are the same. Also, the road TR has a straight-ahead region TR1 where the vehicle 100 travels straight and a turning region TR2 where the vehicle 100 turns. In the straight-ahead region TR1, the road TR is linear.

[0017] The turning region TR2 is a location where the vehicle 100 changes direction. In the turning region TR2, the vehicle 100 makes a U-turn. In the turning region TR2, for example, the road TR is in the shape of an arc with a predetermined radius of curvature. In the turning region TR2, the road TR is a semi-circle. The turning regions TR2 are provided at both ends of the straight-ahead region TR1. For example, when the vehicle 100 advances in the +X direction in the straight-ahead region TR1, it reaches the turning region TR2. When the vehicle 100 makes a 180-degree turn in the turning region TR2, it advances in the -X direction in the straight-ahead region TR1. Conversely, when advancing in the -X direction in the straight-ahead region TR1, it reaches the turning region TR2. When the vehicle 100 makes a 180-degree turn in the turning region TR2, it advances in the +X direction in the straight-ahead region TR1. In this way, the vehicles 100 are sequentially manufactured by passing through the straight-ahead region TR1 and the turning region TR2 alternately.

[0018] The sensor 300 is a camera that images the moving or stationary vehicle 100. The sensor 300 images one or a plurality of vehicles 100. The sensor 300 is provided to detect the inter-vehicle distance. Based on the image captured by the sensor 300, the server 200 can detect the position of the vehicle 100 in the factory. For example, it is installed on the walls, columns, ceilings, etc. of the factory and images the vehicle 100 from an oblique upward direction. The sensor 300 images an image with an angle of view that includes two or more vehicles 100 forming a formation. The sensor 300 is set at the same height as the vehicle 100 and may image two or more vehicles 100 from the side.

[0019] The communication device 330 transmits the image captured by the sensor 300 to the server 200. The communication device 330 may transmit not only the captured image but also information obtained from the captured image to the server 200. In other words, the communication device 330 transmits the detection results detected by the sensor 300. The communication device 330 may be built into the sensor 300 or it may be a separate unit. Also, the communication device 330 may be shared by multiple sensors 300. In other words, if multiple sensors 300 are installed, one communication device 330 may transmit data to the server 200.

[0020] In this manner, when the sensor 300 captures an image of the vehicle 100, the communication device 330 transmits the captured image and other data to the server 200. The communication device 230 receives the captured image data from the sensor 300. The server 200 can estimate the distance between vehicles by performing predetermined image processing on the image captured by the sensor 300. For example, the server 200 calculates the distance between vehicles in a convoy of multiple vehicles 100. The number of vehicles in the convoy is not particularly limited; it must be three or more.

[0021] Furthermore, the sensor 300 for detecting the distance between vehicles is not limited to a camera. The sensor for detecting the distance between vehicles may be various types of sensors such as an RGB camera, a far-infrared camera, or LiDAR. The sensor 300 is not limited to an optical sensor; it may also be radar. Of course, two or more sensors 300 may be installed, or two or more types of sensors 300 may be used in combination. For example, the sensor 300 may include both LiDAR and a camera.

[0022] The communication device 330 transmits the detection result to the server 200. As described above, the detection result transmitted by the sensor 300 may be an captured image or information extracted from the image. For example, if the sensor 300 has an image processing function, the sensor 300 transmits information extracted by image processing to the server 200.

[0023] Furthermore, the sensor 300 may be mounted on the vehicle 100, as shown in Figure 2. For example, an on-board camera, LiDAR, or radar can be the sensor 300. If the sensor 300 is an on-board camera, the sensor 300 will capture an image of the vehicle 100 in front. If the sensor 300 is an on-board LiDAR, the sensor 300 will measure the distance to the vehicle 100 in front. The communication device 130 will transmit the image and measurement results to the server 200.

[0024] The server 200 controls the vehicle 100 so that it moves along the track TR. Furthermore, the server 200 controls multiple vehicles 100 so that they travel in a convoy. For example, the vehicles 100 travel in a single file along the track TR. The server 200 transmits control signals to each vehicle 100 via the communication device 230.

[0025] Furthermore, the detailed configuration of the track TR and its surrounding equipment will be explained using Figures 3 and 4. Figure 3 is a schematic plan view showing a vehicle traveling on the track TR and workers W in its vicinity. Figures 3 and 4 show three vehicles 100 autonomously traveling along the track TR.

[0026] Here, the area in which vehicle 100 travels is defined as the travel area A. The travel area A includes the track TR. In this XY plan view, since the track TR is a straight line along the X direction, the travel area A is a strip-shaped area along the X direction. The travel area A is a strip-shaped area with a width approximately the same as the width of vehicle 100.

[0027] A worker W is present around vehicle 100. Worker W is performing tasks on vehicle 100. While vehicle 100 is traveling in travel area A, worker W performs tasks such as assembling parts, operating switches, welding, and inspection. This completes the tasks for each manufacturing process. Vehicle 100 is manufactured when the tasks for each manufacturing process are performed in a predetermined order. Worker W may be walking at a distance from vehicle 100. Alternatively, worker W may be walking towards vehicle 100 carrying parts or other items.

[0028] Furthermore, control equipment 30 is provided around the travel area A. The control equipment 30 transmits a control signal to the server 200 to stop the vehicle 100. The control equipment 30 is installed, for example, on the ceiling or walls of the factory building. The installation location of the control equipment 30 may be movable. In this case, control equipment 30 is provided on both sides of the travel area A. That is, control equipment 30 is provided on both the +Y side and the -Y side of the travel area A. Of course, the installation location and number of control equipment 30 are not particularly limited.

[0029] A string 31 is connected to the control device 30. The control device 30 and the string 31 are installed at a height that does not interfere with the worker W or the vehicle 100. Furthermore, a suspension string 32 is attached to the string 31. The suspension string 32 is suspended at a height that can be reached by the worker W. When the worker W pulls the suspension string 32, the control device 30 turns on and transmits a control signal. As a result, the vehicle 100 stops.

[0030] When worker W detects an anomaly or trouble, they can pull the suspension cord 32 to bring the vehicle 100 to an emergency stop. The suspension cord 32 functions as a stop switch to stop the vehicle 100. In other words, when worker W pulls the suspension cord 32, which is the stop switch, the control device 30 turns on and sends a control signal to the server 200. As a result, the vehicle 100 stops. The control device 30, the cord 31, and the suspension cord 32 function as emergency stop devices.

[0031] Here, the suspension cord 32 is positioned outside the travel area A so as not to interfere with the vehicle 100. If the suspension cord 32, which is operated by the worker W, is installed in the travel area A, it may come into contact with the moving vehicle 100. There may be cases where the worker W, who is near the vehicle 100, wants to stop the vehicle 100 immediately. Therefore, the suspension cords 32 are installed on both sides of the travel area A. In other words, the suspension cords 32 are installed outside the travel area A.

[0032] Furthermore, if worker W, who is in the travel area A, wants to stop the vehicle 100 using the suspension cord 32, worker W will need to move to the suspension cord 32 and pull it. Therefore, if the distance from worker W to the suspension cord 32 is far, it will be difficult to quickly pull the suspension cord 32. Thus, the vehicle 100 can be controlled based on the image captured by the sensor 300.

[0033] The control of the vehicle 100 during the manufacturing or transport process will be explained below using Figure 5. Figure 5 is a block diagram showing the configuration of the control system of the vehicle manufacturing system 50. As shown in Figure 5, the server 200 includes a worker detection unit 252, a posture detection unit 254, a comparison unit 256, and a driving control unit 257. Although Figure 5 shows one vehicle 100 and one sensor 300, multiple vehicles 100 and sensors 300 are provided, as shown in Figure 1.

[0034] Vehicle 100 includes a vehicle control unit 115, an actuator group 120, and a communication device 130. Sensor 300 is equipped with the communication device 130. Note that the server 200 is not limited to a single physical device, but may be distributed. For example, the database may be a separate storage device or cloud server located independently of the processor.

[0035] The communication device 230 includes a receiver 231 and a transmitter 232. The receiver 231 receives various signals and data from the sensor 300 and the vehicle 100. For example, the receiver 231 receives data indicating the detection result from the sensor 300. The data received from the sensor 300 may be image data or data extracted from image data.

[0036] The transmitter 232 transmits various signals and data to the sensor 300 and the vehicle 100. For example, the transmitter 232 transmits control instruction values ​​to the vehicle 100. Of course, the server 200 may also send and receive data other than those mentioned above. For communication between the receiver 231 and the transmitter 232, it is possible to use processing in accordance with general-purpose communication standards such as WiFi (registered trademark).

[0037] The communication device 130 of vehicle 100 is a wireless terminal device for wireless communication with server 200. The communication device 130 is configured with an IP (Internet Protocol) address, etc. When the communication device 130 of vehicle 100 receives a control instruction value, vehicle 100 moves according to the control instruction value. The actuator group 120 includes wheel motors for driving the wheels, steering motors for controlling the steering angle, brakes for stopping the vehicle, etc. The vehicle control unit 115 generates control signals to control the actuator group 120 according to the control instruction. The vehicle control unit 115 may be composed of an ECU (Electronic Control Unit). This allows vehicle 100 to move along the track TR.

[0038] In the following explanation, it is assumed that the server 200 performs image processing on the captured images acquired from the sensor 300, but the processing may be performed by a device other than the server 200. For example, the sensor 300 may perform part of the processing. Specifically, the sensor 300 may extract the features necessary for image processing and send those features to the server 200. Alternatively, a processor such as a GPU (Graphics Processing Unit) installed in the sensor 300 may detect the worker W and send the detection result.

[0039] As described above, the sensor 300 transmits the captured image to the server 200. The captured image may be a moving image or a still image. When the communication device 230 of the server 200 receives the captured image, the worker detection unit 252 detects the workers W contained in the captured image. For example, the worker detection unit 252 detects each worker W by performing image processing on the captured image. For the processing to detect the workers W, an AI model built using machine learning or an image processing program can be used.

[0040] Since known methods can be used for the processing of the worker detection unit 252, a detailed explanation will be omitted. As described above, the sensor 300 may transmit data such as feature quantities extracted from the captured image, rather than the captured image itself. Alternatively, the processing of the worker detection unit 252 may be performed by the sensor 300.

[0041] For example, the worker detection unit 252 can detect worker W by inputting a captured image into a detection model that utilizes artificial intelligence. Examples of detection models include pre-trained machine learning models that have been trained to implement either semantic segmentation or instance segmentation. As for this machine learning model, for example, a convolutional neural network (CNN) trained by supervised learning using a training dataset can be used. The training dataset includes, for example, multiple training images including workers and ground truth labels indicating the workers' positions. When training the CNN, it is preferable to update the CNN parameters by backpropagation to reduce the error between the output result of the detection model and the ground truth labels.

[0042] The posture detection unit 254 detects the posture of the worker W by performing image processing. A machine learning model built using machine learning can also be used for the posture detection process. For example, the posture detection unit 254 has an AI model that estimates the skeleton of the worker W. The posture detection unit 254 defines a bounding box containing one worker W within the image and identifies the parts of the worker W within the bounding box. For example, it estimates the joint positions such as the elbows, shoulders, pelvis, ankles, and knees through image processing. It estimates the skeleton by connecting the XY coordinates of the joint positions. Then, it detects the posture based on the skeleton.

[0043] The posture detection unit 254 estimates the skeleton by connecting the positions of the joints. The posture detection unit 254 estimates the positions of joints such as the elbows, shoulders, pelvis, wrists, ankles, and knees through image processing. The posture detection unit 254 estimates the x and y coordinates of the joints in the captured image. Specifically, when an image of a bounding box containing the worker W is input to a machine learning model, the posture detection unit 254 detects the posture of the worker W.

[0044] The comparison unit 256 compares the posture of the worker W detected by the posture detection unit 254 (hereinafter referred to as the detected posture) with a reference posture. The driving control unit 257 controls the vehicle 100 based on the comparison result from the comparison unit 256. For example, the driving control unit 257 generates a driving control signal to stop, pause, make an emergency stop, decelerate, accelerate, or start the vehicle 100. When the driving control unit 257 outputs the driving control signal to the transmitter 232, the transmitter 232 transmits the driving control signal to the vehicle 100. As a result, the vehicle 100 stops, pauses, makes an emergency stop, decelerates, accelerates, or starts.

[0045] The comparison unit 256 has a reference posture pre-set for controlling the vehicle 100. For example, the reference posture is a posture with the arms raised. When worker W wants to control the vehicle 100, they extend both arms or one arm vertically upward. Alternatively, the reference posture is a posture with both arms extended to the sides (horizontally). Worker W extends both arms to the left and right. It is preferable that the reference posture is a posture that worker W does not normally take. In other words, the reference posture is a posture different from worker W's work posture. By doing so, it is possible to prevent worker W from unintentionally stopping the vehicle 100. When worker W wants to control the vehicle 100 remotely, they take the reference posture. This allows worker W to quickly control the vehicle 100.

[0046] For example, the comparison unit 256 has one or more reference postures pre-set. In this case, the reference posture (also called the stopping posture) for stopping the vehicle 100 is a posture with one arm raised. As shown in Figure 6, when the worker W raises their right or left arm, the comparison unit 256 determines that it matches the reference posture. Therefore, the driving control unit 257 generates and outputs a driving control signal to stop the vehicle 100. The transmitter 232 transmits the driving control signal to the vehicle 100. When the communication device 130 of the vehicle 100 receives the driving control signal, the vehicle control unit 115 stops the vehicle 100.

[0047] In this way, the vehicle 100 can be stopped quickly. In other words, the vehicle 100 can be stopped without the worker W in the travel area A having to move to the suspension rope 32. If worker W detects an abnormality, the vehicle 100 can be stopped quickly by worker W assuming a stopping posture.

[0048] Multiple reference postures may be set in the comparison unit 256. In this case, control content may be assigned to each of the multiple reference postures. The control content may include one or more of the following: emergency stop, pause, deceleration, acceleration, and start.

[0049] Here, the arm that worker W raises may be limited to either the right or left arm. That is, if the reference posture is one in which the right arm is raised, then when worker W raises the right arm, the vehicle 100 stops, and when worker W raises the left arm, the vehicle 100 does not stop. Alternatively, the reference posture may be one in which either arm is raised. In this case, when worker W raises at least one arm, the vehicle 100 stops. Alternatively, the reference posture may be one in which both arms are raised.

[0050] Furthermore, it is preferable that the reference posture includes a posture in which the arms are raised. This allows the comparison unit 256 to reliably detect that the worker W is in a reference posture. If the sensor 300 is installed on the ceiling or wall, a blind spot may be created by the vehicle 100, etc. However, by raising the arms, the arms can be prevented from being in the blind spot of the vehicle 100. When the arms are raised, they are at a higher position than the vehicle 100, making them less likely to be in the blind spot of the sensor 300 installed above. In other words, the worker W raises their arms to a position higher than the vehicle 100. By doing so, the comparison unit 256 can reliably detect that the worker W is in a reference posture.

[0051] Of course, a reference posture other than raising the arms may also be used. For example, a posture with both arms extended horizontally may be used as a reference posture. Alternatively, a posture with one arm raised and the other extended horizontally may be used as a reference posture. Furthermore, a posture (action) of swinging both arms from side to side while they are raised may also be used as a reference posture. Moreover, a posture with the legs raised may also be used as a reference posture.

[0052] Furthermore, the comparison unit 256 may have multiple reference orientations set. Preferably, the comparison unit 256 has control content set for each reference orientation. In other words, different control content is assigned depending on the reference orientation.

[0053] If the detected posture matches the first reference posture, the vehicle 100 will make an emergency stop. If the detected posture matches the second reference posture, the vehicle 100 will come to a temporary stop. If the detected posture matches the third reference posture, the vehicle 100 will decelerate. If the detected posture matches the fourth reference posture, the vehicle 100 will accelerate. If the detected posture matches the fifth reference posture, the vehicle 100 will start moving. In this way, multiple reference postures may be set, and the driving control may be changed according to the reference posture. This allows the operator W to control the vehicle 100 appropriately.

[0054] The following provides a detailed explanation of the reference pose and its control settings. The following explanation is an example of assigning multiple reference poses and their control settings. Of course, the reference poses and control settings are not limited to the example shown below.

[0055] The first reference posture for emergency stopping vehicle 100 is a posture with both arms raised. This causes vehicle 100 to quickly apply the brakes and come to a stop. The second reference posture for temporary stopping vehicle 100 is a posture with one arm raised and the other arm extended to the side. This causes vehicle 100 to gradually decelerate before coming to a stop. The third reference posture for decelerating vehicle 100 is a posture with both arms extended to the sides. This reduces the rotational speed of the drive motor and other components, causing vehicle 100 to travel at a lower speed than normal.

[0056] Furthermore, the reference posture may be a combination of two or more consecutive poses. In other words, the comparison unit 256 determines that the detected posture matches the reference posture when the worker W takes two or more consecutive poses. In other words, the vehicle 100 can be controlled by the consecutive movements of the worker W. One pose is one in which both arms are extended to the sides, and the other pose is one in which only one arm is extended to the sides.

[0057] For example, the fourth reference posture for accelerating vehicle 100 is to extend both arms to the sides, then lower one arm and extend only the other arm to the side. The fifth reference posture for starting vehicle 100 is to extend one arm to the side, then extend both arms to the sides. In this way, by registering combinations of multiple poses and their sequences as reference postures, various driving controls can be performed in a simple manner. In other words, the control content can be increased without having to divide the posture into many small parts. This allows operator W to appropriately remotely control vehicle 100.

[0058] When using a reference posture that combines multiple poses, the posture detection unit 254 detects the posture in multiple frames. The comparison unit 256 determines that the posture matches the reference posture if two poses are detected in a predetermined order within a predetermined time. In this way, the posture detection unit 254 performs posture detection on the frame images that are input sequentially. Then, when a single worker W takes a predetermined pose in a predetermined order, the comparison unit 256 determines that the detected posture matches the reference posture.

[0059] Furthermore, it is preferable that the first or second reference posture for stopping the vehicle consists of only one pose. In other words, it is preferable not to use a combination of two or more poses as the first or second reference posture. For example, if a problem requiring urgency occurs with vehicle 100, operator W wants to stop vehicle 10 as quickly as possible. Therefore, by operator W taking a single pose, the comparison unit 256 detects that it matches the reference posture. In this way, vehicle 100 can be stopped quickly. It is also preferable that the third reference posture for deceleration also consists of only one pose.

[0060] Furthermore, it is preferable that the fourth reference posture for accelerating the vehicle 100, or the fifth reference posture for starting, is a combination of two consecutive postures. In other words, it is preferable that the fourth reference posture or the fifth reference posture is not just a single posture. This prevents the vehicle 100 from accelerating or starting unintentionally.

[0061] Specifically, if vehicle 100 stops or decelerates, it is preferable, for safety reasons, to notify other workers W in the vicinity of acceleration or departure before accelerating or starting vehicle 100. Therefore, by using a combination of two or more consecutive poses as the reference posture, false detection can be prevented. This further improves safety.

[0062] Furthermore, the reference posture may be set without distinguishing between the left and right arms. For example, a reference posture with only the left arm raised and a reference posture with only the right arm raised may result in the same driving control. Similarly, a posture with the left arm extended to the side and a posture with the right arm extended to the side may result in the same driving control. This makes it easy for the operator to remember multiple reference postures when they are set. In addition, even if the posture detection unit 254 mistakenly detects the operator's front or back, it can prevent false detections. Of course, the reference posture may also be set with distinction between the left and right arms.

[0063] The models for pose detection and comparison with reference poses can use CNN models, similar to the worker detection model. During CNN training, it is preferable to update the CNN parameters using backpropagation to reduce the error between the detection model's output and the correct label. Alternatively, the worker detection, pose detection, and comparison models can all be single models. In this case, when an image is input to the machine learning model, the model outputs a classification result indicating whether worker W is in a reference pose. Furthermore, it outputs a classification result indicating which of the first to fifth reference poses worker W is in. The machine learning model can be a classification model such as k-nearest neighbors or a decision tree.

[0064] For example, when training a machine learning model, images of worker W in the first to fifth reference postures are used as ground truth labeled training data representing the first to fifth reference postures. Alternatively, images of worker W not in any reference posture are used as ground truth labeled training data representing non-reference postures. By performing supervised machine learning using this ground truth labeled training data, a classification model is constructed.

[0065] Furthermore, the driving control signal may include information indicating the vehicle 100 to be controlled. For example, the driving control signal may include the ID of the vehicle 100 to be controlled. In this case, the driving control unit 257 generates a driving control signal that includes the ID of the vehicle to be controlled. The vehicle 100 to be controlled may be determined by the location of the worker W. For example, the vehicle 100 that is within a predetermined distance from the position of the worker W in the first reference posture may be stopped.

[0066] Furthermore, when worker W pulls the suspension cord 32 (see Figures 3 and 4), the control device 30 sends a signal to the server 200 to stop the vehicle 100. The server 200 then sends a stop signal to the vehicle 100 to stop it, as described above. This allows worker W, who is in the non-detection area DA2, to stop the vehicle quickly. Alternatively, the control device 30 may directly send a stop signal to the vehicle 100.

[0067] Furthermore, in order to improve the accuracy of worker W detection or posture detection, worker W may wear clothing with distinctive colors or patterns. Worker W may wear wristbands or the like to improve the accuracy of arm detection. Also, to improve the accuracy of head detection, marks may be placed on helmets or hats. In image processing, worker detection and posture detection are performed by referring to the colors, patterns, wristbands, marks, etc. Furthermore, in machine learning, images of workers wearing distinctive uniforms, wristbands, hats, or helmets may be used as training data.

[0068] In particular, it is preferable for worker W to wear a wristband or the like. The posture detection unit 254 detects the posture of worker W based on the posture of the arm wearing the wristband. The posture of worker W can be detected with high accuracy depending on the position of the wristband. Furthermore, it is even more preferable for the wristband to be a distinctive color such as a fluorescent color or a color that is not found in the surrounding area. In this case, the posture detection unit 254 can reliably detect the wristband, and thus the judgment accuracy of the comparison unit 256 can be increased. For example, if the wristband is in a position higher than the vehicle 100, the judgment accuracy of determining whether the detected posture matches the reference posture can be improved.

[0069] Furthermore, only workers W who are authorized to control vehicle 100 may be required to wear wristbands or similar devices. This prevents vehicle 100 from being controlled incorrectly. For example, if there is a work process that involves raising the arms, the normal working posture may be mistakenly detected as the reference posture. Therefore, workers performing such work should not wear wristbands or similar devices. This allows for more appropriate control of vehicle 100. Moreover, this also prevents false detections in the presence of observers or visitors other than workers.

[0070] Furthermore, if there are multiple workers W in the frame image, the posture detection unit 254 detects the posture of each worker W. Then, the comparison unit 256 compares the detected posture of each worker W with a reference posture. In addition, areas where posture detection is performed may be set. That is, detection areas where posture detection is performed and non-detection areas where posture detection is not performed may be set. For example, work processes in which a worker W raises their arms may be set as non-detection areas, and posture detection will not be performed. This prevents false detections. Furthermore, it can reduce the load on image processing such as posture detection.

[0071] Alternatively, the worker W's running posture may be used as the reference posture. For example, if worker W is running, the driving control unit 257 generates a driving control signal to perform an emergency stop on the vehicle 100. If worker W is running, there is a high probability that a problem of high urgency is occurring. Therefore, if the posture detection unit 254 detects that worker W is running, the driving control unit 257 generates a driving control signal to perform an emergency stop. This allows the vehicle 100 to be stopped quickly. Note that the sensor 300 and server 200 may also detect whether worker W is running based on worker W's speed of movement, rather than worker W's posture.

[0072] Alternatively, the vehicle 100 may be controlled by voice input using a microphone. For example, a sensor 300 equipped with a microphone detects the voice of worker W. When worker W speaks a voice command indicating the control content, the driving control unit 257 generates a driving control signal. This allows for quick control of the vehicle 100. The microphone may be attached to a camera or the like, or a dedicated microphone for driving control may be installed in the factory.

[0073] The vehicle manufacturing method will be described with reference to Figure 7. Figure 7 is a flowchart of the vehicle manufacturing method according to this embodiment.

[0074] First, the worker detection unit 252 detects the worker W included in the captured image (S11). The posture detection unit 254 detects the posture of the worker W (S12). Here, the posture detection unit 254 detects the posture of the worker W by performing image processing on the image of the worker W. Next, the comparison unit 256 compares the detected posture with the reference posture (S13). The comparison unit 256 determines whether the detected posture matches the reference posture (S14).

[0075] If the detected posture does not match the reference posture (NO in S14), the process ends. When the posture of the operator W matches the reference posture (YES in S14), the travel control unit 257 generates a travel control signal (S15). Here, the transmitter 232 transmits the travel control signal to the vehicle 100 (S16). Thereby, the vehicle 100 can be controlled promptly.

[0076] Then, the server 200 repeats the above process for each frame image of the sensor 300. Of course, the server 200 may perform the above process only on some frame images instead of all frame images of the sensor 300. Furthermore, the server 200 may perform the above process on some of the sensors 300 instead of all the sensors 300.

[0077] Hereinafter, a travel control example for controlling the travel of the vehicle 100 in the system will be described.

[0078] Hereinafter, a travel control example for controlling the travel of the vehicle 100 in the system will be described.

[0079] <A. Travel Control Example 1> FIG. 8 is a conceptual diagram showing the configuration of the system 50 in Travel Control Example 1. The system 50 includes a plurality of vehicles 100 as moving bodies, a server 200, and one or more sensors 300.

[0080] When the moving body is other than a vehicle, the expressions "vehicle" and "car" in the present disclosure can be appropriately replaced with "moving body", and the expression "travel" can be appropriately replaced with "movement". <J

[0081] Vehicle 100 is configured to operate autonomously. "Autonomous operation" means operation without the operation of a passenger. Operation refers to operations related to at least one of the following: "going," "turning," or "stopping" of vehicle 100. Autonomous operation is achieved by automatic or manual remote control using a device located outside vehicle 100, or by autonomous control of vehicle 100. Vehicle 100 operating autonomously may have passengers on board who do not perform operation. Passengers who do not perform operation include, for example, people simply sitting in the seats of vehicle 100, or people performing tasks other than operation, such as assembly, inspection, or operating switches, while on board vehicle 100. Operation by a passenger is sometimes called "manned operation."

[0082] In this specification, "remote control" includes "fully remote control," in which all operations of the vehicle 100 are completely determined from outside the vehicle 100, and "partial remote control," in which some operations of the vehicle 100 are determined from outside the vehicle 100. Furthermore, "autonomous control" includes "fully autonomous control," in which the vehicle 100 autonomously controls its own operations without receiving any information from external devices, and "partial autonomous control," in which the vehicle 100 autonomously controls its own operations using information received from external devices.

[0083] In this embodiment, system 50 is used in a factory FC where vehicle 100 is manufactured. The reference coordinate system of the factory FC is the global coordinate system GC. That is, any position within the factory FC is represented by X, Y, Z coordinates in the global coordinate system GC. The factory FC comprises a first location PL1 and a second location PL2. The first location PL1 and the second location PL2 are connected by a track TR on which vehicle 100 can travel. Multiple sensors 300 are installed in the factory FC along the track TR. The position of each sensor 300 in the factory FC is pre-adjusted. Vehicle 100 moves from the first location PL1 to the second location PL2 via the track TR by unmanned operation.

[0084] Figure 9 is a block diagram showing the configuration of system 50. The vehicle 100 includes a vehicle control device 110 for controlling various parts of the vehicle 100, an actuator group 120 including one or more actuators driven under the control of the vehicle control device 110, and a communication device 130 for communicating wirelessly with external devices such as a server 200. The actuator group 120 includes actuators for a drive system to accelerate the vehicle 100, actuators for a steering system to change the direction of travel of the vehicle 100, and actuators for a braking system to decelerate the vehicle 100.

[0085] The vehicle control device 110 is composed of a computer comprising a processor 111, a memory 112, an input / output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input / output interface 113 are connected via the internal bus 114 to enable bidirectional communication. The input / output interface 113 is connected to an actuator group 120 and a communication device 130. The processor 111 implements various functions, including those of a vehicle control unit 115, by executing PG1 stored in the memory 112.

[0086] The vehicle control unit 115 drives the vehicle 100 by controlling the actuator group 120. The vehicle control unit 115 can drive the vehicle 100 by controlling the actuator group 120 using the driving control signal received from the server 200. The driving control signal is a control signal for driving the vehicle 100. In this embodiment, the driving control signal includes the acceleration and steering angle of the vehicle 100 as parameters. In other embodiments, the driving control signal may include the speed of the vehicle 100 as a parameter instead of, or in addition to, the acceleration of the vehicle 100.

[0087] The server 200 is composed of a computer comprising a processor 201, memory 202, an input / output interface 203, and an internal bus 204. The processor 201, memory 202, and input / output interface 203 are connected via the internal bus 204 to enable bidirectional communication. A communication device 205 for communicating with various devices outside the server 200 is connected to the input / output interface 203. The communication device 205 can communicate with the vehicle 100 via wireless communication and can communicate with each sensor 300 via wired or wireless communication. The processor 201 implements various functions, including those of a remote control unit 210, by executing PG2 stored in memory 202.

[0088] The remote control unit 210 acquires detection results from sensors, generates a driving control signal to control the actuator group 120 of the vehicle 100 using the detection results, and transmits the driving control signal to the vehicle 100, thereby driving the vehicle 100 by remote control. In addition to the driving control signal, the remote control unit 210 may also generate and output control signals to control various auxiliary equipment and actuators that operate various devices such as wipers, power windows, and lamps, which are provided on the vehicle 100. In other words, the remote control unit 210 may operate these various devices and auxiliary equipment by remote control.

[0089] Sensor 300 is a sensor located outside of vehicle 100. In this embodiment, sensor 300 is a sensor that detects vehicle 100 from outside of vehicle 100. Sensor 300 is equipped with a communication device (not shown) and can communicate with other devices such as server 200 via wired or wireless communication.

[0090] Specifically, the sensor 300 is comprised of a camera. The camera, as part of the sensor 300, captures an image including the vehicle 100 and outputs the captured image as the detection result.

[0091] Figure 10 is a flowchart showing the processing procedure for vehicle 100's driving control in an example of driving control. In the processing procedure shown in Figure 10, the processor 201 of the server 200 functions as a remote control unit 210 by executing program PG2. The processor 111 of the vehicle 100 functions as a vehicle control unit 115 by executing program PG1.

[0092] In step S110, the processor 201 of the server 200 acquires vehicle position information of the vehicle 100 using the detection result output from the sensor 300. The vehicle position information is the position information that forms the basis for generating the driving control signal. In this embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the global coordinate system GC of the factory FC. Specifically, in step S110, the processor 201 acquires vehicle position information using the captured image acquired from the camera, which is the sensor 300.

[0093] In detail, in step S110, the processor 201 detects the outline of the vehicle 100 from the captured image, calculates the coordinates of the vehicle 100's positioning point in the coordinate system of the captured image, i.e., the local coordinate system, and obtains the position of the vehicle 100 by converting the calculated coordinates to coordinates in the global coordinate system GC. The outline of the vehicle 100 included in the captured image can be detected, for example, by inputting the captured image into a detection model DM that utilizes artificial intelligence. The detection model DM is prepared, for example, within or outside the system 50 and pre-stored in the memory 202 of the server 200. Examples of the detection model DM include a pre-trained machine learning model that has been trained to implement either semantic segmentation or instance segmentation. As this machine learning model, for example, a convolutional neural network (CNN) trained by supervised learning using a training dataset can be used. The training dataset includes, for example, multiple training images containing vehicle 100, and labels indicating whether each region in the training images represents vehicle 100 or something other than vehicle 100. During CNN training, it is preferable to update the CNN parameters using backpropagation to reduce the error between the output result of the detection model DM and the labels. Furthermore, the processor 201 can obtain the orientation of vehicle 100 by, for example, using the optical flow method, estimating it based on the direction of the vehicle 100's movement vector calculated from the positional changes of the vehicle 100's feature points between frames of the captured images.

[0094] In step S120, the processor 201 of the server 200 determines the next target location that the vehicle 100 should head to. In this embodiment, the target location is represented by X, Y, Z coordinates in the global coordinate system GC. The memory 202 of the server 200 pre-stores a reference route RR, which is the path that the vehicle 100 should travel. The route is represented by a node indicating the starting point, nodes indicating waypoints, a node indicating the destination, and links connecting each node. The processor 201 uses the vehicle position information and the reference route RR to determine the next target location that the vehicle 100 should head to. The processor 201 determines the target location on the reference route RR beyond the vehicle 100's current location.

[0095] In step S130, the processor 201 of the server 200 generates a driving control signal to drive the vehicle 100 toward the determined target position. The processor 201 calculates the vehicle's speed from the change in the vehicle's position and compares the calculated speed with the target speed. Overall, the processor 201 determines the acceleration so that the vehicle 100 accelerates if the speed is lower than the target speed, and determines the acceleration so that the vehicle 100 decelerates if the speed is higher than the target speed. Furthermore, if the vehicle 100 is located on the reference path RR, the processor 201 determines the steering angle and acceleration so that the vehicle 100 does not deviate from the reference path RR, and if the vehicle 100 is not located on the reference path RR, in other words, if the vehicle 100 has deviated from the reference path RR, the processor 201 determines the steering angle and acceleration so that the vehicle 100 returns to the reference path RR.

[0096] In step S140, the processor 201 of the server 200 transmits the generated driving control signal to the vehicle 100. The processor 201 repeats the process of acquiring the position of the vehicle 100, determining the target position, generating the driving control signal, and transmitting the driving control signal at predetermined intervals.

[0097] In step S150, the processor 111 of the vehicle 100 receives a driving control signal transmitted from the server 200. In step S160, the processor 111 of the vehicle 100 controls the actuator group 120 using the received driving control signal, thereby driving the vehicle 100 at the acceleration and steering angle represented by the driving control signal. The processor 111 repeats the reception of the driving control signal and the control of the actuator group 120 at a predetermined cycle. According to the system 50 in this example, the vehicle 100 can be driven by remote control, and the vehicle 100 can be moved without using conveyance equipment such as a crane or a conveyor.

[0098] <B:Driving Control Example 2> FIG. 11 is an explanatory diagram showing a schematic configuration of the system 50v in Driving Control Example 2. In this example, the system 50v is different from Driving Control Example 1 in that it does not include the server 200. Also, the vehicle 100v in the configuration can travel by autonomous control of the vehicle 100v. For other configurations, unless otherwise specified, they are the same as those described above.

[0099] In this example, the processor 111v of the vehicle control device 110v functions as the vehicle control unit 115v by executing the program PG1 stored in the memory 112v. The vehicle control unit 115v acquires the output result from the sensor, generates a driving control signal using the output result, and outputs the generated driving control signal to operate the actuator group 120, thereby enabling the vehicle 100v to travel by autonomous control. In this example, in addition to the program PG1, a detection model DM and a reference route RR are stored in the memory 112v in advance.

[0100] FIG. 12 is a flowchart showing the processing procedure of the driving control of the vehicle 100v in Example 2. In the processing procedure of FIG. 12, the processor 111v of the vehicle 100v functions as the vehicle control unit 115v by executing the program PG1.

[0101] In step S210, the processor 111v of the vehicle control device 110v acquires vehicle position information using the detection result output from the camera, which is the sensor 300. In step S220, the processor 111v determines the target position to which the vehicle 100v should next go. In step S230, the processor 111v generates a driving control signal to drive the vehicle 100v toward the determined target position. In step S240, the processor 111v controls the actuator group 120 using the generated driving control signal to drive the vehicle 100v according to the parameters expressed in the driving control signal. The processor 111v repeats the acquisition of vehicle position information, determination of the target position, generation of the driving control signal, and control of the actuators at a predetermined cycle. According to the system 50v in this example, the vehicle 100v can be driven by autonomous control of the vehicle 100v without remote control of the vehicle 100v by the server 200.

[0102] YY: Other examples of driving control (YY1) In the above example, sensor 300 is a camera. However, sensor 300 does not have to be a camera; for example, it could be LiDAR (Light Detection And Ranging). In this case, the detection result output by sensor 300 may be 3D point cloud data representing vehicle 100. In this case, the server 200 and vehicle 100 may acquire vehicle position information by template matching using the 3D point cloud data as the detection result and pre-prepared reference point cloud data.

[0103] In (YY2) Driving control example 1, the server 200 performs the processing from acquiring vehicle position information to generating driving control signals. In contrast, the vehicle 100 may perform at least a part of the processing from acquiring vehicle position information to generating driving control signals. For example, it may be in the following forms (1) to (3).

[0104] (1) The server 200 may acquire vehicle location information, determine the next target location that vehicle 100 should head to, and generate a route from the vehicle 100's current location, as shown in the acquired vehicle location information, to the target location. The server 200 may generate a route to the target location between the current location and the destination, or it may generate a route to the destination. The server 200 may transmit the generated route to vehicle 100. Vehicle 100 may generate a driving control signal so that vehicle 100 travels along the route received from the server 200, and may use the generated driving control signal to control the actuator group 120.

[0105] (2) The server 200 may acquire vehicle location information and transmit the acquired vehicle location information to the vehicle 100. The vehicle 100 may determine the next target location to which the vehicle 100 should go, generate a route from the vehicle 100's current location shown in the received vehicle location information to the target location, generate a driving control signal so that the vehicle 100 travels along the generated route, and control the actuator group 120 using the generated driving control signal.

[0106] (3) In the embodiments of (1) and (2) above, the vehicle 100 is equipped with internal sensors, and the detection results output from the internal sensors may be used in at least one of the generation of a route and the generation of a driving control signal. The internal sensors are sensors mounted on the vehicle 100. The internal sensors may include, for example, sensors that detect the motion state of the vehicle 100, sensors that detect the operating state of each part of the vehicle 100, and sensors that detect the environment around the vehicle 100. Specifically, the internal sensors may include, for example, cameras, LiDAR, millimeter-wave radar, ultrasonic sensors, GPS sensors, acceleration sensors, gyroscopes, etc. For example, in the embodiment of (1) above, the server 200 may acquire the detection results of the internal sensors and reflect the detection results of the internal sensors in the route when generating a route. In the embodiment of (1) above, the vehicle 100 may acquire the detection results of the internal sensors and reflect the detection results of the internal sensors in the driving control signal when generating a driving control signal. In the embodiment of (2) above, the vehicle 100 may acquire the detection results of the internal sensors and reflect the detection results of the internal sensors in the route when generating a route. In the embodiment described in (2) above, the vehicle 100 may acquire the detection results of the internal sensors and reflect the detection results of the internal sensors in the driving control signal when generating the driving control signal.

[0107] (YY3) In the driving control example 2, the vehicle 100v is equipped with an internal sensor, and the detection result output from the internal sensor may be used in at least one of the generation of the route and the generation of the driving control signal. For example, the vehicle 100v may acquire the detection result from the internal sensor and reflect the detection result from the internal sensor in the route when generating the route. The vehicle 100v may acquire the detection result from the internal sensor and reflect the detection result from the internal sensor in the driving control signal when generating the driving control signal.

[0108] (YY4) In driving control example 2, vehicle 100v acquires vehicle position information using the detection results of sensor 300. Alternatively, vehicle 100v may be equipped with an internal sensor, which may acquire vehicle position information using the detection results of the internal sensor, determine the next target location to which vehicle 100v should go, generate a route from vehicle 100v's current location to the target location as shown in the acquired vehicle position information, generate a driving control signal for driving along the generated route, and control the actuator group 120 using the generated driving control signal. In this case, vehicle 100v can drive without using the detection results of sensor 300 at all. Vehicle 100v may also acquire target arrival time and congestion information from outside vehicle 100v and reflect the target arrival time and congestion information in at least one of the route and the driving control signal. Furthermore, all the functional configurations of system 50v may be provided in vehicle 100v. That is, the processing realized by system 50v in this disclosure may be realized by vehicle 100v alone. For example, the leading vehicle 100V may transmit a control instruction value to the following vehicle 100.

[0109] (YY5) In the driving control example 1, the server 200 automatically generates a driving control signal to be transmitted to the vehicle 100. Alternatively, the server 200 may generate a driving control signal to be transmitted to the vehicle 100 in accordance with the operation of an external operator located outside the vehicle 100. For example, the external operator may operate a control device that includes a display for displaying captured images output from the sensor 300, a steering wheel for remotely controlling the vehicle 100, an accelerator pedal, a brake pedal, and a communication device for communicating with the server 200 via wired or wireless communication, and the server 200 may generate a driving control signal in accordance with the operation applied to the control device.

[0110] (YY6) In each of the above driving control examples, the vehicle 100 only needs to have a configuration that allows it to move by unmanned operation, and may be in the form of a platform having the configuration described below. Specifically, in order for the vehicle 100 to perform the three functions of "driving," "turning," and "stopping" by unmanned operation, it only needs to be equipped with at least a vehicle control device 110 and an actuator group 120. When the vehicle 100 acquires information from the outside for unmanned operation, the vehicle 100 may further be equipped with a communication device 130. That is, the vehicle 100 that can move by unmanned operation does not need to have at least some of the interior parts such as the driver's seat and dashboard installed, at least some of the exterior parts such as the bumper and fender installed, and does not need to have a body shell installed. In this case, the remaining parts such as the body shell may be attached to the vehicle 100 before it is shipped from the factory FC, or the remaining parts such as the body shell may be attached to the vehicle 100 after it has been shipped from the factory FC, while the remaining parts such as the body shell are not attached to the vehicle 100. Each part may be attached from any direction, such as the top, bottom, front, rear, right, or left side of the vehicle 100, and each part may be attached from the same direction or from different directions. The positioning of the platform can also be determined in the same way as the vehicle 100 in the first embodiment.

[0111] (YY7) Vehicle 100 may be manufactured by combining multiple modules. A module means a unit composed of multiple parts grouped together according to the part or function of the vehicle 100. For example, the platform of vehicle 100 may be manufactured by combining a front module that constitutes the front part of the platform, a central module that constitutes the central part of the platform, and a rear module that constitutes the rear part of the platform. The number of modules that constitute the platform is not limited to three, but may be two or fewer, or four or more. In addition to, or instead of, the parts that constitute the platform may be modularized, as well as parts that constitute parts of the vehicle 100 that are different from the platform. Various modules may also include any exterior parts such as bumpers and grilles, or any interior parts such as seats and consoles. Furthermore, not limited to vehicle 100, any type of mobile body may be manufactured by combining multiple modules. Such modules may be manufactured, for example, by joining multiple parts by welding or fasteners, or by integrally molding at least a part of the parts that constitute the module as a single part by casting. A molding technique for integrally molding a single component, especially a relatively large component, is also called gigacast or megacast. For example, the front module, central module, and rear module mentioned above may be manufactured using gigacast.

[0112] (YY8) Transporting vehicle 100 using the unmanned operation of the vehicle 100 is also called "autonomous transport." The configuration for realizing autonomous transport is also called a "vehicle remote control autonomous driving transport system." Furthermore, a production method that uses autonomous transport to produce vehicle 100 is also called "autonomous production." In autonomous production, for example, at a factory fuel cell (FC) that manufactures vehicle 100, at least a portion of the transport of vehicle 100 is realized by autonomous transport.

[0113] (YY9) In each of the above driving control examples, some or all of the functions and processes implemented in software may be implemented in hardware. Also, some or all of the functions and processes implemented in hardware may be implemented in software. As hardware for implementing the various functions in each of the above embodiments, various circuits such as integrated circuits and discrete circuits may be used.

[0114] In the above driving control examples 1 and 2, the driving control shown in Figures 3 to 7 can also be applied. For example, the remote control unit 210 shown in Figure 9 performs driving control using image processing. In addition, in Figures 8 to 12, driving control using the suspension string 32 and control device 30 shown in Figures 3 and 4 may also be applied.

[0115] Furthermore, some or all of the processing in the aforementioned sensor 300, vehicle 100, server 200, sensor 300, robot 600, etc., can be implemented as computer programs. Such programs can be stored using various types of non-temporary computer-readable media and supplied to a computer. Non-temporary computer-readable media include various types of tangible recording media. Examples of non-temporary computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (Random Access Memory)). Programs may also be supplied to a computer using various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. Temporary computer-readable media can be supplied to a computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0116] It should be noted that the present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. [Explanation of Symbols]

[0117] 30 Control equipment 31 string 32 Hanging string 50 Vehicle Manufacturing Systems 100 vehicles 115 Vehicle Control Unit 120 Actuator Group 130 Communication equipment 200 servers 230 Communication equipment 231 Receiver 232 Transmitter 252 Worker detection unit 254 Attitude detection unit 256 Comparison Section 257 Driving Control Unit 300 sensors 330 Communication equipment A Driving area

Claims

1. A vehicle manufacturing system that controls multiple vehicles to travel in a convoy during the manufacturing or transport process, A camera that captures images of the driving area and its surroundings where multiple vehicles are traveling, A worker detection unit detects a worker based on the image captured by the aforementioned camera, A posture detection unit detects the posture of the worker by performing image processing on the image captured by the aforementioned camera, A comparison unit that compares the worker's posture with a preset reference posture, A vehicle manufacturing system comprising: a driving control unit that controls the driving of the vehicle according to the comparison results in the comparison unit; and a vehicle manufacturing system comprising:

2. Multiple reference orientations are set in the comparison unit. Control content is assigned to each of the aforementioned multiple reference postures, The vehicle manufacturing system according to claim 1, wherein the control content includes one or more of the following: emergency stop, temporary stop, deceleration, acceleration, and start.

3. The vehicle manufacturing system according to claim 1 or 2, wherein the reference posture includes a posture in which the arms are raised.

4. The vehicle manufacturing system according to claim 3, wherein the reference posture has two or more consecutive poses.

5. A vehicle manufacturing method that controls multiple vehicles to travel in a convoy during the manufacturing process or the transport process, The steps include: using a camera to capture images of the driving area and its surroundings where multiple vehicles are traveling; The steps include detecting a worker based on the image captured by the aforementioned camera, The steps include: detecting the worker's posture by performing image processing on the image captured by the camera; A step of comparing the worker's posture with a pre-set reference posture, A vehicle manufacturing method comprising the step of controlling the driving of the vehicle according to the comparison result in the comparison unit.

Images