Vehicle manufacturing system, vehicle manufacturing method and program
The vehicle manufacturing system addresses the challenge of detecting abnormalities in vehicle operations by using external and internal sensors to compare vehicle positions and attitudes, ensuring safe and controlled vehicle movements through control adjustments and notifications.
Patent Information
- Application Number
- JP2024024429
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-21
- Publication Date
- 2025-09-02
AI Technical Summary
Existing vehicle manufacturing systems lack the ability to detect abnormalities when the difference between external and internal vehicle information exceeds a predetermined threshold, which can lead to unsafe conditions during autonomous or remote-controlled vehicle operations.
A vehicle manufacturing system that utilizes first and second information acquisition means, such as imaging devices, LiDAR, radar, GPS, or ultrasonic sensors, to compare external and internal vehicle positions and attitudes, and switches control or notifies an external party when the difference exceeds a predetermined value, allowing for abnormality detection.
The system effectively detects abnormalities by comparing external and internal vehicle information, ensuring safe and controlled vehicle operations by stopping or decelerating vehicles and notifying external devices when necessary, thereby maintaining safety and efficiency in vehicle manufacturing processes.
Smart Images

Figure 2025127634000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a vehicle manufacturing system, a vehicle manufacturing method, and a program. [Background technology]
[0002] Patent Document 1 describes a vehicle that travels autonomously or by remote control within a manufacturing system for producing vehicles. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2017-538619 Summary of the Invention [Problem to be solved by the invention]
[0004] However, Patent Document 1 only discloses remote control using information outside the vehicle. Therefore, an object of the present disclosure is to provide a vehicle manufacturing system that detects the occurrence of an abnormality when the difference between first information acquired from outside the vehicle and second information acquired from inside the vehicle is greater than a predetermined value. [Means for solving the problem]
[0005] The vehicle manufacturing system of the present disclosure comprises: a first information acquisition means for acquiring, from outside the plurality of vehicles, first information indicating positions and attitudes of the plurality of vehicles that are manufactured while being continuously moved; a second information acquisition means mounted on at least one of the vehicles for acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle; an abnormality occurrence detection means that switches control of the plurality of vehicles or notifies an external party when a difference between the position and attitude of the plurality of vehicles obtained from the first information and the position and attitude of the plurality of vehicles obtained from the second information is greater than a predetermined value.
[0006] With the above configuration, it is possible to provide a system that detects the occurrence of an abnormality when the difference between the first information acquired from outside the vehicle and the second information acquired from inside the vehicle is greater than a predetermined value.
[0007] The vehicle manufacturing system of the present disclosure comprises: the first information is an image or a distance; the second information is an image or a distance; the first information acquisition means is an imaging device, a LiDAR, a radar, a GPS, or an ultrasonic sensor; The second information acquisition means is an imaging device, LiDAR, radar, GPS, or an ultrasonic sensor.
[0008] The above configuration is an example of the first information, the second information, the first information acquisition means, and the second information acquisition means.
[0009] The vehicle manufacturing system of the present disclosure comprises: The switching of the control of the plurality of vehicles is characterized by stopping or decelerating the plurality of vehicles.
[0010] The above configuration is an example of switching of vehicle control.
[0011] The vehicle manufacturing system of the present disclosure comprises: The notification to the outside is characterized by notifying a manager, a worker, or a production management system of the abnormality.
[0012] The above configuration is an example of notification to the outside.
[0013] The vehicle manufacturing system of the present disclosure comprises: The predetermined value varies depending on the specific section.
[0014] With the above configuration, the threshold value of the difference, which is a predetermined value, can be changed depending on the specific section.
[0015] The vehicle manufacturing system of the present disclosure comprises: The specific section is characterized in that it is a section where the vehicle must make a U-turn, a section with a large turning curvature, or a slope.
[0016] The above configuration is an example of a specific section.
[0017] The vehicle manufacturing method of the present disclosure includes: acquiring first information indicating positions and orientations of a plurality of vehicles that are manufactured while being continuously moved, using a first information acquisition means external to the plurality of vehicles; acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle using a second information acquisition means mounted on at least one of the vehicles; A vehicle manufacturing method in which, when a difference between the position and attitude of the plurality of vehicles acquired from the first information acquisition means and the position and attitude of the plurality of vehicles acquired from the second information acquisition means is greater than a predetermined value, control of the plurality of vehicles is switched or a notification is sent to the outside.
[0018] The above configuration provides a method for detecting the occurrence of an abnormality when the difference between the first information acquired from outside the vehicle and the second information acquired from inside the vehicle is greater than a predetermined value.
[0019] The program of the present disclosure is acquiring first information indicating positions and orientations of a plurality of vehicles that are manufactured while being continuously moved, using a first information acquisition means external to the plurality of vehicles; acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle using a second information acquisition means mounted on at least one of the vehicles; The program causes an information processing device to switch control of the multiple vehicles or notify an external device when a difference between the position and attitude of the multiple vehicles acquired from the first information acquisition means and the position and attitude of the multiple vehicles acquired from the second information acquisition means is greater than a predetermined value.
[0020] With the above configuration, a program can be provided that causes an information processing device to detect the occurrence of an abnormality when the difference between first information acquired from outside the vehicle and second information acquired from inside the vehicle is greater than a predetermined value. [Effects of the Invention]
[0021] The present disclosure provides a vehicle manufacturing system or the like that generates an abnormality when a difference between first information acquired from outside the vehicle and second information acquired from inside the vehicle is greater than a predetermined value. [Brief explanation of the drawings]
[0022] [Figure 1] 1 is a schematic diagram illustrating an overview of a vehicle manufacturing system according to an embodiment. [Figure 2] 1 is a block diagram showing a configuration of a vehicle manufacturing system according to an embodiment; [Figure 3] 1 is a flowchart of a vehicle manufacturing method according to an embodiment. [Figure 4] FIG. 2 is a diagram for explaining vehicle travel control. [Figure 5] FIG. 2 is a control block diagram for explaining a first example of driving control. [Figure 6] 1 is a flowchart illustrating a first example of driving control. [Figure 7] FIG. 10 is a control block diagram for explaining a second example of driving control. [Figure 8] 10 is a flowchart illustrating a second example of driving control. DETAILED DESCRIPTION OF THE INVENTION
[0023] Embodiment Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the invention according to the claims is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential means for solving the problems. For clarity of explanation, the following description and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.
[0024] (Description of an outline of a vehicle manufacturing system according to an embodiment) Fig. 1 is a schematic diagram showing an overview of a vehicle manufacturing system according to an embodiment. An overview of a vehicle manufacturing system 50 according to an embodiment will be described with reference to Fig. 1. The vehicle manufacturing system 50 is used in a vehicle manufacturing plant.
[0025] 1, vehicle manufacturing system 50 includes server 200, first information acquisition unit 1111, second information acquisition units 1113 and 1115, a first vehicle 1117, a second vehicle 1119, and wireless communication terminals 1121 and 1123. Outside the vehicle manufacturing system, there is an administrator 1101 and a production management system 1103.
[0026] The manager 1101 is a person who works in a factory. For example, the manager 1101 is a manager or worker of the production management system 1103 or a process. The manager 1101 manages the vehicle manufacturing system 50.
[0027] The production control system 1103 is a manufacturing execution system that monitors and manages the factory equipment and worker work by linking with each part of the factory production line. The production control system 1103 acquires information from the BOP (Bill of Process) and BOE (Bill of Equipment). The production control system 1103 also has a production instruction database to provide production instruction information to the vehicle manufacturing system. The production instructions are instructions to people and equipment, such as the types and specifications of individual products in accordance with the production plan, as well as the parts to be used and procedures.
[0028] The first vehicle 1117 and the second vehicle 1119 are vehicles that are manufactured as a series of vehicles. Hereinafter, the first vehicle 1117 and the second vehicle 1119 are also referred to as vehicle 100. The vehicle 100 is equipped with an ECU (Electronic Control Unit), a battery and a motor on the body, and is equipped with tires, so that it can travel autonomously.
[0029] More specifically, vehicle 100 is an electric vehicle (Battery Electric Vehicle (BEV)). Note that vehicle 100 is not limited to an electric vehicle, and may be, for example, an electric motorcycle, an electric bicycle, an electric kick scooter, a hybrid vehicle, or a fuel cell vehicle. Vehicle 100 may be a vehicle with wheels or a vehicle with tracks, and may be any vehicle, such as a passenger car, truck, bus, two-wheeled vehicle, four-wheeled vehicle, tank, or construction vehicle. Vehicle 100 is not limited to a vehicle, and may also be an electric vertical take-off and landing aircraft (a so-called flying car). Vehicle 100 becomes a completed vehicle by assembling parts while it is moving.
[0030] The first information acquisition unit 1111 acquires first information indicating the position and attitude of the vehicle 100, and the vehicle 100 moves under the control of the server 200. The first information acquisition unit 1111 can use, for example, a LiDAR (Light Detection and Ranging) or an imaging device. The imaging device can be an RGB camera, an RGBD camera, an infrared camera, or the like. The first information acquisition unit 1111 may also be a radar, a GPS (Global Positioning System), or an ultrasonic sensor. The first information is an image or a distance. The first information acquisition unit 1111 acquires the distance and an image of the vehicle 100, and the server 200 calculates the relative position and relative attitude of the vehicle 100. The server 200 may perform image analysis using AI (Artificial Intelligence) to acquire the position and attitude of the vehicle from the image. The position indicates the inter-vehicle distance, and the attitude indicates the direction or steering angle of the vehicle.
[0031] The second information acquisition unit 1113 is mounted on the first vehicle 1117. The second information acquisition unit 1115 is mounted on the second vehicle 1119. The second information acquisition units 1113 and 1115 acquire second information indicating the position and orientation of a vehicle in front of or behind the vehicle. Although FIG. 1 illustrates the second information acquisition unit only acquiring the second information of the front, it may also acquire the second information of the rear. The second information acquisition units 1113 and 1115 are, for example, radar or an imaging device. The second information acquisition unit may be a LiDAR, GPS, or ultrasonic sensor. The second information is an image or distance. The second information acquisition units 1113 and 1115 acquire distances and images of the vehicles in front of or behind the first vehicle 1117 and the second vehicle 1119, and the server 200 calculates the relative positions and relative orientations of the front and rear vehicles. The server 200 may perform image analysis using AI (artificial intelligence) to acquire the position and orientation of the vehicle from the image.
[0032] The wireless communication terminal 1121 is mounted on a first vehicle 1117. The wireless communication terminal 1123 is mounted on a second vehicle 1119. The wireless communication terminal 1121 communicates the second information acquired by a second information acquisition unit 1113 of the first vehicle 1117 to the server 200 via CAN (Controller Area Network) communication. Similarly, the wireless communication terminal 1123 communicates the second information acquired by a second information acquisition unit 1115 of the second vehicle 1119 to the server 200 via CAN communication.
[0033] Server 200 is an information processing device having a memory and a processor, and functions as a vehicle manufacturing control device that controls a vehicle manufacturing system. For example, server 200 receives detection results from first information acquisition unit 1111 and second information acquisition units 1113 and 1115. Server 200 controls the vehicle in accordance with the detection results, etc. Server 200 may be composed of one or more devices. Server 200 may also be a cloud server that distributes and processes some or all of its functions.
[0034] The server 200 performs, for example, signal processing of the first information acquisition unit 1111. The server 200 uses the first information acquired from the first information acquisition unit 1111 to acquire the positions and orientations of the multiple vehicles 100 including the first vehicle 1117 and the second vehicle 1119.
[0035] The server 200 performs, for example, signal processing of the second information acquisition units 1113 and 1115. The server 200 acquires the positions and orientations of the multiple vehicles 100 including the first vehicle 1117 and the second vehicle 1119 using the second information acquired from the second information acquisition units 1113 and 1115.
[0036] When the difference between the positions and attitudes of the multiple vehicles acquired from the first information and the positions and attitudes of the multiple vehicles acquired from the second information is greater than a predetermined value, the server 200 switches the control of the multiple vehicles or notifies an external device. When the difference between the first information and the second information is greater than a predetermined value, for example, when there is an error in the measurement of the inter-vehicle distance, it is dangerous for the vehicle 100 to continue traveling. Therefore, the server 200 determines that an abnormality has occurred in the vehicle manufacturing process and switches the control of the vehicle or notifies an external device.
[0037] Switching vehicle control means stopping or slowing down multiple vehicles traveling in a convoy. Notifying the outside means informing the manager 1101 or the production management system 1103 of an abnormality.
[0038] The predetermined value, which is a threshold value for the difference between the first information and the second information, may vary depending on the section. In sections where vehicles are traveling in a normal convoy, the predetermined value is about 10 cm for the inter-vehicle distance and about 3° for the steering angle, but may be larger in sections where vehicles make U-turns, sections with large turning curvatures, or slopes. For example, in specific sections such as sections where vehicles make U-turns, sections with large turning curvatures, or slopes, the predetermined value may be about 20 cm for the inter-vehicle distance and about 5° for the steering angle. This is because there is a risk that the second information acquisition units 1113 and 1115 may determine the distance and steering angle to be larger than they actually are in specific sections.
[0039] (Description of the configuration of the vehicle manufacturing system according to the embodiment) 2 is a block diagram showing the configuration of a vehicle manufacturing system according to an embodiment, and the configuration of the vehicle manufacturing system according to the embodiment will be described with reference to FIG.
[0040] 2, vehicle manufacturing system 50 includes first information acquisition unit 1111, second information acquisition units 1113 and 1115, and abnormality occurrence detection unit 1125. Abnormality occurrence detection unit 1125 is a part of the functions of server 200.
[0041] The first information acquisition unit 1111 acquires first information indicating the positions and attitudes of the plurality of vehicles manufactured while continuously moving from outside the plurality of vehicles. The first information acquisition unit 1111 is preferably, for example, an infrastructure camera or a LiDAR. The first information acquisition unit 1111 acquires the inter-vehicle distances and steering angle directions of the plurality of vehicles.
[0042] The second information acquisition units 1113 and 1115 are mounted on at least one vehicle and acquire second information indicating the position and attitude of the preceding or following vehicle. The second information acquisition units 1113 and 1115 can acquire the inter-vehicle distance and steering angle direction of the preceding or following vehicle.
[0043] When the difference between the position and attitude of the multiple vehicles obtained from the first information and the position and attitude of the multiple vehicles obtained from the second information is greater than a predetermined value, the abnormality occurrence detection unit 1125 switches control of the multiple vehicles or notifies an external party.
[0044] The first information acquisition unit 1111, the second information acquisition units 1113 and 1115, and the abnormality occurrence detection unit 1125 may be read as a first information acquisition means, a second information acquisition means, and an abnormality occurrence detection means, respectively.
[0045] With this configuration, a vehicle manufacturing system is provided that generates an abnormality when the difference between the first information acquired from outside the vehicle and the second information acquired from inside the vehicle is greater than a predetermined value.
[0046] (Description of the vehicle manufacturing method according to the embodiment) FIG. 3 is a flowchart of the vehicle manufacturing method according to the embodiment. The vehicle manufacturing method according to the embodiment will be described while referring to FIG. 3.
[0047] As shown in FIG. 3, the first information acquisition unit 1111 acquires the first information (step S301). The first information acquisition unit 1111 acquires, from outside the plurality of vehicles, the first information indicating the position and orientation of the plurality of vehicles manufactured while moving continuously.
[0048] Next, the second information acquisition units 1113 and 1115 acquire the second information (step S302). The second information acquisition units 1113 and 1115 are mounted on at least one vehicle and acquire the second information indicating the position and orientation of the vehicle in front or behind.
[0049] Next, when the difference is large, the abnormality occurrence detection unit 1125 switches the control of the vehicle or notifies the outside (step S303). When the difference between the position and orientation of the plurality of vehicles acquired from the first information and the position and orientation of the plurality of vehicles acquired from the second information is larger than a predetermined value, the abnormality occurrence detection unit 1125 switches the control of the plurality of vehicles or notifies the outside.
[0050] With such a configuration, when the difference between the first information acquired from outside the vehicle and the second information acquired from inside the vehicle is larger than a predetermined value, a vehicle manufacturing method that generates an abnormality is provided.
[0051] <A. Travel control example 1> FIG. 4 is a conceptual diagram showing the configuration of the system 50 in travel control example 1. The system 50 includes one or more vehicles 100 as moving bodies, a server 200, and one or more external sensors 300. Hereinafter, the server 200 will be described as the server 200.
[0052] In addition, if the moving body is something other than a vehicle, the expressions "vehicle" and "car" in this disclosure can be replaced with "moving body" as appropriate, and the expression "running" can be replaced with "moving" as appropriate.
[0053] The vehicle 100 is configured to be capable of traveling in an unmanned manner. "Unmanned driving" refers to driving without the driver's control. Driving operation refers to operations related to at least one of "running," "turning," and "stopping" of the vehicle 100. Unmanned driving is achieved by automatic or manual remote control using a device located outside the vehicle 100, or by autonomous control of the vehicle 100. A vehicle 100 traveling in an unmanned manner may have a driver on board who does not operate the vehicle. A driver who does not operate the vehicle may, for example, simply be seated in the vehicle 100, or a person who is riding in the vehicle 100 and performing work other than driving operations, such as assembly, inspection, or operating switches. Driving in which a driver controls the vehicle is sometimes called "manned driving."
[0054] In this specification, "remote control" includes "full remote control" in which all of the operations of vehicle 100 are completely determined from outside vehicle 100, and "partial remote control" in which some of the operations of vehicle 100 are determined from outside vehicle 100. Furthermore, "autonomous control" includes "full autonomous control" in which vehicle 100 autonomously controls its own operations without receiving any information from devices external to vehicle 100, and "partial autonomous control" in which vehicle 100 autonomously controls its own operations using information received from devices external to vehicle 100.
[0055] In this embodiment, the system 50 is used in a factory FC that manufactures vehicles 100. The reference coordinate system of the factory FC is a global coordinate system GC. That is, any position in the factory FC is expressed by X, Y, and Z coordinates in the global coordinate system GC. The factory FC has a first location PL1 and a second location PL2. The first location PL1 and the second location PL2 are connected by a road TR along which the vehicle 100 can travel. In the factory FC, multiple external sensors 300 are installed along the road TR. The position of each external sensor 300 in the factory FC is adjusted in advance. The vehicle 100 moves from the first location PL1 to the second location PL2 along the road TR in an unmanned operation.
[0056] 5 is a block diagram showing the configuration of the system 50. The vehicle 100 includes a vehicle control device 110 for controlling each part of the vehicle 100, an actuator group 120 including one or more actuators that are driven under the control of the vehicle control device 110, and a communication device 130 for communicating via wireless communication with external devices such as a server 200. The actuator group 120 includes an actuator for a drive device for accelerating the vehicle 100, an actuator for a steering device for changing the traveling direction of the vehicle 100, and an actuator for a braking device for decelerating the vehicle 100.
[0057] The vehicle control device 110 is configured by a computer including a processor 111, a memory 112, an input / output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input / output interface 113 are connected via the internal bus 114 to enable bidirectional communication. The input / output interface 113 is connected to an actuator group 120 and a communication device 130. The processor 111 executes a program PG1 stored in the memory 112 to realize various functions including a function as a vehicle control unit 115.
[0058] The vehicle control unit 115 controls the actuator group 120 to cause the vehicle 100 to run. The vehicle control unit 115 controls the actuator group 120 using a running control signal received from the server 200 to cause the vehicle 100 to run. The running control signal is a control signal for causing the vehicle 100 to run. In this embodiment, the running control signal includes the acceleration and steering angle of the vehicle 100 as parameters. In other embodiments, the running control signal may include the speed of the vehicle 100 as a parameter instead of or in addition to the acceleration of the vehicle 100.
[0059] The server 200 is configured by a computer including a processor 201, a memory 202, an input / output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input / output interface 203 are connected via the internal bus 204 to enable bidirectional communication. A communication device 205 is connected to the input / output interface 203 for communicating with various devices external to the server 200. The communication device 205 can communicate with the vehicle 100 via wireless communication, and can communicate with each external sensor 300 via wired communication or wireless communication. The processor 201 executes a program PG2 stored in the memory 202 to realize various functions, including the function of the remote control unit 210.
[0060] The remote control unit 210 acquires detection results from the sensors, generates a driving control signal for controlling the actuator group 120 of the vehicle 100 using the detection results, and transmits the driving control signal to the vehicle 100, thereby remotely controlling the vehicle 100 to drive. The remote control unit 210 may generate and output not only driving control signals but also control signals for controlling actuators that operate various accessories provided in the vehicle 100 and various equipment such as wipers, power windows, and lamps. In other words, the remote control unit 210 may operate these various equipment and accessories by remote control.
[0061] The external sensor 300 is a sensor located outside the vehicle 100. In this embodiment, the external sensor 300 is a sensor that captures the vehicle 100 from outside the vehicle 100. The external sensor 300 is equipped with a communication device (not shown) and can communicate with other devices such as the server 200 via wired communication or wireless communication.
[0062] Specifically, the external sensor 300 is configured by a camera. The camera as the external sensor 300 captures an image including the vehicle 100 and outputs the captured image as a detection result.
[0063] 6 is a flowchart showing the processing procedure for driving control of the vehicle 100 in the driving control example. In the processing procedure in FIG. 6, the processor 201 of the server 200 functions as the remote control unit 210 by executing the program PG2. Also, the processor 111 of the vehicle 100 functions as the vehicle control unit 115 by executing the program PG1.
[0064] In step S110, the processor 201 of the server 200 acquires vehicle position information of the vehicle 100 using the detection results output from the external sensor 300. The vehicle position information is position information that serves as the basis for generating a driving control signal. In this embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the global coordinate system GC of the factory FC. Specifically, in step S110, the processor 201 acquires the vehicle position information using a captured image acquired from a camera, which is the external sensor 300.
[0065] In detail, in step S110, the processor 201, for example, detects the outer shape of the vehicle 100 from the captured image, calculates the coordinates of the positioning point of the vehicle 100 in the coordinate system of the captured image, i.e., the local coordinate system, and converts the calculated coordinates into coordinates in the global coordinate system GC, thereby acquiring the position of the vehicle 100. The outer shape of the vehicle 100 included in the captured image can be detected, for example, by inputting the captured image into a detection model DM that utilizes artificial intelligence. The detection model DM is prepared, for example, inside or outside the system 50, and is stored in advance in the memory 202 of the server 200. The detection model DM may be, for example, a trained machine learning model that has been trained to achieve either semantic segmentation or instance segmentation. For example, a convolutional neural network (hereinafter, CNN) trained by supervised learning using a training dataset may be used as this machine learning model. The training dataset includes, for example, a plurality of training images including the vehicle 100, and labels indicating whether each region in the training images represents the vehicle 100 or a region other than the vehicle 100. During CNN training, it is preferable to update the parameters of the CNN using backpropagation (back propagation) to reduce the error between the output result of the detection model DM and the label. Furthermore, the processor 201 can acquire the orientation of the vehicle 100 by estimating the orientation based on the orientation of the movement vector of the vehicle 100 calculated from the positional changes of feature points of the vehicle 100 between frames of captured images using, for example, an optical flow method.
[0066] In step S120, the processor 201 of the server 200 determines a target position to which the vehicle 100 should next head. In this embodiment, the target position is represented by X, Y, and Z coordinates in the global coordinate system GC. A reference route RR, which is a route to be traveled by the vehicle 100, is stored in advance in the memory 202 of the server 200. The route is represented by nodes indicating the departure point, nodes indicating passing points, nodes indicating the destination, and links connecting the nodes. The processor 201 uses the vehicle position information and the reference route RR to determine a target position to which the vehicle 100 should next head. The processor 201 determines a target position on the reference route RR that is ahead of the current location of the vehicle 100.
[0067] In step S130, the processor 201 of the server 200 generates a travel control signal for causing the vehicle 100 to travel toward the determined target position. The processor 201 calculates the travel speed of the vehicle 100 from the change in the position of the vehicle 100 and compares the calculated travel speed with the target speed. When the travel speed is lower than the target speed, the processor 201 determines an acceleration such that the vehicle 100 accelerates. When the travel speed is higher than the target speed, the processor 201 determines an acceleration such that the vehicle 100 decelerates. Furthermore, when the vehicle 100 is located on the reference route RR, the processor 201 determines a steering angle and acceleration such that the vehicle 100 does not deviate from the reference route RR. When the vehicle 100 is not located on the reference route RR, in other words, when the vehicle 100 has deviated from the reference route RR, the processor 201 determines a steering angle and acceleration such that the vehicle 100 returns to the reference route RR.
[0068] In step S140, processor 201 of server 200 transmits the generated driving control signal to vehicle 100. Processor 201 repeats, at a predetermined cycle, obtaining the position of vehicle 100, determining the target position, generating the driving control signal, and transmitting the driving control signal.
[0069] In step S150, the processor 111 of the vehicle 100 receives a driving control signal transmitted from the server 200. In step S160, the processor 111 of the vehicle 100 controls the actuator group 120 using the received driving control signal, thereby driving the vehicle 100 at the acceleration and steering angle represented by the driving control signal. The processor 111 repeats the reception of the driving control signal and the control of the actuator group 120 at a predetermined cycle. According to the system 50 in this example, the vehicle 100 can be driven by remote control, and the vehicle 100 can be moved without using conveying equipment such as a crane or a conveyor.
[0070] <B:Driving Control Example 2> FIG. 7 is an explanatory diagram showing a schematic configuration of the system 50v in Driving Control Example 2. In this example, the system 50v is different from Driving Control Example 1 in that it does not include the server 200. Also, the vehicle 100v in the configuration can travel by autonomous control of the vehicle 100v. For other configurations, unless otherwise particularly described, they are the same as above.
[0071] In this example, the processor 111v of the vehicle control device 110v functions as the vehicle control unit 115v by executing the program PG1 stored in the memory 112v. The vehicle control unit 115v acquires the output result from the sensor, generates a driving control signal using the output result, and outputs the generated driving control signal to operate the actuator group 120, thereby enabling the vehicle 100v to travel by autonomous control. In this example, in addition to the program PG1, a detection model DM and a reference route RR are stored in the memory 112v in advance.
[0072] FIG. 8 is a flowchart showing the processing procedure of the driving control of the vehicle 100v in Example 2. In the processing procedure of FIG. 8, the processor 111v of the vehicle 100v functions as the vehicle control unit 115v by executing the program PG1.
[0073] In step S210, the processor 111v of the vehicle control device 110v acquires vehicle position information using the detection results output from the camera, which is the external sensor 300. In step S220, the processor 111v determines a target position to which the vehicle 100v should next head. In step S230, the processor 111v generates a driving control signal for driving the vehicle 100v toward the determined target position. In step S240, the processor 111v controls the actuator group 120 using the generated driving control signal, thereby causing the vehicle 100v to drive in accordance with the parameters represented in the driving control signal. The processor 111v repeats the acquisition of vehicle position information, determination of the target position, generation of the driving control signal, and control of the actuators at a predetermined cycle. According to the system 50v in this example, the vehicle 100v can be driven by autonomous control of the vehicle 100v without remote control of the vehicle 100v by the server 200.
[0074] YY: Other driving control examples (YY1) In the above example, the external sensor 300 is a camera. However, the external sensor 300 does not have to be a camera and may be, for example, a LiDAR (Light Detection and Ranging) sensor. In this case, the detection result output by the external sensor 300 may be three-dimensional point cloud data representing the vehicle 100. In this case, the server 200 or the vehicle 100 may acquire vehicle position information by template matching using the three-dimensional point cloud data as the detection result and reference point cloud data prepared in advance.
[0075] (YY2) In driving control example 1, the processes from obtaining vehicle position information to generating driving control signals are executed by server 200. In contrast, at least a part of the processes from obtaining vehicle position information to generating driving control signals may be executed by vehicle 100. For example, the following forms (1) to (3) may be used.
[0076] (1) The server 200 may acquire vehicle position information, determine a target position to which the vehicle 100 should next head, and generate a route from the current location of the vehicle 100 indicated in the acquired vehicle position information to the target position. The server 200 may generate a route to the target position between the current location and the destination, or may generate a route to the destination. The server 200 may transmit the generated route to the vehicle 100. The vehicle 100 may generate a driving control signal so that the vehicle 100 drives on the route received from the server 200, and control the actuator group 120 using the generated driving control signal.
[0077] (2) Server 200 may acquire vehicle position information and transmit the acquired vehicle position information to vehicle 100. Vehicle 100 may determine a target position to which vehicle 100 should next head, generate a route from the current location of vehicle 100 indicated in the received vehicle position information to the target position, generate a driving control signal so that vehicle 100 travels on the generated route, and control actuator group 120 using the generated driving control signal.
[0078] (3) In the above embodiments (1) and (2), the vehicle 100 may be equipped with an internal sensor, and detection results output from the internal sensor may be used for at least one of generating a route and generating a driving control signal. The internal sensor is a sensor equipped in the vehicle 100. The internal sensor may include, for example, a sensor that detects the motion state of the vehicle 100, a sensor that detects the operating state of each part of the vehicle 100, and a sensor that detects the environment around the vehicle 100. Specifically, the internal sensor may include, for example, a camera, LiDAR, millimeter-wave radar, an ultrasonic sensor, a GPS sensor, an acceleration sensor, a gyro sensor, etc. For example, in the above embodiment (1), the server 200 may acquire the detection results of the internal sensor and reflect the detection results of the internal sensor in the route when generating a route. In the above embodiment (1), the vehicle 100 may acquire the detection results of the internal sensor and reflect the detection results of the internal sensor in the driving control signal when generating a driving control signal. In the above embodiment (2), the vehicle 100 may acquire the detection results of the internal sensor and reflect the detection results of the internal sensor in the route when generating a route. In the above embodiment (2), the vehicle 100 may acquire the detection result of the internal sensor, and when generating the driving control signal, may reflect the detection result of the internal sensor in the driving control signal.
[0079] (YY3) In the driving control example 2, the vehicle 100v may be equipped with an internal sensor, and the detection result output from the internal sensor may be used for at least one of generating a route and generating a driving control signal. For example, the vehicle 100v may acquire the detection result of the internal sensor and, when generating a route, reflect the detection result of the internal sensor in the route. The vehicle 100v may acquire the detection result of the internal sensor and, when generating a driving control signal, reflect the detection result of the internal sensor in the driving control signal.
[0080] (YY4) In cruise control example 2, the vehicle 100v acquires vehicle position information using the detection results of the external sensor 300. Alternatively, the vehicle 100v may be equipped with an internal sensor, which acquires vehicle position information using the detection results of the internal sensor, determines a target location to which the vehicle 100v should next travel, generates a route from the current location of the vehicle 100v represented in the acquired vehicle position information to the target location, generates a cruise control signal for traveling along the generated route, and controls the actuator group 120 using the generated cruise control signal. In this case, the vehicle 100v can travel without using any of the detection results of the external sensor 300. The vehicle 100v may acquire a target arrival time or congestion information from outside the vehicle 100v and reflect the target arrival time or congestion information in at least one of the route and the cruise control signal. Furthermore, all of the functional configuration of the system 50v may be provided within the vehicle 100v. In other words, the processing performed by the system 50v in the present disclosure may be performed solely by the vehicle 100v.
[0081] (YY5) In driving control example 1, server 200 automatically generates a driving control signal to be transmitted to vehicle 100. Alternatively, server 200 may generate a driving control signal to be transmitted to vehicle 100 in accordance with the operation of an external operator located outside vehicle 100. For example, the external operator may operate a control device that includes a display that displays captured images output from external sensor 300, a steering wheel for remotely operating vehicle 100, an accelerator pedal, a brake pedal, and a communication device for communicating with server 200 via wired or wireless communication, and server 200 may generate a driving control signal in accordance with the operation applied to the control device.
[0082] (YY6) In each of the above driving control examples, the vehicle 100 may be configured to be capable of moving by unmanned driving, and may be in the form of a platform having the configuration described below, for example. Specifically, the vehicle 100 may be equipped with at least a vehicle control device 110 and an actuator group 120 to perform the three functions of "running," "turning," and "stopping" by unmanned driving. When the vehicle 100 acquires information from the outside for unmanned driving, the vehicle 100 may further be equipped with a communication device 130. In other words, the vehicle 100 capable of moving by unmanned driving may not be equipped with at least some of the interior parts such as a driver's seat and a dashboard, may not be equipped with at least some of the exterior parts such as bumpers and fenders, and may not be equipped with a body shell. In this case, the remaining parts such as the body shell may be attached to the vehicle 100 before the vehicle 100 is shipped from the factory FC, or the remaining parts such as the body shell may be attached to the vehicle 100 after the vehicle 100 is shipped from the factory FC without the remaining parts such as the body shell being attached to the vehicle 100. Each part may be attached from any direction, such as the upper side, lower side, front side, rear side, right side, or left side of the vehicle 100, and may be attached from the same direction or from different directions. Note that the position of the platform configuration may also be determined in the same way as for the vehicle 100 in the first embodiment.
[0083] (YY7) The vehicle 100 may be manufactured by combining multiple modules. A module refers to a unit composed of multiple parts grouped according to the location or function of the vehicle 100. For example, the platform of the vehicle 100 may be manufactured by combining a front module that forms the front portion of the platform, a central module that forms the center portion of the platform, and a rear module that forms the rear portion of the platform. The number of modules that form the platform is not limited to three, but may be two or less, or four or more. In addition to or instead of the parts that form the platform, parts that form portions of the vehicle 100 other than the platform may be modularized. The various modules may include any exterior parts such as a bumper or a grille, or any interior parts such as a seat or a console. Any type of mobile object, not limited to the vehicle 100, may be manufactured by combining multiple modules. Such a module may be manufactured, for example, by joining multiple parts using welding or fasteners, or by integrally molding at least some of the parts that form the module into a single part by casting. The molding method for integrally molding a single component, particularly a relatively large component, is also called gigacasting or megacasting. For example, the front module, center module, and rear module described above may be manufactured using gigacasting.
[0084] (YY8) Transporting vehicle 100 using the unmanned driving of vehicle 100 is also called "self-propelled transport." The configuration for realizing self-propelled transport is also called a "vehicle remote-controlled autonomous transport system." The production method for producing vehicle 100 using self-propelled transport is also called "self-propelled production." In self-propelled production, for example, at a factory FC where vehicle 100 is manufactured, at least a portion of the transport of vehicle 100 is realized by self-propelled transport.
[0085] (YY9) In each of the above driving control examples, some or all of the functions and processes implemented by software may be implemented by hardware. Furthermore, some or all of the functions and processes implemented by hardware may be implemented by software. Various circuits, such as integrated circuits and discrete circuits, may be used as hardware for implementing the various functions in each of the above embodiments.
[0086] Furthermore, some or all of the processes in the external sensor 300, the vehicle 100, the server 200, etc. described above can be realized as a computer program. Such a program can be stored and provided to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be provided to a computer by various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable media can provide the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.
[0087] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention. [Explanation of symbols]
[0088] 50 vehicle manufacturing system, 50v vehicle manufacturing system, 100 vehicle, 100v vehicle, 110 vehicle control device, 110v vehicle control device, 111 processor, 111v processor, 112 memory, 112v memory, 113 input / output interface, 114 internal bus, 115 vehicle control unit, 115v vehicle control unit, 120 actuator group, 130 communication device, 140 power supply port, 200 server, 201 processor, 202 memory, 203 input / output interface, 204 internal bus, 205 communication device, 210 remote control unit, 1101 administrator, 1103 production management system, 1111 first information acquisition unit, 1113 second information acquisition unit, 1115 second information acquisition unit, 1117 first vehicle, 1119 second vehicle, 1121 wireless communication terminal, 1123 Wireless communication terminal, 1125 abnormality detection unit
Claims
1. a first information acquisition means for acquiring, from outside the plurality of vehicles, first information indicating positions and attitudes of the plurality of vehicles that are manufactured while being continuously moved; a second information acquisition means mounted on at least one of the vehicles for acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle; an abnormality occurrence detection means that, when a difference between the positions and attitudes of the plurality of vehicles acquired from the first information and the positions and attitudes of the plurality of vehicles acquired from the second information is greater than a predetermined value, switches control of the plurality of vehicles or notifies an external party.
2. the first information is an image or a distance; the second information is an image or a distance; the first information acquisition means is an imaging device, a LiDAR, a radar, a GPS, or an ultrasonic sensor; The vehicle manufacturing system according to claim 1 , wherein the second information acquisition means is an imaging device, a LiDAR, a radar, a GPS, or an ultrasonic sensor.
3. The vehicle manufacturing system according to claim 1 , wherein switching control of the plurality of vehicles includes stopping or slowing down the plurality of vehicles.
4. 2. The vehicle manufacturing system according to claim 1, wherein the notification to the outside is a notification of the abnormality to a manager, a worker, or a production management system.
5. The vehicle manufacturing system according to claim 1 , wherein the predetermined value varies depending on a specific section.
6. 6. The vehicle manufacturing system according to claim 5, wherein the specific section is a section where the vehicle must make a U-turn, a section with a large turning curvature, or a slope.
7. acquiring first information indicating positions and attitudes of a plurality of vehicles that are manufactured while being continuously moved, using a first information acquisition means external to the plurality of vehicles; acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle using a second information acquisition means mounted on at least one of the vehicles; a vehicle manufacturing method for switching control of the plurality of vehicles or notifying an external party when a difference between the positions and attitudes of the plurality of vehicles acquired from the first information acquisition means and the second information acquisition means is greater than a predetermined value;
8. acquiring first information indicating positions and attitudes of a plurality of vehicles that are manufactured while being continuously moved, using a first information acquisition means external to the plurality of vehicles; acquiring second information indicating the position and attitude of a vehicle in front or behind the vehicle using a second information acquisition means mounted on at least one of the vehicles; A program that causes an information processing device to switch control of the plurality of vehicles or notify an external device when a difference between the position and attitude of the plurality of vehicles acquired from the first information acquisition means and the position and attitude of the plurality of vehicles acquired from the second information acquisition means is greater than a predetermined value.
Citation Information
Patent Citations
On-vehicle image processing device
JP2006151125A
Information processor, system, method, and program
JP2019125354A
Manufacturing method for vehicle
JP2020100179A
Moving object control system, moving object, server device, moving object control method, and moving object control program
JP2023082457A
Method for operating a vehicle and method for operating a manufacturing system
JP2017538619A