Automated Transport System

Abstract

To provide a technique which can accurately acquire the position of an unmanned conveyor.SOLUTION: An unmanned conveyance system includes: an unmanned conveyor which is used for conveying a conveyed object and in which an identification code indicating identification information for identifying at least either one of the conveyed object and the unmanned conveyor and a stop position confirmation marker are arranged; a stereo camera which is arranged at a stop planned position of the unmanned conveyor so as to acquire images of the identification code and the stop position confirmation marker; and an information processor which acquires three-dimensional stop positional information and the identification information on the unmanned conveyor from the images and transmits the three-dimensional stop positional information to a post-process facility for performing processing in a post process of the conveyance of the conveyed object by the unmanned conveyor when the identification information complies with a prefixed condition.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to automated guided transport systems. [Background technology]

[0002] Patent Document 1 discloses an unmanned transport system that acquires position information and identification information of the unmanned transport vehicle and the transported object, and controls the movement of the unmanned transport vehicle. This unmanned transport system captures a recognition marker that an operator places at a predetermined position on the transported object with a camera arranged above the travel path of the unmanned transport vehicle. The unmanned transport system acquires the positions of the unmanned transport vehicle and the transported object on a map from the coordinates of the recognition marker included in the acquired image, and controls the movement and stopping of the unmanned transport vehicle based on the position information of the unmanned transport vehicle and the transported object on the acquired map, and identifies the transported object and the unmanned transport vehicle from the marker identification number acquired from the position recognition marker. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-086198 Summary of the Invention [Problem to be solved by the invention]

[0004] In such an automated guided transport system, there are cases where a process that requires high positional accuracy is performed in a post-process, so there is a demand for technology that can detect the positions of the automated guided transport vehicle and the transported object with high accuracy. [Means for solving the problem]

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to one aspect of the present disclosure, an unmanned transport system is provided, the unmanned transport system including an unmanned transport vehicle for transporting an object, the unmanned transport vehicle having an identification code and a stop position confirmation marker arranged thereon, the identification code indicating identification information for identifying at least one of the object and the unmanned transport vehicle, a stereo camera arranged at a planned stop position of the unmanned transport vehicle for acquiring images of the identification code and the stop position confirmation marker, and an information processing device that acquires three-dimensional stop position information and the identification information of the unmanned transport vehicle from the images, and transmits the three-dimensional stop position information to a downstream process facility that performs a process downstream of the transport of the object by the unmanned transport vehicle when the identification information meets a predetermined condition. According to this form of unmanned transport system, the position of the unmanned transport vehicle can be obtained with high accuracy by using a stereo camera to obtain three-dimensional stopping position information using a stopping position confirmation marker placed on the unmanned transport vehicle. (2) In the automated guided transport system of the above aspect, the information processing device may issue an abnormality notification when the identification information does not match the production instruction. According to this form of automated guided vehicle system, the user can quickly respond to the occurrence of an abnormality by receiving the notification. (3) In the unmanned transport system of the above aspect, the identification code may be configured to be changeable. According to this aspect of the unmanned transport system, the correspondence between the identification code and at least one of the identification information of the unmanned transport vehicle and the identification information of the transported object can be updated by the simple method of changing the identification code. (4) In the unmanned transport system of the above aspect, the information processing device may rewrite the correspondence between the identification code and the identification information without changing the identification code. According to this embodiment of the unmanned transport system, the function of transporting the object targeted by the identification code can be transferred to another unmanned transport vehicle in a simple manner without changing the identification code. (5) In the unmanned transport system of the above aspect, the post-processing facility may be a robot that grasps the transported object in accordance with the transmitted three-dimensional stop position information. According to this type of automated guided transport system, the robot can adjust its position using the three-dimensional stop position information acquired by the stereo camera, and therefore the positioning accuracy of the robot can be improved without providing the robot with additional sensors such as cameras. The present disclosure can also be realized in various forms other than an unmanned transport system, for example, an unmanned transport machine, a transport method, a control method for an unmanned transport machine, a control method for an unmanned transport system, a computer program for realizing the control method, a non-transitory recording medium on which the computer program is recorded, etc. [Brief description of the drawings]

[0007] [Figure 1] 1 is an explanatory diagram showing an overall configuration of an automated guided vehicle system according to a first embodiment of the present disclosure; [Diagram 2] FIG. 2 is a block diagram showing the functional configuration of the automated guided vehicle system. [Diagram 3] 4 is a flowchart showing a transport process of an unmanned transport vehicle executed by the unmanned transport system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] A. First embodiment: FIG. 1 is an explanatory diagram showing the overall configuration of an automated guided transport system 500 according to a first embodiment of the present disclosure. FIG. 2 is a block diagram showing the functional configuration of the automated guided transport system 500. The automated guided transport system 500 manages processes in a production line that manufactures vehicle parts, for example. In the example of FIG. 1, the processes in the production line include a target process P2, a previous process P1 immediately before the target process P2, and a next process P3 immediately after the target process P2. The target process P2 is a so-called material handling process in which a transported object WK processed in the previous process P1 is transferred to the next process P3. The transported object WK includes, for example, a vehicle, a vehicle part, and the like. The automated guided transport system 500 manages the target process P2 and controls a plurality of automated guided transport machines 20 and a transport robot 30 that perform the work of the target process P2.

[0009] 1, the automated guided vehicle system 500 includes a conveyor control device 200, a plurality of automated guided vehicles 20, a robot control device 300, a conveyor robot 30, a stereo camera 400, and an information processing device 100. The conveyor control device 200 receives a control signal from the information processing device 100, and controls the automated guided vehicle 20 in response to the received control signal.

[0010] The automated guided vehicle 20 is a so-called autonomous mobile robot (AMR), and performs self-location estimation, mapping, and automatic travel using a SLAM method using LiDAR or the like. The automated guided vehicle 20 carries an object WK to be transported, and transports the object WK according to instructions from a transport vehicle control device 200. In this embodiment, the object WK is placed at a predetermined position on the automated guided vehicle 20. The automated guided vehicle 20 may be an automated guided vehicle (AGV) with a fixed travel route.

[0011] In the example of Fig. 1, the unmanned carrier 20 includes a plurality of unmanned carriers 210, 220 that circulate between a preceding process P1 and a target process P2. Each unmanned carrier 210, 220 is assigned identification information for individually identifying the unmanned carrier 20, and a control instruction is issued by designating the identification information of the unmanned carrier 20. In the following description, when the unmanned carriers 210, 220 are not to be distinguished from each other, they will be collectively referred to as "unmanned carrier 20."

[0012] In this embodiment, the unmanned carrier 20 travels along the travel routes RT1, RT2, and RT3 associated with the target process P2 and the previous process P1. When the unmanned carrier 20 receives a travel instruction, it travels along the travel routes RT1, RT2, and RT3 to a predetermined target position at a predetermined speed. For example, when the unmanned carrier 210 shown in FIG. 1 is loaded with the transported object WK after processing in the previous process P1, it travels along the travel route RT1 and enters the target process P2. The unmanned carrier 220 shown in FIG. 1 travels along the travel route RT2 and stops at a predetermined stop position SP adjacent to the transport robot 30. At the stop position SP, the transport robot 30 transports the transported object WK on the unmanned carrier 20. When the transport of the transported object WK is completed, it travels along the travel route RT3 shown in FIG. 1 and returns to the previous process P1.

[0013] The robot control device 300 receives a control signal from the information processing device 100 and controls the transport robot 30 in response to the received control instruction. The transport robot 30 is an example of a post-processing facility that performs processing after the transport of the transported object WK by the unmanned transport vehicle 20. "Processing" means performing a specific task on the transported object WK, such as machining or transport. The post-processing does not have to be the process immediately after the transport of the transported object WK, and other processes may be included between the transport of the transported object WK and the post-processing.

[0014] The transport robot 30 is an example of a post-processing facility that performs post-processing. In this embodiment, the transport robot 30 performs transport of the transported object WK to the next process P3 as an example of the post-processing. More specifically, under the control of the robot control device 300, the transport robot 30 grips the transported object WK on the unmanned transport vehicle 20 at the stop position SP and transfers it to the unmanned transport vehicle 230 of the next process P3. As described later, the transport robot 30 controls the robot hand 302 with reference to the three-dimensional coordinates of the unmanned transport vehicle 20 output from the information processing device 100, and grips the transported object WK on the unmanned transport vehicle 20. The transport robot 30 rotates around the central axis AX while gripping the transported object WK, and releases and transfers the transported object WK on the unmanned transport vehicle 230 of the next process P3.

[0015] An identification code 202 and a stop position confirmation marker 204 are arranged on the unmanned transport vehicle 20. The identification code 202 is a two-dimensional code. The identification code 202 is associated with identification information for identifying the unmanned transport vehicle 20, such as the ID, type, model number, and identification number of the unmanned transport vehicle 20. In this embodiment, the identification code 202 is also associated with identification information for identifying the transported object WK, such as the ID, product name, type, model number, identification number, and serial number of the transported object WK mounted on the unmanned transport vehicle 20. Note that "the identification code 202 and the stop position confirmation marker 204 are arranged on the unmanned transport vehicle 20" includes a state in which the identification code 202 and the stop position confirmation marker 204 are arranged on the transported object WK mounted on the unmanned transport vehicle 20.

[0016] The information set in the identification code 202 can be read from an image capturing the identification code 202. The identification code 202 can be any of various markers that can be recognized by the stereo camera 400, such as a QR code (registered trademark), an AR (Augmented Reality) marker, other two-dimensional codes, or one-dimensional codes such as a barcode. The identification code 202 may be associated only with the identification information of either the automated guided vehicle 20 or the transported object WK.

[0017] The stop position confirmation marker 204 is a marker for the information processing device 100 to acquire three-dimensional stop position information of the unmanned transport vehicle 20. The three-dimensional stop position information of the unmanned transport vehicle 20 is, for example, the three-dimensional coordinates of the unmanned transport vehicle 20. In this embodiment, the transported object WK is fixed and placed at a predetermined position on the unmanned transport vehicle 20. Therefore, it is also possible to acquire the three-dimensional coordinates of the transported object WK by the stop position confirmation marker 204. For the stop position confirmation marker 204, various geometric shapes such as a circle or a polygon can be used. For the stop position confirmation marker 204, various markers that can acquire three-dimensional coordinates by utilizing the parallax of the stereo camera 400 may be used. In this embodiment, the information processing device 100 can acquire the relative position of the unmanned transport vehicle 20 with respect to the reference position where it should stop at the stop position SP, that is, the amount of deviation from the reference position, from an image captured of the stop position confirmation marker 204.

[0018] The stereo camera 400 acquires images of the identification code 202 and the stop position confirmation marker 204 of the unmanned transport vehicle 20. The identification code 202 and the stop position confirmation marker 204 are arranged close to each other. Therefore, the stereo camera 400 can acquire images of both the identification code 202 and the stop position confirmation marker 204 by capturing an image once. It is preferable that the angle of view of the stereo camera 400 is set wide in consideration of the variation in the stop position at the stop position SP of the unmanned transport vehicle 20. The stereo camera 400 outputs the acquired images to the information processing device 100.

[0019] The information processing device 100 is a personal computer including a CPU 60 as a central processing unit, a memory 70 such as a ROM or a RAM, a communication unit 50, and an interface circuit 40. A display unit 120 and a notification unit 140 are connected to the interface circuit 40. The display unit 120 is a display that displays the transportation state of the automated guided vehicle 20, production instruction information, and the like in accordance with the processing of the information processing device 100. The notification unit 140 is, for example, an andon (Error indicator light), and notifies a user, a manager, a worker, and the like that an abnormality has occurred in production.

[0020] The communication unit 50 is a circuit for wireless communication with the conveyor control device 200, the robot control device 300, the stereo camera 400, and the production management device 600. Through wireless communication, the information processing device 100 transmits control signals to the conveyor control device 200 and the robot control device 300, acquires images from the stereo camera 400, and acquires production instruction information from the production management device 600 that manages the production plan of the entire production line.

[0021] The CPU 60 executes the programs stored in the memory 70 to realize various functions provided in this embodiment, such as a control unit 62 and a determination unit 64. The control unit 62 controls the multiple unmanned transport vehicles 20 and the transport robot 30. The determination unit 64 analyzes images captured by the stereo camera 400 and determines abnormalities in the target process P2. Note that the functions required for the information processing device 100 may be realized by multiple arbitrary devices.

[0022] The readable / writable area of ​​the memory 70 stores information necessary for each unit of the information processing device 100 to perform processing. As shown in Fig. 2, the memory 70 includes a production instruction storage area 72, a conveyor information storage area 74, a position information storage area 76, and a processing condition storage area 78. The memory 70 may be configured as an external storage device or database.

[0023] The production instruction storage area 72 stores production instruction information for the target process P2. The production instruction information includes, for example, the type, product number, identification information, processing order, processing date and time, processing conditions, and identification information of the automated guided vehicle 20 carrying the transported object WK, of the transported object WK to be processed in the target process P2. The production instruction information may be received from the production management device 600, or may be input by a user. The transport vehicle information storage area 74 stores identification information of the automated guided vehicle 20 and the transported object WK to be loaded on the automated guided vehicle 20.

[0024] The position information storage area 76 stores three-dimensional coordinates of the unmanned carrier 20 stopped at the stop position SP, and three-dimensional coordinates of the transported object WK loaded on the unmanned carrier 20. The position information storage area 76 may further store position information of the unmanned carrier 20 and the transported object WK on the travel routes RT1, RT2, RT3 from a self-position sensor attached to the transported object WK or the unmanned carrier 20. Examples of the self-position sensor include a Global Navigation Satellite System (GNSS) and a gyro sensor.

[0025] The processing condition storage area 78 stores conditions for processing by the downstream process equipment. In this embodiment, an operation procedure of the robot hand 302 corresponding to each identification information of the transported object WK is stored as a condition for processing by the downstream process equipment. The operation procedure of the robot hand 302 includes, for example, a reference position in three-dimensional coordinates of the transported object WK at the stop position SP, a position for gripping the transported object WK, a gripping method by the robot hand 302, and the like.

[0026] 3 is a flowchart showing the transport process of the automated guided vehicle 20 executed by the automated guided vehicle system 500. This flow is started, for example, when the automated guided vehicle system 500 is started.

[0027] In step S10, the information processing device 100 acquires production instruction information from the production management device 600. The control unit 62 acquires identification information of the unmanned conveying vehicle 20 to be controlled from the production instruction information. In step S20, the control unit 62 transmits a control signal to the conveying vehicle control device 200 to move the unmanned conveying vehicle 20 having the identification information to be controlled to the stop position SP, which is the destination position. The control unit 62 may acquire the transported object WK to be the target of the production instruction instead of the unmanned conveying vehicle 20. In this case, the control unit 62 acquires the unmanned conveying vehicle 20 carrying the target transported object WK from the conveying vehicle information storage area 74.

[0028] In step S30, the unmanned carrier 20 arrives at the stop position SP by automatic travel. The information processing device 100 acquires information that the unmanned carrier 20 has arrived at the stop position SP from feedback from the carrier control device 200, or from the stereo camera 400 that has detected the stop position confirmation marker 204. If the unmanned carrier 20 that should arrive is not detected, the stop position of the unmanned carrier 20 may be determined to be abnormal, and the anomaly may be notified by the notification unit 140.

[0029] In step S40, the stereo camera 400, under the control of the control unit 62, simultaneously captures images of the identification code 202 and the stop position confirmation marker 204 arranged on the automated guided vehicle 20. The stereo camera 400 transmits the captured images of the identification code 202 and the stop position confirmation marker 204 to the information processing device 100.

[0030] In step S50, the determination unit 64 performs image analysis of the acquired stop position confirmation marker 204, and acquires three-dimensional coordinates of the automated guided vehicle 20. More specifically, the determination unit 64 acquires an image captured by the stereo camera 400, and performs image analysis of the stop position confirmation marker 204 included in the acquired image. Examples of image analysis include the SGM (Semi Global Matching) method and the SAD (Sum of Absolute Difference) method. As a result, the determination unit 64 acquires three-dimensional coordinates of the automated guided vehicle 20 relative to the reference position where the automated guided vehicle 20 should stop at the stop position SP. The determination unit 64 stores the acquired three-dimensional coordinates in the position information storage area 76.

[0031] In step S60, the determination unit 64 performs image analysis on the acquired identification code 202. In step S70, the determination unit 64 compares the identification information of the automated guided vehicle 20 and the identification information of the transported object WK obtained by image analysis with the production instructions acquired in step S10. If the identification information matches the production instructions (S70: YES), the determination unit 64 transitions the process to step S80.

[0032] In step S80, the control unit 62 reads out the three-dimensional coordinates of the unmanned transport vehicle 20 acquired in step S50 from the position information storage area 76 and transmits them to the robot control device 300. In step S90, the control unit 62 transmits a control signal to the robot control device 300 to control the transport robot 30 to transfer the transported object WK to the next process P3. The robot control device 300 adjusts the position of the transported object WK using the three-dimensional coordinates acquired from the control unit 62 in step S80, and then operates the robot hand 302. This allows the robot hand 302 to accurately grasp the transported object WK even if there is variation in the stopping position of the unmanned transport vehicle 20. When the transport robot 30 transfers the transported object WK to the unmanned transport vehicle 230 of the next process P3, the robot control device 300 transmits the result of the transport process to the information processing device 100. In step S100, the control unit 62 transmits a control signal to the conveyor control device 200 to move the automated conveyor 20 from the stop position SP to the front-stage process P1, and the process is completed.

[0033] In step S70, if the information on the transported object WK does not match the production instructions (S70: NO), the determination unit 64 transitions the process to step S110. In step S110, the control unit 62 transmits control signals to the transport machine control device 200 and the robot control device 300 to stop the unmanned transport vehicle 20 and the transport robot 30. In step S120, the determination unit 64 causes the notification unit 140 to notify the abnormal stop of the unmanned transport vehicle 20 and the transport robot 30.

[0034] In step S130, the determination unit 64 rewrites the association between the identification code 202 stored in the conveyor information storage area 74 and the identification information of the unmanned conveyor 20 and the identification information of the transported object WK in order to substitute the processing of the unmanned conveyor 20 that has stopped abnormally for another unmanned conveyor 20. More specifically, the determination unit 64 updates the information stored in the conveyor information storage area 74 to associate the identification code 202 arranged in the other unmanned conveyor 20 to be substituted with the identification information of the transported object WK to be processed. This makes it possible to substitute the function of the unmanned conveyor 20 that has stopped abnormally for another unmanned conveyor 20 in a simple manner without changing the identification code 202, thereby suppressing or preventing a decrease in productivity. Note that, in cases where it is not necessary to substitute the function for another unmanned conveyor 20, step S130 may be omitted.

[0035] As described above, the unmanned transport system 500 of this embodiment includes the unmanned transport vehicle 20 on which the identification code 202 and the stop position confirmation marker 204 are arranged, the identification code 202 and the stop position confirmation marker 204 indicate identification information for identifying at least one of the transported object WK and the unmanned transport vehicle 20, the stereo camera 400 arranged at the planned stop position of the unmanned transport vehicle 20 to acquire images of the identification code 202 and the stop position confirmation marker 204, and the information processing device 100 that acquires three-dimensional stop position information and identification information of the unmanned transport vehicle 20 from the acquired image and transmits the three-dimensional stop position information to the transport robot 30 that performs the transport process in the subsequent process when the identification information matches a predetermined condition. The stereo camera 400 acquires three-dimensional coordinates using the stop position confirmation marker 204 arranged on the unmanned transport vehicle 20, so that the position of the unmanned transport vehicle 20 can be acquired with high accuracy. In addition, the stereo camera 400 can acquire both the identification code 202 and the stop position confirmation marker 204 with one detection device, and the increase in the number of parts of the unmanned transport system 500 can be suppressed. By transmitting the three-dimensional coordinates acquired by the stereo camera 400 to the transfer robot 30 in the subsequent process, calibration can be performed without providing the automatic transfer device 20 and the transfer robot 30 with a position sensor.

[0036] According to the automated guided transport system 500 of this embodiment, the information processing device 100 issues an abnormality notification when the identification information indicated by the identification code 202 does not match the production instruction. Therefore, the user can respond to the occurrence of an abnormality early.

[0037] According to the automated guided vehicle system 500 of this embodiment, the information processing device 100 rewrites the correspondence between the identification code 202 and the identification information without changing the identification code 202. This makes it possible to substitute the functions of the automated guided vehicle 20 for another automated guided vehicle 20 in a simple manner without changing the identification code 202 arranged in the automated guided vehicle 20.

[0038] According to the automated guided transport system 500 of this embodiment, the post-processing facility is the transport robot 30 equipped with the robot hand 302 that grasps the transported object WK according to the transmitted three-dimensional stop position. Since the position adjustment can be performed using the three-dimensional position acquired by the stereo camera 400, the alignment accuracy of the transport robot 30 can be improved without providing the transport robot 30 with an additional sensor such as a camera.

[0039] B. Other embodiments: (B1) In the above embodiment, the determination unit 64 rewrites the correspondence between the identification code 202 and the identification information of the unmanned conveying device 20 and the identification information of the transported object WK, and causes another unmanned conveying device 20 to take over the function. In contrast to this, the correspondence between the identification code and the identification information of the unmanned conveying device 20 and the identification information of the transported object WK may be rewritten by rewriting the identification code, for example, by rewriting the identification code to the same identification code as the identification code 202 of the original unmanned conveying device 20. By the simple method of rewriting the identification code, it is possible to update the association between the identification code 202 and the identification information of the unmanned conveying device 20 and the identification information of the transported object WK. The identification code can be rewritten, for example, by switching the display of the identification code 202 using the identification code 202 displayed on a liquid crystal display. The identification code may also be rewritten by attaching the changed identification code 202 on the identification code 202 before the change. Furthermore, by using an identification code 202 that uses a temperature-changing material containing a leuco dye and a color developer, a different identification code 202 may be rewritten by changing the temperature of the identification code 202 .

[0040] The present disclosure is not limited to the above-mentioned embodiment, and can be realized in various configurations without departing from the spirit of the present disclosure. For example, the technical features in the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention column can be appropriately replaced or combined to solve some or all of the above-mentioned problems or to achieve some or all of the above-mentioned effects. Furthermore, if the technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]

[0041] 20...unmanned transport vehicle, 30...transport robot, 40...interface circuit, 50...communication unit, 60...CPU, 62...control unit, 64...judgment unit, 70...memory, 72...production instruction storage area, 74...transport vehicle information storage area, 76...position information storage area, 78...processing condition storage area, 100...information processing device, 120...display unit, 140...alarm unit, 200...transport vehicle control device, 202...identification code, 204...stop position confirmation marker, 210...unmanned transport vehicle, 220...unmanned transport vehicle, 230...unmanned transport vehicle, 300...robot control device, 302...robot hand, 400...stereo camera, 500...unmanned transport system, 600...production management device, RT1 to RT3...travel path, SP...stop position, WK...transported object

Claims

1. An automated guided transport system, an unmanned transport vehicle for transporting an object, the unmanned transport vehicle being provided with an identification code and a stop position confirmation marker indicating identification information for identifying at least one of the object and the unmanned transport vehicle; a stereo camera arranged at a planned stop position of the automated guided vehicle for acquiring images of the identification code and the stop position confirmation marker; and an information processing device that acquires three-dimensional stop position information and the identification information of the automated guided vehicle from the image, and transmits the three-dimensional stop position information to a downstream process facility that performs processing of a downstream process prior to the transportation of the transported object by the automated guided vehicle when the identification information meets a predetermined condition. Automated transport system.

2. The automated guided transport system according to claim 1 , wherein the information processing device issues an abnormality notification when the identification information does not match the predetermined condition.

3. The automated guided vehicle system according to claim 1 , wherein the identification code is configured to be changeable.

4. The automated guided transport system according to claim 1 , wherein the information processing device rewrites the correspondence between the identification code and the identification information without changing the identification code.

5. 2. The automated guided transport system according to claim 1, wherein the downstream process facility is a robot that grasps the transported object in accordance with the transmitted three-dimensional stop position information.

Images