Travel line inspection method for transfer robot

The transport robot's imaging system detects deteriorating moving lines and generates warnings to prevent operational disruptions by ensuring path recognition, thus maintaining efficient operation.

JP2024166839APending Publication Date: 2024-11-29FUJITA CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023083219
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-19
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The deterioration of moving lines due to color fading or fraying causes the automatic transport robots to lose track of their path, leading to operational disruptions.

Method used

A method involving a transport robot equipped with an imaging unit that captures images of the moving line and generates warnings when the captured image meets a predetermined condition, such as a threshold area ratio of the line's color, to prevent the robot from continuing operation.

Benefits of technology

Prevents operational disruptions by ensuring the transport robot maintains proper path recognition and alerts operators to maintain or repair the moving lines before they become undetectable.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166839000001_ABST
    Figure 2024166839000001_ABST
Patent Text Reader

Abstract

To previously prevent a work trouble due to defective travel of a transfer robot.SOLUTION: In a travel line inspection method for a transport robot, a computer causes an imaging unit provided in the transport robot to capture an image including at least one travel line formed in a work site to guide a path where the transfer robot travels and generates warning information when the captured image satisfies a prescribed condition. In the travel line inspection method for the transport robot, the prescribed condition may be a condition that a ratio of an area corresponding to the travel line included in the image is lower than a threshold.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method for inspecting a moving line for a transfer robot. [Background technology]

[0002] In recent years, technological development of automatic guided vehicles (AGVs) has progressed, and AGVs have begun to be used in various situations. For example, if AGVs are used in warehouses where products are stored, it becomes possible to automatically transport a wide variety of products. This improves work efficiency and reduces costs. As an example of such an AGV, Patent Document 1 discloses a technology in which an AGV slips under a cart, lifts up the cart, and tows it.

[0003] On the other hand, automatic guided vehicles require power to lift the cart, which leads to larger automatic guided vehicles. In particular, many of the materials at construction sites are heavy, so more power is required to lift a cart loaded with such materials, leading to even larger automatic guided vehicles. For this reason, development is underway for small automatic guided robots with line tracing and automatic following functions that can use the casters of the cart to connect with the cart below and pull the cart. In the case of line tracing, a moving line (conduit) dedicated to the transport robot is formed at the work site, and the automatic guided robot can recognize the moving line and reach its destination. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-59460 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, if the moving line is used for a long time, the color of the moving line may deteriorate or the moving line may become worn out, causing the moving line to disappear. If the moving line disappears, the line cannot be properly recognized (traced), and the vehicle may become unable to travel.

[0006] In view of the above problem, one of the objects of the present invention is to prevent operational troubles caused by poor running of a transport robot in advance. [Means for solving the problem]

[0007] According to one embodiment of the present invention, there is provided a method for inspecting a moving line for a transport robot, the method including: a computer causes an imaging unit provided on the transport robot to capture an image including at least one moving line formed (for example, by coating) at a work site and guiding the movement of the transport robot; and generating warning information when the captured image satisfies a predetermined condition.

[0008] In the above-mentioned method for inspecting a movement line for a transfer robot, the predetermined condition may be that a ratio of an area corresponding to the movement line included in the image is below a threshold value.

[0009] In the above-mentioned method for inspecting a moving line for a transport robot, when calculating the area, a portion of the image corresponding to a first color that is preset using any one of HSV values, RGB values, HSB values, YCBCR values, and YUV values ​​may be measured.

[0010] In the above-mentioned movement line inspection method for a transport robot, the at least one movement line may include a first movement line extending in a first direction in which the transport robot moves, and a second movement line extending in a second direction intersecting the first direction, and the first movement line may be detected preferentially.

[0011] In the above-mentioned movement line inspection method for a transport robot, when the second movement line is formed at the intersection of the first movement line and the second movement line, a total area of ​​the intersecting portions of the first movement line and the second movement line may be calculated.

[0012] In the above-mentioned movement line inspection method for a transfer robot, the first movement line may have a first color, and the second movement line may have a second color different from the first color. Effect of the Invention

[0013] By using one embodiment of the present invention, operational problems caused by improper running of a transport robot can be prevented in advance. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic diagram of a travel line evaluation system according to an embodiment of the present invention. [Diagram 2] 1 is a perspective view of a transfer robot according to an embodiment of the present invention; [Diagram 3] 3 is a functional block diagram of a control unit of the evaluation device according to the embodiment of the present invention. FIG. [Figure 4] 1 is a flowchart of a transfer line evaluation method according to an embodiment of the present invention. [Diagram 5] FIG. 1 is a schematic diagram of a construction site where a moving line evaluation is performed. [Figure 6] FIG. 2 is a schematic diagram of captured image data. [Figure 7] FIG. 2 is a schematic diagram of captured image data. [Figure 8] 1 is an example of captured image data. [Figure 9] 1 is a flowchart of a transfer line evaluation method according to an embodiment of the present invention. [Figure 10A] This is a photograph taken when capturing an image of the moving line of a transport robot. [Figure 10B] FIG. 2 is a schematic diagram of captured image data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, each embodiment of the present invention will be described with reference to the drawings. Note that the embodiments are merely examples, and those skilled in the art can easily modify the embodiments while maintaining the gist of the invention. Naturally, the scope of the present invention includes any of the above-mentioned. In addition, in order to clarify the description, the drawings may be schematic in terms of the width, thickness, shape, etc. of each part compared to the actual embodiment. However, the illustrated shapes are merely examples and do not limit the interpretation of the present invention.

[0016] In this specification, the letters "first", "second", etc., attached to each component are convenient labels used to distinguish each component, and have no other meaning unless otherwise specified.

[0017] In this specification and drawings, the same reference numerals are used to collectively represent multiple identical or similar components, and capital or lowercase alphabets may be added to each of the multiple components to distinguish them from one another. In addition, a hyphen and a natural number may be used to distinguish between multiple parts of one component.

[0018] First Embodiment (1-1. Configuration of the moving line evaluation system) 1 shows a configuration of a moving line evaluation system 10. As shown in FIG. 1, the moving line evaluation system 10 includes an imaging device (a transfer robot 100) and an evaluation device 200.

[0019] The imaging device captures images of the moving line at any time. In this embodiment, a transport robot 100 is used as the imaging device. The transport robot 100 is a robot that is coupled with a dolly at a work site and can automatically travel while towing the dolly to a specified location as instructed. In this case, the robot may be, for example, a vehicle. Therefore, the transport robot 100 can also be called an automatic transport vehicle.

[0020] The evaluation device 200 evaluates the state of the moving line based on the captured image data and notifies the user of the evaluation result. The evaluation device 200 may include a communication terminal for the worker. Each component will be described in detail below.

[0021] (1-2. Configuration of the Transport Robot 100) The transfer robot 100 will be described with reference to FIGS.

[0022] Fig. 2 is a schematic diagram of the transfer robot 100 according to one embodiment of the present invention. Specifically, Fig. 2 is a perspective view of the transfer robot 100 as viewed from above the transfer robot 100.

[0023] 1 and 2, the transfer robot 100 includes a robot main body 110, a traveling unit 120, and an imaging unit 130. The robot main body 110 is located between the two traveling units 120.

[0024] The robot main body 110 has a control unit 111, a storage unit 113, a communication unit 115, and a power supply unit 117. The robot main body 110 receives instructions from the evaluation device 200 at the communication unit 115. A communication device such as a wireless module is used for the communication unit 115. The received instruction information can be stored in the storage unit 113.

[0025] In addition to a semiconductor memory such as an SSD (Solid State Drive), a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium, a magneto-optical recording medium, or a memorizable element that is a storage medium may be used for the storage unit 113. The storage unit 113 stores captured data.

[0026] The control unit 111 is a computer and includes a CPU (Central Processor). The control unit 111 can control the traveling unit 120 and the imaging unit 130 based on instruction information from the evaluation device 200.

[0027] The transfer robot 100 includes a battery as a power supply unit 117. Specifically, a lithium ion battery is used for the power supply unit 117. In addition, the robot main body 110 may be appropriately provided with a motor for driving the traveling unit 120, a brake, and the like.

[0028] The running unit 120 is provided on the side of the robot body unit 110. The running unit 120 can move the robot body unit 110. In this example, a crawler is used for the running unit 120. In this embodiment, the transport robot 100 can move forward or backward by rotating the two running units 120 in the same direction. In addition, the transport robot 100 can rotate (turn) at its position by rotating the two running units 120 in different directions.

[0029] The imaging unit 130 is provided facing downward and forward at the front of the transport robot 100. The imaging unit 130 uses a CCD (Charge Coupled Device) type camera or a CMOS (Complementary Metal-Oxide-Semiconductor) type camera.

[0030] In this embodiment, the transport robot 100 may be moved by an operator. In this case, the transport robot 100 may be provided with a handle for a user to guide the movement of the transport robot 100. The evaluation device may be fixed to a part of the handle.

[0031] (1-3. Configuration of Evaluation Device 200) 1, the evaluation device 200 includes a control unit 210, a storage unit 220, a communication unit 230, an operation unit 240, a display unit 250, and an output unit 260.

[0032] The control unit 210 is a computer, and uses a CPU, ASIC, FPGA, or other arithmetic processing circuit to control processing based on instructions defined in software (program) for evaluating moving lines. In addition, a user interface for executing the evaluation program may be provided on the display unit 250 by instructions from the control unit 210.

[0033] In addition to a semiconductor memory such as an SSD, a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium, a magneto-optical recording medium, or a memorizable element that is a storage medium may be used for the storage unit 220. The storage unit 220 functions as a database that stores location information, map information, and a route that the transport robot 100 will automatically travel, which are used in the evaluation program.

[0034] The communication unit 230 has a transceiver and communicates information related to automatic transport with the transport robot 100 via a communication network. The communication between the communication unit 230 and the transport robot 100 is performed using wireless communication such as wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), or the Internet.

[0035] The operation unit 240 includes a controller, a button, or a switch. When the operation unit 240 is moved up, down, left, right, pressed, rotated, or the like, information based on the operation is transmitted to the control unit 210. In addition, when the display unit 250 is a display device (touch panel) having a touch sensor, the display unit 250 and the operation unit 240 may be disposed in the same place.

[0036] The display unit 250 is a display device such as a liquid crystal display or an organic EL display, and the display content is controlled by a signal input from the control unit 210.

[0037] The output unit 260 includes a speaker, a lighting device, etc. The output unit 260 outputs information based on a signal input from the control unit 210 to the outside.

[0038] (1-4. Functional block diagram of control unit 210) Next, a description will be given of the functional configuration of the control unit 210. Fig. 3 is a functional block diagram of the control unit 210. The control unit 210 includes an imaging control unit 2101, an acquisition unit 2103, an area calculation unit 2105, a determination unit 2107, and an abnormality processing unit 2109.

[0039] The imaging control unit 2101 has a function of controlling imaging, such as starting and ending imaging by the imaging device (transport robot 100).

[0040] The acquisition unit 2103 acquires various information such as image data captured by the imaging unit 130, color information (eg, HSV values) stored in the storage unit 220, and threshold information.

[0041] The area calculation unit 2105 measures a portion of the image data that corresponds to a preset color, and calculates the area.

[0042] The determining unit 2107 compares the calculated area with a preset threshold value and determines whether or not the area satisfies a predetermined condition (in this case, being less than the threshold value).

[0043] The abnormality processing unit 2109 has the function of determining that an abnormality exists when the calculated area satisfies a predetermined condition (less than a preset threshold value), and performing abnormality processing such as stopping the robot from moving, generating warning information, and issuing an output instruction to the output unit 260 for the warning information.

[0044] (1-5. How to evaluate the movement line) FIG. 4 is a flowchart showing a method for evaluating a moving line for a transport robot in this embodiment. FIG. 5 is a schematic diagram of a construction site where moving line evaluation is performed in this embodiment. As shown in FIG. 5, a building 50 at a construction site is provided with a work floor 51 where workers or machines perform work. Materials 53 (in this example, rod-shaped materials 53-1 and block-shaped materials 53-2) are arranged on a floor surface 51a of the work floor 51, and moving lines 55 are provided. The moving lines 55 are formed by applying paint or the like to the floor surface 51a. As shown in FIG. 5, a plurality of moving lines 55 are provided intersecting with each other on the floor surface 51a of the work floor 51. The moving line 55-1 corresponds to the traveling direction D1 (also referred to as the first direction) of the transport robot 100. The moving line 55-2 is a direction (also referred to as the second direction) that intersects with the traveling direction D1. In this example, the moving lines 55-1 and the moving lines 55-2 are perpendicular to each other, but are not necessarily limited to being perpendicular to each other. The evaluation of the movement line 55 is carried out before the automatic transportation of the transport robot 100 in the field work is carried out. The method of evaluating the movement line in this embodiment will be described in detail below.

[0045] First, as shown in FIG. 4 and FIG. 5, the transport robot 100 is moved along the moving line 55. In this example, an operator moves together with the transport robot 100, but the transport robot 100 may move alone. The evaluation device 200 may be attached to a part (handle) of the transport robot 100. The evaluation device 200 instructs the transport robot 100 to capture an image of the moving line (step S100). Based on the instruction from the evaluation device 200, the imaging unit 130 of the transport robot 100 performs an imaging process of the floor surface 51a including the moving line 55. The captured image data is transmitted to the evaluation device 200. The evaluation device 200 acquires the image data (step S101).

[0046] Next, the evaluation device 200 analyzes the image data (step S103). At this time, among the dots included in the image data, a portion (pixel) that corresponds to a color (e.g., red) that is preset by the HSV value is detected, the number of pixels (or dots) of the target color is counted, and the area of ​​the target color is calculated. The HSV value is color information expressed in a manner similar to the way humans perceive color. Furthermore, the area ratio is calculated from the area (number of dots) of the target color relative to the area (number of dots) of the entire image data.

[0047] Next, it is determined whether the area ratio of the target color is equal to or greater than a preset threshold value (step S105). FIG. 6 is a schematic diagram of a case where a movement line 55 exists normally. In the case of FIG. 6, the area ratio of the target color is equal to or greater than the threshold value. If the area ratio of the target color is equal to or greater than the threshold value (step S105; Yes), it is determined that a movement line of the target color exists (is recognizable) (step S107). At this time, if there is no instruction based on an input to stop the evaluation process (step S109; No), the process returns to step S101 to continue the evaluation process.

[0048] FIG. 7 is a schematic diagram of a case where the moving line 55 has disappeared. In the case of FIG. 7, it means that the area ratio of the target color is less than the threshold value. When the area ratio of the target color is less than the threshold value (step S105; No), it is determined that the moving line of the target color has disappeared (step S111). At this time, the evaluation device 200 performs abnormality processing. Specifically, the evaluation device 200 instructs the transport robot to stop capturing images (transmits stop instruction information). In addition, the evaluation device 200 generates warning information. The generated warning information may be displayed on the display unit 250 of the evaluation device 200 or output from the output unit 260. FIG. 8 is an example of image data including an actually captured moving line. From the output warning information, the worker can perform repair work on the part where the moving line 55 has disappeared.

[0049] In this embodiment, the state of the moving line is determined before the transport robot 100 automatically transports the product, thereby preventing problems such as interruption of work due to poor running. In addition, in this embodiment, the evaluation is performed using information captured by the imaging unit 130 provided in the transport robot 100, so that the same information as the color information recognized by the transport robot 100 when it automatically transports the product is judged. This prevents the misrecognition of the moving line from occurring. In this embodiment, the state of the moving line 55 is judged using image data captured by the imaging unit of the transport robot 100. This allows accurate judgment of color changes (deterioration) that are difficult to judge visually due to the amount of light. Therefore, by using this embodiment, work problems due to poor running of the transport robot can be prevented in advance.

[0050] <Second embodiment> In this embodiment, a transfer robot movement line evaluation method different from that in the first embodiment will be described. Specifically, a portion where two movement lines intersect will be described.

[0051] Fig. 9 is a flow chart showing a method for evaluating a moving line for a transfer robot in this embodiment. Fig. 10A is a photograph of an intersecting portion of two moving lines when the moving line is captured by the transfer robot. Fig. 10B is image data of the intersecting portion.

[0052] As shown in FIG. 10B, when an image of an intersecting portion is captured, the moving line 55-1 and the moving line 55-2 may intersect, or the moving line 55-2 may be formed on the moving line. In this embodiment, as shown in FIG. 9, after acquiring image data (step S101), it is determined whether the two moving lines intersect (step S102). If it is determined that the two lines intersect (step S102; Yes), the evaluation device 200 calculates an area (total area) obtained by adding together the area of ​​the color corresponding to the moving line 55-1 and the area of ​​the part (non-corresponding color) of the moving line 55-2 that exists continuously with the moving line 55-1 (corresponding color) (step S104). The subsequent processing is the same as the processing in FIG. 4 of the first embodiment.

[0053] By using this embodiment, it is possible to accurately evaluate the change (deterioration) of the moving line of the target color to be evaluated even at the intersection. Therefore, by using this embodiment, it is possible to prevent work troubles caused by the poor running of the transport robot in advance.

[0054] In this embodiment, an example of calculating the total area is shown, but the present invention is not limited to this. For example, the area ratio of the movement line 55-1 in front of the intersecting part may be used for the determination. Alternatively, the area ratio of the movement line 55-1 on the back side of the intersecting part may be used for the determination.

[0055] (Modification) The above-described embodiments of the present invention may be combined as appropriate as long as they are not mutually inconsistent. Furthermore, those in which a person skilled in the art appropriately adds or removes components or modifies designs, or adds or omits steps or modifies conditions, based on the embodiments, are also included in the scope of the present invention as long as they include the gist of the present invention.

[0056] Even if there are other effects and advantages different from those brought about by the respective embodiments described above, those which are clear from the description in this specification or which can be easily predicted by a person skilled in the art are naturally understood to be brought about by the present invention.

[0057] In the first embodiment of the present invention, an example in which a communication terminal is used as the evaluation device 200 has been described, but the present invention is not limited to this. A server may be used as the evaluation device. In this case, warning information may be transmitted to the communication terminal of the worker.

[0058] In the first embodiment of the present invention, an example is shown in which the area of ​​the target color is calculated using HSV values, but the present invention is not limited to this. For example, the area of ​​the target color may be calculated using any one of RGB values, HSB values, YCBCR values, and YUV values.

[0059] The warning information may be transmitted to an external device other than the evaluation device 200 and output from the external device.

[0060] In the first embodiment of the present invention, an example has been shown in which an image capture instruction is sent from the evaluation device to the transport robot 100, but the present invention is not limited to this. Image capture processing may be performed based on an instruction from the control unit 111 of the transport robot 100.

[0061] In the first embodiment of the present invention, the moving line 55 is formed by applying paint or the like to the floor surface 51a, but the present invention is not limited to this. For example, the moving line 55 may be formed by using tape.

[0062] Moreover, in the above, the movement line evaluation system including the transfer robot 100 has been described, but the movement line evaluation system is not limited to the transfer robot 100 and can be applied to any automatic transfer vehicle. [Explanation of symbols]

[0063] 10···Moving line evaluation system, 50···Building, 51···Work floor, 51a···Floor surface, 53···Material, 53-1···Rod-shaped material, 53-2···Block-shaped material, 55···Moving line, 55-1···Moving line, 55-2···Moving line, 100···Transport robot, 110···Robot main body, 111···Control unit, 113···Memory unit, 115 ···Communication unit, 117···Power supply unit, 120···Travel unit, 130···Imaging unit, 200···Evaluation device, 210···Control unit, 220···Storage unit, 230···Communication unit, 240···Operation unit, 250···Display unit, 260···Output unit, 2101···Imaging control unit, 2103···Acquisition unit, 2105···Area calculation unit, 2107···Determination unit, 2109···Abnormality processing unit

Claims

1. The computer an image including at least one movement line formed in a work site and guiding the movement of the transport robot is captured by an imaging unit provided in the transport robot; generating warning information when the captured image satisfies a predetermined condition; A moving line inspection method for a transport robot.

2. The predetermined condition is that a ratio of an area corresponding to a movement line included in the image is less than a threshold value.

2. The method for inspecting a moving line for a transfer robot according to claim 1.

3. When calculating the area, a portion of the image corresponding to a first color preset by any one of HSV values, RGB values, HSB values, YCBCR values, and YUV values ​​is measured.

3. The method for inspecting a moving line for a transfer robot according to claim 2.

4. The at least one moving line includes a first moving line extending in a first direction in which the transport robot moves, and a second moving line extending in a second direction intersecting the first direction, preferentially detecting the first moving line; 2. The method for inspecting a moving line for a transfer robot according to claim 1.

5. When the second moving line is formed at a portion where the first moving line and the second moving line intersect, Calculating a total area of ​​the intersecting portions of the first movement line and the second movement line; 5. The method for inspecting a moving line for a transfer robot according to claim 4.

6. the first moving line has a first color; the second moving line has a second color different from the first color.

6. The method for inspecting a moving line for a transfer robot according to claim 5.

Citation Information

Patent Citations

  • Robot for load-carrying platform conveyance

    JP2019059460A