Imaging position adjustment method

A movable camera system with a moving mechanism simplifies the detection and correction of positional deviation using a single camera, enhancing accuracy and reducing complexity in automatic guided vehicles.

JP2024162770AInactive Publication Date: 2024-11-21TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023078653
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Conventional systems require multiple imaging devices to detect positional deviation of automatic guided vehicles, leading to a complex configuration.

Method used

A movable camera system with a moving mechanism allows for detecting and correcting positional deviation using a single camera by adjusting its position based on detected deviation amounts and directions.

Benefits of technology

Enables accurate positional correction of the camera with a simple configuration using one camera and a moving mechanism, reducing complexity and improving detection accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162770000001_ABST
    Figure 2024162770000001_ABST
Patent Text Reader

Abstract

To detect a positional deviation amount by a simple constitution and perform required correction.SOLUTION: An imaging position adjustment method which adjusts an imaging position of a camera which images a work placed on a transportation object by a movement mechanism constituted to be capable of moving the camera in parallel with a moving direction of the transportation object comprises: a process of imaging the work by the camera when the transportation object stops at a predetermined stop position; a process of detecting a positional deviation amount and a positional deviation direction from a reference stop position of the actual stop position of the transportation object on the basis of a work image obtained by imaging the work; and a process of adjusting the imaging position of the camera by moving the camera by the movement mechanism, on the basis of the positional deviation amount and the positional deviation direction.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method for adjusting a photographing position. [Background technology]

[0002] Patent Document 1 discloses a system that detects the amount of positional deviation between an actual stopping position and a reference position when an automated guided vehicle is stopped at a specified stopping position based on images captured by multiple imaging devices arranged on the automated guided vehicle, and corrects the stopping position, etc., as necessary. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-212647 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional device has a problem in that a plurality of imaging devices are required for each automatic guided vehicle in order to detect the amount of positional deviation.

[0005] The present invention has been made in view of the above-mentioned problems, and has an object to make it possible to detect the amount of positional deviation with a simple configuration and to make the necessary corrections. [Means for solving the problem]

[0006] In order to solve the above problems, according to one aspect of the present invention, there is provided a photographing position adjustment method for adjusting the photographing position of a camera that photographs a workpiece placed on a conveying body by a moving mechanism configured to move the camera parallel to the moving direction of the conveying body. The photographing position adjustment method includes a step of photographing the workpiece by the camera when the conveying body stops at a predetermined stop position, a step of detecting a positional deviation amount and a positional deviation direction of the actual stop position of the conveying body from a reference stop position based on a workpiece image photographed of the workpiece, and a step of moving the camera by the moving mechanism to adjust the photographing position of the camera based on the positional deviation amount and the positional deviation direction. Effect of the Invention

[0007] According to this aspect of the present invention, the amount and direction of positional deviation can be detected and the shooting position of the camera can be corrected using a simple configuration of one camera and a movement mechanism. [Brief description of the drawings]

[0008] [Figure 1] 1 is a schematic configuration diagram of a camera position adjustment device according to an embodiment of the present invention; [Diagram 2] 10 is a flowchart illustrating details of a camera position adjustment process according to an embodiment of the present invention. [Diagram 3] 11A and 11B are diagrams illustrating an example of a method for determining whether or not the entire workpiece is contained within a workpiece image. [Figure 4] 4 is a diagram illustrating an example of a method for detecting a positional deviation amount X. FIG. [Diagram 5] 11A and 11B are diagrams illustrating an example of a method for detecting a position deviation direction. [Figure 6] 13A and 13B are diagrams illustrating another example of a method for detecting a position deviation direction. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, like components are designated by like reference numerals.

[0010] FIG. 1 is a schematic diagram of a camera position adjustment device 1 according to an embodiment of the present invention.

[0011] The camera position adjustment device 1 includes a moving mechanism 2, a camera 3, and a control device 4, and adjusts the position of the camera 3 that captures an image of a workpiece 101 placed on a transport body 100, such as an autonomous transport vehicle or transport robot. The transport body 100 is configured to move to a reference stop position beside the moving mechanism 2 with the workpiece 101 mounted thereon so that the workpiece can be photographed by the camera 3, and to stop once at the reference stop position.

[0012] The movement mechanism 2 includes a movable belt 21 that is movable parallel to the movement direction of the conveyor 100, and a motor 22 that generates power for moving the movable belt 21 left and right. The motor 22 is driven by the control device 4.

[0013] The camera 3 is fixed on the movable belt 21 so as to move together with the movable belt 21. When the conveyor 100 stops at a reference stop position, the camera 3 captures an image of the workpiece 101 placed on the conveyor 100. The camera 3 captures an image of the workpiece 101 based on a control signal from the control device 4, and transmits the captured image of the workpiece to the control device 4.

[0014] The control device 4 is an ECU (Electronic Control Unit) including a communication unit 41, a storage unit 42, and a processing unit 43.

[0015] The communication unit 41 includes an interface circuit for connecting the control device 4 to the motor 22 and the camera 3. The communication unit 41 supplies the workpiece image received from the camera 3 to the processing unit 43. The communication unit 41 also transmits to the motor 22 and the camera 3 control signals output from the processing unit 43 for driving them.

[0016] The storage unit 42 has a storage medium such as a hard disk drive (HDD), a solid disk drive (SSD), or a semiconductor memory, and stores various computer programs and data used for processing by the processing unit 43.

[0017] The processing unit 43 includes one or more CPUs (Central Processing Units) and their peripheral circuits. The processing unit 43 executes various computer programs stored in the storage unit 42, and is, for example, a processor.

[0018] Here, the conveying body 100 may not stop accurately at the reference stop position, and may stop shifted to the left or right from the reference stop position. If the amount of positional deviation of the conveying body 100 from the reference stop position is large, for example, when a judgment regarding the workpiece 101, such as a judgment of the workpiece 101 being defective based on a workpiece image, may not be able to be made, or may lead to an erroneous judgment. Therefore, in this embodiment, the amount of positional deviation of the conveying body 100 from the reference stop position is detected, and the moving mechanism 2 is controlled according to the amount of positional deviation of the conveying body 100 so that the position of the camera 3 can be adjusted. Hereinafter, the camera position adjustment process performed by the processing unit 43 and thus the control device 4 will be described with reference to FIG. 2 to FIG. 5.

[0019] 2 is a flowchart for explaining the details of the camera position adjustment process. The control device 4 starts this process when the conveyed body 100 stops near a preset reference stop position.

[0020] In step S1, the control device 4 causes the camera 3 to capture an image of the workpiece.

[0021] In step S2, the control device 4 determines whether or not the entire workpiece 101 is contained within the workpiece image. If the entire workpiece 101 is contained within the workpiece image, the control device 4 ends this processing. On the other hand, if the entire workpiece 101 is not contained within the workpiece image, the control device 4 proceeds to processing in step S3.

[0022] In this embodiment, the control device 4 performs template matching on the workpiece image using a template image previously stored in the memory unit 42, as shown in FIG. 3, to determine whether the entire workpiece 101 is contained within the workpiece image.

[0023] In step S3, the control device 4 detects how much the actual stop position of the conveyed body 100 deviates from a preset reference stop position, that is, detects the positional deviation amount X of the conveyed body 100 from the reference stop position.

[0024] In this embodiment, the control device 4 estimates the current center position of the workpiece 101 based on the workpiece image (see (B) and (C) of FIG. 4), for example as shown in FIG. 4, and detects the amount of positional deviation X of the transport body 100 from the reference stop position by comparing it with the center position of the workpiece 101 in a reference image (see (A) of FIG. 4) captured when the transport body 100 is stopped at the reference stop position, which is pre-stored in the memory unit 42.

[0025] In step S4, the control device 4 detects whether the conveyed body 100 is displaced to the left or right with respect to the reference stop position, that is, detects the direction of positional deviation of the conveyed body 100 with respect to the reference stop position.

[0026] In this embodiment, the control device 4 divides the workpiece image into at least two regions, left and right, as shown in FIG. 5, and judges whether the conveyance body 100 or the workpiece 101 is mostly reflected in the left region of the workpiece image or the right region based on, for example, pixel information (color tone) of the image of each divided region. FIG. 5 shows an example in which the conveyance body 100 and the workpiece 101 are mostly reflected in the left region of the workpiece image. If the conveyance body 100 or the workpiece 101 is mostly reflected in the left region of the workpiece image, the control device 4 judges that the conveyance body 100 is shifted to the left with respect to the reference stop position. On the other hand, if the conveyance body 100 or the workpiece 101 is mostly reflected in the right region of the workpiece image, the control device 4 judges that the conveyance body 100 is shifted to the right with respect to the reference stop position.

[0027] In step S5, the control device 4 drives the motor 22 to move the movable belt 21 so that the camera 3 moves from the shooting position by the positional deviation amount X in the positional deviation direction of the conveyor 100. This allows the camera 3 to be moved to a position where the workpiece 101 is captured in the center of the workpiece image.

[0028] In step S6, the control device 4 performs photographing again with the camera 3 to reacquire a workpiece image, and then drives the motor 22 to move the movable belt 21 so that the camera 3 returns to the initial photographing position.

[0029] The shooting position adjustment method according to the present embodiment described above is a method of adjusting the shooting position of the camera 3, which photographs the workpiece 101 placed on the transport body 100, by using a moving mechanism 2 configured to move the camera 3 parallel to the moving direction of the transport body 100, and includes the steps of: a step (S1) of photographing the workpiece 101 by the camera 3 when the transport body 100 stops at a predetermined stopping position; steps (S3, S4) of detecting the amount of positional deviation and the direction of positional deviation of the actual stopping position of the transport body 100 from a reference stopping position based on the workpiece image photographed of the workpiece 101; and a step (S6) of moving the camera 3 by the moving mechanism 2 to adjust the shooting position of the camera 3 based on the amount of positional deviation and the direction of positional deviation.

[0030] As a result, with a simple configuration of one camera 3 and moving mechanism 2, the amount and direction of positional deviation can be detected and the shooting position of the camera 3 can be corrected.

[0031] Although the embodiments of the present invention have been described above, the above-mentioned embodiments merely show some of the application examples of the present invention, and it is not intended that the technical scope of the present invention be limited to the specific configurations of the above-mentioned embodiments.

[0032] For example, in the above embodiment, in step S4 in Fig. 2, the workpiece image is divided into two regions, left and right, as shown in Fig. 5, but the workpiece image may be divided into four regions, top, bottom, left and right, as shown in Fig. 6. By increasing the number of divided regions, the position of the transport body 100 or the workpiece 101 can be grasped more accurately.

[0033] In the above embodiment, the computer program executed in the control device 4 may be provided in a form recorded on a computer-readable portable recording medium, such as a semiconductor memory, a magnetic recording medium, or an optical recording medium. [Explanation of symbols]

[0034] 2 Moving mechanism 3. Camera 100 Carrier 101 Work

Claims

[Claim 1] A photographing position adjustment method for adjusting a photographing position of a camera that photographs a workpiece placed on a conveying body by a moving mechanism configured to be able to move the camera parallel to a moving direction of the conveying body, a step of photographing the workpiece by the camera when the conveyor stops at a predetermined stop position; detecting a positional deviation amount and a positional deviation direction of an actual stop position of the transport body from a reference stop position based on a workpiece image obtained by photographing the workpiece; a step of adjusting a photographing position of the camera by moving the camera using the moving mechanism based on the positional deviation amount and the positional deviation direction; A method for adjusting a shooting position.

Citation Information

Patent Citations

  • Position correcting method

    JP1996075411A

  • Subject tracking apparatus, method for controlling the same, imaging apparatus, display apparatus and program

    JP2010157924A

  • Stop position deviating amount detector for mobile

    JP1999212647A