Alignment adjustment method for stacked image

The method uses a calibration sheet with a grid pattern to measure and adjust the angle of line cameras for precise alignment of stacked images, addressing misalignment issues and preventing image distortion.

JP2024164661AActive Publication Date: 2024-11-27TOYOTA JIDOSHA KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023080306
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27
Estimated Expiration
2043-05-15

AI Technical Summary

Technical Problem

Existing methods for aligning stacked images captured by line cameras lack quantitative adjustment, leading to image distortion due to misalignment, with visual checks being insufficient for accurate judgment.

Method used

A method using a calibration sheet with a grid pattern of dots to adjust alignment, where line cameras scan over the sheet, drawing straight lines between dots to measure and adjust the angle to 90 degrees for precise alignment.

Benefits of technology

Enables quantitative measurement and adjustment of alignment shifts in stacked images, ensuring accurate alignment without distortion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164661000001_ABST
    Figure 2024164661000001_ABST
Patent Text Reader

Abstract

To provide an alignment adjustment method for a stacked image capable of grasping and adjusting alignment deviation.SOLUTION: An alignment adjustment method for a stacked image comprises the steps of: stacking and imaging a calibration sheet that is superposed and arranged on an imaging object and in which multiple dots are arranged in a lattice shape while scanning a line camera; and measuring an angle defined by a first straight line connecting a first dot serving as a starting point and a second dot located at a position away from the first dot in a scanning direction in an obtained stacked image and a second straight line connecting the first dot and a third dot located at a position away from the first dot in a direction orthogonal to the scanning direction to adjust an angle of the line camera with respect to a reference position so that the angle becomes 90 degrees.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method for adjusting the alignment of stacked images. [Background technology]

[0002] Patent Document 1 discloses an original reading device that provides detection patterns, such as triangular and square patterns, adjacent to a black-and-white pattern on a calibration sheet for adjusting black-and-white levels, reads the width of the triangular pattern by scanning an image sensor, and sets the position of the image sensor when this width reaches a predetermined value as the reference position for reading the original. In this original reading device, the image sensor scans to detect the distance from the reference position to the document side edge on both sides of the square pattern, and if the detected distances are not equal, it is determined that the image sensor is tilted. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-134857 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is no quantitative method for adjusting the alignment of line cameras in stacked images, which are made by cutting out parts of images captured by line cameras and stacking them together. Therefore, misalignment of the stacked images causes image distortion and makes it impossible to make an accurate judgment.

[0005] The present invention has been made in consideration of the above problems, and its object is to provide a method for adjusting the alignment of stacked images that can grasp and adjust the alignment deviation of stacked images. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the method for adjusting alignment of a stacked image of the present invention is characterized in that a calibration sheet having a plurality of dots arranged in a grid pattern and placed on top of an object to be imaged is scanned by a line camera to capture a stacked image, measuring the angle formed by a first straight line connecting a first dot that is the starting point in the obtained stacked image and a second dot that is located away from the first dot in the scanning direction, and a second straight line connecting the first dot and a third dot that is located away from the first dot in a direction perpendicular to the scanning direction, and adjusting the angle of the line camera relative to a reference position so that the angle is 90 degrees. Effect of the Invention

[0007] The method for adjusting alignment of stacked images according to the present invention has the effect of making it possible to grasp and adjust misalignment. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an imaging device according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a partial image that is a part of a captured image. [Diagram 3] FIG. 3 is a diagram showing an example of a calibration sheet used for alignment adjustment of a stacked image (line camera). [Figure 4] FIG. 4 is a flowchart showing an example of control performed in the alignment adjustment method for stacked images according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of two straight lines connecting dots in a layered image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the alignment adjustment method for stacked images according to the present invention will be described, however, the present invention is not limited to the embodiment.

[0010] FIG. 1 is a diagram showing a schematic configuration of an imaging device 1 according to an embodiment. In the imaging device 1 according to the embodiment, a line camera 2 and an illumination device 3 are attached to a robot arm (not shown) and are provided so as to be located above an imaging target 4. When imaging the imaging target 4 by the imaging device 1, for example, the robot arm scans the line camera 2 and the illumination device 3 in a scanning direction (for example, the direction of the arrow A in FIG. 1). At that time, the illumination device 3 illuminates the surface of the imaging target 4, and the line camera 2 receives the reflected light reflected by the surface, and images of the surface of the imaging target 4 are continuously captured. The data of the captured image captured by the line camera 2 is transmitted to an image processing device (not shown). Then, the image processing device performs image processing to cut out a partial image 60, which is a part of the captured image 6 captured by the line camera 2 at each scanning position of the line camera 2 and is an image portion corresponding to the regular reflected light of the reflected light received by the line camera 2, as shown in FIG. 2. The image processing device also performs image processing to stack and composite (arrange and composite in the scanning direction) a plurality of partial images 60 cut out for each scanning position of the line camera 2 in the scanning direction, thereby creating a stacked image of the imaged object 4. In this embodiment, imaging for creating a stacked image in this manner is also referred to as stacked imaging.

[0011] Fig. 3 is a diagram showing an example of a calibration sheet 5 used for alignment adjustment of a laminated image (line camera 2). In the alignment adjustment method of a laminated image according to the embodiment, the alignment adjustment of the laminated image (line camera 2) is performed using a calibration sheet 5 in which a plurality of dots 50 are arranged in a grid pattern in the X-axis direction (scanning direction: horizontal direction) and the Y-axis direction (direction perpendicular to the scanning direction: vertical direction) in Fig. 3, as shown in Fig. 3.

[0012] FIG. 4 is a flowchart showing an example of control performed in the alignment adjustment method for stacked images according to the embodiment. First, in the alignment adjustment method for stacked images according to the embodiment, the calibration sheet 5 arranged on the imaging target 4 is imaged while being scanned by the line camera 2 to obtain a stacked image (captured image) of the calibration sheet 5 (step S1). Next, in the alignment adjustment method for stacked images according to the embodiment, the image processing device performs image processing for drawing straight lines between dots in the stacked image (captured image) of the calibration sheet 5 (step S2). Specifically, as shown in FIG. 5, the image processing device draws a first straight line L1 connecting a first dot 50A, which is a starting point, and a second dot 50B, which is located at a position away from the first dot 50A in the X-axis direction, which is the scanning direction, and is located at the end opposite to the first dot 50A, in the stacked image (captured image) of the calibration sheet 5. The image processing device also draws a second straight line L2 connecting the first dot 50A and the third dot 50C located at the end opposite to the first dot 50A in the Y-axis direction, which is a direction perpendicular to the scanning direction from the first dot 50A, in the stacked image (captured image). Next, in the stacked image alignment adjustment method according to the embodiment, as shown in FIG. 5, the image processing device performs a process of measuring the angle between the two straight lines L1 and L2, that is, the angle θ between the first straight line L1 and the second straight line L2 (step S3). Next, in the stacked image alignment adjustment method according to the embodiment, the angle of the line camera 2 with respect to the reference position is adjusted so that the measured angle θ becomes a right angle (90 degrees) (step S4). Specifically, for example, an operator adjusts the mounting angle of the line camera 2 with respect to the robot arm, or the teaching angle for teaching the robot arm so that the line camera 2 is tilted at a predetermined angle with respect to the reference position. As a result, in the method for adjusting alignment of a laminated image according to the embodiment, the alignment of the line camera 2 can be adjusted so that the alignment deviation of the laminated image falls within a specified value.

[0013] If the mounting angle of the line camera 2 with respect to the robot arm is configured to be automatically variable by a driving device or the like, the driving device may automatically adjust the measured angle θ to a right angle (90 degrees). Also, a teaching device (not shown) or the like may automatically teach the robot arm a teaching angle so that the measured angle θ becomes a right angle (90 degrees).

[0014] As described above, in the method for adjusting the alignment of a laminated image according to the embodiment, the alignment deviation of the laminated image can be quantitatively measured from the measured angle θ, and the alignment deviation of the laminated image can be grasped. In addition, in the method for adjusting the alignment of a laminated image according to the embodiment, by utilizing the calibration sheet 5, two straight lines L1 and L2 for determining an angle (right angle) when measuring the alignment deviation of the line camera 2 from the laminated image can be obtained, and the alignment deviation of the laminated image can be grasped and adjusted. [Explanation of symbols]

[0015] 1. Imaging device 2 Line Camera 3. Lighting equipment 4. Image capture target 5 Calibration Sheet 6. Captured images 50 dots 50A 1st dot 50B 2nd dot 50C 3rd dot 60 Partial Images

Claims

[Claim 1] A method for adjusting the alignment of a stacked image, comprising: scanning a calibration sheet having a plurality of dots arranged in a grid pattern and placed on top of an object to be imaged with a line camera to capture a stacked image; measuring an angle formed by a first straight line connecting a first dot that is a starting point in the obtained stacked image and a second dot that is located away from the first dot in the scanning direction; and a second straight line connecting the first dot and a third dot that is located away from the first dot in a direction perpendicular to the scanning direction; and adjusting the angle of the line camera relative to a reference position so that the angle is 90 degrees.

Citation Information

Patent Citations

  • Position correcting method for alignment sensor, reference pattern correcting method, exposure position correcting method, pattern for correction, and alignment device

    JP2006284890A

  • Image processing system and image processing program

    JP2014197762A

  • Method of aligning dual camera modules

    JP2019054501A

  • Parallelism determination method of camera

    JP2021012203A

  • Processing device, imaging apparatus, imaging system, and processing method

    JP2021190967A