Method for adjusting the alignment of stacked images
The method uses a calibration sheet with a grid pattern to measure and adjust the angle of a line camera, addressing image distortion issues in stacked images by ensuring accurate alignment.
Patent Information
- Application Number
- JP2023080306
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-05-15
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2043-05-15
AI Technical Summary
Existing methods for aligning stacked images captured by a line camera rely on visual inspection, leading to image distortion due to alignment deviations, making accurate determination impossible.
A method involving a calibration sheet with a grid pattern is used to adjust the alignment of a line camera by measuring the angle between specific dot connections in the captured image, ensuring the camera is angled at 90 degrees relative to a reference position.
Enables precise detection and adjustment of alignment misalignment in stacked images, allowing for accurate alignment of the line camera.
Smart Images

Figure 0007948069000001 
Figure 0007948069000002 
Figure 0007948069000003
Abstract
Description
Technical Field
[0001] The present invention relates to a method for adjusting alignment of a stacked image.
Background Art
[0002] Patent Document 1 discloses a document reading apparatus in which a detection pattern composed of a triangular pattern, a square pattern and the like is provided adjacent to a black-and-white pattern on a calibration sheet for black-and-white level adjustment, the width of the triangular pattern obtained by scanning with an image sensor is read, and the position of the image sensor when the width reaches a predetermined value is set as a reference position for document reading. Further, in this document reading apparatus, the distances from the reference positions on both sides of the square pattern to the document side end portion are detected by scanning of the image sensor, and if the respective detected distances are not equal, it is determined that the image sensor is tilted.
Prior Art Literature
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] For stacked images formed by cutting out and stacking parts of images captured by a line camera, there is no quantitative alignment adjustment method for the line camera and the adjustment relies on visual inspection, so image distortion occurs due to alignment deviation of the stacked images, making accurate determination impossible.
[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a method for adjusting alignment of a stacked image, which is capable of grasping and adjusting alignment deviation of the stacked image.
Means for Solving the Problems
[0006] To solve the above-mentioned problems and achieve the objective, the stacked image alignment adjustment method according to the present invention is characterized by stacking images of a calibration sheet having multiple dots arranged in a grid pattern, which is placed on top of an object to be imaged, while scanning with a line camera, measuring the angle between a first line connecting a first dot which is the starting point in the obtained stacked image and a second dot located at a position away from the first dot in the scanning direction, and a second line connecting the first dot and a third dot located at a position away from the first dot in a direction perpendicular to the scanning direction, and adjusting the angle of the line camera with respect to a reference position so that the angle is 90 degrees. [Effects of the Invention]
[0007] The stacked image alignment adjustment method according to the present invention has the effect of enabling the detection and adjustment of alignment misalignment. [Brief explanation of the drawing]
[0008] [Figure 1] Figure 1 is a diagram showing the schematic configuration of an imaging device according to an embodiment. [Figure 2] Figure 2 shows an example of a partial image, which is a part of an captured image. [Figure 3] Figure 3 shows an example of a calibration sheet used for aligning stacked images (line camera). [Figure 4] Figure 4 is a flowchart showing an example of the control performed by the stacked image alignment adjustment method according to the embodiment. [Figure 5] Figure 5 shows an example of two straight lines connecting dots in a stacked image. [Modes for carrying out the invention]
[0009] The following describes an embodiment of the stacked image alignment adjustment method according to the present invention. However, the present invention is not limited to this embodiment.
[0010] Figure 1 is a diagram showing the schematic configuration of an imaging device 1 according to an embodiment. In the imaging device 1 according to the embodiment, a line camera 2 and an illumination device 3 are attached to a robot arm (not shown) and positioned above the object to be imaged 4. When imaging the object to be imaged 4 with the imaging device 1, for example, the robot arm is used to scan the line camera 2 and illumination device 3 in the scanning direction (for example, in the direction of arrow A in Figure 1). At that time, the illumination device 3 illuminates the surface of the object to be imaged 4, and the reflected light reflected from the surface is received by the line camera 2, and an image of the surface of the object to be imaged 4 is continuously captured. The data of the image captured by the line camera 2 is transmitted to an image processing device (not shown). The image processing device then performs image processing, as shown in Figure 2, to extract a partial image 60, which is a part of the image 6 captured by the line camera 2, corresponding to the specularly reflected light among the reflected light received by the line camera 2, for each scanning position of the line camera 2. Furthermore, the image processing device performs image processing to create a stacked image of the object to be imaged 4 by stacking and combining (arranging and combining in the scanning direction) multiple partial images 60 extracted for each scanning position of the line camera 2 in the scanning direction. In this embodiment, the imaging for creating a stacked image in this manner is also referred to as stacked imaging.
[0011] Figure 3 shows an example of a calibration sheet 5 used for adjusting the alignment of a stacked image (line camera 2). In the stacked image alignment adjustment method according to the embodiment, the alignment of the stacked image (line camera 2) is adjusted using a calibration sheet 5 in which multiple dots 50 are arranged in a grid in the X-axis direction (scanning direction: horizontal direction) and Y-axis direction (direction perpendicular to the scanning direction: vertical direction) as shown in Figure 3.
[0012] Figure 4 is a flowchart showing an example of the control performed in the stacked image alignment adjustment method according to the embodiment. First, in the stacked image alignment adjustment method according to the embodiment, a calibration sheet 5 placed on top of the object to be imaged 4 is stacked and imaged while scanning with a line camera 2 to obtain a stacked image (imaged image) of the calibration sheet 5 (step S1). Next, in the stacked image alignment adjustment method according to the embodiment, the image processing device performs image processing to draw a straight line between the dots in the stacked image (imaged image) of the calibration sheet 5 (step S2). Specifically, as shown in Figure 5, the image processing device draws a first straight line L1 in the stacked image (imaged image) of the calibration sheet 5, connecting a first dot 50A which is the starting point, and a second dot 50B which is located at a position away from the first dot 50A in the X-axis direction, which is the scanning direction, and at the end opposite to the first dot 50A. Furthermore, the image processing device draws a second straight line L2 in the stacked image (captured image) connecting the first dot 50A and the third dot 50C, which is located at a position away from the first dot 50A in the Y-axis direction, which is perpendicular to the scanning direction from the first dot 50A, and at the opposite end from the first dot 50A. Next, in the stacked image alignment adjustment method according to the embodiment, as shown in Figure 5, the image processing device performs a process to measure the angle between the two straight lines L1 and L2, that is, the angle θ of the angle made by the first straight line L1 and the second straight line L2 (step S3). Next, in the stacked image alignment adjustment method according to the embodiment, the angle of the line camera 2 with respect to the reference position is adjusted so that the measured angle θ is a right angle (90 degrees) (step S4). Specifically, the mounting angle of the line camera 2 to the robot arm, or the teaching angle used to teach the robot arm so that the line camera 2 is tilted at a predetermined angle with respect to the reference position, is adjusted by, for example, an operator. As a result, in the stacked image alignment adjustment method according to the embodiment, the alignment of the line camera 2 can be adjusted so that the alignment deviation of the stacked image falls within a specified value.
[0013] Furthermore, if the mounting angle of the line camera 2 to the robot arm is configured to be automatically adjustable by a drive device or the like, the drive device may be configured to automatically adjust the angle so that the measured angle θ is a right angle (90 degrees). Alternatively, a teaching device (not shown) or the like may be configured to automatically teach the robot arm a teaching angle so that the measured angle θ is a right angle (90 degrees).
[0014] As described above, in the stacked image alignment adjustment method according to the embodiment, the alignment deviation of the stacked image can be quantitatively measured from the measured angle θ, and the alignment deviation of the stacked image can be grasped. Furthermore, in the stacked image alignment adjustment method according to the embodiment, by utilizing the calibration sheet 5, two straight lines L1 and L2 are obtained to determine the angle (right angle) when measuring the alignment deviation of the line camera 2 from the stacked image, and the alignment deviation of the stacked image can be grasped and adjusted. [Explanation of symbols]
[0015] 1. Imaging device 2 Line Camera 3. Lighting equipment 4. Objects to be imaged 5. Calibration Sheet 6. Captured Images 50 dots 50A 1st dot 50B Second dot 50C 3rd dot 60 partial images
Claims
[Claim 1] A method for adjusting the alignment of a stacked image, characterized by: stacking images of a calibration sheet having multiple dots arranged in a grid pattern, which is placed on top of an object to be imaged, while scanning with a line camera; stacking and combining multiple partial images captured by the line camera at each scanning position of the line camera in the scanning direction to obtain a stacked image of the calibration sheet; measuring the angle between a first line connecting a first dot which is the starting point in the obtained stacked image and a second dot located at a position away from the first dot in the scanning direction, and a second line connecting the first dot and a third dot located at a position away from the first dot in a direction perpendicular to the scanning direction; and adjusting the angle of the line camera with respect to a reference position so that the angle is 90 degrees.
Citation Information
Patent Citations
Original reading apparatus
JP2004134857A
Position correcting method for alignment sensor, reference pattern correcting method, exposure position correcting method, pattern for correction, and alignment device
JP2006284890A
Image processing system and image processing program
JP2014197762A
Method of aligning dual camera modules
JP2019054501A
Parallelism determination method of camera
JP2021012203A
