Image acquisition system, method and display panel processing equipment

By designing an image acquisition system for display panels, using real-time image signals to calculate the target displacement value and automatically adjust the device position and angle, the problem of low appearance inspection efficiency in the production process of the display panel is solved, and automated image acquisition and production efficiency are improved.

CN114354630BActive Publication Date: 2025-03-25BOE TECHNOLOGY GROUP CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210017415.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-07
Publication Date
2025-03-25
Estimated Expiration
2042-01-07

AI Technical Summary

Technical Problem

The display panel requires multiple appearance inspections during the production process, especially during the packaging process, and it is necessary to judge the cleanliness and integrity of the protective glass surface. However, since the display panel is easy to reflect and not easy to focus, existing optical platforms require manual debugging equipment when shooting clear images, resulting in high labor costs and low production efficiency.

Method used

An image acquisition system is designed, including a control device, a material carrier device and an image acquisition device. By acquiring the image signal of the target object in real time, calculating the target displacement value, and controlling the movement of the object carrier and the image acquisition device until the sharpness of the received image signal is greater than the preset threshold.

Benefits of technology

It realizes automatic adjustment of the position and angle of the load device and image acquisition device, and quickly obtains clear image signals of the display panel, reducing the time for engineers to adjust the equipment, and improving the equipment productivity and production efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114354630B_ABST
    Figure CN114354630B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an image acquisition system, including: a control device, a loading device and an image acquisition device; the loading device is used to fix the target object; the image acquisition device is used to acquire the image signal of the target object at a preset time interval and send it to the control device in real time; the control device is used to obtain the target displacement value between the loading device and the image acquisition device according to the image signal, and generate a control command carrying the target displacement value and send it to at least one of the loading device and the image acquisition device; at least one of the loading device and the image acquisition device moves according to the control command until the clarity of the image signal received in real time is greater than the preset clarity threshold. The embodiment of the present application adjusts the position distance between the loading device and the image acquisition device in real time according to the image signal, and can automatically capture a clear image of an object that is difficult to focus, and can be applied to the image appearance detection of the display panel to improve the efficiency of the image appearance detection production line.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to an image acquisition system, an image acquisition method and a display panel processing device. Background Art

[0002] The production and preparation of display panels often involves multiple appearance inspections. For example, during the packaging of the display panel, the appearance inspection is performed to determine whether the surface of the protective glass layer of the display panel is dirty, foreign, or damaged before the protective glass layer can be coated. The current appearance inspection is generally completed by taking pictures of the processed products on an optical platform that is efficient and has low pollution to the processing environment. However, for objects such as display panels that are easy to reflect light and difficult to focus, it is necessary to manually debug the equipment repeatedly so that the optical platform can capture a clear image of the display panel, which not only consumes a lot of manpower costs, but also reduces the production efficiency of the display panel. Summary of the invention

[0003] In order to solve the above problems, the embodiments of the present application propose an image acquisition system, an image acquisition method and a display panel processing device, which are intended to automatically capture clear images.

[0004] The embodiment of the present application provides an image acquisition system, the image acquisition system comprising: a control device, a loading device and an image acquisition device;

[0005] The object-carrying device is used to fix the target object;

[0006] The image acquisition device is used to acquire the image signal of the target object at a preset time interval and send it to the control device in real time;

[0007] The control device is used to obtain a target displacement value between the object carrying device and the image acquisition device according to the image signal, and generate a control command carrying the target displacement value and send it to at least one of the object carrying device and the image acquisition device;

[0008] At least one of the object carrying device and the image acquisition device moves according to the control command of the control device until the clarity of the image signal received in real time is greater than a preset clarity threshold.

[0009] Optionally, the control device includes: a target displacement value calculation module;

[0010] The target displacement value calculation module is used to obtain the current distance value between the object carrying device and the image acquisition device, and is also used to obtain the target distance value between the object carrying device and the image acquisition device according to the image signal analysis, and is also used to obtain the target displacement value between the object carrying device and the image acquisition device according to the current distance value and the target distance value;

[0011] The target distance value is a preset distance value within a focal length threshold range of the image acquisition device, and the current distance value is calculated based on the current position coordinates of the object-carrying device and the current position coordinates of the image acquisition device.

[0012] Optionally, the object carrying device comprises: a carrying platform and a three-dimensional moving module;

[0013] The carrier is used to fix the target object;

[0014] The three-dimensional movement module is used to move the stage along one or more directions of the xyz three axes according to the stage displacement distance value corresponding to the control command of the control device.

[0015] Optionally, the object carrying device further comprises: a rotating module;

[0016] The rotation module is used to rotate the stage according to the stage angular displacement value corresponding to the control command of the control device.

[0017] Optionally, the image acquisition device includes: an optical component and a 3D motor;

[0018] The optical component is used to obtain the image signal of the target object; the optical component at least includes: a camera, a lens and a light source;

[0019] The 3D motor is used to control at least one of the camera, the lens and the light source to move in one or more directions of the xyz three axes according to the optical component displacement value corresponding to the control command of the control device.

[0020] Optionally, the image acquisition system further includes: a transmission device; the transmission device is used to transmit the target object.

[0021] Optionally, the image acquisition system further comprises: a first transfer device; the object carrier is arranged on a conveyor belt of the conveyor device and moves with the conveyor belt, and the image acquisition device is arranged directly above the conveyor belt;

[0022] The first transfer device is used to transfer the target object and place it on the loading device.

[0023] Optionally, the image acquisition system further comprises: a second transfer device; the object carrier is arranged outside the conveyor belt of the conveyor, and the image acquisition device is arranged directly above the object carrier;

[0024] The second transfer device is used to transfer the target object on the conveyor belt and place it on the loading device.

[0025] Optionally, the control device further includes: an image storage module and a position storage module;

[0026] The image storage module is used to store target image signals whose clarity is greater than a preset clarity threshold;

[0027] The position storage module is used to store the shooting distance value between the object carrying device and the image acquisition device when the image acquisition device acquires the target image signal.

[0028] Optionally, the control device further includes: a shooting displacement value calculation module and a shooting control module;

[0029] The shooting displacement value calculation module is used to obtain the current distance value between the object carrying device and the image acquisition device according to the image signal analysis, and is also used to obtain the shooting displacement value between the object carrying device and the image acquisition device according to the current distance value and the shooting distance value;

[0030] The shooting control module is used to control at least one of the object carrying device and the image acquisition device to move according to the shooting displacement value, and send a shooting control command to the image acquisition device; wherein the shooting control command is used to control the image acquisition device to acquire a clear image signal of the target object.

[0031] Optionally, the control device further includes: a clarity judgment module;

[0032] The clarity judgment module is used to judge that the clarity of the image signal received in real time is greater than a preset clarity threshold when the preset clarity condition is met;

[0033] Among them, the preset clarity condition is: the contrast of the image signal is within a preset contrast threshold range, and the contour edge gradient of the image signal is within a preset contour edge gradient threshold range, and the image frequency of the image signal is within a preset image frequency threshold range, and the phase information of the image signal conforms to the preset phase information.

[0034] The present application also provides an image acquisition method, which includes:

[0035] Acquire the image signal of the target object in real time;

[0036] Obtaining a target displacement value between the object carrying device and the image acquisition device according to the image signal;

[0037] Controlling at least one of the object carrying device and the image acquisition device to move based on the target displacement value until the clarity of the image signal received in real time is greater than a preset clarity threshold;

[0038] Wherein, the object-carrying device fixes the target object, and the image acquisition device acquires the image signal of the target object at a preset time interval.

[0039] An embodiment of the present application further provides a display panel processing device, wherein the display panel processing device includes the image acquisition system described in any one of the above embodiments.

[0040] Through the above embodiments, the present application provides an image acquisition system, an image acquisition method and a display panel processing device, wherein the image acquisition system automatically adjusts the relative position of the object carrier and the image acquisition device according to the image signal transmitted in real time by the image acquisition device until the clarity of the image signal received in real time is greater than a preset clarity threshold. Accordingly, the embodiments of the present application include the following advantages:

[0041] The image acquisition system proposed in the embodiment of the present application can automatically adjust the angle, height and other parameters of the loading device and the image acquisition device to meet the image detection needs of processed products such as display panels that are prone to reflection and difficult to focus on and photograph clearly, so that the image acquisition device for taking pictures can quickly obtain clear image signals from the surface of the target object. This can effectively save or reduce the time engineers spend adjusting equipment, improve equipment utilization and image appearance detection production line efficiency, and thereby improve the degree of automation and production efficiency of display panel production. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a structural block diagram of an image acquisition system provided in an embodiment of the present application;

[0043] Figure 2 is a structural block diagram of a control device provided in an embodiment of the present application;

[0044] Figure 3 is a structural block diagram of a loading device provided in an embodiment of the present application;

[0045] Figure 4 is a structural block diagram of an image acquisition device provided in an embodiment of the present application;

[0046] Figure 5 It is a structural block diagram of an image acquisition system provided in an embodiment of the present application;

[0047] Figure 6 is a structural block diagram of another image acquisition system provided in an embodiment of the present application;

[0048] Figure 7 is a structural block diagram of a control device provided in an embodiment of the present application;

[0049] Figure 8 It is a step flow chart of an image acquisition method provided in an embodiment of the present application.

[0050] Reference numerals:

[0051] 1000-image acquisition system; 1100-carrying device; 1200-control device; 1300-image acquisition device; 1110-three-dimensional moving module; 1120-carrying platform; 1130-rotation module; 1210-target displacement value calculation module; 1220-clarity judgment module; 1230-image storage module; 1240-position storage module; 1250-shooting displacement value calculation module; 1260-shooting control module; 1310-3D motor; 1320-optical component; 1321-camera; 1322-lens; 1323-light source; 1400-transmission device; 1500-first transfer device; 1600-second transfer device. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0053] The following is a description of the embodiments of the present application with reference to the accompanying drawings:

[0054] Reference Figure 1 , Figure 1 1 is a structural block diagram of an image acquisition system 1000 provided in an embodiment of the present application. Figure 1 As shown, an embodiment of the present application provides an image acquisition system 1000 , and the image acquisition system 1000 includes: a control device 1200 , a loading device 1100 , and an image acquisition device 1300 .

[0055] The object carrying device 1100 is used to fix the target object.

[0056] The object carrying device 1100 is a carrying platform. The carrying platform in the embodiment of the present application includes a platform 1120, preferably an automatic adjustment platform capable of adjusting the position and angle of the platform 1120, and the platform 1120 can be controlled to move in the x / y / z direction and / or change the angle, so that the platform 1120 can carry the target object to any position and change the angle of the object being photographed. The platform 1120 is used to carry the target object.

[0057] The target object may be an object to be inspected that needs to be inspected for appearance through an image, and further, may be a display panel that needs to be inspected for appearance through an image.

[0058] In the embodiment of the present application, the object carrier 1100 can fix the target object at a preset position on the object carrier 1100 by using a pre-set alignment mark and an alignment mark on the target object. The alignment mark on the object carrier 1100 can be a cross mark on the surface of the carrier 1120, and the alignment mark on the target object can be a cross mark on the surface of the target object.

[0059] The image acquisition device 1300 is used to acquire the image signal of the target object at a preset time interval and send it to the control device 1200 in real time.

[0060] The object carrier 1100 may be disposed directly below the image acquisition device 1300 . After a target object to be detected is placed on the object carrier 1100 and fixed, the image acquisition device 1300 may frame and photograph the target object.

[0061] In an optional implementation, the object carrying device 1100 and the image acquisition device 1300 may also send current position signals to the control device 1200 in real time, so that the control device 1200 can understand the relative positions of the object carrying device 1100 and the image acquisition device 1300 in real time.

[0062] In the embodiment of the present application, the image acquisition device 1300 may be an optical system or an optical platform, and may include: a camera 1321, a lens 1322, a light source 1323, a signal receiving module, an optical system bracket, and a 3D motor 1310. Among them, the light source 1323 and the camera 1321 may be installed on the optical system bracket. The signal receiving device may receive the optical platform position adjustment signal sent by the control device 1200, so that the camera 1321, the lens 1322, the light source 1323 and other components in the image acquisition device 1300 may be adjusted in position or angle in the x / y / z direction. The signal receiving module may be a wireless signal receiving device.

[0063] The component types of the optical platform can be set according to the type of the object to be detected or other needs.

[0064] Among them, the optical bracket can be used to set up components such as camera 1321, lens 1322, signal receiving device, 3D motor 1310, etc.; lens 1322 and camera 1321 are used to capture the image of the target object, that is, to obtain the image signal of the target object; the signal receiving module is used to receive the optical platform position adjustment signal issued by the control device 1200 to ensure that the incident light from the light source 1323 can be reflected to the camera 1321 to generate a clear image.

[0065] The control device 1200 is used to obtain a target displacement value between the carrier device 1100 and the image acquisition device 1300 based on the image signal, and control at least one of the carrier device 1100 and the image acquisition device 1300 to move according to the target displacement value until the clarity of the image signal received in real time is greater than a preset clarity threshold.

[0066] The target displacement value may be set according to a preset adjustment step value, and the target displacement value may include a target displacement distance value and a target angular displacement value. For example, the target displacement distance step value may be (0, 2 mm, 0), and the target angular displacement step value may be 0.5° clockwise rotation.

[0067] The adjustment of the target displacement value may be completed by the object carrying device 1100 , or by the image acquisition device 1300 , or by a combination of the object carrying device 1100 and the image acquisition device 1300 .

[0068] Reference Figure 2 , Figure 2 1 is a structural block diagram of a control device 1200 provided in an embodiment of the present application. Figure 2 As shown, specifically, the determination of image clarity can be completed based on at least one of image contrast, contour edge gradient, image frequency, and phase information. Therefore, in an optional implementation, the present application further provides a control device 1200, and the control device 1200 further includes: a clarity determination module 1220.

[0069] The clarity determination module 1220 is used to determine that the clarity of the image signal received in real time is greater than a preset clarity threshold when the preset clarity condition is met.

[0070] Among them, the preset clarity condition is: the contrast of the image signal is within a preset contrast threshold range, and the contour edge gradient of the image signal is within a preset contour edge gradient threshold range, and the image frequency of the image signal is within a preset image frequency threshold range, and the phase information of the image signal conforms to the preset phase information.

[0071] Furthermore, the clarity judgment module 1220 can use a central processing unit (CPU) chip or a micro-logic control unit (MCU) chip as an information processing device, and a program for judging the clarity of the image signal can be burned into the chip, so that the clarity judgment module 1220 can realize the functions of the embodiments of the present application, and these functions can be realized using existing technologies.

[0072] In the embodiment of the present application, the control device 1200 may be a wireless control system. Furthermore, it may be a distributed wireless control system, which may include wireless control subsystems respectively arranged on the object-carrying device 1100 and the image-capturing device 1300 and a separately arranged central control system, wherein the wireless control subsystems respectively arranged on the object-carrying device 1100 and the image-capturing device 1300 respectively control the movement and adjustment of the object-carrying device 1100 and the image-capturing device 1300, and the central control system performs centralized scheduling and control.

[0073] Through the above-mentioned embodiments, the present application can meet the image detection needs of processed products such as display panels that are easy to reflect light and difficult to focus. According to the image signal transmitted in real time by the image acquisition device 1300, the angle, height and other parameters of the loading device 1100 and the image acquisition device 1300 can be automatically adjusted, so that the image acquisition device 1300 for taking pictures can quickly obtain a clear image signal of the surface of the target object, which can effectively save or reduce the time for engineers to adjust the equipment, improve the equipment utilization rate and image detection efficiency, and thus improve the production efficiency of products such as display panels.

[0074] The embodiments of the present application can be applied to image appearance detection of a target object. Therefore, in an optional embodiment, the present application also provides an image detection device, which can obtain an image signal with a clarity greater than a preset clarity threshold from the control device 1200 to perform appearance detection on the target object in the clear image signal.

[0075] Of course, in an optional embodiment, the image acquisition system 1000 may also include a display device. After acquiring an image with a clarity greater than a preset clarity threshold, the control device 1200 may also send an image signal with a clarity greater than the preset clarity threshold to the display device. The display device may display the target object in the clear image signal, and manually perform appearance detection of the target object.

[0076] like Figure 2 As shown, in an optional implementation, the present application further provides a control device 1200 , and the control device 1200 includes: a target displacement value calculation module 1210 .

[0077] The target displacement value calculation module 1210 is used to obtain the current distance value between the carrier 1100 and the image acquisition device 1300, and is also used to obtain the target distance value between the carrier 1100 and the image acquisition device 1300 based on the image signal analysis, and is also used to obtain the target displacement value between the carrier 1100 and the image acquisition device 1300 based on the current distance value and the target distance value.

[0078] The target distance value is a preset distance value within the focal length threshold range of the image acquisition device 1300 , and the current distance value is calculated based on the current position coordinates of the object-carrying device 1100 and the current position coordinates of the image acquisition device 1300 .

[0079] Among them, the current distance value, the target distance value and the target displacement value can be represented by three-dimensional coordinate values ​​and / or angular coordinate values.

[0080] Furthermore, the target displacement value calculation module 1210 can use a central processing unit CPU chip or a micro logic control unit MCU chip as an information processing device, and a program for calculating the target displacement value can be burned into the chip, so that the target displacement value calculation module 1210 can realize the functions of the embodiments of the present application, and these functions can be realized using existing technologies.

[0081] In the embodiment of the present application, the target distance value may be set according to a preset step displacement value based on the focal length threshold range of the image acquisition device 1300, and the preset step displacement value may include a preset step distance value and a preset step angle displacement value. Exemplarily, the preset step distance value may be 2mm, and the current distance value is (x1, y1, z1), then the target distance value may be (x1, y1, z1+2mm), and the target distance value is within the focal length threshold range of the image acquisition device 1300.

[0082] Further, the target displacement value may be the difference between the target distance value and the current distance value. Exemplarily, the current distance value between the object carrier 1100 and the image acquisition device 1300 is (x1, y1, z1), the target distance value between the object carrier 1100 and the image acquisition device 1300 is (x2, y2, z2), and the target displacement value to be moved is (x0, y0, z0), wherein x0=x2-x1, y0=y2-y1, and z0=z2-z1.

[0083] Reference Figure 3 , Figure 3 1 is a structural block diagram of a loading device 1100 provided in an embodiment of the present application. Figure 3As shown, the present application considers using a module that can adjust the position of the platform 1120 to adjust the position of the target object on the carrier 1100. Therefore, in an optional embodiment, the present application also provides a carrier 1100, which includes: a carrier 1120 and a three-dimensional movement module 1110.

[0084] The carrier 1120 is used to fix the target object.

[0085] Specifically, the carrier 1120 may be a transparent carrier 1120, and a transparent scratch-resistant conductive film may be provided on the surface of the transparent carrier 1120 by electroplating. Therefore, the transparent carrier 1120 may utilize the electrostatic adsorption principle to adsorb and fix the 3D protective glass of the display panel on the automatic adjustment carrier.

[0086] The three-dimensional movement module 1110 is used to move the stage 1120 along one or more directions of the xyz three axes according to the displacement distance value of the stage 1120 corresponding to the control command of the control device 1200.

[0087] Among them, the three-dimensional moving module 1110 can preferably be a three-dimensional position moving device, which can enable the carrier 1120 to move in one or more directions of the xyz three-axis, so that the three-dimensional moving module 1110 can realize the functions of the embodiments of the present application, and these functions can be realized using existing technologies.

[0088] Among them, the displacement distance value of the stage 1120 can be determined according to the control command generated by the analysis and calculation of the control device 1200. The sum of the displacement distance value of the stage 1120 and the displacement distance value of the optical component 1320 is equal to the target displacement distance value. By allocating the displacement of the stage 1120 and the displacement of the optical component 1320, the efficiency of equipment adjustment can be improved at the same time. Exemplarily, the target displacement distance value represents the need to control the object-carrying device 1100 and the image acquisition device 1300 to be 4mm away, which can be achieved by the three-dimensional movement module 1110 controlling the stage 1120 to move downward by 4mm, and can also be achieved by the three-dimensional movement module 1110 controlling the stage 1120 to move downward by 2mm and the optical component 1320 to move upward by 2mm.

[0089] The present application also considers using a module that can adjust the angle of the platform 1120 to adjust the angle of the target object on the carrier 1100. Therefore, in an optional embodiment, the present application also provides a carrier 1100, and the carrier 1100 also includes: a rotation module 1130.

[0090] The rotation module 1130 is used to rotate the carrier 1120 according to the angular displacement value of the carrier 1120 corresponding to the control command of the control device 1200.

[0091] Specifically, the rotation module 1130 may include a rotation shaft and a rotation driving unit. Driven by the rotation driving unit, the rotation shaft may drive the carrier to rotate around the rotation axis at an angle corresponding to the control command.

[0092] Furthermore, the object carrying device 1100 may also include an object carrying bracket, which may be used to set the carrier 1120 and the three-dimensional moving module 1110 .

[0093] The angular displacement value of the stage 1120 may be determined according to the control command generated by the analysis and calculation of the control device 1200. The sum of the angular displacement value of the stage 1120 and the angular displacement value of the optical component 1320 is equal to the target angular displacement value. Exemplarily, the target displacement value indicates that the object-carrying device 1100 needs to be controlled to rotate 1° clockwise relative to the image acquisition device 1300, which can be accomplished by the rotation module 1130 controlling the stage 1120 to rotate 1° clockwise, or by the rotation module 1130 controlling the stage 1120 to rotate 0.5° clockwise and the optical component 1320 to rotate 0.5° counterclockwise.

[0094] Through the above embodiments, the automatic adjustment platform in the present application can adjust the position and angle of the platform 1120 and the target object on the platform 1120 by using the three-dimensional movement module 1110 and the rotation module 1130 according to the control command.

[0095] Reference Figure 4 , Figure 4 1 is a structural block diagram of an image acquisition device 1300 provided in an embodiment of the present application. Figure 4 As shown, the present application also considers using a 3D motor 1310 to complete the position adjustment of the image acquisition device 1300. In an optional embodiment, the present application also provides an image acquisition device 1300, and the image acquisition device 1300 includes: an optical component 1320 and a 3D motor 1310.

[0096] The optical component 1320 is used to obtain the image signal of the target object; the optical component 1320 at least includes: a camera 1321, a lens 1322 and a light source 1323.

[0097] The 3D motor 1310 is used to control at least one of the camera 1321, the lens 1322 and the light source 1323 to move in one or more directions of the xyz three axes according to the displacement value of the optical component 1320 corresponding to the control command of the control device 1200.

[0098] Furthermore, the 3D motor 1310 can also be used to achieve angular rotation of the optical component 1320 .

[0099] Among them, the 3D motor 1310 is used to drive any component of the camera 1321, lens 1322, and light source 1323 to move in the x / y / z direction according to the optical platform position adjustment signal and the displacement value of the optical component 1320 corresponding to the optical platform position adjustment signal, so that the light emitted by the light source 1323 can be reflected by the display panel to be detected and then incident on the camera 1321 to generate a clear image.

[0100] Specifically, the camera 1321 may be one of the following: an area array camera 1321, a line array camera 1321, a 3D camera 1321, and a smart camera 1321. The image sensor in the camera 1321 may be one of the following: a CMOS, a CCD. The lens 1322 may be selected according to the focal length, including one of the following: a fixed focus lens 1322, a zoom lens 1322; the lens 1322 may also be selected according to the aperture, and may be one of the following: a fixed aperture, a variable aperture; the lens 1322 may also be selected according to the field of view, and may be one of the following: a telephoto lens 1322, a normal lens 1322, and a wide-angle lens 1322; the lens 1322 may also be selected according to the purpose, and may be one of the following: a telecentric lens 1322, a microscope lens 1322, a macro lens 1322, an ultraviolet lens 1322, and an infrared lens 1322.

[0101] Reference Figure 5 , Figure 5 1 is a structural block diagram of an image acquisition system 1000 provided in an embodiment of the present application. Figure 5 As shown, considering that the image acquisition system 1000 is actually applied to processing scenarios, in an optional embodiment, the present application also provides an image acquisition system 1000, and the image acquisition system 1000 also includes: a transmission device 1400; the transmission device 1400 is used to transmit the target object.

[0102] In consideration of convenience and production efficiency, the present application allows the target object to be imaged directly when being transported on the transport device 1400. Figure 5 As shown, in an optional implementation, the present application further provides an image acquisition system 1000 , and the image acquisition system 1000 further includes: a first transfer device 1500 .

[0103] The first transfer device 1500 may be a robotic arm that grasps by vacuum adsorption.

[0104] The object carrier 1100 is disposed on the conveyor belt of the conveying device 1400 and moves along with the conveyor belt, and the image acquisition device 1300 is disposed directly above the conveyor belt.

[0105] The first transfer device 1500 is used to transfer the target object and place it on the loading device 1100 .

[0106] In the embodiment of the present application, in order to improve the image acquisition efficiency and thus improve the production efficiency, a plurality of carrier devices 1100 may be arranged at equal intervals on the conveyor belt of the conveyor device 1400 at the same time.

[0107] Specifically, in the embodiment of the present application, the hovering time interval of the conveyor belt can be pre-set, the first transfer device 1500 transfers the target object and places it on the carrier device 1100, and the conveyor belt is controlled to convey a preset length within the preset hovering time interval, and the carrier device 1100 on the conveying device 1400 is pre-aligned so that it is just hovered below the image acquisition device 1300. During the hovering period, the control device 1200 controls and adjusts the position and angle of the carrier device 1100 and the image acquisition device 1300 to obtain a clear image signal.

[0108] Reference Figure 6 , Figure 6 FIG. 1 is a structural block diagram of another image acquisition system 1000 provided in an embodiment of the present application. Figure 6 As shown, the above embodiment can use multiple carriers 1100 to complete image acquisition during the transmission process. Considering the cost of the carrier 1100 and taking into account the production efficiency, the target object can be imaged after the transmission device 1400 completes the transmission. Therefore, in an optional embodiment, the present application also provides an image acquisition system 1000, and the image acquisition system 1000 also includes: a second transfer device 1600; the carrier 1100 is arranged outside the conveyor belt of the conveyor 1400, and the image acquisition device 1300 is arranged directly above the carrier 1100;

[0109] The second transfer device 1600 is used to transfer the target object on the conveyor belt to the loading device 1100 .

[0110] The second transfer device 1600 may be a robotic arm that grasps by vacuum adsorption.

[0111] Specifically, in the embodiment of the present application, the hovering time interval of the conveyor belt can be pre-set, and the conveyor belt can be controlled to convey a preset length within the preset hovering time interval. During the hovering of the conveyor belt, the second transfer device 1600 transfers the target object and places it on the loading device 1100. The control device 1200 controls and adjusts the position and angle of the loading device 1100 and the image acquisition device 1300 to obtain a clear image signal.

[0112] Taking into account that target objects such as display panels have high requirements for cleanliness and are relatively smooth, they are prone to slipping, shaking, and wear during the transmission process. In order to reduce the dust particles generated by the conveying system during the transmission process and reduce the pollution to the product, in an optional embodiment, the present application also provides a conveying device 1400, wherein the conveying device 1400 includes a conveyor belt, and the conveyor belt is made of metal.

[0113] Specifically, the conveyor belt can be a metal chain belt. The conveyor 1400 can also include at least one set of rollers, the conveyor belt forms a closed loop around the rollers, and the set of rollers can drive the conveyor belt to transmit. Exemplarily, the conveyor 1400 can also be equipped with a mechanical port of the carrier 1120, a data port for receiving control commands, a motor for driving the rollers to rotate, and a guide groove on the chain. The conveyor 1400 is driven by two motors to rotate the rollers at a preset frequency, and the rollers drive the chain to run around the rollers.

[0114] Furthermore, the conveyor belt may be made of steel or titanium alloy. Specifically, the conveyor belt may be a steel chain belt or a titanium alloy chain belt.

[0115] Reference Figure 7 , Figure 7 1 is a structural block diagram of a control device 1200 provided in an embodiment of the present application. Figure 7 As shown, in the actual production process, if the optical system performance of the image acquisition device 1300 is good enough, a clear image can be obtained at the same appropriate position for the target object of the same model and size. Then, after the target object product is changed, it is only necessary to use the image acquisition system 1000 in the above embodiment to debug the relative position and angle of the carrier device 1100 and the image acquisition device 1300 once, without adjusting each target object once. In this case, when the target object is a test sample, it is sufficient to store the debugged position and angle parameters. Therefore, in an optional embodiment, the present application also provides a control device 1200, and the control device 1200 also includes: an image storage module 1230 and a position storage module 1240.

[0116] The image storage module 1230 is used to store target image signals whose clarity is greater than a preset clarity threshold.

[0117] The position storage module 1240 is used to store the shooting distance value between the object carrying device 1100 and the image acquisition device 1300 when the image acquisition device 1300 acquires the target image signal.

[0118] Furthermore, either the image storage module 1230 or the position storage module 1240 may use a memory, such as a read-only memory, as an information processing device, in which a program that responds to storage instructions to store image signals or position information may be burned, so that the image storage module 1230 and the position storage module 1240 implement the functions of the embodiments of the present application, and these functions can be implemented using existing technologies.

[0119] The shooting distance value is the distance value between the object carrying device 1100 and the image acquisition device 1300 that can be used to obtain a clear image signal of a target object of the same model in the future. The shooting distance value may include a distance value represented by three-dimensional coordinates and an angle value represented by angular coordinates.

[0120] Furthermore, after the sample debugging is completed, subsequent products of this model can directly use the shooting distance value obtained in the above embodiment as the target displacement value. Therefore, in an optional implementation, the present application also provides a control device 1200, and the control device 1200 also includes: a shooting displacement value calculation module 1250 and a shooting control module 1260.

[0121] The shooting displacement value calculation module 1250 is used to obtain the current distance value between the carrying device 1100 and the image acquisition device 1300 based on the image signal analysis, and is also used to obtain the shooting displacement value between the carrying device 1100 and the image acquisition device 1300 based on the current distance value and the shooting distance value.

[0122] The shooting control module 1260 is used to control at least one of the loading device 1100 and the image acquisition device 1300 to move according to the shooting displacement value, and send a shooting control command to the image acquisition device 1300; wherein the shooting control command is used to control the image acquisition device 1300 to acquire a clear image signal of the target object.

[0123] The shooting displacement value is a parameter for position adjustment and angle adjustment in order to capture a clear image of the target object.

[0124] Further, the shooting displacement value may be the difference between the shooting distance value and the current distance value. Exemplarily, the current distance value between the object-carrying device 1100 and the image acquisition device 1300 is (x1, y1, z1), the shooting distance value between the object-carrying device 1100 and the image acquisition device 1300 is (x3, y3, z3), and the shooting displacement value to be moved is (x4, y4, z4), wherein x4=x3-x1, y4=y3-y1, z4=z4-z1.

[0125] Furthermore, either the shooting displacement value calculation module 1250 or the shooting control module 1260 can adopt a central processing unit CPU chip or a micro logic control unit MCU chip as an information processing device, and a program for calculating the shooting displacement value or controlling the shooting can be burned into the chip, so that the displacement value calculation module 1250 and the shooting control module 1260 can realize the functions of the embodiments of the present application, and these functions can be realized using existing technologies.

[0126] Through the above embodiments, the image acquisition system 1000 provided in the present application can adjust the distance between the carrier 1100 and the image acquisition device 1300 in real time according to the image signal received in real time when the product model is changed on the production line, and store the shooting distance value between the carrier 1100 and the image acquisition device 1300 that captures a clear image as a position relationship parameter, so that when the image appearance of the target object of the same model needs to be inspected in the future, the stored shooting distance value can be directly used, combined with the current distance, to control the displacement of one of the carrier 1100 and the image acquisition device 1300, so that a clear image can be directly captured, thereby further improving the image acquisition efficiency and product production efficiency.

[0127] In combination with the above embodiments, for acquiring sample images of display panels that are easy to reflect light and difficult to focus on, in order to further meet the image appearance inspection requirements of display panels, an image acquisition system 1000 in which a loading device 1100 is arranged on a conveying device 1400 is applied. The embodiment of the present application also exemplarily provides a method for acquiring sample images of display panels on a conveying device 1400:

[0128] In step S501 , the display panel samples are transferred from the feeding port to the side of the loading device 1100 .

[0129] Step S502: The display panel sample is transferred and suspended above the loading device 1100 by the first transfer device 1500. The first transfer device 1500 may be a robot with a suction cup.

[0130] Step S503 , using the camera 1321 alignment system, captures the alignment mark on the display panel sample and the alignment mark on the loading device 1100 , and calculates the distance value in any direction in the three-dimensional direction that the display panel sample needs to move.

[0131] Step S504, through the first transfer device 1500, control the display panel sample to move a corresponding distance in the corresponding direction, and use the camera 1321 alignment system to accurately align the alignment mark on the display panel sample and the alignment mark on the carrier 1100 again, and place the display panel sample on the carrier 1120 of the carrier 1100 according to the accurate alignment position, so that the alignment mark on the display panel sample and the alignment mark on the carrier 1100 coincide with each other.

[0132] In step S505 , the loading device 1100 is charged with electrostatic charge to adsorb the sample display panel onto the loading platform 1120 .

[0133] In step S506, the three-dimensional moving module 1110 of the object carrying device 1100 is used to control the stage 1120 carrying the display panel sample to move to the bottom of the image acquisition device 1300, and the image acquisition system 1000 provided in the above embodiment is used to automatically acquire an image signal with a clarity greater than a preset clarity threshold.

[0134] Step S507, storing image signals whose clarity is greater than a preset clarity threshold, and storing the shooting distance value between the object-carrying device 1100 and the image-carrying device 1300 when the image-carrying device 1300 acquires a clear image signal. The shooting distance value represents the distance parameter and angle parameter between the stage 1120 and the optical camera system.

[0135] Also, in order to further realize the image appearance detection requirements of the display panel, the image acquisition system 1000 applied to the carrier 1100 is arranged on one side of the conveying device 1400. Furthermore, the embodiment of the present application also exemplarily provides a method for acquiring a sample image on an independent carrier 1100:

[0136] In step S601 , the display panel sample is transferred from the feeding port to the side of the loading device 1100 by the transfer device 1400 .

[0137] Step S602: The display panel sample is transferred from the conveying device 1400 to hover above the loading device 1100 by the second transfer device 1600. The second transfer device 1600 may be a robot with a suction cup.

[0138] Step 603, using the camera 1321 alignment system, captures the alignment mark on the display panel sample and the alignment mark on the loading device 1100, and calculates the distance value in any direction in the three-dimensional direction that the display panel sample needs to move.

[0139] Step S604, through the second transfer device 1600, control the display panel sample to move a corresponding distance in the corresponding direction, and use the camera 1321 alignment system to accurately align the alignment mark on the display panel sample and the alignment mark on the carrier 1100 again, and place the display panel sample on the carrier 1120 of the carrier 1100 according to the accurate alignment position, so that the alignment mark on the display panel sample and the alignment mark on the carrier 1100 coincide with each other.

[0140] In step S605 , the loading device 1100 is charged with electrostatic charge to adsorb the sample display panel onto the loading platform 1120 .

[0141] In step S606, the three-dimensional moving module 1110 of the loading device 1100 is used to control the stage 1120 carrying the display panel sample to move to the bottom of the image acquisition device 1300, and the image acquisition system 1000 provided in the above embodiment is used to automatically acquire an image signal with a clarity greater than a preset clarity threshold.

[0142] Step S607, storing image signals whose clarity is greater than a preset clarity threshold, and storing the shooting distance value between the object-carrying device 1100 and the image-carrying device 1300 when the image-carrying device 1300 acquires a clear image signal. The shooting distance value represents the distance parameter and angle parameter between the stage 1120 and the optical camera system.

[0143] Through the above embodiments, the example method provided by the present application provides a solution for obtaining clear image signals of display panel samples for the image acquisition system 1000 in which the carrier device 1100 is fixed on the conveyor belt of the conveying device 1400 and moves with the conveyor belt, and the image acquisition system 1000 in which the carrier device 1100 is arranged on one side of the conveying device 1400 and does not move with the conveyor belt. After the display panel model is changed, the distance between the carrier device 1100 and the image acquisition device 1300 can be automatically adjusted to achieve the acquisition and storage of the sample appearance image and shooting position parameters for image appearance detection of the display panel, which greatly improves the efficiency of the display panel appearance detection and further improves the degree of automation and production efficiency of the display panel production.

[0144] Reference Figure 8 , Figure 8 : is a flowchart of a method for acquiring an image provided by an embodiment of the present application. Figure 8 As shown, based on the same inventive concept, the embodiment of the present application further provides an image acquisition method that can be applied to a control device 1200 in an image acquisition system, and the image acquisition method includes:

[0145] Step S801, acquiring an image signal of a target object in real time;

[0146] Step S802, obtaining a target displacement value between the object carrying device 1100 and the image acquisition device 1300 according to the image signal;

[0147] Step S803, controlling at least one of the object carrying device 1100 and the image acquisition device 1300 to move based on the target displacement value until the clarity of the image signal received in real time is greater than a preset clarity threshold;

[0148] The object-carrying device 1100 fixes the target object, and the image acquisition device 1300 acquires the image signal of the target object at a preset time interval.

[0149] Based on the same inventive concept, an embodiment of the present application further provides a display panel processing device, and the display panel processing device includes the image acquisition system 1000 described in any one of the above embodiments.

[0150] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0151] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0152] The above is a detailed introduction to an image acquisition system, method and display panel processing equipment provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

[0153] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0154] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0155] The term "one embodiment", "embodiment" or "one or more embodiments" herein means that a particular feature, structure or characteristic described in conjunction with the embodiment is included in at least one embodiment of the present application. In addition, please note that the examples of the term "in one embodiment" here do not necessarily all refer to the same embodiment.

[0156] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0157] In the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present application may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0158] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An image acquisition system, characterized in that: The image acquisition system comprises: a control device, a loading device and an image acquisition device; The object-carrying device is used to fix the target object; The image acquisition device is used to acquire the image signal of the target object at a preset time interval and send it to the control device in real time; The control device is used to obtain a target displacement value between the object carrying device and the image acquisition device according to the image signal, and generate a control command carrying the target displacement value and send it to at least one of the object carrying device and the image acquisition device, wherein the target displacement value is obtained based on the current distance value and the target distance value; At least one of the object carrying device and the image acquisition device moves according to the control command of the control device until the clarity of the image signal received in real time is greater than a preset clarity threshold; The target distance value is a preset distance value within a focal length threshold range of the image acquisition device, and the current distance value is calculated based on the current position coordinates of the object-carrying device and the current position coordinates of the image acquisition device.

2. The image acquisition system according to claim 1, characterized in that: The control device comprises: a target displacement value calculation module; The target displacement value calculation module is used to obtain the current distance value between the carrier and the image acquisition device, and is also used to obtain the target distance value between the carrier and the image acquisition device based on the image signal analysis, and is also used to obtain the target displacement value between the carrier and the image acquisition device based on the current distance value and the target distance value.

3. The image acquisition system according to claim 1, characterized in that: The object carrying device comprises: a carrying platform and a three-dimensional moving module; The carrier is used to fix the target object; The three-dimensional movement module is used to move the stage along one or more directions of the xyz three axes according to the stage displacement distance value corresponding to the control command of the control device.

4. The image acquisition system according to claim 3, characterized in that: The object carrying device further comprises: a rotating module; The rotation module is used to rotate the stage according to the stage angular displacement value corresponding to the control command of the control device.

5. The image acquisition system according to claim 1, characterized in that: The image acquisition device includes: an optical component and a 3D motor; The optical component is used to obtain the image signal of the target object; the optical component at least includes: a camera, a lens and a light source; The 3D motor is used to control at least one of the camera, the lens and the light source to move in one or more directions of the xyz three axes according to the optical component displacement value corresponding to the control command of the control device.

6. The image acquisition system according to claim 1, characterized in that: The image acquisition system further includes: a transmission device; the transmission device is used to transmit the target object.

7. The image acquisition system according to claim 6, characterized in that: The image acquisition system further comprises: a first transfer device; the object carrier is arranged on the conveyor belt of the conveyor device and moves with the conveyor belt, and the image acquisition device is arranged directly above the conveyor belt; The first transfer device is used to transfer the target object and place it on the loading device.

8. The image acquisition system according to claim 6, characterized in that: The image acquisition system further comprises: a second transfer device; the object carrier is arranged outside the conveyor belt of the conveyor, and the image acquisition device is arranged directly above the object carrier; The second transfer device is used to transfer the target object on the conveyor belt and place it on the loading device.

9. The image acquisition system according to claim 1, characterized in that: The control device also includes: an image storage module and a position storage module; The image storage module is used to store target image signals whose clarity is greater than a preset clarity threshold; The position storage module is used to store the shooting distance value between the object carrying device and the image acquisition device when the image acquisition device acquires the target image signal.

10. The image acquisition system according to claim 9, characterized in that: The control device further comprises: a shooting displacement value calculation module and a shooting control module; The shooting displacement value calculation module is used to obtain the current distance value between the object carrying device and the image acquisition device according to the image signal analysis, and is also used to obtain the shooting displacement value between the object carrying device and the image acquisition device according to the current distance value and the shooting distance value; The shooting control module is used to control at least one of the object carrying device and the image acquisition device to move according to the shooting displacement value, and send a shooting control command to the image acquisition device; wherein the shooting control command is used to control the image acquisition device to acquire a clear image signal of the target object.

11. The image acquisition system according to claim 1, characterized in that: The control device further comprises: a clarity judgment module; The clarity judgment module is used to judge that the clarity of the image signal received in real time is greater than a preset clarity threshold when the preset clarity condition is met; Among them, the preset clarity condition is: the contrast of the image signal is within a preset contrast threshold range, and the contour edge gradient of the image signal is within a preset contour edge gradient threshold range, and the image frequency of the image signal is within a preset image frequency threshold range, and the phase information of the image signal conforms to the preset phase information.

12. An image acquisition method, characterized in that: The image acquisition method comprises: Acquire the image signal of the target object in real time; Obtaining a target displacement value between the object carrying device and the image acquisition device according to the image signal, wherein the target displacement value is obtained based on the current distance value and the target distance value; Controlling at least one of the object carrying device and the image acquisition device to move based on the target displacement value until the clarity of the image signal received in real time is greater than a preset clarity threshold; Wherein, the object-carrying device fixes the target object, and the image acquisition device acquires the image signal of the target object at a preset time interval; The target distance value is a preset distance value within a focal length threshold range of the image acquisition device, and the current distance value is calculated based on the current position coordinates of the object-carrying device and the current position coordinates of the image acquisition device.

13. A display panel processing device, characterized in that: The display panel processing equipment comprises the image acquisition system as described in any one of claims 1-11.

Citation Information

Patent Citations

  • Microscopic imaging detector and automatic focusing method thereof

    CN103776831A