A method and related device for positioning the height reference position of screen pixel layer shooting

Abstract

The present application discloses a method and related device for positioning the reference position of the shooting height of the screen pixel layer, which is used to improve the efficiency of positioning foreign matter in the interlayer of the display screen. The present application includes: determining the coordinates of the display containing foreign matter features, moving the flying camera component to the starting shooting height; controlling the flying camera component to shoot the initial image collection and obtain the clarity of all images; obtaining the intermediate image corresponding to the maximum clarity in the clarity collection and its sequence position in the initial image collection; obtaining the target image collection according to the preset rules; establishing the index relationship of the clarity of all images at the shooting height; fitting the index relationship to obtain the clarity fitting function; calculating the correlation change rate curve of the image clarity and the image shooting height and the maximum extreme point of the clarity according to the clarity fitting function, and determining the target shooting height according to the maximum extreme point; calculating the sum of the target shooting height and the starting shooting height to obtain the target height.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a method for locating a height reference position of a screen pixel layer shooting and a related device. Background Art

[0002] With the continuous progress of the times, the rapid development of science and technology has brought about the upgrading of various electronic devices. As an indispensable visual output component of these devices, displays have been widely used in high-end electronic products such as smart phones, smart TVs, and tablets. People's pursuit of visual experience is growing, which has led to continuous breakthroughs in display technology and has gradually evolved into sophisticated and complex high-tech products.

[0003] In the prior art, the display module of the screen is usually composed of several layers. For example, the OLED display module generally includes a CG layer (cover glass), an OCA layer (optical adhesive), a POL layer (polarizer), a PANEL layer (pixel layer), a SF layer (support film), and a TU layer (composite tape) from top to bottom. In the process of assembling, bonding and forming these different hierarchical structures, foreign matter is sometimes inevitably sandwiched in them, that is, interlayer foreign matter defects. This interlayer foreign matter defect will reduce the display quality of the display product to varying degrees, and will affect consumers' visual perception and user experience. Therefore, it is very important to effectively detect interlayer foreign matter and locate it in layers.

[0004] When locating the interlayer foreign matter in layers, the first thing to do is to confirm a reference position for taking pictures. The purpose of the reference position is to be able to directly capture the position of the middle layer of the display module. The traditional method usually locates the pixel layer by manually adjusting the focus position of the microscope lens. This method has the disadvantages of high detection cost, low efficiency, strong subjectivity, and high requirements for the experience and skills of the detection technicians. The existing automatic positioning method requires collecting a set of pictures within a set height range and performing clarity analysis on each image to locate the pixel layer. However, since dozens of images need to be taken at different heights, it takes a long time and still does not meet the beat requirements in actual applications. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a method and related device for locating a screen pixel layer shooting height reference position, which is used to improve the efficiency of locating foreign objects in the interlayer of a display screen.

[0006] The technical solution provided in this application is described below:

[0007] In a first aspect, the present application provides a method for locating a reference position of a screen pixel layer shooting height, comprising:

[0008] Light up the display, determine the display coordinates containing foreign body features, and move the flying camera assembly to a preset starting shooting height directly above the display coordinates;

[0009] Control the flying camera assembly to move downward from the starting shooting height and shoot an initial image collection according to preset parameters;

[0010] Obtaining the clarity of all images in the initial image collection to obtain a clarity collection;

[0011] After performing Gaussian smoothing on the definition collection, an intermediate image corresponding to the maximum definition value in the definition collection is obtained;

[0012] Acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, to obtain a target image collection;

[0013] Calculating the shooting heights of all images in the target image collection according to a preset rule, indexing the sharpness of all images from the sharpness collection, and establishing an index relationship between the shooting height and the sharpness of all images;

[0014] Fitting the index relationship by the least square method to obtain a clarity fitting function;

[0015] Calculating a correlation change rate curve between image clarity and image shooting height according to the clarity fitting function, obtaining a maximum extreme value point of image clarity according to the correlation change rate curve, and determining a target shooting height according to the maximum extreme value point;

[0016] The sum of the target shooting height and the starting shooting height is calculated to obtain a target height, and the target height is used to determine a reference position of the display screen layer containing the foreign matter feature.

[0017] Optionally, obtaining the clarity of all images in the initial image collection to obtain the clarity collection includes:

[0018] Acquire the image to be processed in the initial image collection, and perform image segmentation on the image to be processed according to a second preset number to obtain a sub-image collection;

[0019] Calculating the clarity of all sub-images in the sub-image collection respectively;

[0020] The clarity of all sub-images is summed up and an average value is calculated to obtain the clarity of the image to be processed;

[0021] The clarity of all images in the initial image collection is calculated respectively to obtain a clarity collection of the initial image collection.

[0022] Optionally, the calculating the shooting heights of all images in the target image collection according to a preset rule, indexing the sharpness of all images from the sharpness collection, and establishing an index relationship between the shooting height and the sharpness of all images includes:

[0023] Setting the shooting height of the first image in the initial image collection to an initial value;

[0024] Calculate the shooting heights of all images in the initial image collection according to the image sampling interval in the preset parameters and the initial value as a first value to obtain a shooting height sequence;

[0025] An index relationship between the shooting height sequence and the definition collection is established according to the target image collection.

[0026] Optionally, fitting the index relationship by the least square method to obtain a clarity fitting function includes:

[0027] According to the least square method, the image shooting height in the index relationship is set as an independent variable, the image clarity is set as a dependent variable, and a second-order polynomial fitting is performed to obtain a clarity fitting function.

[0028] Optionally, calculating a correlation change rate curve between image clarity and image shooting height according to the clarity fitting function, obtaining a maximum extreme value point of image clarity according to the correlation change rate curve, and determining a target shooting height according to the maximum extreme value point includes:

[0029] Calculating the derivative of the clarity fitting function to obtain a correlation change rate curve;

[0030] The maximum value pole of the image clarity is determined according to the correlation change rate curve, and the shooting height corresponding to the derivative function is calculated according to the maximum value pole to obtain the target shooting height.

[0031] Optionally, controlling the flying camera assembly to move downward from the starting shooting height and shooting the initial image collection according to preset parameters includes:

[0032] Acquire preset parameters, wherein the preset parameters include the flying stroke, moving speed, exposure time and image acquisition interval of the flying camera assembly;

[0033] Setting the flying shooting component according to the starting shooting height;

[0034] The flying camera component is controlled to move vertically downward at the moving speed until the moving distance reaches the flying camera stroke, and during the movement, image acquisition is performed according to the image acquisition interval and the exposure time to obtain an initial image collection.

[0035] Optionally, after obtaining the sequence position of the intermediate image in the initial image collection, the method further includes:

[0036] Determining whether the sequence position of the intermediate image is within a preset interval;

[0037] If the sequence position is greater than the maximum value of the preset interval, the flying shot component is adjusted downward;

[0038] If the sequence position is less than the minimum value of the preset interval, the flying shot component is adjusted upward.

[0039] A second aspect of the present application provides a system for positioning a screen pixel layer shooting height reference position, comprising:

[0040] The first determination unit is used to light up the display, determine the coordinates of the display containing the foreign body characteristics, and move the flying shooting component to a preset starting shooting height just above the coordinates of the display;

[0041] A shooting unit, used for controlling the flying shooting assembly to move downward from the starting shooting height and shooting an initial image collection according to preset parameters;

[0042] A first acquisition unit is used to acquire the clarity of all images in the initial image collection to obtain a clarity collection;

[0043] A second acquisition unit is used to obtain an intermediate image corresponding to a maximum value of the clarity in the clarity collection after performing Gaussian smoothing on the clarity collection;

[0044] A third acquisition unit is used to acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, so as to obtain a target image collection;

[0045] A data processing unit, configured to calculate the shooting heights of all images in the target image collection according to a preset rule, index the sharpness of all images from the sharpness collection, and establish an index relationship between the shooting heights and the sharpness of all images;

[0046] A fitting unit, used for fitting the index relationship by a least square method to obtain a clarity fitting function;

[0047] a first calculation unit, configured to calculate a correlation change rate curve between image clarity and image shooting height according to the clarity fitting function, obtain a maximum extreme value point of image clarity according to the correlation change rate curve, and determine a target shooting height according to the maximum extreme value point;

[0048] The second calculation unit is used to calculate the sum of the target shooting height and the starting shooting height to obtain the target height, and the target height is used to determine the reference position of the display screen layer containing the foreign body feature.

[0049] Optionally, the first acquiring unit is specifically used for:

[0050] Acquire the image to be processed in the initial image collection, and perform image segmentation on the image to be processed according to a second preset number to obtain a sub-image collection;

[0051] Calculating the clarity of all sub-images in the sub-image collection respectively;

[0052] The clarity of all sub-images is summed up and an average value is calculated to obtain the clarity of the image to be processed;

[0053] The clarity of all images in the initial image collection is calculated respectively to obtain a clarity collection of the initial image collection.

[0054] Optionally, the data processing unit is mainly used for:

[0055] Setting the shooting height of the first image in the initial image collection to an initial value;

[0056] Calculate the shooting heights of all images in the initial image collection according to the image sampling interval in the preset parameters and the initial value as a first value to obtain a shooting height sequence;

[0057] An index relationship between the shooting height sequence and the definition collection is established according to the target image collection.

[0058] Optionally, the fitting unit is mainly used for:

[0059] According to the least square method, the image shooting height in the index relationship is set as an independent variable, the image clarity is set as a dependent variable, and a second-order polynomial fitting is performed to obtain a clarity fitting function.

[0060] Optionally, the first computing unit is mainly used for:

[0061] Calculating the derivative of the clarity fitting function to obtain a correlation change rate curve;

[0062] The maximum value pole of the image clarity is determined according to the correlation change rate curve, and the shooting height corresponding to the derivative function is calculated according to the maximum value pole to obtain the target shooting height.

[0063] Optionally, the shooting unit is mainly used for:

[0064] Acquire preset parameters, wherein the preset parameters include the flying stroke, moving speed, exposure time and image acquisition interval of the flying camera assembly;

[0065] Setting the flying shooting component according to the starting shooting height;

[0066] The flying camera component is controlled to move vertically downward at the moving speed until the moving distance reaches the flying camera stroke, and during the movement, image acquisition is performed according to the image acquisition interval and the exposure time to obtain an initial image collection.

[0067] Optionally, the system further includes:

[0068] A judging unit, used to judge whether the sequence position of the intermediate image is within a preset interval;

[0069] A first adjustment unit, configured to adjust the flying camera assembly downward when the judgment result of the judgment unit is that the sequence position is greater than the maximum value of the preset interval;

[0070] The second adjustment unit is used to adjust the flying camera assembly upward when the judgment result of the judgment unit is that the sequence position is less than the minimum value of the preset interval.

[0071] A third aspect of the present application provides a device for positioning a screen pixel layer shooting height reference position, the device comprising:

[0072] Processor, memory, input-output unit, and bus;

[0073] The processor is connected to the memory, the input and output unit, and the bus;

[0074] The memory stores a program, and the processor calls the program to execute the first aspect and any optional method in the first aspect.

[0075] A fourth aspect of the present application provides a computer-readable storage medium, on which a program is stored. When the program is executed on a computer, the program executes the first aspect and any optional method in the first aspect.

[0076] It can be seen from the above technical solutions that this application has the following advantages:

[0077] The present application obtains an initial image collection by moving the flying camera component downward to perform high-frequency photography of foreign body features, obtains the clarity of the images contained in the initial image collection, and then obtains a target clarity collection with the clearest image obtained by the flying camera component as the intermediate image, and analyzes and calculates the images in the target clarity collection and the corresponding shooting heights, and then obtains the shooting height for capturing the foreign body features in the clearest state, and the shooting height is the reference position. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] In order to more clearly illustrate the technical solution in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0079] Figure 1 A schematic flow chart of an embodiment of a method for flying position location of foreign matter delamination on a display screen in the present application;

[0080] Figure 2a It is another embodiment flow chart of the first stage of the method for flying location of foreign matter delamination on a display screen in the present application;

[0081] Figure 2b It is a flowchart of another embodiment of the second stage of the method for flying location of foreign matter delamination on a display screen in the present application;

[0082] Figure 2c It is a flowchart of another embodiment of the third stage of the method for flying location of foreign matter delamination on a display screen in the present application;

[0083] Figure 3 A schematic diagram of the structure of an embodiment of a system for flying positioning of foreign matter delamination on a display screen in the present application;

[0084] Figure 4 It is a schematic structural diagram of another embodiment of the system for flying positioning of foreign matter layering on a display screen in the present application;

[0085] Figure 5 This is a schematic structural diagram of another embodiment of the device for flying positioning of foreign matter layered on a display screen in the present application. DETAILED DESCRIPTION

[0086] It should be noted that the method for flying location of foreign matter delamination on a display screen provided by the present application can be applied to a terminal, a system, or a server. For example, the terminal can be a smart phone or a computer, a tablet computer, a smart TV, a smart watch, a portable computer terminal, or a fixed terminal such as a desktop computer. For the convenience of explanation, the present application uses the terminal as an example for illustration.

[0087] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0088] See also Figure 1 The present application first provides an embodiment of a method for flying position location of foreign matter layering on a display screen, the embodiment comprising:

[0089] S101, lighting up the display, determining the coordinates of the display containing foreign body features, and moving the flying camera assembly to a preset starting shooting height directly above the coordinates of the display;

[0090] During the Inline inspection phase when the display screen leaves the factory, the product to be inspected will be inspected. The actual operation is to light up the display screen by crimping and determine the position of the defective display screen. After obtaining the coordinates of the display screen, the terminal will control the movement of the mobile platform to make the small field of view layered camera reach directly above the display screen. In actual situations, the height distance between the small field of view layered camera and the display screen to be tested is controlled by the Z axis. When shooting the display screen, the initial position of the small field of view layered camera is a fixed height determined by a preset teaching position, that is, the starting shooting height. Based on the teaching position, shooting the display screen to be tested can determine that the captured image collection contains the image with the highest clarity corresponding to the focus value of the small field of view layered camera. Generally, the image with the highest clarity corresponds to the pixel layer of the display.

[0091] Specifically, the display module of the screen is usually composed of several layers. For example, the OLED display module generally includes CG layer (cover glass), OCA layer (optical adhesive), POL layer (polarizer), PANEL layer (pixel layer), SF layer (support film), and TU layer (composite tape) from top to bottom. At this time, it can be seen that the pixel layer is the middle layer, which is the reference position for locating the screen level where foreign objects are located.

[0092] S102, controlling the flying camera assembly to move downward from a starting shooting height and shooting an initial image collection according to preset parameters;

[0093] The small field of view layered camera is the main body of the flying photography component in this application. In order to meet the needs of flying photography, the small field of view layered camera needs to be adjusted to a camera with short exposure time and high frame rate, and the motion control card needs to be adjusted to have hardware comparison output or precise output function, so as to achieve high-speed and precise trigger control.

[0094] The preset parameters include: camera exposure time t, flying z-axis starting position Zs, flying stroke L, physical interval space for triggering the camera to take pictures, and z-axis moving speed v during flying. The actual parameter values ​​used are determined according to actual parameters such as the actual screen body thickness and positioning accuracy. The specific actual parameters and preset parameter setting values ​​are not limited here.

[0095] After the terminal sets the flying camera component according to the preset parameters, the flying camera component will move downward from the starting shooting height Zs according to the z-axis moving speed v until the moving distance reaches the flying camera stroke L. During the downward movement, the flying camera component will trigger exposure for a duration of exposure time t according to the physical spacing distance space in the preset parameters, thereby obtaining the initial image collection.

[0096] For example, when t=1ms, the flying stroke L=4mm, the interval space=0.1mm, and v=4mm / s, the flying component will collect a total of 41 images, recorded as {In|n=0, 1, 2, 3, ... , 39, 40}.

[0097] S103, obtaining the clarity of all images in the initial image collection to obtain a clarity collection;

[0098] The purpose of obtaining the clarity of all images in the initial image collection is to provide a data basis for obtaining the image with the best clarity. The method of obtaining the clarity of all images in the initial image collection includes but is not limited to edge detection, contrast analysis, etc. The clarity of the image is recorded as FV, ​​and the clarity collection corresponding to the initial image collection is recorded as {FVn| n=0,1, 2, 3, ... , 39, 40}.

[0099] S104, after performing Gaussian smoothing on the definition collection, an intermediate image corresponding to the maximum definition value in the definition collection is obtained;

[0100] Gaussian smoothing is used to reduce random noise in the data while retaining the main features of the data in the image. After Gaussian smoothing of the image, the noise of the image will be reduced, and the edges and details will become smoother. Specifically, the clarity collection is Gaussian smoothed and recorded as {FV'n| n=0, 1, 2, 3, ... , 39, 40}.

[0101] Secondly, in order to prevent the FV values ​​of some images far away from the actual pixel layer from interfering with the subsequent data fitting when taking more images, the image index corresponding to the maximum value of the clarity {FV'n| n=0, 1, 2, 3, ... , 39, 40} is taken here. The image with the maximum clarity is the intermediate image, denoted by Mx.

[0102] S105, obtaining the sequence position of the intermediate image in the initial image collection, and obtaining a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, to obtain a target image collection;

[0103] The intermediate image is the image with the highest clarity in the initial image collection. S data are selected on both sides of the actual sorting position of the intermediate image in the initial image collection, where s is a first preset number. The value of the first preset number is generally an odd number less than 2 / n. The purpose of taking an odd number is to make the intermediate image the only intermediate value in the target image sequence.

[0104] The data in the initial image collection is screened by a first preset number, and the obtained data is the target image collection, which is recorded as {FVsn| sn=Mx-s, Mx-s+1, Mx-s+2, ... , Mx+s-1, Mx+s}.

[0105] When Mx-s<0, the image is taken from the first image in the initial image collection, that is, sn = 0, 1, 2,... , Mx+s-1, Mx+s;

[0106] When Mx+s>40, take the last image of the initial image collection, that is, sn = Mx-s, Mx-s+1, Mx-s+2, ... 39, 40.

[0107] S106, respectively calculating the shooting heights of all images in the target image collection according to a preset rule, indexing the sharpness of all images from the sharpness collection, and establishing an index relationship of the sharpness of all images at the shooting heights;

[0108] To facilitate the processing of data in the target image collection, after the target image collection is obtained, the flying start position of the initial image collection is set to 0, and the corresponding shooting height of the image of the initial target image collection is calculated according to the physical spacing distance space. For example, space=0.1mm is taken here, then the shooting height of the initial image collection is recorded as {Zn|Zn=0, 0.1, 0.2, 0.3, ... , 3.8, 3.9, 4.0}. After determining the shooting height of the initial image collection, the shooting height corresponding to the target image collection is indexed according to the shooting height data, and the determined index relationship is recorded as {Zsn| sn=Mx-s, Mx-s+1, Mx-s+2, ... , Mx+s-1, Mx+s}.

[0109] Specifically, after the flying start position of the initial image collection is set to 0, the Z-axis zero point position is located at the top of the Z axis. Based on this, the shooting height of the image corresponding to FVmx in the initial image collection is:

[0110] Initial shooting height Zs + (physical spacing distance space * FVmx sequence n in the initial image collection);

[0111] The shooting height of the image corresponding to FVmx in the target image collection is directly obtained by the value corresponding to Mx in {Zsn| sn=Mx-s, Mx-s+1,Mx-s+2, ... , Mx+s-1, Mx+s}.

[0112] That is, when the initial shooting height is 100 mm, the physical spacing distance space is 0.1 mm, and the sequence of FVmx in the initial image is 15, for the initial image collection, the shooting height of FVmx is 101.5; for the target image collection, the shooting height Zn of FVmx is 1.5.

[0113] S107, fitting the index relationship by the least square method to obtain a clarity fitting function;

[0114] The least square method is used to perform a second-order polynomial fitting on the index relationship between the shooting clarity and shooting height of the image in the target image collection obtained in step S106 to obtain a clarity fitting function, which is recorded as f(Z, FV).

[0115] S108, calculating a correlation change rate curve between image clarity and image shooting height according to a clarity fitting function, obtaining a maximum extreme value point of image clarity according to the correlation change rate curve, and determining a target shooting height according to the maximum extreme value point;

[0116] The correlation change rate curve is obtained by differentiation, that is, the derivative function f' is derived for f(Z, FV), and f' is set to 0. When the derivative is 0, the extreme point of the maximum clarity of the fitting function f(Z, FV) can be found, so as to obtain the shooting height corresponding to the extreme point. The shooting height of the extreme point of clarity is recorded as Zr.

[0117] S109, calculating the sum of the target shooting height and the starting shooting height to obtain the target height, and the target height is used to determine the reference position of the display screen layer containing the foreign matter feature.

[0118] Because the shooting height used in the calculation of the clarity fitting function is the reset shooting height, for the initial shooting height Zs, Zr is a correction value for the initial shooting height. The target height obtained by correcting Zs by Zr is recorded as Zp, so that the image captured by the flying camera component at the target height Zp is the clearest, that is, the height of the display pixel layer captured by the flying camera component. The specific correction method is Zp = Zs + Zr.

[0119] See also Figure 2a , Figure 2b and Figure 2c The present application provides another embodiment of a method for flying positioning of foreign matter layering on a display screen, the embodiment comprising:

[0120] S201, lighting up the display, determining the coordinates of the display containing foreign body features, and moving the flying camera assembly to a preset starting shooting height directly above the coordinates of the display;

[0121] Step S201 in this embodiment is similar to step S101 in the aforementioned embodiment, and will not be described in detail here.

[0122] S202, obtaining preset parameters, the preset parameters including the flying stroke, moving speed, exposure time and image collection interval of the flying component;

[0123] The preset parameters include: camera exposure time t, flying z-axis starting position Zs, flying stroke L, physical interval distance space that triggers the camera to take pictures, and z-axis moving speed v during flying.

[0124] The preset parameters are initial values ​​stored in the terminal before the inline test phase and are adaptively set according to the batch of screens to be tested.

[0125] Specifically, the camera exposure time t in the preset parameters determines the brightness of the image taken by the flying camera component. Shortening the exposure time under the condition of meeting the brightness can freeze fast motion and achieve the purpose of reducing motion blur; the flying camera Z-axis starting position Zs is the height of the starting point of the flying camera component; the flying camera stroke L is the distance that the flying camera component moves downward from Zs. Generally, the value of L is slightly larger than the actual thickness of the display screen to be tested, so that when the flying camera component shoots the display screen to be tested, it can focus on each layer of the display screen to be tested, but the screen layer that provides brightness is the pixel layer (PANEL layer). Therefore, based on the display screen image acquisition through flying camera on the screen in the lit state, the highest definition image obtained is the image of the pixel layer; the unit of the physical interval space that triggers the camera to take pictures is generally a length unit, that is, the distance that the flying camera component moves downward. When the flying camera component moves downward by a distance space, a photo action is triggered. The z-axis moving speed v during flying shooting is the speed at which the flying camera component moves vertically downward with the z-axis as the motion axis. The moving speed v is generally set according to the performance of the flying camera component.

[0126] S203, setting the flying shooting component according to the starting shooting height;

[0127] Specifically, the starting shooting height corresponds to the flying camera z-axis starting position Zs in step S202, that is, the initial height of the flying camera component before taking pictures. The starting height of the flying camera component is a height that enables the flying camera component to focus on the pixel layer of the display screen to be tested when moving downward to take pictures. The flying camera component is set according to the starting shooting height so that the initial image collection subsequently acquired will inevitably contain the highest definition image based on the pixel layer.

[0128] S204, controlling the flying camera component to move vertically downward at a moving speed until the moving distance reaches the flying camera stroke, and collecting images according to the image collection interval and exposure time during the movement to obtain an initial image collection;

[0129] In step S203, the flying camera component has been set to the starting shooting height Zs. According to the preset parameters, the flying camera component is controlled to start moving vertically downward at a preset z-axis moving speed v. During the downward movement, the terminal monitors the moving distance of the flying camera component so that the flying camera component stops moving when the moving stroke reaches the flying stroke L. In the process of the flying camera component moving downward, a trigger mechanism is set to collect images according to the preset image collection interval space and exposure time t. Whenever the flying camera component moves downward by a distance of space, the camera is triggered to expose and shoot once. The preset exposure time t is used to control the light exposure amount of each shooting to ensure that the image brightness is appropriate and that fast motion can be frozen to reduce blur. In the process of moving to the flying stroke L, the flying camera component continuously collects images to form a series of images, which constitute the initial image collection. The terminal controls the synchronization of image acquisition and the movement of the flying camera component to ensure that each image can correspond to the z-axis height position when shooting in the shooting order. Each image collected is stored in the order of shooting. When the flying camera component completes the whole process of moving down from the height Zs to the distance L and triggers shooting according to the image collection interval space, a complete initial image collection is obtained, which is recorded as {In | n=0, 1, 2, 3, ..., 39, 40}. The initial image collection will be used for subsequent clarity analysis, Gaussian smoothing, data screening and fitting steps to determine the reference position of the display screen layer of the foreign body feature.

[0130] S205, obtaining an image to be processed from the initial image collection, and performing image segmentation on the image to be processed according to a second preset number to obtain a sub-image collection;

[0131] The process of calculating the clarity of the image to be processed is started when the corresponding image is acquired, that is, when the flying camera component takes the first picture, the clarity analysis of the acquired picture will be performed.

[0132] The image to be processed is the image captured by the flying camera component. After the image to be processed is obtained, the terminal will cut the image to be processed according to the second preset number. The second preset number selection includes but is not limited to: set to 1 (no image cutting), 4 (cut the image in 2*2), 9 (cut the image in 3*3), etc. The cutting number can be set according to actual needs and is not limited here. For example, when the cutting number (the second preset number) is set to 4, the image to be processed will be cut into 4 sub-images, and these 4 sub-images correspond to a sub-image collection.

[0133] Specifically, a cutting algorithm is applied to each image to be processed, and the image is evenly cut into a plurality of sub-images according to a second preset number. The cutting method can be equal division in the horizontal and vertical directions to ensure that each sub-image has the same size, and the sub-images obtained by cutting each image to be processed are collected to form a sub-image collection. Each sub-image collection corresponds to an original image to be processed, and the order of the images to be processed before cutting is maintained. The total of the sub-images obtained is used for subsequent analysis and calculation of the clarity of the image to be processed.

[0134] S206, respectively calculating the clarity of all sub-images in the sub-image collection;

[0135] Using a no-reference image clarity evaluation method, clarity evaluation calculations are performed on each sub-image to obtain a clarity value corresponding to each sub-image; wherein, the no-reference image clarity evaluation method may adopt an evaluation method based on a gradient function, a method based on an image transform domain, an entropy function method, a quadratic blur clarity algorithm, and a structural similarity measurement method, etc., which are not specifically limited here.

[0136] Specifically, after obtaining the sub-image collection, the terminal determines one or more no-reference image clarity evaluation methods. The no-reference image clarity evaluation method uses the original image as a reference, directly extracts features from the sub-image itself for clarity evaluation, extracts features related to clarity for each sub-image, and the features include but are not limited to image gradients, frequency domain components, local contrast, edge information, etc., which are used to represent data on the focusing state of the image. The no-reference image clarity evaluation method is applied to the features of each sub-image, and a clarity score for each sub-image is calculated. When multiple no-reference image clarity evaluation methods are used to calculate image clarity, it is necessary to standardize the clarity scores obtained by each no-reference image clarity evaluation method so that the clarity calculated by different no-reference image clarity evaluation methods is comparable. The sub-image clarity evaluations obtained by the no-reference image clarity evaluation method are comprehensively analyzed, and the clarity value of each sub-image is recorded for subsequent analysis.

[0137] S207, summing up the sharpness of all sub-images and calculating an average value to obtain the sharpness of the image to be processed;

[0138] After obtaining the clarity values ​​of all sub-images in the sub-image collection for the image to be processed, the terminal will sum the clarity of all sub-images in the sub-image collection and calculate the average value. The result obtained is the actual clarity of the image to be processed corresponding to the sub-image collection.

[0139] Specifically, taking the case where the second preset number is 4 and the image to be processed is cut as an example, the terminal will generate a sub-image collection according to the cutting result, and the sub-image collection contains 4 sub-image elements corresponding to the image to be processed. The clarity values ​​of all sub-images in the sub-image collection are calculated by the method of step S206, and the obtained result is recorded as {f1, f2, f3, f4}. The process of calculating the clarity of the image to be processed according to {f1, f2, f3, f4} is FV= (f1+f2+f3+f4) / 4, wherein the divisor in the equation is the value of the second preset number in step S205.

[0140] The calculation result FV is the clarity value of the image to be processed.

[0141] S208, respectively calculating the clarity of all images in the initial image collection to obtain a clarity collection of the initial image collection;

[0142] According to the method of step S207, clarity analysis and calculation are performed on all the images to be processed obtained in the initial image collection, and the calculated clarity is used to index the initial image collection, and the association result obtained by the index is recorded as {FVn| n=0, 1, 2, 3, ... , 39, 40}, which corresponds to the clarity of the nth image in the initial image collection.

[0143] S209, after performing Gaussian smoothing on the definition collection, an intermediate image corresponding to the maximum definition value in the definition collection is obtained;

[0144] S210, obtaining the sequence position of the intermediate image in the initial image collection;

[0145] Steps S209 to S210 in this embodiment are similar to steps S104 to S105 in the aforementioned embodiment, and will not be described in detail here.

[0146] S211, determining whether the sequence position of the intermediate image is within a preset interval;

[0147] The intermediate image is the image with the highest definition in the initial image collection captured by the flying camera component. According to the description of the aforementioned step S10, it can be known that the pixel layer is the intermediate layer of the layered display screen to be tested, that is, the reference layer for locating the layer where the foreign object is located. Relatively speaking, the setting height of the flying camera component at this time is the reference position for photographing the reference layer of the screen to be tested.

[0148] The specific role of the benchmark in determining screen foreign matter is as follows: in the actual process of determining the screen layer where the foreign matter is located, it is necessary to determine the benchmark position of the pixel layer, so that the image of the foreign matter defect on the screen to be tested can be sampled through the benchmark position, and the clarity of the foreign matter defect can be analyzed to first determine whether the foreign matter defect is on the screen of the screen to be tested or inside the screen. When the foreign matter is inside the screen, the terminal will use the pixel layer clarity (the clarity of the benchmark position image) as the preset value, and perform a correlation score analysis on the clarity of the foreign matter image, and determine the specific layer of the screen to be tested where the foreign matter is located through the results of the correlation score analysis.

[0149] Therefore, the shooting height of the intermediate image is the height closest to the reference position, but in actual conditions, the sequence position of the intermediate image in the initial image collection is too large or too small, which will affect the subsequent acquisition of relevant data for determining the specific reference position of the flying camera component through the intermediate image. Therefore, when the intermediate image is acquired, the terminal will judge the specific sequence position of the intermediate image in the initial image collection. The specific judgment condition is whether the sequence position of the intermediate image is within the preset interval. The minimum value of the preset interval cannot be 0, and the maximum value cannot be greater than the number of initial image collections acquired by the flying camera component. The embodiment of the present application provides the following example: When the preset interval is [3,37], when the sequence position of the intermediate image is greater than 37, step S212 is executed, and when the sequence position of the intermediate image is less than 3, step 213 is executed.

[0150] S212, if the sequence position is greater than the maximum value of the preset interval, the flying shot component is adjusted downward;

[0151] According to the description of step S211, when the sequence position of the intermediate image is greater than 37, it means that the initial image data acquired by the current flying camera component is overly concentrated in the position below the pixel layer, and the starting height of the flying camera component should be adjusted to re-acquire the initial image collection for clarity analysis.

[0152] S213: If the sequence position is less than the minimum value of the preset interval, the flying shot component is adjusted upward.

[0153] According to the description of step S211, when the sequence position of the intermediate image is less than 3, it means that the initial image data acquired by the current flying camera component is overly concentrated in the position above the pixel layer, and the starting height of the flying camera component should be lowered to re-acquire the initial image collection for clarity analysis.

[0154] S214, acquiring a first preset number of flying images from the initial image collection to the left and right with the middle image as the center, to obtain a target image collection;

[0155] Step S214 in this embodiment is similar to step S105 in the aforementioned embodiment, and will not be described in detail here.

[0156] S215, setting the shooting height of the first image in the initial image collection as an initial value;

[0157] In actual situations, the shooting height of the flying camera component changes due to the continuous adaptive adjustment of the screen, resulting in the actual recorded height data not being an integer that is easy to calculate. For the convenience of calculation, after the terminal obtains the target image collection, the shooting height of the image sequence in the initial image collection will be reset to an initial value that is more convenient to calculate. That is, when the initial value is set to 0, the shooting height corresponding to the image numbered 0 in FVn is set to 0.

[0158] S216, calculating the shooting heights of all images in the initial image collection according to the image sampling interval in the preset parameters and taking the initial value as a first value to obtain a shooting height sequence;

[0159] When the shooting height of the first image is determined, the shooting heights of subsequent images in the sequence of the initial image collection can be calculated in the following way. The calculation result is recorded as Zn, that is: Zn=space*n, so as to obtain the shooting height of the initial image collection after resetting the initial value, that is, the shooting height sequence. The shooting height sequence is recorded as {Zn| Zn=0, 0.1, 0.2, 0.3,... , 3.8, 3.9, 4.0}.

[0160] S217: Establish an index relationship between the shooting height sequence and the definition collection according to the target image collection.

[0161] According to the aforementioned step S105, the target image collection is expressed as {FVsn| sn=Mx-s, Mx-s+1,Mx-s+2, ... , Mx+s-1, Mx+s}, where sn is the sequence of the images of the target image collection in the initial image collection, and sn is used as the index of the shooting height sequence. The shooting height value of the image with the sequence sn in the target image collection in the shooting height sequence is obtained to obtain an index relationship, which is recorded as: {Zsn| sn=Mx-s, Mx-s+1, Mx-s+2, ..., Mx+s-1, Mx+s}.

[0162] S218. According to the least square method, the image shooting height in the index relationship is set as the independent variable, the image clarity is set as the dependent variable, and a second-order polynomial fitting is performed to obtain a clarity fitting function.

[0163] The index relationship determined in step S217 includes the shooting height Zsn and the corresponding definition value FVsn of each image in the target image collection. The second-order polynomial model is used as the fitting model. The corresponding linear equations are generated one by one for all the corresponding relationships in the index relationship according to the second-order polynomial model setting. The coefficients of the linear equations are calculated respectively by the least square method. A set of linear equation coefficients is obtained by substituting all the corresponding relationships into the linear equations for calculation. The obtained linear equation coefficients are constructed into a normal equation group (Normal Equation). The normal equation group is solved by matrix operation to obtain the specific values ​​of the linear equation coefficients. The coefficients are substituted into the second-order polynomial model to obtain the definition fitting function f(Z, FV).

[0164] S219, calculating the derivative of the clarity fitting function to obtain a correlation change rate curve;

[0165] It can be seen from step S218 that the clarity fitting function f(Z, FV) is a second-order polynomial, and its derivative is a first-order polynomial. By plotting the first-order polynomial obtained after deriving the clarity fitting function, a curve showing the change of clarity FV with the shooting height Z can be obtained. This curve is usually called a correlation change rate curve or a clarity gradient curve.

[0166] Specifically, the terminal derivates the definition fitting function f(Z, FV) and records the result as: f'(Z, FV), wherein the image drawn by f'(Z, FV) is a curve of the rate of change of the correlation between the image definition and the image shooting height.

[0167] S220 , determining the maximum value point of the image clarity according to the correlation change rate curve, and calculating the shooting height corresponding to the derivative function according to the maximum value point to obtain the target shooting height.

[0168] After determining f', let f'= 0 to represent the limit state of clarity, and then calculate f'=0 to obtain the shooting height corresponding to the maximum clarity value. This shooting height is the target shooting height and is recorded as Zr.

[0169] Specifically, the process of taking the derivative of f(Z, FV) is to take f(Z, FV)=aZ 2 +bZ+c, where a, b, c are the coefficients calculated in step S218, and the derivative f'(Z, FV)=2aZ+b, so f'= 0 is actually the calculation of 2aZ+b=0, and the result is Z=-b / 2a, that is, Zr=-b / 2a, which means that Zr can be a negative value.

[0170] In step S215, after obtaining the target image collection, the terminal resets the shooting height of the initial image collection. Therefore, the target shooting height Zr is calculated based on the initial shooting height Zn. For the initial shooting height Zs, the Zr calculated at this time is a correction value that can be a positive value or a negative value. Therefore, when calculating the target height Zp, the calculation process is Zp=Zs+Zr, that is, the target height Zp is the z-axis height of the flying camera component that can directly shoot the pixel layer after correcting the shooting height Zr of the maximum pixel layer shooting clarity at the starting shooting height Zs.

[0171] S221. Calculate the sum of the target shooting height and the starting shooting height to obtain the target height, which is used to determine the reference position of the display screen layer containing the layer where the foreign matter is located.

[0172] Step S221 in this embodiment is similar to step S109 in the aforementioned embodiment, and will not be described in detail here.

[0173] The above is a detailed description of the method for on-the-fly positioning of foreign matter layering on a display screen in an embodiment of the present application. The following is a detailed description of the system and device for on-the-fly positioning of foreign matter layering on a display screen.

[0174] See also Figure 3 The present application provides an embodiment of a system for flying positioning of foreign matter layering on a display screen, the embodiment comprising:

[0175] The first determination unit 301 is used to light up the display, determine the display coordinates containing foreign body features, and move the flying shooting component to a preset starting shooting height just above the display coordinates;

[0176] The shooting unit 302 is used to control the flying shooting component to move downward from the starting shooting height and shoot an initial image collection according to preset parameters;

[0177] The first acquisition unit 303 is used to acquire the clarity of all images in the initial image collection to obtain a clarity collection;

[0178] The second acquisition unit 304 is used to perform Gaussian smoothing on the definition collection and obtain an intermediate image corresponding to the maximum definition value in the definition collection;

[0179] The third acquisition unit 305 is used to acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, to obtain a target image collection;

[0180] The data processing unit 306 is used to calculate the shooting heights of all images in the target image collection according to a preset rule, index the sharpness of all images from the sharpness collection, and establish an index relationship between the sharpness of all images at the shooting heights;

[0181] A fitting unit 307, used for fitting the index relationship by a least square method to obtain a sharpness fitting function;

[0182] A first calculation unit 308 is used to calculate a correlation change rate curve between image clarity and image shooting height according to a clarity fitting function, obtain a maximum extreme value point of image clarity according to the correlation change rate curve, and determine a target shooting height according to the maximum extreme value point;

[0183] The second calculation unit 309 is used to calculate the sum of the target shooting height and the starting shooting height to obtain the target height, and the target height is used to determine the reference position of the display screen layer at the level where the foreign matter is located.

[0184] In this embodiment, the functions of each unit are the same as those described above. Figure 1 The steps in the illustrated embodiments correspond to each other and will not be described again here.

[0185] See also Figure 4 The present application provides another embodiment of a system for flying positioning of foreign matter layering on a display screen, the embodiment comprising:

[0186] The first determination unit 401 is used to light up the display, determine the display coordinates containing foreign body features, and move the flying shooting component to a preset starting shooting height just above the display coordinates;

[0187] The shooting unit 402 is used to control the flying shooting component to move downward from the starting shooting height and shoot an initial image collection according to preset parameters;

[0188] The first acquisition unit 403 is used to acquire the clarity of all images in the initial image collection to obtain a clarity collection;

[0189] The second acquisition unit 404 is used to perform Gaussian smoothing on the definition collection and obtain an intermediate image corresponding to the maximum definition value in the definition collection;

[0190] A judging unit 405 is used to judge whether the sequence position of the intermediate image is within a preset interval;

[0191] A first adjustment unit 406, configured to adjust the flying component downward when the judgment result of the judgment unit 405 is that the sequence position is greater than the maximum value of the preset interval;

[0192] The second adjustment unit 407 is used to adjust the flying shot component upward when the judgment result of the judgment unit 405 is that the sequence position is less than the minimum value of the preset interval.

[0193] The third acquisition unit 408 is used to acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, to obtain a target image collection;

[0194] The data processing unit 409 is used to calculate the shooting heights of all images in the target image collection according to a preset rule, index the sharpness of all images from the sharpness collection, and establish an index relationship between the sharpness of all images at the shooting heights;

[0195] A fitting unit 410, configured to fit the index relationship by a least square method to obtain a clarity fitting function;

[0196] The first calculation unit 411 is used to calculate the correlation change rate curve between the image clarity and the image shooting height according to the clarity fitting function, obtain the maximum extreme value point of the image clarity according to the correlation change rate curve, and determine the target shooting height according to the maximum extreme value point;

[0197] The second calculation unit 412 is used to calculate the sum of the target shooting height and the starting shooting height to obtain the target height, and the target height is used to determine the reference position of the display screen layer containing the foreign matter feature.

[0198] In this application, the first acquisition unit 403 is mainly used for:

[0199] Obtaining an image to be processed from the initial image collection, and performing image segmentation on the image to be processed according to a second preset number to obtain a sub-image collection;

[0200] Calculate the clarity of all sub-images in the sub-image collection respectively;

[0201] The clarity of all sub-images is summed up and the average value is calculated to obtain the clarity of the image to be processed;

[0202] The clarity of all images in the initial image collection is calculated respectively to obtain a clarity collection of the initial image collection.

[0203] In this application, the data processing unit 409 is mainly used for:

[0204] Set the shooting height of the first image in the initial image collection to the initial value;

[0205] Calculate the shooting heights of all images in the initial image collection according to the image sampling interval in the preset parameters and the initial value as the first value to obtain a shooting height sequence;

[0206] An index relationship between the shooting height sequence and the clarity collection is established according to the target image collection.

[0207] In this application, the fitting unit 410 is mainly used for:

[0208] According to the least square method, the image shooting height in the index relationship is set as the independent variable, the image clarity is set as the dependent variable, and a second-order polynomial fitting is performed to obtain the clarity fitting function.

[0209] In this application, the first computing unit 411 is mainly used for:

[0210] Calculate the derivative of the clarity fitting function to obtain the correlation change rate curve;

[0211] The maximum value point of the image clarity is determined according to the correlation change rate curve, and the shooting height corresponding to the derivative function is calculated according to the maximum value point to obtain the target shooting height.

[0212] In this application, the shooting unit 402 is mainly used for:

[0213] Obtaining preset parameters, including the flight travel, moving speed, exposure time, and image acquisition interval of the flight camera component;

[0214] Set the flying shooting component according to the starting shooting height;

[0215] The flying camera component is controlled to move vertically downward at a moving speed until the moving distance reaches the flying camera stroke. During the movement, images are collected according to the image collection interval and exposure time to obtain an initial image collection.

[0216] In this embodiment, the functions of each unit are the same as those described above. Figure 2a , Figure 2b and Figure 2c The steps in the illustrated embodiments correspond to each other and will not be described again here.

[0217] See also Figure 5 The present application provides another embodiment of a device for flying position location of foreign matter layering on a display screen, including:

[0218] Processor 501, memory 502, input and output unit 503, bus 504;

[0219] The processor 501 is connected to the memory 502, the input and output unit 503 and the bus 504;

[0220] Processor 501 specifically executes Figure 1 , Figure 2a , Figure 2b and Figure 2c The operations corresponding to the steps in the method are not described in detail here.

[0221] The present application also relates to a computer-readable storage medium on which a program is stored, wherein when the program is run on a computer, the computer is caused to execute any of the above methods.

[0222] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0223] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0224] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0225] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0226] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), disk or optical disk, etc. Various media that can store program codes.

Claims

1. A method for locating the reference position of the shooting height of a screen pixel layer, It is characterized in that The method comprises: Light up the display, determine the display coordinates containing foreign body features, and move the flying camera assembly to a preset starting shooting height directly above the display coordinates; Control the flying camera assembly to move downward from the starting shooting height and shoot an initial image collection according to preset parameters; Obtaining the clarity of all images in the initial image collection to obtain a clarity collection; After performing Gaussian smoothing on the definition collection, an intermediate image corresponding to the maximum definition value in the definition collection is obtained; Acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, to obtain a target image collection; Calculating the shooting heights of all images in the target image collection according to a preset rule, indexing the sharpness of all images from the sharpness collection, and establishing an index relationship between the shooting height and the sharpness of all images; Fitting the index relationship by the least square method to obtain a clarity fitting function; Calculating a correlation change rate curve between image clarity and image shooting height according to the clarity fitting function, obtaining a maximum extreme value point of image clarity according to the correlation change rate curve, and determining a target shooting height according to the maximum extreme value point; The sum of the target shooting height and the starting shooting height is calculated to obtain a target height, and the target height is used to determine a reference position of the display screen layer containing the foreign matter feature.

2. The method according to claim 1, It is characterized in that The obtaining of the clarity of all images in the initial image collection to obtain the clarity collection includes: Acquire the image to be processed in the initial image collection, and perform image segmentation on the image to be processed according to a second preset number to obtain a sub-image collection; Calculating the clarity of all sub-images in the sub-image collection respectively; The clarity of all sub-images is summed up and an average value is calculated to obtain the clarity of the image to be processed; The clarity of all images in the initial image collection is calculated respectively to obtain a clarity collection of the initial image collection.

3. The method according to claim 1, It is characterized in that The step of calculating the shooting heights of all images in the target image collection according to a preset rule, indexing the sharpness of all images from the sharpness collection, and establishing an index relationship between the shooting height and the sharpness of all images includes: Setting the shooting height of the first image in the initial image collection to an initial value; Calculate the shooting heights of all images in the initial image collection according to the image sampling interval in the preset parameters and the initial value as a first value to obtain a shooting height sequence; An index relationship between the shooting height sequence and the definition collection is established according to the target image collection.

4. The method according to claim 1, It is characterized in that The index relationship is fitted by the least square method to obtain a clarity fitting function, which includes: According to the least square method, the image shooting height in the index relationship is set as an independent variable, the image clarity is set as a dependent variable, and a second-order polynomial fitting is performed to obtain a clarity fitting function.

5. The method according to claim 4, It is characterized in that Calculating the correlation change rate curve between the image clarity and the image shooting height according to the clarity fitting function, obtaining the maximum extreme value point of the image clarity according to the correlation change rate curve, and determining the target shooting height according to the maximum extreme value point includes: Calculating the derivative of the clarity fitting function to obtain a correlation change rate curve; The maximum value pole of the image clarity is determined according to the correlation change rate curve, and the shooting height corresponding to the derivative function is calculated according to the maximum value pole to obtain the target shooting height.

6. The method according to any one of claims 1 to 5, It is characterized in that The step of controlling the flying camera assembly to move downward from the starting shooting height and shooting the initial image collection according to preset parameters comprises: Acquire preset parameters, wherein the preset parameters include the flying stroke, moving speed, exposure time and image acquisition interval of the flying camera assembly; Setting the flying shooting component according to the starting shooting height; The flying camera component is controlled to move vertically downward at the moving speed until the moving distance reaches the flying camera stroke, and during the movement, image acquisition is performed according to the image acquisition interval and the exposure time to obtain an initial image collection.

7. The method according to any one of claims 1 to 5, It is characterized in that After obtaining the sequence position of the intermediate image in the initial image collection, the method further includes: Determining whether the sequence position of the intermediate image is within a preset interval; If the sequence position is greater than the maximum value of the preset interval, the flying shot component is adjusted downward; If the sequence position is less than the minimum value of the preset interval, the flying shot component is adjusted upward.

8. A system for locating the reference position of the screen pixel layer shooting height, It is characterized in that The system comprises: The first determination unit is used to light up the display, determine the coordinates of the display containing the foreign body characteristics, and move the flying shooting component to a preset starting shooting height just above the coordinates of the display; A shooting unit, used for controlling the flying shooting assembly to move downward from the starting shooting height and shooting an initial image collection according to preset parameters; A first acquisition unit is used to acquire the clarity of all images in the initial image collection to obtain a clarity collection; A second acquisition unit is used to obtain an intermediate image corresponding to a maximum value of the clarity in the clarity collection after performing Gaussian smoothing on the clarity collection; A third acquisition unit is used to acquire the sequence position of the intermediate image in the initial image collection, and acquire a first preset number of flying images from the initial image collection to the left and right with the intermediate image as the center, so as to obtain a target image collection; A data processing unit, configured to calculate the shooting heights of all images in the target image collection according to a preset rule, index the sharpness of all images from the sharpness collection, and establish an index relationship between the shooting heights and the sharpness of all images; A fitting unit, used for fitting the index relationship by a least square method to obtain a clarity fitting function; a first calculation unit, configured to calculate a correlation change rate curve between image clarity and image shooting height according to the clarity fitting function, obtain a maximum extreme value point of image clarity according to the correlation change rate curve, and determine a target shooting height according to the maximum extreme value point; The second calculation unit is used to calculate the sum of the target shooting height and the starting shooting height to obtain the target height.

9. A device for locating the reference position of the screen pixel layer shooting height, It is characterized in that The device comprises: Processor, memory, input-output unit, and bus; The processor is connected to the memory, the input and output unit, and the bus; The memory stores a program, and the processor calls the program to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a program stored thereon, wherein the program, when executed on a computer, performs the method according to any one of claims 1 to 7.

Images