Screen position correction method, device, computing device and storage medium

By acquiring high-resolution images in the OLED display panel and determining the deflection angle of the screen area for position correction, the brightness inhomogeneity problem is solved, and the accuracy and display quality of brightness analysis are improved.

CN112862694BActive Publication Date: 2024-11-08合肥欣奕华智能机器股份有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201911100365.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-12
Publication Date
2024-11-08
Estimated Expiration
2039-11-12

AI Technical Summary

Technical Problem

The uneven brightness of the OLED display panel leads to Mura defects, affecting the display quality. The existing Demura technology is difficult to accurately analyze and compensate for the brightness of the screen particles, resulting in insufficient brightness uniformity.

Method used

By acquiring a high-resolution image, the deflection angle of the screen area relative to a predetermined direction is determined, and position correction is performed to ensure that the screen area is displayed in the predetermined direction in the image, thereby improving the accuracy of brightness analysis.

Benefits of technology

It effectively reduces the difficulty of screen position correction, improves the accuracy of brightness analysis, ensures brightness uniformity, reduces equipment hardware requirements, and simplifies the implementation process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112862694B_ABST
    Figure CN112862694B_ABST
Patent Text Reader

Abstract

The present application discloses a screen position correction method, device, computing device and storage medium. The method comprises: acquiring an image of the screen, the resolution of the image being greater than or equal to a preset image resolution, and the image having direction information of a predetermined direction; determining screen particles in the image; based on the screen particles, determining a deflection angle of a screen area in the image compared to the predetermined direction; and based on the deflection angle, performing position correction on the screen area in the image. Thus, by correcting the position of the screen, support is provided for improving the accuracy of screen particle brightness analysis.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] With the continuous development of flat display panel technology, the research and development of organic light-emitting semiconductor OLED (Organic Light-Emitting Diode) has received more and more attention. OLED can emit light by itself, with high visibility and brightness, but its brightness uniformity is the main problem it faces. Inconsistent brightness will seriously reduce the display quality of the display module. This defect is collectively referred to as mura defect in the industry. Therefore, before the display panel is put into use, it is generally necessary to repair the mura defect, that is, to correct the brightness of the display particles.

[0003] To solve this problem, in addition to improving the production process, compensation technology is also needed to compensate the brightness of its pixel particles, especially external optical compensation to eliminate Mura, namely Demura technology. In Demura technology, it is usually necessary to collect high-resolution images, analyze the brightness of screen particles, and then determine the brightness compensation difference. How to achieve accurate analysis of the brightness of screen particles and determine the accurate brightness compensation difference has become an important prerequisite for ensuring brightness uniformity. Summary of the invention

[0004] The purpose of this application is to provide a screen position correction method, device, computing equipment and storage medium to provide support for improving the accuracy of screen particle brightness analysis.

[0005] In a first aspect, an embodiment of the present application provides a screen position correction method, comprising:

[0006] Acquire an image of the screen, wherein a resolution of the image is greater than or equal to a preset image resolution, and the image has direction information of a predetermined direction;

[0007] determining screen grain in the image;

[0008] Based on the screen particles, determining a deflection angle of a screen area in the image compared to the predetermined direction;

[0009] Based on the deflection angle, the position of the screen area is corrected in the image.

[0010] In one embodiment, determining the deflection angle of the screen area in the image compared to the predetermined direction based on the screen particles includes:

[0011] Based on the screen particles, determining a minimum circumscribed rectangle in the image corresponding to the screen area;

[0012] An offset angle of a designated edge of the minimum circumscribed rectangle relative to the predetermined direction is used as a deflection angle of the screen area compared to the predetermined direction.

[0013] In one embodiment, determining the minimum bounding rectangle corresponding to the screen area in the image based on the screen particles includes:

[0014] Based on the structure element of the first size, a dilation operation is performed on the screen particles in the image;

[0015] performing an erosion operation on the expanded screen particles based on a structure element of a second size, wherein the second size is smaller than the first size;

[0016] Based on the result of the erosion operation, a minimum bounding rectangle of the screen area is drawn.

[0017] In one embodiment, the first size and / or the second size is determined based on the particle areas of screen particles away from the edge of the screen area.

[0018] In one embodiment, the minimum circumscribed rectangle surrounds the screen particle, and the distance between the side of the minimum circumscribed rectangle and the edge of the screen area is less than a predetermined distance threshold.

[0019] In one embodiment, based on the deflection angle, position correction is performed on the screen area in the image, including:

[0020] Based on the deflection angle, determining an affine transformation matrix;

[0021] Affine transformation is performed on the screen area based on the affine transformation matrix so that the screen area is displayed based on the predetermined direction in the image.

[0022] In one embodiment, determining screen particles in the image includes:

[0023] Performing image preprocessing on the image;

[0024] Dynamic threshold segmentation is performed on the preprocessed image to determine screen particles in the image.

[0025] In one embodiment, the image preprocessing includes:

[0026] A frequency domain Gaussian filtering algorithm is used to obtain a background image of the image;

[0027] Based on the background image, performing image enhancement on the image; and

[0028] The enhanced image is grayscale stretched.

[0029] In a second aspect, an embodiment of the present application provides a screen position correction device, comprising:

[0030] An image acquisition unit, used for acquiring an image of the screen, wherein the resolution of the image is greater than or equal to a preset image resolution, and the image has direction information of a predetermined direction;

[0031] a particle determination unit, configured to determine screen particles in the image;

[0032] a deflection angle determination unit, configured to determine a deflection angle of a screen area in the image compared to the predetermined direction based on the screen particles;

[0033] A correction unit is used to perform position correction on the screen area in the image based on the deflection angle.

[0034] In the third aspect, another embodiment of the present application also provides a computing device, comprising at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any screen position correction method provided in the embodiment of the present application.

[0035] In a fourth aspect, another embodiment of the present application further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to enable a computer to execute any screen position correction method in the embodiments of the present application.

[0036] The screen position correction method, apparatus, computing device and storage medium provided in the embodiments of the present application determine the deflection angle of the screen area in the image compared to a predetermined direction, and correct the position of the screen area based on the deflection angle, thereby ensuring that the screen area is displayed along the predetermined direction in the image, thereby providing support for improving the accuracy of screen particle brightness analysis.

[0037] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings introduced below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0039] Figure 1is a flow chart of a screen position correction method according to an embodiment of the present application;

[0040] Figure 2 A schematic diagram of an image processing flow according to an embodiment of the present application;

[0041] Figure 3 is a schematic diagram of screen particles according to an embodiment of the present application;

[0042] Figure 4 A schematic diagram of a process for determining a minimum circumscribed rectangle of a screen area according to an embodiment of the present application;

[0043] Figure 5 is a schematic diagram of expanded screen particles according to an embodiment of the present application;

[0044] Figure 6 A schematic diagram of screen particles after corrosion according to an embodiment of the present application;

[0045] Figure 7 is a schematic diagram of a minimum circumscribed rectangle according to an embodiment of the present application;

[0046] Figure 8 A schematic diagram of an image preprocessing process according to an embodiment of the present application;

[0047] Fig. 9 is a schematic diagram of an image after screen position correction according to an embodiment of the present application;

[0048] Fig.10 A verification schematic diagram according to an embodiment of the present application;

[0049] Fig.11 is a schematic diagram of a screen position correction device according to an embodiment of the present application;

[0050] Fig.12 is a schematic diagram of a computing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] As mentioned above, with the continuous development of flat display panel technology, the research and development of OLED has received more and more attention. OLED can emit light by itself, with high visibility and brightness, but its brightness uniformity is the main problem it faces. Inconsistent brightness will seriously reduce the display quality of the display module. This defect is collectively referred to as mura defect in the industry. Therefore, before the display panel leaves the factory, it is generally necessary to repair the mura defect, that is, to correct the brightness of the display particles.

[0052] To solve this problem, in addition to improving the production process, compensation technology is also needed to compensate the brightness of its pixel particles, especially external optical compensation to eliminate Mura, namely Demura technology. In Demura technology, it is usually necessary to collect high-resolution images, analyze the brightness of screen particles, and then determine the brightness compensation difference. How to achieve accurate analysis of the brightness of screen particles and determine the accurate brightness compensation difference has become an important prerequisite for ensuring brightness uniformity.

[0053] Currently, when capturing high-resolution images using Demura technology, the screen will be more or less deflected when it is placed, and these tiny deflections will cause uneven brightness of the screen area in the captured image, resulting in errors in the brightness of the extracted screen particles.

[0054] In view of this, an embodiment of the present application proposes a screen position correction scheme, which determines the deflection angle of the screen area in the image compared to a predetermined direction, and corrects the position of the screen area based on the deflection angle, thereby ensuring that the screen area is displayed along the predetermined direction in the image, thereby providing support for improving the accuracy of screen particle brightness analysis.

[0055] To make the purpose, technical solution and advantages of the embodiments of the present invention more clear, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0056] Figure 1 The figure is a flowchart of a screen position correction method according to an embodiment of the present application.

[0057] like Figure 1 As shown, in step S110, an image of the screen is acquired. The resolution of the image is greater than or equal to a preset image resolution, and the image includes direction information of a predetermined direction.

[0058] In step S120, screen particles in the image, that is, display particles corresponding to screen pixels in the image, are determined. In step S130, based on the screen particles, a deflection angle of the screen area in the image compared to the predetermined direction is determined;

[0059] In step S140, based on the deflection angle, position correction is performed on the screen area in the image.

[0060] Therefore, through the above method steps, by determining the deflection angle of the screen area in the image and correcting the position of the screen, the screen is displayed in the image based on a predetermined direction (such as horizontal or vertical direction) as much as possible, thereby providing support for improving the accuracy of screen particle brightness analysis. The method has small errors, low requirements on device hardware, and is easy to implement, which can greatly reduce the difficulty of implementing screen position correction.

[0061] The details of the above method steps will be described in detail below.

[0062] First, in step S110, the embodiment of the present application can obtain an image of the screen through a camera, for example. When performing image acquisition in step S110, for example, the panel, i.e., the screen, can be lit up and several pictures can be displayed. Then, the selected camera is used to shoot the above pictures.

[0063] To ensure that the screen particles can be obtained more accurately based on the acquired image, for example, a high-resolution camera can be used to obtain a high-resolution image. In the embodiment of the present application, a camera with a resolution that meets the requirements can be selected based on screen-related parameters, such as screen size, screen particle size, pixel pitch, resolution, and other parameters.

[0064] In one embodiment, for example, the resolution of the captured image is greater than or equal to the preset image resolution. Here, the preset image resolution may be, for example, a minimum resolution set to ensure that screen particles can be obtained more accurately based on the acquired image. During implementation, a suitable camera may be selected according to screen parameters (e.g., the size of screen particles, such as particle area) and / or resolution parameters of screens of different models. The selected resolution camera is not limited here, and those skilled in the art may select a camera according to actual needs.

[0065] As an example, the preset image resolution may be, for example, 10000 (pixels) × 7096 (pixels). For example, a high-resolution camera with lens parameters (such as focal length) greater than or equal to 71M may be used to obtain a high-resolution image greater than or equal to 10000 (pixels) × 7096 (pixels).

[0066] In one embodiment, the preset image resolution and the screen resolution may satisfy a predetermined proportional relationship. For example, the preset image resolution may be greater than or equal to three times the screen resolution. For example, if the screen resolution of the screen actually used is 3120 pixels × 1440 pixels, a camera with a focal length of 71M may be used to shoot an image of 10000 (pixels) × 7096 (pixels), and the image resolution of the captured image is approximately 3.2 times the screen resolution. In other words, in the embodiment of the present application, cameras with different lens models may be selected for different screens.

[0067] In one embodiment, the acquired image may further include direction information. Here, the direction information may be determined based on the camera used, for example, it may include image standard coordinate system XYZ data. Among them, a certain direction (for example, horizontal direction X) may be selected as a predetermined direction, and based on the predetermined direction, it may be used as a reference direction in the subsequent screen position correction process.

[0068] Then, in step S120, screen particles in the image are determined.

[0069] Here, for example, the image may be preprocessed to remove noise interference, and then the preprocessed image may be segmented using a dynamic threshold to determine screen particles in the image.

[0070] Figure 2 The figure is a schematic diagram of an image processing flow according to an embodiment of the present application.

[0071] like Figure 2 As shown, for example, in step S210, a frequency domain Gaussian filtering algorithm may be used to obtain a background image of the image.

[0072] As an example, for example, a frequency domain filter can be given, and through the following process (1), the image f(x, y) is converted into the frequency domain F(u, v) through Fourier transform (FFT), the high-frequency signal and the low-frequency signal are separated, and then the high-frequency signal is filtered out through a Gaussian filter H(u, v) to obtain G(u, v), and finally an inverse Fourier transform (IFFT) is performed to convert it to the spatial domain g(x, y).

[0073]

[0074] In step S220, the image is enhanced based on the background image.

[0075] For example, referring to the following formula (2), the enhanced image can be obtained by subtracting the original image captured in step S110 from the background image obtained in step S210.

[0076] S(x,y)=f(x,y)-g(x,y) (2)

[0077] Among them, f(x, y) represents the image obtained in step S110, that is, the original image; g(x, y) represents the background image obtained in step S210; S(x, y) represents the enhanced image.

[0078] In step S230, grayscale stretching is performed on the enhanced image.

[0079] For example, the enhanced image is stretched to [0, 255] by the following formula (3), that is:

[0080]

[0081] Among them, S(x,y) represents the enhanced image; min[S(x,y)] represents the minimum grayscale of S(x,y); max[S(x,y)] represents the maximum grayscale of S(x,y); I(x,y) represents the final image after grayscale stretching.

[0082] Afterwards, for example, a mask mean filter with a predetermined size (e.g., 11*11) can be used to smooth the image g t , and then use the dynamic threshold method to segment Figure 3 It should be understood that only part of the image is captured here for illustration.

[0083] g0≥g t +offset (4)

[0084] Among them, g0 is the segmented particle; offset is the offset, which can suppress the noise in the image.

[0085] Then, in step S130, based on the screen particles, a deflection angle of the screen area in the image compared to the predetermined direction is determined.

[0086] During implementation, for example, the screen area in the image may be determined by screen particles, and based on the edge of the screen area, the deflection angle of the screen compared to a predetermined direction may be determined.

[0087] In one embodiment, for example, based on screen particles, the minimum bounding rectangle corresponding to the screen area in the image may be determined, and the offset angle of the minimum bounding rectangle compared to a predetermined direction may be used as the deflection angle of the screen area compared to the predetermined direction.

[0088] Figure 4 The figure is a schematic diagram of a process of determining a minimum bounding rectangle of a screen area according to an embodiment of the present application.

[0089] like Figure 4 As shown, for example, in step S410, based on the structural element of the first size, the screen particles in the image can be expanded to connect particles with close distances. Among them, "expansion" is an operation to find the local maximum value, which is to "expand the field" of the highlight part of the image. The effect image has a larger highlight area than the original image. From the intuitive point of view of the image, expansion is to enlarge the bright part of the image and reduce the dark part.

[0090] Here, for example, the expansion operation can be performed by the following formula (5):

[0091]

[0092] Among them, A and B can be in the set z, B represents a structural element, and A represents the expanded image (for example Figure 3 ), the first size can be determined based on the particle area of ​​the screen particles away from the edge of the screen area.

[0093] In the embodiment of the present application, the structural element of the first size may be, for example, a rectangular structural element of 11*11. The result after expansion is as follows Figure 5 At this time, not only can the particles with close distances be connected (see the edge of the screen area), but also the particles outside the screen area can be removed by screening the area (such as interference from impurities outside the screen).

[0094] In order to locate the screen area more accurately, for example, in step S420, the expanded screen particles may be eroded based on the structural element of the second size to reduce subsequent errors. Here, "erosion" means that the highlight area in the original image is eroded, and the effect image has a smaller highlight area than the original image. From the intuitive point of view of the image, erosion is to enlarge the dark part of the image and reduce the bright part.

[0095] Here, for example, the corrosion operation can be performed by the following formula (6):

[0096]

[0097] Formula (6) indicates that the structural element B is translated on the image and contains the set of all points in the image A. Thus, the eroded area can completely surround the screen particles, and the distance between the area and the edge particles cannot exceed a predetermined distance threshold.

[0098] In the embodiment of the present application, the second size structure element can be a 9*9 rectangular structure element. The result after the erosion operation is as follows Figure 6 shown.

[0099] In step S430, the minimum bounding rectangle of the screen area may be drawn based on the result of the erosion operation, such as Figure 7 The minimum bounding rectangle may include screen particles, and the distance between the edge of the minimum bounding rectangle and the edge of the screen area is less than a predetermined distance threshold.

[0100] That is to say, the edge of the drawn minimum circumscribed rectangle should surround all screen particles as much as possible, but should not be too far away from the edge particles to reduce subsequent errors.

[0101] exist Figure 7 Based on this, graphic-related parameters can be determined, such as the offset angle of the side of the minimum circumscribed rectangle relative to the predetermined direction, the width W and height H of the rectangle, the coordinates of the center point of the image (x0, y0), etc.

[0102] Further, in step S140, the position of the screen area in the image may be corrected based on the deflection angle.

[0103] In one embodiment, for example, Figure 8As shown, in step S810, an affine transformation matrix may be determined based on the deflection angle.

[0104] For example, the deflection angle θ may be the offset angle of the side of the minimum circumscribed rectangle relative to the horizontal direction. After determining the deflection angle θ, the following rotation matrix R may be determined:

[0105]

[0106] Where E is the identity matrix.

[0107] Then, a translation transformation can be performed, and the translation matrix is ​​as follows:

[0108]

[0109] Among them, T x 、T y are the translation amounts along the x-axis and y-axis respectively. In the embodiment of the present application, for example: T x =W / 2-x0; T y =H / 2-y0.

[0110] In step S820, the screen area is affine transformed based on the affine transformation matrix so that the screen area is displayed in the image based on the predetermined direction. When the image is affine transformed, for example, a cubic interpolation method can be used to reduce the loss after image processing and prevent particle aliasing.

[0111] For example, by using the above translation matrix, the original image x, y is transformed to obtain:

[0112]

[0113] Among them, x' and y' are the processed images, such as Fig. 9 shown.

[0114] Thus, through the above method steps, the deflection angle of the screen area is determined, and the position of the screen is corrected, so that the screen is displayed in the image based on a predetermined direction (such as horizontal direction or vertical direction) as much as possible, thereby providing support for improving the accuracy of screen particle brightness analysis. The method has small error, low requirements on device hardware, and is easy to implement, which can greatly reduce the difficulty of implementing screen position correction.

[0115] In addition, the rotated image can also be verified. Fig.10 As shown, a column (or a row) of particles in the image can be randomly selected to draw a vertical (or horizontal) rectangular frame. It can be seen that the selected particles are basically within the coverage of the rectangular frame, and it is considered that the screen position correction is accurate.

[0116] Based on the same concept, an embodiment of the present application also provides a screen position correction device.

[0117] Fig.11 Schematic diagram of a screen position correction device according to an embodiment of the present application.

[0118] like Fig.11 As shown, the screen position correction device 1100 may include:

[0119] The image acquisition unit 1110 is used to acquire an image of the screen, wherein the resolution of the image is greater than or equal to a preset image resolution, and the image has direction information of a predetermined direction.

[0120] The particle determination unit 1120 is configured to determine screen particles in the image.

[0121] The deflection angle determination unit 1130 is configured to determine a deflection angle of a screen area in the image compared to the predetermined direction based on the screen particles.

[0122] The correction unit 1140 is used to perform position correction on the screen area in the image based on the deflection angle.

[0123] In one embodiment, the deflection angle determination unit 1130 may be configured to:

[0124] Based on the screen particles, determining a minimum circumscribed rectangle in the image corresponding to the screen area;

[0125] An offset angle of a designated edge of the minimum circumscribed rectangle relative to the predetermined direction is used as a deflection angle of the screen area compared to the predetermined direction.

[0126] In one embodiment, the deflection angle determination unit 1130 may be configured to:

[0127] Based on the structure element of the first size, a dilation operation is performed on the screen particles in the image;

[0128] performing an erosion operation on the expanded screen particles based on a structure element of a second size, wherein the second size is smaller than the first size;

[0129] Based on the result of the erosion operation, a minimum bounding rectangle of the screen area is drawn.

[0130] In one embodiment, the first size and / or the second size is determined based on the particle areas of screen particles away from the edge of the screen area.

[0131] In one embodiment, the minimum circumscribed rectangle surrounds the screen particle, and the distance between the side of the minimum circumscribed rectangle and the edge of the screen area is less than a predetermined distance threshold.

[0132] In one embodiment, the correction unit 1140 can be used to:

[0133] Based on the deflection angle, determining an affine transformation matrix;

[0134] Affine transformation is performed on the screen area based on the affine transformation matrix so that the screen area is displayed based on the predetermined direction in the image.

[0135] In one embodiment, the particle determination unit 1120 may be configured to:

[0136] Performing image preprocessing on the image;

[0137] Dynamic threshold segmentation is performed on the preprocessed image to determine screen particles in the image.

[0138] In one embodiment, the image preprocessing may include:

[0139] A frequency domain Gaussian filtering algorithm is used to obtain a background image of the image;

[0140] Based on the background image, performing image enhancement on the image; and

[0141] The enhanced image is grayscale stretched.

[0142] So far, we have combined Fig.11 The screen position correction device of the present application is described. The specific implementation of the function of the device can be found in the above combined Figure 1-Figure 10 The relevant description will not be repeated here.

[0143] After introducing a screen position correction method and apparatus according to an exemplary embodiment of the present application, next, a computing device according to another exemplary embodiment of the present application is introduced.

[0144] Those skilled in the art will appreciate that various aspects of the present application may be implemented as a system, method or program product. Therefore, various aspects of the present application may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to as "circuit", "module" or "system" herein.

[0145] In some possible implementations, the computing device according to the present application may include at least one processor and at least one memory. The memory stores program code, and when the program code is executed by the processor, the processor executes the steps of the screen position correction method according to various exemplary implementations of the present application described above in this specification. For example, the processor may execute the following steps: Figure 1 , Figure 2 , Figure 4 , Figure 8 Steps shown.

[0146] Refer to the following Fig.12 hereinafter, a computing device 130 according to this embodiment of the present application is described. Fig.12 The computing device 130 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0147] like Fig.12 As shown, the computing device 130 is in the form of a general computing device. The components of the computing device 130 may include but are not limited to: at least one processor 131, at least one memory 132, and a bus 133 connecting different system components (including the memory 132 and the processor 131).

[0148] Bus 133 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.

[0149] The memory 132 may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) 1321 and / or a cache memory 1322 , and may further include a read-only memory (ROM) 1323 .

[0150] The memory 132 may also include a program / utility 1325 having a set (at least one) of program modules 1324, such program modules 1324 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0151] The computing device 130 may also communicate with one or more external devices 134 (e.g., keyboards, pointing devices, etc.), one or more devices that enable a user to interact with the computing device 130, and / or any device that enables the computing device 130 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 135. In addition, the computing device 130 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 136. As shown, the network adapter 136 communicates with other modules for the computing device 130 via a bus 133. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computing device 130, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0152] In some possible implementations, various aspects of a screen position correction method provided by the present application may also be implemented in the form of a program product, which includes a program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of a screen position correction method according to various exemplary implementations of the present application described above in this specification. For example, the computer device may execute the following steps: Figure 1 , Figure 2 , Figure 4 , Figure 8 Steps shown.

[0153] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0154] The program product for screen position correction of the embodiment of the present application can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a computing device. However, the program product of the present application is not limited to this. In this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0155] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium other than a readable storage medium, which may transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0156] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0157] Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0158] It should be noted that, although several units or subunits of the device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more units described above can be embodied in one unit. Conversely, the features and functions of one unit described above can be further divided into multiple units to be embodied.

[0159] In addition, although the operations of the method of the present application are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0160] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0161] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0162] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0163] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0164] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0165] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A screen position correction method, characterized in that: include: Acquire an image of the screen, wherein a resolution of the image is greater than or equal to a preset image resolution, and the image includes direction information of a predetermined direction; The preset image resolution and the screen resolution of the screen satisfy a predetermined ratio relationship, and the preset image resolution is greater than the screen resolution; Determine screen particles in the image; the screen particles are display particles corresponding to screen pixels in the image; Based on the structure element of the first size, a dilation operation is performed on the screen particles in the image; performing an erosion operation on the expanded screen particles based on a structural element of a second size, wherein the second size is smaller than the first size; the first size and the second size are determined based on particle areas of the screen particles away from an edge of the screen area; Based on the result of the erosion operation, drawing the minimum bounding rectangle of the screen area; Taking the offset angle of the designated edge of the minimum circumscribed rectangle relative to the predetermined direction as the deflection angle of the screen area compared to the predetermined direction; Based on the deflection angle, the position of the screen area is corrected in the image.

2. The method according to claim 1, characterized in that The minimum circumscribed rectangle surrounds the screen particle, and a distance between a side of the minimum circumscribed rectangle and an edge of the screen area is less than a predetermined distance threshold.

3. The method according to claim 1, characterized in that Based on the deflection angle, position correction is performed on the screen area in the image, including: Based on the deflection angle, determining an affine transformation matrix; Affine transformation is performed on the screen area based on the affine transformation matrix so that the screen area is displayed based on the predetermined direction in the image.

4. The method according to claim 1, characterized in that: Determining screen grain in the image, including: Performing image preprocessing on the image; Dynamic threshold segmentation is performed on the preprocessed image to determine screen particles in the image.

5. The method according to claim 4, characterized in that The image preprocessing comprises: A frequency domain Gaussian filtering algorithm is used to obtain a background image of the image; Based on the background image, performing image enhancement on the image; and The enhanced image is grayscale stretched.

6. A screen position correction device, characterized in that: include: An image acquisition unit, used for acquiring an image of the screen, wherein the resolution of the image is greater than or equal to a preset image resolution, and the image has direction information of a predetermined direction; a particle determination unit, configured to determine screen particles in the image; The screen particles are display particles corresponding to screen pixels in an image; the preset image resolution and the screen resolution of the screen satisfy a predetermined ratio relationship, and the preset image resolution is greater than the screen resolution; a deflection angle determination unit, configured to perform a dilation operation on screen particles in the image based on a structural element of a first size; performing an erosion operation on the expanded screen particles based on a structural element of a second size, wherein the second size is smaller than the first size; the first size and the second size are determined based on particle areas of the screen particles away from an edge of the screen area; Based on the result of the erosion operation, drawing the minimum bounding rectangle of the screen area; Taking the offset angle of the designated edge of the minimum circumscribed rectangle relative to the predetermined direction as the deflection angle of the screen area compared to the predetermined direction; A correction unit is used to perform position correction on the screen area in the image based on the deflection angle.

7. A computing device, characterized in that It includes at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the screen position correction method according to any one of claims 1-5.

8. A computer storage medium, characterized in that The computer storage medium stores computer executable instructions, and the computer executable instructions are used to enable a computer to execute the screen position correction method according to any one of claims 1-5.