Method for detecting crease of folding screen, related device and related medium

Abstract

The invention provides a folding screen crease detection method, a related device and a related medium, which can be applied to a target terminal. According to the folding screen crease detection method provided by the embodiment of the invention, the imaging operation can be performed on the to-be-detected folding screen in the bright screen state based on multiple angles to obtain the target image, and whether the crease exists in the to-be-detected folding screen or not is judged according to the gray value of the pixel point in the target image. According to the invention, crease detection can be realized with a small calculation amount, and the threshold of crease detection is reduced.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a method, related device and related medium for detecting creases on a folding screen. Background Art

[0002] As a new form of display technology, foldable screens are widely used in various foldable electronic devices such as foldable mobile phones and foldable tablets because of their advantages such as folding, compression and flexible changes. However, after multiple folding and unfolding operations on the foldable screen, irreversible wrinkles (also called creases) will appear on the screen surface, which will not only affect the appearance of the screen, but also affect the service life of the screen. Therefore, it is necessary to perform crease detection during the production and assembly process of foldable screens (or products containing foldable screens) to screen out unqualified foldable screens (or products containing foldable screens). Summary of the invention

[0003] In a first aspect, the present application provides a method, a related device, and a related medium for detecting a folding screen crease. The method is applied to a target terminal in a system for detecting a folding screen crease. The system for detecting a folding screen crease may include a target terminal and a folding screen crease detection device. The method includes:

[0004] Receiving a target image sent by the folding screen crease detection device, where the target image is an image of the folding screen to be detected taken by the folding screen crease detection device in a target posture and in a bright screen state;

[0005] Grayscale the target image to obtain a detection image;

[0006] Based on the detection image, determine whether there is a crease in the folding screen to be detected.

[0007] By implementing the method provided in the first aspect, the target terminal can determine whether there is a crease on the folding screen to be detected based on the target image after grayscale processing, which helps to ensure the accuracy of folding screen crease detection while reducing the computational burden of the target terminal when performing folding screen crease detection.

[0008] In some embodiments of the method provided in the first aspect, judging whether there is a crease in the folding screen to be detected based on the detection image includes:

[0009] Based on the grayscale value of each pixel in the detection image, determine the pixel whose grayscale value is in a first preset range as a crease pixel, determine the pixel whose grayscale value is in a second preset range as a background pixel, and determine the first reference data corresponding to the crease pixel and the second reference data corresponding to the background pixel;

[0010] A third reference data is generated based on the first reference data and the second reference data, and when the third reference value is greater than a preset threshold, it is determined that there is a crease in the folding screen to be detected.

[0011] By implementing the method provided in the above embodiment, the target terminal uses the difference in the light presentation between the crease area and the background area, and divides the pixels into crease pixels and background pixels based on the difference in pixel values ​​of each pixel in the detection image, which helps to screen out possible crease areas using a simple and effective method. The target terminal also generates third reference data based on the reference data corresponding to the crease pixels and the background pixels, and determines whether there is a crease in the folding screen to be detected by comparing the third reference data with a preset threshold value, which helps to further improve the accuracy of crease detection and avoid the possibility of misidentification.

[0012] Implementing the method provided in the first aspect, in some embodiments, the first reference data includes a first number of crease pixels and a first average grayscale value of the crease pixels, and the second reference data includes a second number of background pixels and a second average pixel value of the background pixels.

[0013] By implementing the method provided in the above embodiment, the target terminal can count the number of crease pixels and background pixels, which can be used to express the area of ​​the crease region and the area of ​​the background region. The target terminal can also calculate the average grayscale value of the crease pixels and the background pixels, which can be used to calculate the pixel contrast value of the crease region and the background region, thereby more intuitively quantifying the obviousness of the crease region.

[0014] In some embodiments of the method provided in the first aspect, generating third reference data based on the first reference data and the second reference data, and determining that there is a crease in the folding screen to be detected when the third reference value is greater than a preset threshold value includes:

[0015] The average contrast ratio of the crease is calculated based on the first grayscale average value corresponding to the crease pixel point, the second average pixel value corresponding to the background pixel point, and the first formula. The first formula is: Where C represents the average contrast value of the crease, C0 represents the first grayscale average value corresponding to the crease pixel point, and C b Indicates the second average pixel value corresponding to the background pixel;

[0016] The third reference data is calculated based on the average crease contrast value, the crease area and the second formula, where the crease area is obtained based on the first number corresponding to the crease pixel points, and the second formula is: S represents the crease area, and SEMU represents the third reference data.

[0017] By implementing the method provided in the above embodiment, the target terminal can calculate the third reference data in more detail and accurately based on the preset formula, which helps to ensure the accuracy of crease recognition and quantify the user's subjective feeling of the presence of the crease area when using a folding screen (or a product containing a folding screen).

[0018] In some embodiments of the method provided in the first aspect, before receiving the target image sent by the folding screen crease detection device, the method further includes:

[0019] Receive adjustment instructions from relevant staff, where the adjustment instructions are used to indicate the target posture of the folding screen to be tested, and the target posture includes the placement position and / or placement angle.

[0020] By implementing the method provided in the above embodiment, the target terminal can receive adjustment instructions from relevant staff, which helps to adaptively adjust the placement posture of the screen to be tested when performing crease detection on folding screens to be tested of different sizes and / or shapes (such as flat screens and curved screens, etc.).

[0021] Implementing the method provided in the first aspect, in some embodiments, the adjustment instruction is also used to indicate the display brightness and / or display color of the folding screen to be detected.

[0022] By implementing the method provided in the above embodiment, the present application can also adjust the display brightness and / or display color of the folding screen to be detected, which helps to adjust the detection state of the folding screen to be detected to a state where the crease is more obviously presented, thereby improving the accuracy of crease detection.

[0023] In some embodiments of the method provided in the first aspect, after determining whether there is a crease in the folding screen to be detected based on the detection image, the method further includes:

[0024] Generate reminder information and present it to relevant staff.

[0025] By implementing the method provided in the above embodiment, the target terminal can generate and present reminder information to relevant staff, which helps relevant staff to understand the crease-related parameters of the folding screen to be tested in more detail, thereby helping relevant staff to accurately evaluate the severity of the crease in the folding screen to be tested.

[0026] In a second aspect, the present application provides a method for detecting a folding screen crease, which is applied to a folding screen crease detection device in a folding screen crease detection system, the folding screen crease detection system comprising a target terminal and a folding screen crease detection device, the method comprising:

[0027] Receiving an adjustment instruction sent by a target terminal, where the adjustment instruction is used to indicate a target posture of a folding screen to be detected;

[0028] Adjust the placement posture of the folding screen to be tested to the target posture according to the adjustment instruction;

[0029] A target image is acquired and sent to a target terminal. The target image is an image of the folding screen to be detected taken by the folding screen crease detection device in a target posture and in a bright screen state.

[0030] By implementing the method provided in the above embodiment, the folding screen crease detection device can adjust the placement posture of the folding screen to be detected according to the adjustment instructions sent by the target terminal, and obtain the corresponding target image, which helps the target terminal to obtain accurate crease detection results based on the target image.

[0031] In some embodiments of the method provided in the second aspect, the device for detecting folding screen creases includes a surface camera, a five-axis motion device, and a carrier, the surface camera is coupled to the five-axis motion device, and the carrier is coupled to the five-axis motion device;

[0032] Receiving an adjustment instruction sent by a target terminal, where the adjustment instruction is used to indicate a target posture of the folding screen to be detected, including: receiving the adjustment instruction sent by the target terminal through a face camera;

[0033] The placement posture of the folding screen to be tested is adjusted to the target posture according to the adjustment instructions, including: controlling the five-axis motion device according to the adjustment instructions through the face camera, adjusting the placement posture of the carrier to the target posture, and placing the folding screen to be tested on the carrier.

[0034] By implementing the method provided in the above embodiment, the folding screen crease detection device can receive adjustment instructions through the face camera inside it, and the face camera can also control the five-axis motion device to adjust the placement posture of the carrier according to the adjustment instructions, which helps to adjust the folding screen to be detected placed on the carrier to a target posture that is easy to judge the crease, thereby ensuring the accuracy of crease detection.

[0035] In some embodiments of the method provided in the second aspect, acquiring a target image and sending the target image to a target terminal includes:

[0036] The target image is obtained by photographing the image of the folding screen to be inspected in the target posture and in the bright screen state through a face camera;

[0037] The target image is sent to the target terminal through the face camera.

[0038] By implementing the method provided in the above embodiment, the folding screen crease detection device can use its internal surface camera to capture an image of the folding screen to be detected in the target posture and in the bright screen state, and transmit the image to the target terminal, which helps to provide the target terminal with a suitable target image and thereby ensure the accuracy of crease detection.

[0039] In some embodiments of the method provided in the second aspect, the target posture includes a placement position and / or a placement angle.

[0040] By implementing the method provided in the above embodiment, the folding screen crease detection device (or face camera) can adjust the placement posture of the folding screen to be detected, and adjust the detection state of the folding screen to be detected to a state where the crease is more obviously shown, thereby improving the accuracy of crease detection.

[0041] Implementing the method provided in the second aspect, in some embodiments, the adjustment instruction is also used to indicate the display brightness and / or display color of the folding screen to be detected.

[0042] By implementing the method provided in the above embodiment, the present application can also adjust the display brightness and / or display color of the folding screen to be detected, which helps to adjust the detection state of the folding screen to be detected to a state where the crease is more obviously presented, thereby improving the accuracy of crease detection.

[0043] In some embodiments of the method provided in the second aspect, the folding screen crease detection device further includes a gravity sensor;

[0044] According to the adjustment instruction, the placement posture of the folding screen to be detected is adjusted to the target posture, including:

[0045] If the gravity parameters collected by the gravity sensor remain unchanged within a preset time period, the placement posture of the folding screen to be detected is adjusted to the target posture according to the adjustment instruction.

[0046] By implementing the method provided in the above embodiment, the folding screen crease detection device will start to adjust the placement posture of the folding screen to be detected only after the folding screen to be detected is correctly placed on the carrier, which helps to avoid screen stacking and ensure the accuracy of crease detection.

[0047] In a third aspect, the present application provides a target terminal comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code comprises computer instructions, and when the one or more processors execute the computer instructions, the method described in the first aspect and any possible implementation method of the first aspect is executed.

[0048] In a fourth aspect, the present application provides a folding screen crease detection device, which includes one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When one or more processors execute the computer instructions, the method described in the second aspect and any possible implementation method of the second aspect is executed.

[0049] In a fifth aspect, the present application provides a system for detecting folding screen creases, the system comprising a target terminal as described in the third aspect and a folding screen crease detection device as described in the fourth aspect.

[0050] In a sixth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on a target terminal, execute the method described in the first aspect and any possible implementation of the first aspect.

[0051] In the seventh aspect, the present application provides a computer program product comprising instructions, which, when the above-mentioned computer program product runs on an electronic device, enables the above-mentioned electronic device to execute the method described in the first aspect and any possible implementation of the first aspect, or execute the method described in the first aspect and any possible implementation of the first aspect.

[0052] It can be understood that the target terminal provided in the third aspect, the folding screen crease detection device provided in the fourth aspect, the folding screen crease detection system provided in the fifth aspect, the computer-readable storage medium provided in the sixth aspect, and the computer program product provided in the seventh aspect are all used to execute the method provided in the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 It is a scene schematic diagram of crease detection based on three-dimensional imaging in the prior art;

[0054] Figure 2 It is a schematic diagram of the architecture of a system for detecting folding screen creases provided in an embodiment of the present application;

[0055] Figure 3 It is a structural schematic diagram of a folding screen crease detection device provided in an embodiment of the present application;

[0056] Figure 4 It is a structural schematic diagram of a five-axis motion device provided in an embodiment of the present application;

[0057] Figure 5 This is a schematic diagram of a scene of a fixed point of a five-axis motion device provided in an embodiment of the present application;

[0058] Figure 6 It is a flowchart of a method for detecting folding screen creases provided in an embodiment of the present application;

[0059] Figure 7a-Figure 7b is a schematic diagram of a scenario for obtaining a target image of a folding screen to be detected provided by an embodiment of the present application;

[0060] Figure 8 It is a flowchart of a method for detecting folding screen creases based on multiple imaging angles provided in an embodiment of the present application;

[0061] Fig. 9 It is a flowchart of another method for detecting folding screen creases provided in an embodiment of the present application;

[0062] Figure 10a-Figure 10b is a schematic diagram of a scenario of inputting an adjustment instruction provided in an embodiment of the present application;

[0063] Fig.11 This is a schematic diagram of a scenario of connected domain division provided in an embodiment of the present application;

[0064] Fig.12 It is a structural schematic diagram of a folding screen crease detection device provided in an embodiment of the present application;

[0065] Fig.13 is a schematic diagram of the structure of a target terminal provided in an embodiment of the present application;

[0066] Fig.14 It is a schematic diagram of the composition of another target terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0068] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0069] In order to make the description of the following embodiments clear and concise, a brief introduction to the related technology is first given:

[0070] Flexible screen refers to flexible organic light-emitting diodes (OLED). OLED has the characteristics of self-luminescence, which allows each pixel to emit light independently without a backlight. Therefore, OLED has a higher contrast and a wider color gamut, and can present a more delicate and vivid picture effect. Secondly, flexible OLED uses flexible substrate materials such as polyimide (PI), which enables the screen to bend and fold, so that it can adapt to various curved shapes.

[0071] Folding screens are a branch of flexible screens, which can be bent 360 degrees or even twisted. Based on the folding screen, a folding screen mobile phone can be designed and realized. From the perspective of the folding scheme, the current folding screen mobile phones have various forms such as horizontal inward folding, horizontal outward folding, and vertical inward folding. In the process of opening and closing the folding screen, the middle part of the folding screen lacks a supporting structure, which will cause it to be unable to offset the concave inertia caused by the bending state, and when the folding screen is unfolded, the door panel position on both sides of the hinge connected to the folding screen will generate an upward force on the folding screen. It is under the combined action of these two forces that an M-shaped crease will be generated in the center of the folding screen. After the folding screen is creased, the life of the screen will be greatly reduced. In order to reduce the probability of folding screens, manufacturers can replace the U-shaped hinge structure with a water drop hinge structure; they can use better outer screen materials, such as ultra-thin glass (UTG) instead of clear polyimide film (CPIFilm) to improve the toughness of the folding screen; and they can use a floating middle plate design. With the floating middle plate design, when the folding screen is opened, the floating middle plate will rise accordingly, thereby "supporting" the central crease of the screen, making the screen flatter; when the folding screen is folded, the floating middle plate will drop accordingly, providing sufficient space for the screen to bend, thereby achieving the purpose of protecting the screen.

[0072] In order to ensure the integrity of foldable devices (or products containing foldable screens) before they are put on the market, manufacturers will perform crease detection on foldable screens. Existing technology can achieve crease detection on foldable screens through three-dimensional imaging technology.

[0073] See also Figure 1 , Figure 1 A schematic diagram of a scene of crease detection based on three-dimensional imaging in the prior art.

[0074] like Figure 1As shown, the prior art can perform a three-dimensional scan on the screen to be inspected by obtaining the reflected light of the folding screen to be inspected, so as to obtain the point cloud data of the hinge area; then calculate the surface area of ​​the hinge area according to the three-dimensional coordinates of multiple points contained in the point cloud data of the hinge area; further, according to the calculated area and the standard value of the surface area of ​​the hinge area, obtain the area change degree of the hinge area, and determine the crease degree of the folding screen device based on the area change degree. Furthermore, the prior art can perform point cloud splicing to reconstruct the three-dimensional topography of the folding screen based on the sub-point cloud data obtained by the three-dimensional scanning, and then obtain the area change degree of the hinge area.

[0075] It can be seen that the prior art does not limit the placement of the folding screen to be detected. Therefore, the folding screen to be detected may be misjudged as having creases due to improper placement (such as stacking) of the folding screen to be detected. Therefore, it is necessary to more standardize the detection process of folding screen creases. In addition, when extracting the point cloud data of the folding screen to be detected, the prior art may miss identifying small creases on the folding screen to be detected, so there may be problems with recognition accuracy. Furthermore, since the prior art needs to perform three-dimensional imaging of the folding screen to be detected based on the point cloud data of the folding screen to be detected, it will cause problems such as Figure 2 The target terminal 210 in the folding screen has a large operating burden, so there are certain requirements for the performance of the target terminal 210, which will lead to a high threshold for folding mark detection and increase the production cost of the folding screen (or products containing folding screens). Therefore, those skilled in the art need to find a method to lower the threshold for folding mark detection while ensuring the accuracy of folding screen folding mark recognition.

[0076] The embodiments of the present application can provide a method for detecting folding screen creases, which can perform imaging operations on a flat, bright folding screen to be detected from multiple angles, and obtain a target image for crease detection, and then determine whether there is a crease in the folding screen to be detected based on the grayscale value of the pixel points in the target image. Crease detection can be achieved with a smaller amount of calculation, thereby lowering the threshold for crease detection.

[0077] See also Figure 2 , Figure 3 and Figure 4 ,in, Figure 2 A schematic diagram of the architecture of a folding screen crease detection system provided in an embodiment of the present application, Figure 3 A schematic diagram of the structure of a folding screen crease detection device provided in an embodiment of the present application, Figure 4 A schematic diagram of the structure of a five-axis motion device provided in an embodiment of the present application.

[0078] like Figure 2As shown, the folding screen crease detection system may include: a target terminal 210 and a folding screen crease detection device 220; Figure 3 As shown, the folding screen crease detection device 220 may include a face camera 230 , a five-axis motion device 240 , a carrier 250 and a dark box 260 .

[0079] Among them, the target terminal 210 can have a communication connection with the face camera 230 in the folding screen crease detection device 220, and the communication connection can be a wireless connection (such as Bluetooth and wireless LAN, etc.), or a wired connection (such as a data cable, etc.). The target terminal 210 can be used to receive the detection instruction input by the relevant staff, and send the detection instruction to the face camera 230, and control the five-axis motion device 240 through the face camera 230 to adjust the placement posture of the carrier 250 to the target posture, wherein the placement posture may include placement position and / or placement angle. The target terminal 210 can also receive the target image sent by the face camera 230, and determine whether there is a crease on the folding screen to be detected based on the target image. The target image refers to the image of the folding screen to be detected taken by the folding screen crease detection device in the target posture and in the bright screen state. Specifically, the target terminal 210 can grayscale the target image to obtain a grayscale image corresponding to the target image, and judge whether there is a crease in the folding screen to be detected based on the pixel value of each pixel in the grayscale image. It can be seen that the judgment process has low requirements on the operating performance of the target terminal 210, which helps to lower the threshold of folding screen crease detection. In some possible implementations, the target terminal 210 can receive the target image after the face camera 230 performs grayscale processing. The target terminal 210 only needs to judge whether there is a crease in the folding screen to be detected based on the pixel value of each pixel in the grayscale image, which can further reduce the computing burden of the target terminal 210. In some implementations, the target terminal 210 can be called a terminal device, and the terminal device can be fixed or mobile, etc. Its specific form can be a mobile phone, a tablet computer, a computer with wireless transceiver function, a wearable terminal device, etc. Furthermore, the target terminal 210 may be a terminal device on a PC side, such as an all-in-one computer, and its operating system may include but is not limited to Linux system, Unix system, Windows series system (such as Windows XP, Windows 7, etc.), Mac OS X system (operating system of Apple computer) and other operating systems; the target terminal 210 may also be a mobile terminal device, such as a smart phone, and its operating system may include but is not limited to Android system, IOS (operating system of Apple mobile phone), Window system and other operating systems.

[0080] In some possible implementations, the target terminal 210 may also establish a communication connection with the five-axis motion device 240, and the communication connection may be a wireless connection (such as Bluetooth and wireless LAN, etc.) or a wired connection (such as a data cable, etc.). The target terminal 210 may directly control the five-axis motion device 240 to adjust the placement posture of the face camera 230 and / or the carrier 250 according to the detection instructions input by the relevant staff.

[0081] Optionally, the face camera 230 is in communication connection with the five-axis motion device 240 and the carrier 250, is arranged on the five-axis motion device 240, and is a device with imaging function. Specifically, the face camera 230 can be used to receive the adjustment instruction sent by the target terminal 210, and the adjustment instruction can be used to indicate the target posture of the carrier 250, and can also be used to indicate the imaging parameters of the screen to be detected, and the imaging parameters may include display brightness and display color, etc. Optionally, the face camera 230 can also be used to adjust the placement posture of the carrier 250 to the target posture according to the adjustment instruction, can provide power for the screen to be detected on the carrier 250, and adjust the display brightness and / or display color of the screen to be detected according to the control instruction. The face camera 230 can also obtain the target image for crease detection, and transmit the target image to the target terminal 210, and the target terminal 210 determines whether there is a crease on the screen to be detected. In some possible implementations, the face camera 230 may also perform grayscale processing on the acquired target image, and then send the grayscaled target image to the target terminal 210 , which helps to reduce the operating burden of the target terminal 210 .

[0082] Alternatively, if Figure 4 As shown, the five-axis motion device 240 may include a first moving track 241, a second moving track 242, a third moving track 243, a first rotating shaft 244, and a second rotating shaft 245. Among them, the first moving track 241 is placed along the x-axis direction, the second moving track 242 is placed along the y-axis direction, and the third moving track 243 is placed along the z-axis. The first rotating shaft 244 can allow the carrier 250 to rotate around the x-axis, and the second rotating shaft 245 can allow the carrier 250 to rotate around the y-axis. Specifically, the face camera 230 can move along the first moving track 241 and / or the third moving track 243, and the carrier 250 can move along at least one of the second moving track 242, the first rotating shaft 244, and the second rotating shaft 245, so as to achieve the purpose of adjusting the placement posture of the face camera 230 and / or the carrier 250.

[0083] For example, Figure 5As shown, assuming that there are a first fixed point 2411, a second fixed point 2421 and a third fixed point 2431 on the first moving track 241, the second moving track 242 and the third moving track 243 respectively, when the face camera 230 is located at the first fixed point 2411 and the third fixed point 2431 at the same time, it is the initial position of the face camera 230, and when the carrier 250 is located at the second fixed point 2421 and the plane where the carrier 250 is located is parallel to the horizontal plane, it is the initial position of the carrier 250, and when it is necessary to obtain the target image of the folding screen to be detected, the carrier 250 will move to the second fixed point 2421. When the carrier 250 is rotated clockwise around the x-axis (which can be understood as a direction parallel to or overlapping with the extension direction of the first moving rail 241) and / or the y-axis (which can be understood as a direction parallel to or overlapping with the extension direction of the second moving rail 242), the angle between the carrier 250 (or the folding screen to be detected on the carrier) and the horizontal plane (which can be understood as the plane where the x-axis and the y-axis are located, or the plane where the first moving rail 241 and the second moving rail 242 are located) and / or the vertical plane (which can be understood as the plane where the x-axis and the z-axis are located, or the plane where the first moving rail 241 and the third moving rail 243 are located) gradually increases. If the adjustment instruction transmitted by the target terminal 210 to the face camera 230 is used to indicate the information of "acquiring the image of the folding screen to be detected corresponding to the time when the carrier 250 is located at the second fixed point 2421 and forms an angle of 45° with the horizontal plane, 20 cm above the carrier 250 and 5 cm to the right", the face camera 230 can control itself to move 5 cm to the right along the first moving track 241 from the origin, and then move 20 cm upward along the third moving track 243, and control the carrier 250 (or the folding screen to be detected on the carrier) to rotate 45° clockwise through the second rotating shaft 245. When the face camera 230 and the carrier 250 move to the position corresponding to the adjustment instruction and present the corresponding angle, the face camera 230 will acquire the target image of the folding screen to be detected in the bright screen state, and transmit the target image to the target terminal 210.

[0084] Furthermore, after the face camera 230 transmits the target image to the target terminal 210, the face camera 230 and the carrier 250 can be controlled to return to the corresponding initial positions, and the carrier 250 can be moved along the second moving track 242 to the exit of the dark box 260. At the exit of the dark box 260, the staff or the robot arm can remove the folding screen to be inspected, and place a new folding screen to be inspected (which can be understood as the next folding screen to be inspected that needs to be inspected for creases) as required.

[0085] The carrier 250 is arranged on the five-axis motion device 240, and can be used to carry the screen to be detected. Specifically, the carrier 250 can be a rectangular platform slightly larger than the folding screen to be detected, and may include a retaining buckle thereon, which can be used to fix the folding screen to be detected to prevent the folding screen to be detected from slipping when the carrier 250 moves or rotates. Optionally, the carrier 250 can also fix the folding screen to be detected by means of electrostatic adsorption and special tape (such as traceless glue). Optionally, the carrier 250 can be disassembled and replaced, and the relevant operator can replace the carrier 250 with a hard platform of suitable shape, size and fixing method according to the actual situation. It should be noted that the material of the carrier 250 is not limited in the embodiment of the present application.

[0086] Furthermore, when the folding screen to be tested is placed on the carrier 250, the relevant operator can adjust the placement of the folding screen to be tested (such as allowing the folding screen to be tested to be unfolded flatly), or the face camera 230 can control the carrier 250 to adjust the placement of the folding screen to be tested according to a preset program. Exemplarily, the preset program can be: controlling the carrier 250 to pass through the first rotating shaft 244 and the second rotating shaft 245 in sequence, shaking at a higher frequency (such as 4 times / second) and a smaller shaking amplitude (such as ±2°) for a certain time (such as 10 seconds), so as to achieve the purpose of allowing the folding screen to be tested to be unfolded flatly on the carrier 250.

[0087] Furthermore, the face camera 230, the five-axis motion device 240 and the carrier 250 are all located in the dark box 260, which can reduce the influence of ambient light on the face camera 230 to obtain the target image. The dark box 260 can leave one surface as an exit for technicians to place or take out the folding screen to be tested, and the remaining five surfaces are made of opaque materials.

[0088] Figure 2 The system for detecting folding screen creases shown is only an example. In a specific implementation, the system for detecting folding screen creases may include devices with more or fewer functions, and may also combine or split some devices. For example, the target terminal 210 may also be one of multiple target terminals 210, and the folding screen crease detection device 220 may be one of multiple folding screen crease detection devices 220. When the target terminal 210 is one of multiple target terminals 210, the folding screen crease detection device 220 may obtain one target image under the control of the target terminal 210, or may obtain multiple target images corresponding to the folding screens to be detected at different placement positions and / or placement angles under the control of the target terminal 210.

[0089] Regarding the role of each device in the folding screen crease detection system (such as the target terminal 210 and the folding screen crease detection device 220), and the specific implementation of the operations performed by each device (such as the target terminal 210 and the folding screen crease detection device 220), please refer to the relevant description of the subsequent method embodiments, which will not be repeated here.

[0090] It needs to be explained that, Figure 3 The structural diagram of the folding screen crease detection device 220 is only for more clearly describing the method of the embodiment of the present application, and does not mean that the method of the embodiment of the present application can only be applied to the following examples: Figure 3 The device shown should not be construed as limiting the present application. In actual application scenarios, devices that implement the same functions as the components included in the folding screen crease detection device 220 of the embodiment of the present application should be understood to be within the scope of protection of the present application.

[0091] See also Figure 6 , which is a flow chart of a method for detecting folding screen creases provided in an embodiment of the present application, and is applied to a folding screen crease detection device, and the folding screen crease detection device can refer to Figures 2 to 3 Any of the accompanying drawings corresponds to the folding screen crease detection device 220 described in the embodiment.

[0092] like Figure 6 As shown, the method may include the following steps:

[0093] S601: The facial photography device receives an adjustment instruction from the target terminal.

[0094] Specifically, the adjustment instruction may be used to indicate a target posture of the face camera 230 and / or the vehicle 250 , that is, a placement position and a placement angle of the face camera 230 and / or the vehicle 250 .

[0095] Exemplarily, the adjustment instruction can be used to indicate the information of "20 cm above the carrier 250 and 5 cm to the right, obtain the corresponding folding screen image to be detected when the carrier 250 is located at the second fixed point and at an angle of 45° to the horizontal plane." Among them, "20 cm from the carrier in the vertical direction and 5 cm to the right" is used to indicate the placement position of the face camera 230, and "located at the second fixed point at an angle of 45° to the horizontal plane" is used to indicate the placement position and placement angle of the carrier 250.

[0096] In some possible implementations, the adjustment instructions may be entered in advance by a technician before the folding screen crease detection device 220 leaves the factory, or may be set by relevant staff according to actual conditions when using the folding screen crease detection device 220. For example, when it is confirmed that there is a crease on the folding screen to be detected, the relevant staff may also set more placement positions and angles for the face camera 230 and / or the carrier 250 to achieve the purpose of crease review, which helps to further improve the accuracy of crease detection.

[0097] S602: In response to the folding screen to be inspected being placed on the carrier, the face camera adjusts the placement position and placement angle of the face camera and / or the carrier according to the adjustment instruction.

[0098] In some possible implementations, a timer and a sensor (such as an infrared sensor or a gravity sensor, etc.) may be configured on the carrier 250. When the sensor senses that the folding screen to be detected is placed on the carrier 250, the timing starts. When the relevant parameters of the sensor of the carrier 250 do not change within a preset time period, it is confirmed that the placement of the folding screen to be detected has been completed, and the face camera 230 can start to adjust the placement position and angle of the face camera 230 and / or the carrier 250 according to the adjustment instructions. Exemplarily, assume that a gravity sensor is provided on the carrier 250, and the preset time period is 2 seconds. When the relevant staff or the robotic arm places the folding screen to be inspected on the carrier 250, the gravity sensor of the carrier 250 will collect gravity parameter 1. If the relevant staff or the robotic arm needs to adjust the flatness of the folding screen to be inspected, then under the action of relevant forces, the gravity sensor of the carrier 250 will collect multiple changing gravity parameters (such as gravity parameter 2 and gravity parameter 3, gravity parameter 2 can be less than the value of gravity parameter 1, and gravity parameter 3 can be greater than the value of gravity parameter 1). After the relevant staff or the robotic arm finishes adjusting the flatness of the folding screen to be tested, the gravity sensor of the carrier 250 will collect an unchanging gravity parameter 4 (which can be understood as the gravity parameter of the folding screen to be tested). If the values ​​of the gravity parameters collected by the gravity sensor of the carrier 250 within 2 seconds are all the same as the gravity parameter 4, it can be confirmed that the placement of the folding screen to be tested has been completed, and the face camera 230 can start to adjust the placement position and angle of the face camera 230 and / or the carrier 250 according to the adjustment instructions.

[0099] Furthermore, the relevant staff can click a confirmation button on the target terminal 210 to consider that the placement action of the folding screen to be detected has been completed, and the target terminal 210 can send a target image acquisition instruction to the face camera 230. In response to the target image acquisition instruction, the face camera 230 can start to adjust the placement position and placement angle of the face camera 230 and / or the carrier 250 according to the adjustment instruction. Among them, the target image represents the image of the folding screen to be detected in the bright screen state.

[0100] Furthermore, the method of the embodiment of the present application can perform crease detection on the folding screen to be detected based on the target image obtained from a single preset imaging angle, or can perform crease detection on the folding screen to be detected based on the target image obtained from multiple preset imaging angles.

[0101] For example, the method of the present application can be as follows: Figure 7a As shown, only the target image 1 corresponding to the folding screen to be detected is obtained when it is placed horizontally, and the folding screen to be detected is detected based on the target image 1; in order to further improve the accuracy of folding detection, the method of the embodiment of the present application can also be as follows Figure 7b As shown, target images 1, 2, and 3 of the folding screen to be detected are obtained in sequence when the folding screen to be detected is placed horizontally and the carrier is rotated ±45° around the y-axis, and crease detection is performed on the folding screen to be detected based on target images 1, 2, and 3. It should be noted that due to the different placement angles, the areas of target images 2 and 3 will be smaller than the area of ​​target image 1. It should be noted that the above examples of the placement position and placement angle of the carrier (or the screen to be detected) are only for the purpose of explaining the embodiment method of the present application in more detail, and should not constitute a limitation on the present application. The specific data or parameters of the adjustment instruction can be set by the technician according to the actual situation.

[0102] In some possible implementations, the adjustment instruction may also be used to indicate the display brightness of the folding screen to be detected. It is understandable that when there is a crease in the folding screen to be detected, the display brightness of the crease area is greater than the display brightness of the normal screen area.

[0103] Exemplarily, the display brightness of the folding screen to be detected is represented by 0% to 100%. If the display brightness of the folding screen to be detected is too high (such as the display brightness is greater than 90%), the imaging device in the face camera 230 may be damaged; if the display brightness of the folding screen to be detected is too low (such as the display brightness is less than 30%), the display brightness of the crease area may be similar to the display brightness of the normal screen area (such as the display brightness of the crease area is 25%, and the display brightness of the normal screen area is 24%), which increases the difficulty of the target terminal 210 to perform crease detection and may reduce the accuracy of crease detection. Therefore, the embodiment of the present application chooses to further ensure the accuracy of crease detection by limiting the display brightness of the folding screen to be detected. Specifically, setting the preset display brightness to 70% helps to ensure the safety of the face camera 230 while making the display brightness of the crease area and the display brightness of the normal screen area have a more obvious difference (such as the display brightness of the crease area is 86%, and the display brightness of the normal screen area is 70%).

[0104] In some possible implementations, the adjustment instruction may also be used to indicate the display color of the folding screen to be detected. It is understandable that when there is a crease in the folding screen to be detected, the corresponding grayscale value of the crease area is greater than the corresponding grayscale value of the normal screen area.

[0105] Exemplarily, the depth of the display color of the folding screen to be detected is represented by the grayscale value of its corresponding grayscale image, and the larger the corresponding grayscale value, the lighter the display color. It can be understood that when the display color of the folding screen to be detected is lighter, the grayscale value corresponding to the crease area is closer to the corresponding grayscale value of the normal screen area (such as the corresponding grayscale value of the crease area is 200, and the corresponding grayscale value of the normal screen area is 195). Therefore, the embodiment of the present application further ensures the accuracy of crease detection by limiting the display color of the folding screen to be detected. Specifically, assuming that the corresponding grayscale value of the preset display color is 150, it is helpful to make the corresponding grayscale value of the crease area and the corresponding grayscale value of the normal screen area have a more obvious difference (such as the display brightness of the crease area is 180, and the display brightness of the normal screen area is 150).

[0106] S603: The facial camera acquires the target image and transmits the target image to the target terminal.

[0107] The target terminal 210 can perform fold detection based on the target image and present the relevant detection results to relevant staff. The specific implementation method can be referred to below. Fig. 9 The relevant steps and implementation contents thereof.

[0108] See also Figure 8 , is a flow chart of a method for detecting folding screen creases based on multiple imaging angles provided in an embodiment of the present application, which is applied to a folding screen crease detection device. The folding screen crease detection device can refer to Figures 2 to 3 Any of the accompanying drawings corresponds to the folding screen crease detection device 220 described in the embodiment.

[0109] like Figure 8 As shown, the solution process may include the following steps:

[0110] S801: The facial photography device receives an adjustment instruction sent by the target terminal.

[0111] S802: The face camera confirms that the folding screen to be tested is placed on the carrier.

[0112] S803: The face camera adjusts the placement position of the face camera based on the five-axis motion device so that the face camera is aligned with the folding screen to be inspected.

[0113] S804: The face camera adjusts the placement position and placement angle of the vehicle based on the five-axis motion device, so that the vehicle is located at the second fixed point and the plane of the vehicle is 45 degrees to the horizontal plane.

[0114] S805: The face camera acquires a first target image, and sends the target image to a target terminal for the target terminal to perform crease detection.

[0115] Among them, the target image refers to the image taken by the folding screen crease detection device of the folding screen to be detected in the target posture and in the bright screen state.

[0116] S806: The face camera adjusts the placement angle of the vehicle based on the five-axis motion device so that the plane of the vehicle is -45° with the horizontal plane.

[0117] S807: The face camera acquires a second target image, and sends the second target image to the target terminal for the target terminal to perform crease detection.

[0118] S808: The face camera adjusts the placement angle of the vehicle based on the five-axis motion device so that the plane where the vehicle is located is parallel to the horizontal plane.

[0119] S809: The face camera obtains the third target image, and sends the third target image to the target terminal for the target terminal to perform crease detection.

[0120] The specific implementation of steps S801 to S809 can be referred to Figure 6 Steps S601 to S603 and their related implementation examples are not described in detail here.

[0121] See also Fig. 9 , which is a flow chart of another method for detecting folding screen creases provided in an embodiment of the present application, and is applied to a target terminal. The target terminal can refer to Figures 2 to 3 Any of the drawings corresponds to the target terminal 210 described in the embodiment.

[0122] like Fig. 9 As shown, the method may include the following steps:

[0123] S901: The target terminal receives a target image sent by the face camera, and obtains a detection image based on the target image.

[0124] Specifically, the target image refers to an image of the folding screen to be detected in the target posture and in the bright screen state, which is taken by the folding screen crease detection device. The target terminal 210 can obtain the above-mentioned detection image by graying the target image.

[0125] In some possible implementations, before step S901, the target terminal 210 may send a default adjustment instruction to the face camera 230, and may also send a temporary adjustment instruction input by relevant staff on the target terminal 210 to the face camera 230. Among them, the default adjustment instruction may be set by a technician when the target terminal 210 (or the system for detecting folding screen creases) leaves the factory, or may be set by relevant staff when the target terminal 210 (or the system for detecting folding screen creases) is put into use. The default adjustment instruction may be considered as an adjustment instruction executed by the target terminal 210 (or the system for detecting folding screen creases); the temporary adjustment instruction may be an adjustment instruction set by relevant staff according to actual conditions, which helps the target terminal 210 (or the system for detecting folding screen creases) to adapt to more folding screen crease detection scenarios (such as folding screens of different materials for crease detection, or folding screens that are initially judged to have creases for crease verification, etc.). It should be noted that the relevant embodiments of the face camera 230 acquiring the target image can refer to the above. Figure 6 Steps S601 to S603 and their related implementation examples are not described in detail here.

[0126] For example, Fig.10a As shown, after the relevant staff double-clicks the icon 1 in the target terminal 210, an adjustment instruction input interface 3 will be presented on the screen 2 of the target terminal 210. The relevant staff can set the placement position and placement angle of the face camera 230 and / or the carrier 250 in the adjustment instruction input interface 3. In response to the relevant staff clicking the button 4, the target terminal 210 will integrate the various parameters input by the relevant staff into the adjustment instruction and send the adjustment instruction to the face camera 230. Optionally, as Fig.10b As shown, the relevant staff can open the browser 5 in the target terminal 210 and enter the URL of the folding screen crease detection webpage in the address bar 6 of the browser 5 (such as Fig.10b www.zhehenjiance.com as shown in ), then the folding screen crease detection webpage 7 will be presented on the screen 2 of the target terminal 210, and the relevant staff can set the placement position and placement angle of the face camera 230 and / or the carrier 250 in the folding screen crease detection webpage 7. In response to the relevant staff clicking button 8, the target terminal 210 will integrate the various parameters input by the relevant staff into adjustment instructions, and send the adjustment instructions to the face camera 230. It should be noted that the above examples of the way in which the relevant staff inputs the adjustment instructions are only for more detailed explanation of the embodiment method of the present application, and do not mean that the way in which the relevant staff inputs the adjustment instructions can only use the above methods. The specific form of the target terminal 210 is not limited to the PC terminal, but can also be a terminal device such as a mobile terminal, which should not constitute a limitation on the present application and will not be repeated here.

[0127] In some other possible implementations, the target terminal 210 can also directly control the five-axis motion device 240 according to the adjustment instruction, and control the face camera 230 to obtain the target image. Exemplarily, when the adjustment instruction is used to indicate the information of "20 cm above the carrier 250 and 5 cm offset to the right, obtain the corresponding image of the folding screen to be detected when the carrier 250 is located at the second fixed point and at an angle of 45° with the horizontal plane", the target terminal 210 can directly control the five-axis motion device 240 to fix the carrier 250 on the second fixed point of the second moving track 242, and rotate the plane of the carrier 250 clockwise by 45° around the y-axis (which can be understood as the straight line where the second moving track 242 is located), and then move the face camera 230 5 cm to the right along the first moving track 241 and 20 cm upward along the third moving track 243. When the face camera 230 and the carrier 250 are in the placement position and / or placement angle corresponding to the adjustment instruction, the target terminal 210 can control the face camera 230 to perform the image acquisition operation and obtain the target image.

[0128] Optionally, the target terminal 210 may control only the face camera 230 to obtain one target image, or may control the face camera 230 to obtain multiple target images corresponding to the folding screen to be detected at different placement positions and / or placement angles.

[0129] Possibly, before the target terminal 210 can control the face camera 230 to perform the image acquisition operation, the target terminal 210 can also adjust the display brightness and display color of the folding screen to be detected. The specific adjustment method can refer to the above Figure 6 The relevant implementation contents of step S602 are not described in detail here.

[0130] S902: The target terminal identifies the pixels whose grayscale values ​​are in a first preset range as crease pixels and the pixels whose grayscale values ​​are in a second preset range as background pixels based on the grayscale values ​​of each pixel in the detection image, and confirms the first reference data corresponding to the crease pixels and the second reference data corresponding to the background pixels.

[0131] Among them, the crease pixel points correspond to the above Figure 6 The pixel points in the crease area mentioned in the figure correspond to the background pixel points mentioned above. Figure 6 The pixels of the normal screen area mentioned in .

[0132] In some embodiments, the first reference data may include a first number of crease pixels and a first average grayscale value of the crease pixels, and the second reference data may include a second number of background pixels and a second average pixel value of the background pixels.

[0133] S903: The target terminal generates third reference data based on the first reference data and the second reference data, and when the third reference value is greater than a preset threshold, confirms that there is a crease on the folding screen to be detected.

[0134] In some possible implementations, the third reference data may be calculated using the following formula:

[0135]

[0136]

[0137] Among them, C represents the average contrast value of the crease, C0 represents the first grayscale average value corresponding to the crease pixel point, and C b represents the second average pixel value corresponding to the background pixel point, S represents the area of ​​the crease, and the crease area can be obtained based on the first number corresponding to the crease pixel point. The evaluation unit of SEMU is JND (Just Notice Difference), which is a parameter that characterizes the difference in screen imaging perceived by the human eye. In the embodiment of the present application, SEMU can be used to indicate the obviousness of the crease, which is equivalent to the third reference data mentioned above. When SEMU is greater than the preset threshold, it can be considered that there is a crease on the folding screen to be detected, and the larger the SEMU is, the more obvious the crease on the folding screen to be detected is, and the easier it is to be perceived by the human eye.

[0138] In some possible implementations, if the target terminal 210 only controls the face camera 230 to obtain one target image, the target terminal 210 only needs to confirm whether there is a crease in the folding screen to be detected based on whether the third reference data corresponding to the target image is greater than a preset threshold; if the target terminal 210 controls the face camera 230 to obtain multiple target images corresponding to the folding screen to be detected in different placement positions and / or placement angles, then when the number of target images with creases is greater than a first preset value, it can be considered that there is a crease in the folding screen to be detected; if the target terminal 210 controls the face camera 230 to obtain multiple target images corresponding to the folding screen to be detected in different placement positions and / or placement angles, then when the ratio of the number of target images with creases to the number of all target images is greater than a second preset value, it can be considered that there is a crease in the folding screen to be detected. Exemplarily, the first preset value is set to 2. If the target terminal 210 controls the face camera 230 to obtain 5 target images (assuming that these 5 target images are collected by the face camera 230 when the placement angles of the carrier 250 are 0°, ±45° and ±60° to the horizontal plane, respectively), then when the third reference data corresponding to more than or equal to 2 target images among the 5 target images is greater than the preset threshold, it is confirmed that there is a crease on the folding screen to be detected; suppose the second preset value is 80%, if the target terminal 210 controls the face camera 230 to obtain 5 target images (assuming that these 5 target images are collected by the face camera 230 when the placement angles of the carrier 250 are 0°, ±45° and ±60° to the horizontal plane, respectively), then when the third reference data corresponding to more than or equal to 5×80%=4 target images among the 5 target images is greater than the preset threshold, it is confirmed that there is a crease on the folding screen to be detected.

[0139] In some possible implementations, since the area of ​​the target image may be different from the actual area of ​​the folding screen to be detected at different placement angles, the embodiment of the present application may also set different preset thresholds based on the different placement angles of the carrier 250 (or the folding screen to be detected). Exemplarily, when the plane where the carrier 250 is located is parallel to the horizontal plane, the area of ​​the target image is the same as the actual area of ​​the folding screen to be detected, and the preset threshold in this case is set as the first preset threshold; when there is an angle between the plane of the carrier 250 and the horizontal plane, the area of ​​the target image will be smaller than the actual area of ​​the folding screen to be detected, and the preset threshold in this case is set as the second preset threshold. In order to avoid the situation where the crease area presented in the target image is reduced due to the tilt of the carrier 250 (or the folding screen to be detected), a second preset threshold that is smaller than the first preset threshold can be set. Optionally, the embodiment of the present application can set the second preset threshold based on the first preset threshold and the ratio of the area of ​​the target image to the actual area of ​​the folding screen. For example, if the first preset threshold is 1.5, the area of ​​the target image is 288×512 pixels, and the actual area of ​​the folding screen is 360×640 pixels, it can be seen that the ratio of the area of ​​the target image to the actual area of ​​the folding screen is 0.8, and the second preset threshold can be set to 1.5×0.8=1.2. It should be noted that the above method for setting the second preset threshold is only to explain the embodiment method of the present application in more detail, and the technicians can also use other methods to set the second preset threshold according to the actual situation, which is not limited here.

[0140] In some possible implementations, if the target terminal 210 confirms that there is a crease in the folding screen to be detected based on the target image, a reminder message similar to "There is a crease in the folding screen to be detected, and the area accounts for 15% of the entire screen" can be generated, and the reminder message can be presented on the display screen of the target terminal 210, or the reminder message can be presented to the relevant staff in the form of voice broadcast. Optionally, the target terminal 210 can also transmit the reminder message to the relevant staff who have an associated relationship with the target terminal 210 in the form of text messages, telephone voice, emails, and private messages on social accounts. If the target terminal 210 has at least one of the above contact methods of the corresponding staff, it can be considered that the staff has a corresponding relationship with the target terminal 210.

[0141] It can be seen that the method of the embodiment of the present application can determine whether there is a crease on the folding screen to be detected based on the grayscale image of the target image, which helps to reduce the amount of calculation for folding screen crease detection, thereby reducing the operating burden of the target terminal and improving the efficiency of crease detection. In addition, the grayscale value of the target image can better retain the detailed features of the folding screen to be detected, thereby improving the accuracy of crease detection, and can also achieve a visual recognition effect similar to that of the human eye, which can be further used to quantitatively evaluate the impact of creases on user use.

[0142] In some possible implementations, based on Figure 6 , Figure 8 and Fig. 9 The method for detecting folding screen creases described in the present application embodiment can also be applied to the scene of screen scratch detection. The target terminal 210 can confirm the number of scratches on the screen and the area of ​​each scratch based on the target image. Furthermore, corresponding reminder information can be generated according to the number of scratches and the area of ​​scratches.

[0143] Exemplarily, the target terminal 210 may acquire the target screen image to be detected in the same manner as described above. Fig. 9 The contents of step S901 and its related embodiments are the same. After obtaining the target image of the screen to be detected, the target terminal 210 can divide the detection image after graying the target image into connected domains to obtain multiple different scratch areas. The area of ​​each scratch is determined based on the number of pixels in each scratch area and the corresponding average gray value.

[0144] Specifically, the embodiment of the present application determines each connected domain that may exist in one or more target images by marking adjacent pixels with the same grayscale value as the same connected domain. Specifically, the connected domain marking algorithm can be implemented by a seed filling algorithm (Seed-Filling algorithm), and the specific implementation process can refer to the following steps:

[0145] a. Traverse each pixel of the entire target image from left to right and from top to bottom;

[0146] b. If the pixel has been traversed, continue traversing according to the preset rules, otherwise go to step c;

[0147] c. Take the pixel as the starting seed and put it in a set marked as label, then push all the pixels that meet the conditions into the stack according to the specified neighborhood relationship;

[0148] d. Pop the top pixel of the stack and put it in the set marked with label, and then push all the pixels that meet the conditions into the stack according to the specified neighborhood relationship;

[0149] e. Repeat step d until the stack is empty. At this point, a connected domain in the target image is found, and the category of the connected domain is marked as label;

[0150] f. Repeat step b until the entire target image is traversed.

[0151] See also Fig.11 , which is a schematic diagram of a connected domain division scenario provided in an embodiment of the present application.

[0152] like Fig.11As shown, if there is a connected domain 1 (the grayscale value is set to 125, accounting for 80% of the target image area), a connected domain 2 (the grayscale value is set to 225, accounting for 5% of the target image area), a connected domain 3 (the grayscale value is set to 225, accounting for 5% of the target image area) and a connected domain 4 (the grayscale value is set to 225, accounting for 10% of the target image area) in the target image corresponding to the screen to be detected.

[0153] Furthermore, the target terminal 210 can Fig. 9 The steps in the above and the related embodiments thereof determine whether connected domain 2, connected domain 3 and connected domain 4 are scratches. If it is confirmed that the third reference data corresponding to the pixel points in connected domain 2, connected domain 3 and connected domain 4 is greater than the corresponding preset threshold, it can be considered that there are three scratches in the screen to be detected. Further, a reminder message similar to "there are three scratches in the current screen to be detected" can be generated. The way of presenting the reminder message can refer to the above Fig. 9 Step S903 and its related embodiments are not described in detail here. Figure 6 , Figure 8 and Fig. 9 The contents of the relevant embodiments can be adaptively applied to the screen scratch detection scenario and will not be elaborated here.

[0154] See also Fig.12 , which is a structural schematic diagram of a folding screen crease detection device provided in an embodiment of the present application.

[0155] like Fig.12 As shown, the folding screen crease detection device 220 may include: a data transmission module 221, a control module 222 and an image acquisition module 223.

[0156] The data transmission module 221 may be used to receive an adjustment instruction from a target terminal, where the adjustment instruction may be used to indicate a placement position and / or placement angle of the folding screen to be detected;

[0157] The control module 222 can adjust the placement position and / or placement angle of the folding screen to be detected based on the adjustment instruction;

[0158] The image acquisition module 223 may be used to obtain a target image when the placement position and / or placement angle of the folding screen to be detected is consistent with the placement position and / or placement angle required by the adjustment instruction. The target image refers to an image of the folding screen to be detected taken by the folding screen crease detection device in the target posture and in the bright screen state;

[0159] The data transmission module 221 may also be used to transmit the target image to the target terminal.

[0160] See also Fig.13, is a structural diagram of a target terminal provided in an embodiment of the present application.

[0161] like Fig.13 As shown, the target terminal 210 may include: an interaction module 211, a data transmission module 212 and a calculation module 213;

[0162] The interaction module 211 may be used to receive adjustment instructions input by relevant staff;

[0163] The data transmission module 212 may be used to send the adjustment instruction to the folding screen crease detection device;

[0164] The data transmission module 212 may also be used to receive a target image sent by the folding screen crease detection device;

[0165] The calculation module 213 can be used to determine whether there is a crease on the folding screen to be detected based on the target image.

[0166] In some possible implementations, the target terminal 210 may further include:

[0167] The calculation module 213 can also be used to grayscale the target image to obtain a detection image;

[0168] The calculation module 213 may also, based on the grayscale value of each pixel in the detection image, identify the pixel whose grayscale value is in the first preset range as a crease pixel, identify the pixel whose grayscale value is in the second preset range as a background pixel, and confirm the first reference data corresponding to the crease pixel and the second reference data corresponding to the background pixel;

[0169] The calculation module 213 can also generate third reference data based on the first reference data and the second reference data. When the third reference value is greater than a preset threshold, it is confirmed that there is a crease on the folding screen to be detected.

[0170] See also Fig.14 , is a schematic diagram of another target terminal provided in an embodiment of the present application, and the target terminal may include:

[0171] Processor 1010, memory 1020 and I / O interface 1030. The processor 1010, memory 1020 and I / O interface 1030 can be connected to each other in a communicative manner. The memory 1020 is used to store instructions, and the processor 1010 is used to execute the instructions stored in the memory 1020 to implement the above Fig. 9 The corresponding method steps.

[0172] The processor 1010 is used to execute the instructions stored in the memory 1020 to control the I / O interface 1030 to receive and send signals and complete the steps in the above method. The memory 1020 can be integrated in the processor 1010 or set separately from the processor 1010.

[0173] The memory 1020 may also include a storage system 1021, a cache 1022, and a RAM 1023. The cache 1022 is a primary memory between the RAM 1023 and the CPU, which is composed of a static memory chip (SRAM). It has a relatively small capacity but a much higher speed than the main memory, close to the speed of the CPU; the RAM 1023 is an internal memory that directly exchanges data with the CPU, which can be read and written at any time (except when refreshed), and has a very high speed. It is usually used as a temporary data storage medium for the operating system or other running programs. The three are combined to realize the functions of the memory 1020.

[0174] As an implementation, the function of the I / O interface 1030 may be implemented by a transceiver circuit or a dedicated transceiver chip. The processor 1010 may be implemented by a dedicated processing chip, a processing circuit, a processor or a general-purpose chip.

[0175] As another implementation method, it is possible to use a general-purpose computer to implement the device provided in the embodiment of the present application. That is, the program code that implements the functions of the processor 1010 and the I / O interface 1030 is stored in the memory 1020, and the general-purpose processor implements the functions of the processor 1010 and the I / O interface 1030 by executing the code in the memory 1020.

[0176] For the concepts, explanations, detailed descriptions and other steps involved in the device and related to the technical solutions provided in the embodiments of the present application, please refer to the description of the method steps performed by the device in the aforementioned method or other embodiments, which will not be repeated here.

[0177] As another implementation of this embodiment, a computer-readable storage medium is provided, on which instructions are stored. When the instructions are executed, the method in the above method embodiment is executed.

[0178] As another implementation of this embodiment, a computer program product including instructions is provided, and when the instructions are executed, the method in the above method embodiment is performed.

[0179] Those skilled in the art will appreciate that for ease of description, Fig.14 Only one memory and processor are shown. In an actual terminal or server, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage device, etc., which is not limited in the embodiments of the present application.

[0180] It should be understood that in the embodiments of the present application, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.

[0181] It should also be understood that the memory mentioned in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).

[0182] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated in the processor.

[0183] It should be noted that the memory described herein is intended to include, without being limited to, these and any other suitable types of memory.

[0184] In addition to the data bus, the bus may also include a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Fig.14 In the text file, various buses are marked as buses.

[0185] It should also be understood that the first, second, third, fourth and various numerical numbers involved in this document are only distinctions made for the convenience of description and are not intended to limit the scope of the present application.

[0186] It should be understood that the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0187] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0188] In various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0189] Those skilled in the art will appreciate that the various illustrative logical blocks (ILBs) and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0190] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0191] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0192] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0193] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0194] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement part or all of the steps of any method for detecting folding screen creases as recorded in the above method embodiments.

[0195] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the methods for detecting folding screen creases as recorded in the above method embodiments.

[0196] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for detecting folding screen creases, characterized in that: A target terminal applied to a folding screen crease detection system, the folding screen crease detection system comprising the target terminal and a folding screen crease detection device, the method comprising: Receiving a target image sent by the folding screen crease detection device, where the target image is an image of the folding screen to be detected taken by the folding screen crease detection device in a target posture and in a bright screen state; grayscale the target image to obtain a detection image; Based on the detection image, it is determined whether there is a crease in the folding screen to be detected.

2. The method according to claim 1, characterized in that The determining, based on the detection image, whether there is a crease in the folding screen to be detected includes: Based on the grayscale value of each pixel in the detection image, determine the pixel whose grayscale value is in a first preset range as a crease pixel, determine the pixel whose grayscale value is in a second preset range as a background pixel, and determine the first reference data corresponding to the crease pixel and the second reference data corresponding to the background pixel; A third reference data is generated based on the first reference data and the second reference data, and when the third reference value is greater than a preset threshold, it is determined that there is a crease in the folding screen to be detected.

3. The method according to claim 2, characterized in that The first reference data includes a first number of crease pixel points and a first average grayscale value of the crease pixel points, and the second reference data includes a second number of background pixel points and a second average pixel value of the background pixel points.

4. The method according to claim 2 or 3, characterized in that: The generating third reference data based on the first reference data and the second reference data, and determining that there is a crease in the folding screen to be detected when the third reference value is greater than a preset threshold, includes: The average contrast ratio of the crease is calculated based on the first grayscale average value corresponding to the crease pixel point, the second average pixel value corresponding to the background pixel point, and a first formula. The first formula is: Where C represents the average contrast value of the crease, C0 represents the first grayscale average value corresponding to the crease pixel point, and C b Indicates the second average pixel value corresponding to the background pixel; The third reference data is calculated based on the crease average contrast value, the crease area and a second formula, wherein the crease area is obtained based on a first number corresponding to crease pixels, and the second formula is: Wherein S represents the crease area, and SEMU represents the third reference data.

5. The method according to any one of claims 1 to 4, characterized in that: Before receiving the target image sent by the folding screen crease detection device, the method further includes: Receive adjustment instructions from relevant staff, where the adjustment instructions are used to indicate the target posture of the folding screen to be detected, and the target posture includes a placement position and / or a placement angle.

6. The method according to claim 5, characterized in that The adjustment instruction is also used to indicate the display brightness and / or display color of the folding screen to be detected.

7. The method according to claim 6, characterized in that After determining whether there is a crease in the folding screen to be detected based on the detection image, the method further includes: Generate reminder information and present the reminder information to the relevant staff.

8. A method for detecting folding screen creases, characterized in that: A folding screen crease detection device applied to a folding screen crease detection system, the folding screen crease detection system comprising a target terminal and the folding screen crease detection device, the method comprising: receiving an adjustment instruction sent by the target terminal, where the adjustment instruction is used to indicate a target posture of the folding screen to be detected; Adjusting the placement posture of the folding screen to be detected to the target posture according to the adjustment instruction; A target image is acquired and sent to the target terminal, wherein the target image is an image of the folding screen to be detected taken by the folding screen crease detection device in the target posture and in a bright screen state.

9. The method according to claim 8, characterized in that The device for detecting folding screen creases comprises a surface camera, a five-axis motion device and a carrier, wherein the surface camera is coupled to the five-axis motion device, and the carrier is coupled to the five-axis motion device; The receiving the adjustment instruction sent by the target terminal includes: receiving the adjustment instruction sent by the target terminal through the face capture device; The step of adjusting the placement posture of the folding screen to be detected to the target posture according to the adjustment instruction includes: controlling the five-axis motion device according to the adjustment instruction by the face camera to adjust the placement posture of the carrier to the target posture, and placing the folding screen to be detected on the carrier.

10. The method according to claim 9, characterized in that The acquiring the target image and sending the target image to the target terminal includes: The target image is obtained by photographing the image of the folding screen to be inspected in the target posture and in the screen-on state by the face camera; The target image is sent to the target terminal through the face capture device.

11. The method according to any one of claims 8 to 10, characterized in that: The target posture includes a placement position and / or a placement angle.

12. The method according to claim 11, characterized in that The adjustment instruction is also used to indicate the display brightness and / or display color of the folding screen to be detected.

13. The method according to claim 12, characterized in that The folding screen crease detection device also includes a gravity sensor; The adjusting the placement posture of the folding screen to be detected to the target posture according to the adjustment instruction includes: If the gravity parameters collected by the gravity sensor remain unchanged within a preset time period, the placement posture of the folding screen to be detected is adjusted to the target posture according to the adjustment instruction.

14. A target terminal, characterized in that: The method comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, wherein the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the method according to any one of claims 1 to 7 is executed.

15. A folding screen crease detection device, characterized in that: It comprises one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the method as described in any one of claims 8 to 13 is executed.

16. A system for detecting folding screen creases, characterized in that: The system includes the target terminal as described in claim 14 and the folding screen crease detection device as described in claim 15.

17. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on the target terminal, the method according to any one of claims 1 to 7 is executed.

Images