Folding screen detection method, folding screen detection system and related device

Abstract

The embodiment of the invention provides a detection method of a folding screen, a detection system of the folding screen and a related device, and relates to the technical field of terminals. The folding screen comprises a first surface, a second surface, a third surface and a fourth surface, the distance between the first surface and the second surface is the thickness of the folding screen, and the distance between the third surface and the fourth surface is the width or height of the folding screen; the method comprises the steps that a first image is acquired, the first image comprises an image obtained by shooting a folding screen from an angle facing a third surface or a fourth surface, a tangent plane of the first surface forms a first edge of the first image, and a tangent plane of the second surface forms a second edge of the first image; performing edge detection on the first image to obtain a first edge line and a second edge line; when the distance between the first edge line and the second edge line in the target direction is larger than a distance threshold value, it is determined that the folding screen breaks down. In this way, the fault phenomenon of the folding screen can be detected.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a folding screen detection method, a folding screen detection system and related devices. Background Art

[0002] With the development of terminal technology, electronic devices can be equipped with folding screens. When an electronic device is equipped with a folding screen, the electronic device can be in a folded state or an unfolded state. When the electronic device switches from the folded state to the unfolded state, or from the unfolded state to the folded state, the folding screen will bend repeatedly. In this way, the folding screen is prone to malfunction, affecting the user experience. Summary of the invention

[0003] The embodiments of the present application provide a folding screen detection method, a folding screen detection system and related devices, which are applied to the field of terminal technology and are conducive to detecting folding screen failures.

[0004] In the first aspect, the embodiment of the present application provides a method for detecting a folding screen. The folding screen includes a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is a foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; the method includes: acquiring a first image, the first image includes an image obtained by photographing the folding screen from an angle facing the third surface or the fourth surface, the first surface and the second surface are not visible in the first image, and the section of the first surface forms a first edge of the first image, and the section of the second surface forms a second edge of the first image; edge detection is performed on the first image to obtain a first edge line of the first edge in the first image, and a second edge line of the second edge in the first image; when there is a pixel point whose distance in the target direction between the first edge line and the second edge line is greater than the distance threshold, the folding screen failure is determined, and the target direction is the direction of longitudinal cutting of the first edge line and the second edge line.

[0005] The folding screen may include multiple flexible materials, and these flexible materials may enable the folding screen to have thickness, width, and height. In the embodiment of the present application, the folding screen may be as follows Fig. 9 As shown in a. Fig. 9 In the example shown, the first surface may be the bottom of the folding screen, the second surface may be the top of the folding screen, the third surface may be the right side of the folding screen, and the fourth surface may be the left side of the folding screen. The distance between the first surface and the second surface may be the thickness of the folding screen. The rotation axis may also be located on the first surface after folding.

[0006] exist Fig. 9In a, the direction of acquiring the first image is to shoot facing the right side (or the third surface). In other implementations, the direction of acquiring the first image may be to shoot facing the left side (or the fourth surface), the front side or the back side.

[0007] As the folding screen is folded more times, the second surface is prone to deformation and failure. In some implementations, the first image can be as follows Fig. 9 As shown in c in FIG. 1 , the first image includes the third surface or the fourth surface, while the first surface and the second surface are not visible in the first image. At the same time, the section of the first surface forms the first edge of the first image, and the section of the second surface forms the second edge of the first image, that is, material 4 forms the first edge of the first image, and material 1 forms the second edge of the first image.

[0008] The second surface of the folding screen is deformed and may be farther from the first surface. In the first image, the distance between the pixels on the first edge line and the second edge line relative to each other may be greater than the distance formed by the pixels corresponding to the thickness of the folding screen in the first image. The deformation of the middle bending area of ​​the folding screen is generally large, and it may be calculated whether the distance between the pixels on the first edge line and the second edge line relative to each other in the middle bending area is greater than the distance threshold.

[0009] In the embodiment of the present application, the first edge line can refer to Fig.10 The upper edge line shown in c in the figure, the second edge line can refer to Fig.10 The target direction is the direction of the longitudinal cutting of the first edge line and the second edge line, that is, the direction of the line segment l.

[0010] The method provided in the embodiment of the present application may be executed by a device having a processing function, such as an electronic device or a server, which is not limited in the embodiment of the present application.

[0011] In this way, when there is a pixel point between the first edge line and the second edge line whose distance in the target direction is greater than the distance threshold, the folding screen failure is determined, which is conducive to detecting the phenomenon of folding screen failure. Compared with manual observation, it is conducive to improving detection efficiency and detection accuracy.

[0012] In one possible implementation, edge detection is performed on a first image to obtain a first edge line of a first edge in the first image and a second edge line of a second edge in the first image, including: performing edge detection on the first image to obtain multiple edge lines; if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, then obtaining the first edge line and the second edge line.

[0013] When edge detection is performed on the first image, more edges can be obtained. In order to identify the required edge lines, the length threshold can be used to filter out edge lines that are not likely to be required. The edge lines of the folding screen are relatively long, so the edge lines whose lengths are greater than or equal to the length threshold are determined as the first edge lines and the second edge lines. This is conducive to improving recognition accuracy.

[0014] In a possible implementation, if there are two edge lines among multiple edge lines whose lengths are greater than or equal to a length threshold, a first edge line and a second edge line are obtained, including: if there are two edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, and both edge lines are distributed on both sides of the center line of the third surface or the fourth surface, then a first edge line and a second edge line are obtained.

[0015] In order to more accurately identify the first edge line and the second edge line, the first edge line and the second edge line may be screened out from a plurality of edge lines according to the length of the edge line and the distribution of the edge line.

[0016] In the embodiment of the present application, the distribution of the edge line can be determined by the starting point and the ending point of the edge line.

[0017] In a possible implementation, before obtaining the first edge line and the second edge line if there are two edge lines whose lengths are greater than or equal to a length threshold among a plurality of edge lines, the method also includes: if there are non-continuous edge lines among the plurality of edge lines, deleting the non-continuous edge lines among the plurality of edge lines; if there are two edge lines whose lengths are greater than or equal to the length threshold among the plurality of edge lines, obtaining the first edge line and the second edge line, including: if there are two edge lines whose lengths are greater than or equal to the length threshold among the plurality of edge lines other than the non-continuous edge lines, obtaining the first edge line and the second edge line.

[0018] In order to more accurately identify the first edge line and the second edge line, the first edge line and the second edge line can be screened out from the plurality of edge lines by the length of the edge line, the distribution of the edge line and the continuity of the edge line. In addition, deleting the non-continuous edge line is conducive to reducing the impact of the non-continuous edge line on subsequent processing.

[0019] In one possible implementation, edge detection is performed on the first image, including: in the first image, removing pixel points corresponding to the third surface or the fourth surface except for pixel points within the first area, to obtain a second image, wherein a center line of the first area intersects with the rotation axis; and edge detection is performed on the second image.

[0020] In order to improve the efficiency of image processing, the first image can be processed to remove pixels of no interest. Since the middle bending area of ​​the folding screen is prone to deformation, the embodiment of the present application can remove pixels outside the middle bending area. The first area is used to represent the middle bending area. The center line of the first area is the same as the center line of the folding screen, but the pixels contained are smaller than the pixels of the folding screen.

[0021] In one possible implementation, edge detection is performed on the second image, including: if there is a difference between the second area and the third area in the second image, edge detection is performed on the second image, the coordinate values ​​of the pixels included in the second area in the target direction are greater than the coordinate values ​​of the pixels included in the first area in the target direction, and the coordinate values ​​of the pixels included in the third area in the target direction are less than the coordinate values ​​of the pixels included in the first area in the target direction.

[0022] The first area is the area of ​​interest, the area outside the first area can be the background, the second area can be the area above the first area in the image, and the third area can be the area below the first area in the image. The embodiment of the present application can determine whether there is stray light in the background by comparing whether there is a difference between the second area and the third area. If there is a difference, stray light appears, and the image can be re-acquired for detection. If there is no difference, it means that stray light does not appear, and edge detection can continue.

[0023] This helps reduce the impact of background stray light on edge detection.

[0024] In a possible implementation, edge detection is performed on the first image, including: acquiring a third image, where the third image is a previous frame image of the first image; if the difference between the average brightness of the third image and the average brightness of the first image is greater than a brightness threshold, edge detection is performed on the first image.

[0025] During the folding process, the folding screen may have to wait for a while before folding or unfolding. During the waiting time, the captured images are the same. In order to improve image processing efficiency, the average brightness of the two images can be used to determine whether the folding screen is in the waiting process. If the difference in the average brightness is greater than the brightness threshold, it means that it is not in the waiting process, and edge detection is performed on the first image.

[0026] In a possible implementation, the first image is taken when the folding screen is in a process of repeated folding; the method also includes: in the event of a folding screen failure, recording the number of times the folding screen is bent.

[0027] If the folding screen fails, record the number of times the folding screen is bent to facilitate subsequent estimation of the life of the folding screen.

[0028] In the second aspect, an embodiment of the present application provides a folding screen detection device, which may be an electronic device or a server, or a chip or chip system in an electronic device or a server. The folding screen detection device may include an acquisition unit and a processing unit. When the folding screen detection device is an electronic device, the processing unit may be a processor. The folding screen detection device may also include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the electronic device implements a folding screen detection method described in the first aspect or any possible implementation of the first aspect. When the folding screen detection device is a chip or chip system in an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit so that the electronic device implements a folding screen detection method described in the first aspect or any possible implementation of the first aspect. The storage unit may be a storage unit in the chip (for example, a register, a cache, etc.), or a storage unit in the electronic device located outside the chip (for example, a read-only memory, a random access memory, etc.).

[0029] Exemplarily, the folding screen includes a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; the acquisition unit is used to acquire a first image, the first image includes an image obtained by photographing the folding screen from an angle facing the third surface or the fourth surface, the first surface and the second surface are not visible in the first image, and the section of the first surface forms the first edge of the first image, and the section of the second surface forms the second edge of the first image. The processing unit is used to perform edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image; when there is a pixel point whose distance in the target direction is greater than a distance threshold between the first edge line and the second edge line, the folding screen failure is determined, and the target direction is the direction of longitudinal cutting of the first edge line and the second edge line.

[0030] In a possible implementation, the processing unit is further used to: perform edge detection on the first image to obtain multiple edge lines; if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, obtain a first edge line and a second edge line.

[0031] In a possible implementation, the processing unit is also used to: if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, and the two edge lines are distributed on both sides of the center line of the third surface or the fourth surface, then a first edge line and a second edge line are obtained.

[0032] In a possible implementation, the processing unit is also used to: if there are non-continuous edge lines among the multiple edge lines, delete the non-continuous edge lines from the multiple edge lines; if among the multiple edge lines other than the non-continuous edge lines, there are two edge lines whose lengths are greater than or equal to a length threshold, obtain a first edge line and a second edge line.

[0033] In one possible implementation, the processing unit is also used to: in the first image, remove the pixel points corresponding to the third surface or the fourth surface except the pixel points within the first area to obtain a second image, where the center line of the first area intersects the rotation axis; and perform edge detection on the second image.

[0034] In one possible implementation, the processing unit is also used to: if there is a difference between the second area and the third area in the second image, perform edge detection on the second image, the coordinate values ​​of the pixels included in the second area in the target direction are greater than the coordinate values ​​of the pixels included in the first area in the target direction, and the coordinate values ​​of the pixels included in the third area in the target direction are less than the coordinate values ​​of the pixels included in the first area in the target direction.

[0035] In a possible implementation, the acquisition unit is also used to: acquire a third image, where the third image is a previous frame image of the first image; the processing unit is also used to: perform edge detection on the first image if the difference between the average brightness of the third image and the average brightness of the first image is greater than a brightness threshold.

[0036] In a possible implementation, the first image is taken when the folding screen is in a process of repeated folding; the processing unit is also used to: in the event of a folding screen failure, record the number of times the folding screen is bent.

[0037] In a third aspect, an embodiment of the present application provides a folding screen detection system, comprising: a photographing device, a processing device and a folding screen; the folding screen comprises a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is a foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; the photographing device is used to capture an image of the folding screen from an angle facing the third surface or facing the fourth surface; the processing device is used to execute the method described in the first aspect or any possible implementation of the first aspect.

[0038] In a possible implementation, the detection system further includes an interface device, and the interface device is used to connect the photographing device and the processing device.

[0039] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect.

[0040] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program or instructions are stored. When the computer program or instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation of the first aspect.

[0041] In a sixth aspect, an embodiment of the present application provides a computer program product, which includes a computer program code. When the computer program code runs on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation of the first aspect.

[0042] In the seventh aspect, an embodiment of the present application provides a chip or a chip system, which is applied to an electronic device, and the chip or chip system includes at least one or more processors, and the one or more processors are used to call computer instructions to execute the method described in the first aspect or any possible implementation of the first aspect.

[0043] In a possible implementation, the chip or chip system described above in the embodiment of the present application further includes at least one memory, in which instructions are stored. The memory may be a storage unit inside the chip, such as a register, a cache, etc., or a storage unit of the chip (e.g., a read-only memory, a random access memory, etc.).

[0044] It should be understood that the third to seventh aspects of the embodiments of the present application correspond to the technical solutions of the first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 This is a stacking diagram of a folding screen in an unfolded state provided by an embodiment of the present application;

[0046] Figure 2 This is a stacking diagram of a folding screen in a folded state provided by an embodiment of the present application;

[0047] Figure 3 is a schematic diagram of a folding screen layer provided in an embodiment of the present application;

[0048] Figure 4 is a schematic diagram of another folding screen layering provided in an embodiment of the present application;

[0049] Figure 5 is a schematic diagram of another folding screen layering provided in an embodiment of the present application;

[0050] Figure 6 is a schematic diagram of side monitoring when a folding screen is in an unfolded state provided by an embodiment of the present application;

[0051] Figure 7 is a schematic diagram of side monitoring when a folding screen is in a folded state provided by an embodiment of the present application;

[0052] Figure 8 is a schematic flow chart of a folding screen detection method provided in an embodiment of the present application;

[0053] Fig. 9 is a schematic diagram of capturing a folding screen image provided by an embodiment of the present application;

[0054] Fig.10 is a schematic diagram of an image processing process provided by an embodiment of the present application;

[0055] Fig.11 is a schematic diagram of edge detection provided by an embodiment of the present application;

[0056] Fig.12 is a schematic diagram of another edge detection provided by an embodiment of the present application;

[0057] Fig.13 is a schematic flow chart of another folding screen detection method provided in an embodiment of the present application;

[0058] Fig.14 It is a schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] In order to clearly describe the technical solution of the embodiment of the present application, the following description is first made:

[0060] In the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. For example, the first image and the second image are only used to distinguish different images, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0061] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0062] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.

[0063] With the development of terminal technology, electronic devices can be equipped with folding screens. When an electronic device is equipped with a folding screen, the electronic device can be in a folded state or an unfolded state. When the electronic device switches from the folded state to the unfolded state, or from the unfolded state to the folded state, the folding screen will bend. In this way, the folding screen is prone to malfunction, affecting the user experience.

[0064] The folding screen is a bendable flexible screen, which is made of various flexible materials bonded together with glue. During the use of the folding screen, it needs to be bent thousands or even tens of thousands of times. During the bending process of the folding screen, each layer of the screen is composed of soft flexible materials, and each layer of flexible material is bonded together with glue. After repeated bending, the viscosity of the glue will decrease. After the viscosity of the glue decreases, the bending will continue. Since the bending force between the layers remains unchanged during the bending process, delamination (peeling) will occur when the viscosity of the glue decreases, causing the folding screen to malfunction. The failure caused by delamination can also be called a peeling failure.

[0065] For example, Figure 1 A stacking diagram of a folding screen in an unfolded state is shown. Figure 1As shown, the folding screen is not bent and is in an unfolded state. The folding screen may include four flexible materials, namely material 1, material 2, material 3 and material 4. Any two layers of the four layers of flexible materials are glued together, so that the four layers of flexible materials are glued together. In the unfolded state, each layer of flexible material is not subjected to force.

[0066] If the folding screen is bent in the unfolded state, it is in the folded state. Figure 2 A stacking diagram of a folding screen in a folded state is shown. Figure 2 As shown, the folding screen is bent and in a folded state. The four layers of flexible materials are glued together and bent together. In the folded state, each layer of flexible material is stressed.

[0067] From the unfolded state to the folded state, and then from the folded state to the unfolded state, after repeated bending, the viscosity of the glue of each layer of flexible material will decrease. After the viscosity of the glue decreases, the bending continues. Since the bending force between the layers remains unchanged during the bending process, delamination will occur when the viscosity of the glue decreases. These four layers of flexible materials may delaminate in various situations.

[0068] In a possible implementation, the viscosity of the glue between the material 4 and the material 3 is reduced, and during the bending process, the material 4 is separated from the material 3, resulting in a delamination phenomenon.

[0069] For example, Figure 3 A schematic diagram of the folding screen layering is shown. Figure 3 As shown, in the side view of the folding screen, the folding screen is in an unfolded state, material 4 is separated from material 3, and material 1, material 2 and material 3 are not separated. The folding screen is delaminated and fails.

[0070] In another possible implementation, the viscosity of the glue between the material 3 and the material 2 is reduced, and during the bending process, the material 3 is separated from the material 2, resulting in a delamination phenomenon.

[0071] For example, Figure 4 A schematic diagram of the folding screen layering is shown. Figure 4 As shown, in the side view of the folding screen, the folding screen is in an unfolded state, material 3 is separated from material 2, material 4 is not separated from material 3, and material 1 is not separated from material 2. The folding screen is delaminated and fails.

[0072] In yet another possible implementation, the viscosity of the glue between the material 2 and the material 1 is reduced, and during the bending process, the material 2 is separated from the material 1, resulting in a delamination phenomenon.

[0073] For example, Figure 5A schematic diagram of the folding screen layering is shown. Figure 5 As shown, in the side view of the folding screen, the folding screen is in an unfolded state, material 2 is separated from material 1, and material 4, material 3 and material 2 are not separated. The folding screen is delaminated and fails.

[0074] Depend on Figures 3 to 5 It can be seen that when the folding screen is delaminated, different types of failures may occur. This is because the layers are bonded together with glue, so delamination may occur in each layer of the folding screen. The bonding ability between each layer is closely related to the material properties and glue performance of each layer. When the folding screen is bent multiple times, due to the change in force and the decrease in the activity of the glue, when the bonding performance of one layer decreases significantly, delamination will occur.

[0075] The folding screen can be subjected to a bending reliability test before it leaves the factory. During the test, the folding screen is controlled to be bent multiple times, and the stratification phenomenon of the folding screen is manually observed. When the stratification phenomenon is manually observed, the number of bending times of the folding screen is recorded. It takes a while to observe the folding screen from the beginning of bending to the occurrence of failure. Due to the limited time and energy of the personnel, they cannot always stare at the bending process. This will result in the failure to detect the stratification of the folding screen in time, which will lead to inaccurate bending times. If the service life of the folding screen is estimated based on an inaccurate number of bending times, the estimated service life of the folding screen will also be inaccurate.

[0076] In addition, in order to improve the test efficiency, the folding screen can be placed in an insulated box for bending reliability testing. In this way, although the high and low temperature environments can be set through the insulated box, it is beneficial to quickly reduce the viscosity of the glue and shorten the bending time. However, when the folding screen is in the insulated box, it is even more impossible for the human eye to observe the stratification phenomenon. If a fixed number of bending times is used, the service life of the folding screen cannot be accurately estimated.

[0077] If the estimated service life of the folding screen is inaccurate, the folding screen will easily delaminate after leaving the factory, affecting the user experience.

[0078] In view of this, the embodiments of the present application provide a folding screen detection method, a folding screen detection system and related devices. During the folding process of the folding screen, an image including the folding screen is captured by a camera, and edge detection is performed on the image to obtain the edge line of the folding screen. If the distance between two edge lines of the folding screen is greater than a threshold, it means that the folding screen is layered and faulty. In this way, no manual observation is required, which is conducive to the detection of folding screen faults.

[0079] Using the method provided in the embodiment of the present application, folding screen failures can be identified more accurately, the number of times the folding screen is bent when the folding screen fails can be recorded, and the life of the folding screen can be estimated using the number of bends.

[0080] Before introducing the detection method provided in the embodiment of the present application, the detection system provided in the embodiment of the present application is first introduced.

[0081] The detection system provided in the embodiment of the present application may include a folding screen to be tested, a bendable tool, a camera, and a server. The folding screen to be tested is fixed on the bendable tool. When the bendable tool is bent, the folding screen to be tested can be bent. When the bendable tool is unfolded, the folding screen to be tested can be unfolded. When the bendable tool is repeatedly bent, the folding screen to be tested can be repeatedly bent.

[0082] The camera can be placed on the side of the folding screen to be tested, and on the same plane as the middle bending area of ​​the folding screen to be tested. This placement is because when the folding screen to be tested is layered, it is not easy to detect from the front of the folding screen to be tested due to the obstruction of the surface material of the folding screen to be tested, but the side is not blocked, and the layering phenomenon can be well observed from the side. The camera can capture images including the side of the folding screen to be tested. When the folding screen to be tested is layered, the camera can capture images including the above Figure 3 , Figure 4 or Figure 5 The image of the folding screen to be tested is shown. The camera can be understood as a photo taking device.

[0083] The server can control the bendable tool to bend repeatedly to achieve the control of the folding screen to be tested to bend repeatedly. The server is connected to the camera through an interface, and can control the camera to capture images and obtain the images captured by the camera. The detection method provided by the embodiment of the present application is deployed in the server, and the detection method provided by the embodiment of the present application can be used to monitor the image. When the stratification phenomenon is detected, the number of bends of the folding screen to be tested and the time when the stratification phenomenon occurs are output. Among them, the time when the stratification phenomenon occurs can be the length of time from the start of bending to the occurrence of the stratification phenomenon.

[0084] In some examples, when the server controls the folding screen to be tested to bend repeatedly through the bendable fixture, it can control the camera to collect images in real time. The camera can transmit the image of the folding screen to be tested during the bending process to the server. The server can use the detection method provided in the embodiment of the present application to monitor the image during the bending process in real time.

[0085] In a possible implementation, the specific process of repeatedly bending the folding screen to be tested may be: the folding screen to be tested waits for a period of time in the unfolded state before bending, and the folding screen to be tested waits for a period of time in the folded state before unfolding, and so on. The waiting time of the folding screen to be tested in the unfolded state and the waiting time in the folded state may be the same or different, and the embodiment of the present application does not limit this.

[0086] For example, Figure 6 A schematic diagram of side monitoring when the folding screen is in the unfolded state is shown. Figure 6 As shown, the folding screen detection system includes a folding screen to be tested 601, a camera 602, an interface device 603, a server 604 and a bendable tool. The bendable tool is not shown in the figure. The camera 602 is placed on the side of the folding screen to be tested 601 and is placed on the same plane as the folding screen to be tested. The folding screen to be tested 601 is in an unfolded state.

[0087] The camera 602 is connected to the server 604 via the interface device 603. The interface device 603 may include one or more interfaces. When the interface device 603 includes multiple interfaces, the interface device 603 may be used to connect to multiple cameras. In this way, the detection system can test multiple folding screens to be tested at the same time, which is conducive to improving the test efficiency.

[0088] The server 604 may be a device with a large computing power, and the server 604 may be electrically connected to the bendable tool, and the bendable tool may be used to control the folding screen to be tested. Figure 7 A schematic diagram of side monitoring when a folding screen is in a folded state is shown. Figure 7 As shown, the folding screen 601 to be tested is in a folded state. Figure 6 The same is not repeated here.

[0089] When the folding screen to be tested is bent repeatedly, the server 604 can obtain the image captured by the camera 602 and monitor the image captured by the camera 602.

[0090] In other examples, the detection system may include a control device, and when the control device controls the folding screen to be tested to bend repeatedly through a bendable fixture, the server may control the camera to collect images in real time. The camera may transmit images of the folding screen to be tested during the bending process to the server. The server may use the detection method provided in the embodiment of the present application to monitor the images during the bending process in real time.

[0091] The detection system shown above is an example. In another example, the embodiment of the present application further provides a detection system, which may include a folding screen to be tested, a bendable tool, a camera, and an electronic device with a processing function. The electronic device may be a computer, a tablet, or other device, which is not limited in the embodiment of the present application.

[0092] The electronic device can control the bendable tool to bend repeatedly to achieve the control of the folding screen to be tested to bend repeatedly. The electronic device can also control the camera to capture images and obtain the images captured by the camera. The electronic device is deployed with the detection method provided by the embodiment of the present application, and the detection method provided by the embodiment of the present application can be used to monitor the image. When the delamination phenomenon is detected, it is determined that the folding screen to be tested is faulty.

[0093] In some implementations, the electronic device may include a camera, and the camera may be used to capture images.

[0094] It is understandable that both electronic devices and servers may be referred to as processing devices.

[0095] The following uses the server as the execution body to introduce in detail the folding screen detection method provided in the embodiment of the present application.

[0096] For example, Figure 8 FIG. 1 is a schematic flow chart of a folding screen detection method provided by an embodiment of the present application. Figure 8 As shown, the method may include the following steps:

[0097] S801: Acquire a current frame image and a frame image previous to the current frame image.

[0098] If the current frame image is the first frame image captured by the camera, there is no previous frame image and subsequent processing is not required.

[0099] If the current frame image is not the first frame image captured by the camera, it corresponds to a previous frame image, and the server can obtain the current frame image and the previous frame image.

[0100] Since the folding screen includes multiple materials, it has a certain thickness. The embodiment of the present application takes the folding screen as a rectangular parallelepiped as an example for explanation. The camera takes a picture on the side of the folding screen, and the collected image may include the side of the folding screen.

[0101] Combination Fig. 9 Describe the images captured by the camera.

[0102] like Fig. 9As shown in a in FIG. 1 , the folding screen is a rectangular parallelepiped, including a front side, a back side, a left side, a right side, a top side, and a bottom side. The bottom side includes a folding axis, and when the folding screen is folded, the bottom side can be folded along with the rotation of the folding axis. The thickness, width, and height of the folding screen can be Fig. 9 As shown in a in .

[0103] In order to detect whether the folding screen is delaminated, a camera may be used to capture an image of the folding screen from an angle facing the left side or the right side. Fig. 9 As shown in a in the figure, the camera can capture an image of the folding screen from an angle facing the right side.

[0104] If the folding screen fails, the folding screen is not a rectangular block, such as Fig. 9 As shown in b in the figure, the top of the folding screen is convex. If the folding screen includes material 1, material 2, material 3 and material 4, there may be a delamination phenomenon between the two layers of materials. The camera shoots from the right side, and it can be obtained Fig. 9 The image shown in c.

[0105] like Fig. 9 As shown in c in FIG. 1 , the material 4 and material 1 of the folding screen are the surface of the folding screen, and the material 2 and material 3 are the inside of the folding screen. There may be a layering between the material 4 and the material 3 inside the folding screen, resulting in a folding screen failure. The image of the current frame obtained by the server can be as follows Fig. 9 As shown in c.

[0106] When the folding screen is bent, it bends after waiting for a period of time in the unfolded state, and the folding screen unfolds after waiting for a period of time in the folded state, and so on. When waiting in the unfolded state or the folded state, more images can be collected. These images are the same and the processing results are the same. If they are processed one by one, the detection efficiency will be reduced. Therefore, the server can determine whether the folding screen is in the bending process based on the two frames of images. If the two frames of images are the same or similar, no subsequent processing is required. If there are differences between the two frames of images, subsequent processing can continue.

[0107] In an embodiment of the present application, it is possible to determine whether the folding screen is in the bending process by the average brightness of two frames of images.

[0108] S802: Calculate the average brightness of two frames of images respectively.

[0109] The server calculates the average brightness of the current frame image and the average brightness of the previous frame image.

[0110] S803: Determine whether the average brightness difference between the two frames of image is greater than a brightness threshold.

[0111] In some examples, the server can analyze whether the average brightness of the two frames is greater than the brightness threshold based on inter-frame interpolation. If the inter-frame interpolation is relatively small, the average brightness difference between the two frames is less than or equal to the brightness threshold, indicating that the folding screen is in a stationary state (i.e., unfolded or folded) and is not in the bending process. If the inter-frame interpolation is relatively large, the average brightness difference between the two frames is greater than the brightness threshold, indicating that the folding screen is in the bending process.

[0112] S804: If the average brightness difference between the two frames of image is greater than the brightness threshold, a region of interest (ROI) is obtained from the current frame of image.

[0113] The locations where delamination is prone to occur in the folding screen are the folding axis of the folding screen and the area near the folding axis. The embodiment of the present application takes the folding axis of the folding screen and the area near the folding axis as the ROI and focuses on monitoring this area.

[0114] For example, the current frame image can refer to Fig.10 In a, get ROI from the current frame image, and you can get Fig.10 b in the figure. The server can find the pixels of the folding screen from the current frame image, and then remove the pixels outside the ROI from the pixels of the folding screen to obtain the ROI.

[0115] In this way, compared with detecting the entire folding screen, detecting ROI can reduce the detection area, which is beneficial to improving processing efficiency. At the same time, it is beneficial to reduce the impact of abnormal disturbances in areas outside the ROI.

[0116] If the average brightness difference between the two frames is less than or equal to the brightness threshold, the folding screen is not in the bending process, and the server can discard this frame of image and obtain the next frame of image captured by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0117] S805 , determining whether there is a difference between the upper and lower regions of the ROI in the current frame image.

[0118] The upper and lower regions of ROI are used to represent the upper region of ROI and the lower region of ROI. The upper region of ROI is the region composed of pixels above the ROI pixels in the current frame image, and the lower region of ROI is the region composed of pixels below the ROI pixels in the current frame image.

[0119] After the server obtains the ROI, it can obtain an image including the ROI. The server can compare the pixels above the ROI pixel and the pixels below the ROI pixel in the image including the ROI to determine whether there is a difference. In this way, testing the background of the ROI area is conducive to determining whether there is stray light in the background.

[0120] If there is a difference between the upper and lower regions of the ROI, it indicates that there is stray light. If layered monitoring is performed based on such an image, the monitoring accuracy is low. Therefore, the server can discard this frame of image and obtain the next frame of image captured by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0121] S806: If there is no difference between the upper and lower regions of the ROI, perform noise reduction processing.

[0122] The server can perform noise reduction processing on the image including the ROI, which is helpful to remove the influence of noise and further help to improve the accuracy of subsequent monitoring.

[0123] The noise reduction method used by the server may be related to the performance of the camera, wherein the performance of the camera may include parameters such as exposure, signal-to-noise ratio, and sensitivity.

[0124] In some examples, the server may use Gaussian filtering for noise reduction.

[0125] S807: Perform edge detection on the image after the noise reduction process.

[0126] Performing edge detection on the denoised image is helpful to obtain the edge information of ROI.

[0127] In some examples, the server may perform Canny edge detection on the denoised image.

[0128] There is no difference between the upper and lower regions of the above ROI, which is also helpful to reduce the impact on edge detection.

[0129] S808, searching for non-zero point positions in the image after edge detection.

[0130] The non-zero position can be used to represent the edge identified by edge detection. The image after edge detection includes many edges. The server can find the non-zero position in the image after edge detection to obtain these edges. In some examples, the non-zero position can also be called a non-zero edge point.

[0131] S809: Calculate edge continuity.

[0132] After the server obtains these edges, it can calculate whether these edges are continuous. If these edges are continuous, they may be the edges of the ROI. If these edges are discontinuous, they are most likely not the edges of the ROI, and there may be noise or false edges.

[0133] In some examples, if the distance between the endpoints of two edges is less than or equal to a preset distance, it can be said that the two edges are continuous. If the distance between the endpoints of two edges is greater than a preset distance, it can be said that the two edges are discontinuous.

[0134] If the edges are discontinuous, they can be removed to reduce the impact on subsequent processing.

[0135] S810: If the edge is continuous, determine whether the edge length is greater than a length threshold.

[0136] If the edge length is greater than the length threshold, it can be said that the edge may be the edge of the ROI. If the edge length is less than or equal to the length threshold, it can be said that the edge is most likely not the edge of the ROI, and the server can remove the edge to reduce the impact on subsequent processing. Among them, the length threshold can be calibrated experimentally, and the embodiments of the present application are not limited to this. In some examples, the length threshold can be positively correlated with the number of pixels occupied by the width of the folding screen in the image.

[0137] If the lengths of all edges in the image are less than or equal to the length threshold, or if there is an edge whose length is greater than the length threshold, it means that the edge of the ROI cannot be accurately identified, and the server can discard this frame of image and obtain the next frame of image captured by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0138] In the case that there are at least two edges in the image whose lengths are both greater than the length threshold, the server may continue to determine whether the at least two edges are edges of the ROI, and may execute S811.

[0139] S811. When the edge length is greater than a length threshold, obtain the starting point and the ending point of the upper edge line and the lower edge line in the image.

[0140] In the case where the lengths of at least two edges are greater than the length threshold, it is determined whether the distance between any two of the at least two edges is greater than the thickness of the folding screen. The thickness of the folding screen is used to indicate the thickness of the material included in the folding screen.

[0141] If the distance between the lengths of two edges among at least two edges is less than or equal to the thickness of the folding screen, it can be said that the two edges are close and the probability of delamination between the two edges is small. If the distance between the lengths of any two edges among at least two edges is less than the thickness of the folding screen, it means that any two edges are close, and there is no need to obtain the starting point and the ending point of the upper edge line and the lower edge line in the image. The server can discard this frame of image and obtain the next frame of image captured by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0142] If the distance between the lengths of two edges among at least two edges is greater than the thickness of the folding screen, the probability of delamination between the two edges is high, and the starting point and the ending point of the upper edge line and the lower edge line among the edges are obtained. In the vertical direction, the position of the pixel point of the lower edge line is greater than the position of the pixel point of the upper edge line. S812: Determine whether the starting point and the ending point of the upper edge line and the lower edge line are on both sides of the center of the folding screen.

[0143] If the starting point and the ending point of the upper edge line are on both sides of the center of the folding screen, it means that the upper edge line is most likely the edge line of the ROI area. If the starting point and the ending point of the lower edge line are on both sides of the center of the folding screen, it means that the lower edge line is most likely the edge line of the ROI area.

[0144] If the starting point and the ending point of the upper edge line are not on both sides of the center of the folding screen, it means that the upper edge line is most likely not the edge line of the ROI area, and the server discards this frame image and obtains the next frame image captured by the camera, that is, executes S816. After the server obtains the next frame image, it can use the next frame image as the current frame image and execute the above S801.

[0145] If the starting point and the ending point of the lower edge line are not on both sides of the center of the folding screen, it means that the lower edge line is most likely not the edge line of the ROI area, and the server discards this frame image and obtains the next frame image captured by the camera, that is, executes S816. After the server obtains the next frame image, it can use the next frame image as the current frame image and execute the above S801.

[0146] S813: If both are on the two sides of the center of the folding screen, calculate the distance between the two edge lines.

[0147] If they are both on both sides of the center of the folding screen, it means that the edge line of the appropriate ROI has been detected. The server can obtain the highest points of the two lines respectively and calculate the distance between the two lines based on the vertical distance between the highest points of the two lines.

[0148] S814: Determine whether the distance between the two lines is greater than a distance threshold.

[0149] For example, Fig.10 As shown in c in FIG. 1 , the upper edge line and the lower edge line are represented by short dashed lines, and it is determined whether the distance l between the two lines is greater than the distance threshold.

[0150] S815: If the distance is greater than the distance threshold, stratification occurs.

[0151] The distance threshold may be greater than the distance formed by the pixel points occupied by the thickness of the folding screen in the image, and may be positively correlated with the size of the image. For example, the size of the image is m*n, and the distance threshold may be n / 5. n / 5 is greater than the distance formed by the pixel points occupied by the thickness of the folding screen in the image.

[0152] If the distance is greater than the distance threshold, it means that delamination occurs, and the folding screen is faulty. If the distance is less than or equal to the distance threshold, it means that no delamination occurs, and the server continues to monitor, that is, repeats the above process.

[0153] If delamination occurs, the above Figure 3 , Figure 4 or Figure 5 The layering type shown, Figure 2 The edge detection map of the hierarchical type shown can be Fig.10 As shown in c. Figure 3 The edge detection map of the hierarchical type shown can be Fig.11 shown. Figure 4 The edge detection map of the hierarchical type shown can be Fig.12 Show.

[0154] S816. Obtain the next frame of image in any of the following cases: there is a difference between the upper and lower areas of the ROI area; no two edge lines in the image have a length greater than the length threshold; the starting point and the ending point of the upper edge line or the lower edge line are not on both sides of the center of the folding screen; the distance between the upper edge line and the lower edge line is less than the distance threshold.

[0155] The folding screen detection method provided in the embodiment of the present application performs edge detection on the image captured by the camera. If the distance between two edge lines in the image is greater than the distance threshold, it can be determined that the folding screen to be tested has a layered phenomenon. In order to improve the detection accuracy, the two edge lines can be continuous, the lengths of both are greater than the length threshold, and the starting point and the end point of the edge line are on both sides of the center of the folding screen. In this way, the probability that these two edge lines are the lines of the folding screen to be tested is high.

[0156] The method provided in the embodiment of the present application can be used to estimate the life of the folding screen and compare the bending ability of different materials. The method provided in the embodiment of the present application can also be used to analyze the stress condition during the bending process of the folding screen, the screen vibration caused by bending, and the force analysis.

[0157] An example provided by an embodiment of the present application is described in detail above, and another example provided by an embodiment of the present application will be introduced below.

[0158] For example, Fig.13 A schematic flow chart of a folding screen detection method provided by an embodiment of the present application is shown. The folding screen includes a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates.

[0159] like Fig.13 As shown, the method may include the following steps:

[0160] S1301. Acquire a first image, where the first image includes an image of the folding screen photographed from an angle facing the third surface or the fourth surface, where the first surface and the second surface are not visible in the first image, and a cut surface of the first surface forms a first edge of the first image, and a cut surface of the second surface forms a second edge of the first image.

[0161] The first image can refer to the above Figure 8 The current frame image shown. The acquisition of the first image may refer to the above S801, which will not be described in detail here.

[0162] S1302: Perform edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image.

[0163] Before edge detection is performed on the first image, S801 to S806 may be performed, or a portion of them may be performed or none of them may be performed, which is not limited in the present embodiment. Edge detection is performed on the first image to obtain the first edge line and the second edge line, which may include some or all of the steps in S808 to S812, which is not limited in the present embodiment.

[0164] S1303: When there is a pixel point between the first edge line and the second edge line whose distance in the target direction is greater than the distance threshold, determine that the folding screen is faulty, and the target direction is a direction that vertically cuts the first edge line and the second edge line.

[0165] This step may refer to the above-mentioned S814 and will not be described in detail here.

[0166] In this way, when there is a pixel point between the first edge line and the second edge line whose distance in the target direction is greater than the distance threshold, the folding screen failure is determined, which is conducive to detecting the phenomenon of folding screen failure. Compared with manual observation, it is conducive to improving detection efficiency and detection accuracy.

[0167] Optionally, performing edge detection on the first image to obtain a first edge line of the first image with a first edge and a second edge line of the first image with a second edge includes: performing edge detection on the first image to obtain multiple edge lines; if there are two edge lines in the multiple edge lines whose lengths are greater than or equal to a length threshold, then obtaining the first edge line and the second edge line. This step may refer to the above S810. This is conducive to improving recognition accuracy.

[0168] Optionally, if there are two edge lines whose lengths are greater than or equal to the length threshold among the multiple edge lines, then the first edge line and the second edge line are obtained, including: if there are two edge lines whose lengths are greater than or equal to the length threshold among the multiple edge lines, and both edge lines are distributed on both sides of the center line of the third surface or the fourth surface, then the first edge line and the second edge line are obtained. This step can refer to the above S811 and S812. In this way, it is conducive to accurately identifying the first edge line and the second edge line.

[0169] Optionally, before obtaining the first edge line and the second edge line if there are two edge lines whose lengths are greater than or equal to a length threshold among multiple edge lines, the method also includes: if there are non-continuous edge lines among the multiple edge lines, deleting the non-continuous edge lines among the multiple edge lines; if there are two edge lines whose lengths are greater than or equal to the length threshold among the multiple edge lines, obtaining the first edge line and the second edge line, including: if among the edge lines other than the non-continuous edge lines among the multiple edge lines, there are two edge lines whose lengths are greater than or equal to the length threshold, obtaining the first edge line and the second edge line.

[0170] This step may refer to the above S809. In this way, it is more conducive to accurately identifying the first edge line and the second edge line.

[0171] Optionally, edge detection is performed on the first image, including: in the first image, removing pixel points corresponding to the third surface or the fourth surface except for pixel points within the first area, to obtain a second image, wherein a center line of the first area intersects with the rotation axis; and edge detection is performed on the second image.

[0172] This step may refer to the above S804. This is helpful to improve the image processing efficiency.

[0173] Optionally, edge detection is performed on the second image, including: if there is a difference between the second area and the third area in the second image, edge detection is performed on the second image, the coordinate values ​​of the pixels included in the second area in the target direction are greater than the coordinate values ​​of the pixels included in the first area in the target direction, and the coordinate values ​​of the pixels included in the third area in the target direction are less than the coordinate values ​​of the pixels included in the first area in the target direction.

[0174] This step may refer to the above S805. This helps to reduce the influence of background stray light on edge detection.

[0175] Optionally, performing edge detection on the first image includes: acquiring a third image, where the third image is a previous frame image of the first image; if the difference between the average brightness of the third image and the average brightness of the first image is greater than a brightness threshold, performing edge detection on the first image.

[0176] This step may refer to the above-mentioned S802 and S803. This is helpful to improve the image processing efficiency.

[0177] Optionally, the first image is taken when the folding screen is in a process of repeated folding; the method further comprises: in the case of a folding screen failure, recording the number of times the folding screen is bent. If the folding screen fails, recording the number of times the folding screen is bent is to facilitate subsequent estimation of the life of the folding screen.

[0178] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0179] The folding screen detection method of the embodiment of the present application has been described above, and the device for executing the above method provided by the embodiment of the present application is described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the relevant device provided by the embodiment of the present application can execute the steps in the above folding screen detection method.

[0180] Fig.14 This is a schematic diagram of the structure of a chip provided in an embodiment of the present application. Fig.14 As shown, the chip 140 includes one or more (including two) processors 1401 , a communication line 1402 , a communication interface 1403 , and a memory 1404 .

[0181] In some implementations, the memory 1404 stores the following elements: executable modules or data structures, or a subset thereof, or an extended set thereof.

[0182] The method for processing network jams described in the above embodiment of the present application can be applied to the processor 1401, or implemented by the processor 1401. The processor 1401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method for processing network jams can be completed by an integrated logic circuit of hardware or software instructions in the processor 1401. The above-mentioned processor 1401 can be a general-purpose processor (for example, a microprocessor or a conventional processor), a digital signal processor (digital signal processing, DSP), an application-specific integrated circuit (application-specific integrated circuit, ASIC), a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates, transistor logic devices or discrete hardware components. The processor 1401 can implement or execute the methods, steps and logic block diagrams related to each processing disclosed in the embodiment of the present application.

[0183] The steps of the method for processing network freezes disclosed in the embodiment of the present application can be directly embodied as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. Among them, the software module can be located in a mature storage medium in the field such as a random access memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable read only memory (EEPROM). The storage medium is located in the memory 1404, and the processor 1401 reads the information in the memory 1404, and completes the steps of the above method in combination with its hardware.

[0184] The processor 1401 , the memory 1404 , and the communication interface 1403 may communicate with each other via the communication line 1402 .

[0185] In the above embodiments, the instructions stored in the memory for execution by the processor may be implemented in the form of a computer program product, wherein the computer program product may be pre-written in the memory, or may be downloaded and installed in the memory in the form of software.

[0186] The folding screen detection method provided in the embodiment of the present application can be applied to electronic devices with communication functions. The electronic device includes a terminal device, and the specific device form of the terminal device can refer to the above-mentioned related description, which will not be repeated here.

[0187] An embodiment of the present application provides a terminal device, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the terminal device to execute the above-mentioned fault handling method.

[0188] The embodiment of the present application provides a chip. A chip or a chip system, the chip or chip system is applied to an electronic device, the chip or chip system includes at least one or more processors, and the one or more processors are used to call computer instructions to execute the fault handling method in the above embodiment. Its implementation principle and technical effect are similar to those of the above-mentioned related embodiments, and will not be repeated here.

[0189] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program or instruction. The above-mentioned fault handling method is implemented when the computer program or instruction is executed by an electronic device. The fault handling method described in the above embodiment can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the function can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. Computer-readable media may include computer storage media and communication media, and may also include any medium that can transfer a computer program from one place to another. The storage medium may be any target medium that can be accessed by a computer.

[0190] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, disk storage or other magnetic storage devices, or any other medium that is intended to carry or store the required program code in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave) is used to transmit software from a website, server or other remote source, the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disks and optical disks as used herein include optical disks, laser disks, optical disks, digital versatile disks (DVD), floppy disks and Blu-ray disks, where disks usually reproduce data magnetically, while optical disks reproduce data optically using lasers. Combinations of the above should also be included in the scope of computer-readable media.

[0191] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program code runs on an electronic device, the electronic device executes the above-mentioned fault handling method.

[0192] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0193] The above specific implementation methods further illustrate the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. A folding screen detection method, characterized in that: The folding screen comprises a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is a foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; the method comprises: Acquire a first image, where the first image includes an image of the folding screen photographed from an angle facing the third surface or the fourth surface, the first surface and the second surface are not visible in the first image, and a cut surface of the first surface forms a first edge of the first image, and a cut surface of the second surface forms a second edge of the first image; Performing edge detection on the first image to obtain a first edge line where the first edge is on the first image, and a second edge line where the second edge is on the first image; When there is a pixel point between the first edge line and the second edge line whose distance in a target direction is greater than a distance threshold, the folding screen failure is determined, and the target direction is a direction vertically cutting the first edge line and the second edge line.

2. The method according to claim 1, characterized in that: The performing edge detection on the first image to obtain a first edge line where the first edge is on the first image and a second edge line where the second edge is on the first image includes: Performing edge detection on the first image to obtain a plurality of edge lines; If there are two edge lines among the plurality of edge lines whose lengths are greater than or equal to the length threshold, the first edge line and the second edge line are obtained.

3. The method according to claim 2, characterized in that If there are two edge lines among the plurality of edge lines whose lengths are greater than or equal to a length threshold, obtaining the first edge line and the second edge line comprises: If there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, and the two edge lines are distributed on both sides of the center line of the third surface or the fourth surface, the first edge line and the second edge line are obtained.

4. The method according to claim 2 or 3, characterized in that: Before obtaining the first edge line and the second edge line if there are two edge lines whose lengths are greater than or equal to the length threshold among the plurality of edge lines, the method further includes: If there is a discontinuous edge line among the plurality of edge lines, deleting the discontinuous edge line from the plurality of edge lines; If there are two edge lines among the plurality of edge lines whose lengths are greater than or equal to a length threshold, obtaining the first edge and the second edge comprises: If, among the edge lines other than the non-continuous edge lines, there are two edge lines whose lengths are greater than or equal to a length threshold among the plurality of edge lines, the first edge line and the second edge line are obtained.

5. The method according to any one of claims 1 to 4, characterized in that The performing edge detection on the first image comprises: In the first image, pixel points other than pixel points in the first region are removed from the pixel points corresponding to the third surface or the fourth surface to obtain a second image, wherein a center line of the first region intersects the rotation axis; Perform edge detection on the second image.

6. The method according to claim 5, characterized in that The performing edge detection on the second image comprises: If there is a difference between the second area and the third area in the second image, edge detection is performed on the second image, and the coordinate values ​​of the pixels included in the second area in the target direction are greater than the coordinate values ​​of the pixels included in the first area in the target direction, and the coordinate values ​​of the pixels included in the third area in the target direction are less than the coordinate values ​​of the pixels included in the first area in the target direction.

7. The method according to any one of claims 1 to 6, characterized in that The performing edge detection on the first image comprises: Acquire a third image, where the third image is a frame image previous to the first image; If the difference between the average brightness of the third image and the average brightness of the first image is greater than a brightness threshold, edge detection is performed on the first image.

8. The method according to any one of claims 1 to 7, characterized in that The first image is taken when the folding screen is in a process of repeated folding; The method further comprises: In case the folding screen fails, the number of times the folding screen is bent is recorded.

9. A folding screen detection system, characterized in that: include: A photographing device, a processing device and a folding screen; the folding screen comprises a first surface, a second surface, a third surface, a fourth surface and a rotating shaft, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is a foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; The photographing device is used to photograph the image of the folding screen from an angle facing the third surface or facing the fourth surface; The processing device is used to execute the method according to any one of claims 1 to 8.

10. The detection system according to claim 9, characterized in that: The detection system further comprises an interface device, and the interface device is used to connect the photographing device and the processing device.

11. An electronic device, characterized in that: The electronic device comprises: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions so that the electronic device executes the method as described in any one of claims 1 to 8.

12. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 8.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 8.

14. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is run on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 8.

Images