Detection Method for Foldable Screen, Detection System for Foldable Screen and Related Devices

Abstract

An embodiment of the present application provides a detection method for a folding screen, a detection system for a folding screen, and related devices, relating to the technical field of terminals. The folding screen includes a first surface, a second surface, a third surface, and a fourth surface. The distance between the first surface and the second surface is the thickness of the folding screen, and the distance between the third surface and the fourth surface is the width or height of the folding screen. The method includes: obtaining a first image, where the first image includes an image of the folding screen taken from an angle facing the third surface or the fourth surface, a section plane of the first surface forms a first edge of the first image, and a section plane of the second surface forms a second edge of the first image; performing edge detection on the first image to obtain a first edge line and a second edge line; and determining that the folding screen is faulty when the distance in a target direction between the first edge line and the second edge line is greater than a distance threshold. In this way, it is beneficial to detect the phenomenon of a faulty folding screen.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular, to a detection method for a folding screen, a detection system for a folding screen, and related devices. Background Art

[0002] With the development of terminal technology, electronic devices can be configured with folding screens. When an electronic device is configured with a folding screen, the electronic device can be in a folded state or an unfolded state. When the electronic device switches from the folded state to the unfolded state, or from the unfolded state to the folded state, the folding screen will be repeatedly bent. In this way, the folding screen is prone to failure, affecting the user experience. Summary of the Invention

[0003] Embodiments of this application provide a detection method for a folding screen, a detection system for a folding screen, and related devices, which are applied to the technical field of terminals and are conducive to detecting the phenomenon of folding screen failure.

[0004] In a first aspect, an embodiment of this application provides a detection method for a folding screen. The folding screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotating shaft. The distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates; the method includes: obtaining a first image, where the first image includes an image of the folding screen taken from an angle facing the third surface or the fourth surface, the first surface and the second surface are not visible in the first image, and the tangent plane of the first surface forms a first edge of the first image, and the tangent plane of the second surface forms a second edge of the first image; performing edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image; and determining that the folding screen is faulty when there are pixel points with a distance greater than a distance threshold in a target direction between the first edge line and the second edge line, where the target direction is the direction of longitudinally cutting the first edge line and the second edge line.

[0005] The folding screen may include multiple flexible materials, which can make the folding screen have a thickness, a width, and a height. In the embodiments of this application, the folding screen may be as Figure 9 shown in a of Figure 9 In the example shown, the first surface may be the lower surface of the folding screen, the second surface may be the upper surface of the folding screen, the third surface may be the right side surface of the folding screen, and the fourth surface may be the left side surface of the folding screen. The distance between the first surface and the second surface may be the thickness of the folding screen. The rotating shaft may also be called, and after folding, it may be located on the first surface.

[0006] In Figure 9In a, the direction of obtaining the first image is taken facing the right side (or the third surface). In some other implementations, the direction of obtaining the first image can be taken facing the left side (or the fourth surface), the front side, or the back side.

[0007] As the number of folding times of the folding screen increases, the second surface is prone to deformation and malfunction. In some implementations, the first image can be as Figure 9 shown in c of, the first image includes the third surface or the fourth surface, while the first surface and the second surface are not visible in the first image. At the same time, the section of the first surface forms the first edge of the first image, and the section of the second surface forms the second edge of the first image, that is, Material 4 forms the first edge of the first image, and Material 1 forms the second edge of the first image.

[0008] When the second surface of the folding screen is deformed, it can be farther away from the first surface. In the first image, the distance between the corresponding pixel points on the first edge line and the second edge line can be greater than the distance formed by the pixel points corresponding to the thickness of the folding screen in the first image. The deformation of the middle bending area of the folding screen is generally larger. It can be calculated whether the distance between the corresponding pixel points on the middle bending area of the first edge line and the second edge line is greater than the distance threshold.

[0009] In the embodiments of the present application, the first edge line can refer to Figure 10 the upper edge line shown in c of, and the second edge line can refer to Figure 10 the lower edge line shown in c of. The target direction is the direction of longitudinally cutting the first edge line and the second edge line, that is, the direction where the line segment l is located.

[0010] The method provided by the embodiments of the present application can be executed by a device with processing functions, for example, an electronic device or a server. The embodiments of the present application do not limit this.

[0011] In this way, when there are pixel points with a distance greater than the distance threshold in the target direction between the first edge line and the second edge line, it is determined that the folding screen is faulty, which is beneficial to realizing the detection of the phenomenon of the folding screen malfunction. Compared with manual observation, it is beneficial to improve the detection efficiency and the detection accuracy.

[0012] In a possible implementation manner, edge detection is performed on the first image to obtain the first edge line of the first edge in the first image and the second edge line of the second edge in the first image, including: performing edge detection on the first image to obtain a plurality of edge lines; if there are two edge lines with a length greater than or equal to the length threshold among the plurality of edge lines, then obtain the first edge line and the second edge line.

[0013] When performing edge detection on the first image, a relatively large number of edges can be obtained. To identify the required edge lines, edge lines that are likely not to be the required ones can be filtered out by a length threshold. Since the edge lines of the foldable screen are relatively long, edge lines with a length greater than or equal to the length threshold are determined as the first edge line and the second edge line. This helps to improve the recognition accuracy.

[0014] In a possible implementation, if there are two edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, obtaining the first edge line and the second edge line includes: if there are two edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, and both edge lines are distributed on both sides of the center line of the third surface or the fourth surface, then obtain the first edge line and the second edge line.

[0015] To more accurately identify the first edge line and the second edge line, the first edge line and the second edge line can be filtered out from multiple edge lines based on the length of the edge lines and the distribution of the edge lines.

[0016] In the embodiments of the present application, the distribution of the edge line can be determined by the starting point and the ending point of the edge line.

[0017] In a possible implementation, before if there are two edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, and obtaining the first edge line and the second edge line, the method further includes: if there are discontinuous edge lines among multiple edge lines, then delete the discontinuous edge lines among multiple edge lines; if there are two edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, and obtaining the first edge and the second edge includes: if there are two edge lines among the edge lines other than the discontinuous edge lines among multiple edge lines whose lengths are greater than or equal to the length threshold, then obtain the first edge line and the second edge line.

[0018] To more accurately identify the first edge line and the second edge line, the first edge line and the second edge line can be filtered out from multiple edge lines based on the length of the edge lines, the distribution of the edge lines, and the continuity of the edge lines. Additionally, deleting the discontinuous edge lines helps to reduce the influence of the discontinuous edge lines on subsequent processing.

[0019] In a possible implementation, performing edge detection on the first image includes: in the first image, removing the pixel points other than the pixel points within the first region from the pixel points corresponding to the third surface or the fourth surface, to obtain a second image, and the center line of the first region intersects with the rotating shaft; performing edge detection on the second image.

[0020] To improve the processing efficiency of an image, the first image can be processed to remove pixels that are not of interest. Since the middle bending area of the folding screen is prone to deformation, the embodiments of the present application can remove the pixels outside the middle bending area. The first area is used to represent the middle bending area. The center line of the first area is the same as the center line of the folding screen, but the number of pixels it contains is less than that of the folding screen.

[0021] In a possible implementation, edge detection is performed on the second image, including: if there is a difference between the second area and the third area in the second image, edge detection is performed on the second image. The coordinates of the pixels included in the second area in the target direction are greater than the coordinates of the pixels included in the first area in the target direction, and the coordinates of the pixels included in the third area in the target direction are less than the coordinates of the pixels included in the first area in the target direction.

[0022] The first area is the area of interest. The area outside the first area can be the background. The second area can be the area above the first area in the image, and the third area can be the area below the first area in the image. The embodiments of the present application can determine whether there is stray light in the background by comparing whether there is a difference between the second area and the third area. If there is a difference, there is stray light, and the image can be re-acquired for detection. If there is no difference, it means there is no stray light, and edge detection can continue.

[0023] In this way, it is beneficial to reduce the influence of the stray light in the background on edge detection.

[0024] In a possible implementation, edge detection is performed on the first image, including: obtaining a third image, where the third image is the previous frame image of the first image; if the difference between the average brightness of the third image and the average brightness of the first image is greater than the brightness threshold, edge detection is performed on the first image.

[0025] During the folding process of the folding screen, there may be a situation where folding or unfolding is waited for a period of time. During the waiting time, the captured images are the same. To improve the image processing efficiency, it can be determined whether the folding screen is in the waiting process by the average brightness of two images. If the difference in average brightness is greater than the brightness threshold, it means it is not in the waiting process, and edge detection is performed on the first image.

[0026] In a possible implementation, the first image is captured during the repeated folding process of the folding screen; the method further includes: recording the number of bending times of the folding screen in case of a folding screen failure.

[0027] If the folding screen fails, record the number of bending times of the folding screen to facilitate subsequent estimation of the lifespan of the folding screen.

[0028] Second aspect, an embodiment of the present application provides a detection device for a foldable screen. The detection device for the foldable screen can be an electronic device or a server, or a chip or a chip system within the electronic device or the server. The detection device for the foldable screen can include an acquisition unit and a processing unit. When the detection device for the foldable screen is an electronic device, the processing unit can be a processor. The detection device for the foldable screen can further include a storage unit, and the storage unit can be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the electronic device to implement a detection method for a foldable screen described in the first aspect or any possible implementation manner of the first aspect. When the detection device for the foldable screen is a chip or a chip system within the electronic device, the processing unit can be a processor. The processing unit executes the instructions stored in the storage unit to enable the electronic device to implement a detection method for a foldable screen described in the first aspect or any possible implementation manner of the first aspect. The storage unit can be a storage unit within the chip (e.g., registers, caches, etc.), or a storage unit outside the chip within the electronic device (e.g., read-only memory, random access memory, etc.).

[0029] Exemplarily, the foldable screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotating shaft. The distance between the first surface and the second surface is the thickness of the foldable screen. The distance between the third surface and the fourth surface is the width or height of the foldable screen. The first surface is the foldable surface of the foldable screen. When the foldable screen is folded, the foldable surface is folded as the rotating shaft rotates; the acquisition unit is configured to acquire a first image, where the first image includes an image of the foldable screen captured from an angle facing the third surface or the fourth surface. The first surface and the second surface are not visible in the first image, and the tangent plane of the first surface forms a first edge of the first image, and the tangent plane of the second surface forms a second edge of the first image. The processing unit is configured to perform edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image; in a case where there are pixel points with a distance greater than a distance threshold in a target direction between the first edge line and the second edge line, it is determined that the foldable screen has a fault, and the target direction is the direction longitudinally cutting the first edge line and the second edge line.

[0030] In a possible implementation manner, the processing unit is further configured to: perform edge detection on the first image to obtain a plurality of edge lines; if there are two edge lines among the plurality of edge lines whose lengths are greater than or equal to a length threshold, then obtain the first edge line and the second edge line.

[0031] In a possible implementation, the processing unit is further configured to: if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, and the two edge lines are both distributed on both sides of the center line of the third surface or the fourth surface, obtain a first edge line and a second edge line.

[0032] In a possible implementation, the processing unit is further configured to: if there are discontinuous edge lines among the multiple edge lines, delete the discontinuous edge lines among the multiple edge lines; if there are two edge lines among the edge lines other than the discontinuous edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, obtain a first edge line and a second edge line.

[0033] In a possible implementation, the processing unit is further configured to: in the first image, remove the pixel points other than the pixel points within the first region from the pixel points corresponding to the third surface or the fourth surface, to obtain a second image, where the center line of the first region intersects the rotation axis; perform edge detection on the second image.

[0034] In a possible implementation, the processing unit is further configured to: if there are differences between the second region and the third region in the second image, perform edge detection on the second image, where the coordinates of the pixels included in the second region in the target direction are greater than the coordinates of the pixels included in the first region in the target direction, and the coordinates of the pixels included in the third region in the target direction are less than the coordinates of the pixels included in the first region in the target direction.

[0035] In a possible implementation, the acquisition unit is further configured to: acquire a third image, where the third image is the previous frame image of the first image; the processing unit is further configured to: if the difference between the average brightness of the third image and the average brightness of the first image is greater than the brightness threshold, perform edge detection on the first image.

[0036] In a possible implementation, the first image is captured during the repeated folding process of the folding screen; the processing unit is further configured to: in the case of a folding screen failure, record the number of bends of the folding screen.

[0037] In a third aspect, an embodiment of the present application provides a detection system for a folding screen, including: a photographing device, a processing device, and a folding screen; the folding screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotation axis, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotation axis rotates; the photographing device is configured to capture an image of the folding screen from an angle facing the third surface or the fourth surface; the processing device is configured to execute the method described in the first aspect or any one of the possible implementations of the first aspect.

[0038] In one possible implementation, the detection system further includes an interface device for connecting the photographing device and the processing device.

[0039] In a fourth aspect, an embodiment of the present application provides an electronic device, including one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the electronic device to execute the method described in the first aspect or any one of the possible implementations of the first aspect.

[0040] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer programs or instructions are stored. When the computer programs or instructions run on an electronic device, the electronic device is caused to execute the method described in the first aspect or any one of the possible implementations of the first aspect.

[0041] In a sixth aspect, an embodiment of the present application provides a computer program product, which includes computer program code. When the computer program code runs on an electronic device, the electronic device is caused to execute the method described in the first aspect or any one of the possible implementations of the first aspect.

[0042] In a seventh aspect, an embodiment of the present application provides a chip or a chip system. The chip or the chip system is applied to an electronic device, and the chip or the chip system includes at least one or more processors. The one or more processors are used to call computer instructions to execute the method described in the first aspect or any one of the possible implementations of the first aspect.

[0043] In one possible implementation, the chip or the chip system described above in the embodiment of the present application further includes at least one memory, and instructions are stored in the at least one memory. The memory may be a storage unit inside the chip, such as a register, a cache, etc., or a storage unit of the chip (such as a read-only memory, a random access memory, etc.).

[0044] It should be understood that the third aspect to the seventh aspect of the embodiments of the present application correspond to the technical solutions of the first aspect of the embodiments of the present application, and the beneficial effects obtained by each aspect and the corresponding feasible implementations are similar and will not be elaborated herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 is a stacked diagram of a folding screen in an unfolded state provided by an embodiment of the present application;

[0046] Figure 2 is a stacked diagram of a folding screen in a folded state provided by an embodiment of the present application;

[0047] Figure 3 It is a schematic diagram of a folded screen layer provided by an embodiment of the present application;

[0048] Figure 4 It is another schematic diagram of a folded screen layer provided by an embodiment of the present application;

[0049] Figure 5 It is yet another schematic diagram of a folded screen layer provided by an embodiment of the present application;

[0050] Figure 6 It is a schematic diagram of side monitoring when a folded screen provided by an embodiment of the present application is in the unfolded state;

[0051] Figure 7 It is a schematic diagram of side monitoring when a folded screen provided by an embodiment of the present application is in the folded state;

[0052] Figure 8 It is a schematic flowchart of a detection method for a folded screen provided by an embodiment of the present application;

[0053] Figure 9 It is a schematic diagram of collecting an image of a folded screen provided by an embodiment of the present application;

[0054] Figure 10 It is a schematic diagram of an image processing process provided by an embodiment of the present application;

[0055] Figure 11 It is a schematic diagram of edge detection provided by an embodiment of the present application;

[0056] Figure 12 It is another schematic diagram of edge detection provided by an embodiment of the present application;

[0057] Figure 13 It is another schematic flowchart of a detection method for a folded screen provided by an embodiment of the present application;

[0058] Figure 14 It is a schematic diagram of the structure of a chip provided by an embodiment of the present application. Detailed implementation manners

[0059] For the convenience of clearly describing the technical solutions of the embodiments of the present application, the following explanations are made first:

[0060] In the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items with basically the same functions and effects. For example, the first image and the second image are only used to distinguish different images, and their sequence is not limited. Those skilled in the art can understand that the terms "first" and "second" do not limit the quantity and execution order, and the terms "first" and "second" do not necessarily limit being different.

[0061] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0062] In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one (item)" or its similar expression refers to any combination of these items, including any combination of single item (item) or plural items (items). For example, at least one (item) of a, b, or c may represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, and c may be single or multiple.

[0063] With the development of terminal technology, an electronic device can be configured with a foldable screen. When the electronic device is configured with a foldable screen, the electronic device can be in a folded state or an unfolded state. When the electronic device switches from the folded state to the unfolded state, or from the unfolded state to the folded state, the foldable screen will bend. In this way, the foldable screen is prone to failures, affecting the user experience.

[0064] The foldable screen is a bendable flexible screen, and the flexible screen is formed by bonding various flexible materials with glue. During the use of the foldable screen, it needs to be bent thousands of times or even tens of thousands of times. During the bending process of the foldable screen, each layer of the screen is composed of soft flexible materials, and each layer of flexible materials is bonded by glue. During the process of repeated bending, the viscosity of the glue will decrease. After the viscosity of the glue decreases and continues to bend, since the bending force between each layer remains unchanged during the bending process, a peeling phenomenon will occur when the viscosity of the glue decreases, resulting in a failure of the foldable screen. The failure caused by delamination can also be called a peeling failure.

[0065] Exemplarily, Figure 1 shows a stacked diagram of a foldable screen in the unfolded state. As Figure 1As shown, the folding screen is not bent and is in the unfolded state. The folding screen may include 4 types of flexible materials, namely Material 1, Material 2, Material 3, and Material 4. Any two of these 4 layers of flexible materials are pasted together with glue, so that these 4 layers of flexible materials are pasted together by glue. In the unfolded state, each layer of flexible material is not stressed.

[0066] If the folding screen is bent in the unfolded state, it is in the folded state. Figure 2 A stacked diagram of a folding screen in the folded state is shown. As Figure 2 shown, the folding screen is bent and is in the folded state. These 4 layers of flexible materials are pasted together by glue and bend together. In the folded state, each layer of flexible material is stressed.

[0067] From the unfolded state to the folded state, and then from the folded state to the unfolded state, after repeated bending processes, the adhesiveness of the glue of each layer of flexible material will decrease. After the adhesiveness of the glue decreases and continues to bend, since the bending force between each layer remains unchanged during the bending process, delamination will occur when the adhesiveness of the glue decreases. These 4 layers of flexible materials may experience various delamination situations.

[0068] In one possible implementation, the adhesiveness of the glue between Material 4 and Material 3 decreases. During the bending process, Material 4 and Material 3 separate, resulting in a delamination phenomenon.

[0069] Exemplarily, Figure 3 a schematic diagram of a delaminated folding screen is shown. As Figure 3 shown, in the side view of the folding screen, the folding screen is in the unfolded state, Material 4 and Material 3 are separated, and Material 1, Material 2, and Material 3 are not separated. The folding screen has a delamination phenomenon and malfunctions.

[0070] In another possible implementation, the adhesiveness of the glue between Material 3 and Material 2 decreases. During the bending process, Material 3 and Material 2 separate, resulting in a delamination phenomenon.

[0071] Exemplarily, Figure 4 a schematic diagram of a delaminated folding screen is shown. As Figure 4 shown, in the side view of the folding screen, the folding screen is in the unfolded state, Material 3 and Material 2 are separated, Material 4 and Material 3 are not separated, and Material 1 and Material 2 are not separated. The folding screen has a delamination phenomenon and malfunctions.

[0072] In yet another possible implementation, the adhesiveness of the glue between Material 2 and Material 1 decreases. During the bending process, Material 2 and Material 1 separate, resulting in a delamination phenomenon.

[0073] Exemplarily, Figure 5Shows a schematic diagram of the layering of a folding screen. As Figure 5 shown, in the side view of the folding screen, when the folding screen is in the unfolded state, there is a separation between Material 2 and Material 1, and there is no separation between Material 4, Material 3, and Material 2. The folding screen shows a layering phenomenon and a fault occurs.

[0074] From Figures 3 to 5 it can be seen that when the folding screen shows layering, different types of faults can occur. This is because each layer is bonded by glue. Then, when the folding screen shows a layering phenomenon, it may occur in each layer. There is a relatively close relationship between the bonding ability between each layer, the material properties between each layer, and the performance of the glue. When the folding screen is bent multiple times, due to the change in force and the decrease in the activity of the glue, when the bonding performance of one layer decreases significantly, layering will occur.

[0075] Before the folding screen leaves the factory, a bending reliability test can be carried out on the folding screen. During the test, the folding screen is controlled to be bent multiple times, and the folding screen is observed manually for layering. When layering is observed manually, the number of bends of the folding screen is recorded. However, it takes a certain amount of time to observe from the start of bending the folding screen to the occurrence of a fault. Due to the limited time and energy of personnel, it is impossible to keep staring at the bending process all the time. In this way, it will lead to the failure to detect the layering phenomenon of the folding screen in time, and further lead to inaccurate number of bends obtained. If the service life of the folding screen is estimated based on inaccurate number of bends, it will also lead to inaccurate estimation of the service life of the folding screen.

[0076] In addition, if in order to improve the test efficiency, the folding screen can be placed in an incubator for a bending reliability test. In this way, although the high and low temperature environments can be set through the incubator, which is beneficial to quickly reducing the viscosity of the glue and shortening the bending time, however, when the folding screen is in the incubator, it is even more impossible for the human eye to observe the layering phenomenon. If a fixed number of bends is used, it is even more impossible to accurately estimate the service life of the folding screen.

[0077] If the estimated service life of the folding screen is inaccurate, after the folding screen leaves the factory, the folding screen is prone to layering, affecting the user experience.

[0078] In view of this, the embodiments of the present application provide a detection method for a folding screen, a detection system for a folding screen, and related devices. During the bending process of the folding screen, an image including the folding screen is collected through a camera, and edge detection is performed on the image to obtain the edge line of the folding screen. If the distance between two edge lines in the edge line of the folding screen is greater than a threshold, it indicates that the folding screen has a layering phenomenon and a fault occurs. In this way, it is not necessary to observe manually, which is beneficial to detecting the phenomenon of the folding screen having a fault.

[0079] By using the method provided in the embodiments of the present application, the folding screen failure can be accurately identified, the number of bends of the folding screen at the time of folding screen failure can be recorded, and the life of the folding screen can be estimated using the number of bends.

[0080] Before introducing the detection method provided in the embodiments of the present application, the detection system provided in the embodiments of the present application will be introduced first.

[0081] The detection system provided in the embodiments of the present application may include a folding screen to be tested, a bendable fixture, a camera, and a server. Among them, the folding screen to be tested is fixed on the bendable fixture. When the bendable fixture bends, it can drive the folding screen to be tested to bend. When the bendable fixture unfolds, it can drive the folding screen to be tested to unfold. When the bendable fixture bends repeatedly, it can drive the folding screen to be tested to bend repeatedly.

[0082] The camera can be placed on the side of the folding screen to be tested and in the same plane as the middle bending area of the folding screen to be tested. This placement is because when the folding screen to be tested has a delamination phenomenon, it is not easy to detect from the front of the folding screen to be tested due to the occlusion of the surface material of the folding screen to be tested, while there is no occlusion on the side, and the delamination phenomenon can be well observed from the side. The camera can collect an image including the side of the folding screen to be tested. When the folding screen to be tested has a delamination, the camera can collect an image of the folding screen to be tested as shown in the above Figure 3 、 Figure 4 or Figure 5 The server can control the bendable fixture to bend repeatedly to control the folding screen to be tested to bend repeatedly. The server is connected to the camera through an interface, can control the camera to collect images, and obtain the images collected by the camera. The detection method provided in the embodiments of the present application is deployed in the server, and the detection method provided in the embodiments of the present application can be used to monitor the images. When a delamination phenomenon is detected, the number of bends of the folding screen to be tested and the time when the delamination phenomenon appears are output. Among them, the time when the delamination phenomenon appears can be the duration from the start of bending to the appearance of the delamination phenomenon.

[0083] In some examples, when the server controls the folding screen to be tested to bend repeatedly through the bendable fixture, it can control the camera to collect images in real time. The camera can transmit the images during the bending process of the folding screen to be tested to the server. The server can use the detection method provided in the embodiments of the present application to monitor the images during the bending process in real time.

[0084]

[0085] ​In a possible implementation, the specific process of repeatedly bending the folding screen to be tested can be as follows: the folding screen to be tested is bent after waiting for a period of time in the unfolded state, and the folding screen to be tested is unfolded after waiting for a period of time in the folded state, and so on. Among them, the duration of waiting in the unfolded state of the folding screen to be tested and the duration of waiting in the folded state can be the same or different, and the embodiments of the present application do not limit this.

[0086] Exemplarily, Figure 6 shows a schematic diagram of side monitoring when a folding screen is in the unfolded state. As Figure 6 shown, the detection system of the folding screen includes a folding screen 601 to be tested, a camera 602, an interface device 603, a server 604, and a bendable fixture. Among them, the bendable fixture is not shown in the figure. The camera 602 is placed on the side of the folding screen 601 to be tested and is on the same plane as the folding screen to be tested. The folding screen 601 to be tested is in the unfolded state.

[0087] The camera 602 is connected to the server 604 through the interface device 603. The interface device 603 can include one or more interfaces. When the interface device 603 includes multiple interfaces, the interface device 603 can be used to connect to multiple cameras. In this way, the detection system can test multiple folding screens to be tested at the same time, which is beneficial to improving the test efficiency.

[0088] The server 604 can be a device with relatively large computing power. The server 604 can be electrically connected to the bendable fixture to control the folding screen to be tested to bend through the bendable fixture. Exemplarily, Figure 7 shows a schematic diagram of side monitoring when a folding screen is in the folded state. As Figure 7 shown, the folding screen 601 to be tested is in the folded state. Others are Figure 6 the same as above and will not be elaborated here.

[0089] In the case where the folding screen to be tested is repeatedly bent, the server 604 can obtain the images collected by the camera 602 and monitor the images collected by the camera 602.

[0090] In some other examples, the detection system can include a control device. When the control device controls the folding screen to be tested to be repeatedly bent through the bendable fixture, the server can control the camera to collect images in real time. The camera can transmit the images during the bending process of the folding screen to be tested to the server. The server can use the detection method provided by the embodiments of the present application to monitor the images during the bending process in real time.

[0091] The detection system shown above is an example. In another example, an embodiment of the present application further provides a detection system, which may include a folding screen to be tested, a bendable fixture, a camera, and an electronic device with processing capabilities. The electronic device may be a device such as a computer or a tablet, and the embodiments of the present application do not limit this.

[0092] The electronic device can control the bendable fixture to bend repeatedly to control the folding screen to be tested to bend repeatedly. The electronic device can also control the camera to collect images and obtain the images collected by the camera. The detection method provided by the embodiments of the present application is deployed in the electronic device, and the detection method provided by the embodiments of the present application can be used to monitor the images. When a delamination phenomenon is detected, it is determined that the folding screen to be tested is faulty.

[0093] In some implementations, the electronic device may include a camera, and the camera can be used to collect images.

[0094] It can be understood that both the electronic device and the server can be referred to as processing devices.

[0095] Next, taking the server as the execution entity, the detection method of the folding screen provided by the embodiments of the present application will be introduced in detail.

[0096] Exemplarily, Figure 8 shows a schematic flowchart of a detection method for a folding screen provided by an embodiment of the present application. As Figure 8 shown, the method may include the following steps:

[0097] S801. Obtain the current frame image and the previous frame image of the current frame image.

[0098] If the current frame image is the first frame image collected by the camera, there is no previous frame image, and subsequent processing may not be performed.

[0099] If the current frame image is not the first frame image collected by the camera, there is a corresponding previous frame image, and the server can obtain the current frame image and the previous frame image.

[0100] Since the folding screen includes multiple materials, it has a certain thickness. In the embodiments of the present application, the folding screen is taken as a cuboid as an example for illustration. The camera takes pictures on the side of the folding screen, and the collected images may include the side of the folding screen.

[0101] Combined with Figure 9 the images collected by the camera will be described.

[0102] As Figure 9As shown in a of, the folding screen is a cuboid, including a front face, a back face, a left side face, a right side face, an upper face, and a lower face. Among them, the lower face includes a folding axis. When the folding screen is folded, the lower face can be folded as the folding axis rotates. The thickness, width, and height of the folding screen can Figure 9 be as shown in a of.

[0103] In order to detect whether the folding screen is delaminated, a camera can be used to take an image of the folding screen from an angle facing the left side face or the right side face. As Figure 9 shown in a of, the camera can take an image of the folding screen from an angle facing the right side face.

[0104] If the folding screen fails, the folding screen is not a cuboid. As Figure 9 shown in b of, the upper face of the folding screen bulges. If the folding screen includes Material 1, Material 2, Material 3, and Material 4, delamination may occur between two layers of materials. When the camera takes a picture from the direction of the right side face, an image as shown in Figure 9 c of can be obtained.

[0105] As Figure 9 shown in c of, Material 4 and Material 1 of the folding screen are the surfaces of the folding screen, and Material 2 and Material 3 are the interiors of the folding screen. Delamination may occur between Material 4 and Material 3 inside the folding screen, resulting in a folding screen failure. The image of the current frame obtained by the server can be as shown in Figure 9 c of.

[0106] When the folding screen is bent, it is bent after waiting for a period of time in the unfolded state, and the folding screen is unfolded after waiting for a period of time in the folded state, and so on. When waiting in the unfolded state or the folded state, more images can be collected. These images are all the same, and the processing results are the same. If processed sequentially, the detection efficiency will be reduced. Therefore, the server can determine whether the folding screen is in the bending process based on two frames of images. If the two frames of images are the same or similar, subsequent processing can be skipped. If there are differences between the two frames of images, subsequent processing can continue.

[0107] In the embodiment of the present application, it is possible to determine whether the folding screen is in the bending process by the average brightness of two frames of images.

[0108] S802. Calculate the average brightness of the two frames of images respectively.

[0109] The server calculates the average brightness of the current frame image and calculates the average brightness of the previous frame image.

[0110] S803. Determine whether the difference in the average brightness of the two frames of images is greater than the brightness threshold.

[0111] In some examples, the server can analyze whether the average brightness of two frames of images is greater than the brightness threshold based on inter-frame interpolation. If the inter-frame interpolation is relatively small, the difference in the average brightness of the two frames of images is less than or equal to the brightness threshold, indicating that the folding screen is in a stationary state (i.e., the unfolded state or the folded state) and is not in the bending process. If the inter-frame interpolation is relatively large, the difference in the average brightness of the two frames of images is greater than the brightness threshold, indicating that the folding screen is in the bending process.

[0112] S804. If the difference in the average brightness of two frames of images is greater than the brightness threshold, obtain the region of interest (ROI) from the current frame image.

[0113] The positions where delamination is likely to occur in the folding screen are the folding axis of the folding screen and the area near the folding axis. In the embodiments of the present application, the folding axis of the folding screen and the area near the folding axis are used as the ROI, and this area is monitored keyly.

[0114] Exemplarily, the current frame image can refer to Figure 10 a in, and by obtaining the ROI from the current frame image, b in Figure 10 can be obtained. The server can find the pixels of the folding screen in the current frame image, and then remove the pixels outside the ROI from the pixels of the folding screen to obtain the ROI.

[0115] In this way, detecting the ROI can reduce the detection area compared with detecting the entire folding screen, which is beneficial to improving the processing efficiency. At the same time, it is beneficial to reduce the influence of abnormal disturbances in the area outside the ROI.

[0116] If the difference in the average brightness of two frames of images is less than or equal to the brightness threshold, the folding screen is not in the bending process. The server can discard this frame of image and obtain the next frame of image collected by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame image and execute the above S801.

[0117] S805. Determine whether there are differences between the upper and lower regions of the ROI in the current frame image.

[0118] The upper and lower regions of the ROI are used to represent the upper region and the lower region of the ROI. The upper region of the ROI is the region composed of the pixels above the ROI pixels in the current frame image, and the lower region of the ROI is the region composed of the pixels below the ROI pixels in the current frame image.

[0119] After the server obtains the ROI, it can obtain the image including the ROI. The server can compare the pixels above the ROI pixels and the pixels below the ROI pixels in the image including the ROI to determine whether there are differences. In this way, testing the background of the ROI region is beneficial to determining whether there is stray light influence in the background.

[0120] If there are differences in the upper and lower regions of the ROI, it indicates that there is stray light interference. If hierarchical monitoring is performed based on such an image, the monitoring accuracy is relatively low. Therefore, the server can discard this frame of image and obtain the next frame of image collected by the camera, that is, execute S816. After the server obtains the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0121] S806. If there are no differences in the upper and lower regions of the ROI, noise reduction processing is performed.

[0122] The server can perform noise reduction processing on the image including the ROI. In this way, it is beneficial to remove the influence of noise and further beneficial to improving the subsequent monitoring accuracy.

[0123] The noise reduction method used by the server can be related to the performance of the camera. Among them, the performance of the camera can include parameters such as exposure, signal-to-noise ratio, and sensitivity.

[0124] In some examples, the server can use Gaussian filtering for noise reduction processing.

[0125] S807. Perform edge detection on the image after noise reduction processing.

[0126] Performing edge detection on the image after noise reduction processing is beneficial to obtaining the edge information of the ROI.

[0127] In some examples, the server can perform Canny edge detection on the image after noise reduction processing.

[0128] The non-existence of differences in the upper and lower regions of the above ROI is also beneficial to reducing the influence on edge detection.

[0129] S808. Find the non-zero point positions in the image after edge detection.

[0130] The non-zero point positions can be used to represent the edges identified through edge detection. There are many edges in the image after edge detection. The server can find the non-zero point positions in the image after edge detection to obtain these edges. In some examples, the non-zero point positions can also be called non-zero point edge points.

[0131] S809. Calculate the edge continuity.

[0132] After the server obtains these edges, it can calculate whether these edges are continuous. If these edges are continuous, they may be the edges of the ROI. If these edges are discontinuous, they are probably not the edges of the ROI, and there may be noise or pseudo-edges.

[0133] In some examples, if the distance between the endpoints of two edges is less than or equal to a preset distance, it can be stated that these two edges are continuous. If the distance between the endpoints of two edges is greater than the preset distance, it can be stated that these two edges are discontinuous.

[0134] If the edges are discontinuous, these edges can be removed to reduce the impact on subsequent processing.

[0135] S810. If the edges are continuous, determine whether the edge length is greater than the length threshold.

[0136] If the edge length is greater than the length threshold, it can be stated that the edge may be the edge of the ROI. If the edge length is less than or equal to the length threshold, it can be stated that the edge is probably not the edge of the ROI, and the server can remove the edge to reduce the impact on subsequent processing. Among them, the length threshold can be calibrated through experiments, and the embodiments of the present application do not limit this. In some examples, the length threshold may be positively correlated with the number of pixels occupied by the width of the folding screen in the image.

[0137] If the lengths of all edges in the image are less than or equal to the length threshold, or there is an edge with a length greater than the length threshold, it indicates that the edge of the ROI has not been accurately identified. The server can discard this frame of image and obtain the next frame of image collected by the camera, that is, execute S816. After the server obtains the next frame of image, the next frame of image can be used as the current frame of image, and the above S801 can be executed.

[0138] If there are at least two edges in the image whose lengths are both greater than the length threshold, the server can continue to determine whether these at least two edges are the edges of the ROI and can execute S811.

[0139] S811. When the edge length is greater than the length threshold, obtain the starting points and ending points of the upper edge line and the lower edge line in the image.

[0140] When there are at least two edges whose lengths are greater than the length threshold, determine whether the distance between any two of the at least two edges is greater than the thickness of the folding screen. Among them, the thickness of the folding screen is used to represent the thickness of the material composition included in the folding screen.

[0141] If the distance between the lengths of two edges among at least two edges is less than or equal to the thickness of the folding screen, it can be stated that these two edges are relatively close, and the probability of delamination occurring between these two edges is relatively small. If the distance between the lengths of any two edges among at least two edges is less than the thickness of the folding screen, it indicates that any two edges are relatively close, then there is no need to obtain the starting points and ending points of the upper edge line and the lower edge line in the image. The server can discard this frame of image and acquire the next frame of image captured by the camera, that is, execute S816. After the server acquires the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0142] If the distance between the lengths of two edges among at least two edges is greater than the thickness of the folding screen, the probability of delamination occurring between these two edges is relatively large, then obtain the starting points and ending points of the upper edge line and the lower edge line among these edges. In the vertical direction, the position of the pixel points of the lower edge line is greater than the position of the pixels of the upper edge line. S812. Determine whether the starting points and ending points of the upper edge line and the lower edge line are on both sides of the center of the folding screen.

[0143] If the starting point and ending point of the upper edge line are on both sides of the center of the folding screen, it indicates that the upper edge line is probably the edge line of the ROI region. If the starting point and ending point of the lower edge line are on both sides of the center of the folding screen, it indicates that the lower edge line is probably the edge line of the ROI region.

[0144] If the starting point and ending point of the upper edge line are not on both sides of the center of the folding screen, it indicates that the upper edge line is probably not the edge line of the ROI region. The server discards this frame of image and acquires the next frame of image captured by the camera, that is, execute S816. After the server acquires the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0145] If the starting point and ending point of the lower edge line are not on both sides of the center of the folding screen, it indicates that the lower edge line is probably not the edge line of the ROI region. The server discards this frame of image and acquires the next frame of image captured by the camera, that is, execute S816. After the server acquires the next frame of image, it can use the next frame of image as the current frame of image and execute the above S801.

[0146] S813. If both are on both sides of the center of the folding screen, then calculate the distance between the two edge lines.

[0147] If both are on both sides of the center of the folding screen, it indicates that the edge lines of the appropriate ROI have been detected. The server can respectively obtain the highest points of the two lines and calculate the distance between the two lines based on the vertical distance between the highest points of the two lines.

[0148] S814. Determine whether the distance between the two lines is greater than the distance threshold.

[0149] Exemplarily, as shown in Figure 10 c, the upper edge line and the lower edge line are represented by short dashed lines, and it is determined whether the distance l between the two lines is greater than the distance threshold.

[0150] S815. If the distance is greater than the distance threshold, delamination occurs.

[0151] The distance threshold can be greater than the distance formed by the number of pixels occupied by the thickness of the folding screen in the image, and can be positively correlated with the size of the image. Exemplarily, if the size of the image is m*n, the distance threshold can be n / 5. n / 5 is greater than the distance formed by the number of pixels occupied by the thickness of the folding screen in the image.

[0152] If the distance is greater than the distance threshold, it indicates that delamination occurs, and the folding screen failure can be determined. If the distance is less than or equal to the distance threshold, it indicates that delamination does not occur, and the server continues to monitor, that is, repeats the above process.

[0153] If delamination occurs, the above Figure 3 , Figure 4 or Figure 5 shown delamination types may occur. Figure 2 The edge detection map of the delamination type shown can be as shown in Figure 10 c. Figure 3 The edge detection map of the delamination type shown can be as shown in Figure 11 shown. Figure 4 The edge detection map of the delamination type shown can be as shown in Figure 12 shown.

[0154] S816. In any of the following cases, obtain the next frame of image: there are differences in the upper and lower regions of the ROI region; there are no two edge lines in the image with lengths greater than the length threshold; the starting and ending points of the upper edge line or the lower edge line are not on both sides of the center of the folding screen; the distance between the upper edge line and the lower edge line is less than the distance threshold.

[0155] The detection method of the folding screen provided by the embodiments of the present application performs edge detection on the image collected by the camera. If the distance between two edge lines in the image is greater than the distance threshold, it can be determined that delamination occurs in the folding screen to be detected. To improve the detection accuracy, these two edge lines can be continuous, both with lengths greater than the length threshold, and the starting and ending points of the edge lines are on both sides of the center of the folding screen. In this way, the probability that these two edge lines are the lines of the folding screen to be detected is relatively high.

[0156] The method provided by the embodiments of the present application can be applied to estimate the lifespan of the folding screen and compare the bending abilities of different materials. The method provided by the embodiments of the present application can also be applied to analyze the stress situation during the bending process of the folding screen, the screen shifting situation caused by bending, and the force analysis.

[0157] An example provided by an embodiment of the present application is described in detail above. Another example provided by the embodiment of the present application will be introduced below.

[0158] Exemplarily, Figure 13 A schematic flowchart of a detection method for a folding screen provided by an embodiment of the present application is shown. The folding screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotating shaft. The distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotating shaft rotates.

[0159] As Figure 13 shown, the method may include the following steps:

[0160] S1301. Obtain a first image, where the first image includes an image of the folding screen taken from an angle facing the third surface or the fourth surface. The first surface and the second surface are not visible in the first image, and the tangent plane of the first surface forms a first edge of the first image, and the tangent plane of the second surface forms a second edge of the first image.

[0161] The first image may refer to the current frame image shown above. Figure 8 Obtaining the first image may refer to S801 above, which will not be elaborated here.

[0162] S1302. Perform edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image.

[0163] Before performing edge detection on the first image, S801 to S806 may be executed, or a part of them may be executed or none of them may be executed. The embodiment of the present application does not limit this. When performing edge detection on the first image, the obtained first edge line and second edge line may include some steps or all steps of S808 to S812. The embodiment of the present application does not limit this.

[0164] S1303. When there are pixel points with a distance greater than a distance threshold in the target direction between the first edge line and the second edge line, determine that the folding screen is faulty, where the target direction is the direction of longitudinally cutting the first edge line and the second edge line.

[0165] This step may refer to S814 above, which will not be elaborated here.

[0166] In this way, when there are pixel points with a distance in the target direction greater than the distance threshold between the first edge line and the second edge line, it is determined that the folding screen is faulty, which is conducive to detecting the phenomenon of the folding screen malfunctioning. Compared with manual observation, it is conducive to improving the detection efficiency and the detection accuracy.

[0167] Optionally, performing edge detection on the first image to obtain the first edge line of the first edge in the first image and the second edge line of the second edge in the first image includes: performing edge detection on the first image to obtain multiple edge lines; if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, then obtain the first edge line and the second edge line. This step can refer to the above S810. In this way, it is conducive to improving the recognition accuracy.

[0168] Optionally, if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, then obtaining the first edge line and the second edge line includes: if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, and both of the two edge lines are distributed on both sides of the center line of the third surface or the fourth surface, then obtain the first edge line and the second edge line. This step can refer to the above S811 and S812. In this way, it is conducive to accurately identifying the first edge line and the second edge line.

[0169] Optionally, before if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, then obtaining the first edge line and the second edge line, the method further includes: if there are discontinuous edge lines among the multiple edge lines, then delete the discontinuous edge lines among the multiple edge lines; if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, then obtaining the first edge and the second edge includes: if there are two edge lines among the edge lines other than the discontinuous edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, then obtain the first edge line and the second edge line.

[0170] This step can refer to the above S809. In this way, it is more conducive to accurately identifying the first edge line and the second edge line.

[0171] Optionally, performing edge detection on the first image includes: in the first image, removing the pixel points other than the pixel points in the first region from the pixel points corresponding to the third surface or the fourth surface, where the center line of the first region intersects the rotation axis; performing edge detection on the second image.

[0172] This step can refer to the above S804. In this way, it is conducive to improving the processing efficiency of the image.

[0173] Optionally, edge detection is performed on the second image, including: if there is a difference between the second region and the third region in the second image, edge detection is performed on the second image, where the coordinates of the pixels included in the second region in the target direction are greater than the coordinates of the pixels included in the first region in the target direction, and the coordinates of the pixels included in the third region in the target direction are less than the coordinates of the pixels included in the first region in the target direction.

[0174] This step can refer to the above S805. In this way, it is beneficial to reduce the influence of background stray light on edge detection.

[0175] Optionally, edge detection is performed on the first image, including: obtaining a third image, where the third image is the previous frame image of the first image; if the difference between the average brightness of the third image and the average brightness of the first image is greater than the brightness threshold, edge detection is performed on the first image.

[0176] This step can refer to the above S802 and S803. In this way, it is beneficial to improve the image processing efficiency.

[0177] Optionally, the first image is taken during the repeated folding process of the folding screen; the method further includes: in the case of a folding screen failure, recording the number of bends of the folding screen. If the folding screen fails, recording the number of bends of the folding screen is convenient for subsequent estimation of the life of the folding screen.

[0178] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions, and corresponding operation entrances are provided for the user to choose to authorize or refuse.

[0179] The detection method of the folding screen in the embodiments of the present application has been described above. Next, the device for executing the above method provided by the embodiments of the present application will be described. Those skilled in the art can understand that the method and the device can be combined and cited with each other, and the relevant device provided by the embodiments of the present application can execute the steps in the above detection method of the folding screen.

[0180] Figure 14 It is a schematic structural diagram of a chip provided by an embodiment of the present application. As Figure 14 shown, the chip 140 includes one or more than two (including two) processors 1401, a communication line 1402, a communication interface 1403, and a memory 1404.

[0181] In some embodiments, the memory 1404 stores the following elements: executable modules or data structures, or subsets thereof, or extended sets thereof.

[0182] The method for handling network lag described in the embodiments of the present application above can be applied to or implemented by the processor 1401. The processor 1401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the method for handling network lag above can be completed by the integrated logic circuit in the hardware of the processor 1401 or instructions in software form. The above-mentioned processor 1401 may be a general-purpose processor (e.g., a microprocessor or a conventional processor), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate, transistor logic devices, or discrete hardware components. The processor 1401 can implement or execute various processing-related methods, steps, and logic block diagrams disclosed in the embodiments of the present application.

[0183] The steps of the method for handling network lag disclosed in combination with the embodiments of the present application can be directly implemented by the hardware decoding processor or implemented by a combination of hardware and software modules in the decoding processor. Among them, the software module can be located in mature storage media in the art such as random access memory, read-only memory, programmable read-only memory, or electrically erasable programmable read-only memory (EEPROM). This storage medium is located in the memory 1404, and the processor 1401 reads the information in the memory 1404 and combines its hardware to complete the steps of the above method.

[0184] Communication can be carried out between the processor 1401, the memory 1404, and the communication interface 1403 through the communication line 1402.

[0185] In the above embodiments, the instructions stored in the memory for the processor to execute can be implemented in the form of a computer program product. Among them, the computer program product can be pre-written in the memory or downloaded and installed in the memory in software form.

[0186] The method for detecting a folding screen provided by the embodiments of the present application can be applied to an electronic device with communication functions. The electronic device includes a terminal device, and the specific device form of the terminal device and the like can refer to the above relevant description and will not be elaborated here.

[0187] An embodiment of the present application provides a terminal device, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the terminal device to execute the above-mentioned fault handling method.

[0188] An embodiment of the present application provides a chip. The chip or chip system is applied to an electronic device. The chip or chip system includes at least one or more processors, and the one or more processors are used to call computer instructions to execute the fault handling method in the above-mentioned embodiment. Its implementation principle and technical effects are similar to those of the above-related embodiments, and will not be elaborated here.

[0189] An embodiment of the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program or instructions. When the computer program or instructions are executed by an electronic device, the above-mentioned fault handling method is implemented. The fault handling method described in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. The computer-readable medium can include a computer storage medium and a communication medium, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0190] In a possible implementation, the computer-readable medium may include RAM, ROM, a compact disc read-only memory (CD-ROM), or other optical disc memories, magnetic disk memories, or other magnetic storage devices, or any other medium targeted at carrying or storing the required program code in the form of instructions or data structures and accessible by a computer. Moreover, any connection is properly referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of the medium. As used herein, disk and optical disc include optical disc, laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc, where disks typically reproduce data magnetically, while optical discs utilize lasers to optically reproduce data. The above combinations should also be included within the scope of the computer-readable medium.

[0191] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program code runs on an electronic device, the electronic device is caused to execute the above-mentioned fault handling method.

[0192] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable devices to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing devices generate means for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0193] In the above specific embodiments, the purpose, technical solution, and beneficial effects of the present invention have been further described in detail. It should be understood that the above are only specific embodiments of the present invention and are not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made on the basis of the technical solution of the present invention should be included in the protection scope of the present invention.

Claims

1. A detection method for a folding screen, characterized in that, The folding screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotating shaft. The distance between the first surface and the second surface is the thickness of the folding screen. The distance between the third surface and the fourth surface is the width or height of the folding screen. The first surface is the foldable surface of the folding screen. When the folding screen is folded, the foldable surface is folded as the rotating shaft rotates. The method includes: Obtain a first image, where the first image includes an image of the folding screen taken from an angle facing the third surface or the fourth surface. The first surface and the second surface are not visible in the first image, and the tangent plane of the first surface forms a first edge of the first image, and the tangent plane of the second surface forms a second edge of the first image. Perform edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image. In the case where there are pixel points with a distance greater than a distance threshold in the target direction between the first edge line and the second edge line, determine that the folding screen is faulty. The target direction is the direction perpendicular to the first edge line and the second edge line.

2. The method according to claim 1, wherein The performing edge detection on the first image to obtain a first edge line of the first edge in the first image and a second edge line of the second edge in the first image includes: Perform edge detection on the first image to obtain multiple edge lines. If there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, obtain the first edge line and the second edge line.

3. The method according to claim 2, wherein The if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, obtain the first edge line and the second edge line includes: If there are two edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, and the two edge lines are both distributed on both sides of the center line of the third surface or the fourth surface, obtain the first edge line and the second edge line.

4. The method according to claim 2 or 3, characterized in that, Before the if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, obtain the first edge line and the second edge line, the method further includes: If there are discontinuous edge lines among the multiple edge lines, delete the discontinuous edge lines among the multiple edge lines. The if there are two edge lines among the multiple edge lines whose lengths are greater than or equal to a length threshold, obtain the first edge and the second edge includes: If there are two edge lines among the edge lines other than the discontinuous edge lines among the multiple edge lines whose lengths are greater than or equal to the length threshold, obtain the first edge line and the second edge line.

5. The method according to any one of claims 1 to 4, characterized in that The performing edge detection on the first image includes: In the first image, remove the pixel points corresponding to the third surface or the fourth surface except those within the first region, where the center line of the first region intersects the rotation axis, to obtain a second image. Perform edge detection on the second image.

6. The method according to claim 5, characterized in that, The performing edge detection on the second image includes: If there are differences between a second region and a third region in the second image, perform edge detection on the second image, where the pixels included in the second region have coordinate values in the target direction greater than those of the pixels included in the first region, and the pixels included in the third region have coordinate values in the target direction less than those of the pixels included in the first region.

7. The method according to any one of claims 1 to 6, characterized in that, The performing edge detection on the first image includes: Obtain a third image, where the third image is the previous frame image of the first image. If the difference between the average brightness of the third image and the average brightness of the first image is greater than a brightness threshold, perform edge detection on the first image.

8. The method according to any one of claims 1 to 7, characterized in that The first image is captured during the repeated folding process of the folding screen. The method further includes: In the case of a folding screen failure, record the number of bends of the folding screen.

9. A detection system for a foldable screen, characterized in that, including: A photographing device, a processing device, and the folding screen; the folding screen includes a first surface, a second surface, a third surface, a fourth surface, and a rotation axis, the distance between the first surface and the second surface is the thickness of the folding screen, the distance between the third surface and the fourth surface is the width or height of the folding screen, the first surface is the foldable surface of the folding screen, and when the folding screen is folded, the foldable surface is folded as the rotation axis rotates. The photographing device is configured to capture an image of the folding screen from an angle facing the third surface or the fourth surface. The processing device is configured to execute the method according to any one of claims 1 to 8.

10. The detection system according to claim 9, wherein The detection system further includes an interface device for connecting the photographing device and the processing device.

11. An electronic device, characterized in that, The electronic device includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is configured to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the electronic device to execute the method according to any one of claims 1 to 8.

12. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system includes one or more processors, and the one or more processors are configured to call computer instructions to cause the electronic device to execute the method according to any one of claims 1 to 8.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions, and when the computer instructions run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 8.

14. A computer program product, characterized in that, The computer program product includes computer program code, and when the computer program code runs on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 8.

Images