Screen fault detection method and electronic equipment

Abstract

The invention discloses a screen fault detection method and electronic equipment. The method can be applied to first electronic equipment with image processing capability, such as a notebook computer, a tablet computer and the like. The method comprises the following steps: a first electronic device receives a plurality of video frames from a high-speed camera, wherein the plurality of video frames are obtained by continuously shooting images displayed by a second electronic device by the high-speed camera; performing gray processing on the plurality of video frames to obtain a plurality of video frames after gray processing; determining the similarity between every two adjacent video frames in the plurality of video frames after gray processing; and based on the similarity between every two adjacent video frames, determining whether the screen of the second electronic equipment for displaying the image has a splash screen fault or not. By adopting the method, when fault detection is carried out on the screen of the image displayed by the second electronic equipment, the omission ratio can be reduced.

Description

Technical Field

[0001] This application relates to the field of terminals, and in particular, to a method for detecting screen faults and an electronic device. Background Art

[0002] The display screen (or screen) of an electronic device is the direct medium for interaction between the user and the content. However, when the display screen of the electronic device displays a picture, problems such as black screens, colored screens, and flashing screens often occur, which results in a poor user experience. Therefore, it is necessary to detect the display screen in a timely manner to discover display problems and solve them in a timely manner.

[0003] Currently, when a test device (denoted as the first electronic device) detects a screen fault of a device under test (denoted as the second electronic device), it can first obtain the image displayed by the second electronic device collected by a high-speed camera (denoted as Image 1), and the image of its own display captured by the second electronic device using a screenshot software (denoted as Image 2). Then, compare Image 1 and Image 2 to determine whether the screen of the second electronic device has a flashing screen fault. In this way, there is a high false negative rate when the first electronic device detects the flashing screen fault of the second electronic device due to the low screenshot rate of the second electronic device.

[0004] Therefore, when detecting a flashing screen fault of the screen of the second electronic device, how to reduce the false negative rate has become an urgent problem to be solved. Summary of the Invention

[0005] An embodiment of this application provides a method for detecting screen faults and an electronic device, which can reduce the false negative rate when detecting a flashing screen fault of the screen of the second electronic device.

[0006] In a first aspect, an embodiment of this application provides a method for detecting screen faults, which is applied to a first electronic device. The method includes: receiving a plurality of video frames from a high-speed camera, where the plurality of video frames are obtained by continuously shooting the image displayed by the second electronic device by the high-speed camera; performing grayscale processing on the plurality of video frames respectively to obtain the plurality of video frames after grayscale processing; determining the similarity between every two adjacent video frames among the plurality of video frames after grayscale processing; and determining whether the screen of the image displayed by the second electronic device has a flashing screen fault based on the similarity between every two adjacent video frames.

[0007] After implementing the method provided in the first aspect, when the first electronic device detects a screen flashing fault on the screen of the second electronic device displaying an image, it can determine whether there is a screen flashing phenomenon on the screen of the second electronic device displaying the image based on the similarity between adjacent two video frames among multiple video frames continuously captured by a high-speed camera of the second electronic device. In this way, compared with the method of the first electronic device determining whether there is a screen flashing fault on the second electronic device by comparing the image captured by the high-speed camera of the second electronic device with the image captured by the second electronic device itself using the screenshot software, there is no need for the second electronic device to take a screenshot to obtain the displayed image, thereby reducing the missed detection rate when detecting the screen flashing fault on the screen of the second electronic device displaying the image.

[0008] Combined with the first aspect, in an alternative embodiment, determining the similarity between every two adjacent video frames among the multiple video frames after grayscale processing includes: determining the hash value of each video frame among the multiple video frames after grayscale processing; and determining the similarity between every two adjacent video frames based on the hash value of each video frame.

[0009] Combined with the first aspect, in an alternative embodiment, determining whether there is a screen flashing fault on the screen of the second electronic device displaying the image based on the similarity between every two adjacent video frames includes: selecting the first two similarities from the similarities between every two adjacent video frames according to the selection order from large to small similarity; in the case where it is determined that both the first two similarities are greater than a preset similarity threshold and the absolute value of the difference between the ratio of the first two similarities and 1 is less than or equal to a preset threshold, determining that there is a screen flashing fault on the screen of the second electronic device displaying the image; in the case where it is determined that the similarity between every two adjacent video frames is less than or equal to the preset similarity threshold, or the absolute value of the difference between the ratio of the first two similarities and 1 is greater than the preset threshold, determining that there is no screen flashing fault on the screen of the second electronic device displaying the image.

[0010] Combined with the first aspect, in an alternative embodiment, the method further includes: determining the normalized brightness value of each video frame among the multiple video frames after grayscale processing; and determining whether there is a black screen fault on the screen of the second electronic device displaying the image based on the normalized brightness value of each video frame.

[0011] After implementing the method provided by this embodiment, the first electronic device can perform black screen fault detection on the screen of the second electronic device's displayed image based on the normalized brightness value of each video frame after grayscale processing. Compared with the method in which the first electronic device determines whether the second electronic device has a black screen fault by comparing the image captured by the high-speed camera with the image captured by the second electronic device itself using the screenshot software, there is no need for the second electronic device to take a screenshot to obtain the displayed image, thereby reducing the missed detection rate when performing black screen fault detection on the screen of the second electronic device's displayed image.

[0012] In combination with the first aspect, in an optional embodiment, determining whether the screen of the second electronic device's displayed image has a black screen fault based on the normalized brightness value of each video frame includes: when it is determined that any one of the normalized brightness values in each video frame is less than a preset normalized brightness threshold, determining that the screen of the second electronic device's displayed image has a black screen fault; when it is determined that the normalized brightness value of each video frame is greater than or equal to the preset normalized brightness threshold, determining that the screen of the second electronic device's displayed image does not have a black screen fault.

[0013] In combination with the first aspect, in an optional embodiment, the method further includes: determining the no-reference result sharpness (NRSS) value of each video frame among the multiple video frames after grayscale processing; and determining whether the screen of the second electronic device's displayed image has a color screen fault based on the NRSS value of each video frame.

[0014] After implementing the method provided by this embodiment, the first electronic device can perform color screen fault detection on the screen of the second electronic device's displayed image based on the NRSS value of each video frame after grayscale processing. Compared with the method in which the first electronic device performs color screen fault detection on the screen of the second electronic device's displayed image based on the block variance of each video frame, it is possible to reduce the influence of non-color screen content, such as edge textures, on the block variance of the video frame, thereby reducing the false detection rate when performing color screen fault detection on the screen of the second electronic device's displayed image.

[0015] In combination with the first aspect, in an optional embodiment, determining whether the screen of the second electronic device's displayed image has a color screen fault based on the NRSS value of each video frame includes: when it is determined that any one of the NRSS values in each video frame is greater than a preset NRSS threshold, determining that the screen of the second electronic device's displayed image has a color screen fault; when it is determined that the NRSS value of each video frame is less than or equal to the preset NRSS threshold, determining that the screen of the second electronic device's displayed image does not have a color screen fault.

[0016] In combination with the first aspect, in an optional implementation, the method further includes: determining the edge lines of each video frame after grayscale processing; and determining whether there is a moiré fault on the screen of the second electronic device based on the edge lines of each video frame.

[0017] After implementing the method provided in this implementation, the first electronic device can detect moiré faults on the screen of the second electronic device for displaying images based on the edge lines of each video frame after grayscale processing.

[0018] In combination with the first aspect, in an optional implementation, determining whether there is a moiré fault on the screen of the second electronic device based on the edge lines of each video frame includes: when it is determined that among the edge lines of each video frame, the luminance value of any one edge line is greater than a preset edge line luminance value, determining that there is a moiré fault on the screen of the second electronic device; and when it is determined that the luminance values of the edge lines in each video frame are all less than or equal to the preset edge line luminance value, determining that there is no moiré fault on the screen of the second electronic device.

[0019] In a second aspect, an embodiment of the present application provides a first electronic device, including: a touch screen, a camera, one or more processors, and one or more memories; the one or more processors are coupled to the touch screen, the camera, and the one or more memories, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the first electronic device is caused to execute the method as described in the first aspect or any optional implementation of the first aspect.

[0020] In a third aspect, the present application provides a chip system, which is applied to a first computing device. The chip system includes one or more processors, and the processors are used to call computer instructions to cause the first computing device to execute the method as described in the first aspect or any optional implementation of the first aspect.

[0021] In a fourth aspect, an embodiment of the present application provides a computer program product containing instructions. When the computer program product runs on a first electronic device, the first electronic device is caused to execute the method as described in the first aspect or any optional implementation of the first aspect.

[0022] In a fifth aspect, the present application provides a computer-readable storage medium, including instructions. When the instructions run on a first electronic device, the first electronic device is caused to execute the method as described in the first aspect or any optional implementation of the first aspect. Description of the Drawings

[0023] Figure 1It is a schematic diagram of an application scenario of a screen fault detection method provided by an embodiment of the present application;

[0024] Figure 2 It is a schematic flowchart of a screen fault detection method provided by an embodiment of the present application;

[0025] Figure 3 It is a schematic diagram of the process of a first electronic device determining the hash value of video frame 1 among multiple video frames after gray-scale processing;

[0026] Figure 4a It is a schematic diagram of a set of consecutive video frames after gray-scale processing provided by an embodiment of the present application;

[0027] Figure 4b It is provided by an embodiment of the present application Figure 4a In the shown consecutive video frame, it is a schematic diagram of the Hamming distance between every two adjacent video frames;

[0028] Figure 5 It is a schematic diagram of another screen fault detection method provided by an embodiment of the present application;

[0029] Figure 6 It is a schematic diagram of the process of a first electronic device determining the normalized brightness value of video frame 2 among multiple video frames after gray-scale processing;

[0030] Figure 7a It is a schematic diagram of a set of consecutive video frames after gray-scale processing provided by an embodiment of the present application;

[0031] Figure 7b It is provided by an embodiment of the present application Figure 7a In the shown consecutive video frame, it is a schematic diagram of the normalized brightness value of each video frame;

[0032] Figure 8 It is a schematic diagram of yet another screen fault detection method provided by an embodiment of the present application;

[0033] Figure 9 It is a schematic diagram of the process of a first electronic device determining the NRSS value of video frame 3 among multiple video frames after gray-scale processing;

[0034] Figure 10a It is a schematic diagram of a set of consecutive video frames after gray-scale processing provided by an embodiment of the present application;

[0035] Figure 10b It is provided by an embodiment of the present application Figure 10a In the shown consecutive video frame, it is a schematic diagram of the NRSS value of each video frame;

[0036] Figure 11It is a schematic flowchart of another screen fault detection method provided by an embodiment of the present application;

[0037] Figure 12 It is a schematic diagram of the process of a first electronic device determining the edge line of video frame 4 in multiple video frames after grayscale processing;

[0038] Figure 13a It is a schematic diagram of the result obtained by a first electronic device provided by an embodiment of the present application for detecting line break faults in a continuous video frame;

[0039] Figure 13b It is a schematic diagram of a video frame with line breaks marked provided by an embodiment of the present application;

[0040] Figure 14 It is a schematic diagram of the software architecture of a first electronic device provided by an embodiment of the present application;

[0041] Figure 15 It is a schematic diagram of the hardware structure of a first electronic device provided by an embodiment of the present application. Detailed implementation manners

[0042] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Referring to the embodiments herein means that the specific features, structures, or characteristics described in conjunction with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art can explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0043] In this application, the first electronic device may include, but is not limited to, a mobile phone with image processing capabilities, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device (such as a smart watch), a vehicle-mounted device, a smart home device, and / or a smart city device, etc. The embodiments of this application do not impose any special restrictions on the specific type of the first electronic device.

[0044] In this application, the second electronic device may include, but is not limited to, a mobile phone with a display screen, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device (such as a smart watch), a vehicle-mounted device, a smart home device, and / or a smart city device, etc. The embodiments of this application do not impose any special restrictions on the specific type of the second electronic device.

[0045] Taking the second electronic device being a mobile phone as an example, please refer to Table 1, which is a summary table of the frequently occurring display problems on the screens of mobile phones of different series provided by the embodiments of this application.

[0046] Table 1 Summary table of the frequently occurring display problems on the screens of mobile phones of different series

[0047]

[0048]

[0049] As can be seen from Table 1 above, the black flower screen flash is the most serious problem among the common display problems of the screen. The occurrence of the black flower screen flash problem on the screen is mostly probabilistic, and it is difficult to retain the problem scene, and it is difficult to reproduce, resulting in greater difficulty in analysis. Moreover, the occurrence of display problems on the screen will lead to a poor user experience. Therefore, it is necessary to detect the screen in a timely manner to discover display problems and solve them in a timely manner.

[0050] Currently, when the first electronic device detects the screen of the second electronic device for faults, it can first obtain the image displayed by the second electronic device collected by the high-speed camera (denoted as Image 1), and the image of its own display captured by the second electronic device using the screenshot software (denoted as Image 2). Then, compare Image 1 and Image 2 to determine whether the second electronic device has a screen flash fault. In this way, due to the low screenshot rate of the second electronic device, the missed detection rate of the first electronic device when detecting the screen flash fault of the second electronic device is relatively high.

[0051] To solve the above problems, an embodiment of the present application provides a screen fault detection method. This screen fault detection method can be applied to the first electronic device with image processing capabilities.

[0052] When implementing the screen fault detection method provided by the embodiment of the present application, when the first electronic device detects the screen flash fault of the image displayed by the second electronic device, it can determine whether the screen of the image displayed by the second electronic device has a screen flash phenomenon based on the similarity between adjacent two video frames among the multiple video frames obtained by continuously shooting the image displayed by the second electronic device by the high-speed camera.

[0053] Specifically, please refer to Figure 1 , Figure 1 is a schematic diagram of an application scenario of a screen fault detection method provided by an embodiment of the present application. As Figure 1 shown, the screen fault detection system includes a first electronic device 101, a high-speed camera 102, and a second electronic device 103. Among them, the first electronic device 101 can first receive multiple video frames from the high-speed camera 102, and the multiple video frames are obtained by continuously shooting the image displayed by the second electronic device 103 by the high-speed camera 102. Secondly, perform gray processing on the multiple video frames to obtain the multiple video frames after gray processing. Then, the first electronic device 101 can determine the similarity between every two adjacent video frames among the multiple video frames after gray processing. Finally, based on the similarity between every two adjacent video frames, determine whether the screen of the image displayed by the second electronic device 103 has a color screen fault.

[0054] Implementing the above screen fault detection method, compared with the method of determining whether the second electronic device has a screen flashing fault by comparing the image displayed by the second electronic device captured by the acquired high-speed camera with the image displayed by the second electronic device itself captured by the screenshot software of the second electronic device, there is no need for the second electronic device to capture the displayed image by taking a screenshot, thereby reducing the missed detection rate when detecting the screen flashing fault of the displayed image of the second electronic device.

[0055] The following provides a detailed introduction to the screen fault detection method provided by the embodiments of the present application.

[0056] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a screen fault detection method provided by the embodiments of the present application. This method can be executed by a first electronic device (such as Figure 1 the first electronic device 101 in Figure 2 ). As shown in

[0057] S201. The first electronic device receives multiple video frames from a high-speed camera, where the multiple video frames are obtained by continuously shooting the image displayed by the second electronic device with the high-speed camera.

[0058] S202. The first electronic device performs grayscale processing on the multiple video frames respectively to obtain the multiple grayscale-processed video frames.

[0059] Optionally, when the first electronic device performs grayscale processing on the multiple video frames respectively, it can perform histogram mapping (or called grayscale mapping) on the multiple video frames respectively.

[0060] In an alternative embodiment, before step S202, the first electronic device also performs cropping and correction processing on the multiple video frames respectively to obtain the multiple cropped and corrected video frames. Optionally, after obtaining the multiple cropped and corrected video frames, the first electronic device can also perform grayscale processing on the multiple cropped and corrected video frames respectively to obtain the multiple grayscale-processed video frames.

[0061] Optionally, when the first electronic device performs grayscale processing on the multiple cropped and corrected video frames respectively, it can perform histogram mapping on the multiple cropped and corrected video frames respectively.

[0062] S203. The first electronic device determines the similarity between every two adjacent video frames among the multiple grayscale-processed video frames.

[0063] In an alternative embodiment, the first electronic device may use a perceptual hash algorithm (pHash) to determine the similarity between each adjacent pair of the multiple video frames after grayscale processing. The similarity between each adjacent pair of video frames is the Hamming distance between each adjacent pair of video frames.

[0064] In this embodiment, the first electronic device may first determine the hash value of each video frame among the multiple video frames after grayscale processing; and based on the hash value of each video frame, determine the similarity between each adjacent pair of video frames.

[0065] Next, taking the first electronic device to determine the hash value of any one of the multiple video frames after grayscale processing (for example, video frame 1) as an example, combined with Figure 3 , the process of the first electronic device determining the hash value of each video frame will be introduced. Figure 3 FIG. is a schematic diagram of the process of the first electronic device determining the hash value of video frame 1 among the multiple video frames after grayscale processing.

[0066] As Figure 3 shown, the first electronic device may first perform a discrete cosine transform (DCT) on the grayscale-processed video frame 1 to convert the video frame from the spatial domain to the frequency domain, obtaining the frequency domain information matrix corresponding to video frame 1. Secondly, from the frequency domain information matrix corresponding to video frame 1, select a 16*16 matrix that records the low-frequency information in video frame 1. Then, determine the mean value of the above 16*16 matrix. Finally, based on the above 16*16 matrix and the mean value of the 16*16 matrix, determine the hash value of this video frame 1. Among them, when the first computing device determines the hash value of video frame 1 based on the above 16*16 matrix and the mean value of the 16*16 matrix, it may first convert the values in the 16*16 matrix that are greater than or equal to the mean value of the matrix to 1, convert the values in the 16*16 matrix that are less than the mean value of the matrix to 0, then generate a binary array based on the converted values, and use the generated binary array as the hash value of video frame 1. In this way, through binarization, the low-frequency information can be compressed into a 0, 1 list (hash value) with a length of 16*16, greatly compressing the video frame and retaining the low-frequency information of the video frame. Among them, the hash value can be used to compare the similarity between two adjacent video frames.

[0067] It can be understood that the first electronic device can determine the hash value of each video frame among the multiple video frames after grayscale processing through the method as Figure 3 shown.

[0068] S204. The first electronic device determines whether there is a screen flashing fault on the screen of the second electronic device's displayed image based on the similarity between every two adjacent video frames.

[0069] In an optional implementation, the first electronic device determines whether there is a screen flashing fault on the screen of the second electronic device's displayed image based on the similarity between every two adjacent video frames, which may include: selecting the first two similarities from the similarities between every two adjacent video frames according to the selection order from the largest to the smallest similarity; determining that there is a screen flashing fault on the screen of the second electronic device's displayed image when it is determined that both the first two similarities are greater than the preset similarity threshold and the absolute value of the difference between the ratio of the first two similarities and 1 is less than or equal to the preset threshold; determining that there is no screen flashing fault on the screen of the second electronic device's displayed image when it is determined that the similarity between every two adjacent video frames is less than or equal to the preset similarity threshold, or the absolute value of the difference between the ratio of the first two similarities and 1 is greater than the preset threshold. Optionally, the preset similarity threshold is determined by the first electronic device based on the historical screen flashing faults of the screen of the second electronic device's displayed image; the preset threshold is determined according to empirical values.

[0070] Among them, the absolute value of the difference between the ratio of the first two similarities and 1 being less than or equal to the preset threshold can also be understood as the ratio of the first two similarities approaching 1; the absolute value of the difference between the ratio of the first two similarities and 1 being greater than the preset threshold can also be understood as the ratio of the first two similarities being much greater than 1 or much less than 1.

[0071] Optionally, the above similarity may refer to the Hamming distance.

[0072] Exemplarily, the following combines Figure 4a and Figure 4b to explain the process of the first electronic device determining whether there is a screen flashing fault on the screen of the second electronic device's displayed image based on the similarity between every two adjacent video frames. Figure 4a is a schematic diagram of a set of continuously video frames after gray-scale processing provided by an embodiment of the present application; Figure 4b is provided by an embodiment of the present application Figure 4a In a continuous video frame shown, it is a schematic diagram of the Hamming distance between every two adjacent video frames.

[0073] As Figure 4a shown, which includes 7 continuous video frames. As Figure 4b shown, the abscissa represents adjacent video frames, and the ordinate represents the Hamming distance. From Figure 4b it can be seen that Figure 4aAmong the 7 consecutive video frames shown, the Hamming distance between video frame 1 and video frame 2 (frame(1 - 2)) is 0.0156; the Hamming distance between video frame 2 and video frame 3 (frame(2 - 3)) is 0.4219; the Hamming distance between video frame 3 and video frame 4 (frame(3 - 4)) is 0.0391; the Hamming distance between video frame 4 and video frame 5 (frame(4 - 5)) is 0.4063; the Hamming distance between video frame 5 and video frame 6 (frame(5 - 6)) is 0.0781; the Hamming distance between video frame 6 and video frame 7 (frame(6 - 7)) is 0.0625. At this time, the first electronic device can select the first two Hamming distances from the Hamming distances between the above adjacent two video frames in the order of selection from large to small, that is, 0.4219 (the Hamming distance of frame(2 - 3)) and 0.4063 (the Hamming distance of frame(4 - 5)), and the first electronic device can determine that the ratio of 0.4219 and 0.4063 is 0.4219 / 0.4063 ≈ 1.038. Assume that the preset Hamming distance threshold is 0.1 and the preset distance threshold is 0.04. Then the first electronic device can determine that the Hamming distance 0.4219 of frame(2 - 3) is greater than 0.1, the Hamming distance 0.4063 of frame(4 - 5) is greater than 0.1, and the absolute value of the difference between the ratio (1.038) of the Hamming distance 0.4219 of frame(2 - 3) and the Hamming distance 0.4063 of frame(4 - 5) and 1, |1.038 - 1| = 0.038, is less than the preset distance threshold 0.04. In this case, the first electronic device can determine that there is a screen flashing fault in the screen of the second electronic device for displaying the image. Further, since the Hamming distances of frame(2 - 3) and frame(4 - 5) are relatively large, the first electronic device can determine that there is a picture jump between frame(2 - 3) and there is a picture jump between frame(4 - 5). Thus, the first electronic device can determine that the abnormal video frames flashing among the 7 consecutive video frames are video frame 3 and video frame 4.

[0074] In an alternative embodiment, after step S204, when the first electronic device determines that there is a screen flashing fault in the screen of the second electronic device for displaying the image, the first electronic device can also store the received multiple video frames to generate information such as a fault video and a fault log.

[0075] In an embodiment of the present application, when the first electronic device detects a screen flashing fault in the screen of the second electronic device displaying an image, based on the similarity between adjacent two video frames among the multiple video frames obtained by continuously shooting the image displayed by the second electronic device using a high-speed camera, it is determined whether the screen of the image displayed by the second electronic device has a screen flashing phenomenon. In this way, compared with the method in which the first electronic device determines whether the second electronic device has a screen flashing fault by comparing the image of the second electronic device displayed collected by the high-speed camera with the image of its own display captured by the second electronic device using a screenshot software, there is no need for the second electronic device to take a screenshot to obtain the displayed image, thereby reducing the missed detection rate when detecting the screen flashing fault in the screen of the image displayed by the second electronic device.

[0076] Please refer to Figure 5 , Figure 5 which is a schematic diagram of another screen fault detection method provided by an embodiment of the present application. Different from the screen fault detection method shown in Figure 2 , the difference of the screen fault detection method shown in Figure 5 is that the screen fault detection method shown in Figure 5 can also determine whether the screen of the image displayed by the second electronic device has a black screen fault. As shown in

[0077] S501. The first electronic device receives a plurality of video frames from a high-speed camera, where the plurality of video frames are obtained by continuously shooting the image displayed by the second electronic device using the high-speed camera.

[0078] S502. The first electronic device performs gray-scale processing on the plurality of video frames respectively to obtain the plurality of video frames after gray-scale processing.

[0079] In an optional implementation manner, after step S502, the first electronic device can execute both step S503a and S504a and step S503b and S504b; or the first electronic device only executes step S503b and S504b.

[0080] S503a. The first electronic device determines the similarity between every two adjacent video frames among the plurality of video frames after gray-scale processing.

[0081] S504a. The first electronic device determines whether the screen of the image displayed by the second electronic device has a screen flashing fault based on the similarity between every two adjacent video frames.

[0082] In an optional implementation manner, the specific processes of step S503a and S504a can respectively refer to the relevant descriptions in the foregoing steps S203 and S204, and will not be elaborated here.

[0083] S503b. The first electronic device determines the normalized brightness value of each video frame among the multiple video frames after grayscale processing.

[0084] Taking the first electronic device to determine the normalized brightness value of any one of the multiple video frames after grayscale processing (for example, video frame 2) as an example, combined with Figure 6 , the process of the first electronic device determining the normalized brightness value of each video frame will be introduced. Figure 6 It is a schematic diagram of the process for the first electronic device to determine the normalized brightness value of video frame 2 among the multiple video frames after grayscale processing.

[0085] As Figure 6 shown. The first electronic device can first calculate the grayscale mean value of video frame 2 after grayscale processing, and then divide the grayscale mean value of video frame 2 by 255 to obtain the normalized brightness value of video frame 2.

[0086] It can be understood that the first electronic device can determine the normalized brightness value of each video frame among the multiple video frames after grayscale processing through the method as Figure 6 shown.

[0087] S504b. The first electronic device determines whether the screen of the second electronic device for displaying an image has a black screen fault based on the normalized brightness value of each video frame.

[0088] In an optional implementation manner, the first electronic device determines whether the screen of the second electronic device for displaying an image has a black screen fault based on the normalized brightness value of each video frame, which may include: when it is determined that any one of the normalized brightness values among the normalized brightness values of each video frame is less than a preset normalized brightness threshold, it is determined that the screen of the second electronic device for displaying an image has a black screen fault; when it is determined that the normalized brightness value of each video frame is greater than or equal to the preset normalized brightness threshold, it is determined that the screen of the second electronic device for displaying an image does not have a black screen fault. Optionally, the preset normalized brightness threshold is determined by the first electronic device based on the historical black screen faults of the screen of the second electronic device for displaying an image.

[0089] Exemplarily, the following combines Figure 7a and Figure 7b to explain the process of the first electronic device determining whether the screen of the second electronic device for displaying an image has a black screen fault based on the normalized brightness value of each video frame. Figure 7a It is a schematic diagram of a set of consecutive video frames after grayscale processing provided by an embodiment of the present application; Figure 7b It is provided by an embodiment of the present application Figure 7a shown in a schematic diagram of the normalized brightness value of each video frame in one consecutive video frame.

[0090] As Figure 7aAs shown, which includes 6 consecutive video frames. As Figure 7b shown, the abscissa represents the video frames, and the ordinate represents the normalized luminance value. From Figure 7b it can be seen that Figure 7a among the 6 consecutive video frames shown, the normalized luminance value of video frame 1 (frame1) is 0.7354; the normalized luminance value of video frame 2 (frame2) is 0.7353; the normalized luminance value of video frame 3 (frame3) is 0.7348; the normalized luminance value of video frame 4 (frame4) is 0.0344; the normalized luminance value of video frame 5 (frame5) is 0.7346; the normalized luminance value of video frame 6 (frame6) is 0.7347. Assuming that the preset normalized luminance threshold is 0.1, the first electronic device can determine that the normalized luminance value 0.0344 of frame4 is less than 0.1. In this case, the first electronic device can determine that the screen of the image displayed by the second electronic device has a black screen phenomenon. Further, the first electronic device can determine that the black screen among the 6 consecutive video frames is video frame 4.

[0091] In an alternative embodiment, after step S504b, the first electronic device can also store the received multiple video frames when determining that the screen of the image displayed by the second electronic device has a black screen fault, so as to generate information such as a fault video and a fault log.

[0092] In the embodiment of the present application, the first electronic device can detect the black screen fault of the screen of the image displayed by the second electronic device based on the normalized luminance value of each video frame in the multiple video frames after gray processing. Compared with the method in which the first electronic device determines whether the second electronic device has a black screen fault by comparing the image displayed by the second electronic device collected by the acquired high-speed camera with the image displayed by the second electronic device captured by the screenshot software of the second electronic device, there is no need for the second electronic device to capture the displayed image by screenshot, thereby reducing the missed detection rate when detecting the black screen fault of the screen of the image displayed by the second electronic device.

[0093] Please refer to Figure 8 , Figure 8 which is a schematic diagram of another screen fault detection method provided by the embodiment of the present application. Different from the screen fault detection methods shown in Figure 2 and Figure 5 , Figure 8 the screen fault detection method shown can also determine whether the screen of the image displayed by the second electronic device has a flash screen fault. As Figure 8 shown, the screen fault detection method may include but is not limited to the following steps:

[0094] S801. The first electronic device receives multiple video frames from a high-speed camera, where the multiple video frames are obtained by the high-speed camera continuously shooting the image displayed on the second electronic device.

[0095] S802. The first electronic device performs grayscale processing on each of the multiple video frames to obtain the multiple video frames after grayscale processing.

[0096] In an alternative embodiment, after step S802, the first electronic device can execute both step S803a and S804a, step S803b and S804b, and step S803c and S804c; or, the first electronic device only executes step S803a and S804a, and S803c and S804c; or, the first electronic device only executes step S803c and S804c.

[0097] S803a. The first electronic device determines the similarity between every two adjacent video frames among the multiple video frames after grayscale processing.

[0098] S804a. The first electronic device determines whether there is a screen flashing fault on the screen of the image displayed by the second electronic device based on the similarity between every two adjacent video frames.

[0099] In an alternative embodiment, the specific processes of step S803a and S804a can be respectively referred to the relevant descriptions in the foregoing steps S203 and S204, and will not be elaborated here.

[0100] S803b. The first electronic device determines the normalized luminance value of each video frame among the multiple video frames after grayscale processing.

[0101] S804b. The first electronic device determines whether there is a black screen fault on the screen of the image displayed by the second electronic device based on the normalized luminance value of each video frame.

[0102] In an alternative embodiment, the specific processes of step S803b and S804b can be respectively referred to the relevant descriptions in the foregoing steps S503b and S504b, and will not be elaborated here.

[0103] S803c. The first electronic device determines the no-reference result sharpness NRSS value of each video frame among the multiple video frames after grayscale processing.

[0104] Among them, the NRSS value can be used to measure the high-frequency information of each video frame, and the NRSS value can adjust the window size and can better measure the content of a flower screen. The larger the NRSS value, the clearer the video frame.

[0105] Taking the determination of the NRSS value of any one of the multiple video frames after grayscale processing by the first electronic device (for example, video frame 3) as an example, combined with Figure 9 , the process of the first electronic device determining the NRSS value of each video frame will be introduced. Figure 9 It is a schematic diagram of the process of the first electronic device determining the NRSS value of video frame 3 among the multiple video frames after grayscale processing.

[0106] As Figure 9 shown, the first electronic device can first perform low-pass filtering on video frame 3 after grayscale processing using a low-pass filter to filter out the high-frequency information in video frame 3, and obtain the low-frequency information image corresponding to video frame 3 after grayscale processing. Then, calculate the structural similarity (SSIM) between the low-frequency information image corresponding to video frame 3 and video frame 3 to measure the high-frequency information lost in video frame 3. Finally, use 1 minus the above SSIM value to obtain the NRSS value of video frame 3.

[0107] It can be understood that the first electronic device can determine the NRSS value of each video frame among the multiple video frames after grayscale processing through the method as Figure 9 shown.

[0108] S804c. The first electronic device determines whether there is a screen distortion fault in the image displayed by the second electronic device based on the NRSS value of each video frame.

[0109] In an optional implementation manner, the first electronic device determines whether there is a screen distortion fault in the image displayed by the second electronic device based on the NRSS value of each video frame, which may include: when determining that any one of the NRSS values among the NRSS values of each video frame is greater than a preset NRSS threshold, it is determined that there is a screen distortion fault in the image displayed by the second electronic device; when determining that the NRSS values of each video frame are all less than or equal to the preset NRSS threshold, it is determined that there is no screen distortion fault in the image displayed by the second electronic device. Optionally, the preset NRSS threshold is determined by the first electronic device based on the historical screen distortion faults of the screen of the image displayed by the second electronic device.

[0110] Exemplarily, the process of the first electronic device determining whether there is a screen distortion fault in the image displayed by the second electronic device based on the NRSS value of each video frame will be explained below in combination with Figure 10a and Figure 10b . Figure 10a It is a schematic diagram of a set of consecutive video frames after grayscale processing provided by an embodiment of the present application, Figure 10b is provided by an embodiment of the present application Figure 10a shown in a schematic diagram of the NRSS value of each video frame in one consecutive video frame.

[0111] As shown Figure 10a in the figure, it includes 5 consecutive video frames. As shown Figure 10b in the figure, the abscissa represents the video frames, and the ordinate represents the NRSS value. It can be seen from Figure 10b the figure that Figure 10a among the 5 consecutive video frames shown, the NRSS value of video frame 1 (frame1) is 0.3755; the NRSS value of video frame 2 (frame2) is 0.3752; the NRSS value of video frame 3 (frame3) is 0.3750; the NRSS value of video frame 4 (frame4) is 0.7921; the NRSS value of video frame 5 (frame5) is 0.3308. Assuming that the preset NRSS threshold is 0.75, the first electronic device can determine that the NRSS value 0.7921 of frame4 is greater than 0.75. In this case, the first electronic device can determine that the screen of the image displayed by the second electronic device has a screen distortion phenomenon. Further, the first electronic device can determine that the video frame with screen distortion among the 5 consecutive video frames is video frame 4.

[0112] In an alternative embodiment, after step S804c, when the first electronic device determines that the screen of the image displayed by the second electronic device has a screen distortion fault, the first electronic device can also store the received multiple video frames to generate information such as a fault video and a fault log.

[0113] In the embodiment of the present application, the first electronic device can perform screen distortion fault detection on the screen of the image displayed by the second electronic device based on the NRSS value of each video frame in the multiple video frames after gray-scale processing. Compared with the method in which the first electronic device performs screen distortion fault detection on the screen of the image displayed by the second electronic device based on the block variance of each video frame, it can reduce the influence of non-screen-distorted content, such as edge textures, on the block variance of the video frames, thereby reducing the false detection rate when performing screen distortion fault detection on the screen of the image displayed by the second electronic device.

[0114] Please refer to Figure 11 , Figure 11 which is a schematic flowchart of another screen fault detection method provided by the embodiment of the present application. Different from the screen fault detection methods shown in Figure 2 , Figure 5 or Figure 8 , the screen fault detection method shown in Figure 11 can also determine whether the screen of the image displayed by the second electronic device has a screen line fault. As shown Figure 11 in the figure, the screen fault detection method may include but is not limited to the following steps:

[0115] S1101. The first electronic device receives multiple video frames from a high-speed camera, where the multiple video frames are obtained by the high-speed camera continuously photographing the image displayed on the second electronic device.

[0116] S1102. The first electronic device performs grayscale processing on the multiple video frames respectively to obtain the multiple video frames after grayscale processing.

[0117] In an alternative embodiment, after step S802, the first electronic device can execute both steps S1103a and S1104a, and steps S1103b and S1104b, and steps S1103c and S1104c, and also execute S1103d and S1104d; or, the first electronic device only executes steps S1103a and S1104a, and S1103d and S1104d; or, the first electronic device executes steps S1103a and S1104a, S1103b and S1104b, and S1103d and S1104d; or, the first electronic device only executes S1103d and S1104d.

[0118] S1103a. The first electronic device determines the similarity between every two adjacent video frames among the multiple video frames after grayscale processing.

[0119] S1104a. The first electronic device determines whether there is a screen flashing fault in the image displayed on the second electronic device based on the similarity between every two adjacent video frames.

[0120] In an alternative embodiment, the specific processes of steps S1103a and S1104a can be respectively referred to the relevant descriptions in the foregoing steps S203 and S204, and will not be elaborated here.

[0121] S1103b. The first electronic device determines the normalized brightness value of each video frame among the multiple video frames after grayscale processing.

[0122] S1104b. The first electronic device determines whether there is a black screen fault in the image displayed on the second electronic device based on the normalized brightness value of each video frame.

[0123] In an alternative embodiment, the specific processes of steps S1103b and S1104b can be respectively referred to the relevant descriptions in the foregoing steps S503b and S504b, and will not be elaborated here.

[0124] S1103c. The first electronic device determines the no-reference result sharpness NRSS value of each video frame among the multiple video frames after grayscale processing.

[0125] S1104c. The first electronic device determines whether there is a screen distortion fault on the screen of the second electronic device based on the NRSS value of each video frame.

[0126] In an alternative implementation, for the specific processes of steps S1103c and S1104c, reference can be made to the relevant descriptions in the foregoing steps S803c and S804c respectively, and details will not be elaborated here.

[0127] S1103d. The first electronic device determines the edge line of each video frame among the multiple video frames after grayscale processing.

[0128] Taking the first electronic device determining the edge line of any one video frame (for example, video frame 4) among the multiple video frames after grayscale processing as an example, combined with Figure 12 , the process of the first electronic device determining the edge line of each video frame among the multiple video frames after grayscale processing will be introduced. Figure 12 It is a schematic diagram of the process of the first electronic device determining the edge line of video frame 4 among the multiple video frames after grayscale processing.

[0129] As Figure 12 shown, the first electronic device can first perform low-pass filtering on the grayscale-processed video frame 4 using a low-pass filter to filter out the noise in video frame 4 and obtain the filtered video frame 3. Then, use the Canny operator to extract the edge information of the filtered video frame 3. Finally, perform the Hough transform on the extracted edge information to obtain the edge line of video frame 3.

[0130] Among them, the Canny operator is an edge detection algorithm that is not easily affected by noise, can identify weak edges and strong edges in the image, and comprehensively determine the overall edge information of the image in combination with the positional relationship between the strong and weak edges.

[0131] The Hough transform is a feature extraction algorithm mainly used to separate geometric shapes (such as straight lines, etc.) with certain same features from an image.

[0132] It can be understood that the first electronic device can determine the edge line of each video frame among the multiple video frames after grayscale processing through the method as Figure 12 shown.

[0133] S1104d. The first electronic device determines whether there is a screen line fault on the screen of the second electronic device based on the edge line of each video frame.

[0134] In an alternative embodiment, the first electronic device determines whether there is a moiré fault on the screen of the second electronic device based on the edge lines of each video frame, which may include: when it is determined that among the edge lines of each video frame, the luminance value of any edge line is greater than a preset edge line luminance value, it is determined that there is a moiré fault on the screen of the second electronic device; when it is determined that the luminance values of the edge lines in each video frame are all less than or equal to the preset edge line luminance value, it is determined that there is no moiré fault on the screen of the second electronic device.

[0135] Exemplarily, assume that after the first electronic device performs moiré fault detection on a continuous video frame (for example, 5 video frames), the obtained results are as Figure 13a shown. Figure 13a FIG. is a schematic diagram of the results obtained by the first electronic device provided in an embodiment of the present application for performing moiré fault detection on a continuous video frame segment. As Figure 13a shown, it includes 5 video frames, and obvious edge information appears in video frame 3. At this time, the first electronic device can perform a Hough transform on the edge information in video frame 3 to determine the edge line of this video frame 3, and based on the edge line of this video frame 3, determine that there is a moiré fault on the screen of the second electronic device. For example, as Figure 13b shown. Figure 13b FIG. is a schematic diagram of a video frame with moiré marked provided in an embodiment of the present application.

[0136] In an alternative embodiment, after step S1104d, when the first electronic device determines that there is a moiré fault on the screen of the second electronic device for the displayed image, the first electronic device may also store the received multiple video frames to generate information such as a fault video and a fault log.

[0137] In the embodiment of the present application, the first electronic device may perform edge detection on the received multiple video frames, and based on the edge detection result, determine whether there is a moiré fault on the screen of the second electronic device for the displayed image. Thus, the accuracy of moiré fault detection for the screen of the second electronic device for the displayed image can be improved.

[0138] Please refer to Figure 14 , Figure 14 FIG. is a schematic diagram of the software architecture of a first electronic device provided in an embodiment of the present application.

[0139] The software system of the first electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiment of the present invention, taking the Android system with a layered architecture as an example, the software structure of the first electronic device is exemplarily described.

[0140] The layered architecture divides software into several layers, and each layer has clear roles and divisions of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the hardware abstraction layer (HAL), and the kernel layer.

[0141] The application layer may include a series of application packages. Such as Figure 14 shown, the application packages may include applications such as camera, gallery, video, music, navigation, calendar, map, WLAN, etc.

[0142] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions. Such as Figure 14 shown, the application framework layer may include a window manager, a content provider, a view system, a telephone manager, a resource manager, a notification manager, etc.

[0143] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0144] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc.

[0145] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

[0146] The telephone manager is used to provide the communication function of the first electronic device. For example, the management of call status (including answering, hanging up, etc.).

[0147] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, and so on.

[0148] The notification manager enables an application to display notification information in the status bar. It can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as the notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, it prompts text information in the status bar, emits a prompt sound, the electronic device vibrates, the indicator light flashes, etc.

[0149] The hardware abstraction layer may include multiple functional modules. For example, a receiving module, a processing module, a determining module, etc.

[0150] Among them, the receiving module can be used to receive multiple video frames from a high-speed camera. The multiple video frames are obtained by the high-speed camera continuously shooting the images displayed by the second electronic device;

[0151] The processing module can be used to perform grayscale processing on the multiple video frames respectively to obtain the multiple video frames after grayscale processing;

[0152] The determining module can be used to determine the similarity between every two adjacent video frames among the multiple video frames after grayscale processing;

[0153] The determining module can also be used to determine whether the screen of the image displayed by the second electronic device has a screen flashing fault based on the similarity between every two adjacent video frames.

[0154] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0155] Figure 15 It is a schematic diagram of the hardware structure of a first electronic device provided by an embodiment of the present application.

[0156] Such as Figure 15As shown in the figure, the first electronic device may include a processor 110, an external memory interface 120A, an internal memory 120B, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 140A, a battery 140B, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0157] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the first electronic device. In other embodiments of the present application, the first electronic device may include more or fewer components than Figure 15 shown in the figure, or combine certain components, or split certain components, or have different component arrangements. Figure 15 The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0158] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0159] The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0160] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0161] In an alternative embodiment, the processor 110 can be used to perform the operations of the first electronic device in the above screen fault detection method, specifically as follows: receiving a plurality of video frames from a high-speed camera, where the plurality of video frames are obtained by the high-speed camera continuously shooting the image displayed on the second electronic device; performing gray-scale processing on the plurality of video frames respectively to obtain the plurality of gray-scale processed video frames; determining the similarity between every two adjacent video frames among the plurality of gray-scale processed video frames; and determining whether there is a screen flashing fault on the screen of the image displayed by the second electronic device based on the similarity between every two adjacent video frames.

[0162] In addition, the processor 110 can also be used to: determine the normalized brightness value of each video frame among the plurality of gray-scale processed video frames; and determine whether there is a black screen fault on the screen of the image displayed by the second electronic device based on the normalized brightness value of each video frame.

[0163] In addition, the processor 110 can also be used to: determine the no-reference result sharpness NRSS value of each video frame among the plurality of gray-scale processed video frames; and determine whether there is a screen distortion fault on the screen of the image displayed by the second electronic device based on the NRSS value of each video frame.

[0164] In addition, the processor 110 can also be used to: determine the edge line of each video frame among the plurality of gray-scale processed video frames; and determine whether there is a screen line fault on the screen of the second electronic device based on the edge line of each video frame.

[0165] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0166] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface to implement the touch function of the first electronic device.

[0167] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0168] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In some embodiments, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0169] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through Bluetooth headphones.

[0170] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the first electronic device. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the first electronic device.

[0171] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0172] The USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the first electronic device, and can also be used to transfer data between the first electronic device and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0173] It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are only illustrative and do not constitute a structural limitation on the first electronic device. In other embodiments of the present application, the first electronic device can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0174] The charging management module 140 is configured to receive a charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input from the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the first electronic device. While charging the battery 140B, the charging management module 140 can also supply power to the electronic device through the power management module 140A.

[0175] The power management module 140A is used to connect the battery 140B, the charging management module 140, and the processor 110. The power management module 140A receives inputs from the battery 140B and / or the charging management module 140 and supplies power to the processor 110, the internal memory 120B, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 140A can also be used to monitor parameters such as the battery capacity, the number of battery charge cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 140A can also be disposed in the processor 110. In some other embodiments, the power management module 140A and the charging management module 140 can also be disposed in the same device.

[0176] The wireless communication function of the first electronic device can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0177] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0178] The mobile communication module 150 can provide solutions for wireless communication such as 2G / 3G / 4G / 5G applied to the first electronic device. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be provided in the same device.

[0179] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0180] The wireless communication module 160 may provide solutions for wireless communications applied to the first electronic device, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0181] In some embodiments, the antenna 1 of the first electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, enabling the first electronic device to communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0182] The first electronic device realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0183] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the first electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0184] The first electronic device can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, etc.

[0185] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera photosensitive element. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, etc. of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0186] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the first electronic device may include one or N cameras 193, where N is a positive integer greater than 1.

[0187] The digital signal processor is used to process digital signals. In addition to being able to process digital image signals, it can also process other digital signals. For example, when the first electronic device selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0188] The video codec is used to compress or decompress digital videos. The first electronic device can support one or more video codecs. In this way, the first electronic device can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0189] The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission pattern between human brain neurons, it can quickly process input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the first electronic device can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0190] The internal memory 120B may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0191] The random access memory may include static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation of DDR SDRAM is generally called DDR5 SDRAM), etc.;

[0192] The non-volatile memory may include disk storage devices and flash memory.

[0193] Flash memory can be classified according to its operating principle into NOR Flash, NAND Flash, 3D NAND Flash, etc., and according to the number of potential levels of storage cells into single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc., and according to storage specifications into universal flash storage (UFS), embedded multi media Card (eMMC), etc.

[0194] The random access memory can be directly read and written by the processor 110, and can be used to store the operating system or executable programs (such as machine instructions) of other running programs, and can also be used to store data of users and application programs, etc.

[0195] The non-volatile memory can also store executable programs and data of users and application programs, etc., and can be pre-loaded into the random access memory for the processor 110 to directly read and write.

[0196] The external memory interface 120A can be used to connect to an external non-volatile memory to expand the storage capacity of the first electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120A to implement the data storage function. For example, files such as music and videos are saved in the external non-volatile memory.

[0197] The first electronic device can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc.

[0198] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0199] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The first electronic device can listen to music or hands-free calls through the speaker 170A.

[0200] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the first electronic device answers a call or a voice message, the voice can be listened to by placing the receiver 170B close to the human ear.

[0201] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak close to the microphone 170C to input the sound signal into the microphone 170C. The first electronic device may be provided with at least one microphone 170C. In some other embodiments, the first electronic device may be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the first electronic device may also be provided with three, four or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and implement a directional recording function, etc.

[0202] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D may be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0203] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the first electronic device detects the intensity of the touch operation according to the pressure sensor 180A. The first electronic device can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations with the same touch position but different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0204] The gyroscope sensor 180B can be used to determine the motion posture of the first electronic device. In some embodiments, the angular velocity of the first electronic device about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of jitter of the first electronic device, calculates the distance that the lens module needs to compensate according to the angle, and enables the lens to offset the jitter of the first electronic device through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenarios.

[0205] The barometric pressure sensor 180C is used to measure the barometric pressure. In some embodiments, the first electronic device calculates the altitude according to the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0206] The magnetic sensor 180D includes a Hall sensor. The first electronic device can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the first electronic device is a flip phone, the first electronic device can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the flip, features such as automatic unlocking of the flip can be set.

[0207] The acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device in various directions (generally three axes). When the first electronic device is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0208] The distance sensor 180F is used to measure the distance. The first electronic device can measure the distance by infrared or laser. In some embodiments, in a shooting scene, the first electronic device can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0209] The proximity light sensor 180G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode can be an infrared light-emitting diode. The first electronic device emits infrared light outward through the light-emitting diode. The first electronic device uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the first electronic device. When insufficient reflected light is detected, the first electronic device can determine that there is no object near the first electronic device. The first electronic device can use the proximity light sensor 180G to detect that the user holds the first electronic device close to the ear for a call, so as to automatically turn off the screen to achieve the purpose of power saving. The proximity light sensor 180G can also be used for automatic unlocking and locking of the leather case mode and pocket mode.

[0210] The ambient light sensor 180L is used to sense the ambient light brightness. The first electronic device can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance during photography. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the first electronic device is in a pocket to prevent accidental touches.

[0211] The fingerprint sensor 180H is used to collect fingerprints. The first electronic device can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.

[0212] The temperature sensor 180J is used to detect temperature. In some embodiments, the first electronic device uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the first electronic device reduces the performance of the processor near the temperature sensor 180J to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the first electronic device heats the battery 140B to prevent the first electronic device from shutting down abnormally due to low temperature. In some other embodiments, when the temperature is lower than yet another threshold, the first electronic device boosts the output voltage of the battery 140B to prevent abnormal shutdown caused by low temperature.

[0213] The touch sensor 180K, also known as a "touch control device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch control screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the first electronic device, at a different position from the display screen 194.

[0214] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M to implement voice functions. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement heart rate detection functions.

[0215] The button 190 includes a power-on button, volume buttons, etc. The button 190 can be a mechanical button or a touch button. The first electronic device can receive button inputs and generate key signal inputs related to the user settings and function controls of the first electronic device.

[0216] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. Touch operations on different areas of the display screen 194 can also correspond to different vibration feedback effects by the motor 191. Different application scenarios (such as time reminder, receiving messages, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0217] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0218] The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the first electronic device. The first electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The first electronic device interacts with the network through the SIM card to achieve functions such as calls and data communication. In some embodiments, the first electronic device uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the first electronic device and cannot be separated from the first electronic device.

[0219] It should be noted that for the above method embodiments, for simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present invention is not limited by the described action sequence. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential to the present invention. The various embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0220] As used in the specification and the appended claims of this application, the singular forms "a", "an", "the", "above", "said", "this" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in this application refers to and encompasses any and all possible combinations of one or more of the listed items. As used in the above embodiments, depending on the context, the term "when" may be construed to mean "if" or "after" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "upon determining" or "if detected (the stated condition or event)" may be construed to mean "if determined" or "in response to determining" or "when detected (the stated condition or event)" or "in response to detecting (the stated condition or event)".

[0221] In the specification, claims and drawings of this application, the terms "first", "second", etc. are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a series of steps or units are included, or optionally, steps or units not listed are also included, or optionally, other steps or units inherent to these processes, methods, products or devices are also included.

[0222] Only parts relevant to this application are shown in the drawings, not all of the content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process may be terminated when its operations are completed, but may also have additional steps not included in the drawings. The process may correspond to a method, function, procedure, subroutine, subprogram, etc.

[0223] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive), etc.

[0224] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by relevant hardware instructed by a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The foregoing storage medium includes various media that can store program codes, such as ROM or random access memory RAM, magnetic disks, or optical discs.

[0225] In summary, the above descriptions are only embodiments of the technical solutions of the present invention and are not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention shall be included within the protection scope of the present invention.

Claims

1. A method for detecting screen faults, characterized in that, Applied to a first electronic device, the method includes: Receiving a plurality of video frames from a high-speed camera, the plurality of video frames being obtained by the high-speed camera continuously photographing an image displayed on a second electronic device; Performing grayscale processing on each of the plurality of video frames to obtain a plurality of video frames after grayscale processing; Determining the similarity between each adjacent two of the plurality of video frames after grayscale processing; Based on the similarity between each adjacent two of the video frames, determining whether there is a screen flashing fault on the screen of the second electronic device displaying the image.

2. The method according to claim 1, wherein The determining the similarity between each adjacent two of the plurality of video frames after grayscale processing includes: Determining the hash value of each video frame in the plurality of video frames after grayscale processing; Based on the hash value of each video frame, determining the similarity between each adjacent two of the video frames.

3. The method according to claim 1, wherein The determining whether there is a screen flashing fault on the screen of the second electronic device displaying the image based on the similarity between each adjacent two of the video frames includes: According to the selection order from large to small similarity, selecting the first two similarities from the similarities between each adjacent two of the video frames according to the similarity between each adjacent two of the video frames; In the case where it is determined that both of the first two similarities are greater than a preset similarity threshold and the absolute value of the difference between the ratio of the first two similarities and 1 is less than or equal to a preset threshold, determining that there is a screen flashing fault on the screen of the second electronic device displaying the image; In the case where it is determined that the similarity between each adjacent two of the video frames is less than or equal to the preset similarity threshold, or the absolute value of the difference between the ratio of the first two similarities and 1 is greater than the preset threshold, determining that there is no screen flashing fault on the screen of the second electronic device displaying the image.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: Determining the normalized luminance value of each video frame in the plurality of video frames after grayscale processing; Based on the normalized luminance value of each video frame, determining whether there is a black screen fault on the screen of the second electronic device displaying the image.

5. The method according to claim 4, characterized in that, The determining whether there is a black screen fault on the screen of the second electronic device displaying the image based on the normalized luminance value of each video frame includes: In the case where it is determined that any one of the normalized luminance values in the normalized luminance values of each video frame is less than a preset normalized luminance threshold, determining that there is a black screen fault on the screen of the second electronic device displaying the image; In the case where it is determined that the normalized luminance value of each video frame is greater than or equal to the preset normalized luminance threshold, determining that there is no black screen fault on the screen of the second electronic device displaying the image.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Determining the no-reference result sharpness NRSS value of each video frame in the plurality of video frames after grayscale processing; Based on the NRSS value of each video frame, determining whether there is a screen distortion fault on the screen of the second electronic device displaying the image.

7. The method according to claim 6, wherein The determining whether there is a screen distortion fault on the screen of the second electronic device displaying the image based on the NRSS value of each video frame includes: When there is any NRSS value greater than a preset NRSS threshold in determining the NRSS value of each of the video frames, it is determined that the screen of the second electronic device for displaying the image has a screen distortion fault; When it is determined that the NRSS value of each of the video frames is less than or equal to the preset NRSS threshold, it is determined that the screen of the second electronic device for displaying the image does not have a screen distortion fault.

8. The method according to any one of claims 1 to 7, characterized in that, The method further includes: Determining the edge line of each of the multiple video frames after grayscale processing; Based on the edge line of each of the video frames, determining whether the screen of the second electronic device for displaying the image has a horizontal line distortion fault.

9. The method according to claim 8, characterized in that The determining whether the screen of the second electronic device for displaying the image has a horizontal line distortion fault based on the edge line of each of the video frames includes: When there is any edge line with a brightness value greater than a preset edge line brightness value among the edge lines of each of the video frames, it is determined that the screen of the second electronic device for displaying the image has a horizontal line distortion fault; When it is determined that the brightness value of the edge line in each of the video frames is less than or equal to the preset edge line brightness value, it is determined that the screen of the second electronic device for displaying the image does not have a horizontal line distortion fault.

10. A first electronic device, characterized in that, It includes: A memory, a processor, and a touch screen; wherein: The touch screen is used for displaying content; The memory is used for storing a computer program, and the computer program includes program instructions; The processor is used for calling the program instructions to enable the first electronic device to execute the method according to any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images