Terminal equipment screen detection method and device, electronic equipment and readable storage medium

Abstract

The embodiment of the invention provides a terminal equipment screen detection method and device, electronic equipment and a readable storage medium. The method comprises the following steps: acquiring a preset screen fault detection parameter and a screen fault detection threshold value; collecting a screen image of a screen of the terminal equipment; acquiring corresponding key information from the screen image according to the screen fault detection parameters; and comparing the key information with a screen fault detection threshold value, and determining whether the screen has a fault according to a comparison result. According to the embodiment of the invention, the detection program can be automatically started to obtain the screen fault detection parameter and the screen fault detection threshold value, the screen image of the terminal equipment is obtained in real time, and the key information is extracted from the screen image according to the screen fault detection parameter to determine whether the screen has a fault, so that the screen fault can be found and processed in time; and the control experience of the user on the terminal equipment is ensured.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of terminal technology, and in particular, to a terminal device screen detection method, a terminal device screen detection device, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the continuous development of terminal devices, the performance and stability of the screen of smart devices, as one of the core parts of user control of terminal devices, are increasingly receiving attention. The screen is an important component of smart devices, and its quality directly affects the user experience.

[0003] However, screen failures of terminal devices often occur in actual applications, causing inconvenience to users in controlling the terminal devices. Summary of the invention

[0004] In view of the above problems, a method and device for detecting the screen of a terminal device is proposed to overcome the above problems or at least partially solve the above problems. The specific technical solution is as follows:

[0005] An embodiment of the present invention discloses a terminal device screen detection method, the method comprising:

[0006] Obtaining preset screen fault detection parameters and screen fault detection thresholds;

[0007] Capturing a screen image of a screen of the terminal device;

[0008] Acquiring corresponding key information from the screen image according to the screen fault detection parameter;

[0009] The key information is compared with the screen fault detection threshold, and whether the screen has a fault is determined according to the comparison result.

[0010] In one embodiment of the present invention, the terminal device at least includes a home central control screen in a smart home system; the key information at least includes a pixel brightness value and a color distribution value.

[0011] In one embodiment of the present invention, obtaining a preset screen fault detection parameter and a screen fault detection threshold includes:

[0012] When the terminal device is turned on or enters a standby state, a preset screen fault detection parameter and a screen fault detection threshold are obtained.

[0013] In an embodiment of the present invention, the screen fault detection threshold includes a screen response time threshold, and the method further includes:

[0014] Monitoring a screen response time of a screen of the terminal device;

[0015] The screen response time is compared with the screen response time threshold, and whether the screen has a fault is determined according to the comparison result.

[0016] In an embodiment of the present invention, after comparing the key information with the screen fault detection threshold and determining whether the screen has a fault according to the comparison result, the method further includes:

[0017] Determine a fault type corresponding to the fault; the fault type includes at least a hardware fault and a software fault, the hardware fault includes at least bright spots, dark spots, display stripes and touch failure on the screen, and the software fault includes at least an incorrect resolution setting of the screen, driver incompatibility and system failure.

[0018] In an embodiment of the present invention, after determining the fault type corresponding to the fault, the method further includes:

[0019] The fault is located according to the fault type to obtain fault location information.

[0020] In an embodiment of the present invention, the key information includes key information obtained from the system configuration and system log of the terminal device, and the fault is located according to the fault type to obtain the fault location information, including:

[0021] When the fault type is a hardware fault, generating a plane coordinate system according to the screen size of the screen;

[0022] Determine coordinate position information of a fault point in the screen in the plane coordinate system, and use the coordinate position information as fault position information of the fault;

[0023] When the fault type is a software fault, the key information corresponding to the screen fault is determined to be obtained from the system configuration or the system log, and the system configuration or the system log is used as the fault location information of the fault.

[0024] In one embodiment of the present invention, the method further comprises:

[0025] determining the fault degree of the fault according to the difference between the key information and the screen fault detection threshold;

[0026] A fault analysis report is generated according to the fault degree, fault type and fault location information.

[0027] In one embodiment of the present invention, the method further comprises:

[0028] Generate a fault resolution suggestion plan based on the fault analysis report; the fault resolution suggestion plan at least includes restarting the terminal device, adjusting the screen brightness of the terminal device, and contacting after-sales service.

[0029] The embodiment of the present invention further discloses a terminal device screen detection device, the device comprising:

[0030] A detection data acquisition module, used to obtain preset screen fault detection parameters and screen fault detection thresholds;

[0031] A screen image acquisition module, used to acquire a screen image of the screen of the terminal device;

[0032] A key information acquisition module, used to acquire corresponding key information from the screen image according to the screen fault detection parameter;

[0033] The fault determination module is used to compare the key information with the screen fault detection threshold, and determine whether the screen has a fault according to the comparison result.

[0034] In one embodiment of the present invention, the terminal device at least includes a home central control screen in a smart home system; the key information at least includes a pixel brightness value and a color distribution value.

[0035] In one embodiment of the present invention, the detection data acquisition module is used to:

[0036] When the terminal device is turned on or enters a standby state, a preset screen fault detection parameter and a screen fault detection threshold are obtained.

[0037] In an embodiment of the present invention, the screen fault detection threshold includes a screen response time threshold, and the device further includes: a screen response time monitoring module, which is used to:

[0038] Monitoring a screen response time of a screen of the terminal device;

[0039] The screen response time is compared with the screen response time threshold, and whether the screen has a fault is determined according to the comparison result.

[0040] In an embodiment of the present invention, the device further includes: a fault type determination module, configured to:

[0041] Determine a fault type corresponding to the fault; the fault type includes at least a hardware fault and a software fault, the hardware fault includes at least bright spots, dark spots, display stripes and touch failure on the screen, and the software fault includes at least an incorrect resolution setting of the screen, driver incompatibility and system failure.

[0042] In an embodiment of the present invention, the device further includes: a fault location information determination module, configured to:

[0043] The fault is located according to the fault type to obtain fault location information.

[0044] In one embodiment of the present invention, the key information includes key information obtained from the system configuration and system log of the terminal device, and the fault location information determination module is used to:

[0045] When the fault type is a hardware fault, generating a plane coordinate system according to the screen size of the screen;

[0046] Determine coordinate position information of a fault point in the screen in the plane coordinate system, and use the coordinate position information as fault position information of the fault;

[0047] When the fault type is a software fault, the key information corresponding to the screen fault is determined to be obtained from the system configuration or the system log, and the system configuration or the system log is used as the fault location information of the fault.

[0048] In one embodiment of the present invention, the device further comprises: a fault degree determination module, configured to:

[0049] determining the fault degree of the fault according to the difference between the key information and the screen fault detection threshold;

[0050] A fault analysis report is generated according to the fault degree, fault type and fault location information.

[0051] In one embodiment of the present invention, the device further comprises: a fault solution suggestion determination module, which is used to:

[0052] Generate a fault resolution suggestion plan based on the fault analysis report; the fault resolution suggestion plan at least includes restarting the terminal device, adjusting the screen brightness of the terminal device, and contacting after-sales service.

[0053] The embodiment of the present invention further discloses an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0054] The memory is used to store computer programs;

[0055] The processor is used to implement the method described in the embodiment of the present invention when executing the program stored in the memory.

[0056] The embodiment of the present invention further discloses a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the embodiment of the present invention.

[0057] The embodiment of the present invention further discloses a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, enables the processors to execute the method described in the embodiment of the present invention.

[0058] The embodiments of the present invention include the following advantages:

[0059] In an embodiment of the present invention, a preset screen fault detection parameter and a screen fault detection threshold are obtained; a screen image of the screen of the terminal device is collected, corresponding key information is obtained from the screen image according to the screen fault detection parameter, the key information is compared with the screen fault detection threshold, and then it can be determined whether the screen has a fault according to the comparison result. The embodiment of the present invention can automatically start the detection program to obtain the screen fault detection parameter and the screen fault detection threshold, obtain the screen image of the terminal device in real time, and extract key information from the screen image according to the screen fault detection parameter to determine whether the screen has a fault, so that the screen fault can be discovered and processed in time, ensuring the user's control experience of the terminal device. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 is a flowchart of a method for detecting a terminal device screen provided in an embodiment of the present invention;

[0061] Figure 2 It is a schematic diagram of a screen self-check fault location process of a home central control screen provided in an embodiment of the present invention;

[0062] Figure 3 It is a schematic diagram of screen failure analysis and processing of a home central control screen provided in an embodiment of the present invention;

[0063] Figure 4 is a structural block diagram of a terminal device screen detection device provided in an embodiment of the present invention;

[0064] Figure 5 It is a schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present invention. DETAILED DESCRIPTION

[0065] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0066] Reference Figure 1 , shows a flowchart of a terminal device screen detection method provided in an embodiment of the present invention, which may specifically include the following steps:

[0067] Step 101: Obtain preset screen fault detection parameters and screen fault detection thresholds;

[0068] In some specific embodiments, the terminal device may at least include a home central control screen in a smart home system. The home central control screen is a core control device of the smart home system. A user can control the smart home devices in the smart home system by controlling the home central control screen. Of course, in addition to the home central control screen in the smart home system, the terminal device may also be other devices with a screen, and the embodiments of the present invention do not need to limit this.

[0069] In an embodiment of the present invention, when it is necessary to perform screen fault detection on the screen of a terminal device, the terminal device can automatically start a screen fault self-detection program, and then the screen fault self-detection program reads and loads preset screen fault detection parameters and screen fault detection thresholds. Specifically, according to the screen fault detection parameters, it can be determined which information needs to be collected from the screen image as key information for determining the screen fault. The screen fault detection threshold is used to determine whether there is a range interval of a screen fault, and whether the screen has a fault is determined according to whether the key information falls into the range interval. Exemplarily, the screen fault detection parameters can be pixel brightness values ​​and color distributions, and the key information collected based on the screen fault detection parameters can include the pixel brightness values ​​and color distribution values ​​of the screen. The screen fault detection threshold can include a pixel brightness threshold of 80. If the pixel brightness value of the screen is greater than 80, it can be determined that the screen of the terminal device has a fault of uneven brightness distribution. Among them, the screen fault detection parameters and the screen fault detection threshold can be determined by big data technology, or can be determined by user input, and the embodiment of the present invention does not need to be limited to this.

[0070] Step 102: collecting a screen image of the screen of the terminal device;

[0071] Step 103: acquiring corresponding key information from the screen image according to the screen fault detection parameter;

[0072] In an embodiment of the present invention, a screen image of the screen of a terminal device can be acquired in real time, and the acquired screen image may be one or more. Specifically, the screen image can be acquired in real time by an image sensor built into the terminal device, and the screen image can be preprocessed (preprocessing may include enhancing features, reducing noise, etc.), and then key information can be extracted from the screen image according to screen fault detection parameters, such as pixel brightness values, color distribution values, etc.

[0073] Step 104: Compare the key information with the screen fault detection threshold, and determine whether the screen has a fault based on the comparison result.

[0074] In the embodiment of the present invention, after extracting key information from the screen image, the key information may be compared with a corresponding screen fault detection threshold, and then whether the screen has a fault may be determined by determining whether the key information falls within a range.

[0075] In some specific embodiments, image processing technology and machine learning algorithms can be used to perform in-depth analysis of screen images to determine whether the screen has faults such as bright spots, dark spots, uneven colors, slow response speed, etc. Exemplarily, image processing technology can include a singular value decomposition algorithm, which uses a singular value decomposition algorithm to perform matrix decomposition and reconstruct the screen image displayed on the screen, thereby highlighting the bright spots, dark spots, and uneven colors in the screen; using a machine learning algorithm to pre-process the screen data, select features, and build a model. For example, screen data such as screen response time can be processed and analyzed to evaluate whether the screen response time is consistent with the expected setting model, so as to achieve fault judgment on the response speed of the screen.

[0076] In an embodiment of the present invention, in addition to triggering the screen fault self-check process through a terminal device, it can also be triggered by other terminal devices connected to the terminal device, such as through an application APP on a smartphone or instructions from a server background, and the embodiment of the present invention does not need to be limited to this.

[0077] In the above-mentioned terminal device screen detection method, a preset screen fault detection parameter and a screen fault detection threshold are obtained; a screen image of the screen of the terminal device is collected, and corresponding key information is obtained from the screen image according to the screen fault detection parameter, and the key information is compared with the screen fault detection threshold, and then it can be determined whether the screen has a fault according to the comparison result. The embodiment of the present invention can automatically start the detection program to obtain the screen fault detection parameter and the screen fault detection threshold, obtain the screen image of the terminal device in real time, and extract key information from the screen image according to the screen fault detection parameter to determine whether the screen has a fault, so that the fault of the screen of the terminal device can be discovered and processed in time, ensuring the user's control experience of the terminal device.

[0078] In an embodiment of the present invention, obtaining a preset screen fault detection parameter and a screen fault detection threshold may include:

[0079] When the terminal device is turned on or enters a standby state, a preset screen fault detection parameter and a screen fault detection threshold are obtained.

[0080] In an embodiment of the present invention, when the terminal device is turned on or enters a standby state, the screen fault self-detection program can be automatically started, and then the screen fault self-detection program reads and loads preset screen fault detection parameters and screen fault detection thresholds to detect whether the screen has a fault. It should be noted that the communication pins of the screen of the terminal device in the embodiment of the present invention are always in a low-power wake-up state, so that the screen of the terminal device can be monitored in real time in any case such as when the terminal device enters a standby state, so that the screen fault can be discovered and processed in time, ensuring the user's control experience of the terminal device.

[0081] In an embodiment of the present invention, the screen fault detection threshold includes a screen response time threshold, and the method may further include:

[0082] Monitoring a screen response time of a screen of the terminal device;

[0083] The screen response time is compared with the screen response time threshold, and whether the screen has a fault is determined according to the comparison result.

[0084] In specific implementations, screen response time refers to the time required for the screen of a terminal device to complete display changes from receiving a signal. Usually, the response time is measured in milliseconds (ms). Screen response time is an important indicator for measuring the screen display speed and dynamic performance of a terminal device. Screen response time can affect the smoothness and clarity of the image displayed on the screen.

[0085] In an embodiment of the present invention, the system of the terminal device monitors the screen response time, and then the screen response time can be compared with the screen response time threshold, and whether the screen is faulty can be determined based on the comparison result. Exemplarily, if the screen response time is greater than or equal to the screen response time threshold, it means that the screen's reaction speed is not sensitive enough, and the screen has a slow reaction speed fault, and the screen's slow reaction speed fault can be processed in time to ensure that the screen's reaction speed is always in a sensitive state. Of course, if the screen response time is less than the screen response time threshold, it means that the screen's reaction speed is sensitive, and the screen does not have a slow reaction speed fault, and no processing is required.

[0086] In an embodiment of the present invention, after comparing the key information with the screen fault detection threshold and determining whether the screen has a fault according to the comparison result, the method may further include:

[0087] Determine a fault type corresponding to the fault.

[0088] In a specific implementation, the types of screen failures can be divided into at least two categories: hardware failures and software failures. Specifically, hardware failures are related to the physical characteristics of the screen, usually related to the screen itself, and can at least include bright spots, dark spots, display stripes, and touch failures on the screen, etc. Software failures are related to the system configuration (display settings, driver) or system log of the screen, and can at least include resolution setting errors, driver incompatibility, and system failures of the screen, etc. Specifically, the system configuration records the settings and parameters of the terminal device, such as screen resolution, driver version, user preferences, etc.; the system log records various events and error information during the operation of the terminal device, such as screen startup, shutdown, errors, warnings, crashes, etc., and fault location can be performed based on the system log.

[0089] In an embodiment of the present invention, after determining that there is a fault on the screen of the terminal device, the fault type corresponding to the fault can be further determined, that is, whether it is a hardware fault or a software fault, and then corresponding fault solution suggestions can be provided or the fault can be located according to the fault type, so as to deal with the screen fault in a timely manner.

[0090] In an embodiment of the present invention, after determining the fault type corresponding to the fault, the method may further include:

[0091] The fault is located according to the fault type to obtain fault location information.

[0092] In a specific implementation, different fault types have different ways of locating faults, so the fault location information can be obtained by locating the fault according to the fault type. For example, when the fault type is a hardware fault, the fault is usually the screen itself, so the fault location information can be directly located on the screen. When the fault type is a software fault, the fault is usually a fault in the system configuration or system log of the terminal device, so it is necessary to further determine whether the system configuration or system log is determined as the fault location information. The embodiment of the present invention can improve the efficiency of fault location by locating the screen fault according to the fault type to obtain the fault location information.

[0093] In some embodiments, based on the features of the fault point of the screen fault (e.g., key information), the terminal device can further determine the fault type to locate the fault and obtain fault location information, and use image processing technology and other methods to accurately mark the specific location of the fault point on the screen based on the fault location information, so that it is convenient for users or maintenance personnel to quickly locate the fault and handle it. Exemplarily, the screen image displayed on the screen can be denoised, enhanced, and feature extracted through image processing technology, and then matched, located, and marked according to the extracted features to achieve fault location.

[0094] In an embodiment of the present invention, the key information includes key information obtained from the system configuration and system log of the terminal device, and the fault is located according to the fault type to obtain the fault location information, including:

[0095] When the fault type is a hardware fault, generating a plane coordinate system according to the screen size of the screen;

[0096] Determine coordinate position information of a fault point in the screen in the plane coordinate system, and use the coordinate position information as fault position information of the fault;

[0097] When the fault type is a software fault, the key information corresponding to the screen fault is determined to be obtained from the system configuration or the system log, and the system configuration or the system log is used as the fault location information of the fault.

[0098] In an embodiment of the present invention, when the fault type is a hardware fault, the terminal device generates a plane coordinate system according to the screen size of the screen, which is used to accurately locate the position of the fault point in the screen. For example, for hardware faults, such as bright spots, dark spots, display stripes, touch failure, etc., the terminal device can accurately obtain the fault position information of the fault point in the screen. For example, if the screen has a fault of excessive brightness, the position of excessive brightness can be determined as the fault point where the fault exists, and then the coordinate position information of the fault point can be determined according to the plane coordinate system as the fault position information of the fault.

[0099] In an embodiment of the present invention, key information may include key information obtained from the system configuration and system log of the terminal device. For example, key information such as setting resolution and the latest version of the driver can be obtained from the system configuration, and key information such as the existence of multiple crash records on the screen can be obtained from the system log. When the fault type is a software fault, the terminal device determines the fault location information of the fault based on the system configuration or the system log. For software faults, such as resolution setting errors, driver incompatibility, system faults, etc., the terminal device can determine the relevant key information obtained from the system configuration or the system log. For example, assuming that the screen has an actual resolution (the actual resolution can be determined based on the screen image) that is different from the set resolution of the system configuration, it means that the determination of the screen fault is determined by obtaining key information from the system configuration, that is, the setting resolution, and the system configuration can be used as the fault location information of the fault. The screen fault can be solved later by adjusting the system configuration.

[0100] In one embodiment of the present invention, the method may further include:

[0101] determining the fault degree of the fault according to the difference between the key information and the screen fault detection threshold;

[0102] A fault analysis report is generated according to the fault degree, fault type and fault location information.

[0103] In an embodiment of the present invention, the terminal device system determines the severity of the fault (fault degree) according to the difference between the extracted key information and the screen fault detection threshold. According to the fault degree of the fault, the user or maintenance personnel can determine whether it needs to be handled as soon as possible to prevent the fault from further increasing. Exemplarily, the fault degree can be divided into three fault degrees: high, medium and low. Assuming that the maximum brightness of the screen is detected to be 100, and the brightness threshold is 80, the difference is 20, and it can be determined that the screen has a bright spot fault of medium fault degree.

[0104] Furthermore, after determining the fault extent, a detailed fault analysis report can be further generated based on parameters such as the fault extent, fault type and fault location information, so that the user can quickly understand the screen status based on the fault analysis report and then perform corresponding processing.

[0105] In one embodiment of the present invention, the method may further include:

[0106] Generate a fault resolution suggestion plan based on the fault analysis report; the fault resolution suggestion plan at least includes restarting the terminal device, adjusting the screen brightness of the terminal device, and contacting after-sales service.

[0107] In an embodiment of the present invention, the terminal device can automatically generate a detailed fault analysis report, the content of which may include at least important information such as the fault type, fault location information, and fault degree. Then, based on the fault analysis report, such as the fault type and severity in the fault analysis report, the terminal device can provide the user with corresponding fault solution suggestions. Specifically, the fault solution suggestions may include restarting the home central control screen, adjusting the screen brightness, contacting after-sales service, etc.

[0108] In some embodiments of the present invention, fault analysis reports and fault solution suggestions can also be synchronously saved in the storage system of the home central control screen, thereby providing users with a historical fault query function, allowing them to conveniently view past fault analysis reports and fault solution suggestions at any time, and providing solutions to terminal device screen failures.

[0109] The self-check process of the screen of the terminal device in the embodiment of the present invention can promptly notify the user to perform fault processing when the screen fails, thereby minimizing data loss and damage caused by the screen failure, thereby ensuring data security. In addition, through the locally stored historical fault analysis reports and fault solution suggestions, the screen self-check process is performed with the user's knowledge. In addition, the embodiment of the present invention can run independently on the terminal device, thereby ensuring the security of private data.

[0110] In order to enable those skilled in the art to better understand the embodiments of the present invention, specific examples are used for illustration below.

[0111] Reference Figure 2 , is a schematic diagram of a screen self-check fault location process of a home central control screen provided in an embodiment of the present invention. The specific process may include:

[0112] 1. The home central control screen enters the power-on or standby state; 2. Enters the screen self-test system (screen self-test program); 3. Captures the screen image (screen image information); 4. Preprocesses the screen image; 5. Extracts key information from the preprocessed screen image; 6. Performs in-depth analysis of key information; 7. Detects the screen response speed (screen response time); 8. Locates the fault based on the results of the in-depth analysis and the screen response speed.

[0113] Reference Figure 3 , is a schematic diagram of screen failure analysis and processing of a home central control screen provided in an embodiment of the present invention, and the specific process may include:

[0114] 1. Determine the fault type; 2. Locate the fault according to the fault type; 3. Generate a plane coordinate system and mark the fault point according to the plane coordinate system; 4. Generate a fault analysis report; 5. Provide fault solution suggestions; 6. Synchronously record the fault analysis report and fault solution suggestions.

[0115] In an embodiment of the present invention, when the home central control screen is turned on or enters the standby state, the system of the home central control screen will automatically start the screen fault self-detection program, then read and load the preset screen fault detection parameters and screen fault detection thresholds, and then enter the screen self-detection state. First, the terminal device will collect the screen image in real time through the built-in image sensor, pre-process the screen image, and then extract key information from the pre-processed screen image, such as pixel brightness, color distribution, etc. At the same time, the system of the terminal device will monitor the screen response time to ensure that the screen's response speed is always in a sensitive state. Subsequently, the screen image is deeply analyzed using image processing technology and machine learning algorithms to determine whether the screen has bright spots, dark spots, uneven colors, slow response speed and other faults. If a fault is detected, the system will immediately locate the fault point and generate a detailed fault analysis report. Among them, the fault analysis report may include information such as fault type, location (cause), fault degree, fault location information, etc., so that users can quickly understand the screen condition of the terminal device's screen.

[0116] In an embodiment of the present invention, based on the characteristics of the fault point (such as key information), the system of the terminal device will further determine the fault type and locate the fault, use image processing technology to accurately mark the position of the fault point on the screen (fault location information), and generate a plane coordinate system based on the screen size to provide coordinate location information of the fault point, so as to facilitate users or maintenance personnel to quickly locate the fault; and based on the results of the fault analysis (i.e., fault type, fault degree, fault location information, etc.), the system automatically generates a detailed fault analysis report, and the content of the fault analysis report may include information such as fault type, fault location, fault degree, etc. Then, based on the fault type and severity, the system of the terminal device can provide users with corresponding fault solution suggestions. Among them, the fault solution suggestions may include but are not limited to restarting the home central control screen, adjusting the screen brightness, contacting after-sales service, etc.

[0117] Moreover, in an embodiment of the present invention, the fault analysis report and fault solution suggestion plan will also be synchronously saved in the storage system of the home central control screen, providing the user with a historical fault query function, so that the user can conveniently check the past fault analysis reports and fault solution suggestion plans at any time, thereby providing the user with ideas for solving the fault.

[0118] The screen self-check system method for the home central control screen proposed in the embodiment of the present invention realizes a comprehensive self-check of the screen of the home central control screen by real-time monitoring of the screen status, using advanced image processing technology and machine learning algorithms for fault detection, providing an intuitive and easy-to-use user interaction interface (graphical user interface), and ensuring data security and privacy protection. The embodiment of the present invention not only improves the detection efficiency and user experience of the screen of the home central control screen, but also reduces the maintenance cost of the screen of the home central control screen and enhances the competitiveness of the product. In the future, with the continuous advancement of technology, the embodiment of the present invention can continue to be further improved and optimized to provide strong support for the development of smart homes.

[0119] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0120] Reference Figure 4 , shows a structural block diagram of a terminal device screen detection device provided in an embodiment of the present invention, and the device may specifically include the following modules:

[0121] The detection data acquisition module 401 is used to obtain preset screen fault detection parameters and screen fault detection thresholds;

[0122] A screen image acquisition module 402, used to acquire a screen image of the screen of the terminal device;

[0123] A key information acquisition module 403, configured to acquire corresponding key information from the screen image according to the screen fault detection parameter;

[0124] The fault determination module 404 is used to compare the key information with the screen fault detection threshold, and determine whether the screen has a fault according to the comparison result.

[0125] In one embodiment of the present invention, the terminal device at least includes a home central control screen in a smart home system; the key information at least includes a pixel brightness value and a color distribution value.

[0126] In one embodiment of the present invention, the detection data acquisition module 401 is used to:

[0127] When the terminal device is turned on or enters a standby state, a preset screen fault detection parameter and a screen fault detection threshold are obtained.

[0128] In an embodiment of the present invention, the screen fault detection threshold includes a screen response time threshold, and the device further includes: a screen response time monitoring module, which is used to:

[0129] Monitoring a screen response time of a screen of the terminal device;

[0130] The screen response time is compared with the screen response time threshold, and whether the screen has a fault is determined according to the comparison result.

[0131] In an embodiment of the present invention, the device further includes: a fault type determination module, configured to:

[0132] Determine a fault type corresponding to the fault; the fault type includes at least a hardware fault and a software fault, the hardware fault includes at least bright spots, dark spots, display stripes and touch failure on the screen, and the software fault includes at least an incorrect resolution setting of the screen, driver incompatibility and system failure.

[0133] In an embodiment of the present invention, the device further includes: a fault location information determination module, configured to:

[0134] The fault is located according to the fault type to obtain fault location information.

[0135] In one embodiment of the present invention, the fault location information determination module is used to:

[0136] When the fault type is a hardware fault, generating a plane coordinate system according to the screen size of the screen;

[0137] Determine coordinate position information of a fault point in the screen in the plane coordinate system, and use the coordinate position information as fault position information of the fault;

[0138] When the fault type is a software fault, the key information corresponding to the screen fault is determined to be obtained from the system configuration or the system log, and the system configuration or the system log is used as the fault location information of the fault.

[0139] In one embodiment of the present invention, the device further comprises: a fault degree determination module, configured to:

[0140] determining the fault degree of the fault according to the difference between the key information and the screen fault detection threshold;

[0141] A fault analysis report is generated according to the fault degree, fault type and fault location information.

[0142] In one embodiment of the present invention, the device further comprises: a fault solution suggestion determination module, which is used to:

[0143] Generate a fault resolution suggestion plan based on the fault analysis report; the fault resolution suggestion plan at least includes restarting the terminal device, adjusting the screen brightness of the terminal device, and contacting after-sales service.

[0144] In an embodiment of the present invention, a preset screen fault detection parameter and a screen fault detection threshold are obtained; a screen image of the screen of the terminal device is collected, corresponding key information is obtained from the screen image according to the screen fault detection parameter, the key information is compared with the screen fault detection threshold, and then it can be determined whether the screen has a fault according to the comparison result. The embodiment of the present invention can automatically start the detection program to obtain the screen fault detection parameter and the screen fault detection threshold, obtain the screen image of the terminal device in real time, and extract key information from the screen image according to the screen fault detection parameter to determine whether the screen has a fault, so that the screen fault can be discovered and processed in time, ensuring the user's control experience of the terminal device.

[0145] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0146] In addition, an embodiment of the present invention further provides an electronic device, including: a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned terminal device screen detection method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0147] The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the above-mentioned terminal device screen detection method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0148] An embodiment of the present invention also provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the various processes of the above-mentioned terminal device screen detection method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0149] Figure 5A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present invention.

[0150] The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511. Those skilled in the art will appreciate that Figure 5 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. In the embodiments of the present invention, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted terminal, a wearable device, and a pedometer.

[0151] It should be understood that in the embodiment of the present invention, the radio frequency unit 501 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving downlink data from the base station, it is sent to the processor 510 for processing; in addition, uplink data is sent to the base station. Generally, the radio frequency unit 501 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

[0152] The electronic device provides users with wireless broadband Internet access through the network module 502, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0153] The audio output unit 503 can convert the audio data received by the RF unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output it as sound. Moreover, the audio output unit 503 can also provide audio output related to a specific function performed by the electronic device 500 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, etc.

[0154] The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processor (GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 506. The image frame processed by the graphics processor 5041 can be stored in the memory 509 (or other storage medium) or sent via the radio frequency unit 501 or the network module 502. The microphone 5042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 501 in the case of a telephone call mode.

[0155] The electronic device 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 5061 and / or the backlight when the electronic device 500 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 505 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0156] The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0157] The user input unit 507 can be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. The touch panel 5071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 5071 or near the touch panel 5071 using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 5071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the contact point coordinates, and then sends it to the processor 510, receives the command sent by the processor 510 and executes it. In addition, the touch panel 5071 can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch panel 5071, the user input unit 507 may also include other input devices 5072. Specifically, other input devices 5072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here.

[0158] Furthermore, the touch panel 5071 may be overlaid on the display panel 5061. When the touch panel 5071 detects a touch operation on or near it, it transmits the information to the processor 510 to determine the type of the touch event. Then, the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Figure 5 In the figure, the touch panel 5071 and the display panel 5061 are used as two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.

[0159] The interface unit 508 is an interface for connecting an external device to the electronic device 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device 500 or may be used to transmit data between the electronic device 500 and an external device.

[0160] The memory 509 can be used to store software programs and various data. The memory 509 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 509 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0161] The processor 510 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 509 and calling data stored in the memory 509, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 510.

[0162] The electronic device 500 may also include a power source 511 (such as a battery) for supplying power to each component. Preferably, the power source 511 may be logically connected to the processor 510 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0163] In addition, the electronic device 500 includes some functional modules not shown, which will not be described in detail here.

[0164] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0165] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0166] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

[0167] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0168] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0169] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0170] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0171] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0172] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

[0173] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A terminal device screen detection method, characterized in that: The method comprises: Obtaining preset screen fault detection parameters and screen fault detection thresholds; Capturing a screen image of a screen of the terminal device; Acquiring corresponding key information from the screen image according to the screen fault detection parameter; The key information is compared with the screen fault detection threshold, and whether the screen has a fault is determined according to the comparison result.

2. The method according to claim 1, characterized in that The terminal device at least includes a home central control screen in a smart home system; the key information at least includes a pixel brightness value and a color distribution value.

3. The method according to claim 1, characterized in that Get the preset screen fault detection parameters and screen fault detection thresholds, including: When the terminal device is turned on or enters a standby state, a preset screen fault detection parameter and a screen fault detection threshold are obtained.

4. The method according to claim 1, characterized in that: The screen fault detection threshold includes a screen response time threshold, and the method further includes: Monitoring a screen response time of a screen of the terminal device; The screen response time is compared with the screen response time threshold, and whether the screen has a fault is determined according to the comparison result.

5. The method according to claim 1, characterized in that After comparing the key information with the screen fault detection threshold and determining whether the screen has a fault according to the comparison result, the method further includes: Determine a fault type corresponding to the fault; the fault type includes at least a hardware fault and a software fault, the hardware fault includes at least bright spots, dark spots, display stripes and touch failure on the screen, and the software fault includes at least an incorrect resolution setting of the screen, driver incompatibility and system failure.

6. The method according to claim 1, characterized in that After determining the fault type corresponding to the fault, the method further includes: The fault is located according to the fault type to obtain fault location information.

7. The method according to claim 6, characterized in that The key information includes key information obtained from the system configuration and system log of the terminal device, and the fault location information is obtained by locating the fault according to the fault type, including: When the fault type is a hardware fault, generating a plane coordinate system according to the screen size of the screen; Determine coordinate position information of a fault point in the screen in the plane coordinate system, and use the coordinate position information as fault position information of the fault; When the fault type is a software fault, the key information corresponding to the screen fault is determined to be obtained from the system configuration or the system log, and the system configuration or the system log is used as the fault location information of the fault.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: determining the fault degree of the fault according to the difference between the key information and the screen fault detection threshold; A fault analysis report is generated according to the fault degree, fault type and fault location information.

9. The method according to claim 8, characterized in that The method further comprises: Generate a fault resolution suggestion plan based on the fault analysis report; the fault resolution suggestion plan at least includes restarting the terminal device, adjusting the screen brightness of the terminal device, and contacting after-sales service.

10. A terminal device screen detection device, characterized in that: The device comprises: A detection data acquisition module, used to obtain preset screen fault detection parameters and screen fault detection thresholds; A screen image acquisition module, used to acquire a screen image of the screen of the terminal device; A key information acquisition module, used to acquire corresponding key information from the screen image according to the screen fault detection parameter; The fault determination module is used to compare the key information with the screen fault detection threshold, and determine whether the screen has a fault according to the comparison result.

11. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is used to store computer programs; The processor is used to implement the method according to any one of claims 1 to 9 when executing the program stored in the memory.

12. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to any one of claims 1 to 9.

Images