Screen detection method and system

By establishing a communication link between the quality inspection client and the server, generating a touch detection guide map and automatically sliding the touch screen, the problems of low efficiency and insufficient accuracy in the existing technology are solved, and efficient and accurate Screen detection.

CN119002727APending Publication Date: 2024-11-22转转一零二四(北京)科技有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411067657.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing screen detection methods rely on manual detection, are inefficient and easily subjectively affected, and cannot accurately detect minor touch problems, such as broken touch and messy touch, which affect the detection accuracy.

Method used

By establishing a communication link between the quality inspection client and the server, a touch detection guide map is generated, and the touch detection device is automatically sliding the touch screen, obtaining point data and analyzing it, and automatically generating quality inspection results to improve detection efficiency and accuracy Spend.

Benefits of technology

It realizes automation of screen detection, improves detection efficiency and accuracy, reduces manual subjective influence, and can accurately detect tiny touch problems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002727A_ABST
    Figure CN119002727A_ABST
Patent Text Reader

Abstract

The invention provides a screen detection method and system, and the method is applied to a quality inspection client, and comprises the steps: sending the equipment information of detected equipment to a server, so as to enable the server to determine a to-be-detected area of a screen of the detected equipment; based on the to-be-detected area of the screen, generating a touch detection guide graph, so that the touch detection equipment performs sliding touch operation on the screen of the detected equipment according to the touch detection guide graph; obtaining point location data of touch control of a screen of the detected equipment, so that the server determines a quality inspection result of a to-be-detected area of the screen based on the point location data; and determining a screen quality inspection result of the detected equipment based on the quality inspection result of the to-be-detected area of the screen. According to the scheme, the touch detection guide map is automatically generated through the server side and the quality inspection client side, the touch detection device is used for automatically conducting sliding touch operation on the screen according to the touch detection guide map, the screen quality inspection result is determined according to the touched point position data of the screen, automatic screen detection is achieved, and the efficiency and accuracy of screen detection are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of device detection, and in particular to a screen detection method and system. Background Art

[0002] Second-hand e-commerce platforms are trading platforms for second-hand goods. When users sell second-hand goods on second-hand e-commerce platforms, second-hand e-commerce platforms need to conduct quality inspections on the second-hand goods they sell. For electronic devices with screens, the quality of the screen touch plays a vital role in the pricing of the electronic devices, so the touch screen is also a hardware that must be inspected for the quality inspection of second-hand electronic devices.

[0003] The existing screen detection method is usually manual detection, which has low detection efficiency. Manual detection is completely dependent on human feedback and judgment of screen touch, which is easily affected by subjective consciousness. In addition, some minor touch problems (less than 9 square millimeters) such as broken touch and random touch are almost not observed by the naked eye and are often ignored, affecting the accuracy of screen detection. Summary of the invention

[0004] Based on the above requirements, the present application proposes a screen detection method and system, which can improve the efficiency and accuracy of screen detection.

[0005] To achieve the above objectives, this application proposes the following technical solutions:

[0006] According to a first aspect of an embodiment of the present application, a screen detection method is provided, which is applied to a quality inspection client, and the quality inspection client is installed on a device to be inspected. The method includes:

[0007] Sending the read device information of the detected device to a server, so that the server determines the screen area to be detected of the detected device;

[0008] Generate a touch detection guide map based on the screen area to be detected fed back by the server, so that the touch detection device performs a sliding touch operation on the screen of the device to be detected according to the touch detection guide map;

[0009] Acquire the point data of the screen of the detected device being touched, and upload the point data to the server, so that the server analyzes the point data and determines the quality inspection result of the area to be detected on the screen;

[0010] Based on the quality inspection result of the screen area to be inspected fed back by the server, the screen quality inspection result of the inspected device is determined.

[0011] Optionally, after acquiring the touch point data of the screen of the detected device, the method further includes:

[0012] Based on the touch detection guide map and all point data, determining whether there is a broken contact point in the touch detection guide map; wherein the broken contact point is a point that has not been touched;

[0013] If there is a broken contact point and the number of broken contact detections does not reach a preset number, the number of broken contact detections is updated, and broken contact detection data is generated based on all broken contact points, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the broken contact detection data;

[0014] The touch point data of the screen of the detected device is obtained, and the touch point data is uploaded to the server.

[0015] Optionally, the screen detection method further includes:

[0016] If there is a broken contact point and the number of broken contact detections reaches a preset number, it is determined that the screen quality inspection result of the detected device is that the screen is abnormal.

[0017] Optionally, determining the screen quality inspection result of the detected device based on the quality inspection result of the screen area to be detected fed back by the server includes:

[0018] If the confidence level data included in the quality inspection result of the screen area to be inspected reaches a preset threshold, it is determined that the screen quality inspection result of the inspected device indicates that the screen is normal.

[0019] Optionally, the screen detection method further includes:

[0020] If the confidence level data included in the quality inspection result of the screen area to be detected does not reach the preset threshold, the quality inspection result of the screen area to be detected includes the screen area to be detected re-determined by the server; wherein the re-determined screen area to be detected does not include the screen area that has been detected, and the confidence level data is calculated based on the addition of weight values ​​corresponding to the areas where the data of each point where the screen is touched are located;

[0021] A touch detection guide map is generated based on the re-determined screen area to be detected to perform screen detection.

[0022] According to a second aspect of an embodiment of the present application, a screen detection method is provided, which is applied to a server, and the method includes:

[0023] Based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database and the detected screen area of ​​the detected device, determine the screen area to be detected of the detected device, and send the screen area to be detected of the detected device to the quality inspection client; the detection area database stores the required inspection area and historical fault area corresponding to the device information;

[0024] The touch point data of the screen of the inspected device sent by the quality inspection client is analyzed to determine the quality inspection result of the area to be inspected on the screen.

[0025] Optionally, the determining the screen area to be inspected of the device to be inspected based on the device information of the device to be inspected sent by the quality inspection client, a pre-built inspection area database, and the inspected screen area of ​​the device to be inspected includes:

[0026] Based on the device information of the detected device sent by the quality inspection client, the screen of the detected device is divided into at least two areas;

[0027] Determine the weight value of each area based on the device information of the device to be tested sent by the quality inspection client, the pre-built detection area database and the screen detection area of ​​the device to be tested;

[0028] Based on the weight values ​​of the respective areas, at least one area is selected from all the areas to obtain the screen area to be detected of the detected device.

[0029] Optionally, analyzing the touch point data of the screen of the device to be inspected sent by the quality inspection client to determine the quality inspection result of the area to be inspected on the screen includes:

[0030] Determine the area where the data of each point on the screen of the device under inspection sent by the quality inspection client is located as the touched area;

[0031] Add up the weight values ​​corresponding to all touched areas as confidence level data;

[0032] If the confidence level data reaches a preset threshold, the confidence level data is used as the quality inspection result of the screen area to be inspected;

[0033] If the confidence level data does not reach the preset threshold, the screen area to be detected of the device to be detected is re-determined based on the device information of the device to be detected, the pre-built detection area database and the screen area of ​​the device to be detected, and the re-determined screen area to be detected and the confidence level data are both used as the quality inspection results of the screen area to be detected.

[0034] According to a third aspect of an embodiment of the present application, a screen detection system is provided, including: a quality inspection client, a touch detection device, and a server, wherein the quality inspection client runs on a detected device;

[0035] When the detected device runs the quality inspection client, the screen detection method applied to the quality inspection client is executed;

[0036] The server is used to execute the screen detection method applied to the server;

[0037] The touch detection device is used to perform a sliding touch operation on the screen of the detected device according to the touch detection guide map displayed by the detected device.

[0038] Optionally, the touch detection device includes: a mechanical arm, a camera device, a conveying device and a detection box;

[0039] The mechanical arm is arranged in the detection box, and the camera device is arranged on the mechanical arm;

[0040] The conveying device is used to convey the detected device to the detection box, and to convey the detected device out of the detection box;

[0041] The camera device is used to capture the touch detection guide image displayed by the detected device;

[0042] The mechanical arm is used to perform a sliding touch operation on the screen of the detected device according to the touch detection guide map.

[0043] The screen detection method proposed in the present application is applied to a quality inspection client, and the quality inspection client is installed on the device to be detected. The method includes: sending the device information of the device to be detected read to the server, so that the server determines the screen area to be detected of the device to be detected; generating a touch detection guide map based on the screen area to be detected fed back by the server, so that the touch detection device performs a sliding touch operation on the screen of the device to be detected according to the touch detection guide map; obtaining the point data of the screen of the device to be detected being touched, and uploading the point data to the server, so that the server analyzes the point data and determines the quality inspection result of the screen area to be detected; based on the quality inspection result of the screen area to be detected fed back by the server, the screen quality inspection result of the device to be detected is determined. By adopting the technical solution of the present application, the touch detection guide map can be automatically generated by the server and the quality inspection client, and the touch detection device can automatically perform a sliding touch operation on the screen according to the touch detection guide map, thereby automatically determining the screen quality inspection result according to the acquired point data of the screen being touched, realizing automatic screen detection, and improving the efficiency and accuracy of screen detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0045] Figure 1A schematic diagram of a flow chart of a screen detection method applied to a quality inspection client provided in an embodiment of the present application;

[0046] Figure 2 A schematic diagram of a touch detection guide map provided in an embodiment of the present application;

[0047] Figure 3 A flowchart of another screen detection method applied to a quality inspection client provided in an embodiment of the present application;

[0048] Figure 4 A flowchart of a screen detection method applied to a server provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of the structure of a screen detection system provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of the structure of another screen detection system provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solution of the embodiment of the present application is applicable to the application scenario of electronic device detection, and is specifically used in the application scenario of electronic device screen detection. The technical solution of the embodiment of the present application can improve the efficiency and accuracy of screen detection.

[0053] A second-hand e-commerce platform is a platform for trading second-hand goods. Users can buy and sell second-hand goods through the second-hand e-commerce platform. After receiving the products that customers want to sell, the second-hand e-commerce platform will not directly sell the products on the second-hand e-commerce platform. Instead, it needs to conduct quality inspections on the products and determine whether the products can be sold and the selling price based on the quality inspection results. For electronic devices with touch screens, the touch function of the screen plays a vital role in the pricing of electronic devices, such as mobile phones and tablets. Therefore, for electronic devices with touch screens, the screen is a necessary testing hardware for equipment quality inspection.

[0054] The existing screen detection method usually adopts manual detection, which relies on human touch operation to make feedback judgments, and the detection efficiency is low. In particular, after the detection personnel have been working for a long time, the quality inspection efficiency shows a significant downward trend. In addition, manual detection is easily affected by the subjective consciousness of the detection personnel, and some minor touch problems (for example, broken touch, random touch, etc. less than 9 square millimeters) are almost not observed by the naked eye, and are easily ignored by the detection personnel, thus affecting the accuracy of screen detection.

[0055] Based on this, the present application proposes a screen detection method, which can realize automatic screen detection, thereby solving the problem of low efficiency and accuracy of screen detection in the prior art.

[0056] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] Exemplary Methods

[0058] See also Figure 1 As shown, the embodiment of the present application proposes a screen detection method, which is applied to a quality inspection client, and the quality inspection client is installed on the device to be inspected, wherein the quality inspection client is preferably a quality inspection APP. The method includes:

[0059] S101 : sending the read device information of the detected device to a server, so that the server determines a screen area to be detected of the detected device.

[0060] In this embodiment, the quality inspection client is pre-installed in the device to be inspected that needs to perform screen inspection, so that the device to be inspected can run the quality inspection client. The quality inspection client installed in the device to be inspected pre-builds a communication link with the server, so that data interaction between the quality inspection client and the server can be achieved. Among them, the server is a server or a cloud.

[0061] When the detected device runs the quality inspection client, the quality inspection client can read the device information of the detected device, wherein the device information of the detected device includes: the model, system version, international mobile equipment identity (IMEI) and other information of the detected device. After the quality inspection client reads the device information of the detected device, it sends it to the server, that is, the device information of the detected device is synchronized to the server. After receiving the device information of the detected device, the server determines the screen area to be detected of the detected device according to the device information. Specifically, the server pre-constructs a detection area database, which stores the areas where historical detection faults of different devices occur more (i.e., historical fault areas) and pre-set basic detection areas (i.e., must-check areas). The server can query the areas where historical detection faults of the same type of devices as the detected device occur more and the basic detection areas corresponding to the detected device according to the device information of the detected device, and then calculate the area currently required to be detected by the detected device as the screen area to be detected. In addition, the server can also record the screen area that has been detected of the detected device, and the calculated screen area to be detected of the detected device does not include the screen area that has been detected of the detected device. After the server determines the screen area to be detected of the device to be detected, it feeds back the screen area to be detected to the quality inspection client, where the screen area to be detected is the coordinate information of the area.

[0062] In addition, after receiving the device information of the device to be detected sent by the quality inspection client, the server will generate a quality inspection code for the device to be detected based on the device information. The function of the quality inspection code is mainly to identify the current detection of the device to be detected, that is, when the server feeds back the determined screen area to be detected of the device to be detected to the quality inspection client, it carries the quality inspection code of the device to be detected generated by it.

[0063] S102: Generate a touch detection guide map based on the screen area to be detected fed back by the server, so that the touch detection device performs a sliding touch operation on the screen of the device to be detected according to the touch detection guide map.

[0064] After receiving the screen area to be detected from the server, the quality inspection client marks the screen according to the screen area to be detected, thereby generating a touch detection guide map. The locations to be touched marked in the touch detection guide map all belong to the screen area to be detected. Figure 2As shown, all the circles in the figure are positions to be touched, and the area involved in all the circles is the screen area to be detected. Among them, the quality inspection client will mark the starting position and the ending position of the touch detection guide map, for example, it can be marked with different colors, or marked with different shapes, etc. After the quality inspection client generates the touch detection guide map, it will be displayed on the screen of the detected device, so that the touch detection device can perform a sliding touch operation on the screen of the detected device according to the touch detection guide map displayed by the detected device. This embodiment can also use a method of lighting up each circle in the touch detection guide map to indicate whether the point corresponding to the circle is touched, that is, every time the touch detection device slides and touches a circle, the circle is lit (that is, the color of the circle changes).

[0065] Specifically, the touch detection device includes a controller, a camera device and a mechanical arm. The camera device is arranged on the mechanical arm and can capture the touch detection guide map displayed on the screen of the detected device. The controller positions the mechanical arm based on the touch detection guide map captured by the camera device, and controls the mechanical arm to slide and touch the screen of the detected device according to the touch detection guide map, that is, the mechanical arm is controlled to touch the screen from the starting position in the touch detection guide map, and slide according to the touch detection guide map until all positions to be touched in the touch detection guide map are touched, and then stops at the end position in the touch detection guide map, and then controls the mechanical arm to lift from the screen. Among them, the camera device can use visual recognition to realize the positioning of the touch position of the mechanical arm on the screen.

[0066] S103, obtaining the touch point data of the screen of the detected device, and uploading the touch point data to the server, so that the server analyzes the touch point data and determines the quality inspection result of the screen area to be detected.

[0067] In this embodiment, when the touch detection device performs a sliding touch operation on the screen of the detected device according to the touch detection guide map, the quality inspection client installed in the detected device will collect the point data of the screen of the detected device being touched, wherein the point data is the coordinate data of the screen being touched. When the touch detection device completes the touch of all the positions to be touched in the touch detection guide map according to the touch detection guide map (for example, Figure 2 After all the circles in the touch detection guide diagram shown are lit up), or after the touch detection device performs a sliding touch operation on the screen of the detected device for a preset time, stop acquiring the touch point data of the screen of the detected device.

[0068] After the quality inspection client obtains the point data of the screen being touched on the device being inspected, it will upload all the point data to the server synchronously. The server will analyze and calculate the point data to determine the quality inspection result of the screen area to be inspected of the device being inspected. When the quality inspection client uploads the point data to the server, the point data carries the quality inspection code pre-determined by the server. The quality inspection client determines the quality inspection result of the screen area to be inspected of the device being inspected, and also feeds back the quality inspection result with the quality inspection code to the quality inspection client.

[0069] Specifically, the server divides the screen of the detected device into regions in advance, and pre-sets the weight value of each region, wherein the weight values ​​of the historical fault area and the must-check area corresponding to the device information of the detected device are larger, while the weight values ​​of other areas and the screen detected area are smaller. The server determines the area involved in all point data, and adds the weight values ​​corresponding to these areas, and the obtained value is used as the confidence level data of the current screen detection, and the confidence level data is the quality inspection result of the screen area to be detected of the current screen detection. In addition, if the confidence level data does not reach the preset threshold, it is necessary to redetermine the screen area to be detected of the detected device based on the device information of the detected device, the pre-built detection area database and the screen area of ​​the detected device, and the redetermined screen area to be detected is also used as the quality inspection result of the screen area to be detected of the current screen detection, wherein the redetermination of the screen area to be detected is the same as that described in step S101.

[0070] S104: Determine the screen quality inspection result of the device to be inspected based on the quality inspection result of the screen area to be inspected fed back by the server.

[0071] In this embodiment, the quality inspection client receives the quality inspection result of the screen area to be inspected fed back by the server, and determines the screen quality inspection result of the device to be inspected based on the quality inspection result. Specifically, if the confidence level data included in the quality inspection result of the screen area to be inspected fed back by the server reaches a preset threshold, it means that most of the historical fault areas and the must-inspect areas in the screen of the device to be inspected have passed the screen inspection, and at this time, it is determined that the screen quality inspection result of the device to be inspected indicates that the screen is normal.

[0072] Furthermore, if the confidence level data included in the quality inspection results of the screen area to be detected fed back by the server does not reach the preset threshold, it means that there are still many areas in the historical fault area and the must-check area of ​​the screen of the detected device that have not been tested. At this time, the quality inspection results of the screen area to be detected fed back by the server also include the screen area to be detected re-determined by the server. The re-determined screen area to be detected also belongs to the historical fault area and the must-check area in the screen of the detected device, but the re-determined screen area to be detected does not include the screen area that has been detected in the screen of the detected device. After the quality inspection client receives the screen area to be detected re-determined by the server, it continues to execute steps S102 to S104 according to the re-determined screen area to be detected until the confidence level data in the quality inspection results fed back by the server reaches the preset threshold. Among them, the confidence level data is calculated by adding the weight values ​​corresponding to the areas where the data of each point where the screen is touched is located.

[0073] From the above introduction, it can be seen that the screen detection method proposed in the embodiment of the present application sends the device information of the detected device to the server, so that the server determines the screen area to be detected of the detected device; based on the screen area to be detected fed back by the server, a touch detection guide map is generated, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the touch detection guide map; the point data of the screen of the detected device being touched is obtained, and the point data is uploaded to the server, so that the server analyzes the point data and determines the quality inspection result of the screen area to be detected; based on the quality inspection result of the screen area to be detected fed back by the server, the screen quality inspection result of the detected device is determined. By adopting the technical solution of this embodiment, the touch detection guide map can be automatically generated by the server and the quality inspection client, and the touch detection device can automatically perform a sliding touch operation on the screen according to the touch detection guide map, thereby automatically determining the screen quality inspection result according to the acquired point data of the screen being touched, realizing automatic screen detection, and improving the efficiency and accuracy of screen detection.

[0074] As an optional implementation, see Figure 3 As shown, in another embodiment of the present application, after executing step S103 to obtain the point data of the screen of the detected device being touched, the following steps are also included:

[0075] S301: Based on the touch detection guide map and all point data, determine whether there is a disconnected contact point in the touch detection guide map.

[0076] Specifically, after the touch detection device completes the sliding touch operation according to the touch detection guide map, the quality inspection client will collect the data of each point touched by the touch detection device on the screen of the detected device. At this time, the quality inspection client needs to analyze all the point data according to the sliding touch route displayed in the touch detection guide map, determine whether there are untouched points in the touch detection guide map, and use these untouched points as broken contact points. In addition, the quality inspection client records the number of broken touch detections, and this embodiment also needs to determine whether the number of broken touch detections has reached a preset number.

[0077] S302: If there are broken contact points and the number of broken contact detections does not reach a preset number, the number of broken contact detections is updated, and broken contact detection data is generated based on all broken contact points, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the broken contact detection data.

[0078] If it is determined that there is a broken contact point, and the number of broken contact detections has not reached the preset number, a broken contact detection is performed based on the broken contact points in all point data, and the number of broken contact detections is updated, that is, the number of broken contact detections is increased by one. Specifically, to perform a broken contact detection based on the broken contact points in all point data, it is first necessary to generate broken contact detection data based on all broken contact points. The broken contact detection data is a broken contact detection guide map composed of all broken contact points, which includes the starting point and end point of the broken contact detection. The touch detection device performs a sliding touch operation on the screen of the detected device according to the broken contact detection data to achieve re-touch of the broken contact point.

[0079] S303: Acquire the point data of the screen of the detected device being touched, and upload the point data to the server.

[0080] When the touch detection device performs a sliding touch operation on the screen of the detected device according to the touch break detection data, the quality inspection client needs to continue to collect the point data of the touched screen of the detected device, and simultaneously upload the point data obtained by the touch break detection to the server, so that the server can analyze the point data previously obtained according to the touch detection guide map and the point data obtained according to the touch break detection data together, thereby determining the quality inspection result of the screen area to be detected.

[0081] In addition, after obtaining the point data after the touch detection device performs a sliding touch operation according to the broken touch detection data, the point data previously obtained according to the touch detection guide map and the point data obtained according to the broken touch detection data are used as all point data, and based on the touch detection guide map and all point data, it is determined whether there is a broken touch point in the touch detection guide map, and whether the number of broken touch detections reaches the preset number. If there is a broken touch point and the number of broken touch detections does not reach the preset number, the number of broken touch detections is updated again, and the broken touch detection data is generated again based on all the latest broken touch points, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the broken touch detection data, and obtains the point data of the screen of the detected device being touched, and uploads the point data to the server. If there is a broken touch point and the number of broken touch detections reaches the preset number, it is determined that the screen quality inspection result of the detected device is abnormal. That is, steps S301 to S304 are executed in a loop until there is no broken contact point or the number of broken touch detections reaches the preset number.

[0082] S304: If there is a broken contact point and the number of broken contact detections reaches a preset number, it is determined that the screen quality inspection result of the detected device is that the screen is abnormal.

[0083] If it is determined that there is a broken contact point, but the number of broken contact detections has reached a preset number of times, it means that the preset number of broken contact detections have been performed on the broken contact point, but the broken contact point still exists. At this time, it is determined that there is a touch problem on the screen of the device being tested, that is, the screen quality inspection result of the device being tested is determined to be a screen abnormality.

[0084] If it is determined that there is no broken contact point, it means that there is no touch problem in the screen area to be tested of the device being tested. At this time, the point data touched by all touch detection devices on the screen are uploaded to the server, so that the server can finally determine the quality inspection result of the screen area to be tested of the device being tested.

[0085] As an optional implementation, the present application embodiment also proposes a screen detection method, which is applied to a server, which is a server or a cloud. Figure 4 As shown, the method includes:

[0086] S401, based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database and the detected screen area of ​​the detected device, determine the screen area to be detected of the detected device, and send the screen area to be detected of the detected device to the quality inspection client.

[0087] A detection area database is pre-constructed in the server, and the detection area database stores areas where historical detection failures of different devices occur more frequently (i.e., historical failure areas) and pre-set basic detection areas (i.e., areas that must be inspected). After receiving the device information of the device to be detected sent by the quality inspection client, the server can query the areas where historical detection failures of devices of the same type as the device to be detected occur more frequently and the basic detection areas corresponding to the device to be detected based on the device information of the device to be detected, and then calculate the area that the device to be detected currently needs to detect as the screen area to be detected. In addition, the server can also record the screen area that has been detected of the device to be detected, and the calculated screen area to be detected of the device to be detected does not include the screen area that has been detected of the device to be detected. After the server determines the screen area to be detected of the device to be detected, it feeds back the screen area to be detected to the quality inspection client. Among them, the screen area to be detected is the coordinate information of the area.

[0088] Furthermore, this step specifically includes the following:

[0089] First, based on the device information of the detected device sent by the quality inspection client, the screen of the detected device is divided into at least two areas.

[0090] The device information of the detected device received by the server includes the model, system version, International Mobile Equipment Identity (IMEI) and other information of the detected device. The server can determine the screen specifications of the detected device based on the model of the detected device, etc., and thus divide the screen of the detected device into regions, that is, divide the screen of the detected device into at least two regions.

[0091] Second, based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database and the detected screen area of ​​the detected device, the weight value of each area is determined.

[0092] The server has pre-built a detection area database, which stores historical fault areas and must-check areas of different devices. The server can determine the historical fault areas and must-check areas corresponding to the detected device based on the device information of the detected device, and the server also records the screen detected area of ​​the detected device where the quality inspection client is located. The server determines the weight values ​​of each area divided on the screen based on the historical fault areas, must-check areas, and screen detected areas corresponding to the detected device. That is, among all the areas divided on the screen, the weight values ​​of the historical fault areas and must-check areas but not the screen detected areas are set to larger weight values, while other areas are set to smaller weight values, or the weight values ​​are directly set to 0, where the sum of the weight values ​​of all areas is 1.

[0093] Third, based on the weight values ​​of the respective regions, at least one region is selected from all the regions to obtain the screen region to be detected of the detected device.

[0094] Based on the determined weight values ​​of each area in the screen, at least one area is selected from all the areas. In this embodiment, the weight values ​​can be sorted from large to small, and areas with larger weight values ​​are selected. All selected areas are combined into the screen area to be detected of the detected device.

[0095] S402: Analyze the touch point data of the screen of the inspected device sent by the quality inspection client to determine the quality inspection result of the screen area to be inspected.

[0096] After receiving the touch point data of the screen of the device being tested from the quality inspection client, the server analyzes all the point data to determine the quality inspection result of the screen area to be tested. The specific steps are as follows:

[0097] First, determine the area where each point data of the screen of the device under test sent by the quality inspection client is located on the screen of the device under test, and use the area where all the point data are located as the touched area;

[0098] Second, according to the predetermined weight values ​​corresponding to each area, the sum of the weight values ​​of all touched areas is calculated, and the sum of the weight values ​​is used as the confidence level data of the screen area to be detected;

[0099] Third, if the confidence level data reaches a preset threshold, the confidence level data is used as the quality inspection result of the screen area to be inspected;

[0100] Fourth, if the confidence level data does not reach the preset threshold, the screen area to be inspected of the device to be inspected is re-determined based on the device information of the device to be inspected, the pre-built detection area database and the screen area to be inspected of the device to be inspected, and the re-determined screen area to be inspected and the confidence level data are both used as the quality inspection results of the screen area to be inspected.

[0101] In this embodiment, each time the screen area to be detected is re-determined, the screen area that has been detected will be updated, so the weight value of each area divided by the screen will also be updated, and the weight value of the screen area that has been detected will be set to a smaller value, while the weight values ​​of other historical fault areas and must-check areas that have not been detected will increase. Therefore, the more areas that have been detected, the larger the weight values ​​of the remaining historical fault areas and must-check areas that have not been detected will be, and the calculated confidence level data will also become larger and larger until the preset threshold is reached, and the screen area to be detected is stopped from being re-determined, thereby stopping the detection. At this point, most of the historical fault areas and must-check areas in the screen of the detected device will become the screen detected areas, completing the screen detection of the detected device.

[0102] From the above introduction, it can be seen that the screen detection method proposed in the embodiment of the present application can use the server and the quality inspection client to automatically generate a touch detection guide map, and use the touch detection device to automatically slide the screen according to the touch detection guide map, thereby automatically determining the screen quality inspection result based on the acquired screen touch point data, realizing automatic screen detection and improving the efficiency and accuracy of screen detection.

[0103] Exemplary Systems

[0104] Accordingly, the present application also provides a screen detection device, see Figure 5 As shown, the apparatus includes: a touch detection device 100, a quality inspection client 110 and a server 120, wherein the quality inspection client 110 runs on the detected device, and data interaction is achieved between the quality inspection client 110 and the server 120 through a communication link.

[0105] When the detected device runs the quality inspection client 110, the quality inspection client 110 is used to:

[0106] Send the read device information of the detected device to the server, so that the server can determine the screen area to be detected of the detected device;

[0107] Generate a touch detection guide map based on the screen area to be detected fed back by the server, so that the touch detection device performs a sliding touch operation on the screen of the device to be detected according to the touch detection guide map;

[0108] Obtain the touch point data of the screen of the device being tested, and upload the point data to the server, so that the server can analyze the point data and determine the quality inspection result of the screen area to be tested;

[0109] Based on the quality inspection result of the screen area to be inspected fed back by the server, the screen quality inspection result of the device to be inspected is determined.

[0110] The server 120 is used for:

[0111] Based on the device information of the device under test sent by the quality inspection client, the pre-built detection area database and the detected screen area of ​​the device under test, the screen area to be detected of the device under test is determined, and the screen area to be detected of the device under test is sent to the quality inspection client; the detection area database stores the required inspection area and historical fault area corresponding to the device information;

[0112] The touch point data of the screen of the device being tested sent by the quality inspection client is analyzed to determine the quality inspection result of the screen area to be tested.

[0113] The touch detection device 100 is used to perform a sliding touch operation on the screen of the detected device according to the touch detection guide map displayed by the detected device.

[0114] From the above introduction, it can be seen that the screen detection system proposed in the embodiment of the present application can use the server and the quality inspection client to automatically generate a touch detection guide map, and use the touch detection device to automatically slide the screen according to the touch detection guide map, thereby automatically determining the screen quality inspection result based on the acquired screen touch point data, realizing automatic screen detection and improving the efficiency and accuracy of screen detection.

[0115] As an optional implementation, another embodiment of the present application discloses that after the quality inspection client 110 obtains the point data of the screen of the inspected device being touched, it is also used to:

[0116] Based on the touch detection guide map and all point data, determine whether there is a broken contact point in the touch detection guide map; wherein the broken contact point is a point that is not touched;

[0117] If there is a broken contact point and the number of broken contact detections does not reach the preset number, the number of broken contact detections is updated, and broken contact detection data is generated based on all broken contact points, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the broken contact detection data;

[0118] Get the touch point data of the screen of the detected device and upload the point data to the server.

[0119] As an optional implementation, another embodiment of the present application discloses that the quality inspection client 110 is further used for:

[0120] If there is a broken contact point and the number of broken contact detections reaches a preset number, it is determined that the screen quality inspection result of the detected device is that the screen is abnormal.

[0121] As an optional implementation, another embodiment of the present application discloses that the quality inspection client 110 determines the screen quality inspection result of the detected device based on the quality inspection result of the screen area to be detected fed back by the server, including:

[0122] If the confidence level data included in the quality inspection result of the screen area to be inspected reaches a preset threshold, it is determined that the screen quality inspection result of the inspected device indicates that the screen is normal.

[0123] As an optional implementation, another embodiment of the present application discloses that the quality inspection client 110 is further used for:

[0124] If the confidence level data included in the quality inspection result of the screen area to be detected does not reach the preset threshold, the quality inspection result of the screen area to be detected includes the screen area to be detected re-determined by the server; wherein the re-determined screen area to be detected does not include the screen area that has been detected, and the confidence level data is calculated by adding the weight values ​​corresponding to the areas where the data of each point of the screen being touched are located;

[0125] A touch detection guide map is generated based on the re-determined screen area to be detected to perform screen detection.

[0126] As an optional implementation, another embodiment of the present application discloses that the server 120 determines the screen area to be detected of the detected device based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database, and the detected screen area of ​​the detected device, including:

[0127] Based on the device information of the detected device sent by the quality inspection client, the screen of the detected device is divided into at least two areas;

[0128] Determine the weight value of each area based on the device information of the device under test sent by the quality inspection client, the pre-built detection area database and the screen detection area of ​​the device under test;

[0129] Based on the weight values ​​of the respective areas, at least one area is selected from all the areas to obtain the screen area to be detected of the detected device.

[0130] As an optional implementation, another embodiment of the present application discloses that the server 120 analyzes the touch point data of the screen of the detected device sent by the quality inspection client to determine the quality inspection result of the screen area to be inspected, including:

[0131] Determine the area where the data of each point on the screen of the device under inspection sent by the quality inspection client is located as the touched area;

[0132] Add up the weight values ​​corresponding to all touched areas as confidence level data;

[0133] If the confidence level data reaches the preset threshold, the confidence level data is used as the quality inspection result of the screen area to be inspected;

[0134] If the confidence level data does not reach the preset threshold, the screen area to be inspected of the device to be inspected is re-determined based on the device information of the device to be inspected, the pre-built detection area database and the screen area that has been inspected of the device to be inspected, and the re-determined screen area to be inspected and the confidence level data are both used as the quality inspection results of the screen area to be inspected.

[0135] As an alternative implementation, see Figure 6 As shown, in another embodiment of the present application, the touch detection device 100 includes: a mechanical arm 103, a camera device 102, a conveyor 104 and a detection box. The mechanical arm 103 is arranged in the detection box, and the camera device 102 is arranged on the mechanical arm 103.

[0136] The conveying device 104 is used to convey the detected device 200 to the detection box, and to convey the detected device 200 out of the detection box.

[0137] The camera device 102 is used to capture the touch detection guide image displayed on the screen of the detected device 200 .

[0138] The mechanical arm 103 is used to perform a sliding touch operation on the screen of the detected device 200 according to the touch detection guide map.

[0139] As an alternative implementation, see Figure 6 As shown, in another embodiment of the present application, it is disclosed that the touch detection device 100 also includes: a controller 101, which is respectively connected to the robot arm 103, the camera device 102 and the transmission device 104, and the controller 101 is also communicated with the quality inspection client 110 installed on the device 200 to be detected.

[0140] The controller 101 is used to control the conveying device 104 to convey the detected device 200, and is also used to control the robotic arm 103 to move above the detected device 200, control the camera device 102 to shoot the touch detection guide map displayed on the screen of the detected device 200, and control the robotic arm 103 to perform a sliding touch operation on the screen of the detected device 200 according to the touch detection guide map.

[0141] The screen detection system provided in this embodiment belongs to the same application concept as the screen detection method provided in the above embodiments of this application, and can execute the screen detection method provided in any of the above embodiments of this application, and has the corresponding functional modules and beneficial effects of executing the screen detection method. For technical details not fully described in this embodiment, please refer to the specific processing content of the screen detection method provided in the above embodiments of this application, and will not be repeated here.

[0142] Exemplary Electronic Devices

[0143] Another embodiment of the present application also provides an electronic device, see Figure 7 As shown, the device includes:

[0144] Memory 300 and processor 310;

[0145] The memory 300 is connected to the processor 310 and is used to store programs;

[0146] The processor 310 is used to implement the screen detection method disclosed in any of the above embodiments by running the program stored in the memory 300.

[0147] Specifically, the electronic device may further include: a bus, a communication interface 320 , an input device 330 and an output device 340 .

[0148] The processor 310, the memory 300, the communication interface 320, the input device 330 and the output device 340 are connected to each other via a bus.

[0149] A bus may include a pathway that transfers information between components of a computer system.

[0150] The processor 310 may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the scheme of the present invention. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0151] The processor 310 may include a main processor, and may also include a baseband chip, a modem, and the like.

[0152] The memory 300 stores a program for executing the technical solution of the present invention, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes a computer operation instruction. More specifically, the memory 300 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.

[0153] The input device 330 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0154] Output device 340 may include devices that allow information to be output to a user, such as a display screen, printer, speaker, etc.

[0155] The communication interface 320 may include any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

[0156] The processor 310 executes the program stored in the memory 300 and calls other devices, which can be used to implement each step of any screen detection method provided in the above embodiments of the present application.

[0157] Exemplary computer program products and storage media

[0158] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the screen detection method according to various embodiments of the present application described in the above-mentioned "Exemplary Method" section of this specification.

[0159] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0160] In addition, an embodiment of the present application may also be a storage medium on which a computer program is stored, and the computer program is executed by a processor to execute the steps of the screen detection method according to various embodiments of the present application described in the above “Exemplary Method” section of this specification.

[0161] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0162] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0163] The steps in the methods of each embodiment of the present application can be adjusted in order, combined and deleted according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0164] The modules and sub-modules in the devices and terminals of the various embodiments of the present application can be combined, divided and deleted according to actual needs.

[0165] In the several embodiments provided in the present application, it should be understood that the disclosed terminals, devices and methods can be implemented in other ways. For example, the terminal embodiments described above are only schematic, for example, the division of modules or submodules is only a logical function division, and there may be other division methods in actual implementation, for example, multiple submodules or modules can be combined or integrated into another module, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0166] The modules or submodules described as separate components may or may not be physically separated, and the components of the modules or submodules may or may not be physical modules or submodules, that is, they may be located in one place, or they may be distributed on multiple network modules or submodules. Some or all of the modules or submodules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0167] In addition, each functional module or submodule in each embodiment of the present application may be integrated into one processing module, or each module or submodule may exist physically separately, or two or more modules or submodules may be integrated into one module. The above-mentioned integrated modules or submodules may be implemented in the form of hardware or in the form of software functional modules or submodules.

[0168] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0169] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly by hardware, software units executed by a processor, or a combination of the two. The software units may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0170] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0171] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A screen detection method, characterized in that: Applied to a quality inspection client, the quality inspection client is installed on the device to be inspected, and the method includes: Sending the read device information of the detected device to a server, so that the server determines the screen area to be detected of the detected device; Generate a touch detection guide map based on the screen area to be detected fed back by the server, so that the touch detection device performs a sliding touch operation on the screen of the device to be detected according to the touch detection guide map; Acquire the point data of the screen of the detected device being touched, and upload the point data to the server, so that the server analyzes the point data and determines the quality inspection result of the area to be detected on the screen; Based on the quality inspection result of the screen area to be inspected fed back by the server, the screen quality inspection result of the inspected device is determined.

2. The method according to claim 1, characterized in that After acquiring the touch point data of the screen of the detected device, the method further includes: Based on the touch detection guide map and all point data, determining whether there is a broken contact point in the touch detection guide map; wherein the broken contact point is a point that has not been touched; If there is a broken contact point and the number of broken contact detections does not reach a preset number, the number of broken contact detections is updated, and broken contact detection data is generated based on all broken contact points, so that the touch detection device performs a sliding touch operation on the screen of the detected device according to the broken contact detection data; The touch point data of the screen of the detected device is obtained, and the touch point data is uploaded to the server.

3. The method according to claim 2, characterized in that Also includes: If there is a broken contact point and the number of broken contact detections reaches a preset number, it is determined that the screen quality inspection result of the detected device is that the screen is abnormal.

4. The method according to claim 1, characterized in that: Determining the screen quality inspection result of the detected device based on the quality inspection result of the screen area to be detected fed back by the server includes: If the confidence level data included in the quality inspection result of the screen area to be inspected reaches a preset threshold, it is determined that the screen quality inspection result of the inspected device indicates that the screen is normal.

5. The method according to claim 4, characterized in that Also includes: If the confidence level data included in the quality inspection result of the screen area to be detected does not reach the preset threshold, the quality inspection result of the screen area to be detected includes the screen area to be detected re-determined by the server; wherein the re-determined screen area to be detected does not include the screen area that has been detected, and the confidence level data is calculated based on the addition of weight values ​​corresponding to the areas where the data of each point where the screen is touched are located; A touch detection guide map is generated based on the re-determined screen area to be detected to perform screen detection.

6. A screen detection method, characterized in that: Applied to the server, the method includes: Based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database and the detected screen area of ​​the detected device, determine the screen area to be detected of the detected device, and send the screen area to be detected of the detected device to the quality inspection client; the detection area database stores the required inspection area and historical fault area corresponding to the device information; The touch point data of the screen of the inspected device sent by the quality inspection client is analyzed to determine the quality inspection result of the area to be inspected on the screen.

7. The method according to claim 6, characterized in that The step of determining the screen area to be detected of the detected device based on the device information of the detected device sent by the quality inspection client, the pre-built detection area database, and the detected screen area of ​​the detected device includes: Based on the device information of the detected device sent by the quality inspection client, the screen of the detected device is divided into at least two areas; Determine the weight value of each area based on the device information of the device to be tested sent by the quality inspection client, the pre-built detection area database and the screen detection area of ​​the device to be tested; Based on the weight values ​​of the respective areas, at least one area is selected from all the areas to obtain the screen area to be detected of the detected device.

8. The method according to claim 7, characterized in that Analyzing the touch point data of the screen of the device being tested sent by the quality inspection client to determine the quality inspection result of the area to be tested on the screen, including: Determine the area where the data of each point on the screen of the device under inspection sent by the quality inspection client is located as the touched area; Add up the weight values ​​corresponding to all touched areas as confidence level data; If the confidence level data reaches a preset threshold, the confidence level data is used as the quality inspection result of the screen area to be inspected; If the confidence level data does not reach the preset threshold, the screen area to be detected of the device to be detected is re-determined based on the device information of the device to be detected, the pre-built detection area database and the screen area of ​​the device to be detected, and the re-determined screen area to be detected and the confidence level data are both used as the quality inspection results of the screen area to be detected.

9. A screen detection system, characterized in that: include: A quality inspection client, a touch detection device and a server, wherein the quality inspection client runs on the device being tested; When the detected device runs the quality inspection client, the screen detection method according to any one of claims 1 to 5 is executed; The server is used to execute the screen detection method according to any one of claims 6 to 8; The touch detection device is used to perform a sliding touch operation on the screen of the detected device according to the touch detection guide map displayed by the detected device.

10. The screen detection system according to claim 9, characterized in that: The touch detection device comprises: a mechanical arm, a camera device, a conveying device and a detection box; The mechanical arm is arranged in the detection box, and the camera device is arranged on the mechanical arm; The conveying device is used to convey the detected device to the detection box, and to convey the detected device out of the detection box; The camera device is used to capture the touch detection guide image displayed by the detected device; The mechanical arm is used to perform a sliding touch operation on the screen of the detected device according to the touch detection guide map.