Application program page detection method and device, equipment, medium and program product

Abstract

The invention discloses an application page detection method and device, equipment, a medium and a program product. The method comprises the steps of obtaining a current display page of a target application program; obtaining each page unit from the current display page, carrying out pixel point sampling detection on each page unit, and determining a first display state detection result of each page unit; obtaining an abnormal page unit in the current display page according to the first display state detection result of each page unit; and determining a second display state detection result of the current display page according to the display area of the abnormal page unit in the current display page. According to the technical scheme, the accuracy of the monitoring source data is improved, so that the accuracy of the monitoring result is improved.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to methods, apparatus, devices, media, and program products for detecting application page. Background Technology

[0002] Nowadays, most images displayed on mobile application pages use services from third-party CDN (Content Delivery Network) providers. Unlike regular API requests, network fluctuations can easily cause images on application pages to fail to load, resulting in large blank areas on the mobile screen and significantly impacting the user experience. Therefore, it's common practice to add log reporting functionality to the application's image library to monitor image loading status.

[0003] The existing monitoring logic relies on the application's own image library and image loading process. If the image library itself has vulnerabilities or there are vulnerabilities in the intermediate links of the image loading process, the problem of abnormal image loading on the user's mobile device may be masked, resulting in inaccurate monitoring results. Summary of the Invention

[0004] This invention provides a method, apparatus, device, medium, and program product for detecting application pages, in order to improve the accuracy of monitoring source data and thus improve the accuracy of monitoring results.

[0005] According to one aspect of the present invention, an application page detection method is provided, the method comprising:

[0006] Get the currently displayed page of the target application;

[0007] Each page unit is obtained from the currently displayed page, and pixel sampling detection is performed on each page unit to determine the first display state detection result of each page unit;

[0008] Based on the first display status detection results of each page unit, obtain the abnormal page units in the currently displayed page;

[0009] The second display state detection result of the current display page is determined based on the display area of ​​the abnormal page unit in the current display page.

[0010] According to another aspect of the present invention, an application page detection device is provided, the device comprising:

[0011] The current display page acquisition module is used to obtain the current display page of the target application;

[0012] The first detection result determination module is used to obtain each page unit from the current display page, perform pixel sampling detection on each page unit, and determine the first display state detection result of each page unit.

[0013] An abnormal page unit acquisition module is used to acquire abnormal page units in the currently displayed page based on the first display state detection result of each page unit.

[0014] The second detection result determination module is used to determine the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page.

[0015] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0016] At least one processor; and

[0017] A memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the application page detection method according to any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the application page detection method according to any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program that, when executed by a processor, implements the application page detection method according to any embodiment of the present invention.

[0021] The technical solution of this invention involves obtaining the current display page of the target application; obtaining each page unit from the current display page and performing pixel sampling detection on each page unit to determine the first display state detection result of each page unit; obtaining abnormal page units in the current display page based on the first display state detection results of each page unit; and determining the second display state detection result of the current display page based on the display area of ​​the abnormal page units in the current display page. By adopting a technique that directly observes the client interface and determines the application page display state through pixel sampling detection, this solution addresses the problem that existing monitoring logic relies on the application's own image library and image loading process. If the image library itself has vulnerabilities or there are vulnerabilities in the intermediate steps of the image loading process, abnormal image loading on the user's mobile device may be masked, leading to inaccurate monitoring results. This improves the accuracy of the monitoring source data, thereby improving the accuracy of the monitoring results.

[0022] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 A flowchart of an application page detection method provided in Embodiment 1 of the present invention;

[0025] Figure 2 A flowchart of another application page detection method provided in Embodiment 2 of the present invention;

[0026] Figure 3 This is a complete schematic diagram of an application page detection method provided by an embodiment of the present invention;

[0027] Figure 4 This is a schematic diagram of the structure of an application page detection device provided in Embodiment 3 of the present invention;

[0028] Figure 5 This is a schematic diagram of the structure of an electronic device that implements the application page detection method of this invention. Detailed Implementation

[0029] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] Before introducing the solution of the present invention, the relevant terms involved in the embodiments of the present invention will be explained.

[0032] White screen: A large portion of the images in an app (application) fail to load, resulting in a blank screen where a large area of ​​content is displayed to the user.

[0033] View: The smallest unit used to load page content in a mobile (client) system. It can be an image, a button, or text, etc.

[0034] Bitmap: An object used in mobile systems to store image content, containing the image's binary information and the color value of each pixel.

[0035] Example 1

[0036] Figure 1 This is a flowchart of an application page detection method provided in Embodiment 1 of the present invention. This embodiment is applicable to situations where the display status of an application's page is detected. This method can be executed by an application page detection device, which can be implemented in hardware and / or software. The application page detection device can be configured in the processor of the client where the application resides. Figure 1 As shown, the method includes:

[0037] S110. Obtain the currently displayed page of the target application.

[0038] The target application can refer to the application on the client side that is being monitored, i.e., the application that the client is the object of monitoring. The currently displayed page can refer to the page that the target application is currently displaying on the client side.

[0039] In this embodiment, the target application can be monitored on the client side. When the target application is launched on the client side and a page is displayed, the current display page of the target application can be obtained.

[0040] S120. Obtain each page unit from the currently displayed page, and perform pixel sampling detection on each page unit to determine the first display state detection result of each page unit.

[0041] In this context, a page unit can refer to a page element that makes up the currently displayed page. For example, the currently displayed page includes image 1, image 2, and image 3. Below image 1 is descriptive text 1, below image 2 is descriptive text 2, and below image 3 is descriptive text 3. The currently displayed page also includes button 1, button 2, and button 3. Here, image 1, image 2, image 3, descriptive text 1, descriptive text 2, descriptive text 3, button 1, button 2, and button 3 are page elements of the currently displayed page, i.e., page units. In this embodiment, the currently displayed page and page units can refer to screenshots of the page actually displayed by the client, screenshots of the target application's currently displayed page, and screenshots of the page units actually displayed. The first display state detection result can refer to the detection result of the complete display of the page units in the currently displayed page.

[0042] In this embodiment, pixel sampling detection can be performed on the page units actually displayed in the current display page to determine the first display state detection result of each actual display page unit.

[0043] In one optional implementation, obtaining each page unit from the currently displayed page may include: monitoring the page tree structure corresponding to the currently displayed page, adding the new page unit to the message queue when a new page unit is added to the page tree structure, and obtaining each page unit from the message queue.

[0044] Here, the page tree structure refers to the view tree of the currently displayed page, and the views in the view tree refer to page units. A message queue can be middleware used to temporarily store image views. The advantage of setting up a message queue is that it can reduce the pressure of directly processing the view tree when the amount of data in the view tree is large.

[0045] In this embodiment, the display status of the target application can be monitored by pre-setting listeners for the target application. During the pre-display phase of the current display page, whenever a new image view is added to the view tree on the current display page, the new image view is added to the message queue, and then the page units of the current display page are retrieved from the message queue.

[0046] In one optional implementation, pixel sampling detection is performed on each page unit to determine the first display state detection result of each page unit. This may include: sequentially determining the currently processed page unit from each page unit; drawing the image content of the currently processed page unit into a preset temporary storage object according to a preset compression ratio to obtain the current drawing result; extracting a first type of pixels from the current drawing result according to a preset extraction rule, and obtaining a second type of pixels from the first type of pixels according to a preset statistical rule; comparing the proportion of the second type of pixels in the first type of pixels with a preset first threshold to determine the first display state detection result of the currently processed page unit.

[0047] The currently processed page unit can refer to the page unit currently undergoing complete display detection. This currently processed page unit can be one of the various page units in the currently displayed page. Since the file of the currently processed page unit obtained directly from the client is large, performing pixel detection directly would be labor-intensive and could easily cause the client system to crash. Therefore, a preset compression ratio is determined. The preset compression ratio can be determined through experimental results or manual experience; this embodiment does not impose a limitation. For example, the width and height of the currently processed page unit after processing according to the preset compression ratio could be 50*50. The preset temporary storage object can be an object used to temporarily store the compressed image of the currently processed page unit, such as a Bitmap. This setting has the advantage of reducing memory usage and facilitating subsequent pixel sampling detection. The current drawing result can refer to the temporary storage result of the currently processed page unit in the preset temporary storage object after processing according to the preset compression ratio. The preset extraction rule can refer to the pixel extraction rule when performing pixel detection on the current drawing result. For example, the preset extraction rule can be to extract N*N pixels at equal intervals from the non-boundary pixels of the current drawing result (because pixels on the boundary are likely to be the same color). The first type of pixels can refer to the pixels extracted from the current drawing result according to preset extraction rules. The preset statistical rules can refer to the rules for counting the number of pixels in the first type according to their color. The second type of pixels can refer to the pixels in the first type that have the same color and the largest number. The preset first threshold can refer to the upper limit of the proportion of the second type of pixels in the first type of pixels. The preset first threshold can be determined by experimental results or manual experience, and is not limited in this embodiment.

[0048] In this embodiment, the current processing page unit can be determined from each page unit of the currently displayed page. The image content of the current processing page unit is compressed according to a preset compression ratio in a preset temporary storage object to obtain the current drawing result corresponding to the current processing page unit. Further, N*N first-type pixels can be extracted from the non-boundary pixels of the current drawing result at equal intervals. The number of pixels with the same color in the first-type pixels is counted according to the pixel color. The pixels with the same color and the largest number are determined as second-type pixels (if there are 50 white, red, or yellow second-type pixels, and 50 is the order of magnitude of the number of pixels with the same color and the largest number, one can be randomly selected from white, red, or yellow). The proportion of the second-type pixels in the first-type pixels is compared with a preset first threshold. If the proportion is greater than the preset first threshold, it can be said that most of the images in the current processing page unit are the same color, which is likely an image loading anomaly. Therefore, the first display state detection result of the current processing page unit can be determined to be an anomaly. If the proportion is less than or equal to the preset first threshold, the first display state detection result of the current processing page unit can be determined to be no anomaly.

[0049] S130. Based on the first display status detection results of each page unit, obtain the abnormal page units in the currently displayed page.

[0050] In this embodiment, after each page unit in the currently displayed page determines the first display state detection result, it can be determined that there are page units with abnormal display in each page unit, that is, abnormal page units. Abnormal page units can be one or more page units in each page unit.

[0051] S140. Determine the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page.

[0052] Where there is only one abnormal page unit, the display area is the display area of ​​that abnormal page. If there are two or more abnormal page units, the display area can be the sum of the display areas of each abnormal page unit. The second display status detection result can refer to the detection result of the display integrity of the currently displayed page. The second display status detection result depends on the first display status detection result of each page unit.

[0053] In one optional implementation, determining the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page may include: obtaining the coordinate data of the abnormal page unit in the current display page; calculating the display area of ​​the abnormal page unit in the current display page based on the coordinate data; determining the display area ratio of the abnormal page unit in the current display page based on the display area and the area of ​​the current display page; and comparing the display area ratio with a preset second threshold to determine the second display state detection result of the current display page.

[0054] The coordinate data can be obtained through an interface pre-specified by the client operating system. The preset second threshold can refer to the upper limit of the display area of ​​the abnormal page unit in the currently displayed page. The preset second threshold can be determined by experimental results or manual experience, and this embodiment does not impose any limitations.

[0055] In this embodiment, the coordinate data of the abnormal page unit in the current display page can be obtained through the interface pre-specified by the client operating system. The actual display area of ​​the abnormal page unit is determined based on the coordinate data, and the display area ratio of the abnormal page unit in the current display page is calculated. The display area ratio is further compared with a preset second threshold. If the display area ratio is greater than the preset second threshold, the second display state detection result of the current display page can be determined to be abnormal. If the display area is less than or equal to the preset second threshold, the second display state detection result of the current display page can be determined to be abnormal.

[0056] The technical solution of this invention involves obtaining the current display page of the target application; obtaining each page unit from the current display page and performing pixel sampling detection on each page unit to determine the first display state detection result of each page unit; obtaining abnormal page units in the current display page based on the first display state detection results of each page unit; and determining the second display state detection result of the current display page based on the display area of ​​the abnormal page units in the current display page. By adopting a technique that directly observes the client interface and determines the application page display state through pixel sampling detection, this solution addresses the problem that existing monitoring logic relies on the application's own image library and image loading process. If the image library itself has vulnerabilities or there are vulnerabilities in the intermediate steps of the image loading process, abnormal image loading on the user's mobile device may be masked, leading to inaccurate monitoring results. This improves the accuracy of the monitoring source data, thereby improving the accuracy of the monitoring results.

[0057] Example 2

[0058] Figure 2This is a flowchart of another application page detection method provided in Embodiment 2 of the present invention. This embodiment adds an operation after S140, based on the above embodiments. For example... Figure 2 As shown, the method includes:

[0059] S210. Obtain the currently displayed page of the target application.

[0060] S220. Obtain each page unit from the currently displayed page, and perform pixel sampling detection on each page unit to determine the first display state detection result of each page unit.

[0061] S230. Based on the first display status detection results of each page unit, obtain the abnormal page units in the currently displayed page.

[0062] S240. Determine the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page.

[0063] S250. If the second display status detection result indicates an anomaly, the image information of the abnormal page unit is reported to the server of the target application, and the third display status detection result fed back by the server of the target application for the current display page is received.

[0064] The image information of the abnormal page unit can refer to relevant log information that can be used to analyze the cause of the abnormality. This image information may include the identity information of the abnormal page unit. The third display status detection result can refer to the detection result of the current display page determined by the target application's server after detecting the original image corresponding to the abnormal page unit.

[0065] In this embodiment, if the client determines that the second display state detection result indicates an anomaly, the image information of the abnormal page unit can be reported to the server of the target application. The server directly detects all pixels of the original image of the abnormal page unit without compression or pixel sampling, and then feeds back the detection result of the currently displayed page to the client. The advantage of this setting is that server-side detection of the original image can, to some extent, avoid client misjudgment. Optionally, if the client determines that the second display state detection result indicates no anomaly, it can be determined as the final detection result, i.e., no server verification is required.

[0066] S260. Determine the misjudgment situation of the second display state detection result based on the third display state detection result.

[0067] In one optional implementation, determining the misjudgment of the second display state detection result based on the third display state detection result may include: determining that the second display state detection result is misjudged if the third display state detection result indicates no abnormality; and determining that the second display state detection result is not misjudged if the third display state detection result indicates an abnormality.

[0068] In this embodiment, if the server returns a detection result indicating no abnormality, it can be determined that the client has misjudged the detection result of the currently displayed page; otherwise, it can be determined that the client has not misjudged the detection result of the currently displayed page.

[0069] Based on the above optional implementation methods, optionally, the display device of the target application is instructed to adjust the compression ratio to draw the image content of the currently processed page unit into a preset temporary storage object, and the pixel sampling detection of the currently processed page unit is re-performed according to the new drawing result until there are no misjudgments in the second display state detection result.

[0070] The device on which the target application is displayed is the aforementioned client.

[0071] In this embodiment, if the client determines that its detection result is misjudged based on the third display status detection result fed back by the server, it can adjust the compression ratio and / or preset extraction rules for the misjudged page unit according to the instructions from the server, so as to redraw and sample and detect pixels until there is no misjudgment. The advantage of this setting is that the compression ratio and / or preset extraction rules can be adjusted in a timely manner to avoid misjudgment from happening again, thereby improving the accuracy of the detection result.

[0072] The technical solution of this invention adopts a direct client-side perspective, performing pixel sampling detection on the displayed page to determine the application page display status. Furthermore, it verifies the client-side detection results by detecting the original image of the abnormal page unit on the server side. This solves the problem that existing monitoring logic relies on the application's own image library and image loading process. If the image library itself has vulnerabilities or there are vulnerabilities in the intermediate steps of the image loading process, the problem of abnormal image loading on the user's mobile device may be masked, leading to inaccurate monitoring results. This improves the accuracy of the monitoring source data, thereby improving the accuracy of the monitoring results and avoiding misjudgments to a certain extent.

[0073] To enable those skilled in the art to better understand the application page detection method of this embodiment, Figure 3 This is a complete schematic diagram of an application page detection method provided by an embodiment of the present invention.

[0074] Step 1: Register a listener that adds a new image view to the message queue whenever a new image view is added to the view tree on the currently displayed page of the target application.

[0075] Step 2: Iterate through the message queue in Step 1 and determine whether the page containing the currently processed image View (i.e., the currently processed page unit) is displayed in the foreground of the client. If not, skip it; otherwise, continue to the next step.

[0076] Step 3: Draw the current image View obtained in Step 2 into a Bitmap with a specified width and height of M*M (equivalent to the preset compression ratio). This step is to reduce memory usage and facilitate subsequent detection. M*M can generally be 50*50.

[0077] Step 4: Treat the Bitmap from Step 3 as an M*M two-dimensional array, and take out N*N equally spaced pixels (excluding pixels on the Bitmap boundary, because pixels on the boundary are likely to be the same color).

[0078] Step 5: Find the color with the most occurrences from the N*N pixels taken in Step 4. Assuming that white pixels are the most numerous, with a total of Y pixels, then we can get a ratio p (equivalent to the proportion of the number of pixels) by calculating Y / (N*N). If p is greater than the threshold t (equivalent to the preset first threshold), it means that most of the current image is the same color, which is likely due to an abnormal loading of the current image view.

[0079] Step 6: Analyze the abnormal image views detected in Step 5. Calculate their display area by obtaining their coordinates on the client screen (equivalent to the currently displayed page). Sum these coordinates and divide by the area of ​​the client screen to obtain the proportion q of the abnormal image view in the screen content (equivalent to the display area percentage). If q is greater than the specified threshold u (equivalent to the preset second threshold), a white screen is considered to have occurred. At this time, the relevant logs of these abnormal image views will be reported to the server of the target application.

[0080] Step 7: The server receives the image information of the abnormal image view reported in Step 5, downloads these images to the local server, and then performs pixel detection on them in a similar way to Steps 3-5, but without scaling or sampling the images. All pixels of the original image are directly extracted for detection. If the detection result exceeds the threshold t, it means that no white screen has occurred and it is considered a misjudgment. Otherwise, the sizes of M and N in Steps 3 and 4 need to be adjusted until they are appropriate.

[0081] Example 3

[0082] Figure 4This is a schematic diagram of an application page detection device provided in Embodiment 3 of the present invention. Figure 4 As shown, the device includes: a current display page acquisition module 310, a first detection result determination module 320, an abnormal page unit acquisition module 330, and a second detection result determination module 340.

[0083] The current display page acquisition module 310 is used to acquire the current display page of the target application;

[0084] The first detection result determination module 320 is used to obtain each page unit from the current display page, perform pixel sampling detection on each page unit, and determine the first display state detection result of each page unit.

[0085] The abnormal page unit acquisition module 330 is used to acquire the abnormal page unit in the currently displayed page based on the first display state detection result of each page unit;

[0086] The second detection result determination module 340 is used to determine the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page.

[0087] The technical solution of this invention involves obtaining the current display page of the target application; obtaining each page unit from the current display page and performing pixel sampling detection on each page unit to determine the first display state detection result of each page unit; obtaining abnormal page units in the current display page based on the first display state detection results of each page unit; and determining the second display state detection result of the current display page based on the display area of ​​the abnormal page units in the current display page. By adopting a technique that directly observes the client interface and determines the application page display state through pixel sampling detection, this solution addresses the problem that existing monitoring logic relies on the application's own image library and image loading process. If the image library itself has vulnerabilities or there are vulnerabilities in the intermediate steps of the image loading process, abnormal image loading on the user's mobile device may be masked, leading to inaccurate monitoring results. This improves the accuracy of the monitoring source data, thereby improving the accuracy of the monitoring results.

[0088] Optionally, the first detection result determination module 320 can be used for:

[0089] Monitor the page tree structure corresponding to the currently displayed page, and add the new page unit to the message queue when a new page unit is added to the page tree structure;

[0090] Retrieve each page unit from the message queue.

[0091] Optionally, the first detection result determination module 320 can also be used for:

[0092] The current processing page unit is determined sequentially from each of the page units;

[0093] The image content of the current processing page unit is drawn into a preset temporary storage object according to a preset compression ratio to obtain the current drawing result;

[0094] According to preset extraction rules, a first type of pixel is extracted from the current drawing result, and a second type of pixel is obtained from the first type of pixel according to preset statistical rules; the second type of pixel is the pixel with the same color and the largest number among the first type of pixel;

[0095] The first display state detection result of the current processing page unit is determined by comparing the proportion of the second type of pixels in the first type of pixels with a preset first threshold.

[0096] Optionally, the second detection result determination module 340 can be used for:

[0097] Obtain the coordinate data of the abnormal page unit in the currently displayed page;

[0098] Calculate the display area of ​​the abnormal page unit in the currently displayed page based on the coordinate data;

[0099] Based on the displayed area and the area of ​​the currently displayed page, determine the proportion of the displayed area of ​​the abnormal page unit in the currently displayed page;

[0100] The second display state detection result of the current display page is determined by comparing the display area ratio with a preset second threshold.

[0101] Optionally, the application page detection device further includes a misjudgment determination module, which, after determining the second display state detection result of the current display page based on the display area of ​​the abnormal page unit in the current display page, includes:

[0102] The third detection result acquisition unit is used to report the image information of the abnormal page unit to the server of the target application if the second display status detection result is abnormal, and to receive the third display status detection result fed back by the server of the target application for the current display page.

[0103] The misjudgment determination unit is used to determine the misjudgment situation of the second display state detection result based on the third display state detection result.

[0104] Optional, the misjudgment determination unit can be used for:

[0105] If the third display state detection result is that there is no abnormality, it is determined that the second display state detection result is a misjudgment;

[0106] If the third display state detection result indicates an anomaly, it is determined that the second display state detection result is not a misjudgment.

[0107] Optionally, the application page detection device further includes a re-detection module, used to: after determining that there is a misjudgment in the second display state detection result:

[0108] The target application's display device is instructed to adjust the compression ratio to draw the image content of the currently processed page unit into a preset temporary storage object, and the pixel sampling detection of the currently processed page unit is re-performed based on the new drawing result until there are no misjudgments in the second display state detection result.

[0109] The application page detection device provided in this embodiment of the invention can execute the application page detection method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method.

[0110] Example 4

[0111] Figure 5 A schematic diagram of an electronic device 400 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers or various forms of mobile devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0112] like Figure 5 As shown, the electronic device 400 includes at least one processor 401 and a memory, such as a read-only memory (ROM) 402 and a random access memory (RAM) 403, communicatively connected to the at least one processor 401. The memory stores computer programs executable by the at least one processor. The processor 401 can perform various appropriate actions and processes based on the computer program stored in the ROM 402 or loaded into the RAM 403 from storage unit 408. The RAM 403 may also store various programs and data required for the operation of the electronic device 400. The processor 401, ROM 402, and RAM 403 are interconnected via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0113] Multiple components in electronic device 400 are connected to I / O interface 405, including: input unit 406, such as keyboard, mouse, etc.; output unit 407, such as various types of displays, speakers, etc.; storage unit 408, such as disk, optical disk, etc.; and communication unit 409, such as network card, modem, wireless transceiver, etc. Communication unit 409 allows electronic device 400 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0114] Processor 401 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 401 performs the various methods and processes described above, such as application page detection methods.

[0115] In some embodiments, the application page detection method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 408. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by processor 401, one or more steps of the application page detection method described above may be performed. Alternatively, in other embodiments, processor 401 may be configured to perform the application page detection method by any other suitable means (e.g., by means of firmware).

[0116] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0117] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0118] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0119] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0120] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0121] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0122] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0123] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. An application page detection method, characterized by, The method comprises the following steps: acquiring a current display page of a target application; acquiring each page unit from the current display page, and performing pixel point sampling detection on the each page unit to determine a first display state detection result of the each page unit; acquiring an abnormal page unit in the current display page according to the first display state detection result of the each page unit; determining a second display state detection result of the current display page according to a display area of the abnormal page unit in the current display page.

2. The method of claim 1, wherein, The step of acquiring each page unit from the current display page comprises the following steps: monitoring a page tree structure corresponding to the current display page, and adding a new page unit to a message queue in a case where the new page unit is added to the page tree structure; acquiring the each page unit from the message queue.

3. The method of claim 1, wherein, The step of performing pixel point sampling detection on the each page unit to determine the first display state detection result of the each page unit comprises the following steps: determining a current processing page unit from the each page unit in sequence; drawing picture content of the current processing page unit into a preset temporary storage object according to a preset compression ratio to obtain a current drawing result; extracting a first type of pixel point from the current drawing result according to a preset extraction rule, and acquiring a second type of pixel point from the first type of pixel point according to a preset statistical rule; the second type of pixel point is a pixel point with the same color and the largest quantity in the first type of pixel point; comparing a quantity ratio of the second type of pixel point in the first type of pixel point with a preset first threshold value to determine the first display state detection result of the current processing page unit.

4. The method of claim 1, wherein, The step of determining the second display state detection result of the current display page according to the display area of the abnormal page unit in the current display page comprises the following steps: acquiring coordinate data of the abnormal page unit in the current display page; calculating a display area of the abnormal page unit in the current display page according to the coordinate data; determining a display area ratio of the abnormal page unit in the current display page according to the display area and an area of the current display page; comparing the display area ratio with a preset second threshold value to determine the second display state detection result of the current display page.

5. The method of claim 1, wherein, After determining the second display state detection result of the current display page according to the display area of the abnormal page unit in the current display page, the method further comprises the following steps: if the second display state detection result is abnormal, reporting picture information of the abnormal page unit to a server of the target application, and receiving a third display state detection result of the current display page fed back by the server of the target application; determining a misjudgment condition of the second display state detection result according to the third display state detection result.

6. The method of claim 5, wherein, The step of determining the misjudgment condition of the second display state detection result according to the third display state detection result comprises the following steps: in a case where the third display state detection result is not abnormal, determining that the second display state detection result is misjudged. In a case where the third display state detection result is abnormal, it is determined that the second display state detection result is not misjudged.

7. The method of claim 6, wherein, After it is determined that the second display state detection result is misjudged, the method further includes: The display device of the target application program is instructed to adjust a compression ratio to draw picture content of the current processing page unit into a preset temporary storage object, and the current processing page unit is re-detected by pixel sampling according to a new drawing result until the second display state detection result is not misjudged.

8. An application page detection apparatus characterized by comprising: The method includes: a current display page acquisition module configured to acquire a current display page of a target application program; a first detection result determination module configured to acquire each page unit from the current display page, and detect the each page unit by pixel sampling to determine a first display state detection result of the each page unit; an abnormal page unit acquisition module configured to acquire an abnormal page unit in the current display page according to the first display state detection result of the each page unit; a second detection result determination module configured to determine a second display state detection result of the current display page according to a display area of the abnormal page unit in the current display page.

9. An electronic device, comprising: The electronic device includes: at least one processor; and a memory connected with the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the application page detection method in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for causing the processor to execute the application page detection method in any one of claims 1-7 when executed.

11. A computer program product, characterised in that, The computer program product includes a computer program, and the computer program, when executed by the processor, implements the application page detection method according to any one of claims 1-7. The computer program product includes a computer program, and the computer program, when executed by the processor, implements the application page detection method according to any one of claims 1-7.

Images