A method and device for obtaining evaluation parameters of an application sliding effect

Abstract

Embodiments of the present application provide a method and device for obtaining evaluation parameters of an application sliding effect, relating to image processing technology, and can obtain more accurate evaluation parameters for evaluating the application sliding effect on an electronic device. The specific solution includes: obtaining N first pictures of a first application displayed by the electronic device in response to a user's sliding operation; N is a positive integer; identifying placeholders in the N first pictures according to a preset color range and the sizes and shapes of a preset plurality of placeholders; calculating the content integrity of the N first pictures according to the area ratio of the placeholders in the N first pictures in the N first pictures; or calculating the content integrity of the N first pictures according to the display duration ratio of the first pictures including placeholders in the N first pictures in the total display duration of the N first pictures; calculating the content integrity of the N first pictures according to the above area ratio and the display duration of each first picture.

Description

Technical Field

[0001] The embodiments of the present application relate to image processing technologies, and in particular, to a method and device for obtaining evaluation parameters of an application sliding effect. Background Art

[0002] With the popularization of electronic devices, more and more user requirements are realized through various applications on the electronic devices. In order to provide users with a better application usage experience, the coherence or fluency of users using applications on electronic devices is evaluated, so as to make corresponding improvements according to the evaluation results. Considering that the most commonly used electronic devices currently are touch-controlled terminals, therefore, the interface display effect (simply referred to as the application sliding effect) when users slide applications on electronic devices is mainly evaluated. In order to evaluate the application sliding effect, first use a high-speed camera to shoot the application sliding process on the electronic device within a certain time period. Then, manually count the number of frames in the captured pictures. Then, calculate the frame rate based on the number of frames and the time period, so as to evaluate the application sliding effect through the frame rate.

[0003] When manually counting the number of frames, it is impossible to accurately find the subtle changes in the content of several consecutive frames in the captured pictures. Furthermore, it may be considered that the content of these consecutive frames has not changed, and these consecutive frames are recorded as one frame. In this way, there is a certain error in the number of frames counted manually, and there is also an error in the frame rate calculated using this number of frames. And, compared with the frame rate, the integrity of the interface content displayed by the electronic device during the process of sliding the application on the electronic device has a greater impact on the application sliding effect. To sum up, the frame rate calculated by the above solution cannot accurately evaluate the application sliding effect on the electronic device. Summary of the Invention

[0004] The present application provides a method and device for obtaining evaluation parameters of an application sliding effect, which can obtain evaluation parameters for more accurately evaluating the application sliding effect on an electronic device.

[0005] In a first aspect, the present application provides a method for obtaining an evaluation parameter of the sliding effect of an application. In this method, first, N first pictures of a first application displayed by an electronic device in response to a user's sliding operation can be obtained; then, according to a preset color range, and the sizes and shapes of a preset plurality of placeholders, the placeholders in the N first pictures can be identified; then, according to the area ratio of the placeholders in the N first pictures in the N first pictures, the content integrity of the N first pictures can be calculated; or, according to the display duration of the first pictures including placeholders in the N first pictures, in the duration ratio of the total display duration of the N first pictures, the content integrity of the N first pictures can be calculated; or, according to the area ratio of the placeholders in the N first pictures in the N first pictures, and the display duration of each first picture in the N first pictures, the content integrity of the N first pictures can be calculated. Wherein, N is a positive integer. The preset color range is the color range to which the pixel points in the preset plurality of placeholders belong. The above content integrity is used to evaluate the interface effect of the first application displayed by the electronic device in response to the sliding operation.

[0006] It can be understood that if any of the first pictures displayed by the electronic device includes a placeholder, it means that there is still content to be loaded in this first picture. That is to say, the content of this frame of picture displayed by the electronic device is incomplete. Thus, after identifying the placeholders in the N first pictures, the content integrity of the N first pictures can be calculated according to the placeholders in the N first pictures.

[0007] In one calculation method, the content integrity of the N first pictures can be calculated according to the area ratio of the placeholders in the N first pictures in the N first pictures. From the above description, it can be known that if any of the first pictures displayed by the electronic device includes a placeholder, it means that the content of this frame of picture displayed by the electronic device is incomplete. Therefore, the area ratio of the placeholder in the corresponding first picture can be used to calculate the content integrity of this frame of picture displayed by the electronic device.

[0008] In another calculation method, the content integrity of the N first pictures can be calculated according to the duration ratio of the display duration of the first pictures including placeholders in the N first pictures in the total display duration of the N first pictures. It can be understood that if the duration ratio of the display duration of the first pictures including placeholders in the N first pictures in the total display duration of the N first pictures is relatively large, it means that there are more first pictures including placeholders (i.e., the first pictures with incomplete content) in the N first pictures. That is to say, the content of multiple frames of pictures in the N first pictures displayed by the electronic device is incomplete. Therefore, the above duration ratio can be used to calculate the content integrity of the N first pictures.

[0009] In another calculation method, the content integrity of the N first pictures can be calculated based on the area ratio of the placeholders in the N first pictures and the display duration of each first picture. From the above description, it can be known that if any of the first pictures displayed by the electronic device includes a placeholder, it means that the content of this frame of picture displayed by the electronic device is incomplete. Therefore, the area ratio of the placeholder in the corresponding first picture and the display duration of each first picture can be used to calculate the content integrity of this frame of picture displayed by the electronic device.

[0010] Among them, the higher the content integrity of the N first pictures, the more content the user can view from the above N first pictures. Therefore, the level of the content integrity of the N first pictures has a greater impact on the user's viewing experience; therefore, the content integrity of the N first pictures can be used as an evaluation parameter for the application sliding effect, and can more accurately evaluate the interface effect of the first application displayed by the electronic device in response to the sliding operation (i.e., the application sliding effect on the electronic device).

[0011] In this application, the placeholders in the N first pictures can be recognized; then, the content integrity of the N first pictures can be calculated according to the above area ratio or duration ratio to obtain an evaluation parameter for the application sliding effect. In this application, during the process of obtaining the evaluation parameter for the application sliding effect, no manual participation or the assistance of other devices (such as a high-speed camera) is required; the above content integrity can be automatically obtained, and the calculation process is simple and easy to implement.

[0012] In a possible design of the first aspect, the calculation of the content integrity of the N first pictures based on the area ratio of the placeholders in the N first pictures in the N first pictures includes: first calculating the area ratio of the placeholders in each first picture in the N first pictures in the corresponding first picture, and calculating the average value of the area ratios of the N first pictures; then calculating a first difference, where the first difference is the difference between 1 and the average value. The first difference is used to represent the content integrity of the N first pictures.

[0013] In another possible design of the first aspect, the calculation of the content integrity of the N first pictures based on the duration ratio of the display duration of the first pictures including placeholders in the N first pictures in the total display duration of the N first pictures includes: first counting the display duration of each first picture in the N first pictures, and calculating the display duration of the first pictures including placeholders in the N first pictures and the total display duration of the N first pictures; then calculating a first ratio, where the first ratio is the ratio of the display duration of the first pictures including placeholders in the N first pictures to the total display duration of the N first pictures; then, calculating a second difference, where the second difference is the difference between 1 and the first ratio. The second difference is used to represent the content integrity of the N first pictures.

[0014] In another possible design manner of the first aspect, calculating the content integrity of the N first pictures according to the area ratio of the placeholders in the N first pictures and the display duration of each first picture in the N first pictures includes: calculating the area ratio of the placeholders in each first picture in the N first pictures to the area of the corresponding first picture, counting the display duration of each first picture, and calculating the product of the area ratio and the display duration of the first picture for each first picture; calculating the total display duration of the N first pictures; calculating a second ratio; the second ratio is the ratio of the sum of all the products of the N first pictures to the total display duration of the N first pictures; calculating a third difference, the third difference is the difference between 1 and the second ratio; the third difference is used to represent the content integrity of the N first pictures.

[0015] In another possible design manner of the first aspect, the preset color interval is a preset Hue, Saturation, Value (HSV) interval. Identifying the placeholders in the N first pictures according to the preset color interval, as well as the sizes and shapes of the preset multiple placeholders includes: for each first picture in the N first pictures, performing the following operations to identify the placeholders in the corresponding first picture: first, obtaining the HSV values of each pixel point, setting the HSV values of the pixel points whose HSV values are within the preset HSV interval to a first preset HSV value, and setting the HSV values of the pixel points whose HSV values are not within the preset HSV interval to a second preset HSV value to obtain a second picture; then, searching for a graph with the corresponding size and shape from the area where the HSV value in the second picture is the first preset HSV value according to the sizes and shapes of the preset multiple placeholders; then, if a graph with the corresponding size and shape is searched, determining that the graph is the placeholder in the corresponding first picture. Wherein, the second picture includes an area where the HSV value is the first preset HSV value and an area where the HSV value is the second preset HSV value; the difference between the first preset HSV value and the second preset HSV value is greater than a preset threshold.

[0016] In another possible design manner of the first aspect, searching for a graph with the corresponding size and shape from the area where the HSV value in the second picture is the first preset HSV value according to the sizes and shapes of the preset multiple placeholders includes: first, performing image processing on the second picture to obtain a processed second picture; then, searching for a graph with the corresponding size and shape from the processed second picture according to the sizes and shapes of the preset multiple placeholders. Wherein, the image processing includes at least one of image denoising and image morphological processing. Image denoising includes at least one of: performing an AND operation on the second picture and the corresponding first picture to restore the original color of the area where the HSV value in the second picture is the first preset HSV value; Gaussian denoising; and binarization operation.

[0017] In another possible design of the first aspect, the method further includes: if a graphic with a corresponding size and shape is not found, performing border burr processing on the processed second picture to obtain a second picture after burr processing; then, searching for a graphic with a corresponding size and shape in the second picture after burr processing according to the sizes and shapes of a plurality of preset placeholders; and then, if a graphic with a corresponding size and shape is found, determining that the graphic is the placeholder in the corresponding first picture.

[0018] In another possible design of the first aspect, the preset color range is a preset HSV range. Before identifying the placeholders in N frames of first pictures according to the preset color range and the sizes and shapes of a plurality of preset placeholders, the method further includes: first obtaining pictures of a plurality of placeholders of at least one application; then obtaining the HSV values of each pixel point in the pictures of the plurality of placeholders, and determining the preset HSV range according to the obtained HSV values.

[0019] In a second aspect, the present application provides a device for obtaining an evaluation parameter of an application sliding effect. The device includes: an obtaining module, a picture recognition module, and a calculation module. Among them, the obtaining module is configured to obtain N frames of first pictures of a first application displayed by an electronic device in response to a user's sliding operation; N is a positive integer. The picture recognition module is configured to identify the placeholders in N frames of first pictures according to a preset color range and the sizes and shapes of a plurality of preset placeholders; the preset color range is the color range to which the pixel points in the plurality of preset placeholders belong. The calculation module is configured to calculate the content integrity of N frames of first pictures according to the area ratio of the placeholders in N frames of first pictures in the N frames of first pictures; or calculate the content integrity of N frames of first pictures according to the duration ratio of the display duration of the first pictures including placeholders in N frames of first pictures in the total display duration of N frames of first pictures; or calculate the content integrity of N frames of first pictures according to the area ratio of the placeholders in N frames of first pictures and the display duration of each frame of first pictures in N frames of first pictures. Among them, the content integrity is used to evaluate the interface effect of the electronic device displaying the first application in response to the sliding operation.

[0020] In a possible design of the second aspect, the calculation module is specifically configured to: first calculate the area ratio of the placeholders in each frame of the N frames of first pictures in the corresponding first picture, and calculate the average value of the area ratios of the N frames of first pictures; then calculate a first difference, where the first difference is the difference between 1 and the average value. The first difference is used to represent the content integrity of N frames of first pictures.

[0021] In another possible design of the second aspect, the calculation module is specifically configured to: first, count the display duration of each of the N first pictures, and calculate the display duration of the first pictures including placeholders among the N first pictures, as well as the total display duration of the N first pictures; then, calculate a first ratio, where the first ratio is the ratio of the display duration of the first pictures including placeholders among the N first pictures to the total display duration of the N first pictures; finally, calculate a second difference, where the second difference is the difference between 1 and the first ratio. The second difference is used to characterize the content integrity of the N first pictures.

[0022] In another possible design of the second aspect, the calculation module is specifically configured to: calculate the area ratio of the placeholders in each of the N first pictures to the area of the corresponding first picture, count the display duration of each first picture, and calculate the product of the area ratio and the display duration for each first picture; calculate the total display duration of the N first pictures; calculate a second ratio; the second ratio is the ratio of the sum of all the products of the N first pictures to the total display duration of the N first pictures; calculate a third difference, where the third difference is the difference between 1 and the second ratio; the third difference is used to characterize the content integrity of the N first pictures.

[0023] In another possible design of the second aspect, the preset color range is a preset HSV range. The picture recognition module is specifically configured to, for each of the N first pictures, perform the following operations to identify the placeholders in the corresponding first picture: first, obtain the HSV values of each pixel point, set the HSV values of the pixel points within the preset HSV range to a first preset HSV value, and set the HSV values of the pixel points not within the preset HSV range to a second preset HSV value to obtain a second picture; then, search for a graphic with the corresponding size and shape from the area where the HSV value is the first preset HSV value in the second picture according to the sizes and shapes of a preset plurality of placeholders; then, if a graphic with the corresponding size and shape is searched, determine that the graphic is the placeholder in the corresponding first picture. Wherein, the second picture includes an area where the HSV value is the first preset HSV value and an area where the HSV value is the second preset HSV value. The difference between the first preset HSV value and the second preset HSV value is greater than a preset threshold.

[0024] In another possible design of the second aspect, the picture recognition module is specifically configured to: perform image processing on the second picture to obtain the processed second picture; and then search for a graphic with a corresponding size and shape in the processed second picture according to the sizes and shapes of a plurality of preset placeholders. The image processing includes at least one of image denoising and image morphological processing. The image denoising includes at least one of: performing an AND operation on the second picture and the corresponding first picture to restore the original color of the area in the second picture where the HSV value is the first preset HSV value; Gaussian denoising; and binary operation.

[0025] In another possible design of the second aspect, the picture recognition module is further configured to: if no graphic with a corresponding size and shape is found, perform border burr processing on the processed second picture to obtain the second picture after burr processing; then search for a graphic with a corresponding size and shape in the second picture after burr processing according to the sizes and shapes of a plurality of preset placeholders; and then, if a graphic with a corresponding size and shape is found, determine that the graphic is the placeholder in the corresponding first picture.

[0026] In another possible design of the second aspect, the preset color range is a preset HSV range. The device further includes a color statistics module. The color statistics module is configured to: before identifying the placeholders in N frames of the first pictures according to the preset color range and the sizes and shapes of a plurality of preset placeholders, obtain pictures of a plurality of placeholders of at least one application; then obtain the HSV values of each pixel point in the pictures of the plurality of placeholders, and determine the preset HSV range according to the obtained HSV values.

[0027] In a third aspect, the present application provides an electronic device, which includes a processor, a memory, and a communication interface; the memory and the communication interface are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, the memory includes a non-volatile storage medium, and when the processor executes the computer instructions, the electronic device is caused to execute the method as described in the first aspect and any one of its possible design manners.

[0028] In a fourth aspect, the present application provides a computer storage medium, which includes computer instructions, and when the computer instructions run on an electronic device, the electronic device is caused to execute the method as described in the first aspect and any one of its possible design manners.

[0029] In a fifth aspect, the present application provides a computer program product, and when the computer program product runs on an electronic device, the electronic device is caused to execute the method as described in the first aspect and any one of its possible design manners.

[0030] For the second aspect of this application and any possible design thereof, as well as the technical effects brought about by the third, fourth, and fifth aspects, reference may be made to the technical effects brought about by different design manners in the first aspect above, which will not be elaborated herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 Schematic diagram of the composition of an electronic device provided in an embodiment of this application Figure 1 ;

[0032] Figure 2A Schematic diagram of an application interface provided in an embodiment of this application Figure 1 ;

[0033] Figure 2B Schematic diagram II of an application interface provided in an embodiment of this application;

[0034] Figure 3 Flowchart of a method for obtaining evaluation parameters of an application sliding effect provided in an embodiment of this application Figure 1 ;

[0035] Figure 4A Flowchart of a method for identifying placeholders in a picture provided in an embodiment of this application Figure 1 ;

[0036] Figure 4B Flowchart II of a method for identifying placeholders in a picture provided in an embodiment of this application;

[0037] Figure 5 Flowchart II of a method for obtaining evaluation parameters of an application sliding effect provided in an embodiment of this application;

[0038] Figure 6A Simplified diagram of a first picture of a certain frame of an application provided in an embodiment of this application;

[0039] Figure 6B Second picture with modified HSV value provided in an embodiment of this application;

[0040] Figure 6C Processed second picture provided in an embodiment of this application;

[0041] Figure 6D First picture marked with placeholders provided in an embodiment of this application;

[0042] Figure 6E Another first picture marked with placeholders provided in an embodiment of this application;

[0043] Figure 7 Flowchart of a method for obtaining evaluation parameters of an application sliding effect provided in an embodiment of this application Figure 3;

[0044] Figure 8 Flowchart Four of a method for obtaining evaluation parameters of an application sliding effect provided by an embodiment of the present application;

[0045] Figure 9 Flow of a method for obtaining evaluation parameters of an application sliding effect provided by an embodiment of the present application Figure 5 ;

[0046] Figure 10 Composition schematic diagram of a device for obtaining evaluation parameters of an application sliding effect provided by an embodiment of the present application;

[0047] Figure 11 Composition schematic diagram Two of an electronic device provided by an embodiment of the present application. Detailed implementation manners

[0048] In the embodiments of the present application, "first", "second", "third", etc. are used to distinguish different objects, or to distinguish different processes for the same object, rather than to describe a specific order of the objects. For example, the first picture and the second picture are different pictures.

[0049] A method for obtaining evaluation parameters of an application sliding effect provided by an embodiment of the present application can be applied to an electronic device with touch control or other devices. This electronic device can also be called a terminal. This other device can perform data interaction with the electronic device. For example, it can obtain N first pictures of a first application displayed by the electronic device in response to a user's sliding operation from the electronic device. The execution subject of the method for obtaining evaluation parameters of the application sliding effect can be a device for obtaining evaluation parameters of the application sliding effect. The device for obtaining evaluation parameters of the application sliding effect can be the above-mentioned electronic device or the above-mentioned other device. The device for obtaining evaluation parameters of the application sliding effect can also be the Central Processing Unit (CPU) of the above-mentioned electronic device (or the above-mentioned other device); or, a control module in the above-mentioned electronic device (or the above-mentioned other device) for executing the evaluation parameters of the application sliding effect, and so on.

[0050] It should be noted that the terminal in the embodiments of the present application can be a mobile phone, a tablet computer, a computer with wireless transceiver function, a virtual reality terminal, an augmented reality terminal, a wireless terminal in industrial control, a wireless terminal in unmanned driving, a wireless terminal in remote surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, and so on. The embodiments of the present application do not limit the specific technologies and specific device forms adopted by the terminal.

[0051] Figure 1 This is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application. As Figure 1 shown, the electronic device may include at least one processor 11, a memory 12, a communication interface 13, and a bus 14.

[0052] Next, a specific introduction to each component of the electronic device will be given in conjunction with Figure 1 :

[0053] The processor 11 may be a single processor or a collective term for multiple processing elements. For example, the processor 11 may be a CPU, or an application specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application solution, such as: one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs).

[0054] Among them, the processor 11 can execute various functions of the electronic device by running or executing software programs stored in the memory 12 and calling data stored in the memory 12.

[0055] In a specific implementation, as an embodiment, the processor 11 may include one or more CPUs. For example, as Figure 1 shown, the processor 11 includes CPU0 and CPU1.

[0056] In a specific implementation, as an embodiment, the electronic device may include multiple processors. For example, as Figure 1 shown, it includes a processor 11 and a processor 15. Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). Here, the processor may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0057] The memory 12 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or can also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 12 can exist independently and be connected to the processor 11 through the bus 14. The memory 12 can also be integrated with the processor 11. Among them, the memory 12 is used to store the software program for executing the solution of this application and is controlled by the processor 11 for execution.

[0058] The communication interface 13 is used to communicate with other devices or communication networks, such as for communicating with communication networks such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc. The communication interface 13 can include a receiving unit to implement the receiving function and a transmitting unit to implement the transmitting function.

[0059] The bus 14 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity of representation, Figure 1 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0060] Figure 1The device structure shown does not constitute a limitation on the electronic device, which may include more or fewer components than shown, or combine certain components, or have a different component arrangement. Although not shown, the electronic device may also include a battery, a camera, a Bluetooth module, a Global Position System (GPS) module, a display screen, etc., which will not be elaborated here.

[0061] It should be noted that the hardware structure of the above device for obtaining the evaluation parameters of the application sliding effect may refer to Figure 1 the schematic diagram of the hardware structure of the electronic device shown.

[0062] With the popularization of electronic devices, especially touch-controlled terminals, the operation of electronic devices is simpler and more convenient. Therefore, more and more user requirements are realized through various applications on the electronic device. In response to user requirements, there have emerged not only applications with more functions but also more types of applications, such as mobile applications (APPlications, APPs), instant apps that do not require installation, mini-programs that do not require installation, and so on. In addition to meeting user requirements, the manufacturers of electronic devices or the managers of applications also evaluate the coherence or fluency of users' use of applications on electronic devices, and make corresponding improvements based on the evaluation results, so as to provide users with a better application usage experience.

[0063] Considering that the most widely used electronic devices currently are touch-controlled terminals, therefore, the interface display effect (simply referred to as the application sliding effect) when users perform a sliding operation on an application on the electronic device is mainly evaluated. The evaluation parameter used in the related technology to evaluate the application sliding effect is the frame rate. Specifically, first, a high-speed camera is used to shoot the interface change process of the first application in response to the sliding operation on the electronic device within a certain duration. Then, the pictures of the same content in the captured pictures are counted as 1 frame manually until all the captured pictures are counted, and the number of frames is obtained. Then, the frame rate is calculated based on the number of frames and the duration, and this frame rate is used to evaluate the application sliding effect.

[0064] The above related technology requires the assistance of a high-speed camera and manual participation to obtain the frame rate, and there are many technical implementation requirements. Secondly, when manually counting the number of frames, it is impossible to accurately detect the subtle changes in the content of several consecutive frames in the captured pictures. Furthermore, it may be considered that the content of these consecutive frames has not changed, and these consecutive frames are counted as 1 frame. In this way, there is a certain error in the number of frames counted manually, and the frame rate calculated using this number of frames also has an error. The frame rate with errors cannot accurately evaluate the application sliding effect on the electronic device. Moreover, currently, the frame rates of sliding applications on different terminals, or the frame rates of sliding different applications on a terminal, have very small differences, and it is difficult to evaluate the application sliding effect on the electronic device through the frame rate.

[0065] In addition, by comparing this frame rate with the output frame rate of the electronic device, one can only find out whether frames are dropped when the electronic device responds to the sliding operation and displays the interface of the first application, that is, whether the electronic device displays all the pictures of the first application when responding to the sliding operation. However, the fact that the electronic device does not drop frames or drops few frames does not mean that the sliding effect of the application on the electronic device is good, because there may be a situation where the content of each frame picture of the first application displayed by the electronic device in response to the sliding operation is incomplete, which has a greater impact on the user experience. Therefore, determining whether frames are dropped through this frame rate cannot accurately evaluate the sliding effect of the application on the electronic device.

[0066] Exemplarily, refer to Figure 2A the schematic diagram of the application interface shown. The user opens the product browsing interface 20 of a certain shopping application on the electronic device, and multiple product information is displayed on the product browsing interface 20. The multiple product information includes: the picture and detailed introduction of product 21, the picture and detailed introduction of product 22, the picture and detailed introduction of product 23, and the picture and detailed introduction of product 24. Among them, the detailed introduction of product 21 is "outdoor sports shoes, ￥99", the detailed introduction of product 22 is "comfortable cloth shoes, ￥159", the detailed introduction of product 23 is "fashionable leather shoes, ￥299", and the detailed introduction of product 24 is "fashionable cloth shoes, ￥199". It can be known that on the product browsing interface 20, the picture of product 21 is loaded and displayed on the placeholder of product 21, the picture of product 22 is loaded and displayed on the placeholder of product 22, the picture of product 23 is loaded and displayed on the placeholder of product 23, and the picture of product 24 is loaded and displayed on the placeholder of product 24.

[0067] Furthermore, according to the method of the arrow in Figure 2A , perform a sliding operation on this shopping application. The electronic device responds to this sliding operation and draws and outputs multiple frames of first pictures according to the output frame rate. Taking a certain frame of the multiple frames of first pictures as an example, refer to Figure 2B . A certain frame of the first picture is successfully displayed on the product browsing interface 20, but the content of a certain frame of the first picture displayed on the product browsing interface 20 is incomplete. In addition to the above multiple product information, a certain frame of the first picture also includes the placeholder and detailed introduction of product 25, and the placeholder and detailed introduction of product 26. Among them, the detailed introduction of product 25 is "cowhide leather shoes", and the detailed introduction of product 26 is "canvas shoes". The placeholder of product 25 indicates that the picture of product 25 has not been successfully loaded, and the placeholder of product 26 indicates that the picture of product 26 has not been successfully loaded. It can be seen that the incomplete content when displaying a certain frame of the first picture causes the user to be unable to obtain complete information, greatly reducing the user experience.

[0068] In summary, the process of obtaining the frame rate in the above related technologies is complex, and the obtained frame rate cannot accurately evaluate the sliding effect of an application on an electronic device.

[0069] An embodiment of the present application provides a method for obtaining an evaluation parameter of an application sliding effect, which can simplify the process of obtaining the evaluation parameter and make the obtained evaluation parameter more accurately evaluate the sliding effect of an application on an electronic device.

[0070] The method for obtaining an evaluation parameter of an application sliding effect provided by an embodiment of the present application can be applied to an electronic device with touch control or other devices. Taking an electronic device as an example, the method for obtaining an evaluation parameter of an application sliding effect will be introduced below.

[0071] An embodiment of the present application provides a method for obtaining an evaluation parameter of an application sliding effect. When an electronic device displays N first pictures of a first application in response to a user's sliding operation, there may be incompletely loaded content on any of the N first pictures, and only a placeholder corresponding to the content is displayed for the incompletely loaded content on any of the N first pictures. Therefore, the placeholders can be recognized in the N first pictures, and then the area ratio of the placeholders in the corresponding first pictures can be calculated, and the content integrity of the N first pictures can be calculated using the area ratio. As Figure 3 shown, the method for obtaining an evaluation parameter of an application sliding effect may include S301-S303.

[0072] S301. The electronic device obtains N first pictures of a first application that the electronic device displays in response to a user's sliding operation, where N is a positive integer.

[0073] When the electronic device runs the first application, the interface of the first application is displayed on the touch screen of the electronic device. The user can perform a sliding operation on the first application through the touch screen. The electronic device responds to the sliding operation and outputs N first pictures at a fixed output frame rate; the N first pictures include a start frame (the 1st frame) to an end frame (the Nth frame). Furthermore, the N first pictures are continuously displayed on the interface of the first application on the touch screen. The electronic device can obtain one first picture output by the electronic device at an output time interval until N first pictures are obtained, or directly obtain N first pictures. Among them, the first application can be any application installed in the electronic device.

[0074] Among them, the output frame rate is an inherent attribute of the electronic device. The output time interval of the electronic device is determined by the output frame rate.

[0075] In some embodiments, each of the N frames of the first pictures represents a page of a first application drawn by the electronic device in response to the sliding operation. The content in the page may include pictures, text, etc. A certain content in the page may be loaded and displayed on a corresponding placeholder in the page. When a certain content on the page is not loaded completely, the placeholder corresponding to the content is displayed on the page. The placeholder may also be referred to as an uncompleted loading block, and the area where the content on the page is loaded completely may be referred to as a completed loading block.

[0076] S302. The electronic device identifies the placeholders in the N frames of the first pictures according to a preset color range and the sizes and shapes of a preset plurality of placeholders.

[0077] Among them, if a frame of picture displayed by the electronic device includes a placeholder, it means that this frame of picture includes content that has not been successfully loaded; that is, this frame of picture displayed by the electronic device is incomplete.

[0078] Generally speaking, the color values of the respective pixel points corresponding to the placeholder in any frame of picture are within a certain color range (i.e., the above-mentioned preset color area); and the size and shape of the placeholder are both fixed; therefore, in the embodiments of the present application, the placeholders in the N frames of the first pictures can be identified according to the preset color range and the sizes and shapes of a preset plurality of placeholders.

[0079] In the embodiments of the present application, for each of the N frames of the first pictures, the electronic device identifies a graphic that conforms to the preset color range and the sizes and shapes of a preset plurality of placeholders. If such a graphic is identified, it is confirmed that the graphic is the placeholder in the corresponding first picture. If such a graphic is not identified, it is determined that this frame of the first picture does not include a placeholder.

[0080] Exemplarily, the above-mentioned preset color range may include a preset HSV range or a preset Red, Green, Blue (RGB) range. For example, the preset HSV range may be generated according to the HSV values of the pixel points in the placeholders used by at least one application. For example, the preset RGB range may be generated according to the RGB values of the pixel points in the placeholders used by at least one application.

[0081] In the embodiments of the present application, taking the preset color range being the preset HSV range as an example, the process of the electronic device determining the preset color range is introduced. Specifically, before S302, the electronic device may obtain pictures of a plurality of placeholders of at least one application. Then, the HSV values of the respective pixel points in the pictures of the plurality of placeholders are obtained, and the preset HSV range is determined according to the obtained HSV values.

[0082] After the electronic device obtains the HSV values of each pixel point in the pictures of multiple placeholders, it can determine the maximum HSV value (upper_hsv) and the minimum HSV value (lower_hsv) among the obtained HSV values. The maximum HSV value and the minimum HSV value form a preset HSV range.

[0083] Among them, at least one application may include the above-mentioned first application. Of course, the at least one application may also include one or more applications installed in the electronic device. Alternatively, the at least one application may not only include the applications installed in the electronic device, but also include applications not installed in the electronic device. It can be understood that each application may include multiple application pages (also referred to as application interfaces), and different application pages may include different placeholders. The pictures of the multiple placeholders of the at least one application include: the pictures of one or more placeholders of each application in the at least one application.

[0084] It should be noted that the process of the electronic device obtaining the preset RGB range is the same as the process of obtaining the preset HSV range, and will not be elaborated in the embodiments of the present application.

[0085] In the embodiments of the present application, the electronic device may also determine the sizes and shapes of the preset multiple placeholders before executing S302. Specifically, before S302, the electronic device may obtain the pictures of the multiple placeholders of at least one application, and may also determine the sizes and shapes of the preset multiple placeholders according to the pictures of the placeholders of at least one application. Among them, the size of the preset multiple placeholders may be a size range or one or more size values. The shapes of the preset multiple placeholders may include at least one of the following: square, rectangle, oblong, circle, rhombus, etc.

[0086] In some embodiments, the electronic device may use the shape represented by the pictures of the multiple placeholders of at least one application as the shape of the preset multiple placeholders. According to the pictures of the placeholders of at least one application, determine the maximum size and the minimum size of the placeholder, and use the sizes within the range from the maximum size of the placeholder to the minimum size of the placeholder as the sizes of the preset multiple placeholders.

[0087] In some embodiments, in addition to determining the pictures of the preset multiple placeholders according to the pictures of the multiple placeholders of at least one application. The electronic device may also, when displaying each application, count the size of the partial area on the interface of the electronic device where only the placeholders in the application are displayed; and set the sizes of the preset multiple placeholders according to the size of the partial area of the placeholder.

[0088] S303. The electronic device calculates the content integrity of the N first pictures according to the area ratio of the placeholders in the N first pictures. The content integrity is used to evaluate the interface effect of the first application in response to the sliding operation on the electronic device.

[0089] Among them, the electronic device can first calculate the area ratio of the placeholders in the N first pictures in the N first pictures; and then calculate the content integrity of the N first pictures according to the area ratio. The content integrity of the N first pictures can be used to evaluate the interface effect of the first application in response to the sliding operation on the electronic device. Specifically, the electronic device can determine whether the content integrity is greater than the first preset integrity threshold. If the content integrity is greater than the first preset integrity threshold, it means that the content of the page of the first application displayed in response to the sliding operation on the electronic device is complete, and it can be considered that the interface effect of the first application displayed in response to the sliding operation on the electronic device is good (that is, the application sliding effect on the electronic device is good). If the content integrity is less than or equal to the first preset integrity threshold, it means that there is a lot of missing content in the page of the first application displayed in response to the sliding operation on the electronic device, and it can be considered that the interface effect of the first application displayed in response to the sliding operation on the electronic device is poor (that is, the application sliding effect on the electronic device is good).

[0090] Furthermore, when the application sliding effect on the electronic device is poor, the electronic device or the first application can be optimized. Among them, the optimization operations on the electronic device can include: adjusting the output frame rate of the electronic device; pre-caching the network multimedia content to be displayed by the first application in the electronic device. The optimization operations on the first application can include: simplifying the page layout, simplifying the page content, etc.

[0091] For the method for obtaining the evaluation parameter of the application sliding effect provided in the embodiments of the present application, if any of the first pictures displayed by the electronic device includes a placeholder, it means that there is still content to be loaded in the first picture. That is to say, the content of this frame of picture displayed by the electronic device is incomplete. Therefore, the content integrity of the N first pictures can be calculated according to the area ratio of the placeholders in the N first pictures. Among them, the higher the content integrity of the N first pictures, the more content the user can view from the above N first pictures. Therefore, the level of the content integrity of the N first pictures has a greater impact on the user's viewing experience. Therefore, the content integrity of the N first pictures can be used as an evaluation parameter for the application sliding effect, and can more accurately evaluate the interface effect of the first application displayed in response to the sliding operation on the electronic device (that is, the application sliding effect on the electronic device).

[0092] Exemplarily, taking the preset color range as the preset HSV range as an example, a specific method for the electronic device to identify the placeholders in the N frames of first pictures according to the preset color range, as well as the sizes and shapes of a plurality of preset placeholders, will be introduced. Specifically, for each frame of the first pictures among the above N frames of first pictures, the electronic device can execute Figure 4A The steps S3021 - S3026 shown to identify the placeholders in the corresponding first picture.

[0093] S3021. The electronic device obtains the HSV values of each pixel point, sets the HSV values of the pixel points whose HSV values are within the preset HSV range to the first preset HSV value, and sets the HSV values of the pixel points whose HSV values are not within the preset HSV range to the second preset HSV value, to obtain a second picture.

[0094] Among them, the second picture includes an area with the first preset HSV value and an area with the second preset HSV value. The difference between the first preset HSV value and the second preset HSV value is greater than a preset threshold.

[0095] Exemplarily, the first preset HSV value can be the HSV value representing white, for example, (255, 255, 255); the second preset HSV value can be the HSV value representing black, for example, (0, 0, 0). Another example is that the first preset HSV value can be (200, 200, 200); the second preset HSV value can be (50, 50, 50).

[0096] It can be understood that the electronic device sets the HSV values of the pixel points belonging to the placeholders in each frame of the first pictures to the first preset HSV value, and sets the HSV values of the pixel points not belonging to the placeholders in each frame of the first pictures to the second preset HSV value, so as to separate the placeholders and the background areas outside the placeholders in each frame of the first pictures.

[0097] In some embodiments, the electronic device can modify the HSV values of each frame of the first pictures according to a color processing formula to obtain a second picture. The color processing formula is shown in formula (1):

[0098]

[0099] Among them, r is the HSV value of a pixel point in a frame of the first pictures, S is the HSV value of this pixel point in the corresponding second picture; lower_hsv is the minimum HSV value of the preset HSV range, upper_hsv is the maximum HSV value of the preset HSV range; d1 is the first preset HSV value, d2 is the second preset HSV value. d1 can be 255 representing white, and d2 can be 0 representing black.

[0100] S3022. The electronic device searches for a graphic with a corresponding size and shape from the area in the second picture where the HSV value is the first preset HSV value according to the sizes and shapes of a plurality of preset placeholders.

[0101] To improve the accuracy of the electronic device in searching for a graphic with a corresponding size and shape from the area in the second picture where the HSV value is the first preset HSV value, and thus improve the accuracy of the electronic device in identifying the placeholder; the electronic device can perform image processing on the above-mentioned second picture to obtain a processed second picture; then, search for a graphic with a corresponding size and shape from the area in the processed second picture where the HSV value is the first preset HSV value.

[0102] Among them, the above-mentioned image processing may include at least one of image denoising and image morphological processing. Image denoising may include at least one of: performing an AND operation on the second picture and the corresponding first picture to restore the original color of the area in the second picture where the HSV value is the first preset HSV value; Gaussian denoising; and binary operation.

[0103] It should be noted that if the image processing is used to improve the accuracy of identifying the placeholder, the image processing may also include other operations that can improve the accuracy of identifying the placeholder, such as border burr processing, which is not limited in the embodiments of the present application.

[0104] In the embodiments of the present application, taking the image processing including image denoising, image morphological processing and border burr processing, and the image denoising including: performing an AND operation on the second picture and the corresponding first picture, Gaussian denoising and binary operation as an example, the specific method of S3022 is described. As Figure 4B shown, Figure 4A the S3022 shown may include S3022a - S3022c.

[0105] S3022a. The electronic device performs image denoising on the second picture to obtain a denoised picture.

[0106] The electronic device can perform an AND operation on the second picture and the corresponding first picture to obtain an AND operation picture; then perform Gaussian denoising and binary operation on the AND operation picture in sequence to obtain a denoised picture. The denoised picture is divided into a white area and a black area.

[0107] S3022b. The electronic device performs morphological processing on the denoised picture to obtain a processed second picture.

[0108] The electronic device further suppresses the image noise in the denoised picture through morphological processing, and accurately depicts the edges of each white area in the denoised picture, so as to more accurately identify the placeholder in the processed second picture. The processed picture is divided into a white area and a black area.

[0109] S3022c. The electronic device searches for a figure with a corresponding size and shape from the processed second picture according to the sizes and shapes of a plurality of preset placeholders.

[0110] The electronic device can search for all figures that conform to the sizes and shapes of a plurality of preset placeholders in the white area of the processed second picture. The figures that conform to the sizes and shapes of a plurality of preset placeholders are the placeholders.

[0111] S3023. If a figure with a corresponding size and shape is searched, the electronic device determines that the above figure is the placeholder in the corresponding first picture.

[0112] If the electronic device searches for a figure with a corresponding size and shape in the processed second picture, it can mark the figure at the same position in the corresponding first picture.

[0113] S3024. If a figure with a corresponding size and shape is not searched, the electronic device performs border burr processing on the processed second picture to obtain a second picture after burr processing.

[0114] Through border burr processing, for example, removing border burrs, the electronic device smooths the edges of the processed second picture; thereby improving the accuracy of searching for figures that conform to the sizes and shapes of a plurality of preset placeholders. The second picture after burr processing is divided into a white area and a black area.

[0115] S3025. The electronic device searches for a figure with a corresponding size and shape from the second picture after burr processing according to the sizes and shapes of a plurality of preset placeholders.

[0116] The electronic device can search for all figures that conform to the sizes and shapes of a plurality of preset placeholders in the white area of the second picture after burr processing.

[0117] S3026. If a figure with a corresponding size and shape is searched, the electronic device determines that the above figure is the placeholder in the corresponding first picture; if a figure with a corresponding size and shape is not searched, the electronic device determines that the above frame of the first picture does not include a placeholder.

[0118] It should be noted that in order to identify all the placeholders in a frame of the first picture at one time as much as possible, after the electronic device executes S3022b to obtain the processed second picture, it can perform border burr processing on the processed second picture to obtain a second picture after burr processing. After obtaining the second picture after burr processing, the electronic device does not execute S3023 - S3024 and directly executes S3025 - S3026.

[0119] The specific method for identifying the placeholders in each of the N frames of the first pictures provided by the embodiments of this application is that the electronic device first modifies the HSV values of the pixel points of each frame of the first pictures according to the preset HSV intervals corresponding to the placeholders, so as to distinguish the placeholders in each frame of the first pictures from the areas outside the placeholders. Then, various image processing operations are performed on the second picture to reduce the influence of image noise on the identification of the placeholders. Since the image noise interfering with the placeholder identification in the processed second picture (or the second picture after burr processing) is reduced, the accuracy of searching for a graphic that conforms to the sizes and shapes of the preset multiple placeholders in the processed second picture (or the second picture after burr processing) is improved.

[0120] Exemplarily, after the electronic device identifies the placeholders in the N frames of the first pictures, it can sequentially determine whether each of the N frames of the first pictures includes a placeholder. Then, for the first picture including a placeholder, the electronic device can calculate the area ratio of the placeholder in the first picture to which it belongs. Finally, the electronic device can use the calculated area ratio to calculate a first difference. Specifically, refer to Figure 5 , S303 may include S303a - S303b.

[0121] S303a. The electronic device calculates the area ratio of the placeholder in each of the N frames of the first pictures to the first picture to which it belongs, and calculates the average value of the area ratios of the N frames of the first pictures.

[0122] The electronic device can calculate the area ratio of the placeholder in each of the first pictures including a placeholder among the N frames of the first pictures to the first picture to which it belongs; then, calculate the average value of the obtained area ratios. Among them, for the first picture that does not include a placeholder, the area ratio of the placeholder in the first picture to which it belongs is equal to 0.

[0123] It can be understood that since the placeholder represents the area where the content on the page has not been successfully loaded, then, the area ratio of the placeholder in the first picture to which it belongs can represent the content missing ratio of the page displayed by the first picture to which it belongs. The average value of the area ratios can also represent the content missing ratio of the page of the first application (or the N frames of the first pictures) displayed by the electronic device in response to the sliding operation.

[0124] In some embodiments, for each frame of the first pictures, the electronic device can obtain the picture size of the first picture and the size of the placeholder in the first picture. Then, calculate the picture size to obtain the area of the first picture. Also calculate the size of the placeholder to obtain the area of the placeholder. Then, divide the area of the placeholder by the area of the first picture to obtain the area ratio of the placeholder in the first picture.

[0125] Among them, the picture size can be the height and width of the first picture, with the unit of pixel piexl. The size of the placeholder in the first picture includes the sizes of one or more placeholders, and the size of each placeholder is the height and width of the placeholder, with the unit of pixel.

[0126] Furthermore, the electronic device sums up the area ratios of the placeholders in N frames of the first pictures to obtain the total area ratio. Then, the total area ratio is divided by N to obtain the average value of the area ratios.

[0127] In some embodiments, an area ratio calculation formula is used to calculate the area ratio of the placeholders in one frame of the first picture. The area ratio calculation formula is shown in Equation (2):

[0128]

[0129] Among them, R i is the area ratio of the i-th frame of the first pictures among N frames of the first pictures, and the value range of i is 1 - N. T l is the width of the i-th frame of the first picture, and T h is the height of the i-th frame of the first picture. The i-th frame of the first picture includes m placeholders, and Z jl is the width of the j-th placeholder in the i-th frame of the first picture, and Z jh is the height of the j-th placeholder in the i-th frame of the first picture.

[0130] In some embodiments, an average value calculation formula is used to calculate the average value of the area ratios. The average value calculation formula is shown in Equation (3):

[0131]

[0132] Among them, P is the average value of the area ratios of N frames of the first pictures.

[0133] S303b. The electronic device calculates a first difference, and the first difference is the difference between 1 and the average value. The first difference is used to characterize the content integrity of N frames of the first pictures.

[0134] The electronic device subtracts the average value from 1 to obtain the first difference. This first difference is the content integrity of N frames of the first pictures. It can be determined whether the first difference is greater than a first preset integrity threshold. If the first difference is greater than the first preset integrity threshold, it indicates that the electronic device displays the content of the first application completely in response to the sliding operation, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is good (that is, the application sliding effect on the electronic device is good). Otherwise, it indicates that the electronic device lacks a lot of content when displaying the first application in response to the sliding operation, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is poor (that is, the application sliding effect on the electronic device is good).

[0135] In some embodiments, the electronic device may adopt a content integrity calculation formula to calculate the first difference I. The content integrity calculation formula is shown in Equation (4):

[0136] I = 1 - P (4)

[0137] For the specific method provided by the embodiments of the present application for calculating the area ratio of the placeholder in the first picture and its average value, the electronic device can accurately obtain the height and width of the placeholder in the first picture, as well as the height and width of the first picture to which the placeholder belongs. Then, divide the product of the height and width of the placeholder in the first picture by the ratio of the product of the height and width of the first picture to which the placeholder belongs to obtain the area ratio. It can be known that the area ratio calculated using the above accurate height and width is also accurate. Then, calculate 1 minus the average value of the area ratios of N frames of the first picture to obtain the first difference. The first difference calculated using the accurate area ratio is also accurate. Therefore, the first difference can accurately represent the content integrity of N frames of the first picture.

[0138] Exemplarily, taking the first application as a certain shopping application, the method for obtaining the evaluation parameters of the application sliding effect may include steps a1 - a6.

[0139] a1. The electronic device obtains pictures of multiple placeholders of the shopping application.

[0140] a2. The electronic device obtains the HSV values of the pictures of the multiple placeholders, and forms a preset HSV interval from the obtained maximum HSV value and minimum HSV value; and also determines the sizes and shapes of the preset multiple placeholders according to the pictures of the multiple placeholders.

[0141] For example, the pictures of the multiple placeholders are all pictures that are approximately white. Assuming that the obtained HSV values of the pictures of the multiple placeholders include: (0, 0, 248), (0, 0, 249), and (0, 0, 250), it can be determined that the preset HSV interval is from (0, 0, 248) to (0, 0, 250).

[0142] For example, the images of the multiple placeholders are all square, and it is determined that the shape of the preset multiple placeholders is square. Suppose the resolutions of the images of the multiple placeholders include: 120pixel*45pixel, 120pixel*53pixel, 120pixel*60pixel, 120pixel*20pixel. It can be determined that the width range of the preset multiple placeholders is 120, and the height range of the preset multiple placeholders is 20 - 60, that is, the size range of the preset multiple placeholders is from (120, 20) to (120, 60); or, also considering that only a partial area of the placeholder in the application is displayed on the interface of the electronic device, and the impact of the placeholder with a very small height of the displayed partial area on the content integrity of the shopping application is very small, the minimum height of the placeholder can be adaptively set smaller, and it can be determined that the size range of the preset multiple placeholders is from (120, 10) to (120, 60).

[0143] a3. The electronic device obtains N frames of first images of the shopping application displayed in response to the user's sliding operation on the electronic device.

[0144] The electronic device runs the shopping application and displays the interface of the shopping application on the touch screen of the electronic device. The user performs a sliding operation on the shopping application through the touch screen, and the electronic device outputs N frames of first images in response to the sliding operation.

[0145] For example, referring to Figure 6A , taking a certain frame of the first images among the N frames of first images as an example, on the product browsing interface 50 of the shopping application, there is a search box 50-1, a prompt message of "Swipe down to view more products", and this frame of the first image. This frame of the first image includes the detailed introduction of product 51 "Fresh-keeping box, ¥99", the detailed introduction of product 52 "¥189", the picture and detailed introduction of product 53 "Large-capacity refrigerator, ¥3999", the picture and detailed introduction of product 54 "Smart TV, ¥1999", the placeholder of product 55, and the placeholder of product 56. Among them, the placeholder of product 55 indicates that the picture of product 55 has not been successfully loaded, and the placeholder of product 56 indicates that the picture of product 56 has not been successfully loaded. The placeholders of product 55 and product 56 carry special icons.

[0146] a4. The electronic device identifies the placeholders in the N frames of first images according to the preset HSV interval, as well as the size and shape of the preset multiple placeholders.

[0147] For example, for Figure 6AFor a frame of the first picture shown, set the HSV values of the pixel points with HSV values within (0, 0, 248) to (0, 0, 250) to (255, 255, 255), and set the HSV values of the pixel points outside (0, 0, 248) to (0, 0, 250) to (0, 0, 0), obtaining a second picture, as Figure 6B shown. It can be seen that Figure 6B the placeholders in (i.e., the placeholder for product 55 and the placeholder for product 56) are white areas, and the other areas except the placeholders are black areas, achieving the separation of the placeholders and the areas outside the placeholders. Among them, the special icons in the placeholder for product 55 and the placeholder for product 56 are also classified as black areas.

[0148] Then, perform the following steps on the second picture shown in Figure 6B sequence: perform AND operation, Gaussian denoising, and binarization operation with the first picture shown in Figure 6A to obtain the processed second picture, as Figure 6C shown. It can be seen that there is no image noise in the processed second picture (i.e., the sporadic white areas representing non-placeholders in the second picture), that is, the image noise is eliminated. Among them, by performing AND operation on this second picture and the corresponding first picture, the original color of the area with HSV value (255, 255, 255) in this second picture can be restored, and the color of the area with HSV value (0, 0, 0) in this second picture remains unchanged.

[0149] Then, the electronic device can search for a graphic with a corresponding size and shape in the processed second picture. If a graphic with a corresponding size and shape is searched, depict the contour of the graphic with a corresponding size and shape in the processed second picture to generate a standard image block, and perform an overlay operation on the standard image block and the first picture shown in Figure 6A to obtain the first picture marked with placeholders, as Figure 6D shown. It can be seen that the placeholder for product 56 is recognized and marked with a bold dashed line.

[0150] Secondly, if a graphic with a corresponding size and shape is not searched, the electronic device can also remove the border burrs from the processed second picture to obtain a picture after burr processing; or, the electronic device directly removes the border burrs from the processed second picture to obtain a picture after burr processing. Then search for a graphic with a corresponding size and shape in the picture after burr processing. If a graphic with a corresponding size and shape is searched, depict the contour of the graphic with a corresponding size and shape in the picture after burr processing to generate a new standard image block, and perform an overlay operation on the new standard image block and the first picture marked with placeholders to update the first picture marked with placeholders, as Figure 6EAs shown. It can be seen that the placeholders of product 55 are also recognized and marked by thick dashed lines.

[0151] a5. The electronic device calculates the proportion of the area of the placeholder in each of the N frames of the first pictures in the area of the corresponding first picture, and calculates the average value of the proportion of the areas of the N frames of the first pictures.

[0152] For each of the first pictures marked with a placeholder, the electronic device calculates the proportion of the area of the placeholder in the corresponding first picture. Then, the sum of the proportions of the areas of the N frames of the first pictures is divided by N to obtain the average value of the proportion of the areas.

[0153] a6. The electronic device calculates a first difference, where the first difference is the difference between 1 and the average value. The first difference is used to characterize the content integrity of the N frames of the first pictures, and the content integrity is used to evaluate the interface effect of the electronic device in response to the sliding operation to display the first application.

[0154] It should be noted that for the detailed descriptions of steps a5 - a6, reference can be made to the specific introductions of S303a - S303b in the above embodiments, which will not be elaborated here in the embodiments of the present application.

[0155] In the method for obtaining the evaluation parameters of the application sliding effect for the shopping application provided by the embodiments of the present application, first, multiple placeholders used by the shopping application are used to determine a preset HSV object. Then, the HSV values of the pixel points of a frame of the first picture are modified using the preset HSV range, realizing the separation of the placeholder and the area outside the placeholder in a frame of the first picture. Then, various image processings are performed on the second picture, eliminating the interference of the area outside the placeholder. Since the interference of the area outside the placeholder in the processed second picture and the second picture after burr processing is reduced, the accuracy of searching for a graph that conforms to the size and shape of the preset multiple placeholders in the processed second picture and the second picture after burr processing is improved. Finally, the proportion of the area of the placeholder in the corresponding first picture can be accurately calculated, and the accuracy of calculating the content integrity of the N frames of the first pictures using this proportion of the area is also improved.

[0156] An embodiment of the present application provides a method for obtaining evaluation parameters of the sliding effect of an application. When an electronic device displays N first pictures of a first application in response to a user's sliding operation, there may be content that has not been fully loaded on any of the first pictures of a frame. For the content that has not been fully loaded on any of the first pictures of a frame, only the placeholder corresponding to the content is displayed. Therefore, the placeholders can be recognized in the N first pictures. Then, calculate the display duration of the first pictures including placeholders among the N first pictures and the duration ratio in the total display duration of the N first pictures. It can be understood that if the display duration of the first pictures including placeholders among the N first pictures accounts for a relatively large proportion of the total display duration of the N first pictures, it means that there are more first pictures including placeholders (i.e., first pictures with incomplete content) among the N first pictures. Therefore, the content integrity of the N first pictures can be calculated using the duration ratio. Refer to Figure 7 In addition, the method for obtaining the evaluation parameters of the sliding effect of the application may further include S601 - S603.

[0157] S601. The electronic device obtains N first pictures of a first application displayed by the electronic device in response to a user's sliding operation, where N is a positive integer.

[0158] When outputting each frame of the first pictures, the electronic device also outputs the output time of each frame of the first pictures. In addition to obtaining the N first pictures, the electronic device can also obtain the output time of each frame of the first pictures among the N first pictures.

[0159] It should be noted that the detailed description of S601 can refer to the specific introduction of S301 in the above embodiment, which will not be elaborated here in the embodiment of the present application.

[0160] S602. The electronic device recognizes the placeholders in the N first pictures according to a preset color range, as well as the sizes and shapes of a preset plurality of placeholders.

[0161] It should be noted that the detailed description of S602 can refer to the specific introduction of S302 in the above embodiment, which will not be elaborated here in the embodiment of the present application.

[0162] S603. The electronic device calculates the content integrity of the N first pictures according to the duration ratio of the display duration of the first pictures including placeholders among the N first pictures in the total display duration of the N first pictures. Among them, the content integrity is used to evaluate the interface effect of the electronic device displaying the first application in response to the sliding operation.

[0163] The electronic device can, according to the output time of each of the N first pictures obtained, count the display duration of the first pictures including placeholders among the N first pictures, as well as the total display duration of the N first pictures. Then, calculate the proportion of the display duration in the total display duration, and calculate the content integrity of the N first pictures according to the proportion. Then, it can also be determined whether the content integrity is greater than a second preset integrity threshold. If the content integrity is greater than the second preset integrity threshold, it means that the duration of the complete content displayed during the process of the electronic device displaying the first application in response to the sliding operation is relatively long, that is, the user can basically see the complete content, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is good (that is, the application sliding effect on the electronic device is good). Otherwise, it means that the duration of the missing content displayed during the process of the electronic device displaying the first application in response to the sliding operation is relatively long, that is, the user sees more pages with missing content, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is poor (that is, the application sliding effect on the electronic device is good).

[0164] Further, when the application sliding effect on the electronic device is poor, the terminal or the first application can be optimized.

[0165] In the embodiments of the present application, the electronic device sequentially determines whether each of the N first pictures includes a placeholder. Then, calculate the display duration of the first pictures including placeholders, as well as the total display duration of the N first pictures. Then, according to the proportion of the display duration in the total display duration, calculate the content integrity of the N first pictures. Specifically, refer to Figure 8 , S603 may include S603a - S603c.

[0166] S603a. The electronic device counts the display duration of each of the N first pictures, and calculates the display duration of the first pictures including placeholders among the N first pictures, as well as the total display duration of the N first pictures.

[0167] The electronic device can calculate the display duration and the total display duration according to the output time of each of the N first pictures.

[0168] In some embodiments, when the k-th first picture among the N first pictures includes a placeholder, the electronic device subtracts the output time of the k-th first picture from the output time of the (k + 1)-th first picture among the N first pictures to obtain the display duration of the k-th first picture. k takes values in turn among the N - 1 values from 1 to N - 1. Sum the display durations of all the first pictures among the N first pictures to obtain the display duration of the placeholder. Subtract the output time of the first picture among the N first pictures from the output time of the N-th first picture among the N first pictures to obtain the total display duration.

[0169] The electronic device extracts the k-th first picture from N first pictures and determines whether the k-th first picture includes a placeholder. If the k-th first picture includes a placeholder, calculate the display duration of the k-th first picture; otherwise, do not calculate the display duration of the k-th first picture. Add up the display durations of all the first pictures in the N first pictures to obtain the display duration of the placeholder. In addition, calculate the total display duration of the N first pictures.

[0170] It should be noted that the display duration of the placeholder in the N first pictures calculated by the electronic device according to the output time of each first picture in the N first pictures is less than or equal to the actual display duration of the placeholder in the N first pictures, and the calculated total display duration of the N first pictures is less than the actual total display duration of the N first pictures.

[0171] In some embodiments, when the N-th first picture in the N first pictures includes a placeholder, the electronic device can also obtain the end display time of the N-th first picture. Then, subtract the output time of the (N - 1)-th first picture in the N first pictures from the end display time of the N-th first picture to obtain the display duration of the N-th first picture. Then, sum up the display durations of all the first pictures in the N first pictures to obtain the display duration of the placeholder. The display duration of this placeholder is equal to the actual display duration of the placeholder in the N first pictures.

[0172] Furthermore, the electronic device subtracts the output time of the first first picture from the end display time of the N-th first picture in the N first pictures to obtain the total display duration. This total display duration is equal to the actual total display duration of the N first pictures.

[0173] In some embodiments, when the k-th first picture in the N first pictures includes a placeholder, the electronic device calculates the area ratio of the placeholder in the k-th first picture in the corresponding first picture. When the area ratio is greater than the preset area ratio threshold, subtract the output time of the k-th first picture from the output time of the (k + 1)-th first picture to obtain the display duration of the k-th first picture. When the area ratio is not greater than the preset area ratio threshold, do not calculate the display duration of the k-th first picture, that is, the display duration of the k-th first picture is zero.

[0174] Similarly, when the Nth first picture among the N first pictures includes a placeholder, the electronic device calculates the area ratio of the placeholder in the Nth first picture to the area of the first picture to which it belongs. When the area ratio is greater than a preset area ratio threshold, the electronic device subtracts the output time of the (N - 1)th first picture in the N first pictures from the end display time of the Nth first picture to obtain the display duration of the Nth first picture. When the area ratio is not greater than the preset area ratio threshold, the display duration of the Nth first picture is not calculated, that is, the display duration of the Nth first picture is zero.

[0175] Among them, the preset area ratio threshold can be set according to the degree of influence on the user's acquisition of complete content.

[0176] It should be noted that the process of the electronic device calculating the area ratio of the placeholder in the kth first picture to the area of the first picture to which it belongs is the same as the process of the electronic device calculating the area ratio of the placeholder in each first picture among the N first pictures to the area of the first picture to which it belongs. This application embodiment will not be elaborated here.

[0177] S603b. The electronic device calculates a first ratio, where the first ratio is the ratio of the display duration of the first pictures among the N first pictures that include placeholders to the total display duration of the N first pictures.

[0178] The electronic device divides the display duration of the first picture that includes the placeholder by the total display duration to obtain the first ratio, and this first ratio is the duration ratio. The duration ratio represents the ratio of the duration during which the content displayed by the electronic device in response to the sliding operation to display the first application is incomplete. The ratio of the duration during which the content is incomplete is used to evaluate the interface effect of the electronic device in response to the sliding operation to display the first application.

[0179] S603c. The electronic device calculates a second difference, where the second difference is the difference between 1 and the first ratio. The second difference is used to characterize the content integrity of the N first pictures.

[0180] The electronic device subtracts the first ratio from 1 to obtain a second difference. This second difference is the content integrity of N frames of the first picture, and this second difference represents the proportion of the duration during which the content shown is complete in the process of the electronic device displaying the first application in response to a sliding operation. It can then be determined whether the second difference is greater than a second preset integrity threshold. If the second difference is greater than the second preset integrity threshold, it indicates that the duration during which the content shown is complete in the process of the electronic device displaying the first application in response to a sliding operation is relatively long, that is, the user can basically see the complete content, and it can be considered that the interface effect of the electronic device displaying the first application in response to a sliding operation is good (that is, the application sliding effect on the electronic device is good). Otherwise, it indicates that the duration during which the content shown is missing in the process of the electronic device displaying the first application in response to a sliding operation is relatively long, that is, the user sees more pages with missing content, and it can be considered that the interface effect of the electronic device displaying the first application in response to a sliding operation is poor (that is, the application sliding effect on the electronic device is good).

[0181] In the method for obtaining an evaluation parameter of an application sliding effect provided by an embodiment of the present application, if any frame of the first picture displayed by the electronic device includes a placeholder, it means that there is still content that needs to be loaded in this first picture. That is to say, the content of this frame of picture displayed by the electronic device is incomplete. If the display duration of the first pictures including placeholders among N frames of the first pictures accounts for a relatively large proportion of the total display duration of N frames of the first pictures, it means that there are more first pictures including placeholders among N frames of the first pictures (that is, the first pictures with incomplete content). That is to say, the content of multiple frames of the N frames of the first pictures displayed by the electronic device is incomplete. Therefore, the above-mentioned proportion of duration can be used to calculate the content integrity of N frames of the first pictures. Among them, the higher the content integrity of N frames of the first pictures, the more content the user can view from the above N frames of the first pictures. Therefore, the level of the content integrity of N frames of the first pictures has a greater impact on the user's viewing experience. Therefore, the content integrity of the N frames of the first pictures can be used as an evaluation parameter of the application sliding effect, and can more accurately evaluate the interface effect of the electronic device displaying the first application in response to a sliding operation (that is, the application sliding effect on the electronic device).

[0182] An embodiment of the present application provides a method for obtaining an evaluation parameter of an application sliding effect. When an electronic device displays N first pictures of a first application in response to a user's sliding operation, there may be unloaded content on any of the first pictures. The unloaded content on any of the first pictures only displays a placeholder corresponding to the content. Therefore, the placeholders can be recognized in the N first pictures. Then, calculate the area ratio of the placeholder in the corresponding first picture, and count the display duration of each of the N first pictures. It can be understood that the area ratio of the placeholder in a first picture represents the content completeness of that picture. Therefore, the content completeness of the N first pictures can be calculated using the area ratio of the placeholder in each of the N first pictures and the display duration. Refer to Figure 9 , the method for obtaining the evaluation parameter of the application sliding effect may further include S701 - S703.

[0183] S701. The electronic device obtains N first pictures of a first application displayed by the electronic device in response to a user's sliding operation, where N is a positive integer.

[0184] When outputting each of the first pictures, the electronic device also outputs the output time of each of the first pictures. In addition to obtaining the N first pictures, the electronic device can also obtain the output time of each of the N first pictures.

[0185] It should be noted that the detailed description of S701 can refer to the specific introduction of S301 in the above embodiment, and will not be elaborated here in the embodiment of the present application.

[0186] S702. The electronic device identifies the placeholders in the N first pictures according to a preset color range, and the sizes and shapes of a preset plurality of placeholders.

[0187] It should be noted that the detailed description of S702 can refer to the specific introduction of S302 in the above embodiment, and will not be elaborated here in the embodiment of the present application.

[0188] S703. The electronic device calculates the content completeness of the N first pictures according to the area ratio of the placeholders in the N first pictures in the N first pictures, and the display duration of each of the N first pictures. Among them, the content completeness is used to evaluate the interface effect of the electronic device displaying the first application in response to the sliding operation.

[0189] The electronic device calculates the proportion of the area of the placeholder in each of the N frames of the first picture in the corresponding first picture, counts the display duration of each frame of the first picture, and calculates the product of the area proportion and the display duration of the first picture for each frame of the first picture; then calculates the total display duration of the N frames of the first picture; also calculates a second ratio; the second ratio is the ratio of the sum of all the products of the N frames of the first picture to the total display duration of the N frames of the first picture; finally, the electronic device calculates a third difference, and the third difference is the difference between 1 and the second ratio; the third difference is used to characterize the content integrity of the N frames of the first picture.

[0190] Among them, if the area proportion of a frame of the first picture is equal to 0, the product of the area proportion and the display duration of the first picture calculated by the electronic device for this frame of the first picture is also equal to 0. The electronic device adds up all the calculated products to obtain the sum of all the products; then divides the sum of all the products by the total display duration of the N frames of the first picture to obtain the second ratio. The electronic device subtracts the second ratio from 1 to obtain the third difference. This third difference is the content integrity of the N frames of the first picture.

[0191] Among them, the second ratio characterizes the proportion of the duration of the incomplete content displayed under the influence of the incomplete degree of the content displayed during the process of the electronic device displaying the first application in response to a sliding operation; the third difference can characterize the proportion of the duration of the complete content displayed under the influence of the complete degree of the content displayed during the process of the electronic device displaying the first application in response to a sliding operation.

[0192] It should be noted that for the specific process of the electronic device calculating the proportion of the area of the placeholder in each frame of the first picture in the corresponding first picture, reference can be made to the detailed description of calculating the proportion of the area of the placeholder in each frame of the first picture in the corresponding first picture in S303a above; for the specific process of the electronic device counting the display duration of each frame of the first picture, reference can be made to the detailed description of counting the display duration of each frame of the first picture in S603a above; for the specific process of the electronic device calculating the total display duration of the N frames of the first picture, reference can be made to the detailed description of calculating the total display duration of the N frames of the first picture in S603a above; these are not elaborated here in the embodiments of the present application.

[0193] Further, the electronic device can further determine whether the third difference value is greater than a third preset integrity threshold. If the third difference value is greater than the third preset integrity threshold, it indicates that the duration of the relatively complete content displayed during the process of the electronic device displaying the first application in response to the sliding operation is longer, that is, the user can basically see the complete content, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is good (that is, the application sliding effect on the electronic device is good). Otherwise, it indicates that the duration of the relatively large amount of missing content displayed during the process of the electronic device displaying the first application in response to the sliding operation is longer, that is, the user sees a page with more content missing, and it can be considered that the interface effect of the electronic device displaying the first application in response to the sliding operation is poor (that is, the application sliding effect on the electronic device is good).

[0194] In some embodiments, the electronic device may not calculate the total display duration of N frames of the first pictures, but calculate the display duration of the first pictures including placeholders among the N frames of the first pictures; then, use the display duration of the first pictures including placeholders among the N frames of the first pictures to calculate a second ratio; the second ratio is the ratio of the sum of all products of the N frames of the first pictures to the display duration of the first pictures including placeholders among the N frames of the first pictures.

[0195] In the method for obtaining the evaluation parameter of the application sliding effect provided by the embodiments of the present application, if any frame of the first pictures displayed by the electronic device includes a placeholder, it indicates that there is still content to be loaded in the first picture. That is to say, the content of this frame of the picture displayed by the electronic device is incomplete. If the area ratio of the placeholder in a frame of the first pictures is larger, it indicates that there is more missing content in this frame of the first pictures displayed by the electronic device; then, within the display duration of this frame of the first pictures, the user can view less content from this frame of the first pictures; therefore, the process of displaying this frame of the first pictures has a greater impact on the overall experience of the user viewing the N frames of the first pictures. Therefore, the ratio of the duration of the incomplete content displayed under the influence of the degree of incompleteness of the displayed content, that is, the second ratio, can be calculated; then, subtracting this second ratio from 1 to obtain the content integrity of the N frames of the first pictures. The greater the content integrity of the N frames of the first pictures, the longer the duration of the relatively complete content displayed during the process of the electronic device displaying the first application in response to the sliding operation, that is, the user can basically see the complete content. Therefore, the content integrity of the N frames of the first pictures can be used as an evaluation parameter of the application sliding effect, and can more accurately evaluate the interface effect of the electronic device displaying the first application in response to the sliding operation (that is, the application sliding effect on the electronic device).

[0196] It can be understood that, in order to implement the above functions, the above terminals and the like include corresponding hardware structures and / or software modules for executing various functions. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0197] The embodiments of the present application can divide the above terminals and the like into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiments of the present application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0198] In the case of dividing each functional module corresponding to each function, as Figure 10 shown, the embodiments of the present application provide a device 800 for obtaining evaluation parameters of an application sliding effect. The device 800 includes: an acquisition module 801, an image recognition module 802, and a calculation module 803.

[0199] The acquisition module 801 is used to support the device 800 to execute S301, S601, S701 in the above method embodiments, and / or other processes of the technologies described herein; the image recognition module 802 is used to support the terminal 1300 to execute S302, S3021 - S3026, S3022a - S3022c, S602, S702 in the above method embodiments, and / or other processes of the technologies described herein. The calculation module 803 is used to support the device 800 to execute S303, S603, S703 in the above method embodiments, and / or other processes of the technologies described herein.

[0200] Furthermore, the above device 800 may further include: a color statistics module 804. The color statistics module 804 is used to support the device 800 to execute "obtain pictures of multiple placeholders of at least one application; then obtain the HSV values of each pixel point in the pictures of the multiple placeholders, and determine a preset HSV interval according to the obtained HSV values" in the above method embodiments, and / or other processes of the technologies described herein.

[0201] Of course, the above device 800 includes but is not limited to the unit modules listed above. For example, the device 800 may further include a storage unit for storing preset HSV intervals. Moreover, the specific functions that can be realized by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples. For a detailed description of other units of the device 800, reference can be made to the detailed description of the corresponding method steps, which will not be elaborated here in the embodiments of the present application.

[0202] In the case of adopting an integrated unit, the above acquisition module 801, image recognition module 802, calculation module 803, color statistics module 804, etc. can be integrated and implemented in a processing module. The above image recognition module 802, calculation module 803, and color statistics module 804 can be the processing module of the device 800.

[0203] Figure 11 FIG. shows a possible structural schematic diagram of the electronic device involved in the above embodiments. The electronic device 900 includes: a processing module 901, a storage module 902, and a communication module 903.

[0204] The processing module 901 is used to control and manage the electronic device 900. The storage module 902 is used to store the program code and data of the electronic device 900. The communication module 903 is used to communicate with other devices. For example, the communication module is used to receive or send data to other devices.

[0205] Among them, the processing module 901 can be a processor or a controller. For example, it can be a CPU, a general-purpose processor, a DSP, an ASIC, an FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of the present application. The processor can also be a combination that realizes computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 903 can be a transceiver, a transceiver circuit, or a communication interface, etc. The storage module 902 can be a memory.

[0206] When the processing module 901 is a processor (such as Figure 1 the processors 11 and 15 shown), the communication module 903 is a communication circuit (such as Figure 1 the communication interface 13 shown), and the storage module 902 is a memory (such as Figure 1 the memory 12 shown), the electronic device provided by the present application can be the Figure 1 electronic device shown. Among them, the above processor, communication interface, and memory can be coupled together through a bus.

[0207] The embodiment of the present application also provides a computer storage medium, in which computer program code is stored. When the above-mentioned processor executes the computer program code, the electronic device executes Figure 3 , Figure 4A , Figure 4B , Figure 5 and Figures 7 - 9 to implement the method in the above-mentioned embodiment through the relevant method steps in any one of the figures.

[0208] The embodiment of the present application also provides a computer program product. When the computer program product runs on an electronic device, it enables the electronic device to execute Figure 3 , Figure 4A , Figure 4B , Figure 5 and Figures 7 - 9 to implement the method in the above-mentioned embodiment through the relevant method steps in any one of the figures.

[0209] Among them, the device 800, electronic device 900, computer storage medium or computer program product for obtaining the evaluation parameters of the application sliding effect provided by the present application are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be elaborated here.

[0210] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated here.

[0211] In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some interfaces. The indirect coupling or communication connection of the devices or units can be in an electrical, mechanical, or other form.

[0212] The unit described as a separation component may or may not be physically separated. The component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or may be distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0213] In addition, each functional unit in various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0214] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk, or optical disk and other various media that can store program codes.

[0215] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claimed rights.

Claims

1. A method for obtaining an evaluation parameter of an application sliding effect, characterized in that, The method includes: Obtaining N first pictures of a first application displayed by an electronic device in response to a user's swiping operation; N is a positive integer; Identifying placeholders in the N first pictures according to a preset color range, and the sizes and shapes of a preset plurality of placeholders; the preset color range is the color range to which pixel points in the preset plurality of placeholders belong; Calculating the area ratio of the placeholders in each of the N first pictures in the corresponding first picture, calculating the average value of the area ratios of the N first pictures, and calculating the content integrity of the N first pictures according to the average value; or, Counting the display duration of each of the N first pictures, and calculating the display duration of the first pictures including placeholders in the N first pictures and the total display duration of the N first pictures; calculating a first ratio, where the first ratio is the ratio of the display duration of the first pictures including placeholders in the N first pictures to the total display duration of the N first pictures, and calculating the content integrity of the N first pictures according to the first ratio; or, Calculating the area ratio of the placeholders in each of the N first pictures in the corresponding first picture, counting the display duration of each of the first pictures, calculating the product of the area ratio and the display duration of each first picture, calculating the total display duration of the N first pictures, calculating a second ratio, where the second ratio is the ratio of the sum of all the products of the N first pictures to the total display duration of the N first pictures, and calculating the content integrity of the N first pictures according to the second ratio; Wherein, the content integrity is used to evaluate the interface effect of the first application displayed by the electronic device in response to the swiping operation.

2. The method according to claim 1, wherein Calculating the content integrity of the N first pictures according to the average value includes: Calculating a first difference, where the first difference is the difference between 1 and the average value; the first difference is used to represent the content integrity of the N first pictures.

3. The method according to claim 1, characterized in that Calculating the content integrity of the N first pictures according to the first ratio includes: Calculating a second difference, where the second difference is the difference between 1 and the first ratio; the second difference is used to represent the content integrity of the N first pictures.

4. The method according to claim 1, wherein Calculating the content integrity of the N first pictures according to the second ratio includes: Calculating a third difference, where the third difference is the difference between 1 and the second ratio; the third difference is used to represent the content integrity of the N first pictures.

5. The method according to any one of claims 1 to 4, characterized in that The preset color range is a preset hue, saturation, value (HSV) range; The identifying the placeholders in the N first pictures according to the preset color range, and the sizes and shapes of the preset plurality of placeholders includes: For each of the N first pictures, performing the following operations to identify the placeholders in the corresponding first picture: Obtain the HSV values of each pixel, and set the HSV values of the pixels whose HSV values are within the preset HSV range to a first preset HSV value, and set the HSV values of the pixels whose HSV values are not within the preset HSV range to a second preset HSV value, to obtain a second picture; wherein, the second picture includes an area with the HSV value being the first preset HSV value and an area with the HSV value being the second preset HSV value; the difference between the first preset HSV value and the second preset HSV value is greater than a preset threshold; According to the sizes and shapes of the preset multiple placeholders, search for a graphic with a corresponding size and shape from the area in the second picture where the HSV value is the first preset HSV value; If a graphic with a corresponding size and shape is found, determine that the graphic is the placeholder in the corresponding first picture.

6. The method according to claim 5, characterized in that The step of searching for a graphic with a corresponding size and shape from the area in the second picture where the HSV value is the first preset HSV value according to the sizes and shapes of the preset multiple placeholders includes: Perform image processing on the second picture to obtain a processed second picture; According to the sizes and shapes of the preset multiple placeholders, search for a graphic with a corresponding size and shape from the processed second picture; Wherein, the image processing includes at least one of image denoising and image morphology processing; The image denoising includes at least one of: performing an AND operation on the second picture and the corresponding first picture to restore the original color of the area in the second picture where the HSV value is the first preset HSV value; Gaussian denoising; and binary operation.

7. The method according to claim 6, wherein The method further includes: If a graphic with a corresponding size and shape is not found, perform border burr processing on the processed second picture to obtain a second picture after burr processing; According to the sizes and shapes of the preset multiple placeholders, search for a graphic with a corresponding size and shape from the second picture after burr processing; If a graphic with a corresponding size and shape is found, determine that the graphic is the placeholder in the corresponding first picture.

8. The method according to any one of claims 1 to 4, characterized in that The preset color range is the preset HSV range; Before identifying the placeholders in the N frames of first pictures according to the preset color range and the sizes and shapes of the preset multiple placeholders, the method further includes: Obtain pictures of multiple placeholders of at least one application; Obtain the HSV values of each pixel in the pictures of the multiple placeholders, and determine the preset HSV range according to the obtained HSV values.

9. An apparatus for obtaining evaluation parameters of an application sliding effect, characterized in that, The device includes: An obtaining module, configured to obtain N frames of first pictures of a first application displayed by an electronic device in response to a user's sliding operation; N is a positive integer; A picture recognition module, configured to identify the placeholders in the N frames of first pictures according to a preset color range and the sizes and shapes of preset multiple placeholders; the preset color range is the color range to which the pixels in the preset multiple placeholders belong; A calculation module, configured to calculate the area proportion of the placeholder in each of the N first pictures in the N first pictures, calculate the average value of the area proportions of the N first pictures, and calculate the content integrity of the N first pictures according to the average value; or, configured to count the display duration of each of the N first pictures, calculate the display duration of the first pictures including placeholders among the N first pictures, and the total display duration of the N first pictures; calculate a first ratio, where the first ratio is the ratio of the display duration of the first pictures including placeholders among the N first pictures to the total display duration of the N first pictures, and calculate the content integrity of the N first pictures according to the first ratio; or, configured to calculate the area proportion of the placeholder in each of the N first pictures in the respective first picture, count the display duration of each of the first pictures, calculate the product of the area proportion and the display duration of the first picture for each of the first pictures, and calculate the total display duration of the N first pictures; calculate a second ratio, where the second ratio is the ratio of the sum of all the products of the N first pictures to the total display duration of the N first pictures, and calculate the content integrity of the N first pictures according to the second ratio; wherein the content integrity is used to evaluate the interface effect of the first application displayed by the electronic device in response to the sliding operation.

10. The device according to claim 9, wherein the calculation module is specifically configured to: calculate a first difference, where the first difference is the difference between 1 and the average value; the first difference is used to represent the content integrity of the N first pictures.

11. The device according to claim 9, wherein the calculation module is specifically configured to: calculate a second difference, where the second difference is the difference between 1 and the first ratio; the second difference is used to represent the content integrity of the N first pictures.

12. The device according to claim 9, wherein the calculation module is specifically configured to: calculate a third difference, where the third difference is the difference between 1 and the second ratio; the third difference is used to represent the content integrity of the N first pictures.

13. The device according to any one of claims 9-12, characterized in that, The preset color interval is a preset hue, saturation, value HSV interval; The picture recognition module is specifically configured to perform the following operations on each of the N first pictures to identify the placeholder in the corresponding first picture: Obtain the HSV values of each pixel point, set the HSV values of the pixel points within the preset HSV interval to a first preset HSV value, and set the HSV values of the pixel points not within the preset HSV interval to a second preset HSV value to obtain a second picture; wherein, the second picture includes a region with the HSV value of the first preset HSV value and a region with the HSV value of the second preset HSV value; the difference between the first preset HSV value and the second preset HSV value is greater than a preset threshold. Search for a figure with a corresponding size and shape from the area in the second picture where the HSV value is the first preset HSV value according to the sizes and shapes of the preset multiple placeholders; If a figure with a corresponding size and shape is found, determine that the figure is the placeholder in the corresponding first picture.

14. The device according to claim 13, wherein: The picture recognition module is specifically configured to: Perform image processing on the second picture to obtain a processed second picture; Search for a figure with a corresponding size and shape in the processed second picture according to the sizes and shapes of the preset multiple placeholders; Wherein, the image processing includes at least one of image denoising and image morphological processing; The image denoising includes at least one of: performing an AND operation on the second picture and the corresponding first picture to restore the original color of the area in the second picture where the HSV value is the first preset HSV value; Gaussian denoising; and binarization operation.

15. The device according to claim 14, wherein: The picture recognition module is further configured to: If a figure with a corresponding size and shape is not found, perform border burr processing on the processed second picture to obtain a second picture after burr processing; Search for a figure with a corresponding size and shape in the second picture after burr processing according to the sizes and shapes of the preset multiple placeholders; If a figure with a corresponding size and shape is found, determine that the figure is the placeholder in the corresponding first picture.

16. The device according to any one of claims 9 - 12, characterized in that, The preset color range is a preset HSV range; the device further includes: a color statistics module; The color statistics module is configured to: Before identifying the placeholders in the N frames of the first pictures according to the preset color range and the sizes and shapes of the preset multiple placeholders, obtain pictures of the multiple placeholders of at least one application; Obtain the HSV values of each pixel point in the pictures of the multiple placeholders, and determine the preset HSV range according to the obtained HSV values.

17. An electronic device, characterized in that, The electronic device includes: a processor, a memory, and a communication interface; the memory and the communication interface are coupled to the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions; wherein, when the processor executes the computer instructions, the electronic device is caused to execute the method according to any one of claims 1-8 above.

18. A computer storage medium, characterized in that, The computer storage medium includes computer instructions, and when the computer instructions run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-8.

19. A computer program product, characterized in that, When the computer program product runs on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-8.

Images