An interface scrolling speed determination method and device, intelligent device, and storage medium
By acquiring and analyzing image sequences and feature difference information during interface scrolling in smart devices, the problem of inaccurate interface scrolling performance evaluation in existing technologies is solved, enabling more accurate and intuitive determination of interface scrolling speed.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-07
- Publication Date
- 2026-03-17
AI Technical Summary
Existing methods for evaluating the scrolling performance of smart device interfaces only use frame rate as an indicator of screen smoothness, which cannot accurately assess the scrolling performance and results in a poor user experience.
By acquiring the image sequence generated during interface scrolling, feature information of the target feature region in each frame image is extracted, feature difference information between adjacent frame images is calculated, and the scrolling speed of the interface is determined.
It improves the accuracy and intuitiveness of determining the scrolling speed of smart device interfaces, enabling a more comprehensive understanding of interface scrolling performance.
Smart Images

Figure CN117058565B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of image processing technology, specifically to a method, apparatus, smart device, and storage medium for determining interface scrolling speed. Background Technology
[0002] Scrolling functionality is widely used in smart devices, such as scrolling through call logs and photo galleries. The smoothness and responsiveness of this scrolling significantly impact user experience. However, current smoothness measurement techniques only consider frame rate as an indicator of smoothness, neglecting to calculate scrolling performance, thus failing to accurately assess the scrolling performance of smart devices. Summary of the Invention
[0003] This application provides a method, apparatus, smart device, and storage medium for determining interface scrolling speed, which can improve the accuracy of smart devices in determining interface scrolling speed.
[0004] To address the aforementioned technical problems, the embodiments of this application provide the following technical solutions:
[0005] This application provides a method for determining interface scrolling speed, including:
[0006] Obtain the image sequence generated during interface scrolling, the image sequence including multiple frames of images;
[0007] Obtain feature information of the target feature region in each frame of the image;
[0008] Determine the feature differences between the feature information of the target feature regions corresponding to each adjacent frame image in the image sequence;
[0009] The scrolling speed of the interface is determined based on the feature difference information.
[0010] In one embodiment, the feature information includes coordinate information, the feature difference information includes coordinate differences, and the feature difference information between the feature information of the target feature regions corresponding to each adjacent frame image in the image sequence includes:
[0011] The coordinate difference between the target feature regions corresponding to each adjacent frame in the image sequence is calculated based on the coordinate information.
[0012] In one embodiment, determining the scrolling speed of the interface based on the feature difference information includes:
[0013] Obtain the coordinate difference between the target feature regions corresponding to each adjacent frame image;
[0014] The candidate scrolling speed between each adjacent frame image is determined based on the coordinate difference;
[0015] The scrolling speed of the interface is determined based on the candidate scrolling speeds corresponding to each adjacent frame image.
[0016] In one embodiment, before acquiring the feature information of the target feature region in each frame image, the following steps are included:
[0017] Obtain the image parameters of each pixel in each frame of the image;
[0018] The region corresponding to the pixels whose image parameters meet the preset conditions is selected as the target feature region.
[0019] In one embodiment, acquiring the image sequence generated during interface scrolling includes:
[0020] Get the video of the interface scrolling as it scrolls;
[0021] The scrolling video of the interface is processed by image frame segmentation to obtain a multi-frame image sequence of the scrolling interface.
[0022] In one embodiment, performing image frame segmentation on the interface scrolling video to obtain a multi-frame image sequence of interface scrolling includes:
[0023] Obtain the refresh rate of the interface;
[0024] The frame rate is determined based on the refresh rate.
[0025] The interface scrolling video is processed by image frame segmentation according to the frame segmentation rate to obtain a multi-frame image sequence of interface scrolling.
[0026] In one embodiment, after determining the scrolling speed of the interface based on the feature difference information, the process includes:
[0027] The scroll speed curve of the interface is generated based on the scroll speed;
[0028] Output the rolling speed curve.
[0029] According to one aspect of this application, an interface scrolling speed determining device is also provided, comprising:
[0030] The first acquisition module is used to acquire an image sequence generated when the interface scrolls, the image sequence including multiple frames of images;
[0031] The second acquisition module is used to acquire feature information of the target feature region in each frame image;
[0032] The first determining module is used to determine the feature difference information between the feature information of the target feature regions corresponding to each adjacent frame image in the image sequence;
[0033] The second determining module is used to determine the scrolling speed of the interface based on the feature difference information.
[0034] According to one aspect of this application, a smart device is also provided, including a processor and a memory, wherein the memory stores a computer program, and when the processor invokes the computer program in the memory, it executes any of the interface scrolling speed determination methods provided in the embodiments of this application.
[0035] According to one aspect of this application, a storage medium is also provided for storing a computer program, which is loaded by a processor to execute any of the interface scrolling speed determination methods provided in the embodiments of this application.
[0036] This application embodiment can acquire an image sequence generated during interface scrolling, the image sequence including multiple frames; acquire feature information of target feature regions in each frame; determine feature difference information between the feature information of target feature regions corresponding to each adjacent frame in the image sequence; and determine the scrolling speed of the interface based on the feature difference information. By calculating the changes in target feature regions of adjacent frames, i.e., the feature difference information between target feature regions of adjacent frames, the interface scrolling speed can be accurately and quickly determined, improving the accuracy of interface scrolling speed determination for smart devices. Attached Figure Description
[0037] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0038] Figure 1 This is a flowchart illustrating the method for determining interface scrolling speed provided in an embodiment of this application;
[0039] Figure 2 This is a schematic diagram of the target feature regions of two adjacent frames of images during the interface scrolling process provided in the embodiments of this application;
[0040] Figure 3 This is a schematic diagram of the target feature regions of two adjacent frames of images during the interface scrolling process provided in the embodiments of this application;
[0041] Figure 4 This is a schematic diagram of the target feature regions of two adjacent frames of images during the interface scrolling process provided in the embodiments of this application;
[0042] Figure 5 This is a schematic diagram of the curve showing the change of interface scrolling speed over time, provided in an embodiment of this application.
[0043] Figure 6 This is a schematic diagram of the interface scrolling speed determination device provided in the embodiments of this application;
[0044] Figure 7 This is a schematic diagram of the structure of the smart device provided in the embodiments of this application. Detailed Implementation
[0045] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0046] This application provides a method, apparatus, smart device, and storage medium for determining interface scrolling speed. The apparatus is a screen scrolling speed determination device, and the storage medium is a computer-readable storage medium. The method for determining interface scrolling speed can include the screen scrolling speed determination device, which can be integrated into a smart device. This smart device can communicate with a server or terminal. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, but is not limited to these. The server and terminal can be directly or indirectly connected via wired or wireless communication, which is not limited herein. The terminal can be a mobile phone, computer, home appliance, or wearable device, etc.
[0047] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the preferred order of the embodiments.
[0048] In this embodiment, the description will be from the perspective of a smart device. Please refer to [link / reference]. Figure 1 , Figure 1 This is a flowchart illustrating a method for determining interface scrolling speed according to an embodiment of this application. The method for determining interface scrolling speed may include:
[0049] S101. Obtain the image sequence generated when the interface scrolls. The image sequence includes multiple frames of images.
[0050] Here, the interface refers to the interface of the terminal to be tested. The interface scrolling can be caused by manually sliding the interface, and the image sequence generated during the interface scrolling is acquired after the hand leaves the interface. In other words, the acquired image sequence is generated by the free scrolling of the interface. Therefore, the interface scrolling speed can be gradually reduced. The interface scrolling can also be controlled by the program to scroll the interface freely. The interface scrolling direction can be scrolling up, down, left, right, etc.
[0051] In one embodiment, the entity executing the acquisition of the image sequence generated during interface scrolling can be a camera device, which can be a high-speed camera capable of capturing a multi-frame image sequence generated during interface scrolling. After acquiring the image sequence, the camera device sends the image sequence to a smart device, enabling the smart device to acquire the image sequence generated during the scrolling of the terminal under test. Alternatively, the entity executing the acquisition of the image sequence can also be a smart device equipped with a camera device to acquire the image sequence generated during interface scrolling. The entity executing the acquisition of the image sequence can also be the terminal under test itself, which records a video of its own interface scrolling process and sends the video to a smart device, enabling the smart device to acquire the image sequence generated during the scrolling of the terminal under test. In one embodiment, the terminal under test and the smart device can be the same device; for example, the smart device records the image sequence generated during its own interface scrolling process. This embodiment does not impose specific limitations on how the image sequence generated during interface scrolling is acquired.
[0052] In one embodiment, S101 may include:
[0053] S1. Obtain the scrolling video of the interface during scrolling;
[0054] Optionally, a high-speed camera can be used to capture the interface scrolling process of the terminal under test to obtain the interface scrolling video. The interface scrolling process refers to the process of the interface scrolling freely, that is, scrolling without external force. For example, the process of the interface scrolling on its own when the user's hand leaves the interface.
[0055] S2. Perform image frame segmentation on the scrolling video to obtain a multi-frame scrolling image sequence.
[0056] Optionally, S1 may include: performing image frame segmentation processing on the interface scrolling video to obtain a multi-frame image sequence of interface scrolling, which may include: obtaining the refresh frame rate of the interface.
[0057] The refresh rate of the interface can be obtained by the smart device from the device information of the terminal under test, or the refresh rate of the interface can be uploaded to the server in advance by the terminal under test. After the smart device obtains the interface scrolling video generated when the interface of the terminal under test scrolls, it obtains the refresh rate of the interface of the terminal under test from the server.
[0058] The frame rate is determined based on the refresh rate.
[0059] The frame rate can be an integer multiple of the refresh rate of the terminal interface under test. For example, if the refresh rate of the terminal interface under test is 60Hz, the frame rate of the interface can be 60Hz or 120Hz, etc.
[0060] The scrolling video is processed by image frame segmentation based on the frame rate to obtain a multi-frame scrolling image sequence.
[0061] For example, if the scrolling video is 1 minute long and the frame rate is 60Hz, then after performing image frame segmentation on the scrolling video, a 60-frame image sequence can be obtained.
[0062] S102. Obtain feature information of the target feature region in each frame of the image;
[0063] The target feature region can be a pre-marked feature region in the interface image of the terminal to be tested. For example, the target feature region can be a pre-marked point or area in the interface, or a text detection box in a scrolling item displayed on the interface. The feature information can be coordinate information, such as the coordinate value of the mark point or the coordinate information of a point in a text detection box.
[0064] Optionally, S102 includes: establishing horizontal and vertical coordinates in each frame image, and obtaining the horizontal and vertical coordinate information of the target feature region in each frame image, wherein the direction of the vertical coordinate axis is the scrolling direction of the interface.
[0065] Optionally, the following may be included before S102:
[0066] Obtain the image parameters of each pixel in each frame; select the region corresponding to the pixel whose image parameters meet the preset conditions as the target feature region.
[0067] The image parameter can be a pixel value or a grayscale value, etc.
[0068] In one embodiment, for example, refer to Figure 2 , Figure 2This is a schematic diagram of the target feature region between two adjacent frames of images during the scrolling process provided in this application embodiment. The A marker point in the first frame image and the A' marker point in the second frame image are the target feature regions. In this embodiment, the grayscale value of the target marker point, i.e. the target feature region, is set to 0 in advance. In the process of determining the target feature region, the grayscale value of each pixel in each frame image can be obtained. If the grayscale value of the pixel is 0, then the pixel is the target marker point, i.e. the target feature region. Correspondingly, obtaining the feature information of the target feature region in each frame image may include: obtaining the coordinate value of the target marker point.
[0069] In one embodiment, for example, refer to Figure 3 , Figure 3 This is a schematic diagram of the target feature region between two adjacent frames during the interface scrolling process provided in this application embodiment. Region 201 in the (N-2)th frame and region 202 in the (N-1)th frame, i.e., the gray area, are the target feature regions. In this embodiment, the target feature regions in the interface images are pre-marked as feature regions with a grayscale value of 0. Therefore, when determining the target feature region for each frame during the interface scrolling process, the grayscale value of each pixel in each frame can be obtained. If the grayscale value of a pixel is 0, then that pixel is selected as the target feature pixel. The region corresponding to the set of pixels with a grayscale value of 0 is then taken as the target feature region. Correspondingly, obtaining the feature information of the target feature region in each frame may include: obtaining the ordinate value of the upper boundary of the target feature region in each frame or obtaining the ordinate value of the upper right corner vertex of the target feature region in each frame.
[0070] In one embodiment, for example, refer to Figure 4 , Figure 4This is a schematic diagram of the target feature region between two adjacent frames during the interface scrolling process provided in this application embodiment. The text detection box 301 in frame N and the text detection box 302 in frame N+1 are the target feature regions. In this embodiment, it should be noted that the interface displays multiple scrolling items with blank spaces between them. The image parameters of the pixels between the blank spaces and the scrolling items can change abruptly. Therefore, if a sudden change in image parameters occurs between pixels in the image, and the difference in the changed image parameters is greater than a preset difference, the scrolling items in the image are segmented into rows and columns based on the changed pixels, thus obtaining multiple scrolling item images. Among the multiple scrolling item images, the scrolling item whose pixel image parameters meet preset conditions is selected as the target feature region. For example, according to the pixel image parameters, a preset text recognition algorithm, such as an OCR optical character recognition algorithm, is used to recognize the text content in each scrolling item, and the target scrolling item corresponding to the target text content is selected as the target feature region. Correspondingly, obtaining the feature information of the target feature region in each frame image may include: obtaining the ordinate value of the upper boundary of the target scrolling item in each frame image or obtaining the ordinate value of the upper right corner vertex of the target scrolling item in each frame image.
[0071] S103. Determine the feature difference information between the feature information of the target feature regions corresponding to each adjacent frame image in the image sequence;
[0072] The feature information may include coordinate information, and the feature difference information may include coordinate difference. S103 may include: calculating the coordinate difference between the target feature regions corresponding to each adjacent frame image in the image sequence based on the coordinate information.
[0073] In one embodiment, reference is made to Figure 2 If the target feature region is a target marker point, then the coordinate values between the target marker points in each frame image are obtained, and the difference in the vertical coordinate between the target marker points in each adjacent frame image is calculated. This difference in the vertical coordinate represents the sliding distance of the target marker point in the adjacent frame image. Based on this sliding distance, the scrolling speed of the interface in this frame can be calculated. For example, if the coordinate value of the target marker point in the first frame image is A(3,3) and the coordinate value of the target marker point in the second frame image is A'(3,5), then the sliding distance of the target marker point in the first frame image and the second frame image is 2 / frame, that is, the coordinate difference between the target feature regions in the first frame image and the second frame image is 2.
[0074] In one embodiment, reference is made to Figure 3If the target feature region is a feature region with a gray value of 0, then obtain the ordinate of the upper boundary of the target feature region in each frame image, and calculate the difference between the ordinates of the upper boundary of the target feature region in adjacent frames. For example, if the ordinate of the upper boundary of the target feature region in the (N-2)th frame image is 2, and the ordinate of the upper boundary of the target feature region in the (N-1)th frame image is 3, then the coordinate difference between the target feature region in the (N-2)th frame image and the (N-1)th frame image is 1.
[0075] In one embodiment, reference is made to Figure 4 If the target feature region is a target scrolling item, then calculate the difference in the ordinate of the top right corner vertex of the target scrolling item in adjacent frame images. For example, if the ordinate of the top right corner vertex of the target scrolling item in the Nth frame image is 3, and the ordinate of the top right corner vertex of the target scrolling item in the N+1th frame image is 3.5, then the coordinate difference of the target feature region in the Nth frame and the N+1th frame image is 0.5.
[0076] S104. Determine the scrolling speed of the interface based on the feature difference information.
[0077] Optionally, S104 may include: obtaining the coordinate difference between the target feature regions corresponding to each adjacent frame image;
[0078] Candidate scrolling speeds between adjacent frames are determined based on coordinate differences.
[0079] The scrolling speed of the interface is determined based on the candidate scrolling speeds corresponding to each adjacent frame image.
[0080] For example, Figure 2 If the coordinate difference between the target feature region in the first frame and the second frame is 2, then the candidate scrolling speed between the first frame and the second frame is 2 / frame. Figure 3 If the coordinate difference between the target feature region in the (N-2)th frame and the (N-1)th frame is 1, then the candidate scrolling speed between the (N-2)th frame and the (N-1)th frame is 1 / frame. Figure 4 If the coordinate difference between the target feature region in the Nth frame and the (N+1)th frame is 0.5, then the candidate scrolling speed between the third frame and the fourth frame is 0.5 / frame.
[0081] Determining the scrolling speed of the interface based on the candidate scrolling speeds corresponding to each adjacent frame image can include: generating the scrolling speed of the interface based on the set of candidate scrolling speeds. For example, if the image sequence generated when the interface scrolls has m frames, then T = {t1, t2, t3, ..., tm-1}, where T is the interface scrolling speed, t1 is the candidate scrolling speed between the first and second frames, t2 is the candidate scrolling speed between the second and third frames, t3 is the candidate scrolling speed between the third and fourth frames, and tm-1 is the candidate scrolling speed between the (m-1)th frame and the mth frame.
[0082] In this embodiment, by calculating the candidate scrolling speed between each adjacent frame image, we can know the speed change during the interface scrolling process, thereby gaining a more comprehensive understanding of the interface scrolling performance.
[0083] Optionally, after S104, the function may further include: generating a scroll speed curve of the interface based on the scroll speed; and outputting the scroll speed curve.
[0084] In one embodiment, the scrolling speed curve can be a curve showing the change of interface scrolling speed over time, as shown in the reference. Figure 5 , Figure 5 This is a schematic diagram illustrating the change in interface scrolling speed over time, provided in an embodiment of this application. The interface scrolling speed gradually decreases over time until it stops scrolling. In this embodiment, outputting the interface scrolling speed as a scrolling speed curve over time provides a more intuitive representation of the changes in the interface scrolling speed of the terminal under test, thereby improving the intuitiveness of determining the interface scrolling speed for smart devices.
[0085] In this embodiment, the smart device acquires an image sequence generated during interface scrolling, the image sequence including multiple frames; acquires feature information of target feature regions in each frame; determines feature difference information between the feature information of target feature regions corresponding to each adjacent frame in the image sequence; and determines the interface scrolling speed based on the feature difference information. By calculating the changes in target feature regions of adjacent frames, i.e., the feature difference information between target feature regions of adjacent frames, the interface scrolling speed can be accurately and quickly determined, improving the accuracy of the smart device's interface scrolling speed determination.
[0086] To facilitate better implementation of the interface scrolling speed determination method provided in this application embodiment, this application embodiment also provides an apparatus based on the above-described interface scrolling speed determination method. The meanings of the terms used are the same as in the above-described interface scrolling speed determination method, and specific implementation details can be found in the description of the method embodiment.
[0087] Please see Figure 6 , Figure 6This is a schematic diagram of the interface scrolling speed determination device provided in the embodiments of this application. The interface scrolling speed determination device 300 may include a first acquisition module 301, a second acquisition module 302, a first determination module 303, and a second determination module 304, etc.
[0088] The first acquisition module 301 is used to acquire the image sequence generated when the interface scrolls, and the image sequence includes multiple frames of images.
[0089] The second acquisition module 302 is used to acquire feature information of the target feature region in each frame of image;
[0090] The first determining module 303 is used to determine the feature difference information between the feature information of the target feature regions corresponding to each adjacent frame image in the image sequence;
[0091] The second determining module 304 is used to determine the scrolling speed of the interface based on the feature difference information.
[0092] Optionally, the interface scrolling speed determining device may further include:
[0093] The calculation module is used to calculate the coordinate difference between the target feature regions corresponding to each adjacent frame in the image sequence based on the coordinate information.
[0094] The first acquisition module is used to acquire the coordinate difference between the target feature regions corresponding to each adjacent frame image;
[0095] The first determining module is used to determine the candidate scrolling speed between each adjacent frame image based on the coordinate difference;
[0096] The second determining module is used to determine the scrolling speed of the interface based on the candidate scrolling speeds corresponding to each adjacent frame image.
[0097] The second acquisition module is used to acquire the image parameters of each pixel in each frame of the image;
[0098] The selection module is used to select the region corresponding to the pixel points whose image parameters meet the preset conditions as the target feature region.
[0099] The third acquisition module is used to acquire the interface scrolling video generated when the interface scrolls;
[0100] The first frame-segmentation module is used to perform image frame-segmentation processing on the scrolling video of the interface to obtain a multi-frame image sequence of the scrolling interface.
[0101] The fourth acquisition module is used to acquire the refresh frame rate of the interface;
[0102] The third determining module is used to determine the frame rate based on the refresh frame rate.
[0103] The second frame segmentation module is used to perform image frame segmentation processing on the interface scrolling video according to the frame segmentation rate to obtain a multi-frame image sequence of interface scrolling.
[0104] The generation module is used to generate the scroll speed curve of the interface based on the scroll speed.
[0105] The output module is used to output the rolling speed curve.
[0106] This application also provides a smart device, which can be a terminal such as a mobile phone, etc. Figure 7 As shown, it illustrates a structural schematic diagram of the smart device involved in the embodiments of this application, specifically:
[0107] The intelligent device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will understand that... Figure 7 The smart device structure shown does not constitute a limitation on the smart device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:
[0108] The processor 401 is the control center of the smart device. It connects various parts of the smart device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 402, and by calling data stored in the memory 402, thereby providing overall monitoring of the smart device. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 401.
[0109] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created based on the use of the smart device, etc. In addition, the memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
[0110] The smart device also includes a power supply 403 that supplies power to the various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 403 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0111] The smart device may also include an input unit 404, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
[0112] Although not shown, the smart device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 401 in the smart device loads the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 runs the applications stored in the memory 402 to realize various functions, as follows:
[0113] The process involves acquiring an image sequence generated during screen scrolling, comprising multiple frames; obtaining feature information of the target feature region in each frame; determining the feature differences between the target feature regions of adjacent frames; and determining the screen scrolling speed based on these feature differences. By calculating the changes in the target feature regions of adjacent frames—that is, the feature differences between them—the screen scrolling speed can be accurately and quickly determined, improving the accuracy of screen scrolling speed determination for smart devices.
[0114] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed description of the interface scrolling speed determination method above, which will not be repeated here.
[0115] According to one aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a smart device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the smart device to perform the methods provided in the various optional implementations of the above embodiments.
[0116] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by computer instructions, or by controlling related hardware through computer instructions. These computer instructions can be stored in a storage medium and loaded and executed by a processor. The storage medium is a computer-readable storage medium. Therefore, embodiments of this application provide a storage medium storing a computer program, which may include computer instructions. This computer program can be loaded by a processor to execute any of the interface scrolling speed determination methods provided in the embodiments of this application.
[0117] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.
[0118] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0119] Since the computer instructions stored in the storage medium can execute any of the interface scrolling speed determination methods provided in the embodiments of this application, the beneficial effects that any of the interface scrolling speed determination methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.
[0120] The foregoing has provided a detailed description of a method, apparatus, smart device, and storage medium for determining interface scrolling speed according to embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. An interface scrolling speed determination method characterized by comprising: The method comprises: obtaining an image sequence generated during interface scrolling, the image sequence comprising multiple images; obtaining image parameters of each pixel point in each image; selecting a region corresponding to a pixel point whose image parameter meets a preset condition as a target feature region; selecting a region corresponding to a pixel point whose image parameter meets a preset condition as a target feature region, comprising: if image parameters of pixel points in the image suddenly change and the difference of the suddenly changed image parameters is greater than a preset difference, performing row and column segmentation on the scroll items in the image according to the suddenly changed pixel points, thereby obtaining images of multiple scroll items, and selecting a scroll item whose pixel point image parameter meets a preset condition as a target feature region, which comprises: identifying the text content in each scroll item, and selecting a target scroll item corresponding to target text content as a target feature region; obtaining feature information of the target feature region in each image; determining feature difference information between the feature information of the target feature regions corresponding to each adjacent image in the image sequence; determining the scrolling speed of the interface according to the feature difference information.
2. The interface scroll speed determination method according to claim 1, characterized by, The feature information comprises coordinate information, the feature difference information comprises coordinate difference, and the determination of the feature difference information between the feature information of the target feature regions corresponding to each adjacent image in the image sequence comprises: calculating the coordinate difference between the target feature regions corresponding to each adjacent image in the image sequence according to the coordinate information.
3. The interface scroll speed determination method according to claim 2, wherein The determination of the scrolling speed of the interface according to the feature difference information comprises: obtaining the coordinate difference between the target feature regions corresponding to each adjacent image; determining a candidate scrolling speed between each adjacent image according to the coordinate difference; determining the scrolling speed of the interface according to the candidate scrolling speed corresponding to each adjacent image.
4. The interface scroll speed determination method of claim 1, wherein, The obtaining of the image sequence generated during interface scrolling comprises: obtaining an interface scrolling video generated during interface scrolling; performing image frame processing on the interface scrolling video to obtain an image sequence of multiple interface scrolling images.
5. The interface scroll speed determination method according to claim 4, wherein The image frame processing on the interface scrolling video to obtain an image sequence of multiple interface scrolling images comprises: obtaining a refresh frame rate of the interface; determining a frame rate according to the refresh frame rate; performing image frame processing on the interface scrolling video according to the frame rate to obtain an image sequence of multiple interface scrolling images.
6. The interface scroll speed determination method of claim 1, wherein, After the determination of the scrolling speed of the interface according to the feature difference information, comprising: generating a scrolling speed curve of the interface according to the scrolling speed; outputting the scrolling speed curve.
7. An interface scrolling speed determination apparatus characterized by comprising: comprising: a first obtaining module for obtaining an image sequence generated during interface scrolling, the image sequence comprising multiple images; a second obtaining module for obtaining image parameters of each pixel point in each image; selecting a region corresponding to a pixel point whose image parameter meets a preset condition as a target feature region; selecting a region corresponding to a pixel point whose image parameter meets a preset condition as a target feature region, comprising: If image parameters between pixel points in the image have a sudden change, and a difference of the sudden change is greater than a preset difference, then the image is divided into rows and columns according to the pixel points of the sudden change, so as to obtain images of multiple scroll items, and a scroll item with image parameters of pixel points meeting a preset condition is selected as a target feature region, which includes: identifying text content in each scroll item, and selecting a target scroll item corresponding to target text content as the target feature region; The second acquisition module is configured to acquire feature information of the target feature region in each frame of image; The first determination module is configured to determine feature difference information between the feature information of the target feature region corresponding to each adjacent frame of image in the image sequence. The second determination module is configured to determine the scroll speed of the interface according to the feature difference information.
8. A smart device, comprising: The storage medium is configured to store a computer program, and the computer program is loaded by the processor to execute the interface scroll speed determination method in any one of claims 1 to 6.
9. A storage medium, characterized by The storage medium is configured to store a computer program, and the computer program is loaded by the processor to execute the interface scroll speed determination method in any one of claims 1 to 6.
Citation Information
Patent Citations
Smoothness test method and device
CN105100785A
Page jamming determination method and device, electronic equipment and readable storage medium
CN110069194A
Method and equipment for testing fluency of animation effect
CN113419929A