Rolling screen capture method and related device

Abstract

The invention provides a rolling screen capture method and a related device. When the electronic equipment carries out scrolling screen capture, the scrolling distance of a page between two adjacent times of screen capture can be determined through the scrolling distance of a view on the page, and then the repeated area is determined. The rolling distance of the view can be determined without doubt, and is not influenced by the change of the display content of the dynamic element. According to the method, the influence of the dynamic elements on repeated region recognition can be reduced, the success rate of scrolling screenshot is improved, and the experience of using the scrolling screenshot function by a user is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a scrolling screenshot method and related devices. Background Art

[0002] Due to the limited size of the display screens of electronic devices such as mobile phones and tablet computers, electronic devices cannot display all the content on a long page at once. The electronic device can display different parts of the long page in response to an upward or downward sliding operation on the display screen. When the user wants to capture the content of the long page, the electronic device can capture the long page through the scrolling screenshot function, meeting the user's need to capture a long screenshot that exceeds the height of the screen.

[0003] During the scrolling screenshot process, the electronic device can scroll the page and take multiple screenshots to obtain multiple images. Among them, there may be repeated areas in the images obtained by two adjacent screenshots. The electronic device needs to cut out the repeated area on one of the images obtained by two adjacent screenshots, and then stitch the images together. At present, electronic devices often use image recognition algorithms to identify the above-mentioned repeated areas. However, when there are dynamic elements on the page (such as playing videos, dynamic pictures, etc.), the content displayed on the repeated areas may be different. It is difficult for the above-mentioned image recognition algorithm to accurately identify the repeated areas. This will lead to scrolling screenshot errors. It is difficult for electronic devices to accurately stitch out the long screenshots that the user wants to capture. The user experience of using the scrolling screenshot function is poor. Summary of the invention

[0004] The present application provides a scrolling screenshot method and related devices. Among them, when the electronic device is scrolling the screenshot, it can determine the scrolling distance of the page between two adjacent screenshots by the scrolling distance of the view on the page between the two adjacent screenshots, and then determine the repeated area. The electronic device can crop the repeated area on an image in the two adjacent screenshots. Afterwards, the electronic device can splice the cropped images of the repeated area to obtain a long screenshot. The scrolling distance of the above view can be determined without any doubt and will not be affected by the changes in the display content of the dynamic elements. The above method can reduce the impact of dynamic elements on the identification of repeated areas, improve the success rate of scrolling screenshots, and improve the user experience of using the scrolling screenshot function.

[0005] In the first aspect, the present application provides a scrolling screenshot method. An electronic device receives a first operation, and the first operation is used to turn on the scrolling screenshot function; in response to the first operation, the electronic device scrolls the first page, and takes screenshots multiple times in the process of scrolling the first page to obtain multiple images, the multiple images include a first image and a second image, the first image and the second image are respectively obtained by the kth screenshot and the k+1th screenshot in the multiple screenshots, k is a positive integer, and the first image and the second image both include a first area; the electronic device determines that the height of the first area is a first height according to the positions of j views on the first page at the kth screenshot and the k+1th screenshot, and j is a positive integer; the electronic device crops the first area on the first image or the second image according to the first height; the electronic device obtains a first long screenshot based on the splicing of the processed multiple images, the first long screenshot includes the first image and the second image, and there is a first area; wherein the processed multiple images include the first image with the first area cropped, or the second image with the first area cropped.

[0006] The first operation mentioned above can refer to this application Figure 3A For example, the first operation may be a user operation of drawing a target symbol (such as the letter S) on the screen using a finger joint.

[0007] The first page above can refer to this application Figure 3A The application page corresponding to the page content 313 shown in the figure. This application does not limit the application to which the first page belongs.

[0008] The first area mentioned above is the overlapping area of ​​the first image and the second image.

[0009] The first long screenshot can refer to this application Figure 4E Image 441 shown.

[0010] In some embodiments, the first image and the second image are images obtained by taking any two adjacent screenshots of the multiple images. The electronic device can perform repeated area cropping processing on all images obtained by taking any two adjacent screenshots of the multiple images according to the above processing method for the first image and the second image to obtain multiple processed images.

[0011] It can be seen from the above method that when the electronic device is scrolling screenshots, it can determine the scrolling distance of the page between two adjacent screenshots by the scrolling distance of the view on the page, and then determine the repeated area. Even if the content displayed by the same view in the repeated area of ​​two adjacent screenshot images is different, the scrolling distance of the view is determined. In other words, the scrolling distance of the view can be determined without doubt and will not be affected by the change of the display content of the dynamic element. Regardless of whether there are dynamic elements on the page, the electronic device can accurately identify the repeated area on two adjacent screenshot images based on the scrolling distance of the view. Moreover, in the case where the view on the application page changes due to application updates and other reasons, the above method for identifying repeated areas in the process of scrolling screenshots can still accurately identify repeated areas without re-adaptation. This can effectively improve the development efficiency and quality of the scrolling screenshot solution. The above method can reduce the influence of factors such as the presence of dynamic elements on the page and the update of the view on the page on the identification of repeated areas, improve the success rate of scrolling screenshots, and improve the user experience of using the scrolling screenshot function.

[0012] In some embodiments, the electronic device successively captures multiple screenshots during the process of scrolling the first page. The specific implementation method may include: the electronic device successively captures all displayed content on the screen multiple times during the process of scrolling the first page. The first image and the second image can refer to the present application Figure 4A The image shown is composed of the user interface 310. That is, the first image and the second image may include content displayed in a fixed area (such as the head fixed area and / or the bottom fixed area) and content displayed in a page scrolling area.

[0013] Alternatively, the specific method of the above-mentioned multiple screenshots may include: when the electronic device takes a screenshot for the first time during the process of scrolling the first page, all the contents displayed on the screen are captured. The electronic device identifies the page scrolling area based on the image captured for the first time. When the electronic device takes a screenshot for the first time during the process of scrolling the first page, it may only capture the contents displayed in the page scrolling area. If the first image and the second image are both images obtained by non-first screenshots, the first image and the second image can refer to the present application. Figure 4B The image shown is composed of page content 315. That is to say, the first image and the second image may only contain the content displayed in the page scrolling area on the screen.

[0014] In combination with the first aspect, in some embodiments, the electronic device determines the scrolling distance of the j views from the kth screenshot to the k+1th screenshot based on the positions of the j views at the kth screenshot and the k+1th screenshot; the electronic device determines the first scrolling distance of the first page from the kth screenshot to the k+1th screenshot based on the scrolling distance of the j views from the kth screenshot to the k+1th screenshot; the electronic device determines the first height based on the first scrolling distance, wherein the first height is the difference between the height of the first scrolling area where the first page is located and the first scrolling distance. The first scrolling area may be a scrolling area of ​​the first page on the screen.

[0015] In combination with the first aspect, in some embodiments, the electronic device determines the mode of scrolling distances of j views from the kth screenshot to the k+1th screenshot; and the electronic device determines the first scrolling distance according to the mode.

[0016] It is understandable that the size and / or layout of one or more views in an application page may change as the application page scrolls. Therefore, the scrolling distance of the view between two adjacent screenshots cannot represent the scrolling distance of the application page between the two adjacent screenshots. If the electronic device only uses the scrolling distance of one view to determine the scrolling distance of the application page, there may be errors in the scrolling distance of the application page. The mode of the scrolling distances of the above-mentioned multiple views can represent the scrolling distances of most views, and can more accurately reflect the scrolling distance of the application page. Therefore, the electronic device can determine the scrolling distances of multiple views, and determine the scrolling distance of the application page based on the mode of the scrolling distances of multiple views. This can improve the accuracy of determining the scrolling distance of the application page.

[0017] In some embodiments, the scrolling distance of the first page from the kth screenshot to the k+1th screenshot may be the product of the mode of the scrolling distances of j views from the kth screenshot to the k+1th screenshot and the screen attribute. The screen attribute may be preset and related to the resolution of the screen. For example, the screen attribute may be 160 / dpi.

[0018] It should be noted that the units of the scrolling distances of the above j views from the kth screenshot to the k+1th screenshot can all be px. The size of a view displayed on the screen must be adapted to the resolution of the screen. The larger the resolution of the screen, the more pixels the view occupies on the screen. By introducing the unit: density-independent pixel (dp), the size of the view displayed on the screen can be adapted to screens with different pixel densities (i.e., different resolutions). In order to adapt to electronic devices of various models and resolutions, before identifying the repeated areas on two adjacent screenshots, the unit of the above scrolling distance can be converted from px to dp to avoid the view scrolling distance in px being displayed at different actual heights on screens with different resolutions, affecting the accuracy of repeated area recognition. The above-mentioned use of screen attributes can improve the accuracy of determining the scrolling distance of the first page.

[0019] In conjunction with the first aspect, in some embodiments, the j views include views contained in common by the view whose position can be obtained at the kth screenshot and the view whose position can be obtained at the k+1th screenshot. The j views may include the view displayed on the screen of the electronic device at the kth screenshot.

[0020] In combination with the first aspect, in some embodiments, the multiple images also include a third image, the third image is obtained by the k+2th screenshot among the multiple screenshots, and the second image and the third image both include the second area; the electronic device determines that the height of the second area is the second height based on the positions of h views on the first page at the k+1th screenshot and the k+2th screenshot, the h views include the views commonly included by the views that can obtain the position at the k+1th screenshot and the views that can obtain the position at the k+2th screenshot, and h is a positive integer; the electronic device crops the second area on the second image or the third image according to the second height; wherein the processed multiple images include the second image with the second area cropped or the third image with the second area cropped, the first long screenshot includes the third image, and there is a second area.

[0021] It can be seen that when performing repeated area cropping processing on two different adjacent screenshots, the electronic device can use different views. It is understandable that, since the first page is scrolling, one or more views displayed on the screen by the electronic device when taking the kth screenshot may have been moved out of the screen when taking the k+2th screenshot. The electronic device may not be able to obtain the position of the one or more views when taking the k+2th screenshot. Therefore, as the first page scrolls, the electronic device can adjust the view used to determine the repeated area.

[0022] In combination with the first aspect, in some embodiments, the first page is automatically scrolled by the electronic device, or the first page is scrolled by the electronic device in response to an operation for scrolling the first page.

[0023] It can be seen that in the process of scrolling screenshots, no matter the electronic device scrolls the first page automatically or in response to the user's operation of scrolling the first page, the electronic device can accurately identify the repeated areas on two adjacent screenshot images based on the scrolling distance of the view.

[0024] In combination with the first aspect, in some embodiments, the j views are views that do not contain subviews. The positions of the j views at the kth screenshot may include the ordinates of the j views on the screen coordinate system at the kth screenshot. The positions of the j views at the k+1th screenshot may include the ordinates of the j views on the screen coordinate system at the k+1th screenshot.

[0025] The first area is located at different positions on the first image and the second image. The first image is an image obtained by the first screenshot of two adjacent screenshots. Therefore, in the case where the first area only contains the displayed content in the page scrolling area, the first area is located in the area corresponding to the first height above the bottom edge of the first image. Alternatively, in the case where the first area contains all the content displayed on the screen, the first area can be located in the image of the first image after removing the displayed content in the fixed area, and the height above the bottom edge is the area corresponding to the first height. The second image is an image obtained by the latter screenshot of two adjacent screenshots. Therefore, in the case where the second area only contains the displayed content in the page scrolling area, the second area is located in the area corresponding to the first height below the top edge of the second image. Alternatively, in the case where the second area contains all the content displayed on the screen, the second area can be located in the image of the second image after removing the displayed content in the fixed area, and the height below the top edge is the area corresponding to the first height.

[0026] In a second aspect, the present application provides an electronic device, which may include a memory and a processor. The memory may be used to store a computer program. The processor may be used to call the computer program so that the electronic device executes any possible implementation method in the first aspect.

[0027] In a third aspect, the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute any possible implementation method in the first aspect.

[0028] In a fourth aspect, the present application provides a computer program product, which may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method in the first aspect.

[0029] In a fifth aspect, the present application provides a chip, which is applied to an electronic device, and the chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any possible implementation method as in the first aspect.

[0030] It can be understood that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1A It is a schematic diagram of the relationship between some views provided in the embodiments of the present application;

[0032] Figure 1B and Figure 1C is a schematic diagram of a repeating region provided in an embodiment of the present application;

[0033] Figure 2A is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0034] Figure 2B is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application;

[0035] Figure 3A to Figure 3D is a schematic diagram of a scene of a scrolling screenshot provided in an embodiment of the present application;

[0036] Figure 4A to Figure 4E It is a schematic diagram of stitching multiple images captured during page scrolling into a long screenshot provided by an embodiment of the present application;

[0037] Figure 5 is a flow chart of a scrolling screenshot method provided in an embodiment of the present application;

[0038] Figure 6A to Figure 6C are schematic diagrams of some identification repeat regions provided in the embodiments of the present application;

[0039] Figure 7 This is a flow chart of a method for identifying repeated regions provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.

[0041] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0042] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0043] The present application provides a scrolling screenshot method. Among them, when the scrolling screenshot function is turned on, the electronic device can scroll the page and take screenshots multiple times during the scrolling process. The electronic device can also obtain the positions of multiple views on the page at each screenshot. According to the positions of multiple views at two adjacent screenshots, the electronic device can calculate the scrolling distance of the multiple views between two adjacent screenshots. The electronic device can determine the scrolling distance of the page between the two adjacent screenshots based on the mode of the scrolling distances of the multiple views. Furthermore, the electronic device can determine the repeated area based on the scrolling distance of the page between the two adjacent screenshots, and crop the repeated area on one of the images obtained from the two adjacent screenshots. Afterwards, the electronic device can splice the cropped images of the repeated area to obtain a long screenshot.

[0044] It can be seen that when taking scrolling screenshots, the electronic device can determine the scrolling distance of the page between two adjacent screenshots by the scrolling distance of the view on the page, and then determine the repeated area. The scrolling distance of the above view can be determined without any doubt and will not be affected by the change of the display content of the dynamic element. Therefore, regardless of whether there are dynamic elements on the page, the electronic device can accurately identify the repeated area on two adjacent screenshots based on the scrolling distance of the view. The above method can improve the success rate of scrolling screenshots and improve the user experience of using the scrolling screenshot function.

[0045] Some concepts involved in this application are introduced below.

[0046] 1. view.

[0047] A view can represent an interface element displayed on the display screen, such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and so on.

[0048] In some embodiments, a view may contain child views. This view may be referred to as a parent view. Exemplarily, the type of a view may be a view container class. This view may be used as a container to hold other views. For example, a status bar displayed on a screen of an electronic device may be a parent view. The status bar may contain a signal strength indicator, a battery icon, and the like. Both the signal strength indicator and the battery icon may be child views.

[0049] Figure 1A The relationship between multiple views is shown exemplarily.

[0050] like Figure 1AAs shown, view11~view17 can all be interface elements displayed on a page. Among them, view11 can be the parent view of view12 and view13. That is to say, view12 and view13 are child views of view11. View12 and view13 both contain other views. View12 contains view14. Then, view12 is the parent view of view14, and view14 is the child view of view12. View13 contains view15, view16, and view17. Then, view13 is the parent view of view15~view17, and view15~view17 are the child views of view13.

[0051] It can be seen that view14 to view17 are the bottom-level views. The bottom-level views do not contain other subviews.

[0052] In some embodiments, the electronic device can obtain the position of the bottom-level view on a page during the scrolling screenshot process. The electronic device can determine the repeated area based on the scrolling distance of the bottom-level view between two adjacent screenshots. The electronic device can traverse the views on the page to find the bottom-level view on the page. Optionally, the electronic device can also determine the repeated area based on the scrolling distance of the view containing the subview between two adjacent screenshots.

[0053] 2. Repeat area.

[0054] The repeated area may represent the same partial area included in an image captured by the electronic device before the page is scrolled and another image captured after the page is scrolled.

[0055] Figure 1B and Figure 1C A schematic diagram of the repeat region is shown exemplarily.

[0056] like Figure 1B As shown, the application page 20 may include multiple continuous page contents from top to bottom: page content 211, page content 212, and page content 213. Each page content may include one or more views. The application page 20 may be a page provided by any application. The height of the application page 20 is greater than the height of the electronic device display. Therefore, the electronic device cannot display all the page contents on the application page 20 on the display at one time. The user can view different page contents on the application page 20 by sliding up or down on the display.

[0057] like Figure 1CAs shown, the electronic device can display page content 211 on the display screen at time t1. At this time, the electronic device screenshot can obtain Figure 1C The image 221 shown includes the page content 211. The electronic device can scroll the application page 20 upwards, so that the page content displayed on the display screen changes from the page content 211 displayed on the display screen at time t1 to the page content 211 and the page content 212 displayed on the display screen at time t2.

[0058] like Figure 1C As shown, after the electronic device scrolls the application page 20, the page content 211 and the page content 212 can be displayed on the display screen at time t2. The page content displayed on the display screen of the electronic device at time t2 may include a part of the page content 211 (such as the lower part of the page content 211) and a part of the page content 212 (such as the upper part of the page content 212). At this time, the electronic device screenshot can obtain Figure 1C An image 222 including partial page content 211 and partial page content 212 is shown.

[0059] When the electronic device takes a screenshot at time t2, a portion of the page content 211 is still displayed on the display screen. This portion of the page content 211 exists in both the image 221 and the image 222. Therefore, this portion of the page content 211 (i.e. Figure 1C The partial page content 211 ) included in the image 222 shown is a repeated area of ​​the image 221 and the image 222 .

[0060] When splicing image 221 and image 222 into a long screenshot, the electronic device needs to overlap the repeated area on one of image 221 and image 222 to prevent the page content of the same area in application page 20 from appearing multiple times in the long screenshot.

[0061] The above-mentioned repeated area may also be referred to as a common area or the like.

[0062] In some embodiments, when there are dynamic elements on the application page 20, the content displayed in the repeated area on the above-mentioned image 221 may be different from the content displayed in the repeated area on the image 222. For example, the repeated area includes a video window that is playing a video. Image 221 includes the content played by the video window at time t1. Image 222 includes the content played by the video window at time t2. The content played by the video window at time t1 and time t2 is different. Therefore, the content displayed in the repeated area on the image 221 is different from the content displayed in the repeated area on the image 222.

[0063] The structure of the electronic device involved in this application is introduced below.

[0064] Please refer to Figure 2A , Figure 2A The schematic diagram of the hardware structure of the electronic device 100 is exemplarily shown.

[0065] like Figure 2A As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0066] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0067] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0068] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0069] The processor 110 may also be provided with a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0070] The USB interface 130 is an interface that complies with the USB standard specification. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device.

[0071] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 140 charges the battery 142, it can also power the electronic device through the power management module 141.

[0072] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0073] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0074] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network.

[0075] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0076] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0077] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0078] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0079] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0080] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0081] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0082] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0083] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0084] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement a data storage function.

[0085] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.

[0086] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0087] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0088] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0089] The buttons 190 include a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, messages, missed calls, notifications, etc.

[0090] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting the SIM card interface 195 or removing the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications.

[0091] The electronic device 100 may be a mobile phone, a tablet computer, a laptop computer, a smart watch, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The specific type of the electronic device 100 is not limited in the embodiment of the present application.

[0092] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.

[0093] Please refer to Figure 2B , Figure 2B The software structure block diagram of the electronic device 100 is exemplarily shown.

[0094] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Android Runtime and system library, and kernel layer.

[0095] The application layer can include a series of application packages.

[0096] like Figure 2BAs shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, scrolling screenshot application, etc. Among them, the scrolling screenshot application can be used to provide a scrolling screenshot function. The scrolling screenshot application can turn on the scrolling screenshot function in response to an operation that triggers a scrolling screenshot. The scrolling screenshot application can scroll the page and take screenshots multiple times during the scrolling process. When the page scrolls to the bottom or an operation to end the scrolling screenshot is detected, the scrolling screenshot application can end the scrolling screenshot and stitch the multiple images captured when the page is scrolled into a long screenshot. The scrolling screenshot application can also be called a long screenshot application, a sliding screenshot application, etc. The embodiments of the present application are not limited to this.

[0097] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0098] like Figure 2B As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a view position determination module, a gesture recognition module, and the like.

[0099] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0100] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0101] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0102] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0103] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0104] The notification manager enables applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0105] The view position determination module can be used to obtain the position of the view on the page. The position of the view can refer to the position of the view in the screen coordinate system. For example, the screen coordinate system can be a coordinate system with the upper left corner of the display screen of the electronic device 100 as the coordinate origin, the right as the positive direction of the x-axis, and the downward as the positive direction of the y-axis. The embodiment of the present application does not limit the method for selecting the screen coordinate system. Among them, when the view on the page is displayed on the display screen, the view position determination module can obtain the position of the view displayed on the display screen. When the page is scrolled (such as scrolling up, or scrolling down, or scrolling to the left, or scrolling to the right) so that the view on the page moves out of the display screen, the view position determination module can still obtain the position of the view that is moved out of the display screen.

[0106] In some embodiments, the view position determination module may call a function or interface provided by the operating system to obtain the position of the view on the page. For example, the function used to obtain the position of the view on the page may be getLocationOnScreen(). The embodiment of the present application does not limit the method by which the view position determination module obtains the view on the page.

[0107] In some embodiments, the view position determination module can traverse the views on the page and find the bottom-level view on the page (i.e., the view that does not contain subviews). During the scrolling screenshot process, the view position determination module can obtain the positions of multiple views on the page at each screenshot moment, for example, the vertical coordinate of the view in the screen coordinate system. The view position determination module can determine the scrolling distance of the view between two adjacent screenshots based on the position of the view, and determine the scrolling distance of the page between two adjacent screenshots based on the mode of the scrolling distances of multiple views. The view position determination module can send the scrolling distance of the above-mentioned page between two adjacent screenshots to the scrolling screenshot application. The scrolling screenshot application can determine the repeated area based on the scrolling distance of the page between two adjacent screenshots, and crop the repeated area on one of the images obtained from the two adjacent screenshots. Afterwards, the scrolling screenshot application can splice the cropped images of the repeated area to obtain a long screenshot.

[0108] The view position determination module may also be called a scroll distance determination module, etc. This embodiment of the present application does not limit this.

[0109] The gesture recognition module can be used to recognize behaviors such as gesture operations acting on the screen. Exemplarily, the gesture recognition module can recognize a gesture acting on the screen for turning on the scrolling screenshot function. The above-mentioned gesture for turning on the scrolling screenshot function may include but is not limited to: a knuckle gesture of drawing a target symbol (such as the letter S) on the screen using the knuckles, etc. When the above-mentioned gesture for turning on the scrolling screenshot function is recognized, the gesture recognition module can send a message to the scrolling screenshot application of the application layer to instruct the scrolling screenshot application to turn on the scrolling screenshot function.

[0110] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0111] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0112] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0113] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0114] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0115] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0116] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0117] A 2D graphics engine is a drawing engine for 2D drawings.

[0118] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0119] Figure 3A to Figure 3D A scrolling screenshot scenario provided by an embodiment of the present application is exemplified.

[0120] Here, the electronic device 100 takes a scrolling screenshot when displaying a page of a social application as an example for explanation. Figure 3A to Figure 3D The scene shown.

[0121] The electronic device 100 can display Figure 3A The user interface shown. Figure 3A The user interface shown may include a status bar 311 and a page of a social application, wherein the page of the social application may include an application header area 312 , page content 313 , and an application bottom area 314 .

[0122] The status bar 311 may include views such as a signal strength indicator, a Wi-Fi connection indicator, a battery level indicator, and time information.

[0123] One or more views of social application pages may be displayed in the application header area 312. The display position of the view in the application header area 312 is fixed.

[0124] One or more views of social application pages may be displayed in the application bottom area 314. The display position of the view in the application bottom area 314 is fixed.

[0125] The page content 313 may be displayed in a page scrolling area between the application header area 312 and the application bottom area 314. The page content 313 may be scrollable content in a social application page. The social application page may be a long page. The user may scroll the page content 313 up or down to view different parts of the social application page.

[0126] Page content 313 may include multiple views of the social application page. For example, page content 313 may include view313A, view313B, view313C, and view313D. Among them, view313A may be a user avatar. View313B may be a user name (such as Henry). View313C may be a picture. View313D may be a video window that is playing a video. For example, the video in view313D is currently playing to the moment corresponding to 1 minute. The above view313A, view313B, and view313C are all static elements. Static elements may represent views whose display content does not change. The above view313D may display different images in the video at different times. View313D is a dynamic element. Dynamic elements may represent views whose display content may change, and may present a dynamic effect.

[0127] It can be seen that the display positions of the status bar 311, the view in the application header area 312, and the view in the application bottom area 314 are all fixed and will not change as the social application page (ie, the page content 313) is scrolled.

[0128] In response to Figure 3A The operation of triggering scrolling screenshot is shown, the electronic device 100 can turn on the scrolling screenshot function, scroll the page and capture the page content multiple times during the scrolling process. The above-mentioned operation of triggering scrolling screenshot can be, for example, a single finger knuckle tapping the screen and keeping the knuckle on the screen, and using the knuckle to draw the symbol "S" on the screen. The embodiment of the present application does not limit the operation of triggering scrolling screenshot.

[0129] In a possible implementation, the electronic device 100 may scroll up the page content 313 to display Figure 3B The page content 315 shown. The page content 315 may also be scrollable content in the social application page. The page content 315 may include multiple views of the social application page.

[0130] like Figure 3B As shown, a partial view in the page content 315 may be Figure 3A For example, page content 315 also includes view 313D. It can be seen that the video in view 313D continues to play during the scrolling screenshot process. Figure 3B The page content 315 shown in view313D plays the video to the time corresponding to 1 minute and 1 second. That is, the electronic device 100 scrolls the social application page from Figure 3AThe state of the display page content 313 is shown as scrolling page changes to Figure 3B The state of the displayed page content 315 is shown after a period of 1 second.

[0131] Page content 315 also contains Figure 3A The page content 313 shown does not include views. For example, the page content 315 also includes view 313E. View 313E is located below view 313D on the social application page. It is understandable that when the page content 313 is scrolled up, one or more views located below the page content 313 can be scrolled out, and one or more views located in the page content 313 can be removed from the screen. For example, Figure 3A As shown, view313A and view313B are removed from the display, and view313C is partially removed from the display. Page content 315 does not include view313A and view313B, and only includes part of the content of view313C. view313E can also be a dynamic element. For example, view313E is a moving picture, which displays different images at different times.

[0132] It can be seen that there are overlapping areas between page content 313 and page content 315 .

[0133] The electronic device 100 can scroll up the page content 315 to display Figure 3C The page content 316 shown. The page content 316 may also be scrollable content in the social application page. The page content 316 may include multiple views of the social application page.

[0134] like Figure 3C As shown, a partial view in the page content 316 may be Figure 3B The partial view in the page content 315 is shown. For example, the page content 316 includes a part of view 313D and view 313E. It can be seen that the video in view 313D continues to play during the scrolling screenshot. Figure 3C The page content 316 shown in view313D plays the video to the time corresponding to 1 minute and 2 seconds. That is, the electronic device 100 scrolls the social application page from Figure 3B The state of the display page content 315 is shown as scrolling page changes to Figure 3CThe state of the page content 316 is shown after 1 second. Among them, view313D is a dynamic element. The content displayed by view313D in the page content 316 is different from the content displayed by view313D in the page content 315. Similarly, view313E is also a dynamic element. The content displayed by view313E in the page content 316 is different from the content displayed by view313E in the page content 315.

[0135] It can be seen that there are overlapping areas between page content 315 and page content 316 .

[0136] The electronic device 100 can scroll up the page content 316 to display Figure 3D The page content 317 shown. The page content 317 may also be scrollable content in the social application page. The page content 317 may include multiple views of the social application page. The page content 317 and the page content 316 have overlapping areas.

[0137] like Figure 3D As shown, in response to the operation of ending the scrolling screenshot, the electronic device 100 can stop scrolling the page and stitch multiple images captured during the scrolling process into a long screenshot. The above-mentioned operation of ending the scrolling screenshot can be, for example, an operation of clicking on the scrolling area of ​​the page, etc. The embodiment of the present application does not limit the operation of ending the scrolling screenshot.

[0138] Figure 4A to Figure 4E The schematic diagram exemplarily shows how to stitch multiple images captured during page scrolling into a long screenshot.

[0139] Here, combined with the above Figure 3A to Figure 3D The scrolling screenshot scenario shown is described by taking the electronic device 100 taking four screenshots from the start of the scrolling screenshot to the end of the scrolling screenshot as an example.

[0140] like Figure 4A As shown, when the electronic device 100 takes the first screenshot, the display screen may display a user interface 310. Therefore, the electronic device 100 can obtain an image including the user interface 310 when taking the first screenshot. The user interface 310 may be the aforementioned Figure 3A The user interface shown in FIG. 1 shows a first screenshot of the electronic device 100 when the operation for triggering scrolling screenshot is detected. That is, the first screenshot may occur before the electronic device 100 starts scrolling the page.

[0141] It can be seen that the user interface 310 may include, from top to bottom, a head fixed area, a page scrolling area, and a bottom fixed area. The display position of the view in the head fixed area and the bottom fixed area may be fixed. The page content displayed in the page scrolling area may scroll in a target direction. That is, the display position of the view in the page scrolling area may be variable.

[0142] In some embodiments, the head fixed area may include a status bar 311 and an application header area 312. The bottom fixed area may include an application bottom area 314. The status bar 311, the application header area 312, and the application bottom area 314 may refer to the introduction of the aforementioned embodiments. Optionally, the bottom fixed area may also include views such as the bottom desktop navigation bar provided by the system application. The embodiments of the present application do not limit the content contained in the head fixed area and the bottom fixed area. In some embodiments, the user interface 310 may not include a head fixed area and / or a bottom fixed area.

[0143] When taking the first screenshot, page content 313 may be displayed in the page scrolling area.

[0144] In some embodiments, the electronic device 100 can identify the above-mentioned head fixed area, page scrolling area and bottom fixed area, and divide the image obtained by the first screenshot according to the division of the above-mentioned areas. That is, the electronic device 100 can divide the image obtained by screenshotting the user interface 310 into three parts: the head fixed area (including the status bar 311 and the application head area 312), the part corresponding to the page scrolling area (including the page content 313), and the part corresponding to the bottom fixed area (including the application bottom area 314).

[0145] After the electronic device 100 takes the first screenshot, it can scroll the social application page in the page scrolling area and then take a second screenshot.

[0146] like Figure 4B As shown, when the electronic device 100 takes a second screenshot, the display screen may display the aforementioned Figure 3B The user interface shown in the figure. That is, when taking the second screenshot, the content displayed in the page scrolling area is Figure 3B The page content 315 shown. Therefore, the second screen capture of the electronic device 100 can obtain Figure 3B The image of the page content 315 is shown. In a possible implementation, the electronic device 100 can capture the second screenshot. Figure 3BThen, the electronic device 100 can separate the page content 315 in the page scrolling area from the captured image according to the division of the head fixed area, the page scrolling area and the bottom fixed area. In another possible implementation, the electronic device 100 can only capture the page content 315 in the second screenshot. Figure 3B The content in the scrolling area of ​​the page is shown to obtain an image composed of page content 315.

[0147] The electronic device 100 can identify the overlapping area of ​​the page content 313 obtained by the first screenshot and the page content 315 obtained by the second screenshot. Figure 4B The area where the page content 411 is located is the overlapping area of ​​the page content 313 and the page content 315. The method for the electronic device 100 to identify the overlapping area will be specifically introduced in the subsequent embodiments. It will not be expanded here.

[0148] like Figure 4B As shown, page content 315 may include page content 411 and page content 412. When the area where page content 411 is located is identified as a repeated area, electronic device 100 may cut page content 411 from page content 315 so as to subsequently splice page content 313 and page content 412. Optionally, since the view in page content 411 also exists in page content 313, electronic device 100 may also cut the repeated area corresponding to page content 411 on page content 313, while retaining page content 411 on page content 315.

[0149] Similarly, after the electronic device 100 takes the second screenshot, it can continue to scroll the social application page in the page scrolling area and then take the third screenshot.

[0150] like Figure 4C As shown, when the electronic device 100 takes the third screenshot, the display screen may display the aforementioned Figure 3C Therefore, the third screenshot of the electronic device 100 may include Figure 3C The image of the page content 316 is shown. The method by which the electronic device 100 can obtain the page content 316 according to the image of the third screenshot can refer to the method of obtaining the page content 315 according to the image of the second screenshot.

[0151] The electronic device 100 can identify the overlapping area of ​​the page content 315 obtained by the second screenshot and the page content 316 obtained by the third screenshot. Figure 4C The area where the page content 421 is located is the overlapping area of ​​the page content 315 and the page content 316.

[0152] It can be seen that page content 316 may include page content 421 and page content 422. When the area where page content 421 is located is identified as a repeated area, electronic device 100 may cut page content 421 from page content 316 so that page content 422 can be used for splicing later to avoid the view in page content 421 from appearing repeatedly in the long screenshot. Optionally, electronic device 100 may also cut the repeated area corresponding to page content 421 on page content 315, while retaining page content 421 on page content 316.

[0153] like Figure 4D As shown, when the electronic device 100 takes the fourth screenshot, the display screen may display the aforementioned Figure 3D Therefore, the fourth screenshot of the electronic device 100 may include Figure 3D The image of the page content 317 is shown. The fourth screenshot may be the last screenshot. The electronic device 100 may take the fourth screenshot when the scrolling screenshot ends. It is understandable that the screenshots are not limited to four times, and the electronic device 100 may take more or fewer screenshots during the scrolling screenshot process.

[0154] The electronic device 100 can identify the repeated area of ​​the page content 317 obtained by the fourth screenshot and the page content 316 obtained by the third screenshot. Figure 4D The area where the page content 431 is shown is the overlapping area of ​​the page content 316 and the page content 317 .

[0155] It can be seen that page content 317 may include page content 431 and page content 432. When the area where page content 431 is located is identified as a repeated area, electronic device 100 may cut page content 431 from page content 317 so that page content 432 can be used for splicing later to avoid the view in page content 431 from appearing repeatedly in the long screenshot. Optionally, electronic device 100 may also cut the repeated area corresponding to page content 431 on page content 316, while retaining page content 431 on page content 317.

[0156] When the repeated areas of two adjacent screenshot images in all the screenshot images obtained by scrolling screenshots are cropped, the electronic device 100 can use the cropped images for splicing.

[0157] like Figure 4E As shown, the electronic device 100 can be spliced ​​in order from top to bottom: the head fixed area, the page content 313 of the first screenshot, the page content 412 of the second screenshot, the page content 422 of the third screenshot, the page content 432 of the fourth screenshot and the bottom fixed area, to obtain Figure 4E The image 441 shown. The image 441 is the aforementioned Figure 3A to Figure 3D The long screenshot obtained in the scrolling screenshot scenario shown.

[0158] Figure 5 The following is a flowchart of a scrolling screenshot method provided in an embodiment of the present application.

[0159] like Figure 5 As shown, the method may include steps S511 to S514. Among them:

[0160] S511. Enable the scrolling screenshot function.

[0161] S512: Scroll the page, and capture the content displayed on the screen during the scrolling process.

[0162] The electronic device 100 can turn on the scrolling screenshot function in response to the operation of triggering the scrolling screenshot. After the electronic device 100 turns on the scrolling screenshot function, the page can be automatically scrolled. The electronic device 100 can perform the first screenshot operation before starting to scroll the page to obtain the initial display content of the page during the scrolling screenshot process. The electronic device 100 can scroll the page up, down, left, or right. The embodiment of the present application does not limit the scrolling direction of the page. Among them, the electronic device 100 can scroll the page at a uniform speed, and perform a screenshot operation every preset time to capture the content displayed on the screen. The electronic device 100 can capture the content displayed on the screen, which can be all the content displayed on the screen, or it can be a partial content displayed on the screen. Optionally, the electronic device 100 can also scroll the page at a non-uniform speed. The embodiment of the present application does not limit the speed at which the electronic device 100 scrolls the page. In addition, the electronic device 100 can also perform a screenshot operation at irregular intervals during the scrolling of the page.

[0163] In some embodiments, after the electronic device 100 turns on the scrolling screenshot function, it can also scroll the page in response to the user's operation of scrolling the page. In other words, during the scrolling screenshot process, the user can manually scroll the page. The electronic device 100 can capture the content displayed on the screen multiple times during the user's manual scrolling of the page.

[0164] S513: Detecting a condition for ending the scrolling screenshot, and ending the scrolling screenshot.

[0165] The condition for the electronic device 100 to detect the end of the scrolling screenshot may include: the electronic device 100 detects a user operation to end the scrolling screenshot, or the electronic device 100 detects that the page has scrolled to the bottom. The embodiment of the present application does not limit the above-mentioned conditions for ending the scrolling screenshot. When the electronic device 100 ends the scrolling screenshot, it can stop scrolling the page and perform the last screenshot operation.

[0166] S514, performing repeated area cropping processing on the captured multiple images, and then splicing them into a long screenshot, wherein the repeated area cropping processing includes: identifying repeated areas in two adjacent screenshot images, and cropping the repeated area on one of the two adjacent screenshot images.

[0167] The process of cutting out the repeated area and stitching the image by the electronic device 100 can refer to the aforementioned Figure 4A to Figure 4E The process shown.

[0168] In some embodiments, step S514 and step S512 may be performed synchronously. For example, after each screenshot, the electronic device 100 may identify the repeated area between the image of the screenshot and the image of the previous screenshot, and crop the repeated area on one of the images. In this way, when the electronic device 100 detects the condition for ending the scrolling screenshot, the electronic device 100 can quickly splice a long screenshot, reducing the waiting time of the user.

[0169] It can be seen from the above-mentioned scrolling screenshot scenario and method that the electronic device 100 will take multiple screenshots in the process of scrolling the page. There are usually repeated areas in the images obtained from two adjacent screenshots. If the electronic device 100 cannot accurately identify the repeated area, the same view may appear repeatedly in the long screenshot spliced ​​by the electronic device. Alternatively, if the electronic device 100 cannot accurately identify the repeated area, the electronic device 100 may fail to scroll the screenshot and fail to obtain a long screenshot. For example, in order to avoid the situation where the same view appears repeatedly in a long screenshot, the electronic device 100 can directly discard the image of the latter screenshot of the two adjacent screenshots when it is identified that there is no repeated area or the repeated area is small in the images of the two adjacent screenshots. Therefore, the electronic device 100 needs to accurately identify the repeated area to improve the success rate of scrolling screenshots.

[0170] The following describes the method for identifying repeated regions provided by the present application.

[0171] Figure 6A to Figure 6C Shown are schematic diagrams showing some exemplary methods of identifying repetitive regions.

[0172] Here, the kth screenshot and the k+1th screenshot of the electronic device 100 during the scrolling screenshot process are used as examples for description. k is a positive integer. The kth screenshot and the k+1th screenshot can be any two adjacent screenshots of the electronic device 100 during the scrolling screenshot process.

[0173] like Fig. 6AAs shown, when the electronic device 100 takes a screenshot for the kth time, the content displayed on the display screen includes a fixed head area, a fixed bottom area, view1, view2, view3, and view4. Among them, view1, view2, view3, and view4 are located in the page scrolling area on the display screen, and can move out of the page scrolling area or move into the page scrolling area as the application page scrolls. In some embodiments, view1, view2, view3, and view4 can be the bottom-level views on the application page. These bottom-level views do not contain other sub-views. The electronic device 100 can traverse the views on the application page to find the above-mentioned bottom-level views, and then obtain the positions of these bottom-level views at the time of the kth screenshot.

[0174] The electronic device 100 can obtain the view in Fig. 6A The vertical coordinate on the screen coordinate system shown. The screen coordinate system can be a coordinate system with the upper left corner of the display screen of the electronic device 100 as the coordinate origin, the right as the positive direction of the x-axis, and the downward as the positive direction of the y-axis. The units of the x-axis and the y-axis in the screen coordinate system can both be pixels (px).

[0175] Exemplarily, the electronic device 100 can obtain the vertical coordinates of view1, view2, view3, and view4 in the screen coordinate system at the kth screenshot: view1-y1, view2-y1, view3-y1, and view4-y1. A view usually has a certain height. The vertical coordinate of a view in the screen coordinate system can be the vertical coordinate of the top edge in the screen coordinate system, or the vertical coordinate of the bottom edge in the screen coordinate system, or the vertical coordinate of a point between the top edge and the bottom edge in the screen coordinate system.

[0176] like Figure 6B As shown, between the kth screenshot and the k+1th screenshot, the application page can scroll in the page scrolling area, for example, scroll upward. Among them, the head fixed area and the bottom fixed area can always be fixedly displayed on the display screen and do not scroll with the scrolling of the application page. At the k+1th screenshot, view1, view2 and view3 move out of the page scrolling area as the application page scrolls. View4 partially moves out of the page scrolling area as the application page scrolls. The view located below view4 (such as view5, view6) moves into the page scrolling area as the page scrolls. The electronic device 100 can obtain the positions of multiple views displayed at the kth screenshot at the k+1th screenshot.

[0177] Exemplarily, the electronic device 100 may obtain that the vertical coordinates of view1, view2, view3, and view4 on the screen coordinate system at the time of the (k+1)th screenshot are: view1-y2, view2-y2, view3-y2, and view4-y2, respectively.

[0178] In some embodiments, the electronic device 100 can obtain the vertical coordinates of multiple views when taking a screenshot for the kth time. The electronic device 100 can obtain the vertical coordinates of multiple views when taking a screenshot for the k+1th time. The electronic device 100 can find out the views that are included in both the multiple views that can obtain the vertical coordinates when taking the screenshot for the kth time and the multiple views that can obtain the vertical coordinates when taking the screenshot for the k+1th time, and then use the views that are included in both the multiple views that can obtain the vertical coordinates when taking the screenshot for the two adjacent times to determine the height of the repeated area. For example, the views that are included in both the multiple views that can obtain the vertical coordinates when taking the screenshot for the kth time and the multiple views that can obtain the vertical coordinates when taking the screenshot for the k+1th time can be: view1~view4.

[0179] According to the vertical coordinates of view1, view2, view3, and view4 on the screen at the kth screenshot and the k+1th screenshot, the electronic device 100 can determine the scrolling distances of view1, view2, view3, and view4 from the kth screenshot to the k+1th screenshot. Among them, the scrolling distance view1-dy1 of view1 is view1-y1 minus view1-y2. The scrolling distance view2-dy1 of view2 is view2-y1 minus view2-y2. The scrolling distance view3-dy1 of view3 is view3-y1 minus view3-y2. The scrolling distance view4-dy1 of view4 is view4-y1 minus view4-y2.

[0180] In some embodiments, the electronic device 100 can determine the scrolling distance of the application page from the kth screenshot to the k+1th screenshot based on the majority of view1-dy1, view2-dy1, view3-dy1, and view4-dy1. It can be understood that the size and / or layout of one or more views in the application page may change as the application page scrolls. Then, the scrolling distance of the view between two adjacent screenshots cannot represent the scrolling distance of the application page between these two adjacent screenshots. If the electronic device 100 only uses the scrolling distance of one view to determine the scrolling distance of the application page, the scrolling distance of the application page may have errors. The mode of the scrolling distances of the above-mentioned multiple views can represent the scrolling distances of most views, which can more accurately reflect the scrolling distance of the application page. Therefore, the electronic device 100 can determine the scrolling distances of multiple views, and determine the scrolling distance of the application page based on the mode of the scrolling distances of multiple views. This can improve the accuracy of determining the scrolling distance of the application page.

[0181] Exemplarily, the values ​​of view1-dy1, view2-dy1, and view3-dy1 are the same. The value of view4-dy1 is different from the values ​​of view1-dy1, view2-dy1, and view3-dy1. The electronic device 100 can determine the scrolling distance of the application page from the kth screenshot to the k+1th screenshot based on view1-dy1, view2-dy1, and view3-dy1.

[0182] In some embodiments, the electronic device 100 may also determine the scrolling distance of the application page from the kth screenshot to the (k+1)th screenshot according to the scrolling distance of a view (such as a view among view1 to view4).

[0183] Among them, the units of view1-dy1, view2-dy1, view3-dy1, and view4-dy1 can all be px. The size of a view displayed on the screen must be adapted to the resolution of the screen. The larger the screen resolution, the more pixels the view occupies on the screen. By introducing the unit: density-independent pixel (dp), the size of the view displayed on the screen can be adapted to screens with different pixel densities (i.e., different resolutions). When two screens have the same size but different resolutions, the screen with a higher resolution contains more pixels per foot (dpi). That is, the pixel density of the screen with a higher resolution is higher. dp and px can have the following relationship: px=dp*(dpi / 160). For example, a view with a size of 50*50dp can occupy 50*50px pixels when displayed on a 160dpi screen, and can occupy 100*100px pixels when displayed on a 320dpi screen. It can be seen that by using dp to set the view size, the size of each view on the page can be adaptively changed on screens with different resolutions, and the layout and proportion of each view on screens with different resolutions will not be out of balance.

[0184] Therefore, in order to adapt to electronic devices of various models and resolutions, before identifying the repeated areas on two adjacent screenshots, the unit of the above scrolling distance can be converted from px to dp to avoid the situation where the actual height of the view scrolling distance in px displayed on screens with different resolutions affects the accuracy of repeated area recognition.

[0185] The electronic device 100 can determine the page scrolling distance page-dy1 of the application page from the kth screenshot to the k+1th screenshot according to the following formula: page-dy1=mode-dy1*screen attribute. The above mode-dy1 can represent the mode of the above view1-dy1, view2-dy1, view3-dy1, and view4-dy1. The screen attribute can be preset and related to the resolution of the screen. For example, the screen attribute can be 160 / dpi.

[0186] like Figure 6C As shown, the electronic device 100 can identify the page scrolling area on the screen and determine the height of the page scrolling area. The unit of the page scrolling area height can be dp. The electronic device 100 can determine the height of the repeated area according to the following formula: Repeated area height = page scrolling area height - page scrolling distance. The page scrolling distance is page-dy1.

[0187] It can be understood that in the image obtained by the k+1th screenshot, the repeated area is located at the top of the page scrolling area. The repeated area can be an area whose height corresponds to the height of the repeated area from the top edge of the page scrolling area to the bottom edge of the page scrolling area. In the image obtained by the kth screenshot, the repeated area is located at the bottom of the page scrolling area. The repeated area can be an area whose height corresponds to the height of the repeated area from the bottom edge of the page scrolling area to the top edge of the page scrolling area. The electronic device 100 can crop the repeated area in the image obtained by the kth screenshot, or can crop the repeated area in the image obtained by the k+1th screenshot, so that the repeated area appears only once in the long screenshot.

[0188] In addition, when the screen is taken for the k+1th time, the electronic device 100 can obtain the vertical coordinates of other views displayed on the screen at the time of the k+1th screen capture in addition to obtaining the vertical coordinates of the above view1 to view4 at the time of the k+1th screen capture. For example, the electronic device 100 can also obtain the vertical coordinates of view5 and view6 at the time of the k+1th screen capture. The vertical coordinates of view5 and view6 at the time of the k+1th screen capture can be view5-y1 and view6-y1, respectively.

[0189] After the k+1th screenshot, the electronic device 100 may continue to scroll the application page and take the k+2th screenshot. Among them, one or more views displayed on the screen during the k+1th screenshot may have been removed from the screen during the k+2th screenshot. The electronic device 100 may obtain the vertical coordinates of the multiple views displayed on the screen during the k+1th screenshot at the k+2th screenshot. For example, these multiple views may include view4, view5, and view6. These multiple views may be the bottom-level views of the views displayed on the screen during the k+1th screenshot. Then, the electronic device 100 can identify the overlapping area between the image obtained by the k+1th screenshot and the image obtained by the k+2th screenshot. For details, please refer to the above Figure 6A to Figure 6C The process of identifying the overlapping area between the image obtained by the k-th screenshot and the image obtained by the k+1-th screenshot is shown.

[0190] It can be seen that when the electronic device 100 is scrolling screenshots, it can determine the scrolling distance of the page between two adjacent screenshots by the scrolling distance of the view on the page, and then determine the repeated area. Even if the content displayed by the same view in the repeated area of ​​two adjacent screenshot images is different, the scrolling distance of the view is determined. In other words, the scrolling distance of the view can be determined without doubt and will not be affected by the change of the display content of the dynamic element. Regardless of whether there are dynamic elements on the page, the electronic device 100 can accurately identify the repeated area on the two adjacent screenshot images based on the scrolling distance of the view. In addition, in the case where the view on the application page changes due to application updates and other reasons, the above method for identifying repeated areas in the process of scrolling screenshots can still accurately identify repeated areas without re-adaptation. This can effectively improve the development efficiency and quality of the scrolling screenshot solution. The above method can reduce the influence of factors such as the presence of dynamic elements on the page and the update of the view on the page on the identification of repeated areas, improve the success rate of scrolling screenshots, and improve the user experience of using the scrolling screenshot function.

[0191] Figure 7 A flowchart of a method for identifying a repeated region is shown as an example.

[0192] like Figure 7 As shown, the method includes steps S711 to S715. Among them:

[0193] S711 . Obtain the vertical coordinates of m1 views displayed on the screen during the k-th screenshot. The image of the page scrolling area obtained during the k-th screenshot is the k-th image.

[0194] In some embodiments, the m1 views may be the bottom-most views among the views displayed on the screen when the electronic device 100 takes the kth screenshot. The present application embodiment does not limit the value of m1. The electronic device 100 may traverse the views displayed on the screen when the electronic device 100 takes the kth screenshot to identify the bottom-most view. Then, the electronic device 100 may obtain the vertical coordinate of the bottom-most view on the screen coordinate system when the screenshot is taken for the kth time. For example, the m1 views may include the above Fig. 6A The view1 to view4 are shown. m1 is an integer greater than 1.

[0195] The electronic device 100 can obtain the kth image by taking the kth screenshot. The kth image can represent the image corresponding to the page content displayed in the page scrolling area when taking the kth screenshot. For example, the kth image can refer to the image obtained by the aforementioned Figure 4A The image of the page content 313 shown, or can refer to the aforementioned Figure 4BThe page content 315 shown in the figure may be referred to as the image composed of the aforementioned Figure 4C The image of the page content 316 shown, or can refer to the aforementioned Figure 4D An image of the page content 317 shown.

[0196] In some embodiments, the electronic device 100 can capture all contents displayed on the current screen when taking a screenshot for the kth time, for example, including the contents displayed in the head fixed area, the page scrolling area, and the bottom fixed area. Then, the electronic device 100 can distinguish between the head fixed area, the page scrolling area, and the bottom fixed area, and capture the image of the page scrolling area from the image containing all the contents displayed on the screen obtained from the kth screenshot to obtain the above-mentioned kth image. In some embodiments, the electronic device 100 has already distinguished between the head fixed area, the page scrolling area, and the bottom fixed area on the screen. When taking a screenshot for the kth time, the electronic device 100 can directly capture only the contents displayed in the page scrolling area on the current screen to obtain the above-mentioned kth image.

[0197] S712 , obtaining the vertical coordinate of the m1 view at the time of the k+1th screenshot, and the image of the page scrolling area obtained by the k+1th screenshot is the k+1th image.

[0198] After taking the kth screenshot, the electronic device 100 may continue to scroll the page and take the k+1th screenshot. The electronic device 100 may obtain the vertical coordinates of the m1 views on the screen coordinate system at the time of the k+1th screenshot.

[0199] The method for the electronic device 100 to obtain the k+1th image by taking the k+1th screenshot may refer to the method for the electronic device 100 to obtain the kth image in step S711 above.

[0200] It should be noted that when the electronic device 100 takes a screenshot for the kth time, it can obtain the vertical coordinate of the w1 view on the page at the time of the kth screenshot. The w1 view may include the m1 view mentioned above. The w1 view may also include the view that has just scrolled out of the display screen at the time of the kth screenshot. It can be understood that when a view has just scrolled out of the display screen, the electronic device 100 can still obtain the vertical coordinate of this view. When the electronic device 100 takes a screenshot for the k+1th time, it can obtain the vertical coordinate of the w2 view on the page at the time of the k+1th screenshot. The w2 view may also include the m1 view mentioned above. In addition, the views included in the w2 view may also be those not included in the w1 view. When it is necessary to identify the repeated areas of the kth image and the k+1th image, the electronic device 100 can filter out the views included in both the w1 view and the w2 view (such as the m1 view mentioned above). The electronic device 100 may identify the repeated area according to the scrolling distance of the views included in both the w1 views and the w2 views from the kth screenshot to the k+1th screenshot.

[0201] That is, when identifying repeated areas in images obtained from two adjacent screenshots, the electronic device 100 may use the same batch of views whose position information can be obtained during the two adjacent screenshots.

[0202] S713 . Determine the scrolling distance of the m1 views from the kth screenshot to the k+1th screenshot, and determine the scrolling distance of the page according to the mode of the scrolling distances of the m1 views.

[0203] In some embodiments, the scrolling distance of the page from the kth screenshot to the k+1th screenshot may be the product of the mode of the scrolling distances of m1 views and the screen attribute. The method for the electronic device 100 to determine the scrolling distance of the page according to the mode of the scrolling distances of m1 views may refer to the aforementioned method for determining the scrolling distance of the page according to the mode of the scrolling distances of m1 views. Figure 6C Introduction.

[0204] S714: Determine the height of the repeated area between the kth image and the k+1th image according to the height of the page scrolling area and the page scrolling distance.

[0205] The height of the repeated area between the kth image and the k+1th image may be the height of the page scrolling area minus the page scrolling distance.

[0206] S715 . Crop the repeated area on the k+1th image according to the repeated area height.

[0207] Among them, in the images obtained by two adjacent screenshots, the bottom part of the image obtained by the previous screenshot usually repeats the top part of the image obtained by the next screenshot. The k+1th image is the image obtained by the next screenshot of the two adjacent screenshots (i.e., the kth screenshot and the k+1th screenshot). The repeated area on the k+1th image can be an area corresponding to the height of the repeated area below the top edge of the k+1th image. The electronic device 100 can crop the repeated area on the k+1th image that repeats with the kth image, so that the k+1th image after the repeated area is cropped can be subsequently spliced ​​after the kth image.

[0208] Alternatively, the electronic device 100 may also crop the repeated area on the kth image that is repeated with the k+1th image, so that the kth image after the cropping of the repeated area can be subsequently spliced ​​before the k+1th image. The kth image is an image obtained from the first screenshot of two adjacent screenshots (i.e., the kth screenshot and the k+1th screenshot). The repeated area on the kth image may be an area whose height above the bottom edge of the kth image corresponds to the height of the repeated area.

[0209] The electronic device 100 may be configured according to the above Figure 7 The method shown in the figure performs repeated region recognition and cropping on any two adjacent images of the multiple images captured during scrolling screenshots. Afterwards, the electronic device 100 can splice the images that have undergone the repeated region recognition and cropping processing from top to bottom in the order of the screenshot time to obtain a long screenshot. For details, please refer to the above Figure 4E Introduction.

[0210] By the above Figure 7 It can be seen from the method shown that the electronic device 100 can determine the scrolling distance of the page between two adjacent screenshots by the scrolling distance of the view on the page when scrolling screenshots, and then determine the repeated area. Even if the content displayed by the same view in the repeated area of ​​two adjacent screenshot images is different, the scrolling distance of the view is determined. In other words, the scrolling distance of the view can be determined without doubt and will not be affected by the change of the display content of the dynamic element. Regardless of whether there are dynamic elements on the page, the electronic device 100 can accurately identify the repeated area on the two adjacent screenshot images based on the scrolling distance of the view. In addition, in the case where the view on the application page changes due to application updates and other reasons, the above method for identifying repeated areas in the process of scrolling screenshots can still accurately identify repeated areas without re-adaptation. This can effectively improve the development efficiency and quality of the scrolling screenshot solution. The above method can reduce the influence of factors such as the presence of dynamic elements on the page and the update of the view on the page on the identification of repeated areas, improve the success rate of scrolling screenshots, and improve the user experience of using the scrolling screenshot function.

[0211] It is understandable that the various user interfaces described in the embodiments of the present application are only example interfaces and do not limit the present application scheme. In other embodiments, the user interface may adopt a different interface layout, may include more or fewer controls, and may increase or decrease other functional options, as long as they are based on the same inventive concept provided by the present application, they are all within the scope of protection of the present application.

[0212] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.

[0213] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A scrolling screenshot method, characterized in that: The method comprises: The electronic device receives a first operation, where the first operation is used to enable a scrolling screenshot function; In response to the first operation, the electronic device scrolls a first page, and takes multiple screenshots in the process of scrolling the first page to obtain multiple images, the multiple images including a first image and a second image, the first image and the second image are respectively obtained by taking the kth screenshot and the k+1th screenshot in the multiple screenshots, k is a positive integer, and the first image and the second image both include the first area; The electronic device determines, according to positions of j views on the first page at the time of the k-th screenshot and the k+1-th screenshot, that the height of the first area is a first height, where j is a positive integer; The electronic device crops the first area on the first image or the second image according to the first height; The electronic device obtains a first long screenshot by stitching the processed multiple images, wherein the first long screenshot includes the first image and the second image, and there is one first area; The processed multiple images include the first image with the first area cropped, or the second image with the first area cropped.

2. The method according to claim 1, characterized in that The electronic device determines, according to the positions of j views on the first page at the time of the kth screenshot and the k+1th screenshot, that the height of the first area is the first height, specifically including: The electronic device determines the scrolling distance of the j views from the kth screenshot to the k+1th screenshot according to the positions of the j views at the kth screenshot and the k+1th screenshot; The electronic device determines a first scrolling distance of the first page from the kth screenshot to the k+1th screenshot according to the scrolling distance of the j views from the kth screenshot to the k+1th screenshot; The electronic device determines the first height according to the first scrolling distance, wherein the first height is a difference between a height of a first scrolling area where the first page is located and the first scrolling distance.

3. The method according to claim 2, characterized in that The electronic device determines, according to the scrolling distances of the j views from the kth screenshot to the k+1th screenshot, a first scrolling distance of the first page from the kth screenshot to the k+1th screenshot, specifically comprising: The electronic device determines the mode of the scrolling distances of the j views from the kth screenshot to the k+1th screenshot; The electronic device determines the first scroll distance according to the mode.

4. The method according to any one of claims 1 to 3, characterized in that The j views include views commonly contained in the view whose position can be obtained when the k-th screenshot is taken and the view whose position can be obtained when the k+1-th screenshot is taken.

5. The method according to any one of claims 1 to 4, characterized in that The multiple images further include a third image, where the third image is obtained by taking the k+2th screenshot among the multiple screenshots, and both the second image and the third image include a second area; the method further includes: The electronic device determines that the height of the second area is a second height according to the positions of h views on the first page at the time of the k+1th screenshot and the k+2th screenshot, the h views include views commonly included by the views whose positions can be obtained at the time of the k+1th screenshot and the views whose positions can be obtained at the time of the k+2th screenshot, and h is a positive integer; The electronic device crops the second image or the second area on the third image according to the second height; The processed multiple images include the second image with the second area cropped or the third image with the second area cropped, the first long screenshot includes the third image, and there is one second area.

6. The method according to any one of claims 1 to 5, characterized in that The first page is automatically scrolled by the electronic device, or the first page is scrolled by the electronic device in response to an operation for scrolling the first page.

7. The method according to any one of claims 1 to 6, characterized in that The j views are views that do not contain sub-views.

8. An electronic device, characterized in that: The electronic device comprises a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to call the computer program so that the electronic device executes the method according to any one of claims 1 to 7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 7.

Images