Screenshot method and electronic equipment

Abstract

The embodiment of the invention provides a screenshot method and electronic equipment, and the method comprises the steps: in the process that a user executes a first operation on a first user interface, the electronic equipment displays dynamically changing contents in the first user interface, and obtains the first operation information of the first operation; then the electronic equipment determines a first frequency according to the first operation information; and finally, the electronic equipment performs screenshot on the first user interface according to the first frequency. Therefore, the electronic equipment can adjust the screenshot frequency in real time according to the real-time operation information of the operation executed by the user, so that the screenshot frequency of the electronic equipment can be flexibly adjusted to meet screenshot requirements under various conditions, finally, the power consumption of the electronic equipment can be saved, and the use experience of the user is ensured.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on August 29, 2023, with application number 202311115013.9 and application name “A Screenshot Method and Electronic Device”, the entire contents of which are incorporated by reference in this application. Technical Field

[0003] The present application relates to the technical field of electronic equipment, and in particular to a screenshot method and electronic equipment. Background Art

[0004] With the development of software and hardware technologies of electronic equipment, many types of electronic equipment currently support users to operate on touch screens and display dynamic content corresponding to the operations in real time.

[0005] In order to improve the user's operating experience on the electronic device, some optimization measures can also be designed inside the electronic device. These optimization measures generally require obtaining the real-time content drawn by the user on the electronic device display screen. Therefore, designing a solution for obtaining the real-time content drawn by the user is a problem that needs to be solved in this field. Summary of the invention

[0006] The present application provides a screenshot method and an electronic device for taking screenshots of content displayed on a display screen of an electronic device by a user, so as to improve the user experience.

[0007] In a first aspect, an embodiment of the present application provides a screenshot method, which is applied to an electronic device. The following is an example of an electronic device executing the method, and the method includes:

[0008] During the process of a user performing a first operation on a first user interface, the electronic device displays dynamically changing content in the first user interface and obtains first operation information of the first operation; the electronic device determines a first frequency based on the first operation information; and the electronic device takes a screenshot of the first user interface based on the first frequency.

[0009] Through this method, the electronic device can adjust the screenshot frequency in real time according to the real-time operation information of the user's operation, so that the screenshot frequency of the electronic device can be flexibly adjusted to meet the screenshot needs of various situations, and ultimately save the power consumption of the electronic device and ensure the user experience.

[0010] In a possible design, the electronic device stores a correspondence between the operation information and the screenshot frequency value. The electronic device can determine the first frequency corresponding to the first operation information according to the first operation information and the correspondence.

[0011] In one possible design, before obtaining the first operation information of the first operation, the electronic device may also take a screenshot of the first user interface according to the second frequency; based on this, when determining the first frequency, the electronic device may determine the first frequency according to the first operation information and the second frequency.

[0012] Through this design, the electronic device can adjust the original screenshot frequency (second frequency) according to the first operation information to obtain a new screenshot frequency (first frequency).

[0013] In a possible design, the first operation information is used to indicate pressure-sensing data of at least one first screen reporting point in the first operation; the electronic device may determine the first frequency according to the first operation information and the second frequency through the following steps:

[0014] When the pressure-sensitivity change between the pressure-sensitivity data of the first target screen point and the pressure-sensitivity data of the second target screen point is greater than or equal to a first pressure-sensitivity threshold, determining that the first frequency is greater than the second frequency; or

[0015] When the pressure change is less than a second pressure threshold, it is determined that the first frequency is less than the second frequency; and the second pressure threshold is less than or equal to the first pressure threshold; or

[0016] In a case where the second pressure sensitivity threshold is less than the first pressure sensitivity threshold, when the pressure sensitivity change is less than the first pressure sensitivity threshold and greater than or equal to the second pressure sensitivity threshold, determining that the first frequency is equal to the second frequency;

[0017] The first target screen reporting point is the latest screen reporting point among the at least one first screen reporting point, and the second target screen reporting point is the screen reporting point before the first target screen reporting point among the at least one first screen reporting point.

[0018] Through this design, the electronic device can increase the screenshot frequency when the pressure change of the first operation is large, thereby increasing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reducing the delay in executing the subsequent optimization measures to improve the sensitivity of the optimization measures, and ultimately improving the user's experience of using the optimization measures. In the case where the pressure change of the first operation is not large, the screenshot frequency is reduced, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increasing the delay in executing subsequent optimization measures, and ultimately saving the power consumption of the electronic device. In addition, the electronic device may not adjust the screenshot frequency when the change of the first operation is within the range of the first pressure threshold and the second pressure threshold, so as to ensure that the effect of the electronic device executing the subsequent optimization measures is the same as before. In short, this design can improve the flexibility of electronic device screenshots, ensure user experience and avoid waste of power consumption of electronic devices.

[0019] In a possible design, the first operation information is used to indicate a position of at least one first screen reporting point in the first operation; the electronic device may determine the first frequency according to the first operation information and the second frequency through the following steps:

[0020] When at least one of the first conditions is met, it is determined that the first frequency is greater than the second frequency; the first condition includes: the distance between the position of the third target screen reporting point and the set area in the first user interface is less than or equal to a first distance threshold; the user is identified to perform a second operation on the first user interface based on the position of the at least one first screen reporting point; the first operation speed of the first operation determined based on the position of the at least one first screen reporting point is greater than or equal to a first speed threshold; wherein the third target screen reporting point is the latest screen reporting point among the at least one first screen reporting point; the second operation is different from the first operation.

[0021] Through this design, the electronic device can increase the screenshot frequency when the first operation is close to the set area of ​​the first user interface, when it recognizes that the user is performing a second operation during the execution of the first operation, or when the operation speed of the first operation is faster. This can increase the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reduce the delay in executing the subsequent optimization measures to increase the sensitivity of the optimization measures, ultimately improving the user experience of the optimization measures.

[0022] In a possible design, the electronic device may determine the first frequency according to the first operation information and the second frequency through the following steps:

[0023] When at least one of the second conditions is met, it is determined that the first frequency is less than the second frequency; the second condition includes: the distance between the position of the third target screen reporting point and the set area is greater than the second distance threshold; the second distance threshold is greater than or equal to the first distance threshold; the second operation is not recognized based on the position information of the at least one first screen reporting point; the first operation speed is less than the second speed threshold; the second speed threshold is less than or equal to the first speed threshold.

[0024] Through this design, the electronic device can reduce the screenshot frequency when the first operation does not approach the set area of ​​the first user interface, when the electronic device does not recognize the second operation during the first operation, or when the operation speed of the first operation is slow, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increasing the delay in executing subsequent optimization measures, ultimately saving power consumption of the electronic device.

[0025] In a possible design, the electronic device may determine the first frequency according to the first operation information and the second frequency through the following steps:

[0026] When at least one of the third conditions is met, it is determined that the first frequency is equal to the second frequency; the third condition includes: when the second distance threshold is greater than the first distance threshold, the distance between the position of the third target screen point and the set area is greater than the first distance threshold and less than or equal to the second distance threshold; the second operation is not recognized according to the position information of the at least one first screen point; when the second speed threshold is less than the first speed threshold, the first operation speed is greater than or equal to the second speed threshold and less than the first speed threshold.

[0027] Through this design, the electronic device can also not adjust the screenshot frequency when the distance between the first operation and the set area in the first user interface is within the range of the first distance threshold and the second distance threshold, when the electronic device does not recognize the second operation during the first operation, or when the operation speed of the first operation is within the range of the first speed threshold and the second speed threshold, to ensure that the effect of the subsequent optimization measures executed by the electronic device is the same as before. This method can further improve the flexibility of electronic device screenshots, ensure the user experience of the electronic device, and avoid waste of power consumption of the electronic device.

[0028] In a possible design, after the electronic device takes a screenshot of the first user interface according to the second frequency, the electronic device may also obtain second operation information of the first operation; the second operation information is used to indicate the position of at least one second screen reporting point in the first operation; when the distance between the position of the fourth target screen reporting point and the set area is equal to 0 (including the position of the fourth target screen reporting point being within the set area or on the boundary of the set area), stop taking a screenshot of the first user interface; or when the second operation speed of the first operation determined according to the position of the at least one second screen reporting point is less than or equal to a third speed threshold, stop taking a screenshot of the first user interface; wherein the third speed threshold is less than the second speed threshold; the first operation speed in the second condition is less than the second speed threshold, including: the first operation speed is greater than the third speed threshold and less than the second speed threshold; wherein the fourth target screen reporting point is the latest screen reporting point among the at least one second screen reporting point.

[0029] Through this design, the electronic device can stop taking screenshots of the first user interface when the first operation enters the set area or the first operation is a refined operation (no need to perform subsequent optimization measures), thereby causing the electronic device to stop performing subsequent optimization measures, thereby further saving the power consumption of the electronic device and avoiding waste of power consumption.

[0030] In a possible design, when the first frequency is different from the second frequency, a change between the first frequency and the second frequency is a set value.

[0031] Through this design, the electronic device can adjust the screenshot frequency according to the set adjustment step (set value).

[0032] In a possible design, the electronic device takes a screenshot of the first user interface according to the second frequency at the start time of the first operation; wherein the second frequency is a default frequency.

[0033] Through this design, the electronic device can take a screenshot using a default frequency at the start time of the first operation.

[0034] In one possible design, the first operation is a drawing operation; based on this, when the user performs the first operation on the first user interface, the electronic device can display the actual drawing trajectory corresponding to the first operation in the first user interface; when the electronic device takes a screenshot of the first user interface according to the first frequency, at least one first screenshot image is obtained, and third operation information of the first operation is obtained; image recognition is performed on the drawing trajectory in the at least one first screenshot image to determine the first brush mode parameters; based on the first brush mode parameters and the third operation information, a predicted drawing trajectory is determined; and the predicted drawing trajectory is displayed in the first user interface.

[0035] Through this design, the electronic device can take a screenshot of the first user interface in the drawing scene by adjusting the screenshot frequency in real time, thereby realizing global local drawing.

[0036] In a possible design, the first brush mode parameter includes at least one of the following: brush type, line color, line width, and line texture.

[0037] In a possible design, the drawing operation is a touch operation of the user on the first user interface on the display screen using a finger or a touch-assistive tool, wherein the touch-assistive tool includes any one of the following: a stylus, a touch pen, a touch ball, and a mouse.

[0038] In a second aspect, an embodiment of the present application provides an electronic device, including a unit for executing each step in the method provided in the first aspect above. For example, the electronic device may include a display unit and a processing unit, wherein the display unit is used to display a user interface, and the processing unit is used to implement the method provided in the first aspect.

[0039] In a third aspect, an embodiment of the present application provides an electronic device, comprising a display screen, at least one processor and a memory; the at least one processor is coupled to the memory, and the at least one processor is used to read a computer program stored in the memory to execute the method provided in the first aspect.

[0040] In a fourth aspect, an embodiment of the present application provides a chip, which is used to read a computer program stored in a memory and execute the method provided in the first aspect above. Optionally, the chip may include a processor, which is coupled to the memory and is used to read the computer program stored in the memory to implement the method provided in the above embodiment. Optionally, the chip may also include components such as a memory, a communication interface, and a power supply module. The memory is used to store computer programs, the communication interface is used to receive and send data; and the power supply unit is used to power the processor.

[0041] In a fifth aspect, an embodiment of the present application further provides a chip system, which includes a processor for supporting a computer device to implement the method provided in any of the above aspects. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0042] In a sixth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. When the computer program runs on an electronic device, the computer executes the method provided in the first aspect above.

[0043] In a seventh aspect, an embodiment of the present application provides a computer program product, which includes a computer program; when the computer program is run on a computer, the computer executes the method provided in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A schematic diagram of global local rendering provided in an embodiment of the present application;

[0045] Figure 2 A structural diagram of an electronic device provided in an embodiment of the present application;

[0046] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0047] Figure 4 A flowchart of a screenshot method provided in an embodiment of the present application;

[0048] Figure 5A A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0049] Figure 5B A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0050] Fig. 6A A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0051] Figure 6B A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0052] Fig. 7A A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0053] Figure 7B A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0054] Figure 7C A schematic diagram of a rule for adjusting the screenshot frequency provided in an embodiment of the present application;

[0055] Figure 8 A schematic diagram of an application scenario provided for an embodiment of the present application;

[0056] Fig. 9 A software architecture diagram of an electronic device provided in an embodiment of the present application;

[0057] Fig.10 A software architecture diagram of another electronic device provided in an embodiment of the present application;

[0058] Fig.11 A schematic diagram of a screenshot example provided in an embodiment of the present application;

[0059] Fig.12 Another example of a screenshot provided in the present application;

[0060] Fig.13 Another example of a screenshot provided in the present application;

[0061] Fig.14 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] The present application provides a screenshot method and an electronic device for taking screenshots of content drawn by a user on a display screen of an electronic device to improve user experience. The method and the electronic device are based on the same technical concept. Since the method and the electronic device solve problems in a similar manner, the implementation of the electronic device and the method can refer to each other, and the repetitive parts will not be repeated.

[0063] Some terms in this application are explained below to facilitate understanding by those skilled in the art.

[0064] 1) Electronic equipment refers to equipment or devices with data connectivity, data calculation and processing functions. Generally, electronic equipment has a display screen.

[0065] For example, the electronic device in this application can be a tablet computer, a personal computer (PC), a laptop, a computer, a netbook, a car computer, a smart phone, a smart wearable device (such as a smart watch, a smart bracelet, smart glasses, etc.), etc. Of course, the electronic device can also be various portable devices, car terminal devices, personal digital assistants (PDA), smart home devices (such as smart TVs, etc.) and other smart devices. This application does not limit the specific form of the electronic device.

[0066] The electronic device can realize its functions through the operating system installed and provide services to the user. For example, the electronic device can be equipped with, but not limited to, Or other operating systems.

[0067] 2) Applications are used to be installed in electronic devices and can provide services to users after running. Applications can also be called application software or applications (APP). In the subsequent description, application and application are equivalent and can be replaced with each other.

[0068] The application program may be developed by the manufacturer of the electronic device, or by the supplier of the operating system of the electronic device, or by a third-party application manufacturer, and this application does not limit this.

[0069] For example, the application programs may include: various drawing applications, calling applications, camera applications, text messaging applications, chat applications, video applications, music applications, electronic map applications, social applications, etc.

[0070] 3) The screen reporting point is the touch point where the user performs a touch operation on the display screen of the electronic device.

[0071] The screen report point is obtained by the sensor of the electronic device through continuous collection of operation data during the touch operation and related processing of the electronic device. Based on this, each screen report point can have corresponding operation data, such as the pressure data of the screen report point, the position of the screen report point, the temperature of the screen report point, etc. Optionally, since the size of the user interface and the display screen may be the same or different, the position of the screen report point can be the position (coordinates) of the screen report point on the display screen, or it can be the position of the screen report point in the user interface currently displayed on the display screen (or the position relative to the application), and this application does not limit this.

[0072] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0073] In the embodiments of the present application, descriptions such as "when...", "in the case of...", "if" and "if" all mean that the electronic device will make corresponding processing under certain objective circumstances. It does not limit the time, nor does it require the electronic device to make a judgment when implementing it, nor does it mean that there are other limitations.

[0074] It should be noted that in this application, "used for indication" can include being used for direct indication and being used for indirect indication. When describing that a certain information is used to indicate A, it can include that the information directly indicates A or indirectly indicates A, but it does not mean that the information must carry A. Taking the first information used to indicate the first content as an example, the first information can include the first content, and can also include a part of the first content or an identifier or index of the first content, and can also include an algorithm for determining the first content, a calculation parameter, etc. This application does not limit the method of "indication".

[0075] In the present application, "including / comprising A" may be equivalent to "including / comprising A information". A information is used to indicate A.

[0076] In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0077] In order to improve the user's touch experience on electronic devices, some optimization measures can also be designed inside the electronic devices. These optimization measures generally require obtaining the real-time content drawn by the user on the display screen of the electronic device. For example, in order to improve the hand tracking of the user using a stylus on a tablet, it is necessary to obtain the real-time displayed content drawn by the user on the tablet display screen and perform some processing. For another example, when the user opens a game application, the real-time display position of the skill button on the display screen can be obtained, so as to quickly analyze the user's operation and improve the user experience.

[0078] Typically, the method for obtaining the content displayed in real time on the display screen of an electronic device is to take a screenshot, and then perform image recognition on the screenshot image to identify the elements in the screenshot image, and then perform subsequent processing on these elements. Electronic devices usually take screenshots of the user interface on the display screen at a fixed frequency. This screenshot method is less flexible and may affect the user experience and cause waste of power consumption of the electronic device.

[0079] The following is an example of a global local drawing service that improves the hand-hand compatibility of a stylus pen in an electronic device.

[0080] The global local drawing service is that the electronic device imitates and predicts the actual drawing trajectory drawn by the user on the electronic device display screen through the drawing operation, thereby obtaining a predicted drawing trajectory, and displays the predicted drawing trajectory on the electronic device display screen.

[0081] See also Figure 1 As shown, in order to implement the global local drawing service, the electronic device can create a transparent layer (which can be referred to as the global local drawing layer) above the layers corresponding to all applications, which is specifically used to display the predicted drawing trajectory of the stylus. During the process of the user performing a drawing operation on the drawing interface displayed on the display screen (displayed on the application layer corresponding to the application with drawing function), the electronic device can imitate and predict the user's actual drawing trajectory (including line distribution, brush mode, etc.) to obtain a predicted drawing trajectory. Among them, the user can obtain the brush mode parameters of the actual brush set by the user by taking a screenshot of the drawing interface and performing image recognition on the screenshot image, and through learning and imitation, the brush mode parameters of the global drawing brush corresponding to the global local drawing service are set to be consistent with the brush mode parameters of the actual brush, thereby improving the similarity between the predicted drawing trajectory and the actual drawing trajectory.

[0082] In the process of implementing the global local drawing service, if the electronic device takes screenshots of the drawing interface at a fixed frequency, the following problems may occur, which may eventually affect the user experience or cause power consumption waste of the electronic device.

[0083] 1. Because the line width (thickness) of the actual drawing trajectory is strongly related to the pressure sensitivity of the drawing operation, if the pressure sensitivity of the drawing operation changes, if the screenshot frequency of the electronic device does not change accordingly, it is easy for the predicted drawing trajectory to be inconsistent with the line width of the actual drawing trajectory of the user in the drawing interface, and the predicted drawing trajectory cannot quickly adapt to the changing pressure sensitivity.

[0084] 2. If the user's drawing operation reaches certain non-drawing areas of the drawing interface, it is easy for the predicted drawing trajectory to exceed the drawing area.

[0085] 3. In some scenarios, taking screenshots at a fixed frequency may cause power consumption waste or misprocessing.

[0086] For example, when the user's drawing operation is far away from the non-drawing area of ​​the drawing interface (for example, the border of the drawing interface, the menu bar, the title bar and other functional areas), taking screenshots with a fixed screenshot frequency may cause power consumption waste.

[0087] For another example, if the user does not perform other non-drawing operations such as switching brushes during the drawing operation, and a fixed screenshot frequency is used, the electronic device will perform image recognition based on the screenshot image obtained from the current screenshot, which will also cause power consumption waste. When the user performs non-drawing operations such as switching brushes, taking screenshots with a fixed screenshot frequency may also result in some misprocessing, for example, the predicted drawing trajectory and the actual drawing trajectory brush are inconsistent.

[0088] 4. When the user is drawing finely (i.e., the drawing operation is slow), the actual drawing trajectory is drawn slowly, and the chirality fully meets the requirements, so there is no need to predict the trajectory. However, when the user's drawing operation is fast, the electronic device takes screenshots at a fixed frequency, which may cause the predicted drawing trajectory to fail to reach the latest position of the user's drawing operation, affecting the chirality of the electronic device.

[0089] Based on this, the present application provides a screenshot method. The method includes: in the process of a user performing a first operation on a first user interface, the electronic device displays dynamically changing content in the first user interface and obtains first operation information of the first operation; then the electronic device determines a first frequency according to the first operation information; finally, the electronic device takes a screenshot of the first user interface according to the first frequency. In this way, the electronic device can adjust the screenshot frequency in real time according to the real-time operation information of the user's operation, so that the screenshot frequency of the electronic device can be flexibly adjusted to meet the screenshot requirements of various situations, which can ultimately save the power consumption of the electronic device and ensure the user experience.

[0090] The solution provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0091] The present application embodiment provides an electronic device, as shown below Figure 2 , the structure of the electronic device provided in the embodiments of the present application is introduced.

[0092] like Figure 2As shown, the electronic device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc.

[0093] The processor 210 may include one or more processing units, for example: the processor 210 may include a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 200. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0094] A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. By providing the memory, the number of times the processor 210 accesses data to the internal memory 221 may be reduced, the waiting time of the processor 210 may be reduced, and thus the efficiency of the system may be improved.

[0095] The screenshot method provided in the embodiment of the present application can be controlled by the processor 210 or other components can be called to complete, such as controlling the display screen 294 to display the user interface and obtaining the operation information collected by the sensor module 280. The processor 210 can include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU can cooperate to execute the screenshot method provided in the embodiment of the present application. For example, part of the algorithm in the screenshot method is executed by the CPU, and another part of the algorithm for the user interface display is executed by the GPU to obtain faster processing efficiency.

[0096] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. The display screen 294 can be used to display information input by a user or information provided to a user and various graphical user interfaces (GUIs). For example, the display screen 294 can display windows, photos, videos, web pages, or files, etc. In addition, it can be understood that in some embodiments, the status bar may also include a Bluetooth icon, a Wi-Fi icon, an external device icon, etc. In some embodiments, when the processor 210 detects a touch operation of a user's finger (or a stylus, a handwriting pen, etc.), in response to the touch operation, corresponding processing is performed, such as displaying dynamically changing content in a user interface displayed on the display screen 294. In some embodiments, when the processor 210 detects a click operation of an external input device (such as a mouse, a keyboard, etc.) of the electronic device 200 on an application icon, in response to the click operation, a corresponding control operation is performed on the application.

[0097] In the embodiment of the present application, the display screen 294 can be an integrated flexible display screen, or a spliced ​​display screen composed of two or more rigid screens and a flexible screen located between two adjacent rigid screens. After the processor 210 runs the method provided in the embodiment of the present application, the processor 210 can control the display screen 294 to display the user interface of the application.

[0098] In some embodiments, part or all of the display area of ​​the display screen 294 can be used to display a user interface. For example, the electronic device 200 can have multiple display modes, and each display mode has a corresponding display area. The shape or size of the display area corresponding to different display modes may be different. It should be noted that the display areas corresponding to different display modes may overlap.

[0099] Of course, the electronic device 200 may also have only one display mode. In this case, the electronic device 200 may display the user interface through the entire area of ​​the display screen 294 , or may display the user interface through a partial area of ​​the display screen 294 .

[0100] The camera 293 is used to capture still images or videos. Optionally, the electronic device 200 may include 1 to N cameras 293. For example, the camera 293 may include a front camera or a rear camera, or a camera 293 may be used as both a front camera and a rear camera. Typically, the camera 293 may include a photosensitive element such as a lens group and an image sensor. Among them, the lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed, and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal.

[0101] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. The program storage area may store an operating system, a program code of at least one application, etc. The operating system may include, but is not limited to, The data storage area can store data created during the use of the electronic device 200 .

[0102] The internal memory 221 may also store one or more computer programs for executing the method provided in the embodiments of the present application. The one or more computer programs are stored in the internal memory 221 and configured to be executed by one or more processors 210, and the one or more computer programs include instructions, which may be used to execute the various steps in the following embodiments.

[0103] In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0104] The sensor module 280 may include a fingerprint sensor, a touch sensor, a pressure sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like.

[0105] Touch sensor, also known as "touch panel". The touch sensor can be set on the display screen 294. The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 294. In other embodiments, the touch sensor can also be set on the surface of the electronic device 200, which is different from the position of the display screen 294.

[0106] The wireless communication function of the electronic device 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor.

[0107] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0108] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.

[0109] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 270A, a receiver 270B, etc.), or displays an image or video through a display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 250 or other functional modules.

[0110] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 200. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0111] In addition, the electronic device 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D, and the application processor. For example, music playback, recording, etc. The electronic device 200 can receive the key 290 input and generate key signal input related to the user settings and function control of the electronic device 200. The electronic device 200 can generate a vibration prompt using the motor 291. The indicator 292 in the electronic device 200 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 in the electronic device 200 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 295, or pulled out from the SIM card interface 295, to achieve contact and separation with the electronic device 200.

[0112] It should be understood that in practical applications, Figure 2 The electronic device 200 shown is only an example and does not constitute a limitation of the electronic device. In addition, the electronic device 200 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0113] The software system of the electronic device 200 provided in the embodiment of the present application can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the layered architecture as an example to illustrate the software structure of the electronic device. Figure 3 shown.

[0114] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. Figure 3 As shown, the software architecture can be divided into four layers, from top to bottom, namely, application layer, application framework layer (framework, FWK), Android runtime (Android runtime) and system library, and kernel layer. In addition, the electronic device may also include a hardware layer.

[0115] The application layer is the top layer of the operating system, including native applications of the operating system, as well as third-party applications such as camera, gallery, calendar, Bluetooth, music, video, information, etc.

[0116] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions. The application framework layer may include a window manager, an activity manager, an input composition manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, etc.

[0117] The window manager is used to provide window management services (WMS). The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc. The window manager can provide multiple management functions to control parameters such as the transparency, position, and size of the window or interface on the display screen.

[0118] The activity manager is used to provide activity management service (AMS), which is responsible for starting, switching, and scheduling various components in the system and managing and scheduling applications.

[0119] The input synthesis manager is used to provide input synthesis services (InputFlinger) for collecting, processing and distributing user operation information. For example, the input synthesis manager can receive the operation information reported by the sensor through the sensor driver, convert it into an input event, and distribute the input event to other modules for processing according to the event type of the input event. For example, when the user performs a drawing operation, the input synthesis manager generates an input event after receiving the operation information of the drawing operation, and distributes the input event to the window manager; the window manager then distributes it to the activity manager; the activity manager can respond to the input event and display the drawing track in the corresponding window.

[0120] In an embodiment of the present application, the application framework layer may further include a screenshot manager. The screenshot manager may be located in a module in the framework layer that provides certain services. Optionally, when a user performs a touch operation on the user interface of an electronic device, the screenshot manager may obtain operation information corresponding to the touch operation in real time through an input synthesis manager, or obtain operation information corresponding to the touch operation from a sensor driver; and determine the screenshot frequency based on the operation information and set rules. Afterwards, the screenshot manager may take a screenshot of the user interface currently displayed by the electronic device according to the screenshot frequency determined in real time, and obtain at least one screenshot image. The screenshot manager may also perform subsequent optimization processing based on at least one screenshot image obtained by the screenshot to improve the user experience.

[0121] Content providers are used to store and retrieve data and make these data accessible to applications. The data may include files (such as documents, videos, images, audio), text and other information.

[0122] The view system includes visual controls, such as controls for displaying text, images, documents, etc. The view system can be used to build applications. The interface in the display window can be composed of one or more controls. For example, a display interface showing a file icon can include controls for displaying text and controls for displaying images.

[0123] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.

[0124] Optionally, in the Android system, the software structure of the electronic device also includes an Android runtime. The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system. The core library of the Android system consists of two parts: one part is the function function that the Java language needs to call, and the other part is the core library of the Android system. The application layer and the application framework layer run in the virtual machine. Taking Java as an example, the virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0125] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0126] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack and driver model, which are all implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer has many drivers related to electronic devices, the main drivers are: display driver; keyboard driver as input device; Flash driver based on memory technology device; sensor driver; camera driver; audio driver; Bluetooth driver; WiFi driver, etc.

[0127] In an embodiment of the present application, when a user performs a touch operation on the user interface, the sensor driver can obtain the user's operation information based on the user's touch operation detected by a sensor (such as a touch sensor and / or a pressure sensor) set on the display screen, and provide it to the input synthesis manager and the screenshot manager.

[0128] For example, in some embodiments of the present application, the touch operation received by the electronic device may include but is not limited to a user's click (such as single click, double click, etc.) operation / long press operation / slide operation / drag operation / floating gesture operation on the display screen through a finger or a touch auxiliary tool such as a stylus, a touch pen, or a touch ball, etc. The present application does not make specific limitations on this.

[0129] The hardware layer can include various sensors, display screens, cameras, etc.

[0130] It should be noted that Figure 3 It is only an example of a software structure diagram of an electronic device, in which only the levels and software modules related to the present application are simply listed. In practical applications, the operating system of the electronic device may also include other levels and each level may also include other software modules for implementing one or more functions or services. To this end, the embodiments of the present application do not make specific limitations. In addition, the embodiments of the present application do not limit the specific levels where each software module is located, for example, the screenshot manager may also be located in the system library or other levels.

[0131] The present application embodiment provides a screenshot method, which can be applied to Figure 2 The electronic device shown. The software structure of the electronic device can be found in Figure 3 See below. Figure 4 The flowchart shown specifically illustrates the method provided in the embodiment of the present application.

[0132] S401: When a user performs a first operation on a first user interface, the electronic device displays dynamically changing content in the first user interface and obtains first operation information of the first operation.

[0133] In the embodiment of the present application, the first operation is a touch operation that can cause the content displayed on the first user interface to change dynamically. In different application scenarios, the first operation is implemented in different ways.

[0134] For example, in a drawing scene where the electronic device starts a drawing function, the first operation may be a drawing operation. The drawing operation may be a touch operation (such as a click operation, a slide operation, a drag operation, etc.) performed by the user on the first user interface in the display screen through a finger or a touch auxiliary tool (such as a stylus, a touch pen, a touch ball, or a mouse). At this time, the first user interface is a drawing interface. When the user performs a drawing operation, the electronic device will display the actual drawing track corresponding to the drawing operation in the first user interface.

[0135] For another example, in a game scene where an electronic device starts a game application, the first operation may be a game operation. For a description of the game operation, reference may be made to the above-mentioned drawing operation. At this time, the first user interface is a game scene interface. While the user is performing the game operation, the electronic device will display the content corresponding to the game operation (e.g., the game protagonist moves, switches the game scene, etc.) in the first user interface.

[0136] S402: The electronic device determines a first frequency according to first operation information.

[0137] In the embodiment of the present application, the first operation information may be, but is not limited to, operation data indicating at least one first screen reporting point in the first operation. The at least one first screen reporting point is obtained during step S401, and the operation data of the at least one first screen reporting point may be, but is not limited to, at least one of the following: pressure sensing data of at least one first screen reporting point, the position of at least one first screen reporting point, etc.

[0138] Optionally, in the embodiment of the present application, the electronic device may perform S402 in the following two implementations, but is not limited to:

[0139] A first implementation mode: the electronic device stores a correspondence between the operation information and the screenshot frequency value. The electronic device can determine the first frequency corresponding to the first operation information according to the first operation information and the correspondence.

[0140] For example, the electronic device can determine the first frequency based on the pressure sensing data of the first target screen point in the at least one first screen point, and the corresponding relationship between the pressure sensing data and the screenshot frequency value. The first target screen point is the latest (i.e., the last generated) screen point in the at least one first screen point.

[0141] For another example, the electronic device may determine the first frequency based on the average pressure sensitivity value of the pressure sensitivity data of the at least one first screen reporting point and the correspondence between the pressure sensitivity data and the screenshot frequency value.

[0142] Second implementation mode: the electronic device can adjust the original screenshot frequency according to the first operation information to obtain a new screenshot frequency. The first frequency is the new screenshot frequency. The following description is made by taking the original screenshot frequency as the second frequency as an example.

[0143] Optionally, the second frequency may be obtained based on the previous screenshot frequency adjustment, or may be a set frequency (the default screenshot frequency of the application or electronic device, or the screenshot frequency set by the user, etc.). At the start time of the first operation, the electronic device may take a screenshot of the first user interface at the default frequency. For example, when the electronic device takes a screenshot of the first user interface at the start time of the first operation according to the second frequency, the second frequency is the default frequency.

[0144] In this embodiment, before acquiring the first operation information, the electronic device may also use the second frequency to take a screenshot of the first user interface. Based on this, when executing S402, the electronic device may determine the first frequency according to the first operation information and the second frequency.

[0145] The following describes several implementation methods according to the specific content indicated by the first operation information and different adjustment rules.

[0146] Implementation method 1: The first operation information indicates pressure-sensing data of at least one first screen reporting point in the first operation.

[0147] In the first implementation, the first target screen reporting point is the latest screen reporting point among at least one first screen reporting point, and the second target screen reporting point is the screen reporting point before the first target screen reporting point among at least one first screen reporting point. Optionally, the second target screen reporting point and the first target screen reporting point can be two adjacent or non-adjacent screen reporting points, which is not limited in the present application.

[0148] Mode 1-1: the first frequency is different from the second frequency, that is, the new screenshot frequency determined by the electronic device each time is different from the original screenshot frequency, and the electronic device increases or decreases the frequency based on the original screenshot frequency to obtain a new screenshot frequency.

[0149] In this method 1-1, refer to Figure 5A The electronic device determines the first frequency by any of the following steps:

[0150] When the pressure-sensitivity change amount between the pressure-sensitivity data of the first target screen reporting point and the pressure-sensitivity data of the second target screen reporting point is greater than or equal to the first pressure-sensitivity threshold, determining that the first frequency is greater than the second frequency;

[0151] When the pressure sensitivity change is less than the first pressure sensitivity threshold, it is determined that the first frequency is less than the second frequency.

[0152] Through method 1-1, the electronic device can increase the screenshot frequency when the pressure change of the first operation is large, thereby increasing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reducing the delay in executing the subsequent optimization measures to improve the sensitivity of the optimization measures, and ultimately improving the user's experience of using the optimization measures. When the pressure change of the first operation is not large, the screenshot frequency is reduced, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increasing the delay in executing subsequent optimization measures, and ultimately saving the power consumption of the electronic device. In short, this method can improve the flexibility of electronic device screenshots, ensure user experience, and avoid waste of power consumption of electronic devices.

[0153] Mode 1-2: The relationship between the first frequency and the second frequency is not limited. The first frequency and the second frequency can be different or the same, that is, the electronic device can increase or decrease the frequency based on the original screenshot frequency to obtain a new screenshot frequency; or the original screenshot frequency can be kept unchanged.

[0154] In this method 1-2, refer to Figure 5B , the electronic device may determine the first frequency by any of the following steps:

[0155] When the pressure-sensitivity change amount between the pressure-sensitivity data of the first target screen reporting point and the pressure-sensitivity data of the second target screen reporting point is greater than or equal to the first pressure-sensitivity threshold, determining that the first frequency is greater than the second frequency;

[0156] When the pressure change is less than the second pressure threshold, it is determined that the first frequency is less than the second frequency; wherein the second pressure threshold is less than the first pressure threshold;

[0157] When the pressure sensitivity change is less than the first pressure sensitivity threshold and greater than or equal to the second pressure sensitivity threshold, it is determined that the first frequency is equal to the second frequency.

[0158] Compared with the above-mentioned method 1-1, through this method 1-2, the electronic device can also not adjust the screenshot frequency when the change amount of the first operation is within the range of the first pressure threshold and the second pressure threshold, so as to ensure that the effect of the subsequent optimization measures executed by the electronic device is the same as before. This method can further improve the flexibility of electronic device screenshots, ensure the user experience of the electronic device, and avoid waste of power consumption of the electronic device.

[0159] Implementation method 2: The first operation information is used to indicate the position of at least one first screen reporting point in the first operation.

[0160] In the second implementation, the third target screen point is the latest screen point among the at least one first screen point.

[0161] It should be noted that in the case where the first operation information indicates the position of at least one first screen reporting point in the first operation, the electronic device can determine multiple pieces of information based on the first operation information, such as: the distance between the first operation and a set area (a specific area) in the first user interface, whether other operations other than the first operation are performed (hereinafter referred to as the second operation), and the current operation speed of the first operation (i.e., referred to as the first operation speed), etc. In this way, the electronic device can further determine the first frequency based on the above information.

[0162] Optionally, the setting area does not achieve the operation purpose of the user performing the first operation. For example, the setting area may be a boundary of the user interface, or include specific elements (menu bar, title bar, etc.).

[0163] Optionally, when the electronic device determines the distance between the position of the third target screen reporting point and the set area in the first user interface (i.e., the distance between the first operation and the set area in the first user interface) based on the first operation information, the electronic device can determine the first frequency through the following method 2-1 or method 2-2.

[0164] Mode 2-1: The first frequency is different from the second frequency, that is, the new screenshot frequency determined by the electronic device each time is different from the original screenshot frequency, and the electronic device increases or decreases the frequency based on the original screenshot frequency to obtain a new screenshot frequency.

[0165] In this method 2-1, refer to Fig. 6A The electronic device determines the first frequency by any of the following steps:

[0166] When the distance between the position of the third target screen reporting point and the set area in the first user interface is less than or equal to the first distance threshold, determining that the first frequency is greater than the second frequency;

[0167] When the distance between the position of the third target screen reporting point and the set area in the first user interface is greater than a first distance threshold, it is determined that the first frequency is less than the second frequency.

[0168] Through method 2-1, the electronic device can increase the screenshot frequency when the first operation is close to the set area of ​​the first user interface, thereby increasing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reducing the delay in executing the subsequent optimization measures to improve the sensitivity of the optimization measures, and ultimately improving the user's experience of using the optimization measures. In the case where the first operation is not close to the set area of ​​the first user interface, the screenshot frequency is reduced, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increasing the delay in executing subsequent optimization measures, and ultimately saving the power consumption of the electronic device. In short, this method can improve the flexibility of electronic device screenshots, ensure user experience, and avoid waste of power consumption of electronic devices.

[0169] Mode 2-2: The relationship between the first frequency and the second frequency is not limited. The first frequency and the second frequency can be different or the same, that is, the electronic device can increase or decrease the frequency based on the original screenshot frequency to obtain a new screenshot frequency; or the original screenshot frequency can be kept unchanged.

[0170] In this method 2-2, refer to Figure 6B The electronic device determines the first frequency by any of the following steps:

[0171] When the distance between the position of the third target screen reporting point and the set area in the first user interface is less than or equal to the first distance threshold, determining that the first frequency is greater than the second frequency;

[0172] When the distance between the position of the third target screen reporting point and the set area in the first user interface is greater than a second distance threshold, determining that the first frequency is less than the second frequency;

[0173] When the distance between the position of the third target screen reporting point and the set area in the first user interface is greater than the first distance threshold and less than or equal to the second distance threshold, it is determined that the first frequency is equal to the second frequency.

[0174] Compared with the above-mentioned method 2-1, through this method 2-2, the electronic device can also not adjust the screenshot frequency when the distance between the first operation and the set area in the first user interface is within the first distance threshold and the second distance threshold, so as to ensure that the effect of the subsequent optimization measures executed by the electronic device is the same as before. This method can further improve the flexibility of electronic device screenshots, ensure the user experience of the electronic device, and avoid waste of power consumption of the electronic device.

[0175] It should be noted that in the above-mentioned method 2-1 or 2-2, various distance thresholds can be preset or determined according to the current operation speed of the first operation. For example, assuming that the first operation reaches the set area 0.1ms before, and the screenshot frequency of the electronic device needs to be increased, the first distance threshold is the product of the current operation speed of the first operation and 0.1ms.

[0176] Optionally, when the electronic device can identify whether the user performs the second operation on the first user interface based on the position of at least one first screen reporting point in the first operation information, the electronic device can determine the first frequency through the following method 2-3.

[0177] Exemplarily, the electronic device can identify whether the user performs the second operation by determining whether there is a screen point located within the area that triggers the second operation among the positions of the at least one first screen point; or identify whether the user performs the second operation by determining whether the position relationship of different screen points when the second operation (such as right-click, single-click, combo click, etc.) is performed based on the position relationship of the at least one screen point; or identify whether the user performs the second operation based on whether the position change between adjacent screen points in the at least one screen point exceeds a set threshold.

[0178] Method 2-3: The electronic device may determine the first frequency by any of the following steps:

[0179] When the electronic device recognizes that the user performs a second operation on the first user interface according to the position of at least one first screen reporting point, determining that the first frequency is greater than the second frequency;

[0180] When the electronic device does not recognize that the user performs a second operation on the first user interface based on the position of at least one first screen reporting point, it is determined that the first frequency is less than or equal to the second frequency.

[0181] When the electronic device does not recognize the second operation, the electronic device may directly determine that the first frequency is equal to the second frequency, or determine that the first frequency is less than the second frequency; or the electronic device may further determine the value of the first frequency in combination with other conditions.

[0182] Optionally, the second operation may be some setting, control, management or other operations, which may cause changes in the content displayed in the first user interface. Therefore, when the electronic device recognizes that the user performs the second operation while performing the first operation, the screenshot frequency should be increased.

[0183] Through the method 2-3, the electronic device can increase the screenshot frequency when it recognizes that the user is performing the second operation during the execution of the first operation, thereby increasing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reducing the delay in executing the subsequent optimization measures to improve the sensitivity of the optimization measures, and ultimately improving the user's experience of using the optimization measures. In the case that the electronic device does not recognize the second operation during the first operation, the screenshot frequency is reduced, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increasing the delay in executing subsequent optimization measures, and ultimately saving the power consumption of the electronic device; or the electronic device maintains the screenshot frequency unchanged to ensure that the effect of the electronic device executing subsequent optimization measures is the same as before. In short, this method can improve the flexibility of electronic device screenshots, ensure user experience, and avoid waste of power consumption of electronic devices.

[0184] Optionally, when the electronic device determines the first operation speed (current operation speed) of the first operation based on the position of the at least one first screen reporting point, the electronic device may determine the first frequency by the following method 2-4 or method 2-5.

[0185] Exemplarily, the electronic device can determine the first operation speed based on the change amount / change rate between the position of the third target screen point and the position of the previous screen point, wherein the previous screen point is a screen point before the third target screen point in at least one first screen point (for example, the first generated screen point, or a screen point adjacent to the third target screen point).

[0186] Mode 2-4: the first frequency is different from the second frequency, that is, the new screenshot frequency determined by the electronic device each time is different from the original screenshot frequency, and the electronic device increases or decreases the frequency based on the original screenshot frequency to obtain a new screenshot frequency.

[0187] In this method 2-4, refer to Fig. 7A The electronic device determines the first frequency by any of the following steps:

[0188] When a first operation speed of the first operation is greater than or equal to a first speed threshold, determining that the first frequency is greater than the second frequency;

[0189] When a first operation speed of the first operation is less than a first speed threshold, it is determined that the first frequency is less than the second frequency.

[0190] When the user performs the first operation at a fast speed, due to the large span of the operation position, it is easy to make misoperations or incorrectly execute optimization measures. Through this method 2-4, the electronic device can increase the screenshot frequency when the operation speed of the first operation is fast, thereby increasing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or reducing the delay in executing the subsequent optimization measures to improve the sensitivity of the optimization measures, and ultimately improving the user's experience of using the optimization measures. When the operation speed of the first operation is slow, reduce the screenshot frequency, thereby reducing the number of times the electronic device executes subsequent optimization measures or the number of screenshot images processed, or increase the delay in executing subsequent optimization measures, and ultimately save the power consumption of the electronic device. In short, this method can improve the flexibility of electronic device screenshots, ensure user experience, and avoid waste of power consumption of electronic devices.

[0191] In mode 2-5, the relationship between the first frequency and the second frequency is not limited. The first frequency and the second frequency can be different or the same, that is, the electronic device can increase or decrease the frequency based on the original screenshot frequency to obtain a new screenshot frequency; or the original screenshot frequency can be kept unchanged.

[0192] In this method 2-5, refer to Figure 7B The electronic device determines the first frequency by any of the following steps:

[0193] When a first operation speed of the first operation is greater than or equal to a first speed threshold, determining that the first frequency is greater than the second frequency;

[0194] When the first operation speed of the first operation is less than the second speed threshold, it is determined that the first frequency is less than the second frequency.

[0195] When the first operation speed of the first operation is greater than or equal to the second speed threshold and less than the first speed threshold, it is determined that the first frequency is equal to the second frequency.

[0196] Compared with the above-mentioned method 2-4, through this method 2-5, the electronic device can also not adjust the screenshot frequency when the operation speed of the first operation is within the range of the first speed threshold and the second speed threshold, so as to ensure that the effect of the subsequent optimization measures executed by the electronic device is the same as before. This method can further improve the flexibility of electronic device screenshots, ensure the user experience of the electronic device, and avoid waste of power consumption of the electronic device.

[0197] Based on the above description of the methods 2-1 to 2-5 in the second implementation method, it can be known that when the electronic device can determine at least one of the following based on the first operation information, the electronic device can determine the first frequency based on multiple conditions: the distance between the position of the third target screen report point and the set area in the first user interface, whether the user performs the second operation on the first user interface, and the first operation speed of the first operation. That is:

[0198] When at least one of the first conditions is met, the electronic device determines that the first frequency is greater than the second frequency, that is, increases the screenshot frequency. The first condition includes:

[0199] The distance between the position of the third target screen reporting point and the set area in the first user interface is less than or equal to the first distance threshold.

[0200] recognizing that the user performs a second operation on the first user interface according to the position of at least one first screen reporting point;

[0201] A first operation speed of the first operation is greater than or equal to a first speed threshold.

[0202] When at least one of the second conditions is met, the electronic device determines that the first frequency is less than the second frequency, that is, reduces the screenshot frequency. The second condition includes:

[0203] The distance between the position of the third target screen reporting point and the set area in the first user interface is greater than the second distance threshold; the second distance threshold is greater than or equal to the first distance threshold;

[0204] According to the position information of at least one first screen reporting point, it is not recognized that the user performs a second operation on the first user interface;

[0205] The first operation speed of the first operation is less than the second speed threshold; the second speed threshold is less than or equal to the first speed threshold.

[0206] When at least one of the third conditions is met, the electronic device determines that the first frequency is equal to the second frequency, that is, the screenshot frequency is kept unchanged. The third condition includes:

[0207] When the second distance threshold is greater than the first distance threshold, the distance between the position of the third target screen reporting point and the set area is greater than the first distance threshold and less than or equal to the second distance threshold;

[0208] According to the position information of at least one first screen reporting point, it is not recognized that the user performs a second operation on the first user interface;

[0209] When the second speed threshold is smaller than the first speed threshold, the first operation speed of the first operation is greater than or equal to the second speed threshold and smaller than the first speed threshold.

[0210] In one embodiment, in addition to the above electronic device obtaining a new screenshot frequency based on the original screenshot frequency, in some scenarios, the electronic device can also stop taking screenshots of the first user interface. For example, after the electronic device takes a screenshot of the first user interface according to the first frequency (S403), the electronic device can continue to obtain the second operation information of the first operation. The second operation information is used to indicate the position of at least one second screen reporting point in the first operation. The at least one second screen reporting point is obtained by the electronic device during the screenshot process using the first frequency.

[0211] When the electronic device determines that at least one of the following fourth conditions is met, the first user interface can be stopped from being screenshotted. The fourth condition includes:

[0212] The distance between the position of the fourth target screen reporting point and the setting area of ​​the first user interface is equal to 0; the fourth target screen reporting point is the latest screen reporting point among the at least one second screen reporting point;

[0213] A second operation speed of the first operation determined according to the position of at least one second screen reporting point is less than or equal to a third speed threshold; wherein the third speed threshold is less than the second speed threshold.

[0214] It should be noted that, when the electronic device stops taking screenshots of the first user interface when the second operation speed is less than the third speed threshold, the first operation speed in the second condition is less than the second speed threshold, including: the first operation speed is greater than the third speed threshold and less than the second speed threshold, and the rule for adjusting the screenshot frequency based on the operation speed of the first operation meets the requirement. Figure 7C .

[0215] Through this implementation, the electronic device can stop taking screenshots of the first user interface when the first operation enters the set area or the first operation is a refined operation (no need to perform subsequent optimization measures), thereby causing the electronic device to stop performing subsequent optimization measures, thereby further saving power consumption of the electronic device and avoiding waste of power consumption.

[0216] It should also be noted that the electronic device can adjust the screenshot frequency according to the set adjustment step (adjustment value), that is, when the first frequency is different from the second frequency (the first frequency is greater than or less than the first frequency), the change between the first frequency and the second frequency is the set value.

[0217] S403: The electronic device takes a screenshot of the first user interface according to the first frequency.

[0218] In the embodiment of the present application, the electronic device may obtain at least one screenshot image during the process of executing S403, and the electronic device may perform subsequent optimization measures based on these screenshot images to protect the user experience.

[0219] Taking the application scenario of starting the drawing function of the electronic device as an example, the first operation is a drawing operation; during the process of the electronic device executing S403, the electronic device can obtain at least one first screenshot image, and can also obtain third operation information of the first operation; thereafter, the electronic device can implement the global local drawing service based on the at least one first screenshot image and the third operation information through the following steps:

[0220] A1: The electronic device performs image recognition on a drawing trajectory in at least one first screenshot image to determine a first brush mode parameter.

[0221] Optionally, the first brush mode parameter includes at least one of the following: brush type, line color, line width, and line texture.

[0222] Exemplarily, brush types may include: pen, pencil, marker, watercolor pen, oil brush, etc.; line colors may include black, red, green, blue, purple, etc.; line textures may include no texture, water ripple, marble, wood grain, gravel, etc.

[0223] A2: The electronic device determines a predicted drawing trajectory according to the first brush mode parameter and the third operation information.

[0224] The third operation information is used to indicate the position of at least one third screen point. In this way, the electronic device can predict the user's drawing trajectory based on the first brush mode parameter and the position of the at least one third screen point, and determine the predicted drawing trajectory. The specific process can refer to the trajectory prediction algorithm in the global local drawing service, which will not be repeated here.

[0225] A3: The electronic device displays the predicted drawing trajectory in the first user interface.

[0226] See also Figure 1 As shown, the electronic device can display the actual drawing trajectory of the first operation in the application image, and display the predicted drawing trajectory in the global local drawing layer. The electronic device synthesizes and displays the two layers to form a first user interface.

[0227] An embodiment of the present application provides a screenshot method. The method includes: in the process of a user performing a first operation on a first user interface, the electronic device displays dynamically changing content in the first user interface and obtains first operation information of the first operation; then the electronic device determines a first frequency according to the first operation information; and finally the electronic device takes a screenshot of the first user interface according to the first frequency. In this way, the electronic device can adjust the screenshot frequency in real time according to the real-time operation information of the user's operation, so that the screenshot frequency of the electronic device can be flexibly adjusted to meet the screenshot requirements of various situations, which can ultimately save the power consumption of the electronic device and ensure the user experience.

[0228] This application Figure 4 The screenshot method provided in the illustrated embodiment can be applied to various scenarios in which an electronic device takes a screenshot of a user interface when a user performs a touch operation. The following is an example of an application scenario in which an electronic device implements a global local rendering service. Figure 8 As shown, during the global local drawing process, the electronic device generates multiple screen points based on the user's drawing operation, and the electronic device displays the actual drawing trajectory on the display screen based on the generated screen points; in addition, during the drawing operation, the electronic device can determine the screenshot frequency in real time through the operation information of the drawing operation (such as the position of the screen points, pressure, etc.) to take a screenshot of the user interface displayed by the electronic device; after the electronic device takes a screenshot, some subsequent auxiliary measures or optimization measures to improve the user experience are executed according to the obtained screenshot image. For example, Figure 8 As shown in , the electronic device can predict and display the user's drawing trajectory (ie, predicted drawing trajectory).

[0229] Since the electronic device can adjust the screenshot frequency in real time according to the real-time operation information of the user's drawing operation, the screenshot frequency of the electronic device can be flexibly adjusted to meet the screenshot needs of various situations, which can ultimately save the power consumption of the electronic device and ensure the user experience.

[0230] For example, based on Figure 4 In the embodiment shown, in the application scenario where the electronic device implements the global local rendering service, the software structure of the electronic device can be as follows Fig. 9 The electronic device includes a display module, a screenshot management module, an image data analysis service module, a trajectory prediction module, etc.

[0231] After obtaining the operation information of the drawing operation, the sensor driver of the electronic device can report it to the display module, the screenshot management module, and the trajectory prediction module for subsequent processing.

[0232] The screenshot management module can determine the current screenshot frequency according to the operation information of the drawing operation, and then send a screenshot instruction to the display module to instruct the display module to take a screenshot of the user interface currently displayed on the display screen according to the screenshot frequency.

[0233] After the display module takes a screenshot of the user interface according to the screenshot instruction of the screenshot management module, it sends the screenshot image to the screenshot management module; the screenshot management module then forwards it to the image data analysis service module; or the display module can directly send the screenshot image to the image data analysis service module.

[0234] The image data analysis service module performs image recognition analysis on the received screenshot image to determine the user's current brush mode parameters; and sends the determined brush mode parameters to the trajectory prediction module.

[0235] The trajectory prediction module performs trajectory prediction according to the brush mode parameters and the operation information of the current drawing operation to obtain the predicted drawing trajectory.

[0236] The display module can display the actual drawing trajectory corresponding to the drawing operation according to the operation information of the current drawing operation, and can also display the predicted drawing trajectory obtained by the trajectory prediction module.

[0237] For example, based on Figure 4 The embodiment shown and Figure 3 The software structure of the electronic device shown in FIG. 1 may also refer to the software structure of the electronic device in the application scenario where the electronic device implements the global local rendering service. Fig.10 As shown in the figure, the application framework layer can provide services such as window management service (WMS), activity management service (AMS), input synthesis service (InputFlinger), global local drawing service, and image plane engine (SurfaceFlinger).

[0238] After the handwriting application is started electronically, the electronic device starts the global local drawing service. The user can, but is not limited to, draw the user interface displayed on the display screen using fingers or other touch-assisted tools. Fig.10 As shown, the sensor driver of the kernel layer can obtain the operation information of the drawing operation according to the sensor (such as touch sensor and / or pressure sensor) set on the display screen during the process of the user performing the drawing operation on the user interface, and then report the operation information of the drawing operation to the input synthesis service of the application framework layer. Optionally, the sensor driver can also directly report the operation information of the drawing operation to the global local drawing service of the application framework layer.

[0239] The input synthesis service can convert the received operation information of the drawing operation into a specific input event, and notify the handwriting application of the application layer of the input event through the activity management service. In addition, the input synthesis service can also provide the input event to the global local drawing service.

[0240] As shown in the figure, the global local drawing service can realize functions such as screen point acquisition, screen point prediction, screenshot management, brush recognition, trajectory prediction, etc. Optionally, the global local drawing service can obtain the operation information of the drawing operation based on the input event provided by the input synthesis service, or directly obtain the operation information of the drawing operation from the sensor driver.

[0241] The screen point acquisition module in the global local drawing service can analyze and process the operation information of the drawing operation to obtain at least one screen point and the operation data (pressure sensing data, position information, etc.) of the at least one screen point.

[0242] The screenshot management module can determine the screenshot frequency based on the operation data of the at least one screen report point. The specific process can refer to the screenshot method provided in the above embodiment, which will not be repeated here. Afterwards, the screenshot management module can send a screenshot instruction to the screenshot module in SurfaceFlinger, instructing the screenshot module to use the currently determined screenshot frequency to take a screenshot of the user interface displayed on the electronic device.

[0243] After the screenshot module takes a screenshot of the user interface through the display driver to obtain at least one screenshot image, the screenshot module sends the at least one screenshot image to the brush recognition module in the global local drawing service.

[0244] The brush recognition module performs image recognition on the at least one received screenshot image to obtain a brush mode parameter of a brush currently used by the user.

[0245] The screen point prediction module in the global local drawing service can predict the position of the screen point that may be generated by the subsequent drawing operation according to the position of at least one screen point analyzed by the screen point acquisition module.

[0246] The trajectory prediction module in the global local drawing service can perform drawing trajectory prediction processing based on the brush mode parameters obtained by the brush recognition module and the positions of the screen points that may be generated by the drawing operation predicted by the screen point prediction module to obtain a predicted drawing trajectory. After that, the trajectory prediction module transmits the predicted drawing trajectory to SurfaceFlinger, which draws the predicted drawing trajectory to the global local drawing layer.

[0247] In addition, after receiving the input event from the input synthesis service, the handwriting application can analyze and process the input event to obtain the actual drawing trajectory corresponding to the drawing operation, and notify SurfaceFlinger of the actual drawing trajectory. SurfaceFlinger draws the actual drawing trajectory to the application layer corresponding to the handwriting application.

[0248] SurfaceFlinger can synthesize the image display data of the global local drawing layer and the application layer, generate a user interface, and display the user interface on the display screen of the electronic device through the display driver.

[0249] Optionally, SurfaceFlinger can also have the function of brush management. For example, SurfaceFlinger creates, updates, deletes, etc. brushes according to the brush configuration parameters of the handwriting application. SurfaceFlinger also has the function of layer creation and management.

[0250] Based on the screenshot method provided in the embodiments of the present application, in the application scenario where the electronic device implements the drawing function (such as the global local drawing service), the present application also provides the following embodiments, so that the electronic device can adjust the screenshot frequency through a series of rules.

[0251] Each embodiment will be described in detail below in conjunction with the accompanying drawings.

[0252] Embodiment 1: adjusting the screenshot frequency according to the pressure change amount of the drawing operation.

[0253] In this embodiment, the electronic device can determine the pressure change of the drawing operation according to the operation information of the drawing operation. When the pressure change exceeds the set threshold, it means that the pressure change of the user's drawing operation is large, and the electronic device can increase the screenshot frequency.

[0254] For example, assuming that the pressure threshold is 100, the current screenshot frequency is 200ms, and when the user starts to perform a drawing operation, the screenshot frequency of the electronic device is 200ms, and the pressure data of the drawing operation is 300, then when the pressure data of the drawing operation increases to 400 or decreases to 200 (that is, the pressure change is greater than or equal to 100), the electronic device can increase the screenshot frequency to 100ms, and can quickly learn and simulate the user's actual drawing handwriting. Afterwards, when the pressure data of the drawing operation stabilizes at 200 or 400 (that is, the pressure change is less than 100), the electronic device can reduce the screenshot frequency to 200ms.

[0255] For the process of determining the pressure change amount of a drawing operation based on the operation information of the drawing operation, please refer to Figure 4 The description of implementation method 1 in the illustrated embodiment will not be repeated here.

[0256] As the screenshot frequency increases, the speed at which the electronic device analyzes the screenshot data can be increased, thereby better implementing subsequent optimization measures. Therefore, this method can better apply the pressure sensitivity of the drawing operation to the optimization measures of the electronic device. However, if the electronic device always uses a fixed screenshot frequency, when the pressure sensitivity of the drawing operation changes greatly, the optimization measures of the electronic device will have a large delay, resulting in the electronic device sensing the pressure sensitivity of the drawing operation at a slower speed.

[0257] See also Fig.11 As shown, in the process of an electronic device implementing a global local drawing service, when the pressure change of a user's drawing operation is less than a set pressure threshold, the electronic device may not adjust the screenshot frequency; when the pressure change of a drawing operation is greater than or equal to the set pressure threshold, the electronic device may increase the screenshot frequency, thereby enabling the electronic device to more quickly predict and simulate the drawing trajectory under the current pressure data.

[0258] Embodiment 2: adjusting the screenshot frequency according to the distance between the drawing operation and the non-drawing area of ​​the user interface (menu bar, user interface border and other areas, also referred to as specific areas or specific elements).

[0259] See also Fig.12 As shown, when the drawing operation is far away from the non-drawing area (taking the menu bar as an example) (for example, the distance between the drawing operation and the non-drawing area is greater than a set distance threshold (for example, 1 cm)), the electronic device may not adjust the screenshot frequency; when the drawing operation is close to the non-drawing area (for example, the distance between the drawing operation and the non-drawing area is less than or equal to the set distance threshold), the electronic device may increase the screenshot frequency, so that the electronic device can stop predicting the simulated drawing trajectory in time when the drawing operation reaches the non-drawing area, preventing the electronic device from predicting and simulating the drawing trajectory to be displayed in the non-drawing area, avoiding misoperation, and ensuring user experience.

[0260] For information about determining the distance between a drawing operation and the non-drawing area of ​​the user interface based on the operation information of the drawing operation, refer to Figure 4 The description of the second implementation method in the illustrated embodiment will not be repeated here.

[0261] Exemplarily, the set distance threshold can be determined according to the current operation speed of the drawing operation. For example, assuming that the screenshot frequency of the electronic device needs to be increased 0.1ms before the drawing operation (the location of the latest screen point) reaches the set area, the set distance threshold is the product of the current operation speed of the drawing operation and 0.1ms.

[0262] Embodiment 3: adjusting the screenshot frequency according to whether a non-drawing operation (such as switching a brush mode, switching a drawing style, etc.) is performed during the drawing operation.

[0263] See also Fig.13 As shown, when the electronic device does not recognize that the user is performing a non-drawing operation based on the operation information of the drawing operation (for example, by determining whether the user clicks on the menu bar, whether there is at least one screen reporting point in the operation information located in the area where the menu bar is located, the position change between adjacent screen reporting points exceeds a set threshold, etc.), the electronic device can reduce the screenshot frequency; otherwise, increase the screenshot frequency.

[0264] This embodiment is different from the scenarios of embodiments one and two. When the user does not perform non-drawing operations (such as clicking on the menu bar, etc.) during the drawing operation, it means that the user has not switched the brush mode. Therefore, the electronic device reduces the screenshot frequency and can save power consumption of the electronic device.

[0265] Furthermore, the electronic device may reduce the screenshot frequency when it is not recognized that the user performs a non-drawing operation and the distance between the drawing operation and the non-drawing area of ​​the user interface is greater than a set distance threshold.

[0266] Embodiment 4: adjusting the screenshot frequency according to the operation speed of the drawing operation (ie, the drawing speed).

[0267] When the operating speed of the drawing operation is greater than or equal to a first speed threshold, the electronic device increases the screenshot frequency; when the operating speed of the drawing operation is less than the first speed threshold and greater than the second speed threshold, the electronic device reduces the screenshot frequency; when the operating speed of the drawing operation is less than or equal to the second speed threshold, the electronic device stops taking screenshots.

[0268] For example, the speed of the drawing operation is low (for example, less than 2 cm / s), which means that the user is doing some fine writing or painting. At this time, the electronic device does not need to perform predictive simulation operations for drawing notes. Therefore, stopping taking screenshots of the user interface can save power consumption of the electronic device and avoid adverse effects on the user's drawing experience.

[0269] Optionally, the screenshot solution provided by the embodiment of the present application can also be extended to non-drawing scenes, such as game scenes. Optionally, in game software, the screenshot solution provided by the embodiment of the present application can be used as an auxiliary plug-in for the game to provide game optimization services for users. Exemplary, for example, an electronic device can identify the position of a skill button by analyzing a screenshot image. When the electronic device determines that the user is approaching a skill button through the operation information of the user's game operation, the electronic device can increase the screenshot frequency so that the electronic device can quickly perform image analysis based on the screenshot image, so that when the electronic device presses the skill case, the electronic device can make a notification such as prompting the user to release the skill (for example, prompting the user to release this killing skill to kill the enemy, or prompting the user to release this displacement technology to cross the current terrain, etc.), thereby improving the user's gaming experience.

[0270] It should also be noted that each step involved in the above embodiments can be performed by a corresponding device, or by a chip, processor, or chip system in the device, and the embodiments of the present application do not limit them. The above embodiments are only described by taking the execution by the corresponding device as an example. In addition, the specific implementation methods or examples in the above embodiments do not limit the solutions provided in the embodiments of the present application.

[0271] In addition, the embodiments and examples of the present application do not limit the conditions for adjusting the screenshot frequency, and expansion or deformation based on the conditions in the above embodiments or examples are also within the protection scope of the embodiments of the present application. For example: the distance between the first operation and the set area in the first user interface is less than the first distance threshold, which can also be expanded to: the time for the first operation to reach the set area in the first user interface is less than the set time threshold.

[0272] It should be noted that in the above embodiments, some steps can be selected for implementation, and the order of the steps in the diagram can be adjusted for implementation, and this application does not limit this. It should be understood that executing some steps in the diagram, adjusting the order of the steps, or combining them for specific implementation all fall within the scope of protection of this application.

[0273] It is understandable that, in order to implement the functions in the above embodiments, the various devices involved in the above embodiments include hardware structures and / or software modules corresponding to the execution of the various functions. It should be easily appreciated by those skilled in the art that, in combination with the units and method steps of the various examples described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0274] It can be understood that the above-mentioned network architecture and application scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0275] It should be noted that the "steps" in the embodiments of the present application are only for illustration, and are a method of expression used to better understand the embodiments, and do not constitute a substantial limitation on the execution of the scheme of the present application. For example, the "steps" can also be understood as "features". In addition, the steps do not constitute any limitation on the execution order of the scheme of the present application. Any changes in the order of steps, step merging, or step splitting made on this basis that do not affect the implementation of the overall scheme, and the resulting new technical solutions are also within the scope of the disclosure of the present application.

[0276] Based on the same concept, the present application also provides an electronic device. Fig.14 As shown, the electronic device includes one or more processors 1401, a memory 1402, a transceiver 1403 and a display screen 1404. For example, the above-mentioned components can be connected via one or more communication buses. Among them, the one or more computer programs are stored in the above-mentioned memory 1402 and are configured to be executed by the processor 1401. The one or more computer programs include instructions, and the above-mentioned instructions can be used to enable the electronic device to perform each step of the method in the above-mentioned embodiments.

[0277] Exemplarily, the processor 1401 may be Figure 2 The processor 210 shown. The memory 1402 may be specifically Figure 2 The internal memory 221 shown and / or the external memory connected to the electronic device. The transceiver 1403 can be Figure 2 The mobile communication module 250 and / or the wireless communication module 260 shown. The display screen 1404 can be specifically Figure 2 The display screen 294 is shown, and the embodiment of the present application does not impose any limitation on this.

[0278] Based on the same concept, an embodiment of the present application also provides an electronic device, which includes a unit for executing each step of the method provided in the above embodiment. Optionally, the electronic device may include a display screen and a processing unit. Optionally, the electronic device may also include a communication unit. The display screen is used to display an interface; the communication unit is used to receive and send data; and the processing unit is used to execute the method provided in the above embodiment.

[0279] For the specific functions of the above modules, please refer to the above embodiments and will not be repeated here.

[0280] Based on the above embodiments, the embodiments of the present application further provide a computer program product, which includes a computer program; when the computer program runs on a computer, the computer executes the method provided in the above embodiments.

[0281] Based on the above embodiments, the embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the method provided in the above embodiments.

[0282] Optionally, the above-mentioned computer may include, but is not limited to, electronic devices.

[0283] The storage medium may be any available medium that can be accessed by a computer. For example, but not limited to, a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0284] Based on the above embodiments, the embodiments of the present application further provide a chip, the chip is used to read the computer program stored in the memory, and implement the method provided in the above embodiments. Optionally, the chip may include a processor and a memory, the processor is coupled to the memory, and is used to read the computer program stored in the memory, and implement the method provided in the above embodiments.

[0285] Based on the above embodiments, the embodiments of the present application provide a chip system, which includes a processor for supporting a computer device to implement the functions involved in the electronic device in the above embodiments. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0286] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0287] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0288] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0289] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0290] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A screenshot method, applied to an electronic device, characterized in that: include: During the process of the user performing a first operation on the first user interface, dynamically changing content is displayed in the first user interface, and first operation information of the first operation is acquired; Determining a first frequency according to the first operation information; Taking a screenshot of the first user interface according to a first frequency.

2. The method according to claim 1, characterized in that Before acquiring the first operation information of the first operation, the method further includes: taking a screenshot of the first user interface according to a second frequency; The determining the first frequency according to the first operation information includes: The first frequency is determined according to the first operation information and the second frequency.

3. The method according to claim 2, characterized in that The first operation information is used to indicate pressure sensing data of at least one first screen reporting point in the first operation; and determining the first frequency according to the first operation information and the second frequency includes: When the pressure-sensitivity change between the pressure-sensitivity data of the first target screen point and the pressure-sensitivity data of the second target screen point is greater than or equal to a first pressure-sensitivity threshold, determining that the first frequency is greater than the second frequency; or When the pressure change is less than a second pressure threshold, it is determined that the first frequency is less than the second frequency; and the second pressure threshold is less than or equal to the first pressure threshold; or In a case where the second pressure sensitivity threshold is less than the first pressure sensitivity threshold, when the pressure sensitivity change is less than the first pressure sensitivity threshold and greater than or equal to the second pressure sensitivity threshold, determining that the first frequency is equal to the second frequency; The first target screen reporting point is the latest screen reporting point among the at least one first screen reporting point, and the second target screen reporting point is the screen reporting point before the first target screen reporting point among the at least one first screen reporting point.

4. The method according to claim 2 or 3, characterized in that The first operation information is used to indicate the position of at least one first screen reporting point in the first operation; The determining the first frequency according to the first operation information and the second frequency includes: When at least one of the first conditions is met, it is determined that the first frequency is greater than the second frequency; the first condition includes: The distance between the position of the third target screen reporting point and the set area in the first user interface is less than or equal to the first distance threshold; recognizing, according to the position of the at least one first screen reporting point, that the user performs a second operation on the first user interface; A first operation speed of the first operation determined according to the position of the at least one first screen reporting point is greater than or equal to a first speed threshold; or When at least one of the second conditions is met, it is determined that the first frequency is less than the second frequency; the second condition includes: The distance between the position of the third target screen reporting point and the set area is greater than the second distance threshold; the second distance threshold is greater than or equal to the first distance threshold; The second operation is not recognized according to the position information of the at least one first screen reporting point; The first operating speed is less than a second speed threshold; the second speed threshold is less than or equal to the first speed threshold; or When at least one of the third conditions is met, it is determined that the first frequency is equal to the second frequency; the third condition includes: When the second distance threshold is greater than the first distance threshold, the distance between the position of the third target screen reporting point and the set area is greater than the first distance threshold and less than or equal to the second distance threshold; The second operation is not recognized according to the position information of the at least one first screen reporting point; When the second speed threshold is less than the first speed threshold, the first operation speed is greater than or equal to the second speed threshold and less than the first speed threshold; Among them, the third target screen point is the latest screen point among the at least one first screen point; and the second operation is different from the first operation.

5. The method according to claim 4, characterized in that After taking a screenshot of the first user interface according to the second frequency, the method further includes: Acquire second operation information of the first operation; the second operation information is used to indicate the position of at least one second screen reporting point in the first operation; When the distance between the position of the fourth target screen reporting point and the set area is equal to 0, stop taking a screenshot of the first user interface; or When the second operation speed of the first operation determined according to the position of the at least one second screen reporting point is less than or equal to a third speed threshold, stop taking a screenshot of the first user interface; wherein the third speed threshold is less than the second speed threshold; the first operation speed in the second condition is less than the second speed threshold, including: the first operation speed is greater than the third speed threshold and less than the second speed threshold; The fourth target screen point reporting is the latest screen point reporting among at least one second screen point reporting.

6. The method according to any one of claims 3 to 4, characterized in that: When the first frequency is different from the second frequency, the variation between the first frequency and the second frequency is a set value.

7. The method according to any one of claims 2 to 6, characterized in that: The taking a screenshot of the first user interface according to the second frequency includes: At the start time of the first operation, a screenshot of the first user interface is taken according to the second frequency; wherein the second frequency is a default frequency.

8. The method according to any one of claims 1 to 7, characterized in that: The first operation is a drawing operation; During the process in which the user performs the first operation on the first user interface, displaying dynamically changing content in the first user interface includes: during the process in which the user performs the first operation on the first user interface, displaying an actual drawing track corresponding to the first operation in the first user interface; The method further comprises: In the process of taking a screenshot of the first user interface according to the first frequency, obtaining at least one first screenshot image, and acquiring third operation information of the first operation; Performing image recognition on the drawing trajectory in the at least one first screenshot image to determine a first brush mode parameter; Determining a predicted drawing trajectory according to the first brush mode parameter and the third operation information; The predicted drawing trajectory is displayed in the first user interface.

9. The method according to claim 8, characterized in that The first brush mode parameter includes at least one of the following: brush type, line color, line width, and line texture.

10. The method according to claim 8 or 9, characterized in that The drawing operation is a touch operation of the user on the first user interface on the display screen using a finger or a touch auxiliary tool, wherein the touch auxiliary tool includes any one of the following: a stylus, a touch pen, a touch ball, and a mouse.

11. An electronic device, characterized in that: The electronic device comprises: Display screen, used for interface display; a memory for storing computer program instructions; A processor is used to execute the computer program instructions to support the electronic terminal device to implement the method as described in any one of claims 1-10.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processing circuit, the method according to any one of claims 1 to 10 is implemented.

13. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 10.

14. A chip system, characterized in that: The chip system includes a processing circuit and a storage medium, wherein the storage medium stores computer program instructions; when the computer program instructions are executed by the processing circuit, the method as described in any one of claims 1 to 10 is implemented.

Images