Method and device for entering global annotation

Abstract

The embodiment of the invention provides a method and device for entering a global annotation, and relates to the technical field of terminals. In response to a first touch event in the first operation, the electronic equipment performs screenshot on the first interface to obtain a first image; in response to a second touch event in the first operation, the electronic equipment starts a global annotation application; in response to the situation that the electronic equipment starts the global annotation application, the electronic equipment displays a second interface, and a first offset between the position of the second touch event and the position of the first touch event is larger than or equal to a first threshold value; in response to a second operation acting on the second interface, the electronic equipment displays the handwriting corresponding to the operation track of the second operation on the second interface. Therefore, the electronic equipment can quickly pull up the global annotation under the condition that the first offset between the position of the first touch event and the position of the second touch event is greater than or equal to the first threshold value, and the method for entering the global annotation is simplified.

Description

[0001] This application is a divisional application of Chinese patent application No. 202211447489.8, filed on November 18, 2022, entitled "Method and apparatus for accessing global annotations". Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a method and apparatus for accessing global annotations. Background Technology

[0003] With the popularization and development of the Internet, people's functional needs for electronic devices are becoming increasingly diversified. For example, in order to simplify the way users read books or take notes using electronic devices, many electronic devices support annotation using a stylus, thus requiring a more user-friendly way to enter annotation mode. Summary of the Invention

[0004] This application provides a method and apparatus for accessing global annotations, enabling electronic devices to quickly access global annotations when a first offset between the location of a first touch event and the location of a second touch event is greater than or equal to a first threshold. This simplifies the method for accessing global annotations and improves the user experience of using the global annotation function.

[0005] In a first aspect, embodiments of this application provide a method for accessing global annotations. The method includes: an electronic device displaying a first interface; responding to a first touch event in a first operation, the electronic device taking a screenshot of the first interface to obtain a first image, wherein the first operation is performed on the first interface, the type of the first operation is non-handwriting, the first touch event is the first event of the first operation, and the position of the first touch event is within a preset area; responding to a second touch event in the first operation, the electronic device launching a global annotation application; wherein a first offset between the position of the second touch event and the position of the first touch event is greater than or equal to a first threshold; responding to the launch of the global annotation application, the electronic device displaying a second interface, the second interface including the first image; responding to a second operation performed on the second interface, the electronic device displaying handwriting corresponding to the operation trajectory of the second operation on the second interface. In this way, the electronic device can quickly launch global annotations when the first offset between the position of the first touch event and the position of the second touch event is greater than or equal to a first threshold, simplifying the method for accessing global annotations and improving the user experience of using the global annotation function.

[0006] The first interface can be Figure 7The interface shown in Figure 'a'; the first operation can be a trigger operation of a stylus on an electronic device; the first image can be a screenshot image described in the embodiments of this application; the first offset can be the offset B described in the embodiments of this application; the first threshold can be the threshold B described in the embodiments of this application; the second interface can be... Figure 8 The interface shown in 'a'.

[0007] In one possible implementation, before the electronic device launches the global annotation application in response to a second touch event in the first operation, the method further includes: in response to a third touch event in the first operation, the electronic device displays an animation; wherein the third touch event is any movement event following the first touch event; in the animation, the first image is scaled down to a second image, the degree of scaling down of the second image being determined based on a second offset; the second offset is the offset between the position of the third touch event and the position of the first touch event.

[0008] In this way, the electronic device can display an animation effect following the third touch event. This animation can not only prompt the user that the global annotation application has not been launched, but also provide the user with a better device interaction experience.

[0009] The animation can be the follow-along animation described in the embodiments of this application.

[0010] In one possible implementation, the method further includes: if a screenshot of the first interface fails, in response to a third touch event in the first operation, the electronic device displays a third interface; wherein the third interface includes a prompt message indicating that the application corresponding to the first image does not support global annotations. In this way, the electronic device can provide a prompt when the currently displayed interface does not support screenshots, promptly reminding the user whether to enable global annotations.

[0011] The third interface can be Figure 6 The interface shown.

[0012] In one possible implementation, the method further includes: when the electronic device determines that preset conditions are met, the electronic device interrupts the global annotation process; wherein the preset conditions include one or more of the following: a first offset is less than a first threshold and the electronic device receives a fourth touch event in the first operation, or the first operation is a handwriting type. In this way, the electronic device can promptly interrupt the global annotation logic when the preset conditions are met, allowing the electronic device to send the received touch events to other foreground applications or other modules capable of processing touch events.

[0013] The fourth touch event can be the up event described in the embodiments of this application.

[0014] In one possible implementation, before the electronic device receives the second operation, the second interface includes a first image and a prompt indicating whether to enter global annotation. This allows the user to promptly detect whether global annotation has been entered based on the prompt displayed on the electronic device.

[0015] In one possible implementation, the position of the preset area on the electronic device is related to the device's landscape or portrait orientation. This allows the electronic device to access the global annotation application in either landscape or portrait mode, enhancing the user experience.

[0016] In one possible implementation, in response to a first touch event in the first operation, the electronic device takes a screenshot of the first interface to obtain a first image. This includes: in response to the first touch event in the first operation, if a flag bit corresponding to the first interface indicates that the first interface supports screenshots, the electronic device takes a screenshot of the first interface to obtain the first image. In this way, the electronic device can determine whether a screenshot of the first interface is possible based on the flag bit, avoiding the leakage of user privacy when directly taking screenshots of the interface and ensuring the security of global annotation usage.

[0017] In one possible implementation, the method further includes: when the electronic device determines that it is entering the global annotation for the first time, the electronic device displays a fourth interface; wherein the fourth interface includes: a prompt message for introducing the function of global annotation, and a target control for determining entry into global annotation; in response to an operation on the target control, the electronic device displays a fifth interface; wherein the fifth interface includes: a first image, and a function control for adding annotations to the first image. Thus, the electronic device can also issue a prompt when it determines that the function of global annotation has not been introduced, and guide the user on how to use the global annotation function.

[0018] The fourth interface can be Figure 10 The interface shown in 'a'; the fifth interface can be... Figure 10 The interface shown in b is shown in the image.

[0019] In one possible implementation, the method further includes: when the electronic device establishes a connection with the stylus and the electronic device determines, based on a first parameter, that it has not previously introduced the global annotation function, the electronic device displays a sixth interface; wherein the first parameter indicates whether the global annotation function was previously introduced when the electronic device established a connection with the stylus, and the sixth interface includes prompts for introducing the global annotation function. In this way, the electronic device can introduce the global annotation function when establishing a connection with the stylus, facilitating the user's use of the global annotation function.

[0020] The sixth interface can be Figure 9 The interface shown.

[0021] Secondly, embodiments of this application provide an apparatus for accessing global annotations. The apparatus includes: a display unit and a processing unit; the display unit is used to display a first interface; in response to a first touch event in a first operation, the processing unit is used to take a screenshot of the first interface to obtain a first image, wherein the first operation is performed on the first interface, the type of the first operation is non-handwriting, the first touch event is the first event of the first operation, and the position of the first touch event is within a preset area; in response to a second touch event in the first operation; wherein a first offset between the position of the second touch event and the position of the first touch event is greater than or equal to a first threshold; the processing unit is further used to launch a global annotation application; in response to the processing unit launching the global annotation application, the display unit is further used to display a second interface, the second interface including the first image; in response to a second operation performed on the second interface, the display unit is further used to display handwriting corresponding to the operation trajectory of the second operation on the second interface.

[0022] In one possible implementation, in response to a third touch event in the first operation, the display unit is also used to display an animation; wherein the third touch event is any movement event following the first touch event; in the animation, the first image is scaled down to a second image, the degree of scaling down of the second image being determined based on a second offset; the second offset is the offset between the position of the third touch event and the position of the first touch event.

[0023] In one possible implementation, if the screenshot of the first interface fails, in response to a third touch event in the first operation, the display unit is further configured to display a third interface; wherein the third interface includes: a prompt message indicating that the application corresponding to the first image does not support global annotations.

[0024] In one possible implementation, when the electronic device determines that a preset condition is met, the processing unit is further configured to interrupt the entry into global annotation: wherein the preset condition includes one or more of the following: the first offset is less than a first threshold and the electronic device receives a fourth touch event in the first operation, or the first operation is a handwriting type.

[0025] In one possible implementation, before the electronic device receives the second operation, the second interface includes: a first image and a prompt message indicating access to global annotation.

[0026] In one possible implementation, the position of the preset area in the electronic device is related to the horizontal or vertical orientation of the electronic device.

[0027] In one possible implementation, in response to a first touch event in the first operation, if the flag bit corresponding to the first interface indicates that the first interface supports screenshotting, the display unit is specifically used to take a screenshot of the first interface to obtain a first image.

[0028] In one possible implementation, when the electronic device determines that it is entering the global annotation for the first time, the display unit is further configured to display a fourth interface; wherein the fourth interface includes: a prompt message for introducing the functions of the global annotation, and a target control for determining entry into the global annotation; in response to an operation on the target control, the display unit is further configured to display a fifth interface; wherein the fifth interface includes: a first image, and a functional control for adding annotations to the first image.

[0029] In one possible implementation, the method further includes: when the electronic device establishes a connection with the stylus and the electronic device determines based on a first parameter that the electronic device has not introduced the global annotation function, the display unit is further configured to display a sixth interface; wherein the first parameter is used to indicate whether the global annotation function has been introduced when the electronic device establishes a connection with the stylus, and the sixth interface includes: prompt information for introducing the global annotation function.

[0030] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor; when the processor executes the computer program, it causes the electronic device to perform the method described in the first aspect or any implementation thereof.

[0031] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, causes the computer to perform the method described in the first aspect or any implementation thereof.

[0032] Fifthly, a computer program product comprising a computer program that, when run, causes a computer to perform the methods described in the first aspect or any implementation thereof.

[0033] It should be understood that the third to fifth aspects of this application correspond to the technical solutions of the first or second aspects of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0034] Figure 1 A scenario diagram provided for an embodiment of this application;

[0035] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0036] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of this application;

[0037] Figure 4 This application provides a method for accessing global comments;

[0038] Figure 5 A schematic diagram of a preset area provided in an embodiment of this application;

[0039] Figure 6 This application provides a schematic diagram of an interface for displaying prompt information.

[0040] Figure 7 A schematic diagram of a follow-up animation provided for an embodiment of this application;

[0041] Figure 8 A schematic diagram of an interface for global annotation provided in an embodiment of this application;

[0042] Figure 9 This is a schematic diagram illustrating the functions of an interface provided in an embodiment of this application.

[0043] Figure 10 This is a schematic diagram illustrating another function of the interface provided in an embodiment of this application;

[0044] Figure 11 This is a schematic diagram illustrating another method for entering global comments provided in an embodiment of this application;

[0045] Figure 12 A schematic diagram of a device for entering global annotations provided in an embodiment of this application;

[0046] Figure 13 This is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application. Detailed Implementation

[0047] To facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. For example, the first value and the second value are only used to distinguish different values ​​and do not limit their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0048] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0049] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0050] For example, Figure 1 This is a schematic diagram of a scenario provided for an embodiment of this application. Figure 1 In the corresponding embodiments, a tablet is used as an example for illustration. This example does not constitute a limitation on the embodiments of this application.

[0051] When a user needs to annotate the currently displayed interface of an electronic device using a stylus, the device can take a screenshot of the screen. Furthermore, the screenshot can be located in the photo album application, and annotations can be added by editing the screenshot, generating a result such as... Figure 1 The screen shown. Alternatively, after the electronic device captures a screenshot, the screenshot can be copied to a specific application that allows annotations to be added to the image, and the annotation can be added to the screenshot in that specific application.

[0052] After an annotation is added to a screenshot image using a stylus on an electronic device, the device can display something like this: Figure 1 The interface shown. (As shown) Figure 1 As shown, this interface can display screenshots of images with added annotations. Figure 1 As shown, the text "touchscreen" is surrounded by hand-drawn circles, and a handwritten annotation with "Important!" is added.

[0053] However, the above method for adding annotations to images is rather cumbersome and affects the user experience of using the global annotation function.

[0054] In view of this, embodiments of this application provide a method for accessing global annotations, enabling an electronic device to quickly pull up global annotations and display a first interface corresponding to the global annotation function when the first offset between the position of the first touch event and the position of the second touch event is greater than or equal to a first threshold, thereby simplifying the method for accessing global annotations and improving the user experience of using the global annotation function.

[0055] Wherein, the first offset can be the offset B described in the embodiments of this application, and the first threshold can be the threshold B described in the embodiments of this application; the first interface can be Figure 7 The interface shown in 'a'.

[0056] It is understood that the aforementioned electronic devices can also be referred to as: terminal devices, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. Electronic devices can include mobile phones with touchscreens, smart TVs, wearable devices, tablets, computers with wireless transceiver capabilities, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and so on. The embodiments of this application do not limit the specific technologies or device forms used in the electronic devices.

[0057] When the electronic device is a mobile phone, a stylus can be configured on the electronic device so that the stylus can assist the electronic device in realizing the method of entering global annotation provided in the embodiments of this application.

[0058] In other possible implementations, users can also trigger the electronic device with their fingers to enable global annotation, but this application does not limit this approach.

[0059] Therefore, in order to better understand the embodiments of this application, the structure of the electronic device of the embodiments of this application will be described below.

[0060] For example, Figure 2This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0061] Reference Figure 2 An electronic device may include multiple subsystems that cooperate to perform, coordinate, or monitor one or more operations or functions of the electronic device. The electronic device includes a processor 210, an input surface 220, a coordination engine 230, a power subsystem 240, a power connector 250, a wireless interface 260, and a display 270.

[0062] The electronic device establishes a communication connection with the stylus, and the global annotation method provided in this application embodiment can be understood as being implemented when the electronic device and the stylus are connected. The stylus can also be called a touch pen, capacitive pen, or inductive pen, etc.

[0063] For electronic devices, the coordination engine 230 can be used to communicate with and / or process data with other subsystems of the electronic device; communicate with and / or transact data with a stylus; measure and / or acquire the output of one or more analog or digital sensors (such as touch sensors); measure and / or acquire the output of one or more sensor nodes of a sensor node array (such as an array of capacitive sensing nodes); receive and locate tip signals and loop signals from the stylus; locate the stylus based on the position of the tip signal intersection area and the loop signal intersection area, etc.

[0064] In a possible implementation, the sensors in the electronic device may also include a gravity sensor, which can be used to calculate the tilt angle of the electronic device relative to a horizontal plane, thereby identifying the posture of the electronic device. For example, the gravity sensor can detect whether the electronic device is in landscape or portrait mode by calculating the tilt angle of the electronic device relative to a horizontal plane.

[0065] In possible implementations, the electronic device may also detect the screen orientation based on an accelerometer and / or an angular velocity sensor, etc., but this application does not limit this aspect.

[0066] The processor 210 can be used to receive control commands from the stylus, which can be used to instruct the electronic device to perform corresponding control. In this embodiment, when the stylus receives a trigger operation from the user in a preset area, the stylus can recognize the trigger operation and send the control command corresponding to the recognition result to the electronic device, so that the electronic device can execute the control command. For example, the electronic device can perform page turning control according to the control command.

[0067] Generally, the processor 210 can be configured to perform, coordinate, and / or manage the functions of an electronic device. Such functions may include, but are not limited to: communicating and / or trading data with other subsystems of the electronic device, communicating and / or trading data with a stylus, trading data via a wireless interface, trading data via a wired interface, facilitating power exchange via a wireless (e.g., inductive, resonant, etc.) or wired interface, and receiving the position and angular position of one or more styluses.

[0068] Processor 210 can be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, a processor can be a microprocessor, a central processing unit, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor, analog circuitry, digital circuitry, or a combination of these devices. The processor can be a single-threaded or multi-threaded processor. The processor can be a single-core or multi-core processor.

[0069] During use, processor 210 can be configured to access memory storing instructions. These instructions can be configured to cause the processor to perform, coordinate, or monitor one or more operations or functions of the electronic device.

[0070] Instructions stored in memory can be configured to control or coordinate the operation of other components of an electronic device, such as, but not limited to: another processor, analog or digital circuitry, volatile or non-volatile memory modules, displays, speakers, microphones, rotary input devices, buttons or other physical input devices, biometric sensors and / or systems, force or touch input / output components, communication modules (such as wireless interfaces and / or power connectors), and / or haptic feedback devices.

[0071] The memory can also store electronic data that can be used by the stylus or processor. For example, the memory can store electronic data or content (such as media files, documents, and applications), device settings and preferences, timing and control signals, or data, data structures, or databases for various modules, files or configurations related to the detection of tip signals and / or loop signals, and so on. The memory can be configured as any type of storage device. For example, the memory can be implemented as random access memory, read-only memory, flash memory, removable memory, other types of storage elements, or combinations of such devices.

[0072] In this embodiment, the memory can also be connected to the stylus that has been connected to the electronic device, the working mode corresponding to the stylus, and the usage time of the stylus in different working modes. This allows the electronic device to send the working mode with the longest usage time to the stylus the next time it establishes a connection with the stylus, thus avoiding frequent switching of the stylus's working mode.

[0073] The electronic device also includes a power subsystem 240. The power subsystem 240 may include a battery or other power source. The power subsystem 240 may be configured to provide power to the electronic device. The power subsystem 240 may also be coupled to a power connector 250.

[0074] The electronic device also includes a wireless interface 260 to facilitate electronic communication between the electronic device and the stylus. In this embodiment, the electronic device may be configured to receive recognition results from the stylus via a Bluetooth Low Energy communication interface, for example, the electronic device may receive recognition results from the stylus via the wireless interface 260.

[0075] In some embodiments, the electronic device also uses a near-field communication interface to communicate with a stylus. In other examples, the communication interface facilitates electronic communication between the electronic device and external communication networks, devices, or platforms.

[0076] The wireless interface 260 (whether it is a communication interface between an electronic device and a stylus or another communication interface) can be implemented as one or more wireless interfaces, Bluetooth interfaces, near field communication interfaces, magnetic interfaces, universal serial bus interfaces, inductive interfaces, resonant interfaces, capacitive coupling interfaces, Wi-Fi interfaces, TCP / IP interfaces, network communication interfaces, optical interfaces, acoustic interfaces or any conventional communication interface.

[0077] The electronic device also includes a display 270. The display 270 may be located behind the input surface 220 or integrated therewith. The processor 210 may use the display 270 to present information to the user. In many cases, the processor 210 uses the display 270 to present an interface that the user can interact with. In many cases, the user interacts with the interface using a stylus. In this embodiment, the display 270 may display the interface controlled by the stylus.

[0078] It will be apparent to those skilled in the art that some of the specific details presented above regarding the electronic device may not be necessary for practicing a particular implementation or its equivalent. Similarly, other electronic devices may include a greater number of subsystems, modules, components, etc. Where appropriate, some submodules may be implemented as software or hardware. Therefore, it should be understood that the foregoing description is not intended to be exhaustive or to limit this disclosure to its precise form. Rather, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the foregoing teachings.

[0079] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture, etc. This application uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.

[0080] For example, Figure 3 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.

[0081] like Figure 3 As shown, a layered architecture can divide software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into multiple layers, from top to bottom: the application (APP) layer, the application framework layer, the system libraries, and the kernel layer, etc.

[0082] like Figure 3 As shown, the application layer may include applications such as annotation applications. In this embodiment, no specific limitation is made on other applications included in the application layer.

[0083] This annotation application can be used to provide electronic devices with business functions related to global annotation. For example, an electronic device can launch the annotation application based on a user's triggering action on the device, and the device can display: an indicator box to indicate entering global annotation, and several functional controls that may be used during the annotation process.

[0084] In possible implementations, this application layer may also include applications such as: photo album, camera, phone, Bluetooth, map, and music. Figure 3 (not shown in the text), but this is not limited in the embodiments of this application.

[0085] The application framework layer provides application programming interfaces (APIs) and programming frameworks for various types of applications within the application layer, and may include some predefined functions.

[0086] like Figure 3 As shown, the application framework layer may include: an input management module, a global annotation module, a screenshot module, and a window manager, etc.

[0087] The input management module is used to acquire various touch events for electronic devices and send the touch events and corresponding information to the global annotation module. For example, the touch event can be a trigger event triggered by a stylus or a user's finger on the electronic device; the information can include: the location information corresponding to the touch event, the source information of the touch event, and the action type information of the touch event.

[0088] The global annotation module is used to determine whether to allow the global annotation function to be triggered based on touch events. For example, the global annotation module determines: whether the touch event is a stylus input event, whether the touch event is a down event (or a move event, up event, etc.), whether the location of the touch event meets a preset range, whether the touch event has an offset, and whether the screenshot was successful. Furthermore, when it is determined that access to global annotation is allowed, the global annotation module can instruct the annotation application to start global annotation.

[0089] The screenshot module is used to capture screenshots. For example, when the screenshot module receives a screenshot command from the global annotation module, it can capture a screenshot and return a message indicating successful screenshot and the captured image to the global annotation module when the screenshot is successful; alternatively, the screenshot module can also return a message indicating failure to capture the screenshot to the global annotation module when it determines that the screenshot was unsuccessful.

[0090] The window manager is used to manage window programs. Based on instructions from the global annotation module, the window manager can invoke the display to show corresponding content. In possible implementations, the window manager can also obtain the screen size, determine the presence of a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc., but this embodiment does not limit the scope of these implementations.

[0091] In possible implementations, the application framework layer may also include one or more of the following: a content provider, a resource manager, a view system, or a notification manager. Figure 3 (not shown in the image), etc.

[0092] The content provider stores and retrieves data, making it accessible to applications. This data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can consist of one or more views. For example, a display interface including a text message notification icon can include views for displaying text and views for displaying images. The notification manager allows applications to display notifications in the status bar. It can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager is used to notify of download completion, message alerts, etc. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrations, flashing indicator lights, etc.

[0093] The system library can include multiple functional modules. For example, a surface manager, a 3D graphics processing library, a 2D graphics engine, and media libraries.

[0094] The Surface Manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications.

[0095] The 3D graphics processing library is used to implement functions such as 3D graphics drawing, image rendering, compositing, and layer processing.

[0096] A 2D graphics engine is a graphics engine for 2D drawing.

[0097] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0098] The kernel layer is the layer between hardware and software. The kernel layer includes one or more of the following: display driver, camera driver, audio driver, and sensor driver, etc.

[0099] It is understood that the software structure of the electronic device may also include other layers and / or other modules, and the specific results of the electronic device are not limited in the embodiments of this application.

[0100] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be implemented independently or in combination with each other. The same or similar concepts or processes may not be described again in some embodiments.

[0101] For example, Figure 4 This application provides a method for accessing global comments.

[0102] exist Figure 4 In corresponding embodiments, the electronic device may include one or more of the following modules, such as: annotation application, input management module, global annotation module, window manager, and screenshot module; taking a tablet as an example, this application provides an example of a method for entering global annotations, which does not constitute a limitation on the embodiments of this application.

[0103] like Figure 4 As shown, the method to access global comments can include the following steps:

[0104] S401. When the electronic device receives a touch operation from the stylus pen on the display screen, the input management module sends the first touch event to the global annotation module.

[0105] In this embodiment of the application, the triggering operation can be a triggering operation of the stylus on any position on the display screen; the first touch event can be a press event of the stylus on the display screen, and the first touch event can be the first event in the triggering operation of the stylus on the display screen.

[0106] The first touch event may carry one or more of the following information, such as: source information of the first touch event, action type information of the first touch event, and location information of the first touch event.

[0107] The source information may include: stylus (or handwriting type) and finger (or non-handwriting type); the action type information may include: down, move, and up; the position information may be: X-axis information and Y-axis information, and the position information may be coordinate information with the horizontal and vertical directions of the electronic device as the coordinate axes.

[0108] For example, when an electronic device receives any trigger operation from a stylus on the display screen, the input management module sends all received motion events to the global annotation module. These motion events can be the first touch event described in S401.

[0109] S402, The global annotation module determines whether the first touch event is a stylus down event.

[0110] The stylus down event can be an event whose source information is a stylus and whose action type information is down.

[0111] In this embodiment of the application, when the global annotation module determines that the first touch event satisfies the stylus down event, the global annotation module can execute the step shown in S403; or, when the global annotation module determines that the first touch event does not satisfy the stylus down event, the global annotation module can execute the step shown in S406.

[0112] For example, after the global annotation module receives a motion event sent by the input management module, the global annotation module can determine whether the action type of the motion event is down and whether the source of the motion event is a stylus.

[0113] S403, The global annotation module determines whether the first touch event is within the preset area.

[0114] In this embodiment, the preset area can be understood as an area that allows global annotation to be triggered. For example, the preset area can be a rectangular area located in the upper right corner of the electronic device. For instance, the global annotation module can determine whether the first touch event is within the preset area based on the location information (or coordinates) of the first touch event.

[0115] When the global annotation module determines that the first touch event is within the preset area, the global annotation module may execute the steps shown in S404-S405; or, when the global annotation module determines that the first touch event is not within the preset area, the global annotation module may execute the steps shown in S406.

[0116] For example, Figure 5 This is a schematic diagram of a preset area provided in an embodiment of this application. Figure 5 The electronic device shown in 'a' can have a preset area that is a rectangular area with a length of L1 and a width of W1, with the upper right corner of the electronic device as its vertex. The units for L1 and W1 can be device-independent pixels (DP).

[0117] In one possible implementation, when the preset area is a rectangular area, the rectangular area can also be proportional to the display screen of the electronic device.

[0118] In possible implementations, the preset area may be a fan-shaped area, a circular area, or an irregular area located in the upper right corner of the electronic device; or, the preset area may be an area of ​​different shapes located in the upper left, lower right, or lower left corner of the electronic device. In this embodiment, the specific location and shape of the preset area are not limited.

[0119] In a possible implementation, the electronic device can identify its landscape or portrait orientation using sensors such as a gravity sensor, and then match a corresponding preset area to the device based on that orientation. For example, when the device's automatic rotation function is enabled, if the gravity sensor detects a tilt angle of 0° or 180° relative to the horizontal plane, the device can determine its current orientation. Figure 5 In the portrait mode shown by 'a', the preset area can be the rectangular area in the upper right corner of the electronic device.

[0120] Furthermore, when the electronic device receives a user's screen-flipping operation, the gravity sensor can detect when the electronic device's tilt angle relative to the horizontal plane is 90° or 270°, etc., and the electronic device can then react accordingly. Figure 5 The vertical screen mode shown in 'a' is switched to the following: Figure 5In the landscape mode shown by b, the preset area can also be the upper right rectangular area of ​​the electronic device in landscape mode. For example... Figure 5 The electronic device shown in b can have a preset area that is a rectangular area with a length of L2 and a width of W2, with the upper right corner of the electronic device as the vertex. The units of L2 and W2 can also be DP.

[0121] in, Figure 5 The size of the preset area in the interface shown by b is related to... Figure 5 In the interface shown by 'a', the size of the preset areas can be the same or different; and... Figure 5 The position of the preset area in the interface shown by b can be compared with... Figure 5 The location of the preset area described in the interface shown in 'a' is similar, so it will not be repeated here.

[0122] It is understood that S402 and S403 can be executed sequentially or synchronously, and this application embodiment does not specifically limit this.

[0123] S404, The global annotation module sends a screenshot command to the screenshot module.

[0124] The screenshot instruction is used to instruct the screenshot module to take a screenshot of the interface currently displayed on the electronic device (or the target interface) and generate a screenshot image (or the first image).

[0125] Accordingly, when the screenshot module receives a screenshot command sent by the global annotation module, the screenshot module can take a screenshot of the target interface, generate a screenshot image, and execute the steps shown in S405.

[0126] In one possible implementation, when the screenshot module receives a screenshot command from the global annotation module, the screenshot module can confirm with the window manager and determine in the window manager whether the target interface supports screenshots.

[0127] For example, since the target application can register in the window manager when displaying the target interface and determine whether the target interface supports screenshots by setting a flag, when the screenshot module receives a screenshot instruction, it can send an instruction to the window manager and determine whether the target interface supports screenshots. When the screenshot module receives a message from the window manager indicating that the target interface allows screenshots, it can take a screenshot of the target interface, generate a screenshot image, and execute the step shown in S405. Here, the target application can be understood as the application that displays the target interface.

[0128] Understandably, the screenshot module can avoid the leakage of user privacy when directly taking screenshots of the interface through interaction with the window manager, thus ensuring the security of global annotation usage.

[0129] S405. The screenshot module sends a message to the global annotation module to indicate whether the screenshot was successful or failed.

[0130] When the screenshot module sends a message to the global annotation module indicating that the screenshot was successful, the screenshot image may also be included in the message indicating that the screenshot was successful.

[0131] Understandably, in order to ensure that the electronic device can display the screenshot image in the global annotation application when it detects that certain conditions are met, the electronic device can prioritize obtaining the screenshot image in the steps shown in S404-S405.

[0132] In a possible implementation, the electronic device may also place the steps shown in S404-S405 after S408 and before S410 for execution, and this application embodiment does not limit this.

[0133] S406, The global annotation module sends an interrupt command to the input management module.

[0134] The interrupt instruction is used to instruct the input management module to interrupt the global annotation entry logic and to prevent the processing of the first touch event. It is understood that when the input management module receives the interrupt instruction, it can interrupt the execution of at least one of the steps in S407-S418 describing the global annotation entry logic upon receiving a motion event again, and instead re-execute the steps in S401-S405 to re-determine whether the current motion event satisfies the global annotation entry logic.

[0135] For example, if the global annotation module determines based on S402 that the first touch event does not satisfy the stylus down event, and / or the global annotation module determines based on S403 that the first touch event does not satisfy the preset area, the global annotation module sends an interrupt command to the input management module.

[0136] It is understandable that the input management module of an electronic device can send the first touch event to the foreground application or other modules that can process touch events when it receives an interrupt command.

[0137] S407, The input management module sends a second touch event to the global annotation module.

[0138] The second touch event can be any event following the first touch event, such as a move event or an up event, and the information carried in the second touch event can be similar to the information carried in the first touch event in step S401, which will not be elaborated here.

[0139] For example, when an electronic device receives a movement of a stylus toward the display screen, such as the stylus moving along the display screen in any direction, the input management module can obtain the second touch event generated during the movement.

[0140] S408, the global annotation module determines whether the second touch event is a stylus move event.

[0141] The stylus move event can be an event whose source information is a stylus and whose action type information is move.

[0142] In this embodiment of the application, when the global annotation module determines that the second touch event satisfies the stylus move event, the global annotation module can execute the step shown in S410; or, when the global annotation module determines that the second touch event does not satisfy the stylus move event, the global annotation module can execute the step shown in S409.

[0143] S409, The global annotation module sends an interrupt command to the input management module.

[0144] The meaning of this interrupt instruction can be found in the description of the steps shown in S406, and will not be repeated here.

[0145] For example, if the global annotation module determines, based on S408, that the second touch event does not satisfy the stylus move event, the global annotation module sends an interrupt command to the input management module. Adaptably, upon receiving the interrupt command, the input management module can re-execute the steps shown in S401-S405 when it receives the motion event again, and re-determine whether the current motion event satisfies the global annotation entry logic.

[0146] S410, the global annotation module determines whether the screenshot was taken successfully.

[0147] In this context, screenshot failure can be understood as the user wanting to enable global annotation based on a second touch event, but the screenshot may fail because some applications (and / or some interfaces) do not support screenshots. Therefore, in order to allow users to be aware of the enabling status of global annotations in a timely manner, the global annotation module can indicate to the annotation application that it does not currently support global annotations when a screenshot failure is detected.

[0148] For example, when a user needs to make global annotations while using financial or payment applications, the specific nature of these applications means that their displayed interface is likely not compatible with screenshots. Similarly, if a user needs to make global annotations on the lock screen, that lock screen may also not support screenshots. This application does not specifically limit the applications and / or interfaces that do not support screenshots.

[0149] In this embodiment of the application, when the global annotation module determines that the screenshot was successful and receives the screenshot image based on the steps shown in S405, the global annotation module can execute the steps shown in S413; or, when the global annotation module determines that the screenshot failed based on the steps shown in S405, the global annotation module can execute the steps shown in S411.

[0150] It is understood that after the global annotation module receives the second touch event, the global annotation module can execute the steps shown in S408 and S410 simultaneously; or, the global annotation module can execute the steps shown in S408 and S410 sequentially, which is not limited in this embodiment.

[0151] S411, The global annotation module sends a message to the annotation application indicating that global annotations are not supported.

[0152] S412, Comment application prompts that the current application does not support global comments.

[0153] Accordingly, when an annotation application receives a message indicating that global annotations are not supported, the annotation application can issue a prompt and display something like: Figure 6 The interface shown (or the third interface).

[0154] For example, Figure 6 This is a schematic diagram of an interface for displaying prompt information, provided as an embodiment of this application. For example... Figure 6 As shown, the interface may include a prompt message 601 indicating that the current application does not support global annotations. This prompt message 601 can be displayed as: "The current application does not support global annotation mode." In this way, the electronic device can prompt the user to enter global annotation mode based on the prompt message, allowing the user to promptly use other methods to annotate when it is determined that the current application does not support global annotations.

[0155] In a possible implementation, the prompt message 601 can also be displayed as: "The current interface does not support global comments," which indicates that the interface displayed by the current application does not support the global comment mode. This application embodiment does not limit the specific content displayed by the prompt message 601.

[0156] The prompt information 601 can be displayed in a capsule shape or a semi-transparent shape, and the prompt information 601 can be displayed for a certain period of time, such as 2 seconds, and then canceled. The specific form of the prompt information 601 is not limited in this embodiment.

[0157] S413, The global annotation module sends a message to the window manager to instruct the display of the follow animation.

[0158] The follow-up animation (or animation) can be understood as an animation obtained by processing the screenshot image following the movement of the second touch event. Different degrees of movement in the second touch event can correspond to different degrees of scaling of the screenshot image, thereby causing the window manager to generate different follow-up animations. The message used to indicate the follow-up animation may include: data indicating the movement in the second touch event, and the screenshot image.

[0159] It is understood that the movement data in the second touch event can be the offset between the second touch event and the first touch event (or referred to as the second offset). The second touch event described in steps S407-S414 can also be referred to as the third touch event, and the second offset between the third touch event and the first event can be used for displaying follow-up animations. The second touch event can include the third touch event.

[0160] In one possible implementation, the global annotation module could also delete the screenshot image after sending a message to the window manager to instruct the display of the follow-up animation, thus saving memory usage for the global annotation module.

[0161] S414, Window Manager calls the display to show the follow-up animation.

[0162] For example, the window manager can determine the coordinates of the upper right corner of the follow animation based on the data in the second touch event that indicates the movement in the second touch event, as well as the screenshot image; based on the coordinates of the upper right corner, determine the coordinates of other vertices in the follow animation, thereby obtaining the position of the follow animation, and display a scaled-down screenshot image at the position of the follow animation.

[0163] Figure 7 This is a schematic diagram illustrating a hand-tracking animation provided in an embodiment of this application. When the electronic device receives a first touch event from a stylus, the electronic device displays as shown below. Figure 7 The interface shown in Figure a (or the first interface) has an area 701 at the tip of the stylus pen that is only used to indicate the coordinates of the first touch event and may not be actually displayed in the interface of the electronic device.

[0164] In such Figure 7In the interface shown in Figure 'a', when the electronic device receives a second touch event from the stylus, the electronic device can... Figure 7 The interface shown in 'a' will switch to... Figure 7 The interface shown in b. Figure 7 The interface shown in b, region 702, and the screenshot image can move in response to the second touch event, causing the screenshot image to shrink inward from the center point of the electronic device. Figure 7 The image that shrinks inward in the interface shown in b can be called the second image, which is smaller than the first image.

[0165] It is understandable that, such as Figure 7 In a corresponding embodiment, in the follow-through animation, as the offset between the second touch event and the first touch event increases, the screenshot image gradually shrinks inward; furthermore, the presentation effect of the follow-through animation can also be other styles, which are not limited in this embodiment.

[0166] Furthermore, S415, the global annotation module determines whether the offset B has reached the threshold B.

[0167] If the global annotation module determines that the second touch event is a stylus movement event and the screenshot is successful, the global annotation module can continue to execute the steps shown in S415.

[0168] The offset B (or first offset) can be the vertical downward offset of the second touch event compared to the location of the first touch event. For example, the global annotation module can determine the offset B based on the coordinates of the first and second touch events.

[0169] In this embodiment, when the global annotation module determines that the offset B reaches the threshold B (or is understood as the offset B being greater than or equal to the threshold B), the global annotation module can execute the steps shown in S416-S418; or, when the global annotation module determines that the offset B does not reach the threshold B (or is understood as the offset B being less than the threshold B), the global annotation module can execute the steps shown in S419 to wait for the next touch event. This threshold B may also be called the first threshold; the offset B and the threshold B may be the same or different.

[0170] In possible implementations, the offset B can also be the offset of the second touch event in the horizontal left (or right) direction compared to the position of the first touch event. This application does not limit this.

[0171] In a possible implementation, when the global annotation module determines that the offset B corresponding to a certain second touch event has not reached the threshold B, and the global annotation module receives a fourth touch event, such as an up event, the global annotation module can send an interrupt command to the input management module. The interrupt command can be referred to the description in steps S406 or S409, and will not be repeated here.

[0172] In possible implementations, the steps shown in S408, S410 and S415 can be executed simultaneously, or they can be executed separately in the order of S408, S410 and S415. This application embodiment does not limit this.

[0173] S416, The global annotation module sends a message to the window manager to indicate that the follow animation should be stopped.

[0174] Accordingly, the window manager can stop displaying the emulation animation upon receiving the message used to stop the emulation animation. For example, an electronic device can, upon determining to stop displaying the emulation animation, automatically stop it. Figure 7 In the interface shown by b, restore to Figure 7 The interface shown in 'a' causes the reduced screenshot image to gradually zoom outwards from the center point of the electronic device until it is restored to its original size. Figure 7 The interface shown in b is shown in the image.

[0175] In a possible implementation, the window manager may also send a message to the global annotation module indicating that the reticle animation was stopped successfully after the reticle animation is stopped, so that the global annotation module executes the steps shown in S417 when it receives the message indicating that the reticle animation was stopped successfully.

[0176] S417. The global annotation module sends a message to the annotation application to indicate that global annotation is allowed.

[0177] Specifically, when the offset B reaches the threshold B, the global annotation module can launch the annotation application to realize the global annotation function, regardless of whether the global annotation module receives the up event.

[0178] S418, Comment application prompt: The current application supports global comments.

[0179] For example, when the annotation application receives a message indicating that global annotations are allowed, the annotation application can display something like this: Figure 8 The interface shown in 'a'. Figure 8 This is a schematic diagram of an interface for global annotation provided in an embodiment of this application.

[0180] like Figure 8The interface shown in Figure 'a' may include: a prompt box 801 corresponding to global annotations, an indicator box (or prompt message for entering global annotations) 802 indicating entry into global annotation mode, and a toolbar 803. The prompt box 801 may include: controls for exiting global annotations, controls for sharing the current annotation, controls for saving the current annotation, and text information corresponding to global annotations. The prompt box 802 may display: "Global annotation mode has been entered." The toolbar 803 may include various brush controls, color controls, and other functional controls for adding annotations. The prompt box 802 may be displayed for a certain period of time, such as 5 seconds, before being canceled.

[0181] Furthermore, in Figure 8 As shown in the interface 'a', the electronic device can add annotations to the currently displayed screenshot image based on a stylus-triggered operation (or a second operation) on the display screen. For example, the electronic device can display an annotation after the user uses the stylus. Figure 8 The interface shown in b. Figure 8 The interface shown in b can display hand-drawn circles around the text "Touchscreen" and add handwritten annotations with "Important!".

[0182] In possible implementations, S419 and the global annotation module wait for the next touch event.

[0183] When the global annotation module determines that the offset B corresponding to any second touch event has not reached the threshold B, the global annotation module can execute the steps shown in S419 to wait for the next touch event, and when the next touch event is received, perform the judgment shown in S408-S417 on the next touch event.

[0184] Based on this, electronic devices can quickly bring up global annotations when the offset B between the first touch event and the second touch event reaches the threshold B, simplifying the method of entering global annotations and improving the user experience of using the global annotation function.

[0185] Understandable Figure 4 The judgment step described in the corresponding embodiment may not be a step actually executed by the electronic device in the program code, or it may be understood that the electronic device can execute the step corresponding to the at least one condition when it is determined that at least one condition in the judgment step is met.

[0186] exist Figure 4 Based on the corresponding embodiment, prior to S401, the electronic device can also determine whether the global annotation function introduction prompt box has been displayed when establishing a connection with the stylus, and issue a prompt if it is determined that the global annotation function introduction prompt box has not been displayed.

[0187] For example, Figure 9 This is a schematic diagram illustrating the functions of an interface provided in an embodiment of this application.

[0188] In electronic devices display such as Figure 7 In the interface shown in Figure 'a', when the electronic device establishes a connection with the stylus, the global annotation module in the electronic device can read the first parameter. This first parameter indicates whether a global annotation function introduction prompt box was displayed when the electronic device and the stylus were connected. For example, when the global annotation module reads that the first parameter is empty, the electronic device can determine that no global annotation function introduction was performed when the electronic device and the stylus were connected, and thus the electronic device displays something like... Figure 9 The interface shown (or the sixth interface).

[0189] like Figure 9 The interface shown may include: a global annotation function introduction prompt box 901 (or simply prompt box 901). The prompt box 901 may display: an animation 903 indicating entry into global annotation, a prompt message introducing the global annotation function, and a control indicating whether to cancel the display of the prompt box 901 (or it may display as an "I understand" control 902). The prompt message introducing the global annotation function may read: "Global annotation function introduction. You can trigger global annotation from any interface and use the stylus to record your thoughts."

[0190] In such Figure 9 In the interface shown, when the electronic device receives a user's trigger operation on the known control 902, the electronic device can return to, as shown in the image. Figure 7 The interface shown in 'a'.

[0191] Understandably, this is what happens when electronic devices display... Figure 9 When the prompt box 901 appears, the first parameter can be non-empty. The data in the first parameter is used to indicate whether the electronic device performed a function introduction when the stylus was established. Therefore, when the electronic device re-establishes a connection with the stylus, it can determine based on the first parameter that it does not need to perform a function introduction for the global annotation again.

[0192] Based on this, electronic devices can provide a function introduction for global annotation when establishing a connection with a stylus, making it easier for users to use the global annotation function.

[0193] exist Figure 4 Based on the corresponding embodiment, after S419, the electronic device can also determine whether the global annotation function introduction prompt box has been displayed when entering the global annotation application, and initiate a prompt when it is determined that the global annotation introduction prompt box has not been displayed when entering the global annotation application.

[0194] For example, Figure 10 This is a schematic diagram illustrating another function of the interface provided in an embodiment of this application.

[0195] In electronic devices display such as Figure 7 In the case of the interface shown in 'a', when the annotation application in the electronic device is based on Figure 4 In the corresponding embodiment, when determining that annotations are currently allowed, the annotation application can read a second parameter. This second parameter indicates whether a global annotation function introduction prompt has been displayed in the global annotation application. For example, when the annotation application reads that the second parameter is empty, the electronic device can determine that the global annotation function has not been introduced in the global annotation application, and thus the electronic device displays something like... Figure 10 The interface shown in section 'a' (or the fourth interface) may include: a prompt box 1001 corresponding to global annotations, and a prompt box 1002 introducing the global annotation function. The prompt box 1002 may include: an animation 1003 indicating entry into global annotations, a welcome message for using global annotations, a prompt introducing the function of global annotations, and a control 1004 confirming entry into global annotations. The prompt introducing the function of global annotations may display: You can trigger global annotations from any interface and record your thoughts with a stylus; the control 1004 confirming entry into global annotations may display: OK.

[0196] In such Figure 10 In the interface shown in Figure 'a', when the electronic device receives a trigger operation from the user on the control 1004 (or target control) used to determine entry into the global annotation, the electronic device can display as follows: Figure 10 The interface shown as b in the diagram (or the fifth interface) Figure 10 The content displayed in the interface shown by b can be compared with Figure 8 The interface shown in 'a' is similar and will not be described again here.

[0197] It is understood that the interface provided in the embodiments of this application is only an example and does not constitute a limitation on the embodiments of this application.

[0198] For example, based on the above Figures 4-10 In a corresponding embodiment, this application provides a method for accessing global comments. For example, Figure 11 This is a schematic diagram illustrating another method for entering global comments provided in an embodiment of this application.

[0199] like Figure 11 As shown, the method for entering global comments may include the following steps:

[0200] S1101, The electronic device displays the first interface.

[0201] The first interface can be Figure 7 The interface shown in 'a'.

[0202] S1102, In response to the first touch event in the first operation, the electronic device takes a screenshot of the first interface to obtain a first image.

[0203] The first operation is performed on the first interface, and the type of the first operation is non-handwriting type. The first touch event is the first event of the first operation, and the position of the first touch event is within a preset area. The first operation can be a trigger operation of a stylus on an electronic device, and the first image can be a screenshot image described in the embodiments of this application.

[0204] S1103, In response to the second touch event in the first operation, the electronic device launches the global annotation application.

[0205] Wherein, the first offset between the position of the second touch event and the position of the first touch event is greater than or equal to the first threshold.

[0206] S1104. In response to the electronic device launching the global annotation application, the electronic device displays a second interface.

[0207] The second interface includes the first image. The first offset can be the offset B described in the embodiments of this application, the first threshold can be the threshold B described in the embodiments of this application, and the second interface can be... Figure 8 The interface shown in 'a'.

[0208] S1105, In response to a second operation applied to the second interface, the electronic device displays handwriting on the second interface corresponding to the operation trajectory of the second operation.

[0209] Based on this, electronic devices can quickly bring up global annotations when the first offset between the location of the first touch event and the location of the second touch event is greater than or equal to a first threshold, simplifying the method of entering global annotations and improving the user experience of using the global annotation function.

[0210] The above combination Figures 4-11 The methods provided in the embodiments of this application have been described. The apparatus for executing the above methods, provided in the embodiments of this application, is described below. Figure 12 As shown, Figure 12 This is a schematic diagram of a device for entering global annotations provided in an embodiment of this application. The device for entering global annotations can be an electronic device in the embodiment of this application, or a chip or chip system within an electronic device.

[0211] like Figure 12As shown, the device 1200 for entering global annotations can be used in communication equipment, circuits, hardware components, or chips. The device includes a display unit 1201 and a processing unit 1202. The display unit 1201 supports the display steps performed by the device 1200 for entering global annotations; the processing unit 1202 supports the information processing steps performed by the device 1200 for entering global annotations.

[0212] This application provides a device 1200 for accessing global annotation. The device includes a display unit 1201 and a processing unit 1202. The display unit 1201 is used to display a first interface. In response to a first touch event in a first operation, the processing unit 1202 is used to take a screenshot of the first interface to obtain a first image. The first operation is performed on the first interface, the type of the first operation is non-handwriting, the first touch event is the first event of the first operation, and the position of the first touch event is within a preset area. In response to a second touch event in the first operation, the processing unit 1202 is also used to launch a global annotation application. The first offset between the position of the second touch event and the position of the first touch event is greater than or equal to a first threshold. In response to the electronic device launching the global annotation application, the display unit 1201 is also used to display a second interface, which includes the first image. In response to a second operation performed on the second interface, the display unit 1201 is also used to display handwriting corresponding to the operation trajectory of the second operation on the second interface.

[0213] In a possible implementation, the device 1200 for entering global annotations may further include a communication unit 1203; the communication unit 1203 is used to instruct the device 1200 for entering global annotations to perform steps such as sending and receiving data. The communication unit 1203 may be an input or output interface, pin, or circuit, etc.

[0214] In a possible embodiment, the device for accessing global annotations may further include a storage unit 1204. The processing unit 1202 and the storage unit 1204 are connected via a line. The storage unit 1204 may include one or more memories, which may be devices in one or more devices or circuits used for storing programs or data. The storage unit 1204 may exist independently and be connected to the processing unit 1202 of the device for accessing global annotations via a communication line. Alternatively, the storage unit 1204 may be integrated with the processing unit 1202.

[0215] Storage unit 1204 can store computer-executable instructions for methods in an electronic device, so that processing unit 1202 executes the methods in the above embodiments. Storage unit 1204 can be a register, cache, or RAM, etc., and storage unit 1204 can be integrated with processing unit 1202. Storage unit 1204 can be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and storage unit 1204 can be independent of processing unit 1202.

[0216] Figure 13 A schematic diagram of the hardware structure of another electronic device provided in the embodiments of this application is shown below. Figure 13 As shown, the electronic device includes a processor 1301, a communication line 1304, and at least one communication interface. Figure 13 (The example described uses communication interface 1303 as an example).

[0217] The processor 1301 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the program of the present application.

[0218] Communication line 1304 may include circuitry for transmitting information between the aforementioned components.

[0219] Communication interface 1303 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0220] Possibly, the electronic device may also include a memory 1302.

[0221] The memory 1302 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory may exist independently and be connected to the processor via communication line 1304. The memory may also be integrated with the processor.

[0222] The memory 1302 stores computer execution instructions for implementing the scheme of this application, and the processor 1301 controls the execution. The processor 1301 executes the computer execution instructions stored in the memory 1302 to implement the method provided in the embodiments of this application.

[0223] It is possible that the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0224] In a specific implementation, as one example, the processor 1301 may include one or more CPUs, for example... Figure 13 CPU0 and CPU1 in the CPU.

[0225] In a specific implementation, as one example, an electronic device may include multiple processors, for example... Figure 13 Processors 1301 and 1305 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here can refer to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0226] A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. For example, available media may include magnetic media (e.g., floppy disks, hard disks, or magnetic tapes), optical media (e.g., digital versatile discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0227] This application also provides a computer-readable storage medium. The methods described in the above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. The computer-readable medium may include computer storage media and communication media, and may also include any medium capable of transferring a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0228] As one possible design, computer-readable media may include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disc storage; computer-readable media may also include disk storage or other disk storage devices. Furthermore, any connecting cable may also be appropriately referred to as computer-readable media. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of media. As used herein, disks and optical discs include optical discs (CD), laser discs, optical discs, digital versatile discs (DVD), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers.

[0229] The above combinations should also be included within the scope of computer-readable media. The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0230] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

Claims

1. A method for accessing global annotations, applied to an electronic device, the electronic device including a display screen, characterized in that, include: Display the first interface; The system receives a first operation applied to the first interface, wherein the first operation is a stylus operation that slides inward from the upper right corner of the display screen. In response to the offset of the first operation reaching a threshold, a second interface is displayed. The second interface includes a first image obtained by taking a screenshot of the first interface and a toolbar, which includes various drawing tools.

2. The method according to claim 1, characterized in that, Before the offset in response to the first operation reaches a threshold, the method includes: In response to a first touch event in the first operation, a screenshot of the first interface is taken, wherein the first touch event is the first touch event of the first operation, and the position of the first touch event is within the preset area in the upper right corner; In response to the offset of the first operation reaching a threshold, a second interface is displayed, including: Continue to receive the second touch event from the first operation, where the second touch event is any other touch event following the first touch event; When the first offset between the second touch event and the first touch event is greater than or equal to the threshold, the global annotation application is launched, and the second interface is the application interface of the global annotation application.

3. The method according to claim 1, characterized in that, After displaying the second interface, the method further includes: In response to a second operation applied to the second interface, handwriting corresponding to the operation trajectory of the second operation is displayed on the second interface.

4. The method according to claim 1, characterized in that, Before displaying the second interface in response to the offset reaching a threshold in response to the first operation, the method further includes: In response to the first operation, an animation is displayed showing the first image shrinking to the second image.

5. The method according to claim 1, characterized in that, In response to the offset of the first operation reaching a threshold, a second interface is displayed, including: if the first interface is successfully captured, in response to the offset of the first operation reaching a threshold, a second interface is displayed. The method further includes: If taking a screenshot of the first interface fails, a third interface is displayed in response to the offset of the first operation reaching a threshold; wherein, the third interface includes: a prompt message indicating that the application corresponding to the first image does not support global annotations.

6. The method according to claim 1 or 2, characterized in that, After displaying the first interface, the method further includes: Receive a second operation, which is a touch operation of sliding inward from the upper right corner of the electronic device; If the offset of the second operation does not reach the threshold, or if the second operation is of the handwriting type, the electronic device does not launch the global annotation application.

7. The method according to any one of claims 1-6, characterized in that, The second interface also includes a prompt message indicating whether to enter the global comment.

8. The method according to any one of claims 2-7, characterized in that, The position of the preset area in the electronic device is related to the horizontal or vertical orientation of the electronic device.

9. The method according to claim 2, characterized in that, The step of taking a screenshot of the first interface to obtain a first image in response to a first touch event in the first operation includes: In response to the first touch event in the first operation, the flag bit corresponding to the first interface is queried, and the flag bit is used to indicate whether the first interface supports being screenshotted; When the flag corresponding to the first interface indicates that the first interface supports screenshots, the electronic device takes a screenshot of the first interface to obtain the first image.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: The electronic device displays a fourth interface; wherein the fourth interface includes: prompt information for introducing the functions of global annotations.

11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it causes the electronic device to perform the method as described in any one of claims 1 to 9.

12. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it causes the computer to perform the method as described in any one of claims 1 to 9.

Images