Annotation method and electronic device

Abstract

The present application provides an annotation method and an electronic device, and relates to the field of terminal technology. The method includes the steps of: displaying a first interface, the first interface including a first application interface and a second application interface displayed in a split-screen manner; receiving a first annotation operation performed by a user on the first interface; displaying a first annotation on the first interface in response to the first annotation operation; receiving a first scroll operation performed by the user on the first interface; displaying a second interface in response to the first scroll operation, the second interface including the first application interface and the second application interface displayed in a split-screen manner, the second interface being different from the first interface; generating a first annotation picture, the first annotation picture including the first annotation, the second annotation, the first interface, and the second interface. The technical solution provided in the present application can enrich the application scenarios of the annotation function and improve the flexibility of annotation performed by a user.

Description

[Technical field]

[0001] This application claims priority to Chinese Patent Application No. 202111039715.4, entitled “ANNOTATION METHOD AND ELECTRONIC DEVICE,” filed with the China National Intellectual Property Office on September 6, 2021, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of terminal technology, and in particular to an annotation method and an electronic device. [Background technology]

[0003] Electronic devices such as mobile phones and tablet computers are increasingly applied to people's work and study. For ease of use by users, some electronic devices provide annotation functions, and users may annotate content such as text or pictures by using the annotation functions.

[0004] For example, as shown in Fig. 1(a), a user may open a "Gallery" application (APP) on a tablet computer and control the tablet computer to enter an annotation mode. After entering the annotation mode, a user may annotate a picture by using a stylus on an annotation interface, as shown in Fig. 1(b). In addition, the annotation interface may provide a toolbar, and a user may adjust annotation content, etc. by using the toolbar.

[0005] However, the current application scenarios of the annotation function are limited, and its use by users is not free and flexible enough. Summary of the Invention [Problem to be solved by the invention]

[0006] In this respect, the present application provides an annotation method and an electronic device that are used to enrich the application scenarios of the annotation function, thereby improving the flexibility of annotations performed by a user. [Means for solving the problem]

[0007] In order to achieve the above object, according to a first aspect, an embodiment of the present application provides: displaying a first interface, the first interface including a first application interface and a second application interface displayed in a split screen manner; receiving a first annotation operation performed by a user on a first interface; displaying the first annotation on the first interface in response to the first annotation operation; receiving a first scrolling operation performed by a user on a first interface; displaying a second interface in response to the first scrolling operation, the second interface including a first application interface and a second application interface displayed in a split screen manner, the second interface being different from the first interface; receiving a second annotation operation performed by the user on the second interface; displaying the second annotation on the second interface in response to the second annotation operation; generating a first annotated picture, the first annotated picture including a first annotation, a second annotation, a first interface, and a second interface; The present invention provides an annotation method, including:

[0008] When displaying the first application interface and the second application interface in a split-screen manner, the electronic device may receive a user's annotation trigger operation to enter an annotation mode and display the annotation interface (i.e., the first interface), and the first application interface and the second application interface may continue to be displayed in the first interface in a split-screen manner, and an annotation layer may be loaded on the displayed application interface, and the annotation layer may be transparent, and the annotation layer may also include a toolbar.

[0009] The first annotation operation and the second annotation operation may be annotation operations performed by a user on a screen by using a stylus, a finger, or the like.

[0010] For example, when the third application interface and the fourth application interface are displayed in a horizontal split screen manner, when a user inputs an upward or downward scroll operation, the electronic device may scroll the first application interface and / or the second application interface to implement annotation in a vertical split screen scenario using a vertical scroll manner.

[0011] For example, when the third application interface and the fourth application interface are displayed in a top-bottom split screen manner, the user may input a leftward or rightward scroll operation, and the electronic device may scroll the first application interface and / or the second application interface to implement annotation in a left-right scroll manner in the top-bottom split screen scenario.

[0012] In the annotation method provided in this embodiment of the present application, the electronic device may enter an annotation mode in a split-screen scenario for a user to make annotations. In the annotation mode, the user may make annotations on the first application interface and the second application interface displayed in a split-screen manner, and the user may make annotations in a scrolling manner. Therefore, the method can enrich the application scenarios of the annotation function, improve the flexibility of the annotations performed by the user, and improve the annotation experience of the user.

[0013] In a possible implementation of the first aspect, the step of displaying the second interface in response to the first scroll operation specifically includes: The method includes switching a first application interface displayed in a split-screen manner from a first sub-interface of the first application to a second sub-interface of the first application in response to the first scroll operation.

[0014] In the above implementation, the electronic device may update the displayed interface content of the first application interface in response to a user scrolling operation, such that the user can scroll the interface content of the first application interface in the annotation mode, thereby improving the flexibility for the user to perform annotations.

[0015] In a possible implementation of the first aspect, the method includes: switching a second application interface displayed in a split-screen manner from a third sub-interface of the second application to a fourth sub-interface of the second application in response to the first scroll operation; Further includes.

[0016] In the above implementation, synchronized scrolling of interface content in the first application interface and the second application interface can be implemented, thereby improving the convenience of use for the user.

[0017] In a possible implementation of the first aspect, when the first scroll operation is an upward scroll operation, the first sub-interface in the first annotation picture is located above the second sub-interface, and the third sub-interface is located above the fourth sub-interface.

[0018] By using the above implementation, in the process of annotating, the user can view the interface content behind the first application interface and the second application interface by using an upward scroll operation.

[0019] In a possible implementation of the first aspect, if the first scrolling operation is a downward scrolling operation, the first sub-interface in the first annotation picture is located below the second sub-interface, and the third sub-interface is located below the fourth sub-interface.

[0020] By using the above implementation, in the process of annotating, the user can view the interface content before the first application interface and the second application interface by using a downward scroll operation.

[0021] In a possible implementation of the first aspect, if the first application interface is located to the left of the second application interface, the first sub-interface in the first annotation picture is located to the left of the third sub-interface, and the second sub-interface is located to the left of the fourth sub-interface; or When the first application interface is located to the right of the second application interface, the first sub-interface in the first annotation picture is located to the right of the third sub-interface, and the second sub-interface is located to the right of the fourth sub-interface.

[0022] In the above implementation, a user can perform annotations in a scrolling manner in a side-to-side split screen scenario.

[0023] In a possible implementation of the first aspect, the fourth sub-interface is a fill page, which allows the user to use more annotation space for application interfaces that do not allow scrolling.

[0024] In a possible implementation of the first aspect, the first application interface further includes a first component fixedly displayed at a bottom of the first application interface, and the method further includes: The method further includes skipping display of the first component after receiving a first scroll operation performed by the user on the first interface.

[0025] In the above implementation, components such as a menu bar that are fixedly displayed at the bottom of the first application interface are not displayed during the scrolling annotation process, thus allowing the user to see more interface content on the screen and improving the user's annotation experience.

[0026] In a possible implementation of the first aspect, the first application interface further includes a second component fixedly displayed on top of the first application interface, and the method further comprises: The method further includes skipping display of the second component after receiving a first scroll operation performed by the user on the first interface.

[0027] In the above implementation, components such as a status bar that are fixedly displayed at the top of the first application interface are not displayed during the scrolling annotation process, thus allowing the user to see more of the interface content on the screen and improving the user's annotation experience.

[0028] In a possible implementation of the first aspect, the method includes: displaying a third interface, the third interface including a third application interface and a fourth application interface displayed in a split screen manner; receiving a second scrolling operation performed by a user on a third application interface displayed on the third interface; displaying a third application interface in full screen in response to the second scrolling operation; receiving a third annotation operation performed by a user on the third application interface; displaying the third annotation on the third application interface in response to the third annotation operation; generating a second annotated picture, the second annotated picture including a third annotation and a third application interface; Further includes.

[0029] For example, when the third application interface and the fourth application interface are displayed in a vertical split screen manner, the user inputs an upward or downward scroll operation, and the electronic device may display the application interface full screen when the user scrolls the application interface, and implements annotation by a vertical scroll manner in the vertical split screen scenario.

[0030] In another example, when the third application interface and the fourth application interface are displayed in a left-right split-screen manner, the user inputs a leftward or rightward scroll operation, and the electronic device may display the application interface full screen when the user scrolls the application interface, and implements annotation via a left-right scroll manner in the left-right split-screen scenario.

[0031] By using the above implementation, the application scenarios of the annotation function can be further enriched, the flexibility of annotations performed by users can be improved, and the annotation experience of users can be improved.

[0032] In a possible implementation of the first aspect, the method includes: displaying a fourth interface, the fourth interface including a fifth application interface and a sixth application interface displayed in a split screen manner; receiving a fourth annotation operation performed by a user on the fifth application interface or the sixth application interface; displaying the fourth annotation on the fifth application interface or the sixth application interface in response to the fourth annotation operation; receiving a third scrolling operation performed by a user on the fifth application interface; displaying a fifth application interface in full screen in response to a third scrolling operation; generating a third annotation picture, the third annotation picture including a fifth application interface displayed full screen, a sixth application interface, and a fourth annotation; Further includes.

[0033] After the fifth application interface is displayed full screen, the user may add annotations to the fifth application interface, scroll the interface, etc. After the user inputs an annotation save operation, the electronic device may combine the fifth application interface displayed in the annotation process and the annotations added by the user on the fifth application interface into one annotation picture, may combine the sixth application interface displayed in the annotation process and the annotations added by the user on the sixth application interface into one annotation picture, and may then splice the two annotation pictures together for saving.

[0034] By using the above implementation, the application scenarios of the annotation function can be further enriched, the flexibility of the annotations performed by the user is improved, and the annotation experience of the user is enhanced.

[0035] In a possible implementation of the first aspect, the method includes: displaying a fifth interface, the fifth interface including a seventh application interface and an eighth application interface displayed in a split screen manner; receiving a fifth annotation operation performed by the user on the fifth interface; displaying a fifth annotation in response to a fifth annotation operation, the fifth annotation overlaying a boundary between the seventh application interface and the eighth application interface; receiving a fourth scrolling operation performed by a user on a seventh interface; displaying a prompt interface for the user to select whether to save the annotation in response to a fourth scroll operation; displaying the seventh application interface in full screen in response to a user selection operation; generating a fourth annotated picture when the selection operation is an operation of selecting not to save the annotation; or generating a fourth annotation picture and a fifth annotation picture when the selection operation is an operation of selecting to save the annotation, the fourth annotation picture including the seventh application interface displayed in full screen and the fifth annotation, and the fifth annotation picture including the fifth interface and the fifth annotation; Further includes.

[0036] By using the above implementation, the application scenarios of the annotation function can be further enriched, the flexibility of the annotations performed by the user is improved, and the annotation experience of the user is improved.

[0037] In a possible implementation of the first aspect, the method includes: displaying a sixth interface, the sixth interface including a ninth application interface displayed in full screen and a tenth application interface displayed in a floating manner on the ninth application interface; hiding the tenth application interface displayed in a floating manner or displaying the ninth application interface and the tenth application interface in a split screen manner in response to an annotation trigger operation; Further includes.

[0038] In the above implementation, the electronic device can enable a user to enter annotation mode in a floating window scenario, thereby further enriching the application scenarios of the annotation function, improving the flexibility of annotation performed by the user, and enhancing the user's annotation experience.

[0039] According to a second aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor, the memory configured to store a computer program, and the processor configured to execute, upon invocation of the computer program, a method according to the first aspect or any implementation of the first aspect.

[0040] According to a third aspect, an embodiment of the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method according to the first aspect or any implementation of the first aspect.

[0041] According to a fourth aspect, an embodiment of the present application provides a computer program product, which when executed on an electronic device, enables the electronic device to perform a method according to the first aspect or any implementation of the first aspect.

[0042] According to a fifth aspect, an embodiment of the present application provides a chip system including a processor, the processor coupled to a memory, the processor executing a computer program stored in the memory to implement the method according to the first aspect or any implementation of the first aspect. The chip system may be a single chip or may be a chip module including multiple chips.

[0043] As can be understood, for the advantageous effects of the second to fifth aspects, please refer to the relevant description of the first aspect, and the details will not be described again here. [Brief description of the drawings]

[0044] [Figure 1] FIG. 1 is a schematic diagram of an existing annotation scenario.

[0045] [Diagram 2] 1 is a schematic flowchart of an annotation method according to an embodiment of the present application.

[0046] [Diagram 3] 1 is a schematic diagram of an annotation scenario according to an embodiment of the present application;

[0047] [Figure 4] FIG. 2 is a schematic diagram of a floating menu trigger process according to an embodiment of the present application;

[0048] [Diagram 5] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 6] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 7] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 8] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 9] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 10] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 11] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 12] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 13] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 14] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 15] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 16] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application; [Figure 17] 1 is a schematic diagram of several annotation scenarios according to an embodiment of the present application;

[0049] [Figure 18] 1 is a schematic diagram of a structure of a dialogue system according to an embodiment of the present application;

[0050] [Figure 19] 2 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application.

[0051] [Figure 20] 1 is a schematic diagram of a scrolling annotation principle according to an embodiment of the present application;

[0052] [Figure 21] 1 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application.

[0053] [Figure 22] 1 is a schematic diagram of a structure of an annotation device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0054] In order to enrich the application scenarios of the annotation function and improve the flexibility of annotation performed by users, the embodiments of the present application provide a technical solution, in which an electronic device can enter an annotation mode in a multi-window scenario for users to make annotations.

[0055] The electronic device may be a display device such as a mobile phone, a tablet computer, a notebook computer or an e-book reader. This is not particularly limited in this embodiment of the present application. For convenience of explanation, this embodiment of the present application uses a tablet computer as an example in the following description.

[0056] A multi-window scenario may include two or more windows. The windows included in the multi-window scenario may be arranged horizontally (e.g., a horizontal split screen scenario), vertically (e.g., a vertical split screen scenario), or arranged in an overlapping manner (e.g., a floating window scenario). The following describes the technical solution of the present application by using the horizontal split screen scenario, the vertical split screen scenario, and the floating window scenario as examples.

[0057] First, the left-right split screen scenario will be described.

[0058] 2 is a schematic flowchart of an annotation method according to an embodiment of the present application. As shown in FIG. 2, the annotation method provided in this embodiment may include the following steps:

[0059] S110: Display a split-screen interface, where the split-screen interface includes a first application interface and a second application interface arranged horizontally.

[0060] For example, as shown in Fig. 3(a), in a split-screen interface displayed on an electronic device, a first application interface is an application interface of a "gallery" APP, and a second application interface is an application interface of a "notepad" APP, where the "gallery" APP and the "notepad" APP are displayed in a left-right split-screen manner, and the first application interface is disposed on the left side of the second application interface. The positional relationship is also used as an example for the following description.

[0061] It can be understood that the application interface of the same APP can also be displayed on the left-right split screen, that is, the APP corresponding to the first application interface and the second application interface can be the same. The user can control the first application interface and the second application interface to display the same content or different content. This display mode may also be called App multiplier. In addition, the left-right split screen may also be a bar division in the application interface of the same APP. In this embodiment, an example in which the first application interface and the second application interface are application interfaces of different APPs is used for explanation.

[0062] S120: In response to an annotation trigger operation input by a user, a first annotation interface is displayed.

[0063] As shown in (a) and (b) of Figures 3, when the split screen interface is displayed on the electronic device, a user may input an annotation trigger operation to trigger the electronic device to enter an annotation mode and display an annotation interface (referred to herein as the first annotation interface).

[0064] In any implementation, the annotation trigger operation may be an operation performed by a user on the screen of an electronic device.

[0065] Specifically, the annotation trigger operation may be a trigger operation on a target control in a floating menu.

[0066] As shown in Fig. 3(a), after establishing a connection to the stylus, the electronic device may display on the screen a floating menu 10. The floating menu 10 may provide an annotation control (i.e., a target control) and a user may trigger the electronic device to enter annotation mode by tapping the control.

[0067] FIG. 4 shows another implementation of a floating menu. As shown in FIG. 4(a), a user can slide inward from a first corner of the screen (here, the upper right corner is used as an example) to open the floating menu 10. As shown in FIG. 4(b), the floating menu 10 may be semi-ring shaped and displayed along the top and right edges of the screen. Similar to FIG. 3, the floating menu 10 may provide an annotation control, and a user may trigger the electronic device to enter an annotation mode by tapping the control. Specifically, the annotation trigger operation may include an operation of triggering the electronic device to display the floating menu and an operation of tapping the annotation control.

[0068] The operation of triggering the electronic device to display the floating menu is not limited to the above-mentioned operation of sliding inward from the top right corner of the screen, but may alternatively be another operation, for example, the user may alternatively slide outward from the screen to a screen edge area near the top right corner to trigger the electronic device to display the floating menu.

[0069] When the floating menu needs to be closed, the user may trigger the electronic device to close the floating menu by tapping an area outside the floating menu or by performing another operation.

[0070] As shown in (b) of Fig. 4, the floating menu may further provide another function control. Here, for example, a control corresponding to function A is included. When the floating menu includes a relatively large amount of function controls, some function controls may be displayed in the floating menu, for example, two function controls may be displayed and other function controls may be hidden. A user may control the function controls displayed in the floating menu by sliding upward or downward in an arch shape along the extension direction of the floating menu.

[0071] The annotation trigger operation performed by the user on the screen of the electronic device may alternatively be a preset gesture operation. For example, the user may slide inward from the second corner (e.g., the lower left corner) of the screen to trigger the electronic device to enter annotation mode, or the user may perform a target gesture operation across space to trigger the electronic device to enter annotation mode. The gesture operation is not particularly limited in this embodiment.

[0072] In this embodiment, the touch operation performed on the screen of the electronic device may be a touch operation performed by a user using a finger, or may be a touch operation performed by a user using a stylus. In this embodiment, a stylus is used as an example for explanation.

[0073] In any other implementation, the annotation trigger operation may alternatively be an operation performed by the user on the stylus.

[0074] For example, a user may trigger the electronic device to enter annotation mode by double tapping the barrel of the stylus, shaking the barrel, or pressing a target key on the stylus.

[0075] 3(b), after the electronic device enters the annotation mode, the first annotation interface displayed may include interface content 21 of the split-screen interface and an annotation layer covering the interface content 21. The annotation layer may include a transparent area 22 and a toolbar 23.

[0076] A user can see the interface content 21 underneath the annotation area through the transparent area 22 and can annotate on the interface content 21 within the transparent area 22 .

[0077] Functional options for adjusting the annotation content are arranged in the toolbar 23. Fig. 3(b) shows some example functional options, which from left to right are an option to exit annotation mode, an option to adjust line thickness, an option to adjust line color, an eraser option, and an option to save annotations.

[0078] It can be understood that the functionality options of the toolbar 23 are not limited to those shown in Fig. 3, but may include more or fewer options, which is not particularly limited in this embodiment.

[0079] The toolbar 23 may be located at the bottom of the first annotation interface by default, and the user may drag the toolbar 23 to change its position.

[0080] S130: For a first annotation interface, receive and display a first annotation added by a user.

[0081] As shown in (b) of FIG. 3, after the electronic device enters the annotation mode, the user may add an annotation (i.e., a first annotation) to the interface content 21 within the transparent area 22 by using a stylus, and the electronic device may display the annotation added by the user in real time.

[0082] In the process of adding an annotation, the user may select function options on the toolbar 23 to adjust the line thickness or color, or to erase the annotation line.

[0083] S140: In response to a scroll operation input by a user, after performing interface scrolling, a second annotation interface is displayed.

[0084] S150: For a second annotation interface, receive and display a second annotation added by a user.

[0085] S160: In response to an annotation save operation, save an interface including the first annotation and the second annotation.

[0086] In the process of making annotation, if the user wants to continue browsing the subsequent interface contents in the first application interface and the second application interface, the user may input a screen scroll operation (i.e., a scroll operation) on the screen. In this embodiment, after receiving the scroll operation input by the user, the electronic device may scroll the interface to update the interface contents displayed in the annotation interface. Then, the user may subsequently add an annotation (i.e., a second annotation) to the annotation interface obtained after scrolling (i.e., the second annotation interface). After the annotation is completed, the annotation may be saved by using an annotation save option on the toolbar 23, or the electronic device may save the application interface displayed in the annotation process and the annotations added by the user every time the user completes an annotation operation. In this embodiment, an example of a user saving an annotation by using the toolbar 23 is used for explanation.

[0087] Specifically, the scroll operation may be an upward or downward slide operation performed by a user on the screen, or a leftward or rightward slide operation performed by a user on the screen. The scroll annotation processes corresponding to various scroll operations are similar, and the main difference lies in different scroll directions. In the following, the upward slide operation is used as an example for explanation.

[0088] In any implementation, after receiving a user's scroll operation, the electronic device may synchronously display the first application interface and the second application interface in a scroll manner. In the following, some possible scroll annotation scenarios are described using examples.

[0089] Scenario 01: Referring to FIG. 5(a), the interface content of the first application interface, for example, email APP or weather APP, is scrollable. The interface content included in the application interface of these APPs is usually more than what is displayed on the screen. When the APP responds to the user's scroll operation when the interface content has not reached the bottom, the interface content can scroll up and scroll down on the application interface. The interface content of the second application interface, for example, calculator APP or compass APP, is not scrollable. The interface content included in the application interface of these APPs can usually be fully displayed on the screen, i.e., the interface content has reached the bottom. When the APP responds to the user's scroll operation, the interface content does not scroll on the application interface.

[0090] As shown in (a) of Fig. 5, the interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of the first application interface and interface content 2 of the second application interface, and the annotation content includes a first annotation. The first annotation is located in a central area of ​​the screen, and the first annotation horizontally spans interface content 1-1 and interface content 2. The position of the first annotation in the first annotation interface in subsequent scenarios 02-06 will also be described using this position as an example.

[0091] After the user inputs a scroll operation, the electronic device may scroll up the interface content of the first application interface and the interface content of the second application interface, and synchronously scroll the annotation layer. The interface content of the first application interface is scrollable, and new interface content may be displayed by the scroll process. The interface content of the second application interface is non-scrollable, that is, the interface content has reached the bottom. In this case, the bottom of the interface content of the second application interface may be filled with pre-set content. For example, the filling content may be a white page, a background page of the second application interface, etc. In this embodiment, the white page is used as an example for explanation.

[0092] As shown in FIG. 5(b), the electronic device scrolls up the interface content of the first application interface, the interface content of the second application interface, and the annotation layer. In the second annotation interface displayed after scrolling, the interface content of the first application interface may include, from top to bottom, a part of the interface content 1-1 displayed in the first annotation interface of the first application interface, and a newly displayed interface content 1-2 of the first application interface. The interface content of the second application interface may include, from top to bottom, a part of the interface content 2 displayed in the first annotation interface of the second application interface, and a filler content of the second application interface. The first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0093] After scrolling, the user may continue to add a second annotation to the second annotation interface. As shown in FIG. 5(b), the second annotation is placed on the newly displayed interface content in the second annotation interface, and the second annotation spans horizontally the area where the interface content 1-2 of the first application interface is located and the area where the fill content of the second application interface is located. It can be understood that in the second annotation interface after scrolling, the user may also add annotations to the interface content 1-1 of the first application interface and the interface content 2 of the second application interface.

[0094] After performing annotation, the user may input an annotation save operation to save the annotation interface. After receiving the user's annotation save operation, the electronic device may combine the interface content of the first application interface, the interface content of the second application interface, and the annotation of the annotation layer displayed during the entire annotation process, and then save the resulting annotation picture.

[0095] 5(c), in the saved annotation picture, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application interface and the newly displayed interface content 1-2 in the second annotation interface of the first application interface; the interface content of the second application interface may include, from top to bottom, the entire interface content 2 displayed in the first annotation interface of the second application interface and the filler content displayed in the second annotation interface. The annotation content may include, from top to bottom, the first annotation and the second annotation added by the user.

[0096] When saving the annotated picture, the electronic device may save the annotated picture in a default path, for example, save the annotated picture in an album or a memo pad. The user may also set a saving path. For example, after the user selects the annotation saving option in the toolbar 23, the electronic device may display a pop-up window for the user to set a saving path, and then the annotated picture is saved in the path set by the user.

[0097] In addition, after generating the annotated picture, the electronic device may further display a preview interface. The annotated picture may be displayed in the preview interface, for example, by using a pop-up window in a manner similar to screenshots. Also, if the user's tapping operation on the annotated picture is not received within a preset time, the annotated picture may be saved in a default path. If the user's tapping operation on the annotated picture is received within a preset time, a picture editing interface may be displayed. The picture editing interface may include the annotated picture and some editing controls, such as a delete control, a save control, a mosaic control, and a share control. The user may delete the annotated picture in the picture editing interface, or save and / or share the picture after performing related edits.

[0098] It can be understood that the newly displayed content by scrolling the interface is related to the sliding distance in the scroll operation. Therefore, the interface content displayed after scrolling in the second annotation interface may be completely or partially different from the interface content displayed before scrolling in the first annotation interface. In this embodiment, the partial difference is used as an example for explanation. In addition, for ease of understanding, the toolbar 23 is omitted in (a) and (b) of FIG. 5, and the same is true for the following accompanying drawings.

[0099] Scenario 02: Referring to (a) of FIG. 6, both the interface content of the first application interface and the interface content of the second application interface are scrollable, and the interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of the first application interface and interface content 2-1 of the second application interface.

[0100] After the user inputs a scroll operation, the electronic device may scroll up the interface content of the first application interface, the interface content of the second application interface, and the annotation layer, where both the interface content of the first application interface and the interface content of the second application interface are scrollable, and new interface content may be displayed in the scrolling process.

[0101] 6(b), in the second annotation interface displayed after scrolling, the interface content in the first application interface may include, from top to bottom, a part of interface content 1-1 displayed in the first annotation interface of the first application interface and newly displayed interface content 1-2 of the first application interface. The interface content of the second application interface may include, from top to bottom, a part of interface content 2-1 displayed in the first annotation interface of the second application interface and newly displayed interface content 2-2 of the second application interface. The first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0102] As shown in (b) of FIG. 6, the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation spans horizontally between the interface content 1-2 of the first application interface and the interface content 2-2 of the second application interface. As shown in (c) of FIG. 6, in the annotation picture saved after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application interface and the interface content 1-2 newly displayed in the second annotation interface of the first application interface. The interface content of the second application interface may include, from top to bottom, the entire interface content 2-1 displayed in the first annotation interface of the second application interface and the interface content 2-2 newly displayed in the second annotation interface of the second application interface. The annotation content may include, from top to bottom, the first annotation and the second annotation added by the user.

[0103] The application interface of some APPs includes one or more components with fixed positions. When the APP responds to a scroll operation, the positions of these components do not move accordingly. The interface content of some components is scrollable, and the interface content of some components is non-scrollable. For example, the text content of APPs such as gallery APPs, contacts APPs, and notepad APPs is scrollable, and the content in the navigation bar or menu bar is non-scrollable. Some APPs include toolbars, and the content in the toolbars is usually non-scrollable. Each component may include one or more controls. For components whose interface content is scrollable (scrollable components for short), the positions of the controls and other content within the component are movable when the APP responds to a user's scroll operation. For components whose interface content is non-scrollable (non-scrollable components for short), the positions of the controls and other content within the component are non-movable when the APP responds to a user's scroll operation.

[0104] For any APP displayed in the first annotation interface, if the APP includes at least one scrollable component with a fixed position and at least one non-scrollable component, for each non-scrollable component, if the non-scrollable component is located on the left or right side of the scrollable component, during scrolling, interface filling can be performed under the interface content of the non-scrollable component. If the non-scrollable component is located below or above the scrollable component, the interface content of the non-scrollable component may be displayed fixedly during scrolling, or the interface content of the non-scrollable component may not be displayed. During saving, the non-scrollable component may be spliced ​​on or above the interface content of the scrollable component, or the interface content of the non-scrollable component may not be saved. In this embodiment, for illustration, an example in which the interface content of the non-scrollable component is saved without being displayed is used below.

[0105] If multiple components contained in an APP are all non-scrollable components, interface filling may be performed at the bottom of the interface content of the APP.

[0106] The following continues to describe various possible scrolling annotation scenarios when an application interface contains multiple components with fixed positions.

[0107] Scenario 03: Referring to FIG. 7(a), an application interface of a first application includes component 1 and component 3 arranged horizontally, where component 3 is located to the left of component 1, and an application interface of a second application includes component 2, where the interface content of component 1 and the interface content of component 2 are both scrollable, and the interface content of component 3 is non-scrollable. For example, component 1 is a component corresponding to a content area in the first application interface, where component 1 displays text content. Component 3 is a side toolbar in the first application interface. When the first application responds to a scroll operation, the interface content in component 1 may scroll accordingly, and the interface content in component 3 remains unchanged.

[0108] The interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of component 1, interface content 2-1 of component 2, and interface content 3 of component 3, and the annotation content includes a first annotation, where the first annotation is located in a central area of ​​the screen and where the first annotation horizontally spans interface content 1-1 and interface content 2-1.

[0109] After the user inputs a scroll operation, the electronic device may scroll up the interface content of component 1, the interface content of component 2, the interface content of component 3, and the annotation layer. The interface content of component 1 and the interface content of component 2 are both scrollable, and new interface content may be displayed in the scrolling process. The interface content of component 3 is not scrollable, and interface filling may occur.

[0110] 7(b), in the second annotation interface displayed after scrolling, the interface content of the first application interface may include a left portion and a right portion of the content, where the right portion of the content may include, from top to bottom, a part of the interface content 1-1 displayed in the first annotation interface of component 1 and a newly displayed interface content 1-2 of component 1, and the left portion of the content includes, from top to bottom, a part of the interface content 3 displayed in the first annotation interface of component 3 and the filler content of component 3. The interface content of the second application interface includes, from top to bottom, a part of the interface content 2-1 displayed in the first annotation interface of the second application and a newly displayed interface content 2-2 of the second application, and the first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0111] As shown in FIG. 7B, the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation spans horizontally the interface content 1-2 of the first application interface and the interface content 2-2 of the second application interface. As shown in FIG. 7C, in the saved annotation picture after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include a left portion and a right portion of the content. The right portion of the content may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application and the interface content 1-2 newly displayed in the second annotation interface of the first application. The left portion of the content may include, from top to bottom, the entire interface content 3 displayed in the first annotation interface of the component 3 and the filler content displayed in the second annotation interface of the component 3. The interface content of the second application interface may include, from top to bottom, the entire interface content 2-1 displayed in the first annotation interface of the second application and the newly displayed interface content 2-2 in the second annotation interface of the second application, and the annotation content may include, from top to bottom, the first annotation and the second annotation added by the user.

[0112] Scenario 04: Referring to (a) of FIG. 8, the application interface of the first application includes component 1 and component 3 arranged vertically, with component 3 located below component 1. For example, component 3 is a menu bar in the first application interface. The application interface of the second application includes component 2, with the interface content of component 1 being scrollable, and the interface content of component 2 and the interface content of component 3 both not scrollable. The interface contents displayed in the first annotation interface before scrolling are interface content 1-1 of component 1, interface content 2 of component 2, and interface content 3 of component 3.

[0113] After the user inputs a scroll operation, the electronic device may scroll up the interface content of component 1, the interface content of component 2, and the annotation layer, and the interface content of component 3 is not displayed. The interface content of component 1 is scrollable, and new interface content may be displayed in the scrolling process. The interface content of component 2 is not scrollable, and interface filling may occur.

[0114] 8(b), in the second annotation interface displayed after scrolling, the interface content of the first application interface may include, from top to bottom, a part of interface content 1-1 displayed in the first annotation interface of component 1 and newly displayed interface content 1-2 of component 1. The interface content of the second application interface may include, from top to bottom, a part of interface content 2 displayed in the first annotation interface of the second application and filler content of the second application. The first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0115] As shown in (b) of FIG. 8, the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation spans horizontally the interface content 1-2 of the first application interface and the fill content of the second application interface. As shown in (c) of FIG. 8, in the annotation picture saved after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application, the interface content 1-2 newly displayed in the second annotation interface of the first application, and the entire interface content 3 displayed in the first annotation interface of the component 3. The interface content of the second application interface may include, from top to bottom, the entire interface content 2 displayed in the first annotation interface of the second application, and the fill content displayed in the second annotation interface. The annotation content may include, from top to bottom, the first annotation and the second annotation added by the user.

[0116] Scenario 05: Referring to FIG. 9(a), the application interface of a first application includes component 1 and component 3 arranged vertically, where component 3 is located below component 1. The application interface of a second application includes component 2, where the interface content of component 1 and the interface content of component 2 are both scrollable, and the interface content of component 3 is not scrollable. The interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of component 1, interface content 2-1 of component 2, and interface content 3 of component 3.

[0117] After the user inputs a scroll operation, the electronic device may scroll up the interface content of component 1, the interface content of component 2, and the annotation layer, and the interface content of component 3 is not displayed. Both the interface content of component 1 and the interface content of component 2 are scrollable, and new interface content may be displayed in the scrolling process.

[0118] 9(b), in the second annotation interface displayed after scrolling, the interface content of the first application interface may include, from top to bottom, a part of interface content 1-1 displayed in the first annotation interface of component 1 and newly displayed interface content 1-2 of component 1. The interface content of the second application interface may include, from top to bottom, a part of interface content 2-1 displayed in the first annotation interface of the second application and newly displayed interface content 2-2 of the second application. The first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0119] As shown in (b) of Fig. 9, the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation spans horizontally between the interface content 1-2 of the first application interface and the interface content 2-2 of the second application interface. As shown in (c) of Fig. 9, in the annotation picture saved after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application, the interface content 1-2 newly displayed in the second annotation interface of the first application, and the entire interface content 3 displayed in the first annotation interface of the component 3. The interface content of the second application interface may include, from top to bottom, the entire interface content 2-1 displayed in the first annotation interface of the second application, the interface content 2-2 newly displayed in the second annotation interface of the second application, and the interface content 2-3 newly displayed corresponding to the component 3 of the second application. The annotation content may include, from top to bottom, a first annotation and a second annotation added by a user.

[0120] That is, during storage, if the interface content of component 3 is spliced ​​under the interface content 1-2 of component 1, a portion of the interface content may still be displayed after the interface content 2-2 of component 2, so that the lengths of the first and second application interfaces in the stored annotation picture match. It may also be understood that interface filling may occur under the interface content 2-2 of component 2.

[0121] Scenario 06: Referring to (a) of FIG. 10, the application interface of a first application includes components 1 and 3 arranged vertically, with component 3 located below component 1. The application interface of a second application includes components 2 and 4 arranged vertically, with component 4 located below component 2. Both the interface content of component 1 and the interface content of component 2 are scrollable, and both the interface content of component 3 and the interface content of component 4 are non-scrollable. The interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of component 1, interface content 2-1 of component 2, interface content 3 of component 3, and interface content 4 of component 4.

[0122] After the user inputs a scroll operation, the electronic device may scroll up the interface content of component 1, the interface content of component 2, and the annotation layer, and the interface content of component 3 and the interface content of component 4 are not displayed. Both the interface content of component 1 and the interface content of component 2 are scrollable, and new interface content may be displayed in the scrolling process.

[0123] 10(b), in the second annotation interface displayed after scrolling, the interface content of the first application interface may include, from top to bottom, a part of interface content 1-1 displayed in the first annotation interface of component 1 and newly displayed interface content 1-2 of component 1. The interface content of the second application interface may include, from top to bottom, a part of interface content 2-1 displayed in the first annotation interface of the second application and newly displayed interface content 2-2 of the second application. The first annotation is synchronously scrolled up and moved from the central area of ​​the screen to the upper area of ​​the screen.

[0124] As shown in (b) of Fig. 10, the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation spans horizontally between the interface content 1-2 of the first application interface and the interface content 2-2 of the second application interface. As shown in (c) of Fig. 10, in the annotation picture saved after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed in the first annotation interface of the first application, the interface content 1-2 newly displayed in the second annotation interface of the first application, and the entire interface content 3 displayed in the first annotation interface of the component 3. The interface content of the second application interface may include, from top to bottom, the entire interface content 2-1 displayed in the first annotation interface of the second application, the interface content 2-2 newly displayed in the second annotation interface of the second application, and the entire interface content 4 displayed in the first annotation interface of the component 4. The annotation content may include, from top to bottom, a first annotation and a second annotation added by a user.

[0125] FIG. 10 is described using an example in which the heights of components 3 and 4 are the same. It may be understood that the heights of components 3 and 4 may alternatively be different. In this case, in order to make the annotation picture to be saved more beautiful, a part of the interface content may be newly displayed on the shorter one of components 3 and 4 so that the lengths of the first application interface and the second application interface in the annotation picture to be saved match. For example, if the height of component 3 is shorter than the height of component 4, a part of the interface content may be displayed continuously after the interface content 1-2 of component 1.

[0126] In another optional implementation, after receiving the user's scroll operation, the electronic device may display only the application interface where the scroll operation is performed in a scroll manner, and other application interfaces may not be scrolled, i.e., these application interfaces are scrolled asynchronously. During saving, the interface may be filled so that the length of the application interface matches. When the user adds an annotation, annotations that span the screen may be prohibited. In the following, Scenario 02 is used as an example for explanation.

[0127] Referring to (a) of FIG. 11, both the interface content of the first application and the interface content of the second application are scrollable, and the interface content displayed in the first annotation interface before scrolling includes interface content 1-1 of the first application and interface content 2 of the second application, and the first annotation includes annotation 11 and annotation 12, where annotation 11 is located in the middle area of ​​interface content 1-1 and annotation 12 is located in the middle area of ​​interface content 2.

[0128] The user may input a scroll operation (represented by a thick black upward arrow in the figure) in the first application interface, and the electronic device may scroll up the interface content of the first application interface. As shown in (b) of Figure 11, in the second annotation interface displayed after scrolling, the interface content of the first application interface may include, from top to bottom, a part of the interface content 1-1 of the first application displayed in the first annotation interface and a newly displayed interface content 1-2 of the first application, and the interface content of the second application interface remains unchanged.

[0129] As shown in FIG. 11(b), the user may save the annotation interface after adding the second annotation to the second annotation interface, where the second annotation includes annotation 21 and annotation 22, annotation 21 being located on interface content 1-2, and annotation 22 being located on interface content 2 and below annotation 12. As shown in FIG. 11(c), in the annotation picture saved after the electronic device receives the user's annotation save operation, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 displayed on the first annotation interface of the first application, and the interface content 1-2 newly displayed on the second annotation interface of the first application. The interface content of the second application interface may include, from top to bottom, the entire interface content 2 displayed on the first annotation interface of the second application, and the filler content of the second application. The annotation content may include annotation 11 and annotation 21 located on the first application interface, and annotation 12 and annotation 22 located on the second application interface.

[0130] Above, the asynchronous scrolling process is described by using Scenario 02 as an example. The asynchronous scrolling process in other scenarios is similar, and the details are not described again here.

[0131] Below, a top-bottom split screen scenario is described.

[0132] Similar to the left-right split screen, the application interfaces of different APPs may be displayed on the top-bottom split screen, and the application interface of the same APP may also be displayed on the top-bottom split screen. In this embodiment, this is not particularly limited. The following describes the scrolling annotation process by using an example in which the top screen displays a first application interface and the bottom screen displays a second application interface.

[0133] When the electronic device receives the user's scroll operation, the annotation added by the user may be on the annotation interface or may not be on the annotation interface. In addition, the annotation added by the user may span the screen, i.e., the annotation may span vertically between the first application interface and the second application interface, or the annotation may not span the screen, i.e., the annotation may be located within the first application interface or the second application interface. In the following, these cases are described separately.

[0134] Scenario 11: Referring to (a) of FIG. 12, when the electronic device receives the user's scroll operation, there is no annotation on the annotation interface. In this case, the electronic device may display the APP where the user's scroll operation is performed in full screen. For example, as shown in (a) and (b) of FIG. 12, after the user inputs the scroll operation in the first application interface, the electronic device displays the first application interface in full screen.

[0135] Similar to the current full-screen annotation process, the user may add annotations to the first application interface on the screen, scroll the interface, and so on. After the user inputs an annotation save operation, the electronic device may combine the interface content of the first application interface displayed in the annotation process with the annotations added by the user as an annotation picture for storage. For example, as shown in FIG. 12(b), after adding annotations to the first application interface, the user saves the annotation interface, where the annotations added by the user are located in the central area of ​​the first application interface. As shown in FIG. 12(c), after the electronic device receives the user's annotation save operation, the saved annotation picture may include the interface content of the first application interface displayed in full screen and the annotations added by the user.

[0136] Scenario 12: Referring to (a) of FIG. 13, when the electronic device receives a user's scroll operation, the annotation interface includes annotation 11 and annotation 12, annotation 11 is located in a first application interface, annotation 12 is located in a second application interface, and neither annotation 11 nor annotation 12 spans the screen. In this case, the electronic device may display the APP in which the user's scroll operation is performed in full screen. For example, as shown in (a) and (b) of FIG. 13, after the user inputs a scroll operation in the first application interface, the electronic device displays the first application interface in full screen.

[0137] The user may then add annotations to the first application interface on the screen, scroll the interface, etc. After the user inputs an annotation save operation, the electronic device may combine the first application interface displayed in the annotation process with the annotations added by the user in the first application interface into a first annotation picture, combine the second application interface displayed in the annotation process with the annotations added by the user in the second application interface into a second annotation picture, and then splice the second annotation picture to the bottom of the first annotation picture for saving. For example, as shown in (b) of FIG. 13, after adding annotation 2 in the first application interface, the user saves the annotation interface, where annotation 2 is located below annotation 11. As shown in (c) of FIG. 13, after the electronic device receives the user's annotation save operation, the interface content in the saved annotation picture may include, from top to bottom, the interface content of the first application interface displayed in full screen and the interface content of the second application interface displayed before scrolling, and the annotation content may include annotation 11 and annotation 2 located on the first application interface, and annotation 12 located on the second application interface.

[0138] Scenario 13: Referring to Fig. 14(a), when the electronic device receives a user's scroll operation on the first application interface, the annotation interface includes annotation 1, which spans the screen. In this case, the electronic device may prompt the user whether to save the current annotation content by using a pop-up window, as shown in Fig. 14(b). After the user completes the selection, the first application interface is displayed full screen, as shown in Fig. 14(c).

[0139] Similar to the above scenario, the user may add annotations to the first application interface on the screen, scroll the interface, and so on. After the user inputs the annotation save operation, the electronic device may combine the first application interface displayed in the annotation process with the annotation added by the user in the first application interface as an annotation picture for saving. In addition, if the user selects to save the current annotation content in the interface shown in FIG. 14(b), the electronic device may simultaneously combine the application interface shown in FIG. 14(a) with annotation 1 as an annotation picture for saving. For example, as shown in FIG. 14(b) and (c), after the user selects the "Yes" option and adds annotation 2 in the first application interface, the annotation interface is saved, where annotation 2 is located below annotation 1. As shown in FIG. 14(d) and (e), after the electronic device receives the user's annotation save operation, one of the saved annotation pictures may include the first application interface displayed in full screen, annotation 1, and annotation 2. Other saved annotation pictures may include the first and second application interfaces displayed from top to bottom before scrolling, and annotation 1 that spans vertically across the first and second application interfaces.

[0140] In FIG. 14(c), it can be seen that when the electronic device displays the first application interface in full screen, annotation 1 may not be displayed.

[0141] Scenario 14: Referring to Fig. 15(a), when the electronic device receives a user's scroll operation on the second application interface, the annotation interface includes annotation 1, and annotation 1 spans the screen. In this case, the electronic device may scroll up the first application interface and the second application interface, as shown in Fig. 15(b). In the scrolling process, the interface content of the first application interface shown in Fig. 15(a) is gradually hidden from top to bottom, and the new interface content is subsequently displayed in the second application interface.

[0142] As shown in FIG. 15(b), after adding annotation 2 to the interface, the user scrolls the interface again, in this case annotation 2 is located in the second application interface and is located below annotation 1. After the user scrolls the interface, as shown in FIG. 15(c), the interface content of the first application interface shown in FIG. 15(a) is completely hidden, the second application interface is presented in a full-screen display state, annotation 1 and annotation 2 are scrolled up synchronously, annotation 1 is scrolled to the top of the screen, the part located in the first application interface is hidden, and annotation 2 is scrolled to the top area of ​​the screen. After the user continues to add annotation 3, the annotation interface is saved, in this case annotation 3 is located below annotation 2. After receiving the user's annotation save operation, the electronic device may combine the application interface displayed in the annotation process with the annotation added by the user to become an annotation picture for saving. As shown in (d) of FIG. 15, the interface content in the saved annotation picture may include, from top to bottom, the first application interface, the interface content of the second application interface that was displayed before scrolling, and the interface content of the second application interface that was newly displayed after scrolling has been performed twice, and the annotation content may include, from top to bottom, annotation 1 that vertically spans the first application interface and the second application interface, and annotations 2 and 3 that are located in the second application interface.

[0143] Below we describe the floating window scenario.

[0144] As shown in (a) of Fig. 16, the electronic device displays the first application interface in full screen and displays the second application interface in a floating window. In this scenario, the user taps the annotation control in the floating menu 10. As shown in (b) of Fig. 16, after receiving the user's annotation trigger operation, the electronic device may enter the annotation mode and the floating window may be hidden.

[0145] The user may add annotations to the first application interface on the screen, scroll the interface, and so on. After the user inputs an annotation save operation, the electronic device may combine the first application interface displayed in the annotation process with the annotations added by the user as an annotation picture for saving. For example, as shown in (b) of FIG. 16, after the user adds annotation 1 in the first application interface, the interface is scrolled, in this case annotation 1 is located in the center part of the screen. As shown in (c) of FIG. 16, after receiving the user's scroll operation, the electronic device scrolls the interface content of the first application interface, and the new interface content of the first application interface is displayed in the lower part of the screen. In addition, annotation 1 is synchronously scrolled to the upper part of the screen. The user continues to add annotation 2 in the first application interface, and then saves the annotation interface, in this case annotation 2 is located on the newly displayed interface content. As shown in (d) of FIG. 16, after the electronic device receives the user's annotation save operation, the interface content in the saved annotation picture may include, from top to bottom, the interface content of the first application interface displayed before scrolling and the interface content of the first application interface newly displayed after scrolling, and the annotation content may include, from top to bottom, Annotation 1 and Annotation 2.

[0146] In another optional embodiment, as shown in (a) and (b) of FIG. 17, the electronic device displays the first application interface in full screen and displays the second application interface in a floating window. In this scenario, the user inputs an annotation trigger operation by tapping an annotation control in the floating menu 10. After entering the annotation mode, the electronic device may display the first application interface and the second application interface in a split screen manner. Here, a left-right split screen manner is used as an example. It can be understood that the screen split manner may alternatively be a top-bottom split manner during screen split.

[0147] The scrolling annotation process in the split screen scenario is similar to that in the above split screen scenario. In the following, the above scenario 01 is used as an example for illustration.

[0148] As shown in FIG. 17(b), the interface content 1-1 of the first application is scrollable, and the interface content 2 of the second application is not scrollable. After adding the annotation 1, the user inputs a scroll operation, where the annotation 1 is located in the center part of the screen and horizontally spans the first application interface and the second application interface. As shown in FIG. 17(c), after receiving the scroll operation, the electronic device scrolls up the interface content of the first application interface, the interface content of the second application interface, and the annotation layer, and performs interface filling under the interface content of the second application. In the interface obtained after scrolling, the interface content in the first application interface may include, from top to bottom, a part of the interface content 1-1 of the first application shown in FIG. 17(b) and the newly displayed interface content 1-2 of the first application. The interface content in the second application interface may include, from top to bottom, a part of the interface content 2 of the second application and the filling content of the second application. The annotation 1 is synchronously scrolled up and scrolled from the center part of the screen to the top part of the screen.

[0149] After adding the annotation 2, the user inputs an annotation save operation to save the annotation interface, where the annotation 2 spans horizontally the area where the interface content 1-2 of the first application interface is located and the area where the fill content of the second application interface is located. As shown in (d) of FIG. 17, in the saved annotation picture, the interface content of the first application interface may include, from top to bottom, the entire interface content 1-1 shown in (b) of FIG. 17 and the newly displayed interface content 1-2 of the first application shown in (c) of FIG. 17. The interface content of the second application interface may include, from top to bottom, the entire interface content 2 of the second application and the fill content of the second application. The annotation content may include, from top to bottom, the annotation 1 and annotation 2 added by the user.

[0150] In the annotation method provided in this embodiment, the electronic device can enter annotation mode in a multi-window scenario for users to make annotations, which can enrich the application scenarios of the annotation function, improve the flexibility of annotations made by users, and improve the annotation experience of users.

[0151] Based on the same concept, in the implementation of the above-mentioned method, an embodiment of the present application provides a dialogue system. Figure 18 is a schematic diagram of the structure of the dialogue system according to an embodiment of the present application. As shown in Figure 18, the dialogue system may include an electronic device 100 and a stylus 200.

[0152] The electronic device 100 may be a display device such as a mobile phone, a tablet computer, a notebook computer, or an electronic reader. The stylus 200 may be a resistive stylus 200, a capacitive stylus 200, or the like.

[0153] The electronic device 100 may communicate with the stylus 200 via a wireless communication scheme, such as Bluetooth or a wireless fidelity (Wi-Fi) network.

[0154] One or more keys may be disposed on the stylus 200, and these keys may be physical or virtual keys. By using the keys on the stylus 200, a user may control the stylus 200 to perform corresponding operations. For example, after a user taps a first key, the stylus 200 establishes a communication connection to the electronic device 100, and after a user taps a second key, the electronic device 100 enters an annotation mode.

[0155] After the electronic device 100 establishes communication with the stylus 200, a user may input a touch operation by using the stylus 200. In the annotation mode, the electronic device 100 may display a movement track formed by the stylus 200 on the screen.

[0156] The software system of the electronic device 100 may use a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present invention, the software structure of the electronic device 100 is described by using the Android system, which uses a layered architecture, as an example.

[0157] 19 is a schematic diagram of the software architecture of the electronic device 100 according to an embodiment of the present application. As shown in FIG. 19, the software system of the electronic device 100 may be divided into several layers. In some embodiments, the Android system may be divided from top to bottom into an application layer, an application framework layer, an Android Runtime and system libraries, and a kernel layer.

[0158] The application layer may include a set of applications, such as camera, gallery, calendar, phone, WLAN, Bluetooth, music, notepad, message, annotation, browser, etc., as shown in FIG.

[0159] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0160] As shown in FIG. 19, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, a screenshot module, and the like.

[0161] The window manager is configured to manage window programs. The window manager may get the size of the display, determine if there is a status bar, lock the screen, capture the screen, etc. The content provider is configured to store and retrieve data and allow the data to be accessed by the application. The data may include video, images, audio, calls and responses, browsing history and bookmarks, personal address books, etc. The view system includes visual controls, such as controls for displaying text or controls for displaying pictures. The view system may be configured to build applications. The display interface may include one or more views. For example, a display interface including a notification icon for a message may include a text display view and a picture display view. The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, and video files. The notification manager allows the application to display notification information in the status bar, which may be used to convey notification type messages that may disappear automatically after a short time without user interaction. For example, the notification manager is configured to notify of download completion, provide message prompts, etc. The notification manager may alternatively be a notification that appears in the top status bar of the system in the form of a graph or scrollbar text, for example a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window, for example text information is displayed in the status bar, an alert tone is given, the electronic device 100 vibrates, or an indicator light flashes.

[0162] The screenshot module may take a screenshot of the display interface of the electronic device 100 .

[0163] Android runtime includes core libraries and virtual machine. Android runtime is responsible for scheduling and managing the Android system. Core libraries include two parts: functions that need to be called in Java language and Android core libraries.

[0164] The application layer and the application framework layer execute in a virtual machine. The virtual machine executes the java files as binary files in the application layer and the application framework layer. The virtual machine is configured to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0165] The system library may include a number of functional modules, such as a surface manager, media libraries, a 3D graphics processing library (eg, OpenGL ES), a 2D graphics engine (eg, SGL), an input module, and the like.

[0166] The surface manager is configured to manage the display subsystem and provide a blend of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple common audio and video formats, still image files, etc. The media library may support multiple audio and video coding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing library is configured to implement 3D graphics drawing, image rendering and compositing, layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0167] The input module is configured to transfer touch events generated by touch operations input by a user to corresponding applications.

[0168] The kernel layer is a layer between the hardware and the software, and is configured to provide core system services for the Android kernel, such as security services, network services, memory management services, detection management services, and a driver model. The kernel layer may include a display driver, a camera driver, an audio driver, and a sensor driver.

[0169] After a user inputs a touch operation, a touch sensor in a hardware device may generate a corresponding hardware interrupt and send the hardware interrupt to a kernel layer. The kernel layer may encapsulate the touch operation into a touch event (e.g., an action down event, an action move event, or an action up event) and report the touch event to an upper layer APP by using an input module in a system library.

[0170] As described in the previous embodiment, after entering the annotation mode, the electronic device 100 may load an annotation layer on the application interface. In this way, the touch event generated by the scroll operation input by the user is processed by the annotation layer, and the APP located under the annotation layer cannot receive the touch event and cannot implement the interface scroll. In this embodiment, the interface scroll in the annotation mode may be implemented in a manner that simulates a touch event. To implement the scroll annotation function, a content sensor may be added to the application framework layer, and the annotation application may implement the scroll annotation process by using the content sensor. The following describes the scroll annotation principle.

[0171] Fig. 20 is a schematic diagram of the scroll annotation principle according to an embodiment of the present application. As shown in Fig. 20, after a user inputs an annotation trigger operation, the input module can transfer the touch event generated by the annotation trigger operation to the annotation application (step S1). After receiving the touch event, the annotation application can send an interface information request command to the window manager in response to the touch event (step S2) to obtain APP interface information.

[0172] After receiving the interface information request command, the window manager may transfer the currently displayed interface information of the APP (herein referred to as the target APP) to the content sensor (step S3). The content sensor may then transfer the interface information of the target APP to the annotation application (step S4).

[0173] The target APP may include one or more APPs. For example, the target APP may include a "gallery" APP and a "notepad" APP as shown in Fig. 3. The processing process of each target APP is similar, and one target APP is used here as an example for explanation.

[0174] After obtaining the interface information of the target APP, the annotation application may determine the position of the content display control in the interface of the target APP (herein referred to as the first target position) based on the interface layout information in the interface information, and then send a screenshot command to the screenshot module (step S5) to notify the screenshot module to take a screenshot of the first target position.

[0175] After completing the screenshot, the screenshot module may return the screenshot to the annotation application (step S6), which may then load an annotation layer onto the screenshot for display (step S7).

[0176] When the user adds a first annotation to the annotation layer, the input module may forward a touch event corresponding to the first annotation to the annotation application (step S8), and the annotation application may display the first annotation added by the user on the annotation layer in response to the touch event (step S9).

[0177] In addition, after obtaining the screenshot returned by the screenshot module, the annotation application may simulate a touch event corresponding to a scroll operation (scroll touch event for short), and then send the simulated scroll touch event to a window manager (step S10), and notify the window manager to forward the simulated scroll touch event to the target APP.

[0178] After the window manager transfers the simulated scrolling touch event to the target APP (step S11), the target APP may execute a corresponding scrolling process (step S12).

[0179] When the interface content is scrollable, the target APP can scroll the interface content. When the interface content is non-scrollable, i.e., when the interface content reaches the bottom, the target APP cannot scroll the interface content.

[0180] After sending the simulated scrolling touch event to the window manager, the annotation application may determine the position of the scrollable control (herein referred to as the second target position) based on the previously obtained interface information of the target APP, and then send a screenshot command to the screenshot module (step S13) to inform the screenshot module to take a screenshot of the second target position.

[0181] Specifically, the annotation application may determine whether interface content within a control is scrollable based on the control type. Scrollable controls may include RecycleView, ListView, ScrollView, PageView, WebView, etc. For example, a RecycleView control is typically used on the home page of a "gallery" APP, a ListView control is typically used in a news APP, a ScrollView control is typically used in a "contacts" APP, a PageView control is typically used in a slides APP, and a WebView control is typically used in a web page APP.

[0182] After determining the scrollable control, the annotation application may determine a location of the scrollable control as a second target location and instruct the screenshot module to take a screenshot of that location.

[0183] After completing the screenshot, the screenshot module may return the screenshot to the annotation application (step S14). The annotation application may then perform picture deduplication and picture splicing to generate a long screenshot and then update the displayed screenshot (step S15).

[0184] Specifically, the annotation application may compare the currently captured screenshot with the previously captured screenshot. If the entire interface content of the currently captured screenshot exists in the previously captured screenshot, this indicates that the interface content of the target APP has been scrolled to the bottom. In this case, for example, the interface filling may be performed at the bottom of the interface content of the target APP, for example, a white page is filled. If the previously captured screenshot does not include the entire interface content of the currently captured screenshot, the newly loaded interface content of the currently captured screenshot may be spliced ​​under the interface content in the previously captured screenshot, generating a long screenshot.

[0185] When the user inputs a scrolling operation on the annotation layer, the input module may forward a touch event corresponding to the scrolling operation to the annotation application (step S16), and in response to the touch event, the annotation application may scroll the long screenshot and the annotation layer to update the displayed interface content (step S17).

[0186] In addition, after the annotation application performs step S15, if it determines that the interface content of the target APP has not reached the bottom, i.e., the interface content of the target APP can continue to be scrolled, the annotation application returns to step S10 and updates the long screenshot, i.e., the electronic device 100 may repeatedly perform steps S10 to S15 until the preset condition is met.

[0187] The preset condition may be that the interface content of the target APP reaches the bottom or that the electronic device 100 exits the annotation mode.

[0188] When steps S10-S15 are repeatedly performed, if the preset condition is not met, the next long screenshot update process may be performed every time after the long screenshot update process is performed, or the next long screenshot update process may be performed after a preset time has elapsed every time after the long screenshot update process is performed. The preset time between each two long screenshot update processes may be the same or different. For example, the preset duration may be gradually increased.

[0189] It can be understood that when the scrolling annotation function is implemented, the window manager may also be modified so that the annotation application can directly obtain the APP interface information from the window manager. The manner of adding the content sensor to the application framework layer can reduce the modification to the original framework structure and reduce the difficulty of implementation.

[0190] The structure of the electronic device 100 will be described below.

[0191] FIG. 21 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application.

[0192] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) port 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0193] It may be understood that the structure shown in this embodiment of the present application does not constitute a specific limitation on the electronic device 100. In some other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the drawings, combine some components, separate some components, or have a different component arrangement. The components shown in the drawings may be implemented by hardware, software, or a combination of software and hardware.

[0194] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. The different processing units may be separate components or may be integrated into one or more processors.

[0195] The controller may be the central and command center of the electronic device 100. The controller may generate operation control signals based on instruction operation codes and timing signals to control instruction fetching and instruction execution.

[0196] A memory may also be disposed within the processor 110 and configured to store instructions and data. In some embodiments, the memory within the processor 110 is a cache. The memory may store instructions or data that have just been used or that have been used periodically by the processor 110. When the processor 110 needs to use the instructions or data again, the processor may retrieve the instructions or data directly from the memory. This avoids repeated accesses and reduces the latency of the processor 110, thus improving system efficiency.

[0197] In some embodiments, the processor 110 may include one or more interfaces, which may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and / or the like.

[0198] The I2C interface is a bidirectional synchronous serial bus and includes one serial data line (SDA) and one serial clock line (SCL). The I2S interface may be used for audio communication. The PCM interface may also be used for audio communication and sampling, quantization, and coding of analog signals. The UART interface is a universal serial data bus and is used for asynchronous communication. The bus may be a bidirectional communication bus. The UART interface converts data to be transmitted between serial and parallel communication. The MIPI interface may be configured to connect the processor 110 to peripheral components such as the display 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. The GPIO interface may be configured by using software, and the GPIO interface may be configured as a control signal or a data signal. The USB port 130 is a port conforming to the USB standard specification, and may be specifically a mini USB port, a micro USB port, a USB type-C port, and the like. The USB port 130 may be configured to connect to a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and a peripheral device, or to connect to a headset to play audio by using the headset. The port may be further configured to connect to another electronic device, such as an AR device.

[0199] It may be understood that the interface connection relationships between modules shown in this embodiment of the present application are merely an example for illustrative purposes and do not constitute limitations on the structure of the electronic device 100. In some other embodiments of the present application, the electronic device 100 may alternatively use interface connection methods different from those of the above-described embodiment, or a combination of multiple interface connection methods may be used.

[0200] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 may receive the charging input from the wired charger by using the USB port 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input by using a wireless charging coil of the electronic device 100. The charging management module 140 may further provide power to the electronic device by using the power management module 141 while charging the battery 142.

[0201] The power management module 141 is configured to connect to the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, etc. The power management module 141 may be configured to monitor parameters such as battery capacity, battery cycle count, and battery health status (electrical leakage and impedance). In some other embodiments, the power management module 141 may alternatively be located within the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may alternatively be located within the same component.

[0202] The wireless communication function of the electronic device 100 may be implemented by using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, a baseband processor, and the like.

[0203] Antenna 1 and Antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna of electronic device 100 may be configured to cover one or more communication frequency bands. Different antennas may be further multiplexed to improve antenna utilization. For example, Antenna 1 may be multiplexed as a diversity antenna in a wireless local area network. In some other embodiments, the antennas may be used in combination with tuning switches.

[0204] The mobile communication module 150 may provide wireless communication solutions including 2G / 3G / 4G / 5G, etc., and applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves by using the antenna 1, process the received electromagnetic waves such as filtering and amplifying, and send the electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 further amplifies the signal modulated by the modem processor and converts the signal into electromagnetic waves for emission by using the antenna 1. In some embodiments, at least some of the functional modules in the mobile communication module 150 may be located in the processor 110. In some embodiments, at least some of the functional modules in the mobile communication module 150 may be located in the same component as at least some of the modules in the processor 110.

[0205] The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then transmitted to the application processor. The application processor outputs a sound signal by using an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays an image or video by using a display 194. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent of the processor 110 and may be located in the same component as the mobile communication module 150 or another functional module.

[0206] The wireless communication module 160 may provide solutions applied to the electronic device 100 for wireless communication, including wireless local area networks (WLAN) (e.g., wireless fidelity (WI-FI) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) technology, infrared (IR) technology, etc. The wireless communication module 160 may be one or more components integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves by using the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 may further receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal to be transmitted, and convert the signal into an electromagnetic wave for emission by using the antenna 2.

[0207] In some embodiments, in electronic device 100, antenna 1 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with a network and another device by using a wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division-synchronous code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM and / or IR technologies. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GNSS), a BeiDou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0208] The electronic device 100 implements display functionality by using a GPU, a display 194, an application processor, etc. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and render images. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information. The display 194 is configured to display images, videos, etc.

[0209] The display 194 is configured to display images, videos, etc. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a mini-LED, a micro-LED, a quantum dot light emitting diodes (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0210] The electronic device 100 may implement the photography function by using an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like.

[0211] The ISP is configured to process data fed back by the camera 193. The camera 193 is configured to capture still images or video. The digital signal processor is configured to process digital signals, and may process other digital signals in addition to the digital image signal. The video codec is configured to compress or decompress digital video.

[0212] The NPU is a neural-network (NN) calculation processor. By deriving the structure of biological neural networks, such as the transmission mode between human brain neurons, the NPU can rapidly process input information and further perform self-learning continuously. Applications such as intelligent recognition of the electronic device 100, such as image recognition, face recognition, speech recognition or text understanding, can be implemented by using the NPU.

[0213] The internal memory 121 may be configured to store computer executable program code. The executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required by at least one function (e.g., a sound playback function or an image playback function), and the like. The data storage area may store data (e.g., voice data and a phone book) and the like created in the process of using the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory and may further include a non-volatile memory, such as at least one disk storage device, a flash memory device, and a universal flash storage (UFS), and the like.

[0214] The external memory interface 120 can be configured to connect to an external memory card, such as a micro SD card, to expand the storage capabilities of the electronic device 100. The external memory card communicates with the processor 110 by using the external memory interface 120 to implement data storage functions. Files, such as music and videos, are stored on the external memory card.

[0215] The electronic device 100 may implement audio functions, such as video playback or recording, by using an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like.

[0216] The audio module 170 is configured to convert digital audio information into analog audio signals for output, and is also configured to convert analog audio input into digital audio signals. The audio module 170 may be further configured to code and decode audio signals. In some embodiments, the audio module 170 may be located within the processor 110, or some functional modules of the audio module 170 may be located within the processor 110. The speaker 170A, also referred to as a "loudspeaker", is configured to convert electrical audio signals into sound signals. The receiver 170B, also referred to as an "earpiece", is configured to convert electrical audio signals into sound signals. The microphone 170C, also referred to as a "microphone" or "mic", is configured to convert sound signals into electrical signals. The headset jack 170D is configured to be connected to a wired headset. The headset jack 170D may be a USB port 130 or may be a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0217] The keys 190 include a power key, a volume key, and the like. The keys 190 may be mechanical keys or may be touch keys. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function inputs of the electronic device 100. The motor 191 may generate a vibration prompt. The motor 191 may be used for an incoming vibration prompt or may be used for touch vibration feedback. The indicator 192 may be an indicator light and may indicate a charging status and a battery level change, or may be configured to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 is configured to connect to a SIM card. The SIM card may be inserted into or pulled out of the SIM card interface 195 to implement contact and separation with the electronic device 100. The electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 may support a nano SIM card, a micro SIM card, a SIM card, and the like.

[0218] The dialogue system provided in this embodiment may implement the above-mentioned method embodiment, and the implementation principle and technical effect of the dialogue system are similar to those of the method embodiment, and the details will not be described again here.

[0219] Based on the same concept, as an implementation of the aforementioned method, an embodiment of the present application provides an annotation device. The embodiment of the device corresponds to the aforementioned method embodiment. For readability, the details in the aforementioned method embodiment are not described in detail in this device embodiment. However, it should be clear that the device in this embodiment can correspondingly implement all the contents in the aforementioned method embodiment.

[0220] 22 is a schematic diagram of the structure of an annotation device according to an embodiment of the present application. As shown in FIG. 22, the device provided in this embodiment includes: It includes a display module 210 , an input module 220 , a processing module 230 , and a communication module 240 .

[0221] The display module 210 is configured to support the electronic device in performing interface display operations in the above-described embodiments and / or other processes of the techniques described herein. The display module may be a touch screen or other hardware, or a combination of hardware and software.

[0222] The input module 220 is configured to receive user input, such as touch input, voice input, or gesture input, on a display interface of the electronic device. The input module is configured to support the electronic device in performing steps of the user's call answering operation in the above-described embodiments and / or other processes of the techniques described herein. The input module may be a touch screen or other hardware, or a combination of hardware and software.

[0223] The processing module 230 is configured to support the electronic device in performing processing operations related to the annotation process in the above-described embodiments and / or other processes of the techniques described herein.

[0224] The communications module 240 is configured to support the electronic device in performing processing operations associated with the process of communicating with the stylus in the above-described embodiments and / or other processes of the techniques described herein.

[0225] The apparatus provided in this embodiment may implement the above-mentioned method embodiment, and the implementation principle and technical effect of the apparatus are similar to those of the method embodiment, and the details will not be described again here.

[0226] Those skilled in the art may clearly understand that for convenience and simplicity of description, the division of the above functional units and modules is only used as an example for description. In practical application, as necessary, the above functions may be assigned to different functional units and modules for completion, that is, the internal structure of the device may be divided into different functional units or modules to complete all or part of the above functions. The functional units and modules in the embodiments may be integrated into one processing unit, and each of the units may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of the functional units and modules are merely for facilitating the distinction between the functional units and modules, and are not intended to limit the scope of protection of the present application. For the specific operation processes of the units and modules in the above system, please refer to the corresponding processes in the above method embodiments. Details will not be described again here.

[0227] The embodiments of the present application further provide a computer-readable storage medium, which stores a computer program, which, when executed by a processor, implements the method in the above-mentioned method embodiments.

[0228] An embodiment of the present application further provides a computer program product, which, when executed on an electronic device, enables the electronic device to perform the methods in the aforementioned method embodiments.

[0229] The embodiments of the present application further provide a chip system including a processor, where the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method in the above-mentioned method embodiments. The chip system may be a single chip, or may be a chip module including multiple chips.

[0230] All or part of the above-mentioned embodiments may be implemented by using software, hardware, firmware or any combination thereof. When implementing the embodiments using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded into a computer and executed, the procedures or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or another programmable device. The computer instructions may be stored in a computer-readable storage medium and may be transmitted by using the computer-readable storage medium. The computer instructions may be transmitted from a website, computer, server or data center to another website, computer, server or data center in a wired (e.g., coaxial cable, optical fiber or digital subscriber line) or wireless (e.g., infrared, radio or microwave) manner. The computer-readable storage medium may be any available medium accessible by a computer or a data storage device integrating one or more available media, such as a server or data center. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), semiconductor media (eg, Solid State Disks (SSDs)), and the like.

[0231] Those skilled in the art may understand that all or part of the steps of the method in the embodiment may be implemented by a computer program that instructs relevant hardware. The program may be stored in a computer-readable storage medium. When the program is executed, the steps in the method embodiment may be included. The storage medium may include any medium that can store program code, such as a ROM, a random access memory RAM, a magnetic disk, or an optical disk.

[0232] The names or numbers of steps in this application do not imply that the steps in a method procedure must be performed in the time / logical sequence indicated by the names or numbers. The sequence of execution of steps in a named or numbered procedure can be changed based on the technical objective to be achieved, provided that the same or similar technical effect can be achieved.

[0233] In the above embodiments, the description of the embodiments has a respective focus. For parts not described in detail in the embodiments, please refer to the relevant descriptions in other embodiments.

[0234] In the embodiments provided in this application, it should be understood that the disclosed apparatus / device and method may be implemented in other ways. For example, the described apparatus / device embodiments are merely examples. For example, the module or unit division is merely a logical functional division, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not implemented. In addition, the shown or described mutual couplings or direct couplings or communication connections may be implemented by using some interfaces. Indirect couplings or communication connections between apparatuses or units may be implemented in electronic, mechanical, or other forms.

[0235] It should be understood that in the description of this specification and the claims appended hereto, "comprises," "having," and any other variants are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that includes a list of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules that are not explicitly listed or that are inherent to such process, method, product, or device.

[0236] In the description of this application, unless otherwise stated, " / " indicates an "or" relationship between related objects, for example, A / B may represent A or B. In the present application, "and / or" is merely a description of the association relationship between related objects, and indicates that three relationships may exist. For example, A and / or B may represent the following three cases: the case where only A exists, the case where both A and B exist, and the case where only B exists. A and B may be singular or plural.

[0237] Additionally, in the present description, "plurality" means two or more than two. At least one of the following pieces or similar expressions means any combination of these pieces, including any combination of singular or plural pieces. For example, at least one of a, b, and c may represent a, b, c, ab, ac, bc, or abc, where a, b, and c may be singular or plural.

[0238] As used in this specification and the claims appended hereto, depending on the context, the term "if" may be interpreted as "when" or "once" or "in response to determining" or "in response to detecting." Similarly, the phrases "if it is determined that" or "if (a described condition or event) is detected" may be interpreted as meaning "once it is determined that" or "in response to determining" or "once (a described condition or event) is detected" or "in response to (a described condition or event) being detected," depending on the context.

[0239] In addition, in this specification and in the claims that follow this application, terms such as "first," "second," "third," etc. are intended to distinguish between similar objects, but do not necessarily indicate a particular order or sequence. It should be understood that data named in this manner may be interchanged in appropriate circumstances, such that the embodiments described herein may be implemented in other orders other than those illustrated or described herein.

[0240] References to "an embodiment," "some embodiments," and the like in this specification of the application indicate that one or more embodiments of the application include the particular feature, structure, or characteristic described in connection with the embodiment. Thus, statements such as "in an embodiment," "in some embodiments," "in some other embodiments," and "in other embodiments" appearing in different places in this specification are not necessarily meant to refer to the same embodiment. Instead, unless specifically emphasized otherwise, the statement means "one or more, but not all, of the embodiments."

[0241] Finally, it should be noted that the above embodiments are not intended to limit the present application, but only to describe the technical solutions of the present application. Although the present application is described in detail with reference to the above embodiments, it should be understood that those skilled in the art may make modifications to the technical solutions described in the above embodiments, or make equivalent substitutions for some or all of the technical features thereof, without departing from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of annotation executed by a processor of an electronic device, comprising: displaying a first interface, the first interface including a first application interface and a second application interface displayed in a split screen manner; receiving a first annotation operation performed by a user on the first interface; displaying a first annotation on the first interface in response to the first annotation operation; receiving a first scrolling operation performed by the user on the first interface; displaying a second interface in response to the first scrolling operation, the second interface including the first application interface and the second application interface displayed in a split screen manner, the first application interface and the second application interface in the second interface including content that is at least partially different from the first application interface and the second application interface in the first interface, respectively; receiving a second annotation operation performed by the user on the second interface; displaying a second annotation on the second interface in response to the second annotation operation; generating a first annotated picture, the first annotated picture including the first annotation, the second annotation, the first interface, and the second interface; Annotation methods, including:

2. The step of displaying the second interface in response to the first scroll operation specifically includes: switching the first application interface displayed in a split-screen manner from a first sub-interface of the first application to a second sub-interface of the first application in response to the first scroll operation; The method of claim 1 , comprising:

3. The method comprises: switching the second application interface displayed in a split-screen manner from a third sub-interface of the second application to a fourth sub-interface of the second application in response to the first scroll operation; The method of claim 2 further comprising:

4. When the first scroll operation is an upward scroll operation, the first sub-interface in the first annotation picture is located above the second sub-interface, and the third sub-interface is located above the fourth sub-interface. The method according to claim 3.

5. If the first application interface is located to the left of the second application interface, the first sub-interface in the first annotation picture is located to the left of the third sub-interface and the second sub-interface is located to the left of the fourth sub-interface; or When the first application interface is located to the right of the second application interface, the first sub-interface in the first annotation picture is located to the right of the third sub-interface, and the second sub-interface is located to the right of the fourth sub-interface. The method according to claim 4.

6. the fourth sub-interface is a fill page; The method according to claim 3.

7. The first application interface further includes a first component fixedly displayed at a bottom of the first application interface, and the method further includes: skipping display of the first component after receiving the first scrolling operation performed by the user on the first interface; The method of claim 3 further comprising:

8. The method comprises: displaying a third interface, the third interface including a third application interface and a fourth application interface displayed in a split screen manner; receiving a second scrolling operation performed by the user on the third application interface displayed on the third interface; displaying the third application interface in full screen in response to the second scrolling operation; receiving a third annotation operation performed by the user on the third application interface; displaying a third annotation on the third application interface in response to the third annotation operation; generating a second annotated picture, the second annotated picture including the third annotation and the third application interface; The method of claim 1 further comprising:

9. The method comprises: displaying a fourth interface, the fourth interface including a fifth application interface and a sixth application interface displayed in a split screen manner; receiving a fourth annotation operation performed by the user on the fifth application interface or the sixth application interface; displaying a fourth annotation on the fifth application interface or the sixth application interface in response to the fourth annotation operation; receiving a third scrolling operation performed by the user on the fifth application interface; displaying the fifth application interface in full screen in response to the third scrolling operation; The method of claim 1 further comprising:

10. The method comprises: displaying a fifth interface, the fifth interface including a seventh application interface and an eighth application interface displayed in a split screen manner; receiving a fifth annotation operation performed by the user on the fifth interface; displaying a fifth annotation in response to the fifth annotation operation, the fifth annotation overlaying a boundary between the seventh application interface and the eighth application interface; receiving a fourth scrolling operation performed by the user on the fifth interface; displaying a prompt interface for the user to select whether to save the annotation in response to the fourth scroll operation; The method of claim 1 further comprising:

11. The method comprises: displaying a sixth interface, the sixth interface including a ninth application interface displayed in full screen and a tenth application interface displayed in a floating manner on the ninth application interface; hiding the tenth application interface displayed in a floating manner or displaying the ninth application interface and the tenth application interface in a split screen manner in response to an annotation trigger operation; The method of claim 1 further comprising:

12. 12. An electronic device comprising a memory and a processor, the memory being configured to store a computer program and the processor being configured to execute the method according to any one of claims 1 to 11 when invoking the computer program.

13. A computer readable storage medium storing a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 11.

14. A computer program, when executed on an electronic device, enabling the electronic device to carry out the method according to any one of claims 1 to 11.

Images