Method and electronic device for typesetting handwriting

Abstract

The application provides a handwriting typesetting method and an electronic device. The method comprises the following steps: a first electronic device identifies a user's handwriting note in a first application program, wherein the first application program is a text editing application program; a title part in the handwriting note is obtained according to first information, wherein the first information comprises text content with a fixed format combination in the handwriting note; and a first identifier is added to the title part, the first identifier being used to distinguish the title part from a body part in the handwriting note. According to the technical scheme, the reading efficiency of the user when reviewing the handwriting note can be improved.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and more specifically, to a method and electronic device for handwritten typesetting. Background Technology

[0002] Currently, users frequently need to take notes on electronic devices. For example, during online meetings or online courses, users need to quickly take notes on electronic devices (such as learning tablets). However, because the notes taken quickly are often lengthy and extensive, they can lead to low reading efficiency when reviewing them later.

[0003] Therefore, improving the efficiency of users reviewing their notes has become a technical problem that needs to be solved. Summary of the Invention

[0004] This application provides a method and electronic device for handwritten typesetting, aiming to improve the reading efficiency of users reviewing handwritten notes.

[0005] In a first aspect, a method for handwritten text typesetting is provided, applied to a first electronic device, comprising: recognizing a user's handwritten notes in a first application, wherein the first application is a text editing application; obtaining a title portion of the handwritten notes based on first information, wherein the first information includes text content in the handwritten notes having a fixed format combination; adding a first identifier to the title portion of the handwritten notes, the first identifier being used to distinguish the title portion from the body portion of the handwritten notes.

[0006] For example, the first application can be a notepad, memo, etc.

[0007] It should be understood that the title portion of a handwritten note is the title written by the user. This handwritten note can be written by the user in real time or it can be an existing document.

[0008] For example, the first identifier can be a substrate, a rectangle, an underline, a pointing arrow, etc., and is not limited in the embodiments of this application.

[0009] For example, the first information may include content in a fixed format combination, such as numbers + punctuation marks + text (or + line break), letters + punctuation marks + text (or + line break), parentheses + text (or + line break), etc.

[0010] The first information may also include content in a preset color. For example, the first electronic device may recognize yellow or red content in a handwritten note as a title section.

[0011] The first information may also include the circled content. For example, the first electronic device recognizes the content circled in a handwritten note with a rectangle or other irregular shape as the title section.

[0012] The first information may also include highlighted content. For example, the first electronic device identifies the title portion of the highlighted content in a handwritten note. The user can use a highlighter to highlight the content of the handwritten note.

[0013] Based on the embodiments of this application, the first electronic device can recognize the user's handwritten notes in the first application and add a first identifier to the title part of the handwritten notes, thereby better distinguishing the title from the body text. In addition, the first electronic device can also generate a title table of contents composed of the title parts, thereby displaying the framework of the notes to the user.

[0014] In this way, when users review their handwritten notes, they can better distinguish between titles and body text, and quickly browse the overall framework of the notes, thereby improving their reading efficiency when reviewing handwritten notes.

[0015] In some implementations, the method further includes: generating a first heading table of contents consisting of heading sections, wherein the first heading table of contents is in a print font; and collapsing or displaying the first heading table of contents.

[0016] For example, when the first title directory is collapsed, it can be collapsed into a function button. This function button can be located in the toolbar of the first application, or it can float on the display interface of the first application, or it can be located in the sidebar. This embodiment of the application is not limited to this. Users can click the function button to display or collapse the first title directory again.

[0017] In some examples, the first electronic device recognizes a user's handwritten notes in a first application, including: in response to a user activating a layout function, the first electronic device recognizes the user's handwritten notes in the first application.

[0018] In this way, the first electronic device can enable the layout function as needed according to the user's requirements.

[0019] In other examples, this layout feature can also be kept enabled.

[0020] In some implementations, the handwritten notes include a second heading directory, which includes the user's handwritten headings. The method also includes: adding hyperlinks to the headings in the second heading directory, whereby the hyperlinks link to the corresponding body text; and, in response to the user clicking on the first target heading in the second heading directory, jumping to the corresponding body text.

[0021] It should be understood that the second heading list can be a heading list handwritten by the user in the handwritten notes to indicate the overall framework of the notes.

[0022] Based on the embodiments of this application, the first electronic device can add hyperlinks to each title section of the user's handwritten title directory, so that the user can click on the first target title in the handwritten title directory and the first electronic device can conveniently jump to the body section corresponding to the first target title, which can improve the efficiency of the user in viewing notes.

[0023] In some implementations, the method further includes: when the contents of the first heading directory and the second heading directory are different, using the first heading directory to correct the second heading directory.

[0024] In this way, the second heading table of contents, which is initially handwritten by the user, may contain typos or omissions. The first heading table of contents generated by the first electronic device can then correct the second heading table of contents to rectify some of the errors.

[0025] In some implementations, the method further includes: when the triggering condition is met, in response to the user's operation of moving the second target title in the first direction, moving the second target title and the corresponding body text in the first direction, wherein the second target title is a title in the first title table of contents, or the second target title is a title in the title section of the handwritten notes.

[0026] For example, the triggering condition may include detecting a long press operation or a double-click operation, or receiving a first indication message sent by a second electronic device, which may be used to indicate the movement of the trigger title.

[0027] For example, the second electronic device is a stylus. When the stylus detects that the user presses a button or the body of the stylus, it can send the first instruction information to the first electronic device.

[0028] Alternatively, the first instruction message may be sent when the user touches the first electronic device with the end of a stylus.

[0029] Based on the embodiments of this application, when the triggering conditions are met, the first electronic device can also reformat the target title and the corresponding body text, such as moving it up or down, thereby providing users with convenient formatting functions for handwritten notes.

[0030] In some implementations, before moving the second target title and its corresponding body text in the first direction, the method further includes: determining whether there is a third target title at the same level as the second target title below it; when there is a third target title at the same level as the second target title below it, determining the content between the second target title and the third target title as the body text corresponding to the second target title; or, when there is no third target title at the same level as the second target title below it, determining the content below the second target title as the body text corresponding to the second target title.

[0031] For example, if the second target heading is a level 2 heading, then the third target heading must also be a level 2 heading. It should be understood that this body text may also include other heading sections at a lower level than the second target heading, such as level 3 headings.

[0032] Based on the embodiments of this application, the first electronic device can determine the body text corresponding to the second target title, so that during typesetting, the title and the body text corresponding to the title can be moved as a whole to avoid layout disorder and affect the user's reading logic.

[0033] In some implementations, the method further includes: when the user raises their hand, determining whether there is a fourth target title at the same level as the second target title in the area overlapping with the body text corresponding to the second target title; when there is a fourth target title at the same level as the second target title in the overlapping area, moving the fourth target title and the body text corresponding to the fourth target title in a second direction, wherein the second direction is opposite to the first direction.

[0034] It is understandable that the body text corresponding to the fourth objective title can use the same confirmation method as the body text corresponding to the second objective title, which will not be elaborated here.

[0035] Based on the embodiments of this application, when the user raises their hand, it means that the user wants to move the content of the second target title to the position of the raised hand. Then the first electronic device can move the content of the overlapping part in another direction to complete the layout desired by the user.

[0036] In some implementations, the method also includes updating the numbering of the header section.

[0037] It should be understood that the numbering of the headings in the text needs to be updated. In addition, the numbering in the second heading table of contents handwritten by the user and the first heading table of contents generated by the first electronic device also needs to be updated.

[0038] Based on the embodiments of this application, after typesetting, the first electronic device updates the numbering of the title section, thereby making it more in line with the user's reading habits.

[0039] In some implementations, collapsing or displaying the first heading table of contents includes: collapsing and displaying the first heading table of contents when a handwritten second heading table of contents exists in the handwritten notes; or displaying the first heading table of contents when a second heading table of contents does not exist in the handwritten notes.

[0040] Based on the embodiments of this application, when a user's handwritten notes contain a handwritten second heading table of contents, the first electronic device can fold up the first heading table of contents. When the handwritten notes do not contain a second heading table of contents, the first electronic device can display the first heading table of contents, thereby making the handwritten notes more in line with the user's reading habits.

[0041] In some implementations, the method further includes: editing the title portion of the identified handwritten notes in response to detecting a user's editing action.

[0042] For example, the editing operation could be a user long-pressing the title section and editing it, or it could be a user opening the edit button in the toolbar and editing the title.

[0043] It should be understood that the editing may include adjusting the scope of the heading section, deleting the heading, or adjusting the way the heading section is identified.

[0044] Based on the embodiments of this application, the user can also edit the title portion recognized by the first electronic device to correct any inaccuracies in the recognition. Furthermore, this enhances the flexibility of the first electronic device in recognizing the title portion.

[0045] In some implementations, the first information also includes: content in a preset color; content circled; or content highlighted.

[0046] In other examples, the first information may also include other content, which is not limited in the embodiments of this application.

[0047] Secondly, a method for handwritten typesetting is provided, including modules for implementing the method described in the first aspect and any possible implementation thereof.

[0048] Thirdly, an electronic device is provided, comprising: one or more processors; one or more memories; said one or more memories storing one or more programs that, when executed by said one or more processors, cause the method described in the first aspect and any possible implementation thereof to be performed.

[0049] Fourthly, a chip is provided, the chip including a processor and a communication interface, the communication interface being used to receive a signal and transmit the signal to the processor, the processor processing the signal such that the method described in the first aspect and any possible implementation thereof is performed.

[0050] Fifthly, a readable storage medium is provided, wherein instructions are stored therein, which, when executed on an electronic device, cause the method described in the first aspect and any possible implementation thereof to be performed.

[0051] In a sixth aspect, a program product is provided, the program product comprising program code that, when run on an electronic device, causes the method described in the first aspect and any possible implementation thereof to be executed. Attached Figure Description

[0052] Figure 1 A schematic diagram of the structure of the electronic device 100 is shown.

[0053] Figure 2 This is a schematic diagram of a set of GUIs provided in the embodiments of this application.

[0054] Figure 3 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0055] Figure 4 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0056] Figure 5 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0057] Figure 6 This is a schematic diagram illustrating the division of the area corresponding to the title, provided in an embodiment of this application.

[0058] Figure 7 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0059] Figure 8 This is a schematic flowchart illustrating the identification of a title portion provided in an embodiment of this application.

[0060] Figure 9 This is another schematic flowchart for identifying the title portion provided in an embodiment of this application.

[0061] Figure 10 This is a schematic flowchart illustrating a method of quick navigation via a title, as provided in an embodiment of this application.

[0062] Figure 11 This is a schematic flowchart illustrating a typesetting update provided in an embodiment of this application.

[0063] Figure 12 This is a schematic flowchart of a handwritten typesetting method provided in an embodiment of this application.

[0064] Figure 13 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0065] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0066] The methods in this application embodiment can be applied to smartphones, wearable devices, smart TVs, tablets, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, in-vehicle devices, foldable phones, foldable PCs, Internet of Things (IoT) devices, augmented reality devices, virtual reality devices, etc.

[0067] Figure 1 A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include processor 110, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, camera 193, display screen 194, accelerometer 180E, and touch sensor 180K, etc.

[0068] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0069] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0070] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0071] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0072] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), ultra-wideband (UWB), and star-flash technology.

[0073] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.

[0074] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0075] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0076] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0077] The ISP is used to process the data fed back by camera 193. Camera 193 is used to capture still images or videos.

[0078] Touch sensor 180K can be disposed on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen". Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be disposed on the surface of electronic device 100, in a different location than display screen 194.

[0079] Before introducing the technical solutions of the embodiments of this application, some technical terms that may be involved in this application will be introduced as follows.

[0080] Handwritten fonts, also known as handwritten characters, can include fonts, graphics, and other content written by a user using a stylus. For example, in this embodiment of the application, a user can use a stylus to record classroom notes or study notes on an electronic device, and the resulting handwriting can be called a handwritten font.

[0081] Currently, users frequently need to take notes on electronic devices. For example, during online meetings or online courses, users need to quickly take notes on electronic devices (such as learning tablets). However, because the notes taken quickly are often lengthy and extensive, they can lead to low reading efficiency when reviewing them later.

[0082] In view of this, embodiments of this application provide a method and electronic device for handwritten typesetting, in order to improve the reading efficiency of users when reviewing notes later.

[0083] The following will combine Figures 2-7 The graphical user interfaces (GUIs) shown in the illustrations illustrate the technical solutions in the embodiments of this application.

[0084] For example, Figure 2 This is a schematic diagram of a set of GUIs provided in the embodiments of this application. Among them, from Figure 2 (a) to (b) in the figure show the process by which the electronic device 200 hierarchically divides the notes.

[0085] See Figure 2 In (a), the GUI can be the desktop 210 of the electronic device 200. The desktop 210 can include multiple applications (Apps) in the electronic device 200, such as Huawei Video App, Notes App, etc.

[0086] For example, when the electronic device 200 detects that the user has clicked the icon 211 of the note-taking app, it can display something like this: Figure 2 The GUI shown in (b) is shown in the image.

[0087] See Figure 2 In (b), the GUI can be a note display interface 220. The display interface 220 may include a toolbar, which may include an artificial intelligence (AI) title function control 221, a writing function control, an eraser function control, and a table of contents function control 224, etc. The display interface 220 may also include a note display area 223.

[0088] The functional control 221 may include the text content "AI Title" and a settings control 222 for controlling whether the AI ​​title is enabled. It should be understood that... Figure 2 In (b) of this example, the AI ​​title is in the "on" state (or "set" state). In this case, as the user takes notes, the electronic device can recognize the titles in the user's notes and add identifiers to the titles so that the user can clearly distinguish the titles from other content.

[0089] It should be understood that after the electronic device 200 recognizes the title in the notes and adds an identifier to the title, it can also generate a table of contents function control 224 for the title table of contents B in the toolbar.

[0090] In some cases, when a user's handwritten heading list A exists in their handwritten notes, the heading list B generated by the electronic device 200 is collapsed by default. The electronic device can display the heading list B after the user clicks the heading list function control 224.

[0091] In some cases, if the handwritten headings A are not present in the user's handwritten notes, the headings B generated by the electronic device 200 can be displayed by default, meaning the user can directly browse the headings B generated by the electronic device 200.

[0092] In other examples, the directory function control 224 may also be located in other positions, such as floating on the display area 223, which is not limited in this embodiment.

[0093] In other examples, the function control 221 can also be replaced by a one-time function control A. For example, when a user clicks function control A on display interface 220, the electronic device can perform one-time recognition of the title in the user's handwritten notes and add an identifier to the title, or perform a layout function. In this way, the user can click function control A when needed, and the electronic device can perform layout as required.

[0094] It should be understood that the AI ​​title can also be called intelligent title, intelligent layout, automatic layout, title recognition, intelligent arrangement, refresh layout, etc., and the embodiments in this application are not limited thereto.

[0095] In some implementations, the electronic device may include a handwriting recognition engine. This engine allows the device to recognize the user's handwriting and thus identify the title. For example, the handwriting recognition engine might scan the entire handwritten note line by line, generating a newline character at the end of each line.

[0096] It should be understood that electronic devices can determine the headings in notes in the following ways.

[0097] Method 1: The content and order of the text content combination are numbers + text.

[0098] For example, if the text in a line is "1 robot", then that content "1 robot" can be identified as the title.

[0099] Method 2: The content and order of the text content combination are numbers + punctuation marks + text.

[0100] It should be understood that the punctuation marks may include “、”, “.”, or “:”, etc., and the Chinese or English format of the punctuation marks is not limited in the embodiments of this application.

[0101] For example, if the text in a line is “1. Robot”, then the content “1. Robot” can be identified as the title.

[0102] Method 3: The text content consists of special symbols and numbers.

[0103] For example, if the text content is combined into "-robot", then the content "-robot" can be identified as the title.

[0104] Method 4: The text content is a combination of uppercase Chinese numerals, punctuation marks, and text.

[0105] For example, if the text content is combined to form "I. Robot", then the content "I. Robot" can be identified as the title.

[0106] It is understood that the punctuation mark can also be "." or ":", etc., and this application embodiment does not limit it in this way.

[0107] Method 5: Combine text content as brackets (including numbers) + text. Alternatively, combine text content as brackets (including numbers) + punctuation marks + text.

[0108] It should be understood that the number can be Arabic numerals, simplified or traditional Chinese numerals, or Roman numerals.

[0109] For example, if the text content is combined as “(1) Robot” or “(1), Robot”, then the content “(1) Robot” or “(1), Robot” can be identified as the title.

[0110] It is understood that the specific language type of the text is not limited in the embodiments of this application, such as English, Chinese, French, etc.

[0111] Method Six: The text content consists of English letters + words. Alternatively, the text content consists of English letters + punctuation marks + words.

[0112] For example, if the text content is combined into "a robot" or "a, robot", then the content "a robot" or "a, robot" can be identified as the title.

[0113] Method 7: Combine text content into numbers.

[0114] For example, if the text content is combined into "1-1" and "1-2", then the content can be identified as a title.

[0115] Method 8: Use the preset color for the font.

[0116] Electronic devices can provide the function of recognizing the font of a preset color in notes as a title. The preset color can be selected by the user or it can be the system default. This application embodiment does not limit this.

[0117] For example, a user can choose to recognize red text in a note as a title. Alternatively, a user can choose to recognize green text in a note as a title.

[0118] Method Nine: Combining text content into user-selected content. For example, if a user's notes contain manually selected content, such as content selected using rectangles, circles, or irregular shapes, the electronic device can recognize the selected content as a title.

[0119] Method 10: Combine text content into highlighted content.

[0120] It is understandable that in methods one through ten above, a newline character may be included at the end of the text content combination.

[0121] For example, if a user highlights certain content using a highlighter in a color such as red, yellow, or orange, the electronic device can recognize the highlighted content as a title.

[0122] It should be understood that for methods eight to ten described above, the electronic device can provide the user with functional controls to select the aforementioned functions. For example, the toolbar of the display interface 220 may include functional control 1. In response to the user clicking on functional control 1, the electronic device can display the functional options for methods eight to ten described above. The user can select the aforementioned functions, and then the electronic device can identify the corresponding title based on the user's selection.

[0123] It should be understood that the above methods are merely examples. In other examples, electronic devices may use other methods to determine the titles in the notes, and this application embodiment does not limit this.

[0124] After the electronic device 200 determines the titles in the notes, it can add markers to the title sections to indicate to the user which parts belong to the titles.

[0125] See also Figure 2 In (b) of this embodiment, the electronic device may add a background to the title so that the title can be highlighted. For example, the color of the background may be yellow, green, gray, etc., which is not limited in this application.

[0126] In other examples, electronic devices can also add backgrounds of different colors for different levels of headings. For example, a first-level heading can have a background of a first color, and a second-level heading can have a background of a second color, where the first and second colors are different. For example, the first color could be yellow, and the second color could be red.

[0127] In other examples, the electronic device can also add different colored backgrounds to the numbering and text portions in the title. For example, for the handwritten title "1. Title A1", the electronic device can add a first-colored background to the "1." and a second-colored background to "Title A1", where the first and second colors are different.

[0128] It should be understood that the shape of the substrate mentioned in the title is not limited in the embodiments of this application. For example, the substrate may be rectangular, circular, elliptical, line segment, or other irregular shapes.

[0129] It is understandable that user-recorded notes may contain handwritten headings and headings within the main text. For both headings in the headings and headings in the main text, electronic devices need to add a substrate.

[0130] In other examples, electronic devices can use other methods to distinguish headings from other content. For instance, they can bold the heading or add underlines to make it easier for users to differentiate between the heading and the body text.

[0131] Alternatively, electronic devices can add a rectangle to the title section, for example, by using a rectangle to frame the title section, so that users can better distinguish between the title and the body text.

[0132] It should be understood that electronic devices may also use other methods to identify the title section, which is not limited in the embodiments of this application.

[0133] Based on the embodiments of this application, the note-taking app of an electronic device can provide an AI title function, which can identify the title part in the user's notes in real time and add a mark to the title part so that the user can quickly distinguish the title part from the body part, thereby improving the reading efficiency of the user when reviewing the notes later.

[0134] In other examples, if the electronic device 200 discovers errors or omissions in the title table of contents recorded by the user by recognizing the titles of the main text, it can update the title table of contents synchronously.

[0135] In other examples, this AI title feature can also be a system capability of the electronic device 200. For instance, users can enable the AI ​​title feature in the settings of the electronic device 200. This allows the electronic device to use the AI ​​title feature when using apps with text editing capabilities (such as note-taking apps, meeting apps, and text editing apps).

[0136] In other examples, the electronic device 200 may also provide the user with the ability to edit the recognized title.

[0137] In some examples, when the electronic device 200 detects a user's long-press action on a title, it can display a rectangle for editing the recognized title. This rectangle can enclose the title. The user can edit the title box, for example, by increasing or decreasing the selected area; the content within the rectangle can then be considered the title.

[0138] Alternatively, the rectangle could include a delete button, which, when clicked by the user, removes the title tag added to that section of text. This allows users to easily correct any erroneous titles detected by the electronic device.

[0139] Alternatively, the electronic device 200 can also display function options for the user to select the title recognition range. For example, these function options may include content in a preset color, highlighted content, and circled content. The user can adjust the way the electronic device 200 recognizes titles by selecting the above options.

[0140] It should be understood that the long press on the title can be replaced by other operations, such as double-clicking or triple-clicking.

[0141] The rectangular frame can also be replaced by an elliptical frame or other irregular shapes, which are not limited in the embodiments of this application.

[0142] In other examples, the toolbar of the electronic device 200 may also include an edit button for editing the recognized title. When the user clicks the edit button, the electronic device 200 may display a rectangle for editing the recognized title. It should be understood that the specific editing process for the user can be found in the relevant description above.

[0143] In some cases, such as when a user is taking notes in real time without enabling the AI ​​title feature, the electronic device can still recognize the title portion of the existing notes when reviewing them later, even if the user has enabled the AI ​​title feature. The following will combine... Figure 3 This technical solution will be introduced.

[0144] For example, Figure 3This is a schematic diagram of another set of GUIs provided in the embodiments of this application. From... Figure 3 (a) to (b) show the process by which an electronic device recognizes the title in a note based on the user's actions.

[0145] It should be understood that Figure 3 (a) in the text can be found in [reference 1]. Figure 2 The difference between (b) and the description in the previous section is that the function control 221 of the AI ​​title function is in an unset state, and the electronic device has not yet recognized the title part in the notes.

[0146] For example, when the electronic device 200 detects that a user clicks the settings button 222 in the function control 221, it can display something like this. Figure 3 The GUI shown in (b) is shown in the image.

[0147] It should be understood that Figure 3 (b) can be found in Figure 2 For the sake of brevity, the relevant descriptions in (b) will not be repeated here.

[0148] Based on the embodiments of this application, the note-taking app of the electronic device can provide an AI title function. For existing note content, when the electronic device detects that the user has turned on the AI ​​title function, it can also identify the title part and add a mark to the title part so that the user can quickly distinguish the title part from the body part, thereby improving the reading efficiency of the user when reviewing the notes later.

[0149] In some cases, electronic devices can also add hyperlinks to the headings, allowing users to quickly locate the notes they want to view. The following will combine... Figure 4 This technical solution will be introduced.

[0150] For example, Figure 4 This is a schematic diagram of another set of GUIs provided in the embodiments of this application. Among them, from Figure 4 (a) through (c) in the image illustrate the process of a user quickly viewing notes on an electronic device.

[0151] See Figure 4 In (a), the GUI can be the display interface 230 of a note-taking app on an electronic device. The display interface 230 may include a toolbar and a note section.

[0152] It should be understood that this toolbar section can be found in the relevant description above.

[0153] This note section can include a table of contents with headings and the main body of the notes.

[0154] It should be understood that after recognizing the title in the notes, the electronic device 200 can add a hyperlink to the title so that the electronic device can quickly jump to the corresponding note location based on the user's click operation.

[0155] For example, if the headings and the body text of a note share the same target heading, the electronic device can add a hyperlink to the target heading in the headings and the hyperlink can link to the location of the target heading in the body text.

[0156] For example, when the electronic device 200 detects that a user has clicked on the target title "3, Title A3" in the title directory section, it can display the area. Figure 4 The GUI shown in (b) is shown in the image.

[0157] See Figure 4 In (b), the target title "3, Title A3" can display a selected state in response to a user's click operation. For example, the electronic device 200 can add a control to the target title "3, Title A3" so that when the electronic device 200 detects that the user clicks on the target title "3, Title A3", it can display the selected control so that the user can determine which title has been selected.

[0158] Afterwards, the electronic device 200 can display as follows: Figure 4 The GUI shown in (c) is shown in the image.

[0159] See Figure 4 In step (c), the electronic device 200 can jump to the display interface 240. The display interface 240 may include the target title "3, Title A3" of the body of the notes and the corresponding content.

[0160] It is understood that the display interface 240 only needs to be able to display the target title "3, Title A3". The target title "3, Title A3" can be displayed at a preset position on the display interface 240. The preset position can be the top, middle or bottom of the display interface 240, or other positions. This application embodiment does not limit this.

[0161] It should be understood that the target title "3, Title A3" in the display interface 240 can also display the effect of the selected control, so that the user can determine which title they have selected.

[0162] In other examples, the target title "3, Title A3" in the display interface 240 can also be displayed with other effects, such as adding a positioning mark, displaying a fixed color, blinking, or highlighting.

[0163] Based on the embodiments of this application, electronic devices can also add hyperlinks to the title section, so that users can quickly locate the note content they want to view.

[0164] In some situations, users may be in a rush when taking notes, and there may be a need to reformat the format. The following will combine... Figure 5 This technical solution will be introduced.

[0165] For example, Figure 5 This is a schematic diagram of another set of GUIs provided in the embodiments of this application. Among them, from Figure 5 (a) through (c) show the process by which an electronic device rearranges its layout based on user input.

[0166] See Figure 5 In (a), the GUI can be the display interface 250 of a note-taking app on the electronic device 200. The display interface 250 may include a toolbar and the main body of the notes, wherein the main body may include multiple headings at the same level.

[0167] In some cases, users may need to adjust the layout order of certain headings. For example, when electronic device 200 detects that the trigger condition for the target heading "2, Heading A2" is met, it can display something like this: Figure 5 The GUI shown in (b) is shown in the image.

[0168] For example, the triggering condition can be a long press operation, or a click operation of the stylus tip, or a click operation of the stylus tip or the user's finger after receiving the instruction information for indicating movement. The specific conditions of the preset condition are not limited in the embodiments of this application.

[0169] When the stylus detects that the user clicks a button on the stylus or presses the pen body, it can send instruction information to the electronic device 200 to indicate movement.

[0170] See Figure 5 In (b), the target title “2, Title A2” and the titles at the same level as the target title “2, Title A2” and their contents can form a whole.

[0171] For example, the portion between heading "1. Heading A1" and target heading "2. Heading A2" can form a whole, corresponding to area 251; the portion between target heading "2. Heading A2" and heading "3. Heading A3" can form a whole, corresponding to area 252; and the portion between heading "3. Heading A3" and the next heading at the same level can form a whole, corresponding to area 253. Alternatively, if there are no headings at the same level below heading "3. Heading A3" until the end of the notes, then the content below heading "3. Heading A3" can form a whole, corresponding to area 253.

[0172] It is understandable that each heading at the same level as the target heading "2, Heading A2" can have its corresponding area determined in the above manner.

[0173] When the electronic device 200 detects that the user has moved the area 252 upwards, and the area partially overlaps with the area 251, it can display the following: Figure 5 The GUI shown in (c) is shown in the image.

[0174] It should be understood that users can long-press the target title "2, Title A2" to access... Figure 5 When the GUI is shown in (b), the finger continues to move upwards, and the user's finger can remain on the display screen of the electronic device 200 during this process.

[0175] In other examples, the user can long-press the target title "2, Title A2", and the electronic device 200 can display something like this. Figure 5 The GUI shown in (b) can also include a function control for determining the end of editing. After the user moves the corresponding area and clicks the function control to indicate the end of editing, the following can be displayed: Figure 5 The GUI is shown in (c). During this process, the user's finger can leave the display screen of the electronic device 200.

[0176] See Figure 5 In (c), in the display interface 270 of the electronic device 200, the area 252 can be located above the area 251, that is, the layout has changed.

[0177] Furthermore, after the layout changes, the electronic device 200 can update the heading numbers according to the revised layout. For example, after the layout is reformatted, the target heading "Heading A2" in the display interface 270 becomes numbered "1", and the original heading "Heading A1" becomes numbered "2", thus making the change conform to the user's reading habits.

[0178] Understandably, if a table of contents exists after the main text has been reformatted, it also needs to be reformatted to ensure that the table of contents is in the same order as the main text.

[0179] Based on the embodiments of this application, when a user needs to reformat the text, the notes can be easily reformatted by long-pressing and moving the title, thereby better meeting the user's reformatting needs.

[0180] In other examples, when an electronic device determines the area corresponding to a title, if the notes contain dividing lines drawn by the user when taking the notes, the corresponding area may not include those dividing lines.

[0181] See Figure 6 , Figure 6 This is a schematic diagram illustrating the division of the area corresponding to the title, provided in an embodiment of this application. For example... Figure 6 As shown, the user's notes contain dividing lines, and to the right of the dividing lines are multiple headings, such as "2.2, Heading E1" and "2.3, Heading E2".

[0182] When the user long-presses "2.2, Title E1", the electronic device can divide the notes with the dividing line segment when it determines the area corresponding to "2.2, Title E1". For example, the dividing line segment can be used as the starting point of the area, but the dividing line segment is not included. The electronic device will not divide the area from the left side of the dividing line segment, that is, the divided area does not include the dividing line segment.

[0183] See also Figure 6 When formatting, the area included in the headings "2.2, Heading E1" can be designated as Area 1, and the area included in the headings "2.3, Heading E2" can be designated as Area 2.

[0184] In this way, electronic devices can recognize the special segments in a user's notes, avoiding layout issues that disrupt the logical flow of the user's note-taking process.

[0185] In some cases, if the user's continued notes do not include a heading or target section, the electronic device can also generate a table of contents by recognizing the headings in the main text. This will be discussed in the following section. Figure 7 This technical solution will be introduced.

[0186] For example, Figure 7 This is a schematic diagram of another set of GUIs provided in the embodiments of this application. Among them, from Figure 7 (a) through (c) show the process by which an electronic device generates and typesets the title table of contents.

[0187] It should be understood that Figure 7(a) in the text can be found in [reference 1]. Figure 3 The difference between the description in (a) is that the title table of contents is not included in the display interface 280.

[0188] For example, when the electronic device detects that the user has clicked the settings control 222 in the function control 221, it can display something like this. Figure 7 The GUI described in (b) of the document.

[0189] See Figure 7 In (b), the display interface 280 of the electronic device 200 may include a generated title directory section 281.

[0190] Understandably, when an electronic device detects that a user has enabled the AI ​​title function, it can identify the main body of the notes and other title sections, and generate a title table of contents based on the content of the title sections 281.

[0191] For example, if a user needs to reformat the text, they can adjust the position of the headings in the heading table of contents section 281 to reformat the main text.

[0192] It should be understood that electronic devices can also directly jump to the corresponding position of the target title in the main text based on the user's click on the target title in the title table of contents, so that the user can quickly view the notes they want to read.

[0193] For example, when the electronic device 200 detects that a user has long-pressed the target title "2. Title A2" and swiped upwards, the target title "2. Title A2" and the next-level title "2.1 Title D2" can both slide along with the user's swipe. The electronic device 200 can then display the following: Figure 7 The GUI shown in (c) is shown in the image.

[0194] See Figure 7 In section (c), the heading "Heading A2" and its next-level heading "Heading D2" in the heading section 281 are moved before the original heading "Heading A1" and its next-level heading "Heading B1", and the heading numbers are updated accordingly. Furthermore, the content of the main text and the heading numbering are also updated according to the order in the heading section 281.

[0195] In other examples, if the electronic device detects that the user has reformatted the body text, the electronic device also needs to update the heading section 281 synchronously.

[0196] In other examples, if the electronic device detects a misordered numbering of headings when generating the table heading section 281 by recognizing the headings in the main text, it can update the heading numbers. Alternatively, it can reformat the main text based on the heading numbers and then update the table heading section 281 again. This ensures the generated table heading section conforms to the user's reading habits and can also correct user errors to some extent.

[0197] Based on the embodiments of this application, the electronic device can generate a corresponding title table of contents based on the main text of the user's notes, and the user can move the titles in the title table of contents to reformat the main text, thereby simplifying the user's operation.

[0198] The following will combine Figure 8-11 The flowchart shown illustrates the handwritten typesetting method in the embodiments of this application.

[0199] For example, Figure 8 This is a schematic flowchart illustrating the identification of a title portion provided in an embodiment of this application. Figure 8 As shown, the method 300 can be applied to electronic devices, and the method 300 may include steps 310 to 350.

[0200] 310. After the user begins writing, the electronic device detects whether the user has raised their hand.

[0201] In some examples, electronic devices may include apps for text editing, such as note-taking apps, notepad apps, memo apps, etc. In this embodiment of the application, a note-taking app is used as an example for illustration.

[0202] For example, if an electronic device takes notes in a note-taking app and enables the AI ​​title feature, the device can detect in real time whether the user raises their hand after they start writing.

[0203] It should be understood that the writing here can be done using an electronic device with a stylus, or it can be done using a finger or other tools; the embodiments of this application are not limited to this.

[0204] 320. When the user raises their hand, determine whether the duration of the user's hand raising is greater than the preset duration.

[0205] It should be understood that the specific value of the preset duration is not limited in the embodiments of this application. For example, the preset duration can be 10s or 20s, etc.

[0206] During the process of a user taking notes, the duration of the user raising their hand may be relatively short. When the duration of the user raising their hand exceeds the preset duration, the user has most likely finished taking notes, and step 330 can then be executed.

[0207] In other examples, users can click the start control before starting to take notes and the end control when ending to take notes, so that the electronic device can recognize that the user has finished taking notes.

[0208] 330. If the duration of the user raising their hand exceeds the preset duration, determine whether there is a title in the notes.

[0209] It is understandable that electronic devices may include a handwriting recognition engine, through which the electronic device can recognize the handwriting of the user, thereby recognizing the title.

[0210] 340. When it is determined that a title exists in the notes, the electronic device adds an identifier to the title.

[0211] For example, see Figure 2 In (b), the electronic device can add a substrate to the title.

[0212] It is understandable that the technical solutions for adding identifiers to titles on electronic devices can be found in the relevant descriptions above, and will not be repeated here.

[0213] 350, Electronic devices generate a title table of contents.

[0214] It should be understood that step 350 may be an optional step, and in some cases, when the user's notes contain a table of contents, the electronic device may not need to perform step 350.

[0215] In other examples, when a user's notes contain a heading list 1, the electronic device can also internally determine a heading list 2 and verify the heading list 1 based on the heading list 2 to correct the user's typos.

[0216] Based on the embodiments of this application, the electronic device can detect in real time whether the user is taking notes, and identify the title part of the user's notes after the user finishes taking notes, and add a mark to the title part so that the user can quickly distinguish the title part from the body part, thereby improving the user's reading efficiency when reviewing the notes later.

[0217] In other examples, electronic devices can also recognize user-recorded notes in real time and add identifiers to the recognized title portions, which is not limited in this embodiment.

[0218] Figure 9This is a schematic flowchart illustrating the identification of a title portion provided in an embodiment of this application. Figure 9 As shown, the method 600 can be applied to electronic devices, and the method 600 may include steps 610 to 640.

[0219] 610. Electronic device detects whether the function for formatting handwritten notes is enabled.

[0220] For example, see Figure 3 When the electronic device detects that the user clicks on the function control 222, it can be understood that the electronic device has detected that the function of formatting handwritten notes has been enabled.

[0221] 620, The electronic device determines whether a title exists in the notes.

[0222] When an electronic device detects that the function of formatting handwritten notes has been enabled, it can determine whether there is a title in the current handwritten notes.

[0223] It should be understood that the technical solutions for electronic devices to determine whether a title exists in the current handwritten note can be found in the relevant description above, and will not be repeated here for the sake of brevity.

[0224] 630, Electronic devices add identifiers to the title.

[0225] 640, Electronic devices generate a title table of contents.

[0226] It should be understood that steps 630 to 640 can be referred to in the relevant descriptions of steps 340 to 350 above, and will not be repeated here for the sake of brevity.

[0227] Based on the embodiments of this application, for existing handwritten notes, when the electronic device detects that the user has enabled the function of formatting the handwritten notes, it can recognize the handwritten notes, determine the title, and add a mark to the title part so that the user can quickly distinguish the title part from the body part, thereby improving the user's reading efficiency when reviewing the notes later.

[0228] Figure 10 This is a schematic flowchart illustrating a method of quick navigation via a title, as provided in an embodiment of this application. Figure 10 As shown, the method 400 can be applied to electronic devices, and the method 400 may include steps 410 to 430.

[0229] 410. Electronic devices add hyperlinks to headings in the heading directory.

[0230] For example, an electronic device adds hyperlinks to the headings in the heading list, which can link to the location of the target heading in the body text.

[0231] 420. In response to a user clicking on a target title, the electronic device determines whether a target title pair exists.

[0232] When a user clicks on a target title in the title list, the electronic device can determine whether a target title pair exists. It is understood that the target title pair may include the target title in the title list and the target title in the body text.

[0233] 430. When a target heading pair is confirmed to exist, the electronic device jumps to the location of the target heading in the body text.

[0234] For example, when a target heading pair is determined to exist, the electronic device can jump to the location of the target heading in the body text.

[0235] Based on the embodiments of this application, electronic devices can add hyperlinks to titles. Users can click on the target title in the title directory to link to the location of the target title in the body text, so that users can quickly locate the note they want to view.

[0236] For example, Figure 11 This is a schematic flowchart illustrating a typesetting update provided in an embodiment of this application. Figure 11 As shown, the method 500 may include steps 510 to 560.

[0237] 510, The electronic device detects a trigger operation that moves target title 1 and determines whether there is a title 2 at the same level below target title 1.

[0238] In some possible implementations, step 520 can be executed when the electronic device determines that a sibling title 2 exists below the target title 1.

[0239] In some other possible implementations, step 515 can be executed when the electronic device determines that there is no sibling heading 2 below the target heading 1.

[0240] It should be understood that the triggering operation can be found in the relevant description of the preset conditions mentioned above, and will not be repeated here.

[0241] For example, an electronic device can determine a title at the same level as the target title 1 by recognizing the title.

[0242] 515, Electronic device determines whether there is an image or handwriting below target title 1.

[0243] For example, the handwriting may include text content or graphic content, etc.

[0244] It should be understood that electronic devices can use line breaks as an index to determine the content below the heading.

[0245] After step 515, the electronic device may execute step 518.

[0246] 518, The electronic device identifies Target Heading 1 and the image or handwritten notes below Target Heading 1 as the whole content 1.

[0247] In this case, the target heading 1 is the last sibling heading. If the content below it includes images or handwritten notes, the images or handwritten notes can be treated as a whole content 1 along with the target heading 1.

[0248] After step 518, the electronic device can perform step 530.

[0249] 520, The electronic device defines the content between target heading 1 and heading 2 and target heading 1 as the whole content 1.

[0250] For example, an electronic device may treat target heading 1 and the content included below target heading 1 as a whole.

[0251] For example, see Figure 5 In (b), the target heading 1 can be "1. Heading A1", and the heading 2 can be "2. Heading A2". The overall content 1 can be the content corresponding to area 251.

[0252] In other examples, if the line containing target heading 1 also contains text or images, that content can also be included as part of the overall content 1.

[0253] In other examples, if the line containing the target heading 1 includes an image, and that image also occupies several lines above the target heading 1, the electronic device may also include that image as part of the overall content 1.

[0254] In other examples, the electronic device can also adjust the area of ​​the overall content 1 based on the user's editing actions. For example, the user can pull down the edge of the area containing the overall content to increase the area of ​​the overall content 1.

[0255] Understandably, electronic devices can treat each heading at the same level as target heading 1 and its corresponding content as a whole.

[0256] 530, the electronic device detects the user's operation of moving the entire content 1, and controls the entire content 1 to move in accordance with the user's operation.

[0257] For example, the overall content 1 can be moved according to the user's movement operation so that the overall content 1 can be moved to the place where the user wants to stay.

[0258] It should be understood that the embodiments of this application do not limit the direction of movement. For example, it can move upward or downward, left or right, etc.

[0259] 540, when the user raises their hand, the electronic device determines whether there is a title 3 at the same level in the area that overlaps with the overall content 1.

[0260] It should be understood that when the user raises their hand, it can be interpreted as the user having completed the movement. The electronic device can then determine whether there is a title (3) at the same level in the area where the current location overlaps with the overall content (1).

[0261] In some examples, if the electronic device determines that there is a title 3 of the same level in the area overlapping with the overall content 1, then step 550 can be executed; if the electronic device determines that there is no title 3 of the same level in the area overlapping with the overall content 1, then step 545 can be executed.

[0262] 545, The electronic device moves the entire content 1 to the position where the user raises their hand.

[0263] If there is no title 3 of the same level in the area that overlaps with the overall content 1, the electronic device can directly move the overall content 1 to the position where the user raises their hand.

[0264] It should be understood that after step 545, the electronic device may perform step 560.

[0265] 550, the electronic device moves the overall content 3 corresponding to title 3 in the preset direction.

[0266] For example, if the user moves the entire content 1 upwards, the preset direction is downwards, meaning the entire content 1 is moved upwards and the entire content 3 is moved downwards.

[0267] For example, see Figure 5 The area corresponding to the overall content 1 can be area 252, and the area corresponding to the overall content 3 can be area 251. After the user moves the content, area 252 is located above area 251. In this way, the electronic device can complete the reformatting of the heading hierarchy.

[0268] 560, the number of the title update for electronic devices.

[0269] After being reformatted, electronic devices can update the heading numbers according to the order of the headings, thus better aligning with users' reading habits.

[0270] Based on the embodiments of this application, electronic devices can support users to quickly move the area where the title is located for reformatting. Through convenient movement operations, users can quickly reformat the title level of the note content, thereby reducing the burden of reformatting when users have reformatting needs and further improving the efficiency of subsequent note review.

[0271] In addition, the title numbering can be automatically updated after the reformatting, which can better suit users' reading habits.

[0272] Figure 12 This is a schematic flowchart illustrating a handwritten typesetting method provided in an embodiment of this application. Figure 12 As shown, the method 800 can be applied to a first electronic device, and the method 800 may include steps 810 to 840.

[0273] 810, A first electronic device recognizes a user's handwritten notes in a first application, wherein the first application is a text editing application.

[0274] For example, the first application can be a notepad, memo, etc.

[0275] The handwritten notes can be written by the user in real time or be existing.

[0276] 820. Obtain the title portion of the handwritten notes based on the first information, wherein the first information includes text content with a fixed format combination in the handwritten notes.

[0277] For example, the first information may include content in a fixed format combination, such as numbers + punctuation marks + text (or + line break), letters + punctuation marks + text (or + line break), parentheses + text (or + line break), etc.

[0278] For example, the content of this fixed format combination can be found in the descriptions of methods one through seven of electronic device title recognition above, and will not be repeated here.

[0279] The first information may also include content in a preset color. For example, the first electronic device may recognize yellow or red content in a handwritten note as a title section.

[0280] The first information may also include the circled content. For example, the first electronic device recognizes the content circled in a handwritten note with a rectangle or other irregular shape as the title section.

[0281] The first information may also include highlighted content. For example, the first electronic device identifies the title portion of the highlighted content in a handwritten note. The user can use a highlighter to highlight the content of the handwritten note.

[0282] 830, The first electronic device adds a first identifier to the title portion of a handwritten note, the first identifier being used to distinguish the title portion from the body portion of the handwritten note.

[0283] It should be understood that the title section of a handwritten note is the title written by the user.

[0284] For example, the first identifier can be a substrate, a rectangle, an underline, a pointing arrow, etc., and is not limited in the embodiments of this application.

[0285] For example, see Figure 2 The first identifier can be a substrate, for example, the substrate can be a preset color, such as yellow, red, etc., so that the title part can be highlighted.

[0286] Based on the embodiments of this application, the first electronic device can recognize the user's handwritten notes in the first application and add a first identifier to the title part of the handwritten notes, thereby better distinguishing the title from the body text. In addition, the first electronic device can also generate a title table of contents composed of the title parts, thereby displaying the framework of the notes to the user.

[0287] In this way, when users review their handwritten notes, they can better distinguish between titles and body text, and quickly browse the overall framework of the notes, thereby improving their reading efficiency when reviewing handwritten notes.

[0288] In some implementations, the method also includes:

[0289] The first electronic device generates a first heading list consisting of heading sections, wherein the first heading list is in a printed font; the first electronic device folds or displays the first heading list.

[0290] For example, see Figure 7 The first heading section can be the heading section 281. The first heading section is in print font, meaning the first heading section is an electronic heading section.

[0291] For example, when the first title directory is collapsed, it can be collapsed into a function control. This function control can be located in the toolbar of the first application, or it can float on the display interface of the first application, or it can be located in the sidebar. This embodiment of the application is not limited to this. Users can click on the function control to display or collapse the first title directory again.

[0292] For example, see Figure 2 This function control can be a table of contents control 224. When the user clicks this function control 224, the electronic device can display a complete table of contents.

[0293] In some implementations, the first electronic device recognizes the user's handwritten notes in a first application, including: in response to the user's operation of activating a layout function, the first electronic device recognizes the user's handwritten notes in the first application.

[0294] For example, see Figure 3 The user can enable the layout function by clicking the settings control 222.

[0295] In this way, the first electronic device can enable the layout function as needed according to the user's requirements.

[0296] In other examples, this layout feature can also be kept enabled.

[0297] In some implementations, the handwritten notes include a second heading table of contents, which includes the user-written headings. Method 800 also includes:

[0298] The first electronic device adds hyperlinks to the headings in the second heading list, and the hyperlinks are used to link to the body text corresponding to the headings.

[0299] The first electronic device responds to the user's click on the first target title in the second title directory and jumps to the text section corresponding to the first target title.

[0300] It should be understood that the second heading list can be a heading list handwritten by the user in the handwritten notes to indicate the overall framework of the notes.

[0301] For example, see Figure 3 The second heading section can be the handwritten heading section that appears at the beginning of the notes.

[0302] Based on the embodiments of this application, the first electronic device can add hyperlinks to each title section of the user's handwritten title directory, so that the user can click on the first target title in the handwritten title directory and the first electronic device can conveniently jump to the body section corresponding to the first target title, which can improve the efficiency of the user in viewing notes.

[0303] In some implementations, method 800 also includes:

[0304] When the contents of the first heading directory and the second heading directory are different, the first electronic device uses the first heading directory to correct the second heading directory.

[0305] In this way, the second heading table of contents, which is initially handwritten by the user, may contain typos or omissions. The first heading table of contents generated by the first electronic device can then correct the second heading table of contents to rectify some of the errors.

[0306] In some implementations, method 800 also includes:

[0307] When the triggering condition is met, in response to the user's operation of moving the second target title in the first direction, the second target title and the corresponding body text are moved in the first direction, wherein the second target title is a title in the first title table of contents, or the second target title is a title in the title section of the handwritten notes.

[0308] For example, the triggering condition may include detecting a long press operation or a double-click operation, or receiving a first indication message sent by a second electronic device, which may be used to indicate the movement of the trigger title.

[0309] For example, the second electronic device is a stylus. When the stylus detects that the user presses a button or the body of the stylus, it can send the first instruction information to the first electronic device.

[0310] Alternatively, the first instruction message may be sent when the user touches the first electronic device with the end of a stylus.

[0311] Based on the embodiments of this application, when the triggering conditions are met, the first electronic device can also reformat the target title and the corresponding body text, such as moving it up or down, thereby providing users with convenient formatting functions for handwritten notes.

[0312] In some implementations, before moving the corresponding text portion of the second target title in the first direction, the method 800 further includes:

[0313] Determine whether a third target title exists at the same level as the second target title below it;

[0314] When a third target title exists at the same level as the second target title below it, the content between the second and third target titles is defined as the body text corresponding to the second target title; or,

[0315] When there is no third target title at the same level as the second target title below it, the content below the second target title is determined as the body text corresponding to the second target title.

[0316] For example, if the second target heading is a level 2 heading, then the third target heading must also be a level 2 heading. It should be understood that this body text may also include other heading sections at a lower level than the second target heading, such as level 3 headings.

[0317] Based on the embodiments of this application, the first electronic device can determine the body text corresponding to the second target title, so that during typesetting, the title and the body text corresponding to the title can be moved as a whole to avoid layout disorder and affect the user's reading logic.

[0318] In some implementations, method 800 also includes:

[0319] When the user raises their hand, determine whether there is a fourth target title at the same level as the second target title in the area overlapping with the body text corresponding to the second target title;

[0320] When a fourth target title exists at the same level as the second target title in the overlapping area, the fourth target title and the corresponding body text are moved in the second direction, where the second direction is opposite to the first direction.

[0321] For example, the first direction is upward, and the second direction is downward.

[0322] See Figure 5 The second target title can be the title "1. Heading A1" in area 251, and the fourth target title can be the title "2. Heading A2" in area 252.

[0323] It is understandable that the body text corresponding to the fourth objective title can use the same confirmation method as the body text corresponding to the second objective title, which will not be elaborated here.

[0324] Based on the embodiments of this application, when the user raises their hand, it means that the user wants to move the content of the second target title to the position of the raised hand. Then the first electronic device can move the content of the overlapping part in another direction to complete the layout desired by the user.

[0325] In some implementations, method 800 also includes:

[0326] Update the numbering of the title section.

[0327] It should be understood that the numbering of the headings in the text needs to be updated. In addition, the numbering in the second heading table of contents handwritten by the user and the first heading table of contents generated by the first electronic device also needs to be updated.

[0328] Based on the embodiments of this application, after typesetting, the first electronic device updates the numbering of the title section, thereby making it more in line with the user's reading habits.

[0329] In some implementations, the first heading table of contents is collapsed or displayed, including:

[0330] If a handwritten second heading exists in the handwritten notes, the first heading will be collapsed and displayed; or, if a second heading does not exist in the handwritten notes, the first heading will be displayed.

[0331] Based on the embodiments of this application, when a user's handwritten notes contain a handwritten second heading table of contents, the first electronic device can fold up the first heading table of contents. When the handwritten notes do not contain a second heading table of contents, the first electronic device can display the first heading table of contents, thereby making the handwritten notes more in line with the user's reading habits.

[0332] In some implementations, method 800 also includes:

[0333] In response to the detection of a user's editing action, the title portion of the recognized handwritten notes is edited.

[0334] For example, the editing operation could be a user long-pressing the title section and editing it, or it could be a user opening the edit button in the toolbar and editing the title.

[0335] It should be understood that the editing may include adjusting the scope of the heading section, deleting the heading, or adjusting the way the heading section is identified.

[0336] Based on the embodiments of this application, the user can also edit the title portion recognized by the first electronic device to correct any inaccuracies in the recognition. Furthermore, this enhances the flexibility of the first electronic device in recognizing the title portion.

[0337] In some implementations, the first information may also include: content with a fixed format combination; content with a preset color; selected content; or highlighted content.

[0338] In other examples, the first information may also include other content, which is not limited in the embodiments of this application.

[0339] For example, Figure 13 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Figure 13 As shown, the electronic device 900 includes one or more processors 910; one or more memories 920; the one or more memories 920 storing one or more instructions that, when executed by one or more processors 910, cause the method described in any of the possible implementations above to be performed.

[0340] For example, the electronic device 900 can be the electronic device 100, electronic device 200 mentioned above, the electronic device in the embodiment, the first electronic device, etc.

[0341] The electronic device 900 can be used to execute methods 300, 400, 500 and 600 mentioned above.

[0342] This application also provides an electronic device, including a processor, a memory, and a communication interface, wherein the communication interface is used to receive signals, the memory is used to store signals, the communication interface is also used to transmit signals to the processor, and the processor processes the signals so that the handwritten typesetting method described in any of the possible implementations above is executed.

[0343] This application also provides a device for jumping to a display interface, including a processor and a communication interface. The communication interface is used to receive signals and transmit the signals to the processor. The processor processes the signals so that the handwritten typesetting method described in any of the possible implementations above is executed.

[0344] The device can be a chip. For example, the chip can be a chip system or a standalone chip.

[0345] This application also provides a readable storage medium (also known as a computer-readable storage medium) that stores instructions. When these instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the handwritten typesetting method described in the above embodiments.

[0346] This application also provides a program product (also known as a computer program product) that, when run on an electronic device, causes the electronic device to perform the aforementioned steps to implement the handwritten typesetting method described in the above embodiments.

[0347] This application also provides an apparatus including a module for implementing the handwritten typesetting method as described in any of the preceding embodiments.

[0348] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store instructions, and when the apparatus is running, the processor may execute the instructions stored in the memory to cause the apparatus to perform the handwritten typesetting method in the above method embodiments.

[0349] In this embodiment, the device, readable storage medium, program product or apparatus are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0350] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0351] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0352] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0353] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0354] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0355] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks.

[0356] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for typesetting handwritten text, characterized in that, The method is applied to a first electronic device, and the method includes: The user's handwritten notes are recognized in a first application, which is a text editing application; The title portion of the handwritten notes is obtained based on the first information, wherein the first information includes text content with a fixed format combination in the handwritten notes; A first identifier is added to the title portion, which is used to distinguish the title portion from the body portion in the handwritten notes.

2. The method according to claim 1, characterized in that, The method further includes: Generate a first heading list consisting of the heading sections, wherein the first heading list is in a print font; Collapse or display the first heading directory.

3. The method according to claim 1 or 2, characterized in that, The handwritten notes include a second heading directory, which includes a user-written heading section. The method further includes: Add hyperlinks to the heading sections in the second heading directory, the hyperlinks being used to link to the body text corresponding to the heading sections; In response to the user clicking on the first target title in the second title directory, the user is redirected to the body text corresponding to the first target title.

4. The method according to claim 3, characterized in that, The method further includes: When the contents of the first heading directory differ from those of the second heading directory, the second heading directory is corrected using the first heading directory.

5. The method according to any one of claims 1-4, characterized in that, The method further includes: When the triggering condition is met, in response to the user's operation of moving the second target title in the first direction, the second target title and the corresponding body text portion are moved in the first direction, wherein the second target title is a title in the first title directory, or the second target title is a title in the title portion of the handwritten notes.

6. The method according to claim 5, characterized in that, Before moving the corresponding text portion of the second target title in the first direction, the method further includes: Determine whether there is a third target title at the same level as the second target title below the second target title; When a third target title exists at the same level as the second target title below it, the content between the second target title and the third target title is defined as the body text corresponding to the second target title; or, When there is no third target title at the same level as the second target title below the second target title, the content below the second target title is determined as the body text corresponding to the second target title.

7. The method according to claim 5 or 6, characterized in that, The method further includes: When the user raises their hand, determine whether there is a fourth target title at the same level as the second target title in the area overlapping with the body text corresponding to the second target title; When a fourth target title of the same level as the second target title exists in the overlapping area, the fourth target title and the corresponding text portion of the fourth target title are moved in a second direction, wherein the second direction is opposite to the first direction.

8. The method according to claim 7, characterized in that, The method further includes: Update the numbering of the title section.

9. The method according to any one of claims 1-8, characterized in that, The process of collapsing or displaying the first title directory includes: When a handwritten second heading table of contents exists in the handwritten notes, the first heading table of contents is collapsed and displayed; or... If the second heading directory does not exist in the handwritten notes, the first heading directory is displayed.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: In response to detecting a user's editing action, the title portion of the identified handwritten note is edited.

11. An electronic device, characterized in that, include: One or more processors; One or more memories; the one or more memories storing one or more programs that, when executed by one or more processors, cause the method as described in any one of claims 1-10 to be performed.

12. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being used to receive signals and transmit the signals to the processor, the processor processing the signals such that the method as described in any one of claims 1-10 is executed.

13. A readable storage medium, characterized in that, The readable storage medium stores instructions that, when executed on an electronic device, cause the method as described in any one of claims 1-10 to be performed.

14. A program product, characterized in that, The program product includes program code that, when run on an electronic device, causes the method as described in any one of claims 1-10 to be executed.

Images