Display method, electronic equipment and storage medium
By optimizing the cover of smart terminal note-taking applications, and generating beautified summary information and images, the problem of cluttered note covers has been solved, improving users' search efficiency and visual experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2026-04-07
AI Technical Summary
Existing note-taking applications on smart devices often have cluttered cover information, resulting in a poor visual experience and making it difficult for users to quickly find the notes they need.
By optimizing different types of notes, the system generates enhanced covers, including handwritten notes, text notes, and imported PDF document notes. These covers display summary information and matching scene images, and allow users to edit and adjust the covers while keeping the number of characters within a reasonable range.
The personalized and visual experience of the notebook covers has been enhanced, allowing users to find the notes they need more quickly and improving the user experience.
Smart Images

Figure CN121807181A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of smart terminal technology, and in particular to a display method, electronic device and storage medium. Background Technology
[0002] Note-taking apps on smart devices (such as smartphones and tablets) are efficient and convenient applications that help users easily record and organize information. Users can quickly record information through text input, handwriting input, voice input, and information import. Summary of the Invention
[0003] This application provides a display method, an electronic device, and a storage medium. In this method, different methods are used to optimize the cover for different types of user notes, thereby improving the user's visual experience of the note cover.
[0004] Firstly, embodiments of this application provide a display method. This method is applied in an electronic device and includes:
[0005] The electronic device displays the first interface of the note-taking application; the first interface includes a first handwritten note, which contains first handwritten text, and the cover of the first handwritten note is the first cover;
[0006] The electronic device responds to the first operation by displaying a second interface of the note-taking application; the second interface includes a second cover of the first handwritten note; wherein the second cover includes a first summary of the first handwritten text, which is displayed through beautified first handwritten handwriting.
[0007] In this implementation, the first cover is the original cover, and the second cover is the optimized cover. For example, this implementation can be referred to... Figures 4a-4b The scene shown.
[0008] For example, the first operation could be the operation of selecting the first handwritten note on the first interface and then clicking the smart cover option.
[0009] In this way, electronic devices have optimized the covers of handwritten notes containing handwritten text. The optimized cover displays a summary of the handwritten text in an aesthetically pleasing handwritten style, making it easier for users to understand the type and content of the note. This allows users to quickly find the notes they need through the cover. Moreover, the more visually appealing handwritten summary information on the cover enhances the user's overall visual experience.
[0010] According to the first aspect, the method further includes: on the second cover, the background image of the first summary information is a scene image that matches the first summary information.
[0011] For example, this implementation method can be referred to Figures 4d-4e The scene shown.
[0012] In this way, the optimized cover of the handwritten note on the electronic device not only displays a summary of the handwritten text, but also a scene image that matches the summary, which enhances the personalization of the handwritten note cover, makes it easier for users to understand the content of the note, and further improves the user experience.
[0013] According to the first aspect, or any implementation of the first aspect above, the method further includes: an electronic device displaying a third interface of a note-taking application; the third interface includes a second handwritten note, the second handwritten note recording second handwritten text, and the cover of the second handwritten note being a third cover;
[0014] In response to the second operation, the electronic device displays a fourth interface of the note-taking application; the fourth interface includes a fourth cover of the second handwritten note; wherein the fourth cover includes a second image, which is generated based on second summary information of the second handwritten text.
[0015] In this implementation, the third cover is the original cover, and the fourth cover is the optimized cover. For example, this implementation can be referred to... Figure 4g-Figure 4h The scene shown.
[0016] In this way, electronic devices optimize the cover of handwritten notes containing handwritten text. The optimized cover displays a beautiful image that matches the summary of the handwritten text, which not only makes it easier for users to understand the content of the notes, but also enhances the user's visual experience of the note cover.
[0017] According to the first aspect, or any implementation of the first aspect above, the method further includes:
[0018] The electronic device displays the fifth interface of the note-taking application; the fifth interface includes the third handwritten note, which contains an imported PDF document; the cover of the third handwritten note is the fifth cover.
[0019] The electronic device responds to the third operation by displaying a sixth interface of the note-taking application; the sixth interface includes a sixth cover of the three handwritten notes; wherein the sixth cover includes a first image area and a first text area, the first image area displays a first pattern, and the first text area displays a third summary of the first page content of the PDF document.
[0020] In this implementation, the fifth cover is the original cover, and the sixth cover is the optimized cover. For example, this implementation can be referred to... Figures 5a-5b The scene shown.
[0021] In this way, the cover of handwritten notes imported with PDF documents has been optimized. The optimized cover displays a summary corresponding to the content of the first page of the PDF document, and the style of the optimized cover is relatively uniform. This solves the problem of relatively messy cover of notes in the note list in the existing technology, making it easier for users to quickly find the notes they need by note cover.
[0022] According to the first aspect, or any implementation of the first aspect above, when displaying the sixth interface of the note-taking application on the electronic device, the method further includes:
[0023] In response to a fourth operation, the electronic device displays a seventh interface of the note-taking application; the seventh interface includes at least one note cover editing option; in response to an operation on at least one note cover editing option, the electronic device displays an eighth interface of the note-taking application; the eighth interface includes a seventh cover of a third handwritten note; wherein the seventh cover includes a second image area and a second text area, the second image area displays a second pattern, and the second text area displays a fourth summary information of the first page content of a PDF document;
[0024] Among them, at least one of the following differs: the division of the image area and the text area in the cover, the content or color of the first pattern and the second pattern, the display direction of the sixth cover and the seventh cover, and the third summary information and the fourth summary information.
[0025] For example, the fourth action could be the user clicking the edit option (see reference). Figure 5a The operation of option 5113 shown in (2) is as follows.
[0026] For example, the seventh interface can be referred to Figure 5d The user interface shown is 53.
[0027] In this way, the smart cover for handwritten notes generated by electronic devices can be edited and adjusted by the user to make the final handwritten note cover more in line with the user's needs.
[0028] According to the first aspect, or any implementation of the first aspect above, the method further includes:
[0029] The electronic device displays the ninth interface of the note-taking application; the ninth interface includes a first text note, which records target text information, and the cover of the first text note is the eighth cover;
[0030] The electronic device responds to the fifth operation by displaying the tenth interface of the note-taking application; the tenth interface includes the ninth cover of the first text note; wherein the ninth cover includes a third image area and a third text area, the third image area displays a third pattern, and the third text area displays the fifth summary information of the target text information.
[0031] In this way, the cover of text notes containing text information has been optimized. The optimized cover displays a summary corresponding to the text information, and the style of the optimized cover is relatively uniform. This solves the problem of relatively messy covers of text notes in the existing note list, making it easier for users to quickly find the notes they need by the cover.
[0032] According to the first aspect, or any implementation of the first aspect above, when the tenth interface of the note-taking application is displayed on the electronic device, the method further includes:
[0033] In response to a sixth operation, the electronic device displays an eleventh interface of the note-taking application; the eleventh interface includes at least one note cover editing option; in response to an operation on the at least one note cover editing option, the electronic device displays a twelfth interface of the note-taking application; the twelfth interface includes a tenth cover of a first text note; wherein the tenth cover includes a fourth image area and a fourth text area, the fourth image area displays a fourth pattern, and the fourth text area displays sixth summary information of the target text information; wherein at least one of the following is different:
[0034] The division of image and text areas on the cover, the content or color of the third and fourth patterns, the display direction of the ninth and tenth covers, and the fifth and sixth summary information.
[0035] For example, the seventh interface can be referred to Figure 3d The user interface shown is 33.
[0036] In this way, the smart cover for text notes generated by electronic devices can be edited and adjusted by users to make the final text note cover more in line with the user's needs.
[0037] According to the first aspect, or any implementation of the first aspect above, the method further includes:
[0038] The electronic device displays the thirteenth interface of the note-taking application; the thirteenth interface includes the target note, which records the target voice information; the cover of the target note is the eleventh cover; the target note is the fourth handwritten note or the second text note;
[0039] The electronic device responds to the seventh operation by displaying the fourteenth interface of the note-taking application; the fourteenth interface includes the twelfth cover of the target note; wherein the twelfth cover includes a fifth image area and a fifth text area, the fifth image area displays a fifth pattern, and the fifth text area displays the seventh summary information of the target speech information.
[0040] In this way, the cover of text notes or handwritten notes containing voice information has been optimized. The optimized cover displays a summary corresponding to the voice information, which not only makes it easier for users to understand the content of the note, but also enhances the user's visual experience of the note cover.
[0041] According to the first aspect, or any implementation of the first aspect above, the method further includes: the number of characters in the summary information is within a preset range.
[0042] In this way, the number of characters displayed on the note cover is controlled within a certain range, and too much content is not displayed. This not only makes it easier for users to understand the content of the note, but also enhances the user's visual experience of the note cover.
[0043] According to the first aspect, or any implementation of the first aspect above, before the electronic device displays the second interface of the note-taking application, the method further includes: the electronic device performing OCR recognition on the first handwritten text to obtain the first text information included in the first handwritten text, and sending the first text information to the cloud server; the electronic device receiving the first summary information of the first text information returned by the cloud server; and the electronic device generating a second cover based on the beautified first handwritten text and the first summary information.
[0044] This implementation method can be referenced. Figure 4c The process is shown below.
[0045] According to the first aspect, or any implementation of the first aspect above, the method further includes: the electronic device receiving a scene image returned by the cloud server that matches the first summary information; the electronic device generating a second cover based on the beautified first handwritten text and the first summary information, including: the electronic device generating a second cover based on the beautified first handwritten text, the first summary information and the scene image; in the second cover, the first summary information is displayed on the scene image.
[0046] This implementation method can be referenced. Figure 4f The process is shown below.
[0047] According to the first aspect, or any implementation of the first aspect above, before the electronic device displays the fourth interface of the note-taking application, the method further includes: the electronic device performing OCR recognition on the second handwritten text to obtain second text information included in the second handwritten text, and sending the second text information to the cloud server; the electronic device receiving a second image returned by the cloud server; wherein the second image is generated by the cloud server based on the second summary information after generating the second summary information of the second text information.
[0048] This implementation method can be referenced. Figure 4i The process is shown below.
[0049] According to the first aspect, or any implementation of the first aspect above, before the electronic device displays the sixth interface of the note-taking application, the method further includes: the electronic device performing OCR recognition on the first page content of the PDF document to obtain third text information, and sending the third text information to the cloud server; the electronic device receiving the third summary information of the third text information returned by the cloud server; and the electronic device generating a sixth cover according to a preset cover style and the third summary information.
[0050] This implementation method can be referenced. Figure 5c The process is shown below.
[0051] Secondly, embodiments of this application provide an electronic device. The electronic device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when executed by the one or more processors, the electronic device performs the display method of the first aspect and any one thereof.
[0052] The second aspect and any implementation thereof correspond to the first aspect and any implementation thereof, respectively. The technical effects of the second aspect and any implementation thereof are similar to those of the first aspect and any implementation thereof, and will not be repeated here.
[0053] Thirdly, embodiments of this application provide a computer-readable storage medium. This computer-readable storage medium includes a computer program that, when executed on an electronic device, causes the electronic device to perform the display method of the first aspect and any one thereof.
[0054] The third aspect and any implementation thereof correspond to the first aspect and any implementation thereof, respectively. The technical effects of the third aspect and any implementation thereof are similar to those of the first aspect and any implementation thereof, and will not be repeated here.
[0055] Fourthly, embodiments of this application provide a computer program product, including a computer program that, when run, causes a computer to perform a display method as described in the first aspect or any one of the first aspects.
[0056] The fourth aspect and any implementation thereof correspond to the first aspect and any implementation thereof, respectively. The technical effects of the fourth aspect and any implementation thereof are similar to those of the first aspect and any implementation thereof, and will not be repeated here.
[0057] Fifthly, this application provides a chip including a processing circuit and transceiver pins. The transceiver pins and the processing circuit communicate with each other via an internal connection path. The processing circuit executes a display method as described in the first aspect or any one thereof, to control the receiving pin to receive signals and to control the transmitting pin to transmit signals.
[0058] The fifth aspect and any implementation thereof correspond to the first aspect and any implementation thereof, respectively. The technical effects of the fifth aspect and any implementation thereof are similar to those of the first aspect and any implementation thereof, and will not be repeated here. Attached Figure Description
[0059] Figure 1a A schematic diagram of the hardware structure of an electronic device as an example;
[0060] Figure 1b A schematic diagram of the software structure of an electronic device as an example;
[0061] Figure 2 This is a schematic diagram of the user interface of a note-taking application in an electronic device, as an example.
[0062] Figures 3a-3b This is an illustrative diagram illustrating a scenario where the cover of a Chinese note in a note-taking application is optimized.
[0063] Figure 3c This is an illustrative flowchart of the process for optimizing the cover of Chinese notes in a note-taking application.
[0064] Figure 3d This is a schematic diagram of the cover editing interface for Chinese notes in a note-taking application, which serves as an example.
[0065] Figure 3e This is an illustrative flowchart of the process for optimizing the cover of Chinese notes in a note-taking application.
[0066] Figure 3f This is an illustrative flowchart of the process for optimizing the cover of Chinese notes in a note-taking application.
[0067] Figure 3g This is an illustrative flowchart of the process for optimizing the cover of Chinese notes in a note-taking application.
[0068] Figures 4a-4b This is an illustrative diagram illustrating a scenario where the cover of a handwritten note in a note-taking application is optimized.
[0069] Figure 4cThis is an illustrative flowchart of the process for optimizing the cover of handwritten notes in a note-taking application.
[0070] Figures 4d-4e This is an illustrative diagram illustrating a scenario where the cover of a handwritten note in a note-taking application is optimized.
[0071] Figure 4f This is an illustrative flowchart of the process for optimizing the cover of handwritten notes in a note-taking application.
[0072] Figure 4g-Figure 4h This is an illustrative diagram illustrating a scenario where the cover of a handwritten note in a note-taking application is optimized.
[0073] Figure 4i This is an illustrative flowchart of the process for optimizing the cover of handwritten notes in a note-taking application.
[0074] Figures 5a-5b This is an illustrative diagram illustrating a scenario where the cover of a handwritten note in a note-taking application is optimized.
[0075] Figure 5c This is an illustrative flowchart of the process for optimizing the cover of handwritten notes in a note-taking application.
[0076] Figure 5d This is a schematic diagram of the cover editing interface for handwritten notes in a note-taking application, which serves as an example. Detailed Implementation
[0077] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0078] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.
[0079] The terms "first" and "second," etc., used in the specification and claims of this application are used to distinguish different objects, not to describe a specific order of objects. For example, "first target object" and "second target object," etc., are used to distinguish different target objects, not to describe a specific order of target objects.
[0080] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0081] In the description of the embodiments in this application, unless otherwise stated, "multiple" means two or more. For example, multiple processing units means two or more processing units; multiple systems means two or more systems.
[0082] Figure 1a A schematic diagram of the electronic device is shown. It should be understood that... Figure 1a The electronic device shown is merely an example of an electronic device, and electronic devices may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1a The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0083] For example, the electronic device can be a mobile phone, tablet computer, etc., and this embodiment does not limit the type of electronic device.
[0084] The electronic device may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.
[0085] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0086] The controller can serve as the nerve center and command center of an electronic device. Based on the instruction opcode and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.
[0087] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0088] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a limitation on the structure of the electronic device. In other embodiments of this application, the electronic device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0089] The wireless communication function of electronic devices can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0090] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0091] Mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G for use in electronic devices. Wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies for use in electronic devices. In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technologies.
[0092] Electronic devices implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0093] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than 1. The electronic device can implement shooting functions through an ISP, camera 193, video codec, GPU, display screen 194, and application processor, etc. The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or videos. In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than 1.
[0094] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0095] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0096] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.
[0097] The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc., which will not be listed here, and this application does not limit them.
[0098] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device. The electronic device can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device interacts with the network through the SIM card to achieve functions such as calls and data communication. In some embodiments, the electronic device uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from it.
[0099] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.
[0100] Figure 1bThis is a software structure block diagram of an electronic device according to an embodiment of this application.
[0101] The layered architecture of electronic devices divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android Runtime and system libraries, and the kernel layer.
[0102] The application layer can include a series of application packages.
[0103] like Figure 1b As shown, the application package may include applications such as note-taking applications. For example, the application package may also include applications such as camera, gallery, WLAN, Bluetooth, call, calendar, map, navigation, music, video, and SMS.
[0104] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0105] like Figure 1b As shown, the application framework layer may include a window manager, content provider, view system, resource manager, etc.
[0106] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0107] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0108] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0109] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0110] The Android Runtime consists of core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.
[0111] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is the Android core library. The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection. System libraries can include multiple functional modules. Examples include: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), and 2D graphics engines (e.g., SGL).
[0112] The kernel layer is the layer between hardware and software. It includes at least display drivers, Wi-Fi drivers, and sensor drivers. The hardware includes at least a processor, display screen, Wi-Fi module, and sensors.
[0113] Understandable, Figure 1b The layers in the illustrated software structure and the components contained in each layer do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer layers than illustrated, and each layer may include more or fewer components, or combine some components, or split some components, or arrange the components differently; this application does not impose any limitations.
[0114] It is understood that, in order to implement the display method in the embodiments of this application, the electronic device includes hardware and / or software modules that perform various functions. Based on the algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.
[0115] Note-taking apps are efficient and convenient applications for electronic devices that help users easily record and organize information. Users can quickly record information through text input, handwriting input, voice input, and information import, meeting various recording needs in work, life, and daily life.
[0116] For example, in response to a user clicking the icon of a note-taking application on an electronic device, the electronic device can display the user interface of the note-taking application. This article uses a tablet computer as an example to explain the user interface of a note-taking application on an electronic device. Figure 2An example is shown of the user interface of a note-taking application. (See reference...) Figure 2 The user interface 20 shown allows users to create multiple notes within the note-taking application, such as text note 201, text note 202, handwritten note 203, handwritten note 204, text note 205, and text note 206. Understandably, the text content in text notes can be typed by the user using the keyboard of an electronic device, while the text content in handwritten notes can be written by the user using a stylus, electronic pen, or other device that communicates with the electronic device, or directly by the user using their finger on the screen of the electronic device. In some implementations, users can take or import images, record voice, etc., into the notes (including text notes and handwritten notes). In some implementations, users can also import documents (such as PDF documents, Word documents, and TXT documents) into handwritten notes.
[0117] In this embodiment, the content of text notes may include at least one of the following: user-inputted text information, table information, image information captured or imported by the user, and user-recorded voice information; the content of handwritten notes may include at least one of the following: user-handwritten text information, hand-drawn image information, image information captured or imported by the user, document information imported by the user, and user-recorded voice information. Thus, whether it's text notes or handwritten notes, the note-taking application supports multiple types of information recording. It is understood that the type and amount of information recorded in both text notes and handwritten notes are not fixed and are related to the user's actual usage needs.
[0118] In note-taking applications, the cover of a user's note usually displays the content the user has recorded. For example, when a user's note contains a lot of content, the cover will show more content. Figure 2 The cover of Chinese text note 202 is shown in 2021; when the user's notes contain less content, the content displayed on the cover of the user's notes will be less, which can be referred to... Figure 2 The cover of the Chinese text note 201 is shown in Figure 2011. As another example, when a user records image information in the notes, the image may be displayed on the cover of the user's notes, as can be seen in [reference]. Figure 2 The cover 2061 of the Chinese text note 206 is shown. As another example, when a user records table information in the notes, the table may be displayed on the cover of the user's notes; see reference... Figure 2 The cover 2051 of the Chinese text note 205 is shown. As another example, the cover of the handwritten note displays various information handwritten by the user, which can be referred to... Figure 2 The cover 2031 of Chinese text notes 203 and the cover 2041 of text notes 204 are shown.
[0119] As a result, the information displayed on the cover of a user's note in the application's interface is cluttered and disorganized, resulting in a poor visual experience and making it difficult for users to find the target note they need through the cover.
[0120] To address the aforementioned issues, this application provides a display method. In this method, an electronic device can extract key information from a user's notes and intelligently generate a note cover based on the extracted information. This enhances the user's visual experience of the note-taking application interface and allows the user to quickly find the desired note within the application interface using the note cover.
[0121] In this application, different methods can be used to generate smart covers for different types of user notes, such as text notes and handwritten notes. Moreover, for the same type of user notes, different methods can be used to generate smart covers based on the type of information recorded, further enhancing the intelligence of note cover generation.
[0122] (I) Intelligent Cover Generation for Text Notes
[0123] 1. Scenarios where text information is recorded in text notes.
[0124] The "scenarios in which text notes contain text information" mentioned here may include, but are not limited to: scenarios in which text notes contain only text information, scenarios in which text notes contain both text information and image information, etc.
[0125] Figure 3a , Figure 3b An exemplary illustration shows a scenario where a smart cover for generating text notes is displayed. For example... Figure 3a As shown in Figure (1), the electronic device displays a user interface 30 for a note-taking application, which includes a smart cover option 301. The smart cover option 301 is used to intelligently generate a cover for the user's notes.
[0126] It is understandable that the same control can be identified using different reference numerals in different examples, but the function of the control remains the same. Taking the smart cover option as an example, in the examples below, the smart cover option is identified using different reference numerals, such as smart cover option 401, smart cover option 501, etc., and the function of each smart cover option identified by different reference numerals is the same. It should be noted that this embodiment does not limit the display hierarchy of the smart cover option in the note-taking application's program interface. For example, the smart cover option can be set as a sub-option of the more options shown in user interface 30.
[0127] Continue to refer to Figure 3aIn the (1) note list of the user interface 30, there is a text note 302, the cover of which is shown as cover 3021. For example, after selecting text note 302, the user clicks the smart cover option 301. In response to this user action, the electronic device can display as shown in the image. Figure 3a The user interface 31 shown in Figure (2) includes a smart cover 3111 generated for the text notes 302. For example, the user interface 31 includes a smart cover window 311 displaying the smart cover 3111. The smart cover 3111 includes an image area 3111_1 and a text area 3111_2. The image area 3111_1 displays (or is filled with) a preset pattern. The text area 3111_2 displays summary information generated based on the text information recorded in the text notes 302. For example, the number of characters in the summary information is within a preset range, such as 50 ± n characters, where n is an integer and less than a preset threshold (e.g., 5, 10, etc.).
[0128] For example, the user interface 31 also includes a note name 3112 corresponding to the smart cover 3111, which is the note name of the text note 302. For example, the name 3112 of the text note 302 is displayed in the smart cover window 311. The name 3112 can be the same as or the same as the original name "Name 1" of the text note 302; that is, the name 3112 is the name of the regenerated text note 302, and this implementation does not limit this. For example, if the original name "Name 1" of the text note 302 is automatically generated by the electronic device, then the name 3112 can be different from the original name "Name 1" of the text note 302, in which case the electronic device regenerates the name of the text note 302. As another example, if the original name "Name 1" of the text note 302 is user-defined, then the name 3112 can be the same as the original name "Name 1" of the text note 302; that is, the electronic device does not adjust the user-defined note name when generating the smart cover of the text note 302.
[0129] After the electronic device displays the smart cover 3111 of its generated text note 302, the user can confirm the smart cover 3111 to trigger the electronic device to complete the adjustment operation of the cover of the text note 302. For example, continue to refer to... Figure 3a In section (2), the smart cover window 311 includes a confirmation option 3114. In response to the user clicking the confirmation option 3114, the electronic device can display, as shown below... Figure 3b The user interface 32 is shown. In user interface 32, the cover of text note 302 is cover 3022 (i.e., ...). Figure 3aThe smart cover 3111 shown in (2) is named the text note 302, which is also known as note name 3023. Figure 3a The note name shown in (2) is 3112). At this point, the electronic device has completed the optimization and adjustment of the cover of the text note 302.
[0130] like Figure 3c The diagram illustrates a process for generating a cover for a text note. In this scenario, the text note in the electronic device's note-taking application, for which a cover needs to be regenerated, contains text information. (Refer to...) Figure 3c The process for generating a text note cover provided in this application embodiment may include:
[0131] 1.1 In response to the user selecting a target text note in the note-taking application and clicking the "Smart Cover" option, the electronic device sends the text information recorded in the target text note to the cloud server.
[0132] The target text note can be any text note containing text information in the note list of the note application.
[0133] 1.2 After receiving the text information, the cloud server generates a summary of the text information based on a preset model.
[0134] For example, the number of characters in the summary information is within a preset range, such as m ± n characters, where m and n are integers, and n is less than a preset threshold (e.g., 5, 10, etc.). For example, m is 50.
[0135] For example, the preset model can be obtained by training the original machine learning model (i.e., the untrained machine learning model) with a large number of training samples. For example, each set of training samples includes text information and its corresponding summary information. This embodiment does not limit the neural network structure of the preset model.
[0136] 1.3 The cloud server returns a summary of the text information to the electronic device.
[0137] 1.4 The electronic device generates a cover for the target text note based on a preset cover style and summary information, and displays the cover for the target text note.
[0138] In this process, after obtaining the summary information, the electronic device adds the summary information to a preset style cover to obtain the cover of the target text note. For example, the preset style cover includes an image area and a text area. After obtaining the summary information, the electronic device adds the summary information to the text area of the preset style cover to obtain the cover of the target text note. This can be referred to... Figure 3a The smart cover 3111 shown in (2) is shown in the middle.
[0139] As an optional implementation, if the number of characters in the target text note received by the cloud server is small, for example, less than a certain threshold (such as 50 or 60), the cloud server can directly return the text information to the electronic device. Then, the electronic device generates a cover for the target text note based on a preset cover style and this text information, and displays the cover. Alternatively, if the number of characters in the target text note is small, the electronic device can directly generate a cover for the target text note based on a preset cover style and this text information, and display the cover. That is, when the number of characters in the target text note is small, the electronic device does not need to interact with the cloud server; the smart cover is automatically generated locally.
[0140] If the target text note received by the cloud server contains a large number of characters, such as exceeding a certain threshold, the cloud server generates a summary of the text information based on a preset model and returns the summary to the electronic device. The electronic device then generates a cover for the target text note based on a preset cover style and the summary information, and displays the cover.
[0141] Optionally, after receiving the text information, the cloud server can also generate a note name corresponding to the text information based on a preset model and return the note name to the electronic device. For example, the number of characters in the note name is less than a preset threshold. Figure 3a In the example shown in (2), the note name 3112 can be generated by a cloud server.
[0142] Optionally, if the name of the target text note is not user-defined, the electronic device sends the text information of the target text note to the cloud server to request the cloud server to generate summary information, and also requests the cloud server to generate a note name based on the text information. If the name of the target text note is user-defined, the electronic device sends the text information of the target text note to the cloud server and only requests the cloud server to generate summary information. In this way, the electronic device will not adjust the user-defined note name, avoiding confusion for the user.
[0143] In this embodiment, after the electronic device displays the smart cover it generates for a text note, the user can also edit the smart cover, such as editing at least one of the following: the pattern, color, content displayed on the cover, and the name of the text note.
[0144] In this embodiment, after the electronic device displays the smart cover 3111 of the generated text notes 302, the user can edit the smart cover 3111 and / or the name of the text notes 302. Specifically, the user can edit the pattern, color scheme, and text content displayed on the smart cover 3111.
[0145] For example, continue to refer to Figure 3a In the middle (2), the smart cover window 311 may include editing options 3113. In response to a user clicking the editing option 3113, the electronic device may display, as shown below... Figure 3d The user interface 33 shown is included. The user interface 33 may include an editing cover window 331. For example, the editing cover window 331 may include a cover effect display area 3311, a note name 3312, a cover pattern color selection area 3313, and a cover pattern selection area 3314. The cover effect display area 3311 displays the currently generated smart cover; the note name 3312 is the current name of the text note 302; the cover pattern color selection area 3313 displays the supported colors and the currently selected color; and the cover pattern selection area 3314 displays the available patterns and the currently selected pattern.
[0146] Understandably, the smart cover 3311_1 initially displayed in the cover effect display area 3311 is the smart cover 3111 itself. As the color selected by the user in the cover pattern color selection area 3313 changes, and / or as the pattern selected by the user in the cover pattern selection area 3314 changes, the content displayed in the image area 3311_11 of the smart cover 3311_1 changes accordingly.
[0147] Optionally, users can edit the text displayed in the text area 3311_12 of the smart cover 3311_1. Optionally, users can also edit the note name 3312.
[0148] For example, when a user completes relevant editing operations in the cover editing window 331, the user can click the confirmation control 3315. In response to this user operation, the electronic device saves the currently displayed smart cover 3311_1 in the cover editing window 331 and updates the cover of the text note 302 according to the smart cover 3311_1. For example, in response to the user clicking the confirmation control 3315, the electronic device can display, for example... Figure 3a The user interface shown in (2) differs in that the smart cover window in this user interface displays smart cover 3311_1, and then after the user confirms again (such as clicking the confirmation control 3114), the electronic device can display, for example... Figure 3bThe user interface shown differs in that the cover of text note 302 in this user interface is a smart cover 3311_1. Furthermore, for example, in response to the user clicking the confirmation control 3315, the electronic device can directly display, for example... Figure 3b The user interface shown differs in that the cover of text note 302 is a smart cover 3311_1. At this point, the electronic device has completed the optimization and adjustment of the cover of text note 302.
[0149] It should be pointed out that, Figure 3d The user interface 33 shown is an exemplary user interface for editing a note cover. It will be understood that this embodiment may also provide more editing options for the smart cover for the user. For example, the user can select a custom image to fill the image area 3311_11 of the smart cover 3311_1. For example, the user can adjust the orientation of the smart cover 3111, for example, changing the layout of the smart cover 3111 from portrait to landscape. For example, the user can adjust the cover style of the smart cover 3111. Figure 3d The cover style shown is an example of one, where the upper half of the cover displays a pattern and the lower half displays summary note information. This is an example. In an alternative cover style, the cover displays a pattern around its perimeter and summary note information in the center; alternatively, the left half of the cover displays a pattern and the right half displays summary note information. This embodiment does not limit the cover style.
[0150] 2. Scenarios where voice information is recorded in text notes.
[0151] The "scenarios in which text notes contain audio information" mentioned here may include, but are not limited to: scenarios in which text notes contain only audio information, scenarios in which text notes contain both audio and image information, etc.
[0152] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous sections on the scenario of generating smart covers for text notes using electronic devices, and the scenario of editing the generated smart covers. For details, please refer to... Figure 3a , Figure 3b , Figure 3d As shown, it will not be elaborated further here.
[0153] like Figure 3e The diagram illustrates a process for generating a cover for a text note. In this scenario, the text note in the electronic device's note-taking application, for which a cover needs to be regenerated, contains voice information. (Refer to...) Figure 3e The process for generating a text note cover provided in this application embodiment may include:
[0154] 2.1 In response to the user selecting a target text note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs speech recognition on the voice information in the target text note to obtain the text information.
[0155] The target text note can be any text note in the note-taking application's note list that includes voice information.
[0156] For example, electronic devices can use ASR (Automatic Speech Recognition) technology to perform speech recognition on voice information in target text notes to obtain text information. Existing technologies can be referenced for ASR technology, which will not be elaborated upon here.
[0157] 2.2 Electronic devices send the text information they have identified to the cloud server.
[0158] 2.3 After receiving the text information, the cloud server generates a summary of the text information based on a preset model.
[0159] 2.4 The cloud server returns a summary of the text information to the electronic device.
[0160] 2.5 The electronic device generates a cover for the target text note based on a preset cover style and summary information, and displays the cover for the target text note.
[0161] For any parts of this process that are not explained in detail, please refer to the previous text; they will not be repeated here.
[0162] Similarly, if the number of characters in the text information obtained from recognizing the speech information in the target text note is small, the electronic device generates a cover for the target text note based on a preset cover style and this text information, and then displays the cover. If the number of characters in the text information obtained from recognizing the speech information in the target text note is large, the cloud server generates a summary of the text information based on a preset model and returns the summary information to the electronic device. Then, the electronic device generates a cover for the target text note based on the preset cover style and the summary information, and then displays the cover.
[0163] 3. Scenarios where text and voice information are recorded in text notes.
[0164] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous sections on the scenario of generating smart covers for text notes using electronic devices, and the scenario of editing the generated smart covers. For details, please refer to... Figure 3a , Figure 3b , Figure 3d As shown, it will not be elaborated further here.
[0165] like Figure 3f The diagram illustrates a process for generating a cover for a text note. In this scenario, the text note in the electronic device's note-taking application, for which a cover needs to be regenerated, contains both text and voice information. (Refer to...) Figure 3f The process for generating a text note cover provided in this application embodiment may include:
[0166] 3.1 In response to the user selecting a target text note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs speech recognition on the voice information in the target text note to obtain the text information.
[0167] The target text note can be any text note in the note-taking application's note list that contains both text and voice information.
[0168] 3.2 The electronic device sends the text information it recognizes and the text information recorded in the target text note to the cloud server.
[0169] 3.3 After receiving these text messages, the cloud server generates a summary of these text messages based on a preset model.
[0170] 3.4 The cloud server returns a summary of these text messages to the electronic device.
[0171] 3.5 The electronic device generates a cover for the target text note based on a preset cover style and summary information, and displays the cover for the target text note.
[0172] For any parts of this process that are not explained in detail, please refer to the previous text; they will not be repeated here.
[0173] In this scenario, as an optional implementation, after the electronic device performs speech recognition on the speech information in the target text note to obtain text information, it can compare the text information recorded in the target text note with the text information obtained from the speech recognition. If the amount of text information recorded in the target text note is much larger than the amount of text information obtained from the speech recognition, the electronic device will use... Figure 3c The process shown is that the cloud server generates a summary based on the text information recorded in the target text note; if the amount of text information recorded in the target text note is much less than the amount of text information obtained from recognizing the speech information, the electronic device uses... Figure 3e The process shown is that the cloud server generates a summary based on the voice information recorded in the target text note; if the amount of text information recorded in the target text note is roughly equal to the amount of text information obtained from recognizing the voice information, the electronic device uses... Figure 3fThe process shown is that the cloud server combines the voice and text information recorded in the target text notes to generate a summary. "Much more than" and "much less than" can be understood as a significant difference between the two, for example, a difference greater than a preset threshold. Conversely, "approximately equal" can be understood as a significant difference between the two, for example, a difference less than or equal to a preset threshold.
[0174] 4. Scenarios where text notes only include image information
[0175] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous sections on the scenario of generating smart covers for text notes using electronic devices, and the scenario of editing the generated smart covers. For details, please refer to... Figure 3a , Figure 3b , Figure 3d As shown, it will not be elaborated further here.
[0176] like Figure 3g The diagram illustrates a process for generating a cover for a text note. In this scenario, the text note in the electronic device's note-taking application, for which a cover needs to be regenerated, only contains image information. (Refer to...) Figure 3g The process for generating a text note cover provided in this application embodiment may include:
[0177] 4.1 In response to the user selecting a target text note in the note-taking application and clicking the "Smart Cover" option, the electronic device sends the image information of the target text note to the cloud server.
[0178] The target text note can be any text note in the note list of the note application that only records image information. In this embodiment, the number of images recorded in the target text note is not limited.
[0179] For example, an electronic device may send the first image information in the target text note to the cloud server, or it may send all the image information in the target text note to the cloud server; this embodiment does not limit this.
[0180] 4.2 After receiving the image information, the cloud server generates a summary of the image information based on a preset model.
[0181] For example, the preset model can generate a summary of the image information based on graph-to-text technology.
[0182] 4.3 The cloud server returns a summary of the image information to the electronic device.
[0183] 4.4 The electronic device generates a cover for the target text note based on a preset cover style and summary information, and displays the cover for the target text note.
[0184] In this process, after obtaining the summary information, the electronic device adds the summary information to a preset style cover to obtain the cover of the target text note. For example, the preset style cover includes an image area and a text area. After obtaining the summary information of the image information, the electronic device adds the summary information of the image information to the text area of the preset style cover to obtain the cover of the target text note. The image area of the preset style cover can be filled with a preset pattern or with the first image recorded in the target text note; this embodiment does not limit this. It is understood that users can edit the cover of the target text note intelligently generated by the electronic device.
[0185] For any parts of this process that are not explained in detail, please refer to the previous text; they will not be repeated here.
[0186] (II) Intelligent Cover Generation for Handwritten Notes
[0187] 1. Scenarios where handwritten notes contain handwritten text (or handwritten content).
[0188] The "scenarios in which handwritten notes contain handwritten text" mentioned here may include, but are not limited to: scenarios in which handwritten notes contain only handwritten text, scenarios in which handwritten notes contain both handwritten text and image information, etc.
[0189] (1) An optional implementation
[0190] Figure 4a , Figure 4b An exemplary illustration shows a scenario where a smart cover for generating handwritten notes is provided. Figure 4a As shown in Figure (1), the electronic device displays a user interface 40 for a note-taking application, which includes a smart cover option 401.
[0191] Continue to refer to Figure 4a In the (1) note list of the user interface 40, there is a handwritten note 402, the cover of which is shown as cover 4021. For example, after selecting handwritten note 402, the user clicks the smart cover option 401. In response to this user action, the electronic device can display as shown in the image. Figure 4a The user interface 41 shown in (2) includes a smart cover 4111 generated for the handwritten notes 402. For example, the user interface 41 includes a smart cover window 411 displaying the smart cover 4111. Users can swipe left and right within the smart cover window 411 to view more smart covers generated by the electronic device for the handwritten notes 402. Each smart cover of the handwritten notes 402 displays a summary of the handwritten content recorded in the handwritten notes 402. On each smart cover, the summary information can be displayed in the form of handwritten characters.
[0192] For example, on each smart cover, summary information can be displayed through enhanced handwriting. In this way, users can clearly understand the type of notes through the handwriting on the smart cover, and the enhanced handwriting improves the user's visual experience.
[0193] Taking the smart cover 4111 as an example, the summary information displayed on it can be shown in the form of handwriting beautification style 1. Optionally, on other smart covers generated by the electronic device for the handwritten notes 402, the summary information can be shown in the form of other handwriting beautification styles. For example, the number of characters in the summary information is within a preset range, such as a preset range of 50 ± n characters, where n is an integer and n is less than a preset threshold (e.g., 5, 10, etc.).
[0194] For example, each smart cover generated by the electronic device for the handwritten note 402 can be filled with a preset color or pattern as the background for the summary information; this embodiment does not limit this. However, the background and / or the handwritten font beautification style used for the summary information displayed on different smart covers generated by the handwritten note 402 are not entirely the same.
[0195] For example, the user interface 41 also includes a note name 4112 corresponding to the smart cover 4111, which is the note name of the handwritten note 402. For example, the name 4112 of the handwritten note 402 is displayed in the smart cover window 411. The name 4112 can be the same as or the same as the original name "Name 4" of the handwritten note 402; that is, the name 4112 is the regenerated name of the handwritten note 402, and this implementation does not limit this. For example, if the original name "Name 4" of the handwritten note 402 is automatically generated by the electronic device, then the name 4112 can be different from the original name "Name 4" of the handwritten note 402, in which case the electronic device regenerates the name of the handwritten note 402. For example, if the original name "Name 4" of the handwritten note 402 is set by the user, then Name 4112 can be the same as the original name "Name 4" of the handwritten note 402. That is, when the electronic device generates the smart cover of the handwritten note 402, it does not adjust the note name of the user-defined device.
[0196] After the electronic device displays the smart cover 4111 of its generated handwritten note 402, the user can confirm the smart cover 4111 to trigger the electronic device to complete the adjustment operation of the cover of the handwritten note 402. For example, continue to refer to... Figure 4a In the middle (2), the smart cover window 411 includes a confirmation option 4114. In response to the user clicking the confirmation option 4114, the electronic device can display, as shown below... Figure 4bThe user interface 42 is shown. In user interface 42, the cover of the handwritten note 402 is cover 4022 (i.e., ...). Figure 4a The smart cover 4111 shown in (2) is named the handwritten note 402, and the note name is 4023 (that is, the note name 4023). Figure 4a The note name shown in (2) is 4112). At this point, the electronic device has completed the optimization and adjustment of the cover of the handwritten note 402.
[0197] like Figure 4c The diagram illustrates a process for generating a cover for a handwritten note. In this scenario, the handwritten note containing the cover to be regenerated in the electronic device's note-taking application contains handwritten text. (Refer to...) Figure 4c The process for generating a handwritten note cover provided in this application embodiment may include:
[0198] 5.1 In response to the user selecting a target handwritten note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs OCR (Optical Character Recognition) processing on the handwritten content recorded in the target handwritten note to obtain text information corresponding to the handwritten content.
[0199] The target handwritten note can be any handwritten note in the note list of the note-taking application that contains handwritten content.
[0200] 5.2 The electronic device sends the recognized text information to the cloud server.
[0201] 5.3 After receiving the text information, the cloud server generates a summary of the text information based on a preset model.
[0202] For example, the number of characters in the summary information is within a preset range, such as m ± n characters, where m and n are integers, and n is less than a preset threshold (e.g., 5, 10, etc.). For example, m is 50.
[0203] 5.4 The cloud server returns a summary of the text information to the electronic device.
[0204] 5.5 The electronic device generates and displays the cover of the target handwritten note based on the preset handwriting beautification style and summary information.
[0205] Optionally, after receiving the summary information, the electronic device displays the summary information in a blank cover with a preset handwriting enhancement style to obtain the cover of the target handwritten note. Optionally, after receiving the summary information, the electronic device can also display the summary information in a note cover filled with a preset color or preset pattern with a preset handwriting enhancement style to obtain the cover of the target handwritten note.
[0206] If the number of characters in the handwritten content recorded in the target handwritten note is small, for example, less than or equal to the number threshold, the electronic device can directly generate the cover of the target handwritten note by performing OCR processing on the handwritten content according to the preset handwriting beautification style. If the number of characters in the text information (obtained by OCR processing of the handwritten content) received by the cloud server is large, for example, greater than the number threshold, the electronic device generates the cover of the target handwritten note according to the preset handwriting beautification style and summary information.
[0207] Optionally, after receiving the text information, the cloud server can also generate a note name corresponding to the text information based on a preset model and return the note name to the electronic device. For example, the number of characters in the note name is less than a preset threshold. Figure 4a In the example shown in (2), the note name 4112 can be generated by a cloud server.
[0208] Optionally, if the name of the target handwritten note is not user-defined, the electronic device sends the text information of the target handwritten note to the cloud server to request the cloud server to generate summary information, and also requests the cloud server to generate a note name based on the text information. If the name of the target handwritten note is user-defined, the electronic device sends the text information of the target handwritten note to the cloud server and only requests the cloud server to generate summary information. In this way, the electronic device will not adjust the user-defined note name, avoiding confusion for the user.
[0209] In this embodiment, after the electronic device displays the smart cover it generates for a handwritten note, the user can also edit the smart cover, such as editing at least one of the following: the content displayed on the smart cover, the handwriting beautification style used in the content, the name of the handwritten note, and the background fill of the cover.
[0210] For example, continue to refer to Figure 4a In section (2), the smart cover window 411 may include editing options 4113. In response to the user clicking the editing option 4113, the electronic device can display the smart cover editing interface. When the user completes the relevant editing operations in the smart cover editing interface, they can click the confirmation control to trigger the electronic device to save the smart cover and update the cover of the corresponding handwritten note based on the saved smart cover. At this point, the electronic device has completed the optimization and adjustment of the cover of the handwritten note 402.
[0211] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0212] (2) Another alternative implementation
[0213] Figure 4d , Figure 4eAn exemplary schematic diagram illustrates a scenario for generating a smart cover for handwritten notes. About Figure 4d (1) can be found in the section on Figure 4a The explanation of (1) will not be repeated here. In response to the user's action of clicking the smart cover option 401 after selecting handwritten notes 402, the electronic device can display as follows: Figure 4d The user interface 43 shown in Figure (2) displays a smart cover 4311 in the smart cover window 431. Users can swipe left and right in the smart cover window 431 to view more smart covers generated by the electronic device for the handwritten notes 402. Each smart cover of the handwritten notes 402 displays a summary of the handwritten content recorded in the handwritten notes 402.
[0214] On each smart cover, the summary information can be displayed in the form of handwritten text. For example, on each smart cover, the summary information can be displayed in a beautified handwritten text style. Taking smart cover 4311 as an example, the summary information displayed on it can be displayed in the form of handwritten text beautification style 1. Optionally, on other smart covers generated by the electronic device for the handwritten notes 402, the summary information can be displayed in the form of other handwritten text beautification styles. For example, the number of characters in the summary information is within a preset range, for example, a preset range of 50 ± n characters, where n is an integer and n is less than a preset threshold (e.g., 5, 10, etc.).
[0215] For example, each smart cover generated by the electronic device for the handwritten note 402 can be filled with a scene image that matches the summary information. For instance, smart cover 4311 is filled with scene image 1 that matches the summary of the handwritten content recorded by the handwritten note 402. The scene images filled and / or the handwriting enhancement styles used for the summary information displayed on different smart covers generated for the handwritten note 402 are not entirely the same.
[0216] For example, the user interface 43 also includes a note name 4312 corresponding to the smart cover 4311. An explanation of the note name 4312 can be found in the preceding section on note name 4112, and will not be repeated here.
[0217] After the electronic device displays the smart cover 4311 of its generated handwritten notes 402, the user can confirm the smart cover 4311 through the confirmation option, allowing the electronic device to display as shown below. Figure 4e The user interface 44 is shown. The cover of the handwritten note 402 is cover 4024 (i.e.,...). Figure 4d The smart cover 4311 shown in (2) is named the handwritten note 402, which is also known as the note name 4025. Figure 4dThe note title 4312 is shown in (2). At this point, the electronic device has completed the optimization and adjustment of the cover of the handwritten note 402.
[0218] like Figure 4f The diagram illustrates a process for generating a cover for a handwritten note. In this scenario, the handwritten note containing the cover to be regenerated in the electronic device's note-taking application contains handwritten text. (Refer to...) Figure 4f The process for generating a handwritten note cover provided in this application embodiment may include:
[0219] 6.1 In response to the user selecting a target handwritten note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note to obtain text information corresponding to the handwritten content.
[0220] The target handwritten note can be any handwritten note in the note list of the note-taking application that contains handwritten content.
[0221] 6.2 The electronic device sends the recognized text information to the cloud server.
[0222] 6.3 After receiving the text information, the cloud server generates a summary of the text information based on a preset model and generates a scene image that matches the summary information.
[0223] For example, the cloud server can classify and label the summary information into scenes based on the classification and inductive capabilities of a preset model. The types of scenes can include, but are not limited to, traditional Chinese poetry, office work, daily life, and painting. Then, the cloud server can select at least one scene image that matches the summary information based on the scene classification labels. Alternatively, the cloud server can select at least one scene image that matches the summary information based on both the scene classification labels and the content of the summary information.
[0224] 6.4 The cloud server returns a summary of the text information to the electronic device, as well as at least one scene image that matches the summary information.
[0225] 6.5 The electronic device generates the cover of the target handwritten note based on the preset handwriting beautification style, summary information and scene image, and displays the cover of the target handwritten note.
[0226] Optionally, after obtaining the summary information, the electronic device fills a blank cover with a scene image that matches the summary information and adds the summary information to the scene image. The summary information is displayed in a preset handwriting beautification style, thereby obtaining a cover of the target handwritten note.
[0227] Understandably, if the cloud server returns multiple scene images matching the summary information to the electronic device, the electronic device will generate multiple note covers with different scene images. When the electronic device adjusts the handwriting enhancement style for displaying the summary information, it can generate even more note covers with different scene images.
[0228] If the number of characters in the handwritten content recorded in the target handwritten note is small, such as less than or equal to the number threshold, the electronic device can directly generate the cover of the target handwritten note based on the preset handwriting beautification style, the text information obtained by OCR processing of the handwritten content, and the scene image.
[0229] If the number of characters in the text information received by the cloud server (obtained by OCR processing of handwritten content) is large, such as exceeding the number threshold, the electronic device will generate the cover of the target handwritten note based on the preset handwriting beautification style, summary information, and scene image.
[0230] Optionally, after receiving the text information, the cloud server can also generate a note name corresponding to the text information based on a preset model and return the note name to the electronic device.
[0231] In this embodiment, after the electronic device displays the smart cover it generates for a handwritten note, the user can also edit the smart cover, such as editing at least one of the following: the content displayed on the smart cover, the handwriting beautification style used in the content, the name of the handwritten note, and the scene image filled in the cover.
[0232] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0233] (3) Another alternative implementation method
[0234] Figure 4g , Figure 4h An exemplary schematic diagram illustrates a scenario for generating a smart cover for handwritten notes. About Figure 4g (1) can be found in the section on Figure 4a The explanation of (1) will not be repeated here. In response to the user's action of clicking the smart cover option 401 after selecting handwritten notes 402, the electronic device can display as follows: Figure 4g The user interface 45 shown in Figure (2) has a smart cover window 451 that can display multiple smart covers. Each smart cover displays a beautiful image that matches a summary of the handwritten content recorded in the handwritten notes 402, and the beautiful images displayed on different smart covers are different. The user can select one of these multiple smart covers as the optimized cover for the handwritten notes 402.
[0235] For example, four smart covers are displayed in smart cover window 451, such as smart cover 4511, smart cover 4512, smart cover 4513, and smart cover 4514. It is understandable that in such... Figure 4g In the example shown in (2), the smart cover 4511 is highlighted, which is a smart cover selected by the user. The user can switch the selected smart cover by clicking on a smart cover in the smart cover window 451.
[0236] Understandable, such as Figure 4g The display method of the multiple smart covers shown in (2) is only an example, and these multiple smart covers can also be displayed in accordance with... Figure 4d As shown in the display method in (2), this embodiment does not limit the display method of multiple smart covers of handwritten notes.
[0237] For example, the user interface 45 also includes a note name corresponding to the smart cover of the handwritten note 402. An explanation of this note name can be found in the previous section on note name 4112, and will not be repeated here.
[0238] After the electronic device displays the smart cover 4511 of its generated handwritten notes 402, the user can confirm the smart cover 4511 through the confirmation option, allowing the electronic device to display as shown below. Figure 4h The user interface 46 is shown. The cover of the handwritten note 402 is cover 4026 (i.e.,...). Figure 4g The smart cover 4511 shown in (2) is named the handwritten note 402, which is also known as the note name 4027. Figure 4g (The note name shown in (2)). At this point, the electronic device has completed the optimization and adjustment of the cover of the handwritten note 402.
[0239] like Figure 4i The diagram illustrates a process for generating a cover for a handwritten note. In this scenario, the handwritten note containing the cover to be regenerated in the electronic device's note-taking application contains handwritten text. (Refer to...) Figure 4i The process for generating a handwritten note cover provided in this application embodiment may include:
[0240] 7.1 In response to the user selecting a target handwritten note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note to obtain text information corresponding to the handwritten content.
[0241] The target handwritten note can be any handwritten note in the note list of the note-taking application that contains handwritten content.
[0242] 7.2 The electronic device sends the recognized text information to the cloud server.
[0243] 7.3 After receiving the text information, the cloud server generates a summary of the text information based on a preset model, and generates at least one cover image that matches the summary information.
[0244] For example, after generating a summary of the text information based on a preset model, the cloud server can generate at least one cover image that matches the summary information using text-to-image technology. As the name suggests, the cover image is the image displayed on the cover of the handwritten notes.
[0245] 7.4 The cloud server returns at least one cover image to the electronic device.
[0246] 7.5 The electronic device generates a cover for the target handwritten note based on the cover image and displays the cover of the target handwritten note.
[0247] The electronic device can generate a smart cover for the target handwritten note based on each cover image it receives. Thus, the electronic device can generate multiple smart covers for the target handwritten note based on multiple received cover images, allowing the user to choose.
[0248] Optionally, after receiving the text information, the cloud server can also generate a note name corresponding to the text information based on a preset model and return the note name to the electronic device.
[0249] In this embodiment, after the electronic device displays the smart cover it generates for a handwritten note, the user can also edit the smart cover, such as editing at least one of the following: the name of the handwritten note, the cover image, etc.
[0250] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0251] 2. Scenarios where handwritten notes contain documents
[0252] In this scenario, the documents imported into the handwritten notes can include, but are not limited to, PDF documents, Word documents, TXT documents, etc.
[0253] Figure 5a , Figure 5b An exemplary illustration shows a scenario where a smart cover for generating handwritten notes is provided. Figure 5aAs shown in (1), the user interface 50 of the note-taking application includes a smart cover option 501. The note list includes handwritten notes 502, which contain imported PDF documents. The cover of the handwritten notes 502 is shown as cover 5021. For example, in response to a user clicking the smart cover option 501 after selecting the handwritten notes 502, the electronic device can display as shown in [image 1]. Figure 5a The user interface 51 shown in Figure (2) displays a smart cover 5111 in the smart cover window 511. The smart cover 5111 includes an image area 5111_1 and a text area 5111_2. The image area 5111_1 displays a preset pattern. The text area 5111_2 displays summary information generated based on the first page text information of the PDF document imported from the handwritten notes 302. For example, the number of characters in the summary information is within a preset range, such as 50 ± n characters, where n is an integer and less than a preset threshold (e.g., 5, 10, etc.).
[0254] For example, the user interface 51 also includes a note name 5112 corresponding to the smart cover 5111, which is also the note name of the handwritten note 502. The explanation of the note name 5112 can be found in the name 3112 mentioned above, and will not be repeated here.
[0255] For example, continue to refer to Figure 5a In (2), in response to the user clicking the confirmation option 5114, the electronic device can display as follows: Figure 5b The user interface 52 is shown. In user interface 52, the cover of the handwritten note 502 is cover 5022 (i.e., ...). Figure 5a The smart cover 5111 shown in (2) is named the handwritten note 502, which is also called the note name 5023. Figure 5a The note name shown in (2) is 5112. At this point, the electronic device has completed the optimization and adjustment of the cover of the handwritten note 502.
[0256] like Figure 5c The diagram illustrates a process for generating a cover for a handwritten note. In this scenario, the handwritten note containing the cover to be regenerated in the electronic device's note-taking application contains a PDF document. (Refer to...) Figure 5c The process for generating a handwritten note cover provided in this application embodiment may include:
[0257] 8.1 In response to the user selecting a target handwritten note in the note-taking application and clicking the "Smart Cover" option, the electronic device performs OCR processing on the first page content of the imported PDF document in the target handwritten note to obtain the text information corresponding to the first page of the PDF document.
[0258] The target handwritten note can be any handwritten note in the note list of the note-taking application that has a PDF document imported into it.
[0259] Optionally, step 8.1 can also be adjusted to respond to the user's operation of selecting the target handwritten note in the note-taking application and clicking the "Smart Cover" option, in which the electronic device performs OCR processing on all the content of the PDF document imported into the target handwritten note to obtain the text information corresponding to the PDF document.
[0260] 8.2 The electronic device sends the recognized text information to the cloud server.
[0261] 8.3 After receiving the text information, the cloud server generates a summary of the text information based on a preset model.
[0262] For example, the number of characters in the summary information is within a preset range, such as m ± n characters, where m and n are integers, and n is less than a preset threshold (e.g., 5, 10, etc.). For example, m is 50.
[0263] 8.4 The cloud server returns a summary of the text information to the electronic device.
[0264] 8.5 The electronic device generates a cover for the target handwritten note based on a preset cover style and summary information, and displays the cover of the target handwritten note.
[0265] In this process, after receiving the summary information, the electronic device adds it to a preset cover style to obtain the cover of the target handwritten note. For example, the preset cover style includes an image area and a text area. After receiving the summary information, the electronic device adds it to the text area of the preset cover style to obtain the cover of the target handwritten note. This can be referred to... Figure 5a The smart cover 5111 shown in (2) is shown in the middle.
[0266] If the number of characters in the PDF document or the first page of the PDF document imported by the target handwritten notes is small, for example, less than the number threshold, the electronic device will generate the cover of the target handwritten notes according to the preset cover style and the text information obtained by OCR processing of the content of the PDF document or the first page of the PDF document.
[0267] If the number of characters in the text information received by the cloud server (obtained by OCR processing of the PDF document or the content of the first page of the PDF document) is large, for example, exceeding the quantity threshold, the electronic device will generate the cover of the target handwritten note based on the preset cover style and this text information.
[0268] Optionally, after receiving the text information, the cloud server can also generate a note name corresponding to the text information based on a preset model and return the note name to the electronic device. For example, the number of characters in the note name is less than a preset threshold.
[0269] In this embodiment, after the electronic device displays the smart cover it generates for a handwritten note in an imported PDF document, the user can also edit the smart cover, such as editing at least one of the following: the pattern, color, content displayed on the cover, and the name of the handwritten note.
[0270] For example, continue to refer to Figure 5a In (2), in response to the user clicking the edit option 5113, the electronic device can display as follows: Figure 5d The editing interface 53 shown is included. The editing interface 53 may include an editing cover window 531. For example, the editing cover window 531 may include a cover effect display area 5311, a note name 5312, a cover direction editing area 5313, a cover pattern color selection area 5314, a cover style selection area 5315, and a cover pattern selection area 5316.
[0271] Understandably, the Smart Cover 5311_1 initially displayed in the cover effect display area 5311 is the Smart Cover 5111 itself. As the user performs adjustments in the editing interface 53, the Smart Cover 5311_1 displayed in the cover effect display area 5311 changes accordingly, or the content displayed in the image area 5311_11 of the Smart Cover 5311_1 changes accordingly. Optionally, the user can edit the text displayed in the text area 5311_12 of the Smart Cover 5311_1. Optionally, the user can also edit the note name 5312.
[0272] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0273] The above explanation uses the example of importing a PDF document into the target handwritten notes. It is understandable that the same applies when other types of documents, which cannot be directly edited by other users and require OCR processing to obtain text information, are imported into the target handwritten notes; therefore, this will not be elaborated upon further, and this embodiment does not limit the document type.
[0274] For example, taking a target handwritten note containing imported Word and TXT documents as an example, the human-computer interaction scenario can refer to the example of a target handwritten note containing imported PDF documents. For details, please refer to... Figure 5a , Figure 5b , Figure 5dAs shown, this will not be elaborated upon further. Since the content of Word and TXT documents is directly editable by the user, there is no need to perform OCR processing on the document content. Therefore, when importing directly editable text documents such as Word and TXT documents into the target handwritten notes, the difference is... Figure 5c The process shown, sections 8.1 and 8.2, needs to be adjusted to: "In response to the user selecting a target handwritten note in the note-taking application and clicking the 'Smart Cover' option, the electronic device sends all information or the first page information of the document imported into the target handwritten note to the cloud server." Further details not explained here can be found in the preceding text and will not be repeated here.
[0275] 3. Scenarios where handwritten notes contain handwritten content and imported documents are also present.
[0276] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous section on the scenario of generating smart covers for handwritten notes using electronic devices. For details, please refer to... Figures 4a-4b As shown, or refer to Figures 4d-4e As shown, or refer to Figure 4g-Figure 4h As shown, or refer to Figures 5a-5b As shown, it will not be elaborated further here.
[0277] Optionally, in this scenario, the process for generating the handwritten note cover can be referenced. Figure 4c or Figure 4f or Figure 4i or Figure 5c The process is shown. The difference lies in... Figure 4c or Figure 4f or Figure 4i or Figure 5c The process shown is as follows: Figure 4c Step 5.1 or Figure 4f Step 6.1 or Figure 4i Step 7.1 or Figure 5c Step 8.1 needs to be adjusted to "In response to the user's operation of selecting the target handwritten note in the note-taking application and clicking the 'Smart Cover' option, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note and the content or first page content of the imported PDF document to obtain text information."
[0278] In this scenario, as an optional implementation, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note to obtain handwritten text information, and performs OCR processing on the content of an imported PDF document or the first page of a PDF document to obtain document text information. The electronic device can then compare the obtained handwritten text information and document text information.
[0279] If the amount of information in handwritten text is much greater than that in document text, then electronic devices can use... Figure 4c or Figure 4f or Figure 4i The process is shown; if the amount of handwritten text is much less than the amount of document text, then electronic devices can use... Figure 5c The process is illustrated; if the amount of handwritten text information and the amount of document text information are roughly equal, then the electronic device can adopt the adjustment mentioned in this scenario. Figure 4c The process after step 5.1, or adjustments. Figure 4f The process after step 6.1, or adjustments. Figure 4i The process after step 7.1, or adjustments. Figure 5c The process after step 8.1.
[0280] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0281] 4. Scenarios where handwritten notes contain voice information
[0282] The "scenarios in which handwritten notes contain audio information" mentioned here may include, but are not limited to: scenarios in which handwritten notes contain only audio information, scenarios in which handwritten notes contain both handwritten and image information, etc.
[0283] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous section on the scenario of generating smart covers for handwritten notes using electronic devices. For details, please refer to... Figures 4a-4b As shown, or refer to Figures 4d-4e As shown, or refer to Figure 4g-Figure 4h As shown, or refer to Figures 5a-5b As shown, it will not be elaborated further here.
[0284] Optionally, in this scenario, the process for generating the handwritten note cover can be referenced. Figure 4c or Figure 4f or Figure 4i or Figure 5c The process is shown. The difference lies in... Figure 4c or Figure 4f or Figure 4i Or the process shown in 5c, Figure 4c Step 5.1 or Figure 4f Step 6.1 or Figure 4i Step 7.1 or Figure 5c Step 8.1 needs to be adjusted to "In response to the user's operation of selecting the target handwritten note in the note-taking application and clicking the 'Smart Cover' option, the electronic device performs speech recognition on the voice information recorded in the target handwritten note to obtain the text information."
[0285] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0286] Understandably, similar to this scenario, human-computer interaction in situations where text notes contain voice information can also be referenced in the previous section on electronic devices generating smart covers for handwritten notes. For details, please refer to... Figures 4a-4b As shown, or refer to Figures 4d-4e As shown, or refer to Figure 4g-Figure 4h As shown, or refer to Figures 5a-5b As shown, the process will not be repeated here. Correspondingly, the process for generating a handwritten note cover can be found in [reference needed]. Figure 4c or Figure 4f or Figure 4i or Figure 5c The process is shown. The difference lies in... Figure 4c or Figure 4f or Figure 4i Or the process shown in 5c, Figure 4c Step 5.1 or Figure 4f Step 6.1 or Figure 4i Step 7.1 or Figure 5c Step 8.1 needs to be adjusted to "In response to the user selecting a target text note in the note-taking application and clicking the 'Smart Cover' option, the electronic device performs speech recognition on the voice information recorded in the target text note to obtain the text information."
[0287] 5. Scenarios where handwritten notes contain both handwritten content and voice information.
[0288] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous section on the scenario of generating smart covers for handwritten notes using electronic devices. For details, please refer to... Figures 4a-4b As shown, or refer to Figures 4d-4e As shown, or refer to Figure 4g-Figure 4h As shown, it will not be elaborated further here.
[0289] Optionally, in this scenario, the process for generating the handwritten note cover can be referenced. Figure 4c or Figure 4f or Figure 4i The process is shown. The difference lies in... Figure 4c or Figure 4f or Figure 4i The process shown is as follows: Figure 4c Step 5.1 or Figure 4f Step 6.1 or Figure 4i Step 7.1 needs to be adjusted to "In response to the user's operation of selecting the target handwritten note in the note application and clicking the 'Smart Cover' option, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note and performs speech recognition on the voice information recorded in the target handwritten note to obtain text information."
[0290] In this scenario, as an optional implementation, the electronic device performs OCR processing on the handwritten content recorded in the target handwritten note to obtain handwritten text information, and performs speech recognition on the speech information recorded in the target handwritten note to obtain speech text information. The electronic device can then compare the obtained handwritten text information and speech text information.
[0291] If the amount of information in handwritten text is much greater than that in spoken text, then electronic devices can use... Figure 4c or Figure 4f or Figure 4i The process is as follows: If the amount of handwritten text information is much less than the amount of spoken text information, the electronic device can adopt the process mentioned in "4. Scenarios where spoken information is recorded in handwritten notes"; if the amount of handwritten text information and spoken text information are roughly equal, the electronic device can adopt the adjustment mentioned in this scenario. Figure 4c The process after step 5.1, or adjustments. Figure 4f The process after step 6.1, or adjustments. Figure 4i The process following step 7.1.
[0292] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0293] 6. Scenarios where handwritten notes only include image information
[0294] Regarding the human-computer interaction scenarios involved in this case, please refer to the previous sections on the scenario of generating smart covers for handwritten notes using electronic devices, and the scenario of editing the generated smart covers. For details, please refer to... Figures 5a-5b As shown, it will not be elaborated further here.
[0295] Optionally, in this scenario, the process for generating the handwritten note cover can be referenced. Figure 3g The process is shown. Among them, the difference is... Figure 3g The process shown will Figure 3g Simply change "Text Notes" to "Handwritten Notes" in each of the steps shown.
[0296] For details not explained in this scenario, please refer to the previous text; they will not be repeated here.
[0297] It should be noted that the scenario described above uses the example of text notes not supporting the import and display of documents (such as PDF, Word, and TXT documents). Understandably, the note cover generation process for scenarios where text notes support document import and display can be referenced. Figure 5c The process shown will not be repeated here.
[0298] It should be noted that the scenarios described above use the example of a cloud server generating summary information based on information sent by an electronic device (such as text information, image information, etc.) for explanation. In one possible implementation, the electronic device can also generate summary information corresponding to text information, image information, etc., locally through a relevant neural network model. This embodiment does not limit the entity that performs the generation of summary information.
[0299] It should be noted that in the scenarios described above, the electronic device generates a cover page for each user's note (handwritten note) in response to user actions. Understandably, in response to a user selecting multiple user notes (handwritten notes and / or handwritten notes) and clicking the smart cover option, the electronic device can also generate smart covers for these multiple user notes in batches and display them to the user simultaneously. At this point, the user can confirm the smart cover page for each user note individually.
[0300] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned related method steps to implement the display method in the above embodiment.
[0301] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the display method described in the above embodiment.
[0302] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the display methods in the above-described method embodiments.
[0303] In this embodiment, the electronic devices (such as mobile phones), computer storage media, computer program products or chips are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0304] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0305] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0306] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A display method, characterized in that, Used in electronic devices, including: The first interface of the note-taking application is displayed; the first interface includes a first handwritten note, which records first handwritten text, and the cover of the first handwritten note is a first cover. In response to the first operation, a second interface of the note application is displayed; the second interface includes a second cover of the first handwritten note; wherein the second cover includes a first summary of the first handwritten text, the first summary being displayed through beautified first handwritten handwriting.
2. The method according to claim 1, characterized in that, Also includes: On the second cover, the background image of the first summary information is a scene image that matches the first summary information.
3. The method according to claim 1, characterized in that, Also includes: The third interface of the note-taking application is displayed; the third interface includes a second handwritten note, which records second handwritten text, and the cover of the second handwritten note is the third cover; In response to the second operation, a fourth interface of the note-taking application is displayed; the fourth interface includes a fourth cover of the second handwritten note; wherein the fourth cover includes a second image, which is generated based on a second summary information of the second handwritten text.
4. The method according to claim 1, characterized in that, Also includes: The fifth interface of the note-taking application is displayed; the fifth interface includes a third handwritten note, which contains an imported PDF document; The cover of the third handwritten notebook is the fifth cover; In response to the third operation, a sixth interface of the note-taking application is displayed; the sixth interface includes a sixth cover of the three handwritten notes; wherein the sixth cover includes a first image area and a first text area, the first image area displays a first pattern, and the first text area displays a third summary of the first page content of the PDF document.
5. The method according to claim 4, characterized in that, When displaying the sixth interface of the note-taking application, it also includes: In response to the fourth operation, a seventh interface of the note-taking application is displayed; the seventh interface includes at least one note cover editing option. In response to an operation on the at least one note cover editing option, an eighth interface of the note application is displayed; the eighth interface includes a seventh cover of the third handwritten note; wherein the seventh cover includes a second image area and a second text area, the second image area displays a second pattern, and the second text area displays fourth summary information of the first page content of the PDF document; At least one of the following differs: The division of the image area and text area in the cover, the content or color of the first pattern and the second pattern, the display direction of the sixth cover and the seventh cover, the third summary information and the fourth summary information.
6. The method according to any one of claims 1-5, characterized in that, Also includes: The ninth interface of the note application is displayed; the ninth interface includes a first text note, which records target text information, and the cover of the first text note is the eighth cover. In response to the fifth operation, the tenth interface of the note application is displayed; the tenth interface includes the ninth cover of the first text note; wherein the ninth cover includes a third image area and a third text area, the third image area displays a third pattern, and the third text area displays the fifth summary information of the target text information.
7. The method according to claim 6, characterized in that, When displaying the tenth interface of the note-taking application, it also includes: In response to the sixth operation, the eleventh interface of the note-taking application is displayed; the eleventh interface includes at least one note cover editing option; In response to an operation on the at least one note cover editing option, a twelfth interface of the note application is displayed; the twelfth interface includes a tenth cover of the first text note; wherein the tenth cover includes a fourth image area and a fourth text area, the fourth image area displays a fourth pattern, and the fourth text area displays a sixth summary of the target text information; At least one of the following differs: The division of image and text areas in the cover, the content or color of the third and fourth patterns, the display direction of the ninth and tenth covers, and the fifth and sixth summary information.
8. The method according to any one of claims 1-5, characterized in that, Also includes: The thirteenth interface of the note-taking application is displayed; the thirteenth interface includes a target note, which records target voice information; The cover of the target notebook is the eleventh cover; the target notebook is the fourth handwritten notebook or the second text notebook; In response to the seventh operation, the fourteenth interface of the note application is displayed; the fourteenth interface includes the twelfth cover of the target note; wherein the twelfth cover includes a fifth image area and a fifth text area, the fifth image area displays a fifth pattern, and the fifth text area displays the seventh summary information of the target voice information.
9. The method according to claim 1, characterized in that, The number of characters in the summary information is within a preset range.
10. The method according to claim 1, characterized in that, Before displaying the second interface of the note-taking application, it also includes: The first handwritten text is subjected to OCR recognition to obtain the first text information included in the first handwritten text, and the first text information is sent to the cloud server. Receive the first summary information of the first text information returned by the cloud server; The second cover is generated based on the beautified first handwritten text and the first summary information.
11. The method according to claim 10, characterized in that, Also includes: Receive a scene image returned by the cloud server that matches the first summary information; The second cover is generated based on the enhanced first handwritten text and the first summary information, including: The second cover is generated based on the beautified first handwritten text, the first summary information, and the scene image; In the second cover, the first summary information is displayed on the scene image.
12. The method according to claim 3, characterized in that, Before displaying the fourth interface of the note-taking application, it also includes: The second handwritten text is subjected to OCR recognition to obtain the second text information included in the second handwritten text, and the second text information is sent to the cloud server; The cloud server receives the second image returned by the cloud server; wherein the second image is generated by the cloud server based on the second summary information after generating the second text information.
13. The method according to claim 4, characterized in that, Before displaying the sixth interface of the note-taking application, it also includes: The first page content of the PDF document is subjected to OCR recognition to obtain third text information, and the third text information is sent to the cloud server. Receive the third summary information of the third text information returned by the cloud server; The sixth cover is generated based on the preset cover style and the third summary information.
14. An electronic device, characterized in that, include: One or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, cause the electronic device to perform the display method as described in any one of claims 1-13.
15. A computer-readable storage medium comprising a computer program, characterized in that, When the computer program is run on an electronic device, it causes the electronic device to perform the display method as described in any one of claims 1-13.