Handwritten content processing method and related device
By determining and storing the second handwriting content on the target handwriting interface of handwriting electronic devices, the problem of users frequently switching interfaces during the first handwriting requirements is solved, and convenient multi-handwriting requirements processing and low-cost management are achieved.
Patent Information
- Application Number
- PCT/CN2023/143283
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-29
- Publication Date
- 2025-07-03
AI Technical Summary
When using handwriting electronic devices, when users experience sudden or additional second handwriting requirements during the process of making first handwriting requirements, they need to frequently switch the handwriting interface, resulting in cumbersome operations and increased management costs.
A handwritten content processing method is provided, by displaying the first handwritten input content on the target handwritten interface, determining the second handwritten content based on preset operations, and clearing the second handwritten content without switching the interface and storing it to the target file, simplifying the processing process.
It reduces the operation steps of users when dealing with bursts or additional handwriting needs, improves convenience and management efficiency, and reduces the management cost of handwriting content.
Smart Images

Figure CN2023143283_03072025_PF_FP_ABST
Abstract
Description
Handwritten content processing method and related equipment Technical Field
[0001] The present application relates to the field of electronic technology and discloses a handwriting content processing method and related equipment. Background Art
[0002] With the development of handwriting electronic devices, users' demand for handwriting electronic devices is increasing. When a user is using a handwriting electronic device and has a handwriting need that is unrelated to the current handwriting need, the user ends the current handwriting interface and starts a new handwriting interface to record the new handwriting need.
[0003] For example, when a user is recording meeting minutes and needs to record a phone number or address by hand, they need to close the handwriting interface for recording meeting minutes and open a new handwriting interface to record the phone number or address. After recording the phone number or address, the user needs to close the handwriting interface and reopen the handwriting interface for recording meeting minutes. It can be seen that this process is cumbersome and inconvenient.
[0004] Summary of the Invention
[0005] The handwriting content processing method and related equipment provided in the embodiments of the present application can simplify the process of recording sudden, temporary or additional handwriting requirements during the process of recording a handwriting requirement, thereby improving the convenience of recording.
[0006] In a first aspect, embodiments of the present application provide a method for processing handwritten content, which can be applied to electronic devices. The electronic device can be an electronic whiteboard, a business handwriting notebook, an electronic ink screen, a tablet computer, a personal computer, a laptop computer, a computer, a netbook, a car computer, a smartphone, a smart wearable device, etc. Of course, the electronic device can also be various portable devices, car terminal devices, personal digital assistants, smart home devices (e.g., smart TVs), and other smart devices.
[0007] The handwriting content processing method may include: displaying a target handwriting interface; displaying first handwriting content corresponding to a first handwriting input received by the target handwriting interface in the target handwriting interface; determining second handwriting content displayed in the target handwriting interface based on a first target operation; clearing the second handwriting content on the target handwriting interface and retaining at least a portion of the first handwriting content; and storing the second handwriting content in a target file.
[0008] In an embodiment of the present application, an electronic device displays a target handwriting interface, primarily for recording or servicing a first handwriting request. When a sudden, temporary, or additional second handwriting request arises, the target handwriting interface can temporarily record or serve the second handwriting request. The target handwriting interface can display the handwritten content corresponding to the received handwriting input. Based on the first target operation, the electronic device can determine the second handwriting content from the handwriting content displayed in the target handwriting interface. The second handwriting content can be understood as the handwriting content corresponding to the second handwriting request. After determining the second handwriting content, the electronic device clears the second handwriting content from the target handwriting interface, allowing the target handwriting interface to continue serving the first handwriting request. Furthermore, the electronic device stores the second handwriting content to facilitate management of the second handwriting content. This design allows the target handwriting interface serving the first handwriting request to be reused to temporarily serve the second handwriting request. This process eliminates the need to switch handwriting interfaces, resulting in a simpler processing process and improved recording convenience.
[0009] In the embodiment of the present application, the effect or function achieved by the electronic device through the process or operation of performing a first target operation to determine the second handwriting content displayed in the target handwriting interface, clearing the second handwriting content on the target handwriting interface, and storing the second handwriting content in the target file can be called an "inspiration pen" function, a "temporary pen" function, an "inspiration note" function, a "temporary note" function or a "temporary record" function.
[0010] In one possible design, the first target operation includes any one of the following:
[0011] a first preset operation on the physical structure of the electronic device;
[0012] a second preset operation on at least one virtual button displayed on the electronic device;
[0013] a third preset operation on the touch display device of the electronic device;
[0014] Preset voice control operations;
[0015] Preset gesture control operations;
[0016] The operation of sending an indication signal to the electronic device.
[0017] In one possible design, before determining the second handwritten content displayed on the target handwriting interface based on the first target operation, the method further includes:
[0018] After the first target operation is detected, according to any handwriting input received by the target handwriting interface, handwriting content corresponding to the any handwriting input is displayed in the target handwriting interface.
[0019] With this design, the handwriting input operation corresponding to the second handwriting content can occur after the first target operation. In other words, the user can trigger the first target operation while performing the first handwriting request, and then perform the handwriting operation of inputting the second handwriting content in the target handwriting interface corresponding to the first handwriting request. This design does not require the user to switch to a new handwriting interface, but instead temporarily records the second handwriting request in the target handwriting interface corresponding to the first handwriting request.
[0020] In one possible design, determining the second handwritten content displayed on the target handwriting interface based on the first target operation includes:
[0021] The handwritten content corresponding to the second handwriting input received by the target handwriting interface within the first target time period is determined as the second handwriting content, wherein the starting time of the first target time period is the time when the first target operation is detected. Optionally, the duration of the first target time period is a preset first duration. For example, the electronic device can determine the handwriting input with the input time of the handwriting content during the first target time period as the second handwriting content. In other words, the target handwriting interface can receive part of the second handwriting content during the first target time period. The electronic device can determine the second handwriting content based on the handwriting input received by the target handwriting interface during the first target time period and the handwriting input continuous with the handwriting input.
[0022] In one possible design, determining the second handwritten content displayed on the target handwriting interface based on the first target operation includes:
[0023] Based on the detected second target operation, the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the second target time period is determined as the second handwritten content, the starting time of the second target time period is the time when the first target operation is detected, wherein the end time of the second target time period is the time when the second target operation is detected.
[0024] In one possible design, the second handwritten content displayed on the target handwriting interface is determined based on the first target operation in at least one of the following ways:
[0025] Method 1: Based on the detected third target operation, determine a selection range corresponding to the third target operation, and determine the content in the selection range as the second handwritten content.
[0026] Method 2: Determine the second handwritten content based on the input time corresponding to each handwritten content displayed in the target handwriting interface, wherein the input time of the second handwritten content is the handwritten content with the latest input time among the handwritten contents.
[0027] Method three: determining the second handwritten content displayed on the target handwriting interface based on the input time and position corresponding to each handwritten content displayed on the target handwriting interface.
[0028] In some scenarios, after a user opens a target handwriting interface, the target handwriting interface displays handwritten content. This handwritten content may correspond to the handwriting input performed by the user the previous time the target handwriting interface was opened. After the user opens the target handwriting interface this time, they can perform a first handwriting input through the target handwriting interface, and the target handwriting interface may display the first handwritten content corresponding to the first handwriting input. Clearly, the target handwriting interface can display the first handwriting content, and may also display the handwriting content corresponding to the handwriting input performed the previous time the target handwriting interface was opened.
[0029] Optionally, in Method 2 and Method 3, the handwritten content displayed in the target handwriting interface may be the handwritten content corresponding to the handwriting input performed after the target handwriting interface was opened, that is, the first handwritten content. Alternatively, the handwritten content displayed in the target handwriting interface may include the handwritten content corresponding to the handwriting input performed through the target handwriting interface before this time and the first handwritten content.
[0030] Optionally, in the first method, the content in the selection range may be any handwritten content displayed in the target handwriting interface. Alternatively, the content in the selection range may be content in the first handwritten content.
[0031] In one possible design, determining the second handwritten content displayed on the target handwriting interface based on the input time and location corresponding to each handwritten content displayed on the target handwriting interface includes:
[0032] dividing the handwritten content in the target handwriting interface into rows according to the input time corresponding to each handwritten content displayed in the target handwriting interface, and determining the handwritten content in a target row as the second handwritten content, wherein the target row contains the handwritten content with the latest input time among the handwritten contents; or
[0033] The block where each handwritten content displayed in the target handwriting interface is located is determined, and the handwritten content in the target block is determined as the second handwritten content, wherein the target block includes the handwritten content with the latest input time among the handwritten contents.
[0034] In one possible design, after determining the second handwritten content displayed in the target handwriting interface, the method further includes:
[0035] Generate a reminder message to indicate whether the user needs to adjust the second handwritten content; or
[0036] Content confirmation information is generated to instruct the user to confirm whether the second handwritten content is correct.
[0037] With this design, after determining the second handwritten content, the electronic device can generate a reminder message to remind the user to check or see whether the determined second handwritten content is accurate. The reminder message can be displayed and / or in text form. The reminder message may include a reminder text message. The reminder text message is used to remind the user to determine whether the second handwritten content is accurate, or to remind the user whether to modify the second handwritten content. For example, the reminder text message can be "whether to modify the temporary content", "whether to modify the inspiration content", or "whether to modify".
[0038] The reminder information may include display information. The display information is used to indicate the second handwritten content. For example, the display information may include an indicator graphic, and the content in the indicator graphic is the second handwritten content, or the content on one side of the indicator graphic is the second handwritten content. For another example, the display information may include a highlight area, and the content in the highlight area is the second handwritten content. Optionally, the user can adjust the indicator graphic or the highlight area through an adjustment operation to modify the second handwritten content. The electronic device can redetermine the second handwritten content in response to detecting the adjustment operation. When the electronic device redetermines the second handwritten content, it can redetermine the second handwritten content based on the adjusted indicator graphic and the adjusted highlight area. Alternatively, if the handwritten content corresponding to the adjustment operation is a closed graphic or a semi-closed graphic, the closed graphic or the semi-closed graphic can be used as a new selection range, and the electronic device can redetermine the content corresponding to the new selection range as the second handwritten content.
[0039] The content confirmation information may be used to indicate the second handwritten content. The content confirmation information may also include controls that provide the user with the ability to perform one or more of a confirmation operation, a modification operation, and a save operation. In some scenarios, the content confirmation information may include the aforementioned reminder text information and display information.
[0040] In one possible design, the target handwriting interface displays the second handwritten content in the following manner:
[0041] A target layer is added and displayed, where the target layer is used to display the second handwritten content or display a recognition result of the second handwritten content.
[0042] In one possible design, before adding the target layer, the method further includes:
[0043] A first layer is created, where the first layer is used to display the first handwritten content, wherein the first layer is not the same layer as the target layer.
[0044] In some scenarios, the handwriting input corresponding to the second handwritten content may occur after the first target operation. When the electronic device displays the target handwriting interface, it may create a first layer for displaying the first handwritten content. In response to detecting the first target operation, the electronic device may add, create, or add a target layer for displaying the second handwritten content. It can be seen that the first layer and the target layer are not the same layer. In other words, the first handwritten content and the second handwritten content are displayed on different layers.
[0045] In one possible design, adding a target layer includes:
[0046] In response to the first target operation, the target layer is added.
[0047] In one possible design, clearing the second handwritten content on the target handwriting interface includes:
[0048] Clears the target layer.
[0049] In one possible design, clearing the second handwritten content on the target handwriting interface includes:
[0050] The data of the second handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0051] In one possible design, storing the second handwritten content in a target file includes:
[0052] The content data corresponding to the second handwritten content is stored in a target file.
[0053] Optionally, the content data includes a picture of the second handwritten content, or the content data includes reporting point data corresponding to the second handwritten content, or the content data includes a recognition result corresponding to the second handwritten content.
[0054] In one possible design, the method further includes: storing at least a portion of the first handwritten content in a first file, where the first file and the target file are different files.
[0055] Through this design, the target file is used to store the second handwritten content, rather than using the file that stores the handwritten content of the first handwritten requirement to store the second handwritten content. This facilitates the management of the second handwritten content and can play the role of independently managing the handwritten content of the second handwriting requirement, reducing the user's handwritten content management operation costs.
[0056] In some scenarios, the electronic device may display the target handwriting interface in response to opening the first application, and may display a save prompt window in response to closing the first application, prompting the user whether to save the handwritten content in the target handwriting interface.
[0057] In some application scenarios, the electronic device may display a target handwriting interface in response to an operation of opening the first file, and may display a save prompt window in response to an operation of closing the first file, prompting the user whether to save the handwritten content in the target handwriting interface.
[0058] In one possible design, storing content data corresponding to the second handwritten content in a target file includes:
[0059] determining a target content category of the second handwritten content;
[0060] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0061] The content data corresponding to the second handwritten content is stored in the target file.
[0062] Through this design, the handwritten content of the second handwriting demand is classified and managed, which can reduce the user's management cost of the second handwriting demand and improve the user experience.
[0063] In some scenarios, the target file can be implemented as a folder. A folder can contain multiple files. For example, in a contact folder, a phone number can be implemented as a file. Another example is in a to-do folder, a to-do item can be implemented as a file.
[0064] In some scenarios, the target file can be implemented as a single file. The file includes content stored in a predetermined order. When displaying multiple contents from the file, no content overlap occurs. In other words, the multiple contents do not overlap in their displayed positions.
[0065] In one possible design, determining a target content category of the second handwritten content includes:
[0066] Obtaining a recognition result of the second handwritten content, and determining the target content category based on the recognition result of the second handwritten content; and / or,
[0067] Based on the first target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0068] In one possible design, determining the target content classification based on the recognition result includes:
[0069] determining, according to the correspondence between the content classification information and the content categories, the content category corresponding to the target content classification information in the recognition result of the second handwritten content as the target content category;
[0070] The content classification information includes at least one of the following information: classification field, graphics.
[0071] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0072] Through this design, users can customize content classification information, which can reduce the management cost of handwritten content for users' second handwriting needs and improve the user experience of users using electronic devices.
[0073] In one possible design, determining a target content category of the second handwritten content includes:
[0074] Based on the detected fourth target operation, determining a third handwritten content corresponding to the fourth target operation, wherein the fourth target operation and the first target operation are associated operations; based on the recognition result of the third handwritten content, determining a target content category corresponding to the second handwritten content.
[0075] Optionally, the electronic device may determine the second handwritten content based on the recognition result of the third handwritten content.
[0076] In some scenarios, the fourth target operation may be a handwriting input operation, and the handwriting content corresponding to the handwriting input operation is recorded as the third handwriting content. The fourth target operation and the first target operation are associated with each other. For example, the fourth target operation and the first target operation are associated with each other in the time dimension. Optionally, the time of the fourth target operation may be earlier than the time of the first target operation. Alternatively, the time of the first target operation may be earlier than the time of the fourth target operation. Alternatively, the time of the fourth target operation is within the third target time period, the starting time of the third target time period is the time of the first target operation, and the duration of the third target time period may be preset.
[0077] The electronic device can recognize the third handwritten content, such as text recognition, graphic recognition, line type recognition, line length recognition, etc. The electronic device can determine the second handwritten content and the target content category of the second handwritten content based on the recognition result of the third handwritten content.
[0078] In one possible design, any content category is user-configured.
[0079] In one possible design, storing the second handwritten content in a target file includes:
[0080] While clearing the second handwritten content on the target handwriting interface, the second handwritten content is stored in a target file.
[0081] In a second aspect, the present application further provides a method for processing handwritten content, wherein the method is applied to an electronic device, and the method comprises:
[0082] Displaying the lock screen interface of the electronic device;
[0083] Displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0084] If the preset processing conditions are met, the fourth handwritten content is cleared on the lock screen interface and the fourth handwritten content is stored in a target file.
[0085] In this embodiment of the present application, users can perform temporary handwriting needs through the lock interface of the electronic device without having to unlock the device or open the handwriting application. For sudden or temporary handwriting needs, this method can reduce user operation costs and provide a good user experience.
[0086] In one possible design, displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface includes:
[0087] In response to a fifth target operation, displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0088] The fifth target operation includes any one of the following:
[0089] Preset operations on the physical structure of the electronic device;
[0090] a preset operation on at least one virtual button displayed on the electronic device;
[0091] Preset operations on the touch display device of the electronic device;
[0092] Preset voice control operations;
[0093] Preset gesture control operations;
[0094] The operation of sending an indication signal to the electronic device.
[0095] In one possible design, the second handwritten content is displayed on the lock screen interface in the following manner:
[0096] A target layer is added and displayed, where the target layer is used to display the fourth handwritten content or a recognition result of the fourth handwritten content.
[0097] In one possible design, before adding the target layer, the method further includes:
[0098] Create a second layer, where the second layer is used to display preset content of the lock screen interface, wherein the first layer and the target layer are not the same layer.
[0099] In one possible design, adding a target layer includes:
[0100] In response to the fifth target operation, the target layer is added.
[0101] In one possible design, clearing the fourth handwritten content on the lock screen interface includes:
[0102] Clears the target layer.
[0103] In one possible design, clearing the fourth handwritten content on the lock interface includes:
[0104] The data of the fourth handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0105] In one possible design, storing the fourth handwritten content in a target file includes:
[0106] If the preset storage condition is met, the fourth handwritten content is stored in the target file.
[0107] In one possible design, storing the fourth handwritten content in a target file includes:
[0108] The content data corresponding to the fourth handwritten content is stored in a target file.
[0109] Optionally, the content data includes a picture of the fourth handwritten content, or the content data includes reporting point data corresponding to the fourth handwritten content, or the content data includes a recognition result corresponding to the fourth handwritten content.
[0110] In one possible design, storing the content data corresponding to the fourth handwritten content in a target file includes:
[0111] determining a target content category of the fourth handwritten content;
[0112] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0113] The fourth handwritten content is stored in the target file.
[0114] In one possible design, determining a target content category of the fourth handwritten content includes:
[0115] Obtaining a recognition result of the fourth handwritten content, and determining the target content category based on the recognition result of the fourth handwritten content; or,
[0116] Based on the fifth target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0117] In one possible design, determining the target content classification based on the recognition result includes:
[0118] determining, according to a correspondence between content classification information and content categories, the content category corresponding to the target content classification information in the recognition result of the fourth handwritten content as the target content category;
[0119] The content classification information includes at least one of the following information: classification field, graphics.
[0120] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0121] In one possible design, determining a target content category of the fourth handwritten content includes:
[0122] determining, based on the detected sixth target operation, fifth handwritten content corresponding to the sixth target operation, wherein the sixth target operation and the fifth target operation are associated operations;
[0123] Based on the recognition result of the fifth handwritten content, a target content category corresponding to the fourth handwritten content is determined.
[0124] In some scenarios, the electronic device may determine the fourth handwritten content based on the recognition result of the fifth handwritten content.
[0125] In one possible design, any content category is user-configured.
[0126] In one possible design, storing the fourth handwritten content in a target file includes:
[0127] While clearing the fourth handwritten content on the lock screen interface, the fourth handwritten content is stored in a target file.
[0128] In a third aspect, an embodiment of the present application further provides a method for processing handwritten content, which is applied to an electronic device, and the method includes:
[0129] Display the target handwriting interface;
[0130] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0131] Based on the preset target operation, audio is collected and stored.
[0132] In a fourth aspect, an embodiment of the present application further provides a method for processing handwritten content, which is applied to an electronic device, and the method includes:
[0133] Display the target handwriting interface;
[0134] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0135] Determining second handwriting content displayed in the target handwriting interface;
[0136] Clearing the second handwritten content on the target handwriting interface and retaining at least a portion of the first handwritten content;
[0137] The second handwritten content is stored in a target file.
[0138] In a fifth aspect, an embodiment of the present application further provides a method for processing handwritten content, which is applied to an electronic device, and the method includes:
[0139] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0140] Based on the first target operation, second handwritten content displayed in the target handwriting interface is determined, and the second handwritten content is stored in a target file.
[0141] In a sixth aspect, an embodiment of the present application further provides a method for processing handwritten content, which is applied to an electronic device, and the method includes:
[0142] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0143] Determining, based on the first target operation, a content category of the second handwritten content displayed in the target handwriting interface;
[0144] The second handwritten content is stored in a target file according to the content classification of the second handwritten content.
[0145] In a seventh aspect, an embodiment of the present application provides an electronic device, including:
[0146] a memory for storing program instructions;
[0147] A controller is configured to call the program instructions stored in the memory to execute:
[0148] Display the target handwriting interface;
[0149] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0150] Based on the first target operation, determining second handwritten content displayed in the target handwriting interface;
[0151] Clearing the second handwritten content on the target handwriting interface and retaining at least a portion of the first handwritten content;
[0152] The second handwritten content is stored in a target file.
[0153] In one possible design, the first target operation includes any one of the following:
[0154] Preset operations on the physical structure of the electronic device;
[0155] a preset operation on at least one virtual button displayed on the electronic device;
[0156] Preset operations on the touch display device of the electronic device;
[0157] Preset voice control operations;
[0158] Preset gesture control operations;
[0159] The operation of sending an indication signal to the electronic device.
[0160] In one possible design, the controller is specifically configured to execute:
[0161] The handwritten content corresponding to the second handwriting input received by the target handwriting interface within the first target time period is determined as the second handwriting content, wherein the starting time of the first target time period is the time when the first target operation is detected. Optionally, the duration of the first target time period is a preset first duration. For example, the electronic device can determine the handwriting input with the input time of the handwriting content during the first target time period as the second handwriting content. In other words, the target handwriting interface can receive part of the second handwriting content during the first target time period. The electronic device can determine the second handwriting content based on the handwriting input received by the target handwriting interface during the first target time period and the handwriting input continuous with the handwriting input.
[0162] In one possible design, the controller is specifically configured to execute:
[0163] Based on the detected second target operation, the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the second target time period is determined as the second handwritten content, the starting time of the second target time period is the time when the first target operation is detected, wherein the end time of the second target time period is the time when the second target operation is detected.
[0164] In one possible design, the controller is specifically configured to execute:
[0165] Based on the detected third target operation, determining a selection range corresponding to the third target operation, and determining the content in the selection range as the second handwritten content; or,
[0166] Determine the second handwritten content based on the input time corresponding to each handwritten content displayed in the target handwriting interface, wherein the input time of the second handwritten content is the handwritten content with the latest input time among the handwritten contents; or
[0167] Based on the input time and position corresponding to each handwritten content displayed in the target handwriting interface, second handwritten content displayed on the target handwriting interface is determined.
[0168] In one possible design, the controller is specifically configured to execute:
[0169] dividing the handwritten content in the target handwriting interface into rows according to the input time corresponding to each handwritten content displayed in the target handwriting interface, and determining the handwritten content in a target row as the second handwritten content, wherein the target row contains the handwritten content with the latest input time among the handwritten contents; or
[0170] The block where each handwritten content displayed in the target handwriting interface is located is determined, and the handwritten content in the target block is determined as the second handwritten content, wherein the target block includes the handwritten content with the latest input time among the handwritten contents.
[0171] In one possible design, the controller is further configured to execute:
[0172] After determining the second handwritten content displayed in the target handwriting interface, generating reminder information to indicate whether the user needs to adjust the second handwritten content; or
[0173] Content confirmation information is generated to instruct the user to confirm whether the second handwritten content is correct.
[0174] In one possible design, the controller is specifically configured to execute:
[0175] The second handwriting content is displayed on the target handwriting interface in the following manner:
[0176] A target layer is added and displayed, where the target layer is used to display the second handwritten content or display a recognition result of the second handwritten content.
[0177] In one possible design, the controller is further configured to execute:
[0178] Before adding the target layer, a first layer is created, where the first layer is used to display the first handwritten content, wherein the first layer is not the same layer as the target layer.
[0179] In one possible design, the controller is specifically configured to execute:
[0180] In response to the first target operation, the target layer is added.
[0181] In one possible design, the controller is specifically configured to execute:
[0182] Clears the target layer.
[0183] In one possible design, clearing the second handwritten content on the target handwriting interface includes:
[0184] The data of the second handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0185] In one possible design, storing the second handwritten content in a target file includes:
[0186] The content data corresponding to the second handwritten content is stored in a target file.
[0187] Optionally, the content data includes a picture of the second handwritten content, or the content data includes reporting point data corresponding to the second handwritten content, or the content data includes a recognition result corresponding to the second handwritten content.
[0188] In one possible design, the controller is further configured to execute:
[0189] At least a portion of the first handwritten content is stored in a first file, where the first file is different from the target file.
[0190] In one possible design, the controller is specifically configured to execute:
[0191] determining a target content category of the second handwritten content;
[0192] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0193] The content data corresponding to the second handwritten content is stored in the target file.
[0194] In one possible design, the controller is specifically configured to execute:
[0195] Obtaining a recognition result of the second handwritten content, and determining the target content category based on the recognition result of the second handwritten content; and / or,
[0196] Based on the first target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0197] In one possible design, the controller is specifically configured to execute:
[0198] determining, according to the correspondence between the content classification information and the content categories, the content category corresponding to the target content classification information in the recognition result of the second handwritten content as the target content category;
[0199] The content classification information includes at least one of the following information: classification field, graphics.
[0200] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0201] In one possible design, the controller is specifically configured to execute:
[0202] determining, based on the detected fourth target operation, third handwritten content corresponding to the fourth target operation, wherein the fourth target operation and the first target operation are associated operations;
[0203] Based on the recognition result of the third handwritten content, a target content category corresponding to the second handwritten content is determined.
[0204] Optionally, the electronic device may determine the second handwritten content based on the recognition result of the third handwritten content.
[0205] In one possible design, any content category is user-configured.
[0206] In one possible design, the controller is specifically configured to execute:
[0207] While clearing the second handwritten content on the target handwriting interface, the second handwritten content is stored in a target file.
[0208] In an eighth aspect, an embodiment of the present application provides an electronic device, comprising:
[0209] a memory for storing program instructions;
[0210] A controller is configured to call the program instructions stored in the memory to execute:
[0211] Displaying the lock screen interface of the electronic device;
[0212] Displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0213] If the preset processing conditions are met, the fourth handwritten content is cleared on the lock screen interface and the fourth handwritten content is stored in a target file.
[0214] In one possible design, the controller is specifically configured to execute:
[0215] In response to a fifth target operation, displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0216] The fifth target operation includes any one of the following:
[0217] Preset operations on the physical structure of the electronic device;
[0218] a preset operation on at least one virtual button displayed on the electronic device;
[0219] Preset operations on the touch display device of the electronic device;
[0220] Preset voice control operations;
[0221] Preset gesture control operations;
[0222] The operation of sending an indication signal to the electronic device.
[0223] In one possible design, the controller is specifically configured to execute:
[0224] The second handwritten content is displayed on the lock screen in the following manner:
[0225] A target layer is added and displayed, where the target layer is used to display the fourth handwritten content or display a recognition result of the fourth handwritten content.
[0226] In one possible design, the controller is specifically configured to execute:
[0227] Before adding the target layer, a second layer is created, where the second layer is used to display the preset content of the lock screen interface, wherein the first layer and the target layer are not the same layer.
[0228] In one possible design, the controller is specifically configured to execute:
[0229] In response to the fifth target operation, the target layer is added.
[0230] In one possible design, the controller is specifically configured to execute:
[0231] Clears the target layer.
[0232] In one possible design, the controller is specifically configured to execute:
[0233] The data of the fourth handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0234] In one possible design, the controller is specifically configured to execute:
[0235] If the preset storage condition is met, the fourth handwritten content is stored in the target file.
[0236] In one possible design, the controller is specifically configured to execute:
[0237] The content data corresponding to the fourth handwritten content is stored in a target file.
[0238] Optionally, the content data includes a picture of the fourth handwritten content, or the content data includes reporting point data corresponding to the fourth handwritten content, or the content data includes a recognition result corresponding to the fourth handwritten content.
[0239] In one possible design, the controller is specifically configured to execute:
[0240] determining a target content category of the fourth handwritten content;
[0241] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0242] The fourth handwritten content is stored in the target file.
[0243] In one possible design, the controller is specifically configured to execute:
[0244] Obtaining a recognition result of the fourth handwritten content, and determining the target content category based on the recognition result of the fourth handwritten content; or,
[0245] Based on the first target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0246] In one possible design, the controller is specifically configured to execute:
[0247] determining, according to a correspondence between content classification information and content categories, the content category corresponding to the target content classification information in the recognition result of the fourth handwritten content as the target content category;
[0248] The content classification information includes at least one of the following information: classification field, graphics.
[0249] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0250] In one possible design, the controller is specifically configured to execute:
[0251] determining, based on the detected sixth target operation, fifth handwritten content corresponding to the sixth target operation, wherein the sixth target operation and the fifth target operation are associated operations;
[0252] Based on the recognition result of the fifth handwritten content, a target content category corresponding to the fourth handwritten content is determined.
[0253] In some scenarios, the electronic device may determine the fourth handwritten content based on the recognition result of the fifth handwritten content.
[0254] In one possible design, any content category is user-configured.
[0255] In one possible design, storing the fourth handwritten content in a target file includes:
[0256] While clearing the fourth handwritten content on the lock screen interface, the fourth handwritten content is stored in a target file.
[0257] In a ninth aspect, an embodiment of the present application further provides an electronic device, including:
[0258] a memory for storing program instructions;
[0259] A controller is configured to call the program instructions stored in the memory to execute:
[0260] Display the target handwriting interface;
[0261] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0262] Based on the preset target operation, audio is collected and stored.
[0263] In a tenth aspect, an embodiment of the present application further provides an electronic device, including:
[0264] a memory for storing program instructions;
[0265] A controller is configured to call the program instructions stored in the memory to execute:
[0266] Display the target handwriting interface;
[0267] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0268] Determining second handwriting content displayed in the target handwriting interface;
[0269] Clearing the second handwritten content on the target handwriting interface and retaining at least a portion of the first handwritten content;
[0270] The second handwritten content is stored in a target file.
[0271] In an eleventh aspect, an embodiment of the present application further provides an electronic device, including:
[0272] a memory for storing program instructions;
[0273] A controller is configured to call the program instructions stored in the memory to execute:
[0274] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0275] Based on the first target operation, second handwritten content displayed in the target handwriting interface is determined and the second handwritten content is stored in a target file.
[0276] In a twelfth aspect, an embodiment of the present application further provides an electronic device, including:
[0277] a memory for storing program instructions;
[0278] A controller is configured to call the program instructions stored in the memory to execute:
[0279] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0280] Determining, based on the first target operation, a content category of the second handwritten content displayed in the target handwriting interface;
[0281] The second handwritten content is stored in a target file according to the content classification of the second handwritten content.
[0282] In a thirteenth aspect, an embodiment of the present application provides an electronic device, comprising a unit for executing each step of the method provided in the first aspect above. For example, the electronic device may include a display unit and a processing unit, wherein the display unit is configured to display a user interface, and the processing unit is configured to implement the method provided in the first aspect, or the method provided in the second aspect, or the method provided in the third aspect, or the method provided in the fourth aspect, or the method provided in the fifth aspect above.
[0283] In the fourteenth aspect, an embodiment of the present application provides an electronic device, which includes a display screen, at least one processor and a memory; the at least one processor is coupled to the memory, and the at least one processor is used to read the computer program stored in the memory to execute the method provided in the first aspect, or the method provided in the second aspect, or the method provided in the third aspect, or the method provided in the fourth aspect, or the method provided in the fifth aspect.
[0284] In a fifteenth aspect, an embodiment of the present application further provides a handwriting system, which may include any electronic device provided in the present application, and a stylus-type input device.
[0285] In the sixteenth aspect, an embodiment of the present application provides a chip, which is used to read a computer program stored in a memory and execute the method provided in the first aspect, or the method provided in the second aspect, or the method provided in the third aspect, or the method provided in the fourth aspect, or the method provided in the fifth aspect. Optionally, the chip may include a processor, which is coupled to the memory and is used to read the computer program stored in the memory to implement the method provided in the above embodiment. Optionally, the chip may also include components such as a memory, a communication interface, and a power supply module. The memory is used to store computer programs, the communication interface is used to receive and send data; and the power supply unit is used to power the processor.
[0286] In a seventeenth aspect, embodiments of the present application further provide a chip system, comprising a processor configured to support a computer device in implementing the method provided in any of the above aspects. In one possible design, the chip system further comprises a memory configured to store the necessary programs and data for the computer device. The chip system may be composed of a chip alone, or may include a chip and other discrete components.
[0287] In aspect 18, an embodiment of the present application provides a computer storage medium storing a computer program. When the computer program is run on an electronic device, the computer executes the method provided in the first aspect, or the method provided in the second aspect, or the method provided in the third aspect, or the method provided in the fourth aspect, or the method provided in the fifth aspect.
[0288] In the nineteenth aspect, an embodiment of the present application provides a computer program product, which includes a computer program; when the computer program is run on a computer, the computer executes the method provided in the first aspect, or the method provided in the second aspect, or the method provided in the third aspect, or the method provided in the fourth aspect, or the method provided in the fifth aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0289] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0290] FIG1 is a schematic diagram of an application scenario;
[0291] FIG2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
[0292] FIG3 is a schematic diagram of the architecture of a software system provided in an embodiment of the present application;
[0293] FIG4 is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0294] 5A and 5B are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0295] 6A to 6D are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0296] 7A and 7B are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0297] 8A to 8C are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0298] 9A and 9B are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0299] FIG9C is a schematic diagram of determining second handwritten content according to an embodiment of the present application;
[0300] FIG9D is a schematic diagram of a line branching process in a handwriting interface according to an embodiment of the present application;
[0301] FIG9E is a schematic diagram of a block processing of a handwriting interface according to an embodiment of the present application;
[0302] FIG9F is a schematic diagram of third handwritten content provided in an embodiment of the present application;
[0303] FIG10A is a schematic diagram of a working process of an electronic device provided in an embodiment of the present application;
[0304] 10B to 10D are schematic diagrams of clearing the second handwritten content according to embodiments of the present application;
[0305] FIG11A is a schematic diagram of a working process of an electronic device provided in an embodiment of the present application;
[0306] FIG11B is a schematic diagram of handwritten content including a content classification field provided in an embodiment of the present application;
[0307] FIG11C is a schematic diagram showing an exemplary graph corresponding to content classification;
[0308] 11D to 11G are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0309] FIG12A is a schematic diagram of the correspondence between content categories and folders provided in an embodiment of the present application;
[0310] FIG12B is a schematic diagram of a method for opening a file provided in an embodiment of the present application;
[0311] FIG12C is a schematic diagram of a method for opening a file provided in an embodiment of the present application;
[0312] FIG13A is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0313] FIG13B is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0314] FIG13C is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0315] 13D and 13E are schematic diagrams of a working process of an electronic device provided in an embodiment of the present application;
[0316] FIG14A is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0317] FIG14B is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0318] FIG14C is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0319] FIG14D is a schematic flow chart of a handwritten content processing method provided in an embodiment of the present application;
[0320] FIG15 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0321] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.
[0322] As used in the embodiments of the present application, the terms “when…” or “after…” may be interpreted to mean “if…” or “after…” or “in response to determining…” or “in response to detecting…”, depending on the context. Similarly, the phrases “upon determining…” or “if (stated condition or event) is detected” may be interpreted to mean “if determining…” or “in response to determining…” or “upon detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.
[0323] In addition, in the embodiments of the present application, relational terms such as "first" and "second" are used to distinguish one entity from another entity. This is only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or order.
[0324] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0325] This application provides a handwriting content method and related equipment for processing additional or newly added handwriting requirements when processing user handwriting requirements, thereby reducing operational complexity and improving convenience. The method and equipment are based on the same technical concept. Since the principles of the method and equipment for solving problems are similar, the implementation of the equipment and method can refer to each other, and the repeated parts will not be repeated.
[0326] Currently, a user is using a handwriting device to perform a first handwriting requirement, as shown in Figure 1 (a). For example, while a user is recording meeting minutes or reading a document and taking notes, a second handwriting requirement may arise. The second handwriting requirement may be a sudden or additional handwriting requirement, such as recording a phone number or something a work partner has informed them of. In this case, directly recording the second handwriting requirement in the handwritten content of the first handwriting requirement requires the user to subsequently distinguish between the handwriting content of the first handwriting requirement and the handwriting content of the second handwriting requirement, resulting in high management costs.
[0327] In order to easily distinguish the content of the first handwriting requirement from the content of the second handwriting requirement, as shown in (b) in Figure 1, the user needs to close the first handwriting interface of the first handwriting requirement. And start a new handwriting interface as the second handwriting interface of the second handwriting requirement, as shown in (c) in Figure 1. After the user completes the second handwriting requirement in the second handwriting interface, he also needs to close the second handwriting interface, as shown in (d) in Figure 1. To continue the first handwriting requirement, as shown in (e) in Figure 1, the user also needs to find the first handwriting interface of the first handwriting requirement and open the first handwriting interface to display the content of the first handwriting requirement and continue handwriting in the first handwriting interface.
[0328] As can be seen, when a user is using a handwriting device to perform a first handwriting request and a very urgent second handwriting request arises, if the content of the second handwriting request is recorded in the content corresponding to the first handwriting request, the content record of the first handwriting request will be very messy, increasing the management cost of the content of the first handwriting request. If the user pauses the first handwriting request, then opens a new handwriting function page for the second handwriting request, and then returns to the page of the first handwriting request after the second handwriting request is stopped, the operation will be cumbersome and inconvenient.
[0329] In view of this, an embodiment of the present application provides an electronic device that can execute the handwriting content processing method provided in the embodiment of the present application. When a user is using a handwriting device to perform a first handwriting requirement and a very urgent second handwriting requirement arises, the electronic device can reduce user operations, improve operational convenience, and reduce the management costs of the content corresponding to the second handwriting requirement and the content corresponding to the first handwriting requirement.
[0330] An embodiment of the present application provides an electronic device. The structure of the electronic device provided by the embodiment of the present application is introduced below with reference to FIG2 .
[0331] As shown in Figure 2, the electronic device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc.
[0332] The processor 210 may include one or more processing units, for example: the processor 210 may include a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 200. The controller can generate an operation control signal based on the instruction opcode and the timing signal to complete the control of instruction fetching and execution.
[0333] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or is reusing. If the processor 210 needs to use the instruction or data again, it can directly access it from the memory. By providing this memory, the number of times the processor 210 accesses data from the internal memory 221 can be reduced, reducing the processor 210's waiting time, thereby improving system efficiency.
[0334] The handwritten content processing method provided in the embodiments of the present application can be controlled by processor 210 or implemented by calling other components, such as controlling display screen 294 to display the user interface and handwriting interface, and acquiring the point reporting data collected by sensor module 280. Processor 210 can include different components. For example, when integrated with a CPU and GPU, the CPU and GPU can cooperate to execute the handwritten content processing method provided in the embodiments of the present application. For example, some algorithms in the handwritten content processing method can be executed by the CPU, while other algorithms related to the handwriting interface display can be executed by the GPU, thereby achieving faster processing efficiency.
[0335] Display screen 294 is used to display images, videos, and the like. Display screen 294 includes a display panel. The display panel can be an electronic paper display (EPD), a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 200 may include one or N display screens 294, where N is a positive integer greater than 1. Display screen 294 can be used to display information input by or provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 294 can display windows, photos, videos, web pages, user-entered content, handwritten content, or files. In some embodiments, when the processor 210 detects a touch operation by a user's finger (or stylus, pen, etc.), the processor 210 performs corresponding processing in response to the touch operation, such as displaying dynamically changing content in a user interface displayed on the display screen 294. In some embodiments, when the processor 210 detects a click operation on an application icon by an external input device (such as a mouse, keyboard, etc.) of the electronic device 200, the processor 210 performs corresponding control operations on the application in response to the click operation.
[0336] In the embodiment of the present application, the display screen 294 can be a single flexible display screen, or a spliced display screen composed of two or more rigid screens and a flexible screen located between two adjacent rigid screens. After the processor 210 executes the method provided in the embodiment of the present application, the processor 210 can control the display screen 294 to display a user interface.
[0337] In some embodiments, part or all of the display area of the display screen 294 can be used to display a handwriting interface. For example, the electronic device 200 can have multiple display modes, and each display mode has a corresponding display area. The shape or size of the display areas corresponding to different display modes may be different. It should be noted that the display areas corresponding to different display modes may overlap. Of course, the electronic device 200 may also have only one display mode. In this case, the electronic device 200 can display the user interface through the entire area of the display screen 294, or it can display the user interface through a partial block area in the display screen 294.
[0338] The camera 293 is used to capture still images or videos. Optionally, the electronic device 200 may include 1 to N cameras 293. For example, the camera 293 may include a front camera or a rear camera, or one camera 293 may serve as both a front camera and a rear camera. Typically, the camera 293 may include a photosensitive element such as a lens group and an image sensor. The lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal.
[0339] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. The program storage area may store an operating system, program codes of at least one application, etc. The operating system may include, but is not limited to, The data storage area can store data created during the use of the electronic device 200 .
[0340] The internal memory 221 may also store one or more computer programs for executing the methods provided in the embodiments of the present application. The one or more computer programs are stored in the internal memory 221 and configured to be executed by the one or more processors 210. The one or more computer programs include instructions, which may be used to execute the various steps in the following embodiments.
[0341] In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0342] The sensor module 280 may include a fingerprint sensor, a touch sensor, a pressure sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like.
[0343] The touch sensor can be implemented as a touch panel or a touch component. The touch component is used to detect touch operations acting on or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display 294. In some embodiments, the touch component can be set on the display 294. In other words, the display 294 is a touch display. In other embodiments, the touch component can also be set on the surface of the electronic device 200, at a different location from the display 294.
[0344] Optionally, the touch component may adopt, but is not limited to, one or more of the following touch technologies: capacitive touch technology, infrared touch technology, and electromagnetic touch technology. In some examples, the touch component may adopt capacitive touch technology. In other examples, the touch component may adopt infrared touch technology. In still other examples, the touch component may adopt electromagnetic touch technology. In still other examples, the touch component may adopt capacitive touch technology and infrared touch technology. In still other examples, the touch component may adopt capacitive touch technology and electromagnetic touch technology.
[0345] The wireless communication functionality of electronic device 200 can be implemented using antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0346] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.
[0347] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 270A, the receiver 270B, etc.) or displays an image or video through the display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 250 or other functional modules.
[0348] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 200. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0349] In addition, the electronic device 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor. For example, music playback, recording, etc. The electronic device 200 can receive input from the key 290 and generate key signal input related to the user settings and function control of the electronic device 200. The electronic device 200 can use the motor 291 to generate a vibration prompt. The indicator 292 in the electronic device 200 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 in the electronic device 200 is used to connect the SIM card. The SIM card can be connected to and separated from the electronic device 200 by inserting it into the SIM card interface 295 or pulling it out from the SIM card interface 295.
[0350] It should be understood that, in actual applications, the electronic device 200 shown in FIG2 is merely an example and does not constitute a limitation of the electronic device. Furthermore, the electronic device 200 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in the figure may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.
[0351] The software system of the electronic device 200 provided in the embodiment of the present application can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the layered architecture as an example, and exemplifies the software structure of the electronic device as shown in FIG3 .
[0352] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. As shown in Figure 3, this software architecture can be divided into four layers: the application layer, the application framework (FWK), the Android runtime and system libraries, and the kernel layer. Electronic devices may also include a hardware layer.
[0353] The application layer is the top layer of the operating system, including native applications of the operating system and third-party applications such as camera, gallery, calendar, Bluetooth, music, video, information, etc.
[0354] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer may include some predefined functions. The application framework layer may include a window manager, an activity manager, an input composition manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and so on.
[0355] A window manager provides window management services (WMS). It can obtain the display size, determine whether a status bar is present, lock the screen, and take screenshots. It also provides multiple management functions to control parameters such as the transparency, position, and size of windows or interfaces on the display.
[0356] The activity manager provides activity management services (AMS) and is responsible for starting, switching, and scheduling components in the system, as well as managing and scheduling applications.
[0357] The Input Synthesis Manager provides input synthesis services (InputFlinger) for collecting, processing, and distributing user operation information. For example, the Input Synthesis Manager receives operation information reported by the sensor through the sensor driver, converts it into an input event, and distributes the input event to other modules for processing based on the event type. For example, when a user performs a drawing operation, the Input Synthesis Manager generates an input event after receiving the operation information of the drawing operation and distributes the input event to the window manager; the window manager then distributes it to the activity manager; the activity manager can respond to the input event and display the drawing track in the corresponding window.
[0358] In an embodiment of the present application, the application framework layer may further include a content manager. The content manager may be located within a module in the framework layer that provides certain services. Optionally, when a user performs a touch operation on the handwriting interface of an electronic device, the content manager may obtain the point reporting data corresponding to the touch operation in real time through the input synthesis manager, or obtain the point reporting data corresponding to the touch operation from the sensor driver; and determine the handwritten content based on the point reporting data and set rules. The content manager may then store, transcribe, recognize, or send the determined handwritten content to an external device, such as a server.
[0359] The content manager is used to store and retrieve data and make it accessible to applications. The data may include files (such as documents, videos, images, audio), text and other information.
[0360] The view system includes visual controls, such as those for displaying text, images, and documents. The view system can be used to build applications. The interface within a display window can be composed of one or more controls. For example, a display interface showing a file icon might include controls for displaying text and images.
[0361] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.
[0362] Optionally, in the Android system, the software structure of the electronic device also includes the Android runtime. The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and management of the Android system. The Android system's core library consists of two parts: one for the functional functions required by the Java language, and the other for the Android system's core library. The application layer and application framework layer run in the virtual machine. Taking Java as an example, the virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine is responsible for performing functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0363] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.
[0364] The kernel layer provides the operating system's core system services, such as security, memory management, process management, network protocol stacks, and driver models. These services are all implemented within the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers for input devices; Flash drivers for memory-based devices; sensor drivers; camera drivers; audio drivers; Bluetooth drivers; and Wi-Fi drivers.
[0365] In an embodiment of the present application, when a user performs a touch operation on a user interface or a handwriting interface, the sensor driver can obtain the user's operation information based on the user's touch operation detected by a sensor (such as a touch sensor and / or a pressure sensor) set on the display screen, and provide it to the input synthesis manager and the content manager.
[0366] For example, in some embodiments of the present application, the touch operation received by the electronic device may include, but is not limited to, a click (such as a single click, double click, etc.) operation / long press operation / slide operation / drag operation / hover gesture operation on the display screen by a user using a finger or a touch-assisted tool such as a stylus or stylus. This embodiment of the present application does not specifically limit this.
[0367] In some embodiments, the stylus is an active device and includes one or more electronic circuits. For example, the stylus includes one or more sensors and one or more communication circuits (such as a communication module and / or RF circuit). In some embodiments, the stylus includes one or more processors and a power system (e.g., a battery system). In some embodiments, the stylus includes an accelerometer (such as an accelerometer), a magnetometer, and / or a gyroscope that can determine the position, angle, location, and / or other physical characteristics of the stylus (e.g., such as whether the stylus is put down, tilted toward or away from the device, and / or close to or away from the device). In some embodiments, the stylus communicates with the electronic device (e.g., via a communication circuit, through a wireless communication protocol such as Bluetooth) and transmits sensor data to the electronic device. In some embodiments, the stylus can determine (e.g., via an accelerometer or other sensor) whether the user is holding the device. In some embodiments, the stylus can accept tap input from the user on the stylus (e.g., a single click or double click, for example, received by an accelerometer or other sensor) and interpret the input as a command or request to execute a function or switch to a different input mode.
[0368] The hardware layer can include various sensors, displays, cameras, etc.
[0369] It should be noted that Figure 3 is only an example of a software structure diagram of an electronic device, in which only the layers and software modules related to the present application are simply listed. In actual applications, the operating system of the electronic device may also include other layers, and each layer may also include other software modules for implementing one or more functions or services. This embodiment of the present application does not specifically limit this. In addition, this embodiment of the present application does not limit the specific layer where each software module is located. For example, the content manager may also be located in the system library or other layers.
[0370] The technical solution provided in the embodiment of the present application is applicable to handwriting scenarios. For example, handwriting input scenarios include but are not limited to the following applications (application, APP): memo APP, note APP and other note-taking APPs; email APP; instant messaging APP; drawing APP; text processing APP; spreadsheet APP; game APP; video conferencing APP; sports health APP; photo management APP; web APP; etc. When the electronic device executes the above-mentioned APPs, the APP interface can be displayed through the display screen 294, and the handwriting input operation can also be received through the touch sensor 280K. It should be noted that the present application does not limit the handwriting input scenario to APP, but can also be a small program, process or thread, such as a desktop process. The handwriting content processing method provided in the present application can be executed by an electronic device. The following explains some of the terms in this application to facilitate understanding by those skilled in the art.
[0371] 1) Electronic devices are devices or apparatuses that have data connectivity, data calculation, and data processing functions. Generally, electronic devices have display screens.
[0372] For example, the electronic devices in this application may be electronic whiteboards, business notebooks, electronic ink screens, tablet computers, personal computers (PCs), laptop computers, computers, netbooks, in-vehicle computers, smart phones, smart wearable devices (such as smart watches, smart bracelets, smart glasses, etc.), etc. Of course, the electronic devices may also be various portable devices, in-vehicle terminal devices, personal digital assistants (PDAs), smart home devices (such as smart TVs, etc.), and other smart devices. This application does not limit the specific form of the electronic devices.
[0373] The electronic device can realize its functions through the operating system it carries and provide services to the user. For example, the electronic device can be equipped with, but not limited to, Or other operating systems.
[0374] 2) The screen reporting point is the touch point where the user performs a touch operation on the display screen of the electronic device.
[0375] The sensor of the electronic device can report the data or information of the touch point at a certain frequency, such as reporting to a processing system, such as a system on chip (SOC). Each screen reporting point can have corresponding data. The sensor of the electronic device can obtain the data of the touch point by continuously collecting the data of the touch point during the touch operation, and through the relevant processing of the electronic device. Such as sparse sampling processing, denoising processing, etc. In general, the data of the screen reporting point is simply referred to as reporting point data, and the reporting point data may include the timestamp (or acquisition time) of the screen reporting point and the position of the screen reporting point. Among them, the timestamp of the reporting point data represents the time when the sensor of the electronic device collects the screen reporting point during the touch operation. Optionally, since the size of the handwriting interface and the display screen may be the same or different, the position of the screen reporting point may be the position (coordinates) of the screen reporting point on the display screen, or it may be the position of the screen reporting point in the handwriting interface currently displayed on the display screen (or the position relative to the application), and this application does not limit this.
[0376] Optionally, the point reporting data may also include screen pressure data, screen temperature, and point reporting type. Point reporting types may include pen drop points, pen movement points, and pen stop points. In some scenarios, the pressure data may be provided by a touch input device capable of interacting with an electronic device, such as a stylus or handwriting pen.
[0377] The electronic device can display the corresponding handwritten content or input content on the display screen based on each reporting point data. The reporting point data used to display the handwritten content can be recorded as the reporting point data corresponding to the handwritten content.
[0378] Each point reporting data can be stored in a screen point reporting data file, which can be stored in a memory of the electronic device, such as a cache. In some examples, the electronic device can manage the point reporting data in the screen point reporting data file, such as deleting or removing some point reporting data, to clear or undo some or all handwriting in the handwritten content.
[0379] The sensor of the electronic device can detect and receive handwriting input by continuously collecting reporting data during the touch operation.
[0380] 3) Handwritten content refers to the content information obtained in response to handwriting input.
[0381] For any handwriting input, the electronic device's sensor (such as a touch component) can report data or information about each touch point, thereby enabling the electronic device to obtain the point reporting data for any handwriting input. The point reporting data for any handwriting input can reflect the trajectory formed by the handwriting input, generally referred to as handwriting. The content information generated (or displayed) by the electronic device that can reflect the trajectory of the handwriting input can be referred to as the handwritten content corresponding to the handwriting input.
[0382] It is understood that the content information corresponding to the handwriting input can be the actual handwriting input, the handwriting input after scaling based on the actual handwriting input, or the handwriting input generated based on the point reporting data of the handwriting input. In the embodiment of the present application, the handwritten content corresponding to a handwriting input can be understood as the content that can reflect the handwriting formed by the handwriting input. The electronic device can directly display the handwritten content corresponding to the handwriting input based on the point reporting data of the handwriting input.
[0383] Alternatively, if handwriting input is displayed directly based on the dot reporting information, jagged edges, unnatural transitions, and other unsightly effects may occur. The electronic device can determine corresponding processing information based on the dot reporting data of the handwriting input. The processing information may include, but is not limited to, line width parameters and handwriting style parameters. For example, the electronic device can determine the processing information based on the dot reporting speed and / or pressure data corresponding to the handwriting input, as well as a corresponding processing model.
[0384] Optionally, the electronic device may perform smoothing correction or interpolation processing on the handwritten input point reporting data to obtain optimized point reporting data. In this application, point reporting data may refer to unoptimized point reporting data or optimized point reporting data, and this application does not specifically limit this. The electronic device may display the handwritten content corresponding to the handwritten input based on the handwritten input point reporting data and the processing information.
[0385] First, an embodiment of the present application provides a method for processing handwritten content, which can be performed by an electronic device. Referring to FIG4 , the method may include the following steps:
[0386] S101, displaying a target handwriting interface.
[0387] S102: Display first handwriting content corresponding to the first handwriting input in the target handwriting interface according to the first handwriting input received by the target handwriting interface.
[0388] S103: Determine, based on the first target operation, second handwriting content displayed in the target handwriting interface.
[0389] S104: Clear the second handwritten content on the target handwriting interface and retain at least a portion of the first handwritten content.
[0390] S105: Store the second handwritten content in a target file.
[0391] In conjunction with Figure 5A, in the handwriting content processing method provided by this application, as shown in (a) in Figure 5A, the target handwriting interface can be a handwriting interface in which the user is performing a first handwriting requirement. The target handwriting interface can be a user interface, or a part of a user interface. The handwriting interface not only has a display function, but also has a function of receiving handwriting input. The target handwriting interface can receive any handwriting input and display the handwritten content corresponding to any handwriting input in the target handwriting interface.
[0392] The user can trigger the first target operation, causing the electronic device to perform the operations in steps S103, S104, and S105. In step S103, the electronic device can determine the second handwritten content from the handwritten content displayed in the target handwriting interface based on the first target operation, as shown in (b) in Figure 5A. For ease of distinction, in this embodiment of the application, the second handwritten content can be understood as the handwritten content corresponding to the user's second handwriting requirement, or the handwritten content corresponding to the temporary handwriting requirement.
[0393] In some examples, the user can open the target handwriting interface by opening an application. The electronic device can display the target handwriting interface in response to the operation of opening the application. Alternatively, the user can open the target handwriting interface by opening a file. The electronic device can display the target handwriting interface in response to the operation of opening the file. In some scenarios, after the user opens the target handwriting interface, the target handwriting interface displays handwritten content, which can be the handwritten content corresponding to the handwriting input made by the user when the target handwriting interface was opened the previous time. After the user opens the target handwriting interface this time, the target handwriting interface can make a first handwriting input through the target handwriting interface, and the target handwriting interface can display the first handwriting content corresponding to the first handwriting input. It can be seen that the target handwriting interface can display the first handwriting content, and can also display the handwriting content corresponding to the handwriting input made when the target handwriting interface was opened before this time.
[0394] Optionally, in some scenarios, the handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface since the target handwriting interface was opened this time. In other scenarios, the handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface since the target handwriting interface was opened this time, as well as the handwritten content corresponding to each handwriting input made when the target handwriting interface was opened before this time.
[0395] In one possible design, the user triggers the first target operation after performing a handwriting input for the second handwriting requirement. In other words, the second handwriting input corresponding to the second handwriting content may occur before the electronic device detects the first target operation. In this case, the first handwriting input received by the target handwriting interface may be a handwriting input including the second handwriting requirement. The electronic device determines the second handwriting content from the handwriting content displayed in the target handwriting interface based on the first target operation, and may determine the second handwriting content from the first handwriting content. As shown in (a) in Figure 5A, the handwriting content in the target handwriting interface is the first handwriting content corresponding to the first handwriting input received by the target handwriting interface.
[0396] Please continue to refer to (b) and (c) in Figure 5A. After the electronic device determines the second handwritten content, it can clear the second handwritten content from the target handwriting interface and retain at least a portion of the first handwritten content. For example, the handwritten content other than the second handwritten content in the first handwritten content is retained. The user can continue to observe (view) the handwritten content other than the second handwritten content in the first handwritten content through the target handwriting interface, that is, the handwritten content corresponding to the first handwriting requirement, such as the handwritten content in the target handwriting interface shown in (c) in Figure 5A. The user can continue to perform the first handwriting requirement through the target handwriting interface.
[0397] In another possible design, after the user triggers the first target operation, the second handwriting requirement is made in the target handwriting interface. In other words, the second handwriting input corresponding to the second handwriting content may occur after the electronic device detects the first target operation. In this case, the first handwriting input received by the target handwriting interface does not include the handwriting input for the second handwriting requirement. As shown in (a) in Figure 5B, before the electronic device detects the first target operation, the handwriting content in the target handwriting interface is the first handwriting content corresponding to the first handwriting input received by the target handwriting interface. After the electronic device detects the first target operation, the target handwriting interface receives the handwriting input for the second handwriting requirement and displays the handwriting content corresponding to the handwriting input. At this time, the handwriting content displayed on the target handwriting interface may include the first handwriting content and the second handwriting content, as shown in (b) in Figure 5B.
[0398] Continuing with (c) in Figure 5B , after the electronic device determines the second handwritten content, it can clear the second handwritten content from the second handwriting interface, retaining the first handwritten content. The user can continue to observe (view) the entire first handwritten content through the target handwriting interface, i.e., the handwritten content corresponding to the first handwriting request. The user can continue to perform the first handwriting request through the target handwriting interface.
[0399] Based on any of the above possible designs, the electronic device can clear the second handwritten content from the target handwriting interface and store the second handwritten content in a target file. As is clear from the above description, the handwritten content corresponding to the user's second handwriting request can be displayed in the handwriting interface of the first handwriting request, along with the handwritten content corresponding to the user's first handwriting request, that is, displayed in the target handwriting interface. After the electronic device determines the second handwritten content from the target handwriting interface, it can clear the second handwritten content, that is, stop displaying the second handwritten content in the target handwriting interface, and retain at least a portion of the first handwritten content in the target handwriting interface. The electronic device then stores the second handwritten content. This process eliminates the need for the user to repeatedly switch handwriting interfaces to perform different handwriting requests. Furthermore, for the handwritten content corresponding to the first handwriting request, the user does not need to perform additional management operations such as distinguishing the handwritten content of the first handwriting request from the second handwriting request. Thus, the handwritten content processing method provided in the embodiments of the present application can reduce user operations, store sudden handwriting requests of users, and improve convenience.
[0400] In this application, the process of processing handwritten content corresponding to a temporary handwriting requirement can be simply referred to as the inspiration pen function. For example, the process of performing at least one of the following operations on the electronic device: determining the second handwritten content, clearing the second handwritten content, and storing the second handwritten content can be simply referred to as the inspiration pen function. In some scenarios, the electronic device can perform the operations in steps S103, S104, and S105 in response to detecting the first target operation.
[0401] In a possible implementation, the first target operation in this application may include but is not limited to any of the following operations:
[0402] a first preset operation on the physical structure of the electronic device;
[0403] a second preset operation on at least one virtual button displayed on the electronic device;
[0404] a third preset operation on the touch display device of the electronic device;
[0405] The preset first voice control operation;
[0406] The preset first gesture control operation;
[0407] The operation of sending a first indication signal to the electronic device.
[0408] In an embodiment of the present application, the target handwriting interface can receive any handwriting input and display the handwritten content corresponding to the any handwriting input in the target handwriting interface. The operation of this function of the target handwriting interface may not be affected by whether the electronic device detects the first target operation. Before the electronic device detects the first target operation, the receiving and display functions of the target handwriting interface operate normally. After the electronic device detects the first target operation, the receiving and display functions of the target handwriting interface operate normally.
[0409] In some possible scenarios, the first target operation may include a first preset operation on the physical structure of the electronic device. Optionally, the physical structure of the electronic device may be a hardware button, as shown in (a) of FIG6A , and the first preset operation may include but is not limited to: pressing the hardware button, pressing the hardware button multiple times in succession, and long pressing the hardware button for a preset time. Alternatively, the physical structure of the electronic device may be a knob, as shown in (b) of FIG6A , and the first preset operation may include but is not limited to: rotating the knob to a first preset position. Alternatively, the physical structure of the electronic device may be a switch, as shown in (c) of FIG6A , and the first preset operation may include but is not limited to: turning the switch on or off. Alternatively, the physical structure of the electronic device may be a touch bar, and the first preset operation may include but is not limited to touch operations on the touch bar, such as single-clicking the touch bar, double-clicking the touch bar, long pressing the touch bar, or sliding on the touch bar. Optionally, the touch bar may be replaced with a touchpad.
[0410] In other possible situations, the first target operation may include a second preset operation on at least one virtual key displayed on the electronic device. The first target operation may be a second preset operation of the user on at least one virtual key of the inspiration pen function displayed on the electronic device. Optionally, the user can perform the second preset operation on the virtual key through a command input device. The command input device may include but is not limited to a touch screen, an active or passive stylus, a stylus and other input devices. The second preset operation may include but is not limited to: clicking a virtual key once, clicking a virtual key continuously, dragging a virtual key in a preset manner, or long pressing a virtual key for a preset period of time.
[0411] For example, as shown in FIG6B , the first target operation is a second preset operation for the first virtual key. The first virtual key can be displayed in a menu bar in a user interface. The user interface can include a menu bar interface and a handwriting interface. The handwriting interface can be used to display handwritten content and receive handwritten input. This application does not specifically limit the position layout of the menu bar interface and the handwriting interface in the user interface, nor does it specifically limit the layout of each key in the menu bar interface.
[0412] Optionally, when the electronic device displays a user interface including a handwriting interface, the menu bar interface may also be continuously displayed within the user interface. Alternatively, when the electronic device displays a user interface including a handwriting interface, the menu bar interface may be displayed within the handwriting interface upon detecting a preset trigger operation, and if no operation of a button in the menu bar interface is detected within a continuous period, the menu bar interface may be partially or entirely hidden.
[0413] In some other possible scenarios, as shown in FIG6C , the first target operation may include a third preset operation on a touch display device of the electronic device. Optionally, the touch display device may be implemented as a touch screen. The third preset operation may include, but is not limited to, sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0414] In some other possible situations, the first target operation may include a preset first voice control operation. The electronic device may have audio collection capabilities. The electronic device may detect the user's preset first voice control operation on the electronic device. For example, the electronic device may collect audio and recognize that the audio includes a first preset voice instruction. The first preset voice instruction may include but is not limited to: "Turn on inspiration pen mode", "Enter inspiration pen mode", "Switch inspiration pen mode" and other voice contents with the same or similar meanings.
[0415] In some other possible situations, the first target operation may include a preset first gesture control operation. The electronic device may have image acquisition capabilities and gesture recognition capabilities. The user may perform a preset first gesture control operation by performing an air gesture within the image acquisition range of the electronic device. The electronic device may detect whether the user has performed the preset first gesture control operation by detecting whether the captured image includes a preset gesture. Optionally, in this example, the air gesture may be a static gesture, or the air gesture may be a dynamic gesture.
[0416] In some other possible situations, the first target operation may include an operation of sending a first indication signal to the electronic device. The electronic device may have a signal receiving capability. The electronic device may detect the received signal. If the electronic device detects the first indication signal, it may determine that the first target operation is detected. Optionally, as shown in FIG6D , the electronic device may interact with a stylus-type input device. The first indication signal may be a signal sent by a stylus-type input device. The user may trigger the stylus-type input device to send a first indication signal to the electronic device through a preset operation on the stylus-type input device, so that the electronic device switches to the inspiration pen mode. Optionally, the user may perform a preset operation on the stylus-type input device by pressing a button on the stylus-type input device at least once, or by touching a designated position of the stylus-type input device at least once, or by shaking, rocking, or rotating the stylus-type input device in a predetermined manner. The embodiments of the present application do not specifically limit this.
[0417] The electronic device and the stylus-type input device can exchange information based on a preset protocol. The embodiment of the present application does not specifically limit the data transmission protocol or communication protocol of the exchange information. In some application scenarios, the stylus-type input device can be an active stylus.
[0418] In one possible design, the electronic device can display the handwritten content corresponding to any handwriting input received by the target handwriting interface in the target handwriting interface. In other words, in the handwriting interface where the user is performing handwriting input for the first handwriting requirement, the target handwriting interface can display the handwritten content corresponding to any handwriting input received by the target handwriting interface.
[0419] For example, before the electronic device detects the first target operation, the electronic device may, based on any handwriting input received by the target handwriting interface, display the handwritten content corresponding to the any handwriting input in the target handwriting interface. For another example, after the electronic device detects the first target operation, the electronic device may, based on any handwriting input received by the target handwriting interface, display the handwritten content corresponding to the any handwriting input in the target handwriting interface.
[0420] The following describes the process of the electronic device determining the second handwritten content. The electronic device may use, but is not limited to, any one or more of the following operations to determine the second handwritten content.
[0421] Design A1, when the electronic device determines the second handwritten content displayed on the target handwriting interface, it can determine the second handwritten content based on the first target operation. The electronic device can determine the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the first target time period as the second handwritten content, wherein the starting moment of the first target time period is the moment when the first target operation is detected. For example, the electronic device can determine the handwritten content input time in the first target time period as the second handwritten content. Alternatively, the handwritten content corresponding to the handwriting input occurring in the first target time period is determined as the second handwritten content. Alternatively, the handwritten content corresponding to the handwriting input occurring in the first target time period and other handwriting inputs continuous with the handwriting input are determined as the second handwritten content.
[0422] As can be seen, the target handwriting interface can receive part of the second handwritten content within the first target period. Another part of the second handwritten content may be received after the first target period. The electronic device can determine the second handwritten content based on the handwriting input received on the target handwriting interface within the first target period and the handwriting input that is continuous with the handwriting input.
[0423] Optionally, the duration of the first target period may be a preset first duration. Optionally, the first duration may be 1 minute or 30 seconds.
[0424] After detecting the first target operation, the electronic device can distinguish between the content of the first handwriting request and the content of the second handwriting request based on the time when the first target operation is detected. The electronic device can determine the handwritten content corresponding to the second handwriting input received on the target handwriting interface within the first target time period as the second handwriting content, thereby determining the handwritten content corresponding to the second handwriting request.
[0425] In Design A2, when the electronic device determines the second handwritten content displayed on the target handwriting interface, the electronic device may determine the second handwritten content based on the first target operation and the second target operation. Based on the detected second target operation, the electronic device may determine the handwritten content corresponding to the second handwriting input received on the target handwriting interface within a second target period as the second handwritten content, where the start time of the second target period is the time when the first target operation is detected, and the end time of the second target period is the time when the second target operation is detected.
[0426] In this design, the first target operation can also be understood as the operation of starting the inspiration pen function, or the operation of starting the second handwriting requirement. The second target operation can be understood as the operation of ending the second handwriting requirement. The electronic device can determine the handwritten content corresponding to the handwriting input occurring between the first target operation and the second target operation as the second handwritten content.
[0427] Optionally, the second target operation in this application may include but is not limited to any of the following operations:
[0428] a fourth preset operation on the physical structure of the electronic device;
[0429] a fifth preset operation on at least one virtual button displayed on the electronic device;
[0430] a sixth preset operation on the touch display device of the electronic device;
[0431] Preset second voice control operation;
[0432] Preset second gesture control operation;
[0433] The operation of sending a second indication signal to the electronic device.
[0434] Optionally, the physical structure of the electronic device may be a hardware button. The fourth preset operation may include, but is not limited to, pressing the hardware button, pressing the hardware button multiple times in succession, or long-pressing the hardware button for a preset duration. Alternatively, the physical structure of the electronic device may be a knob, and the fourth preset operation may include, but is not limited to, rotating the knob to a second preset position, which may be different from the first preset position. Alternatively, the physical structure of the electronic device may be a switch, and the second preset operation may include, but is not limited to, turning the switch on or off, wherein the fourth preset operation may turn the switch to a different state than the first preset operation. For example, the first preset operation may turn the switch on, and the fourth preset operation may turn the switch off. For another example, the first preset operation may turn the switch off, and the fourth preset operation may turn the switch on. Alternatively, the physical structure of the electronic device may be a touch bar, and the fourth preset operation may include, but is not limited to, touch operations on the touch bar, such as single-clicking the touch bar, double-clicking the touch bar, long-pressing the touch bar, or sliding on the touch bar. Optionally, the touch bar may be replaced with a touchpad.
[0435] In other possible scenarios, the second target operation may include a fifth preset operation on at least one virtual key displayed on the electronic device. The second target operation may be a fifth preset operation performed by the user on at least one virtual key for the inspiration pen function displayed on the electronic device. Optionally, the user may perform the fifth preset operation on the virtual key through a command input device. The command input device may include, but is not limited to, a touch screen, an active or passive stylus, a stylus, or other input device. The fifth preset operation may include, but is not limited to: clicking the virtual key once, clicking the virtual key continuously, dragging the virtual key in a preset manner, or long pressing the virtual key for a preset duration. Optionally, the second preset operation in the aforementioned first target operation is an operation on the first virtual key, and the fifth preset operation in the second target operation is an operation on the second virtual key. In some examples, the first virtual key and the second virtual key are different virtual keys. For example, the first virtual key is a button in the menu bar of the user interface, such as the [Inspiration Pen] button shown in (a) of Figure 7A. When the electronic device executes the inspiration pen function, the display state of the menu bar changes, wherein a second virtual button may be displayed in the menu bar, such as the [End Input] button shown in (b) of Figure 7A.
[0436] In some examples, the first virtual key and the second virtual key are the same virtual key, only the display state is different. As shown in Figure 7B, for example, the first virtual key is a button in the menu bar in the user interface, and the button [Inspiration Pen] shown in (a) of Figure 7B is the display effect of the button in the first display state, and the button [Inspiration Pen] shown in (b) of Figure 7B is the display effect of the button in the second display state. After the first virtual key is clicked, the display state of the first virtual key switches. Optionally, after performing the second preset operation on the first virtual key, the display state of the first virtual key can be switched from the first display state to the second display state. After performing the fifth preset operation on the first virtual key, the display state of the first virtual key can be switched from the second display state to the first display state.
[0437] In some other possible scenarios, the second target operation may include a sixth preset operation on a touch display device of the electronic device. Optionally, the touch display device may be implemented as a touch screen. The sixth preset operation may include, but is not limited to: sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0438] In some other possible scenarios, the second target operation may include a preset second voice control operation. The electronic device may have audio collection capabilities. The electronic device may detect the user's preset second voice control operation on the electronic device. For example, the electronic device may collect audio and recognize that the audio includes a second preset voice instruction. The second preset voice instruction may include, but is not limited to, voice content with the same or similar meaning, such as "end input" and "complete input."
[0439] In some other possible situations, the second target operation may include a preset second gesture control operation. The electronic device may have image acquisition capabilities and gesture recognition capabilities. The user may perform a preset second gesture control operation by performing an air gesture within the image acquisition range of the electronic device. The electronic device may detect whether the user has performed the preset second gesture control operation by detecting whether the preset gesture is included in the captured image. Optionally, in this example, the air gesture may be a static gesture, or the air gesture may be a dynamic gesture. Optionally, the gesture used in the second gesture control operation and the gesture used in the aforementioned first gesture control operation may be the same gesture or different gestures.
[0440] In some other possible situations, the second target operation may include an operation of sending a second indication signal to the electronic device. The electronic device may have a signal receiving capability. The electronic device may detect the received signal. If the electronic device detects the second indication signal, it may be determined that the second target operation is detected. Optionally, the electronic device may interact with a stylus-type input device. The second indication signal may be a signal sent by the stylus-type input device. The user may trigger the stylus-type input device to send a second indication signal to the electronic device through a preset operation on the stylus-type input device, so that the electronic device switches to the inspiration pen mode. In some examples, the data form of the second indication signal may be the same as the data form of the first indication signal. In other words, when the electronic device receives the first indication signal again, it may be determined that the second target operation is detected. In other examples, the data form of the second indication signal may be different from the data form of the first indication signal.
[0441] Design A3: When the electronic device determines the second handwritten content displayed on the target handwriting interface, the electronic device may determine the selection range corresponding to the third target operation based on the detected third target operation, and determine the content in the selection range as the second handwritten content. In some scenarios, the content in the selection range may be part of the handwritten content displayed on the target display interface. In other scenarios, the content in the selection range may be content in the first handwritten content.
[0442] In one possible implementation, the third target operation is to use a set selection range tool provided by the electronic device to set a selection range outline or position in the target handwriting interface. Optionally, the selection range tool sets a default selection range outline to a rectangle or a circle. The electronic device may determine the selection range based on the outline and position of the selection range tool set by the third target operation, and then determine the handwritten content within the selection range as the second handwritten content.
[0443] In another possible implementation, the third target operation is an operation of performing handwriting input on the target handwriting interface. The third target operation may form a line or graphic in the target handwriting interface, and the formed line or graphic may indicate a selection range. The electronic device may determine the selection range based on the formed line or graphic. The handwritten content in the selection range is then determined as the second handwritten content. Optionally, the line or graphic formed by the third target operation in the target handwriting interface to indicate the selection range may include directly indicating the selection range or indirectly indicating the selection range.
[0444] In some examples, the third target operation is a handwriting input operation that forms a closed figure in the target handwriting interface. The embodiment of the present application does not limit the specific form of the closed figure. The closed figure can be any figure that can form a closed space, such as a circle, a rectangle, a triangle, or an irregular closed figure. As shown in Figure 8A, the electronic device can determine whether the target handwriting interface contains a closed figure by means of graphic recognition or detection. The electronic device can include any closed figure in the target handwriting interface, and use the any closed figure as the selection range corresponding to the third target operation, and determine the handwriting content within the selection range as the second handwriting content. In this example, the outline of the closed figure can form a selection range. It can be seen that the closed figure can directly indicate the selection range.
[0445] In some examples, the third target operation may be a handwriting input operation that forms a semi-enclosed graphic in the target handwriting interface. The embodiments of the present application do not limit the specific form of the semi-enclosed graphic. As shown in FIG8B , the electronic device may determine whether the target handwriting interface contains a semi-enclosed graphic through graphic recognition or detection.
[0446] Alternatively, referring to Figure 8B , the electronic device may infer, based on the semi-enclosed figure (shown by the thick black line), that the semi-enclosed figure is close to or similar to a closed figure (shown by the thin dashed line), and use the close closed figure as the selection range corresponding to the third target operation, and determine the handwritten content within the selection range as the second handwritten content. Clearly, in this example, the semi-enclosed figure can indirectly indicate the selection range.
[0447] In some examples, the third target operation may be a handwriting input operation that forms a line of any line type in the target handwriting interface. The embodiment of the present application does not specifically limit the line type. As shown in FIG8C , the electronic device may determine whether the target handwriting interface includes handwritten content of any line type by means of graphic recognition or detection. The electronic device may determine the second handwritten content based on the information of a line of any line type formed by the third target operation. The line information may include but is not limited to the position of the line, the endpoint of the line, and the length of the line. For example, the electronic device may determine the second handwritten content based on the length of the identified line, the content on one side of the line, or the content near the line that matches the length of the line. It can be seen that in this example, the line can indirectly indicate the selection range.
[0448] In some scenarios, the third target operation may occur before the first target operation, or the third target operation may occur after the first target operation. The third target operation may be an operation to form a closed figure, a semi-closed figure, or a line of any type in the target handwriting interface. The following uses the example of the third target operation forming a closed figure in the target handwriting interface as an example.
[0449] In one possible scenario, the third target operation may occur before the first target operation. The electronic device may display a target handwriting interface. Based on the first handwriting input received on the target handwriting interface, the first handwritten content corresponding to the first handwriting input may be displayed on the target handwriting interface. The electronic device may detect the third target operation and determine a selection range corresponding to the third target operation. Then, in response to detecting the first target operation, the electronic device may determine the second handwritten content displayed on the target handwriting interface. The electronic device may clear the second handwritten content on the target handwriting interface and store the second handwritten content in a target file. As shown in (a) of FIG. 9A , a user may perform an input operation to form a closed or semi-closed shape on the target handwriting interface, and the closed or semi-closed shape corresponding to the input operation may be displayed on the target handwriting interface. As shown in (b) of FIG. 9A , the user may perform a second handwriting input on the closed or semi-closed shape, and the electronic device may display the handwritten content corresponding to the second handwriting input on the target handwriting interface. The electronic device may use the closed or semi-closed shape as a selection range and then determine the handwritten content within the selection range as the second handwritten content.
[0450] Optionally, the electronic device may traverse the handwritten content displayed in the target handwriting interface in reverse order according to the input time corresponding to each handwritten content, determine whether each handwritten content contains a hand-drawn graphic that meets the preset graphic conditions, and thereby detect whether to accept the third target operation. If the handwritten content displayed in the target handwriting interface contains a hand-drawn graphic that meets the preset graphic conditions, the electronic device may use the handwritten content in the hand-drawn graphic as the second handwritten content.
[0451] In some application scenarios, the preset graphic condition may be that the hand-drawn graphic is a closed graphic. Alternatively, the preset graphic condition may be that the hand-drawn graphic is a closed graphic and the area of the closed graphic exceeds a preset area threshold. Optionally, the electronic device may obtain data on touch points (trajectory points) of multiple lines of a hand-drawn graphic, and the electronic device may iteratively determine the distance between the line endpoints. When the endpoints of all lines have other line endpoints within the preset distance threshold range, the hand-drawn graphic may be determined to be a closed graphic.
[0452] The electronic device can determine the area of a figure using any existing algorithm or technique for calculating the area of a figure. For example, the electronic device can identify the endpoints of a hand-drawn figure and identify the type of hand-drawn figure. The electronic device can calculate the area of the hand-drawn figure based on the distance between the endpoints and the distance between the endpoints and the handwriting.
[0453] In another possible scenario, the third target operation may occur after the first target operation. The electronic device may display a target handwriting interface. Based on the first handwriting input received by the target handwriting interface, the first handwritten content corresponding to the first handwriting input is displayed in the target handwriting interface. Then, in response to detecting the first target operation, the electronic device may determine the second handwritten content displayed in the target handwriting interface, wherein the electronic device detects whether the third target operation is received, and upon detecting the third target operation, determines the selection range corresponding to the third target operation and determines the content within the selection range as the second handwritten content. The electronic device may clear the second handwritten content on the target handwriting interface and store the second handwritten content in a target file. As shown in (a) of FIG. 9B , the user has completed inputting the second handwriting requirement in the target handwriting interface before the first target operation. As shown in (b) of FIG. 9B , the user may perform an input operation to form a closed or semi-closed figure in the target handwriting interface, and the closed or semi-closed figure corresponding to the input operation is displayed on the target handwriting interface. The electronic device may use the closed graphic or the semi-closed graphic as a selection range, and then determine the handwritten content within the selection range as the second handwritten content.
[0454] Design A4, when the electronic device determines the second handwritten content displayed on the target handwriting interface, it can determine the second handwritten content based on the input time corresponding to each handwritten content displayed in the target handwriting interface, wherein the input time of the second handwritten content is the handwritten content with the latest input time among the handwritten contents. Usually, the handwritten content with the latest input time corresponding to each handwritten content is also the handwritten content with the largest input time corresponding to each handwritten content. Optionally, in some scenarios, each handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface after the target handwriting interface is opened this time. In other scenarios, each handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface after the target handwriting interface is opened this time, as well as the handwritten content corresponding to each handwriting input performed when the target handwriting interface was opened before this time.
[0455] As shown in (a) of FIG9C , the handwritten content displayed in the target handwriting interface includes handwritten content 1, handwritten content 2, handwritten content 3, handwritten content 4, and handwritten content 5. The input time of each handwritten content is t1, t2, t3, t4, and t5, respectively, and the input time of each handwritten content is sorted in order of time: 1, t2, t3, t4, and t5. In response to detecting the first target operation, the electronic device can, based on the input time corresponding to each handwritten content displayed in the target handwriting interface, determine the handwritten content with the latest input time among the handwritten contents displayed in the target handwriting interface, i.e., handwritten content 5, as the second handwritten content.
[0456] Optionally, the time of the dot data corresponding to the handwritten content can represent the input time of the handwritten content. The time when the target handwriting interface receives the handwritten input can be used as the input time of the handwritten content corresponding to the handwritten input. Alternatively, the maximum or minimum time in the dot data used to display the handwritten content can be used as the input time of the handwritten content.
[0457] In some scenarios, the electronic device can determine the handwriting content corresponding to the second time length as the second handwriting content based on the time corresponding to each handwriting content displayed in the target handwriting interface, wherein the end time of the second time length is the maximum time among the times corresponding to each handwriting content.
[0458] As shown in (b) of FIG9C , the handwritten content displayed in the target handwriting interface includes handwritten content 1, handwritten content 2, handwritten content 3, handwritten content 4, and handwritten content 5. The input time of each handwritten content is t1, t2, t3, t4, and t5, respectively. The input time of each handwritten content is sorted in order of time as 1, t2, t3, t4, and t5. In response to detecting the first target operation, the electronic device can, based on the input time corresponding to each handwritten content displayed in the target handwriting interface, determine the handwritten content with the latest input time among the handwritten contents displayed in the target handwriting interface, namely, handwritten content 5, as the second handwritten content. In response to detecting the first target operation, the electronic device can, based on the input time corresponding to each handwritten content displayed in the target handwriting interface, determine the handwritten content with the largest input time among the handwritten contents displayed in the target handwriting interface and the handwritten content within a second time interval (denoted as dt) before the largest input time as the second handwritten content.
[0459] Design A5: When the electronic device determines the second handwritten content displayed on the target handwriting interface, the electronic device may determine the second handwritten content displayed on the target handwriting interface based on the input time and position corresponding to each handwritten content displayed in the target handwriting interface. Optionally, in some scenarios, each handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface after the target handwriting interface is opened this time. In other scenarios, each handwritten content displayed in the target handwriting interface may refer to the handwritten content corresponding to each handwriting input received by the target handwriting interface after the target handwriting interface is opened this time, as well as the handwritten content corresponding to each handwriting input performed when the target handwriting interface was opened before this time.
[0460] In some examples, when the electronic device determines the second handwritten content displayed on the target handwriting interface based on the input time and location corresponding to each handwritten content displayed on the target handwriting interface, the electronic device can separate the handwritten content in the target handwriting interface into lines. Referring to FIG9D , the electronic device can separate the handwritten content into lines based on the location distribution corresponding to each handwritten content displayed on the target handwriting interface and the input time corresponding to each handwritten content.
[0461] Figure 9D illustrates the effect of the electronic device dividing the handwritten content displayed on the target handwriting interface into rows, specifically illustrating the relationship between rows and the handwritten content. Optionally, the target handwriting interface does not display the row lines after the row lines have been divided. The electronic device can determine the row to which the handwritten content belongs based on the position of the row lines in the column direction and the position of the handwritten content. The electronic device can use any existing algorithm or technology to achieve row division of the content displayed on the target handwriting interface.
[0462] For example, the column-wise position of each row in the target handwriting interface can be pre-configured or configured based on the width or length of the handwritten content. The electronic device can match the column-wise position of each handwritten content with the column-wise position of each row. If the difference between the column-wise position of a piece of handwritten content and the column-wise position of any row is less than a preset first distance threshold, the handwritten content can be considered a match with the row. If a piece of handwritten content only matches one row, the handwritten content can be determined to belong to the row with which it matches.
[0463] If there is a handwritten content that has a matching relationship with two rows, that is, a handwritten content matches two rows, the electronic device can determine the row where the handwritten content with an input time close to or adjacent to the input time corresponding to the handwritten content is located as the row to which the handwritten content belongs based on the input time corresponding to each handwritten content.
[0464] The electronic device can thereby learn the row to which each handwritten content in the target handwriting interface belongs. The electronic device can determine the handwritten content in the target row as the second handwritten content, where the target row contains the handwritten content with the latest input time among the handwritten contents. In other words, the row to which the handwritten content with the largest input time among the handwritten contents belongs is the target row. The electronic device can determine the handwritten content belonging to the target row, which is also the handwritten content in the target row, as the second handwritten content.
[0465] In other examples, in the process of determining the second handwritten content displayed on the target handwriting interface based on the input time and position corresponding to each handwritten content displayed in the target handwriting interface, the electronic device can determine the block where each handwritten content displayed in the target handwriting interface is located. As shown in Figure 9E, the electronic device can block the handwritten content of the target handwriting interface, for example, it can be divided into multiple blocks, and there is no overlapping between the blocks. Optionally, any two blocks can meet the preset block position condition. For example, the preset block position condition can be that the positions of the two blocks are clearly distinguished.
[0466] The electronic device may determine the handwritten content in the target block as the second handwritten content. The target block includes the handwritten content with the latest input time among the handwritten contents.
[0467] The electronic device may use any existing algorithm or technology to divide the handwritten content of the target handwriting interface into blocks.
[0468] For example, the electronic device can use a projection method to divide the handwritten content of the target handwriting interface into blocks. The electronic device projects the lines of each handwritten content in the target handwriting interface onto a preset x-axis and a preset y-axis respectively. The electronic device projects the lines of each handwritten content in the target handwriting interface onto a preset x-axis to obtain a first projection histogram corresponding to the x-axis. The x-axis in the first projection histogram is reduced and mapped to the x'-axis to reduce the influence of spaces between characters in the same row or column on the determination of the final segmentation position. The electronic device can calculate the segmentation position on the x'-axis based on the peak and trough trend of the first histogram. The electronic device can determine the segmentation position on the x'-axis based on the aforementioned mapping relationship, and the position of the column segmentation line on the x-axis to obtain the position of the column segmentation line in the target handwriting interface. Similarly, the electronic device projects the lines of each handwritten content in the target handwriting interface onto a preset x-axis to obtain a first projection histogram corresponding to the x-axis. The y-axis in the first projection histogram is reduced and mapped to the y'-axis to reduce the influence of spaces between characters in the same row or column on the determination of the final segmentation position. The electronic device can calculate the segmentation position on the y' axis based on the peak and trough trend of the second histogram. The electronic device can determine the segmentation position on the y' axis based on the aforementioned mapping relationship, thereby obtaining the position of the row segmentation line in the target handwriting interface.
[0469] The electronic device can then divide the target handwriting interface into multiple blocks based on the obtained row and column dividing lines. Based on the positions of each dividing line and the maximum and minimum values of the trajectory points corresponding to all handwritten content on the x-axis and y-axis, different block ranges can be obtained. By traversing all handwritten content, if the center of gravity of the handwriting falls within the range of a block, the stroke is considered to belong to that block.
[0470] For another example, the electronic device can use the trajectory points of each handwritten content in the target handwriting interface as discrete points. Based on the clustering algorithm, the discrete handwriting trajectory points are clustered to obtain the category to which each trajectory point belongs and n category centers, and the circumscribed rectangle of each category is obtained to obtain n areas. The electronic device can use the center of gravity of the handwriting to determine which area the handwriting belongs to (to prevent the noise generated by clustering), and determine multiple blocks and the handwritten content in each block. Optionally, the clustering algorithm may include but is not limited to: density based spatial clustering of applications with noise (DBSCAN), spectral clustering algorithm and other clustering algorithms.
[0471] DBSCAN defines a cluster as the largest set of density-connected points. It can partition sufficiently dense regions into clusters and discover clusters of arbitrary shapes in spatial databases. The spectral clustering algorithm defines an affinity matrix describing the similarity between pairs of data points based on a given sample dataset, calculates the matrix's eigenvalues and eigenvectors, and then selects appropriate eigenvectors to cluster different data points.
[0472] In one possible implementation, the handwritten content processing method may further include: after the electronic device determines the second handwritten content, generating or displaying a reminder message to indicate whether the user needs to adjust the second handwritten content. Alternatively, generating content confirmation information to instruct the user to confirm whether the second handwritten content is correct. The content confirmation information may also have the function of indicating whether the user needs to adjust the second handwritten content.
[0473] The following is an introduction using content confirmation information as an example. In some scenarios, the content confirmation information may include reminder information.
[0474] After determining the second handwritten content, the electronic device may generate content confirmation information to remind the user to check or verify whether the determined second handwritten content is accurate. The content confirmation information may indicate the second handwritten content.
[0475] The content confirmation information may indicate the second handwritten content in the form of a position indication and / or a text indication.
[0476] In some possible designs, the content confirmation information may include reminder text information. The reminder text information is used to remind the user to determine whether the second handwritten content is accurate, or to remind the user whether to modify the second handwritten content. For example, the reminder text information may be "whether to modify the temporary content", "whether to modify the inspiration content", "whether to modify", "whether to save", "whether to modify: the recognition result of the second handwritten content", "please confirm: the recognition result of the second handwritten content". In some scenarios, as shown in (a) in Figure 9F, after the electronic device determines the second handwritten content, please combine Figure 9F (b), the electronic device can generate content confirmation information M1 and display the content confirmation information M1. The content confirmation information M1 can be implemented in the form of a pop-up window. The pop-up window can be a window with preset transparency or a floating window. The reminder text information of the content confirmation information M1 can be "whether to modify: the recognition result of the second handwritten content".
[0477] Optionally, the user may operate the window. If the user modifies the recognition result of the second handwritten content in the window, the modified recognition result of the second handwritten content is updated as the recognition result of the second handwritten content, so as to store the recognition result of the second handwritten content.
[0478] Optionally, when the content confirmation information M1 is implemented as a pop-up window, the position of the pop-up window may overlap with the position of the second handwritten content determined by the electronic device. The position of the pop-up window may also be any position in the user interface to which the target handwriting interface belongs.
[0479] For example, the content confirmation information M1 may further include one or more operation buttons, such as one or more of a "Modify" button, a "Confirm" button, and a "Save" button.
[0480] In some scenarios, after the user clicks the "Modify" button, the user can modify the recognition result of the second handwritten content through the window. Optionally, the recognition result of the second handwritten content can be displayed in the input box M2. The user can modify the recognition result of the second handwritten content in the input box M2. If the user modifies the recognition result of the second handwritten content in the window, the modified recognition result of the second handwritten content is updated as the recognition result of the second handwritten content, so that the electronic device can store the recognition result of the second handwritten content.
[0481] In some scenarios, the user operates the "OK" button to confirm the recognition result of the second handwritten content, so that the electronic device stores the recognition result of the second handwritten content or the modified recognition result.
[0482] In some scenarios, the user's operation of the "Save" button instructs the electronic device to store the recognition result of the second handwritten content or the modified recognition result.
[0483] In some possible designs, the content confirmation information may include display information. The display information is used to indicate the second handwritten content by indicating a position. The display information may include an indication graphic.
[0484] In some examples, the indication graphic may be a closed graphic. Referring to FIG9F (c), the content of the indication graphic M3 is the second handwritten content determined by the electronic device. Optionally, the closed graphic may be a rectangle.
[0485] In some examples, the indication graphic may be a line-type graphic. Referring to (d) in FIG. 9F , the content closest to the upper portion of the indication graphic M4 is the second handwritten content.
[0486] Optionally, for example, the user can enter a mode for adjusting the indication graphic by operating the indication graphic. By dragging a side or endpoint of the indication graphic, the range of the indication graphic can be adjusted. The electronic device can then redefine the second handwritten content based on the adjusted indication graphic.
[0487] In some examples, the displayed information may include a highlighted area. Referring to (e) in FIG. 9F , the content in the highlighted area is the second handwritten content.
[0488] Optionally, the user can modify the second handwritten content by adjusting the indicator graphic through an adjustment operation. The electronic device can redefine the second handwritten content in response to detecting the adjustment operation. When redefining the second handwritten content, the electronic device can redefine the second handwritten content based on the adjusted indicator graphic and the adjusted highlighted area.
[0489] For example, the user can enter the highlight area adjustment mode by operating the highlight area. By dragging an edge or endpoint of the highlight area, the range of the highlight area can be adjusted. The electronic device can re-determine the second handwritten content based on the adjusted highlight area.
[0490] In one possible implementation, the electronic device may simultaneously or synchronously clear the second handwritten content in the target handwriting interface and store the second handwritten content in the target file. Alternatively, the electronic device may asynchronously perform the two operations of clearing the second handwritten content in the target handwriting interface and storing the second handwritten content in the target file. Optionally, the operation of clearing the second handwritten content in the target handwriting interface may precede the operation of storing the second handwritten content in the target file, or the operation of storing the second handwritten content in the target file may precede the operation of clearing the second handwritten content in the target handwriting interface.
[0491] The following describes the process of the electronic device clearing the second handwritten content in the target handwriting interface. The electronic device can use, but is not limited to, any one or more of the following designed operations to clear the second handwritten content in the target handwriting interface.
[0492] Design B1, before the electronic device determines the second handwriting content displayed on the target handwriting interface based on the first target operation, after detecting the first target operation, the electronic device can determine the second handwriting content corresponding to the second handwriting input in the target handwriting interface based on the second handwriting input received by the target handwriting interface, and display the second handwriting content or the recognition result corresponding to the second handwriting content.
[0493] The electronic device can utilize or create a first layer, which is used to display the first handwritten content. When the electronic device displays the second handwritten content, it can add a new layer, which is recorded as the target layer, and the target layer is used to display the second handwritten content. The electronic device displays the target layer to display the second handwritten content on the target handwriting interface. It can be seen that the target layer is different from the aforementioned first layer.
[0494] Optionally, the electronic device may add a target layer after determining the second handwritten content. Alternatively, the electronic device may display the second handwritten content in the target handwriting interface in response to detecting the first target operation. When the electronic device clears the second handwritten content in the target handwriting interface, it may do so by clearing the target layer. The electronic device does not clear the first layer used to display the first handwritten content, thereby retaining the first handwritten content in the target handwriting interface.
[0495] In some application scenarios, after detecting a first target operation, the electronic device distinguishes between the content of the first handwriting requirement and the content of the second handwriting requirement based on the moment when the first target operation is detected. The electronic device may determine the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the aforementioned first target time period as the handwritten content corresponding to the second handwriting requirement. Or the electronic device may, based on the detected second target operation, determine the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the second target time period as the second handwriting content. The electronic device may add a target layer based on detecting the first target operation. The target layer is used to display the second handwriting content. For example, the electronic device may create a new target view object and draw the second handwriting content on the target view object to add a target layer. The electronic device may draw the second handwriting content on a layer of the target view object or on a canvas. The electronic device may clear the second handwriting content on the target handwriting interface by clearing the target layer. For example, the electronic device may close the target view object to clear the target layer.
[0496] In some application scenarios, electronic devices can generate handwritten traces based on the point reporting data corresponding to the handwritten content. Alternatively, electronic devices can generate handwritten traces based on the point reporting data corresponding to the handwritten content and a preset processing algorithm. Preset processing algorithms may include, but are not limited to, smoothing correction algorithms and interpolation algorithms, such as smoothing and interpolation using Bezier curves. Preset processing algorithms may also include trace generation algorithms. For example, trace generation algorithms may include, but are not limited to, algorithms based on line width and / or pen strokes. In some examples, the line width information of handwritten content can be determined based on speed or pressure information in the point reporting data for the handwritten content. The electronic device can use an active stylus to obtain pressure information during the touch of each point reporting point. The greater the pressure, the greater the line width. The smaller the pressure, the smaller the line width. In other examples, the line width information of handwritten content can be determined based on speed information in the point reporting data for the handwritten content. The greater the speed, the smaller the line width. For another example, the algorithm based on pen strokes can be based on brush strokes, which can achieve stroke effects such as non-white, starting strokes, and ending strokes.
[0497] The screen point reporting data file can be used to record the data of each screen point reporting in the target handwriting interface. That is, the screen point reporting data file can be used to record the point reporting data of the handwritten content in the handwriting interface when the user performs a first handwriting request. A second handwriting request can also be input through the target handwriting interface, and the screen point reporting data file can record the point reporting data corresponding to the second handwriting request. Based on the screen point reporting data file, the electronic device can also display the handwritten content corresponding to the second handwriting request, i.e., the second handwriting content, when displaying the handwritten content in the target handwriting interface.
[0498] Design B2, the electronic device can clear the second handwriting content on the target handwriting interface by clearing, removing, deleting, removing, moving out, or transferring the point reporting data of the second handwriting content from the screen point reporting data file.
[0499] In some examples, an electronic device can obtain handwritten content in a target handwriting interface based on a screen point reporting data file. The screen point reporting data file can include point reporting data corresponding to each handwritten content in the target handwriting interface. The point reporting data for each handwritten content can be obtained by collecting the touch points corresponding to the handwriting input by the electronic device's sensors. The screen point reporting data file can be, but is not limited to, a list data structure.
[0500] Optionally, the screen point reporting data file may also include processing information corresponding to each handwritten content. For example, the data used to display each handwritten content in the screen point reporting data file includes {handwritten content identifier, point reporting data} or {handwritten content identifier, point reporting data, processing information}. Optionally, the screen point reporting data file may be based on the granularity of a handwriting. For example, the data used to display each handwritten content in the screen point reporting data file may include: {handwriting, handwriting content identifier to which the handwriting belongs, point reporting data corresponding to the handwriting} or {handwriting, handwriting content identifier to which the handwriting belongs, point reporting data corresponding to the handwriting, processing information corresponding to the handwriting}.
[0501] The electronic device can display the handwriting of each handwritten content based on the data of each handwritten content in the screen point reporting data file. In one possible design, when the electronic device clears the second handwritten content on the target handwriting interface, the data of the second handwritten content can be cleared, removed, deleted, removed, moved out, or transferred from the screen point reporting data file, so that the second handwritten content is not displayed on the target handwriting interface, and the target handwriting interface can display the handwritten content retained in the screen point reporting data file.
[0502] In some examples, in the screen point reporting data file, each point reporting data is configured with a handwritten content identifier. Each processing information is configured with a handwritten content identifier. For example, the identifier of handwritten content A is 1, the identifier of handwritten content B is 2, and the identifier of handwritten content 3 is 3. If the electronic device clears handwritten content A, the point reporting data, processing information, and other data related to handwritten content identifier 1 can be deleted from the screen point reporting data file. If the screen point reporting data retains data related to handwritten content identifier 2 and data related to handwritten content identifier 3, the electronic device can overwrite and render to the canvas layer based on the screen point reporting data file to display handwritten content 2 and handwritten content 3.
[0503] In some examples, as shown in (a) in FIG10A , the second handwritten content is displayed in the target handwriting interface. The electronic device can directly clear the second handwritten content in the target handwriting interface, as shown in (b) in 10A . In other examples, as shown in FIG10A , after the electronic device clears the second handwritten content in the target handwriting interface, the position corresponding to the second handwritten content displays the printed content corresponding to the second handwritten content as shown in (c) in FIG10A . After a preset time period, the electronic device clears the printed content corresponding to the second handwritten content. The printed content corresponding to the second handwritten content can be understood as having the same content as the second handwritten content and displayed in printed style.
[0504] The printed form corresponding to the handwritten content may be determined based on the recognition result of the handwritten content. In some possible application scenarios, the electronic device may obtain the recognition result of any handwritten content.
[0505] Optionally, the recognition result corresponding to any handwritten content may be determined by the electronic device through handwritten content recognition, or may be determined by an external device (such as a server) through handwritten content recognition. For example, the aforementioned handwritten content recognition method may be based on any optical character recognition (OCR) technology, any text recognition technology, any image recognition technology, etc.
[0506] Optionally, the text recognition technology can adopt a CNN text recognition algorithm for image data, or it can adopt an RNN recognition algorithm for trajectory point sequences (such as an LSTM model), or it can be combined with other complex models (such as CRNN or Transformer, etc.). The embodiments of the present application do not specifically limit this.
[0507] Optionally, the graphic recognition technology can adopt an LSTM model based on sequence points, or some RNN models based on target recognition, or some heuristic algorithms (such as an algorithm that makes comprehensive judgments based on the number of inflection points and the number of line segments). The embodiments of the present application do not specifically limit this.
[0508] In some other examples, when the electronic device clears the second handwritten content in the target handwriting interface, the second handwritten content is cleared progressively. The second handwritten content can be divided into a plurality of parts. The point reporting data of each part is deleted from the screen point reporting data file according to a preset order.
[0509] For example, as shown in FIG10B , for the second handwritten content, the electronic device can sort the time in the reporting data of each part of the content from small to large or from large to small, delete the reporting data of each part of the content from the screen reporting data file, and clear the second handwritten content on the target handwriting interface.
[0510] For another example, as shown in FIG10C , for the second handwritten content, the electronic device can sort the positions of the parts of the content along the direction from the starting position to the ending position of the second handwritten content, or along the direction from the ending position to the starting position of the second handwritten content, according to the positions in the reporting data of the parts of the content, and delete the reporting data of each part of the content from the screen reporting data file to clear the second handwritten content on the target handwriting interface.
[0511] For another example, as shown in FIG10D , for the second handwritten content, the electronic device may first delete the reporting point data of one or two partial contents at the middle position according to the position in the reporting point data of each partial content, and then delete the partial content adjacent to the deleted partial content, and delete according to this rule until the reporting point data of the partial content at the starting position and the ending position in the second handwritten content are completely deleted, thereby clearing the second handwritten content on the target handwriting interface.
[0512] In some examples, the screen point reporting data file may include at least one list data structure. Each handwriting (or handwriting) in the handwritten content is formed by pre-setting the processing of all screen point reporting data in the process from putting the pen down to lifting the pen in chronological order. The preset processing can be to connect in the order of reporting points, or to fill in the points with graphics. All the reporting data of each handwriting can be recorded in a list data structure, and based on these data, each handwriting is formed by rendering to the canvas layer. All the reporting data for each handwriting is simply referred to as handwriting data for the convenience of distinguishing. Each handwriting data also includes an attribution identifier, which can be used to distinguish the handwritten content to which the handwriting belongs. For example, when the attribution identifier is a first identifier, it indicates that the handwriting belongs to the handwriting in the first handwritten content. When the attribution identifier is a second identifier, it indicates that the handwriting belongs to the handwriting in the second handwritten content.
[0513] The electronic device clears the second handwritten content in the target handwriting interface. The electronic device can traverse each handwriting in the screen point reporting data file and distinguish the handwriting of the first handwritten content and the second handwritten content according to the attribution identifier of each handwriting. The handwriting attributable to the second handwritten content is cleared from the screen point reporting data file. Optionally, the electronic device can clear all handwriting attributable to the second handwritten content from the screen point reporting data file through one or more clearing operations. After each clearing operation, the electronic device can use the remaining data in the screen point reporting data file to regenerate new rendering content and overwrite the rendering to the current canvas layer.
[0514] After the electronic device determines the second handwritten content, it can store the content data corresponding to the second handwritten content in the target file. The content data corresponding to the handwritten content can be in, but not limited to, any data format or file format. This embodiment of the application does not specifically limit this.
[0515] Optionally, the electronic device may store at least a portion of the first handwritten content retained in the target handwriting interface in a first file, where the first file and the target file are different files and are located in different locations.
[0516] In some scenarios, the electronic device may display a target handwriting interface in response to opening a first application. In response to closing the first application, the electronic device may display a save prompt window, prompting the user whether to save the handwritten content in the target handwriting interface. Optionally, the handwritten content in the target handwriting interface may be the first handwriting content, or may be the first handwriting content minus the second handwriting content, and such handwriting content may be saved in the first file. The user may view the handwritten content in the first file by opening the first file.
[0517] In some application scenarios, the electronic device may display a target handwriting interface in response to an operation of opening a first file. In response to an operation of closing the first file, the electronic device may display a save prompt window to prompt the user whether to save the handwritten content in the target handwriting interface. Optionally, the handwritten content in the target handwriting interface may be the first handwriting content, or may be the first handwriting content minus the second handwriting content. Such handwriting content is saved in the first file. The user may view the handwritten content in the first file by opening the first file.
[0518] The following describes the process of the electronic device storing the second handwritten content in the target file. The electronic device can use, but is not limited to, any one or more of the following designs to store the second handwritten content in the target file.
[0519] In design C1, the content data of the second handwritten content may include a picture (or picture data) of the second handwritten content. Alternatively, the content data may include a recognition result corresponding to the second handwritten content. Alternatively, the content data may include point reporting data corresponding to the second handwritten content. Alternatively, the content data may include point reporting data and processing information corresponding to the second handwritten content.
[0520] Optionally, in the case where the content data includes the reporting point data corresponding to the second handwritten content, the content data of the second handwritten content may include the handwriting data of each handwriting in the second handwritten content, and the layer to which each handwriting belongs. The handwriting data in the same layer is saved in a layer data list in the chronological order of the reporting points. The content data may include at least one layer data list. When the electronic device stores the content data, the layer data may be converted into serialized data and saved in a target file. The target file may be a database or a data file. When the electronic device opens the target file, it deserializes it into a layer data list, and then renders the handwriting data to the layer in chronological order.
[0521] In some examples, the electronic device may obtain a recognition result of the second handwritten content and store the recognition result of the second handwritten content as content data of the second handwritten content.
[0522] Optionally, the electronic device may recognize the second handwritten content, and the handwritten content recognition method may be based on any OCR technology, any text recognition technology, any image recognition technology, etc. Alternatively, after the electronic device is connected to the server, the electronic device may send the second handwritten content to the server, and the server may recognize the second handwritten content.
[0523] Optionally, when the electronic device is not in communication connection with the server, the electronic device may temporarily store the content data of the second handwritten content in a second file.
[0524] After the electronic device is connected to the server, the electronic device can send the second file to the server, so that the server can recognize the second handwritten content based on the second file and return the recognition result corresponding to the second handwritten content to the electronic device. For example, the electronic device can determine that the electronic device is connected to the server based on receiving a network change broadcast, and the electronic device can send the second file to the server. For another example, the electronic device can periodically send network requests to access the server. The electronic device can determine that the server is online based on the response information received from the server, and the electronic device can communicate with the server, which also reflects that the electronic device is connected to the server, and the electronic device can send the second file to the server. Optionally, the electronic device can display the second handwritten content in a third handwriting interface based on the second file. Optionally, after the electronic device opens the second file, the third handwriting interface can only display the second handwritten content and not accept handwriting input. Alternatively, the third handwriting interface can display the second handwritten content and also accept handwriting input, such as editing the second handwritten content, such as adding, modifying, deleting, and other editing operations.
[0525] Design C2, when the electronic device stores the content data corresponding to the second handwritten content in the target file, the content data corresponding to the second handwritten content can be stored in a designated folder, for example, a folder corresponding to the inspiration pen function.
[0526] In Design C3, when the electronic device stores the content data corresponding to the second handwritten content in a target file, the electronic device may perform a classification and storage operation on the second handwritten content. The electronic device may determine the target file based on the target content classification corresponding to the second handwritten content. The electronic device may then store the content data of the second handwritten content in the target file.
[0527] The electronic device may be configured with multiple content categories. Each content category corresponds to a file, and different content categories correspond to different files. The electronic device may determine a target content category corresponding to the second handwritten content. Then, based on a preset correspondence between content categories and files, the electronic device may determine a target file corresponding to the target content category. The electronic device may store the content data of the second handwritten content in the target file.
[0528] In some scenarios, the target file can be implemented as a folder (also called a file directory). A folder can store multiple files. For example, in a contact folder, a phone number can be implemented as a file. Another example is in a to-do folder, a to-do item can be implemented as a file.
[0529] A file directory is a hierarchical structure used to organize and store files and folders in a computer system, often referred to as a folder. A file directory is a tree-like structure consisting of multiple directories and files, helping users organize and access data stored on a computer. Within a file directory, each directory or folder can contain other subdirectories and files.
[0530] In other scenarios, the target file can be implemented as a single file. The file includes content stored in a predetermined order. When displaying multiple contents from the file, no content overlap occurs. In other words, the multiple contents do not overlap in display position.
[0531] In some scenarios, the number of content categories can be user-configured or set. Alternatively, the number of content categories can be pre-configured by the electronic device. In some scenarios, any content category can be user-configured. Alternatively, any content category can be pre-configured by the electronic device.
[0532] Optionally, content classification information of a content classification may represent the content classification. The content classification information includes at least one of the following information: a classification field, a graphic. The content classification information may include the classification field. Alternatively, the content classification information may include a graphic. Alternatively, the content classification information may include both the classification field and the graphic.
[0533] The classification field within the content classification information of a content category can represent the content category. The graphics within the content classification information of a content category can also represent the content category. A classification field can uniquely represent a content category. A graphic can uniquely represent a content category. Optionally, the content classification information of any content category within multiple content categories can be system default or user-configured. For example, a user can configure the classification field for any content category. A user can also configure the graphics for any content category.
[0534] In some examples, as shown in FIG11A , when the electronic device displays the target handwriting interface, a menu toolbar may be displayed, and a virtual button (S1) for the inspiration pen mode may be provided in the toolbar. By clicking the virtual button (S1) for the inspiration pen mode, the electronic device displays a secondary menu (S2) for the inspiration pen mode, and the secondary menu may include a virtual button corresponding to each content category in a plurality of content categories. One content category corresponds to one virtual button, and different content categories correspond to different virtual buttons. Optionally, the virtual button corresponding to the content category can display the category field of the content category. The aforementioned first target operation may be an operation on a virtual button corresponding to any content category, such as a clicking operation.
[0535] If the first target operation is an operation on a target virtual key among virtual keys corresponding to multiple content categories, the electronic device may determine the content category corresponding to the target virtual key as the target content category based on a preset correspondence between multiple content categories and virtual keys.
[0536] In other examples, the electronic device may determine the target content category based on the recognition result of the second handwritten content. The electronic device may determine the content category corresponding to the target content category information in the recognition result of the second handwritten content as the target content category.
[0537] In some scenarios, the electronic device may obtain a text recognition result of the second handwritten content. The electronic device may detect whether the recognition result of the second handwritten content includes a classification field for any content classification. Based on the inclusion of the target classification field in the recognition result, the electronic device may classify the content corresponding to the target classification field as the target content classification.
[0538] For example, the classification field of content classification can be configured as "Tel", "Address", "Operation", or "To Do List", etc. The classification field of content classification can be configured by the user and / or by the system. The embodiment of the present application does not specifically limit the form of the classification field of content classification.
[0539] Optionally, the electronic device can detect whether the starting position of the recognition result of the second handwritten content includes any classification field of the content classification. As shown in (a) in Figure 11B, the second handwritten content is "Tel: 188****888", where the starting position includes the classification field "Tel" of the content classification. The electronic device can determine the content classification with the classification field "Tel" as the target content classification.
[0540] Alternatively, the electronic device can detect whether the end position of the recognition result of the second handwritten content includes any content classification field. As shown in Figure 11B (b), the second handwritten content is "Find a suitable target company (operation)", where the end position includes the content classification field "operation". The electronic device can determine the content classification with the classification field "operation" as the target content classification.
[0541] In other scenarios, the electronic device may obtain a graphic recognition result of the second handwritten content. The electronic device may detect whether the recognition result of the second handwritten content includes a graphic of any content category. Based on the inclusion of the target graphic in the recognition result, the electronic device may classify the content corresponding to the target graphic as the target content category.
[0542] The graphics corresponding to each content category can be configured by the user and / or by the system. This embodiment of the application does not specifically limit the form of the graphics corresponding to the content categories. The electronic device can detect whether the recognition result of the second handwritten content includes a graphic corresponding to any content category. As shown in Figure 11C, the graphic corresponding to the first content category can be a rectangle; the graphic corresponding to the second content category can be an exclamation mark; and the graphic corresponding to the third content category can be a wavy line.
[0543] In other examples, when the electronic device determines the target content category of the second handwritten content, it can determine the third handwritten content corresponding to the fourth target operation based on the detected fourth target operation, wherein the fourth target operation and the first target operation are associated operations.
[0544] Then, the electronic device may determine the second handwritten content and the target content category corresponding to the second handwritten content based on the recognition result of the third handwritten content. Alternatively, the electronic device may determine the target content category corresponding to the second handwritten content based on the recognition result of the third handwritten content.
[0545] The fourth target operation may be a handwriting input operation, and the handwriting content corresponding to the handwriting input operation is recorded as the third handwriting content. In some scenarios, the fourth target operation and the first target operation are associated with each other. For example, the fourth target operation and the first target operation are associated with each other in the time dimension. Optionally, the time of the fourth target operation may be earlier than the time of the first target operation. Alternatively, the time of the first target operation may be earlier than the time of the fourth target operation. Alternatively, the time of the fourth target operation is within the third target period, the starting time of the third target period is the time of the first target operation, and the duration of the third target period may be preset.
[0546] The electronic device can recognize the third handwritten content, such as text recognition, graphic recognition, line type recognition, graphic length, line length recognition, etc.
[0547] The electronic device may detect whether the recognition result of the third handwritten content includes a classification field for any content classification. Based on the inclusion of the target classification field in the recognition result of the third handwritten content, the electronic device may classify the content corresponding to the target classification field as the target content classification. Alternatively, the electronic device may detect whether the recognition result of the third handwritten content includes a graphic for any content classification. Based on the inclusion of the target graphic in the recognition result of the third handwritten content, the electronic device may classify the content corresponding to the target graphic as the target content classification.
[0548] In some scenarios, as shown in FIG11D , the graphic of the third content classification may be a wavy line. Based on the graphic recognition result of the third handwritten content including the wavy line, the electronic device may determine the third content classification corresponding to the wavy line as the target content classification. As shown in FIG11E , the graphic of the third content classification may be a straight line. Based on the graphic recognition result of the third handwritten content including the straight line, the electronic device may determine the content classification corresponding to the straight line as the target content classification. As shown in FIG11F , the graphic of the third content classification may be a rectangle. Based on the graphic recognition result of the third handwritten content including the rectangle, the electronic device may determine the content classification corresponding to the rectangle as the target content classification.
[0549] Optionally, the electronic device may determine the second handwritten content based on the third handwritten content. For example, the third handwritten content may indicate the location or location range of the second handwritten content.
[0550] In some scenarios, the length of the third handwritten content can indicate the location or location range of the second handwritten content. As shown in Figure 11D, the handwritten content near the third handwritten content, whose length is close to the length of the wavy line, is determined as the second handwritten content. Alternatively, the content in the range immediately above the wavy line is determined as the second handwritten content.
[0551] In some scenarios, the third handwritten content may form a selection range or outline. As shown in FIG11D , the electronic device may determine content in the third handwritten content as the second handwritten content.
[0552] Based on any of the above embodiments, after determining the target content category, the electronic device can determine a target file corresponding to the target content category based on a preset correspondence between content categories and files, and store the content data in the target file. Optionally, since each piece of content classification information represents a content category, the correspondence between the content category and the file can be implemented as a correspondence between the content classification information and the file.
[0553] In some scenarios, the electronic device can open the target file and display the second handwritten content in the second handwriting interface. As shown in Figure 11G, the second handwriting interface is different from the aforementioned target handwriting interface. The second handwriting interface is an interface used only to display the second handwritten content. (a) in Figure 11G shows the first user interface, which can include the target handwriting interface and the menu bar interface. After the electronic device opens the target file, the electronic device displays the second user interface, which includes the second handwriting interface and the menu bar interface.
[0554] Optionally, after the electronic device opens the target file, the second handwriting interface can only display the second handwriting content and not receive handwriting input. Alternatively, the second handwriting interface can display the second handwriting content and also receive handwriting input, such as editing the second handwriting content, such as adding, modifying, deleting, and other editing operations.
[0555] In the embodiment of the present application, the handwritten content corresponding to the first handwriting requirement is stored in the first file, and the handwritten content corresponding to the second handwriting requirement is stored in the target file. The first file and the target file are two different files.
[0556] In some examples, the target file is a file. The user can find the target file in the file system of the electronic device, in the file corresponding to the target content category. As shown in FIG12A , the target file can be opened in the folder corresponding to the target content category to which the target file belongs.
[0557] In other examples, as shown in FIG12B , the target user interface includes a menu bar interface and a target handwriting interface, wherein the target handwriting interface is also a handwriting interface for performing the first handwriting request. The menu bar interface may include, but is not limited to, a stylus button (for activating the handwriting function or adjusting parameters such as handwriting thickness and color), an erase button, a background adjustment button, a save button, and the like. Multiple buttons in the menu bar interface may be arranged and displayed in rows or columns.
[0558] The menu bar interface may also include an open file button. By pressing the open file button, the user can activate the electronic device's folder opening function. Optionally, in response to the open file button, the electronic device can open a first folder, where the first folder includes folders corresponding to each content category. The user can open the folder corresponding to the target content category in the first folder, and then find and open the target file in the target folder.
[0559] In some other examples, as shown in FIG12C , the electronic device is pre-installed with a target application. The user can open the target file by opening the target application. For example, after the user clicks the icon of the target application, the electronic device can display the folders corresponding to each content category in the first folder. After the user clicks the target folder corresponding to the target content category, the electronic device can display the files in the target folder. After the user clicks on the file, the electronic device can display a third user interface, which may include a handwriting interface for displaying the file clicked by the user, and the handwriting interface displays the handwritten content in the file clicked by the user or the recognition result corresponding to the handwritten content. Optionally, the third user interface may also include a menu bar. The user can perform editing operations such as adding, modifying, and deleting in the handwriting interface.
[0560] Based on any of the aforementioned embodiments of the electronic device determining the second handwritten content, the electronic device may display the handwritten content corresponding to the handwritten input that occurs after the second handwritten content in the target handwriting interface and store it as the content of the first handwriting request. The electronic device may determine the next second handwritten content based on the next first target operation, clear the next second handwritten content from the target handwriting interface, and store the next second handwritten content in another target file.
[0561] Based on the functions or capabilities of the electronic devices provided in the aforementioned embodiments, FIG13A exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0562] S1301A, displaying a target handwriting interface of the first application.
[0563] The electronic device may launch the first application in response to a user's launch operation on the first application. The first application may be a handwriting application. Alternatively, the first application is an application displayed before the electronic device is locked, and the electronic device may continue to display the first application after it is unlocked.
[0564] S1302A: Display first handwriting content corresponding to the first handwriting input in the target handwriting application interface according to the first handwriting input received by the target handwriting application interface.
[0565] For example, the electronic device may receive touch track points (sequence) input by the user on the surface of the display device through the touch component, and generate and display the first handwritten content.
[0566] S1303A, in response to the first triggering operation, starting the inspiration pen function.
[0567] Optionally, the first trigger operation may be the first target operation in the aforementioned embodiment.
[0568] S1304A: After starting the inspiration pen function, according to the second handwriting input received by the target handwriting application interface, display the second handwriting content corresponding to the second handwriting input in the target handwriting interface.
[0569] S1305A: Clear the second handwriting content in the target handwriting interface, and retain the handwriting content in the target handwriting interface except the second handwriting content.
[0570] The process of the electronic device executing step S1305A can be referred to the relevant introduction of any of the aforementioned embodiments, and will not be repeated here.
[0571] S1306A: Store the second handwritten content in a target file.
[0572] The process of the electronic device executing step S1306A can be referred to the relevant introduction of any of the aforementioned embodiments, and will not be repeated here.
[0573] S1307A, when it is determined that the preset closing condition is met, closing the inspiration pen function.
[0574] Optionally, the inspiration pen function can be a continuously maintained function. When the electronic device detects a second triggering operation, the inspiration pen function can be turned off. The preset turning-off condition can be detecting the second triggering operation. For example, the second triggering operation can be the aforementioned second target operation.
[0575] Alternatively, the inspiration pen function may be a time-sensitive function. The electronic device may determine that the inspiration pen function has been activated for a predetermined activation duration and then deactivate the inspiration pen function. The predetermined deactivation condition may be detecting that the inspiration pen function has been activated for a predetermined activation duration.
[0576] Alternatively, the preset shut-down condition is that the target handwriting interface does not receive any handwriting input within a preset duration after the inspiration pen function is activated. The electronic device may shut down the inspiration pen function.
[0577] In the embodiment of the present application, steps S1305A and S1306A may be performed synchronously or asynchronously. The order of execution of these two steps may be to execute step S1305A first and then execute step S1306A, or to execute step S1306A first and then execute step S1305A. This embodiment of the present application does not specifically limit this.
[0578] Optionally, the electronic device may store the second handwritten content in a target file while clearing the second handwritten content.
[0579] After the inspiration pen function is turned off, according to any handwriting input received by the target handwriting application interface, the handwriting content corresponding to the any handwriting input is displayed in the target handwriting interface.
[0580] In the embodiment of the present application, the target handwriting interface of the first application can be understood as the handwriting interface for the user to perform the first handwriting need. Starting the inspiration pen function can reflect that the user has a temporary handwriting need, such as a second handwriting need. The target handwriting interface still mainly serves the first handwriting need. The target handwriting interface can temporarily serve the second handwriting need. Therefore, after the second handwriting content is displayed on the target handwriting interface, the second handwriting content will be cleared. At the same time, in order to manage the second handwriting content, the second handwriting content is stored. After turning off the inspiration pen function, the target handwriting interface can continue to serve the first handwriting need.
[0581] Based on the functions or capabilities of the electronic devices provided in the aforementioned embodiments, FIG13B exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0582] S1301B, displaying the target handwriting interface of the first application.
[0583] S1302B: Display first handwriting content corresponding to the first handwriting input in the target handwriting application interface according to the first handwriting input received by the target handwriting application interface.
[0584] S1303B, in response to the third trigger operation, start the inspiration pen function.
[0585] Optionally, the third triggering operation may be the aforementioned first target operation. The electronic device may generate a recording input box. The electronic device may display the recording input box in the target handwriting interface. Alternatively, the electronic device may display the user interface in partitions, wherein one display partition displays the recording input box, and another display partition displays the target handwriting interface.
[0586] S1304B, collects audio.
[0587] S1305B, storing the collected audio into a target file.
[0588] Optionally, the electronic device can perform recognition on the collected audio, such as through speech recognition or natural language processing, and automatically extract the recognized content into a summary and store it. Optionally, the electronic device can classify and store the audio based on the recognition results.
[0589] Optionally, the electronic device may display the content recognized based on the collected audio in the target handwriting interface, and then clear the content recognized based on the collected audio from the target handwriting interface.
[0590] Optionally, the electronic device may classify and store the collected audio. The electronic device may perform text recognition on the speech text of the collected audio, using the classification field included in the speech text as the target classification field. The electronic device may classify the content corresponding to the target classification field as the target content classification. Based on the correspondence between the content classification and the file, the electronic device may determine the file corresponding to the target content classification as the target file.
[0591] S1306B, when it is determined that the preset closing condition is met, closing the inspiration pen function.
[0592] Optionally, the inspiration pen function can be a continuously maintained function. When the electronic device detects a second triggering operation, the inspiration pen function can be turned off. The preset turning-off condition can be detecting the second triggering operation. For example, the second triggering operation can be the aforementioned second target operation.
[0593] Alternatively, the inspiration pen function may be a time-sensitive function. The electronic device may determine that the inspiration pen function has been activated for a predetermined activation duration and then deactivate the inspiration pen function. The predetermined deactivation condition may be detecting that the inspiration pen function has been activated for a predetermined activation duration.
[0594] Based on the functions or capabilities of the electronic device provided in the aforementioned embodiments, FIG13C exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0595] S1301C, displaying the lock screen interface of the electronic device.
[0596] Optionally, the electronic device may display a lock screen interface of the electronic device in response to the wake-up operation. The lock screen interface may be used to display an interface for entering a password or an interface for permanently displaying an image or a collection of images. Optionally, the lock screen interface may display status information of the electronic device, such as battery level, charging status, network connection status, etc.
[0597] The lock screen is also used to receive handwritten input. Users can unlock the device by handwriting a password on the lock screen. Users can unlock the device by operating the virtual keyboard displayed on the lock screen. In this embodiment of the present application, the password may include, but is not limited to, numbers, text, letters, and graphics. Users can handwrite the password used to unlock the device on the lock screen.
[0598] Optionally, the wake-up operation may be an operation of the user opening the leather case (protective shell) of the electronic device, and the light sensor of the electronic device may detect the operation. Alternatively, the wake-up operation may be an operation on a physical button of the electronic device. For example, the wake-up operation may be a pressing operation on a physical button of the electronic device. For another example, the wake-up operation may be one or more sliding operations on the touch display of the electronic device, or one or more clicking operations. This application does not impose too many restrictions on this.
[0599] S1302C: Based on the third handwriting input received by the lock screen interface, display fourth handwriting content corresponding to the third handwriting input on the lock screen interface.
[0600] S1303C: If the preset processing conditions are met, clear the fourth handwritten content on the lock screen interface and store the fourth handwritten content in a target file.
[0601] In some application scenarios, users may have temporary, urgent, or sudden handwriting needs when the electronic device is locked. If the user first unlocks the electronic device and then opens the handwriting application to record the handwriting needs, it will cause great inconvenience.
[0602] In view of this, in the handwriting content processing method provided in the embodiment of the present application, the lock screen interface can receive handwriting input and display the handwriting content corresponding to the received handwriting input (recorded as the third handwriting input) on the lock screen interface to meet temporary, urgent or sudden handwriting needs.
[0603] In one possible design, as shown in Figure 13D, the electronic device displays the fourth handwriting content corresponding to the third handwriting input received on the lock screen interface based on the third handwriting input received on the lock screen interface, and can respond to a sixth target operation by displaying the fourth handwriting content corresponding to the third handwriting input received on the lock screen interface.
[0604] In some examples, the fifth target operation may include any of the following operations:
[0605] a seventh preset operation on the physical structure of the electronic device;
[0606] an eighth preset operation on at least one virtual button displayed on the electronic device;
[0607] a ninth preset operation on the touch display device of the electronic device;
[0608] Preset third voice control operation;
[0609] Preset third gesture control operation;
[0610] The operation of sending a third indication signal to the electronic device.
[0611] In some possible scenarios, the fifth target operation may include a seventh preset operation on the physical structure of the electronic device. Optionally, the physical structure of the electronic device may be a hardware button, as shown in (a) of FIG6A , and the seventh preset operation may include but is not limited to: pressing the hardware button, pressing the hardware button multiple times in succession, and long pressing the hardware button for a preset time. Alternatively, the physical structure of the electronic device may be a knob, as shown in (b) of FIG6A , and the seventh preset operation may include but is not limited to: rotating the knob to a first preset position. Alternatively, the physical structure of the electronic device may be a switch, as shown in (c) of FIG6A , and the seventh preset operation may include but is not limited to: turning the switch on or off. Alternatively, the physical structure of the electronic device may be a touch bar, and the seventh preset operation may include but is not limited to touch operations on the touch bar, such as single-clicking the touch bar, double-clicking the touch bar, long pressing the touch bar, or sliding on the touch bar. Optionally, the touch bar may be replaced with a touchpad.
[0612] In other possible situations, the fifth target operation may include an eighth preset operation on at least one virtual button displayed on the lock screen interface of the electronic device. The fifth target operation may be the eighth preset operation of the user on at least one virtual button of the inspiration pen function displayed on the electronic device. Optionally, the user can perform the eighth preset operation on the virtual button through the command input device. The command input device may include but is not limited to a touch screen, an active or passive stylus, a stylus and other input devices. The eighth preset operation may include but is not limited to: clicking a virtual button once, clicking a virtual button continuously, dragging a virtual button in a preset manner, or long pressing a virtual button for a preset period of time.
[0613] In some other possible scenarios, as shown in FIG6C , the fifth target operation may include a ninth preset operation on a touch display device of the electronic device. Optionally, the touch display device may be implemented as a touch screen. The ninth preset operation may include, but is not limited to, sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0614] In some other possible situations, the fifth target operation may include a preset third voice control operation. The electronic device may have audio collection capabilities. The electronic device may detect the user's preset first voice control operation on the electronic device. For example, the electronic device may collect audio and recognize that the audio includes a first preset voice instruction. The first preset voice instruction may include but is not limited to: "Turn on inspiration pen mode", "Enter inspiration pen mode", "Switch inspiration pen mode" and other voice content with the same or similar meanings.
[0615] In some other possible situations, the fifth target operation may include a preset third gesture control operation. The electronic device may have image acquisition capabilities and gesture recognition capabilities. The user may perform a preset third gesture control operation by performing an air gesture within the image acquisition range of the electronic device. The electronic device may detect whether the user has performed the preset third gesture control operation by detecting whether the preset gesture is included in the captured image. Optionally, in this example, the air gesture may be a static gesture, or the air gesture may be a dynamic gesture.
[0616] In some other possible situations, the fifth target operation may include an operation of sending a third indication signal to the electronic device. The electronic device may have a signal receiving capability. The electronic device may detect the received signal. If the electronic device detects the first indication signal, it may determine that the fifth target operation is detected. Optionally, as shown in FIG6D , the electronic device may interact with a stylus-type input device. The third indication signal may be a signal sent by the stylus-type input device. The user may trigger the stylus-type input device to send the third indication signal to the electronic device through a preset operation on the stylus-type input device, so that the electronic device switches to the inspiration pen mode. Optionally, the user may perform a preset operation on the stylus-type input device, which may be at least one pressing operation on a button on the stylus-type input device, or at least one touching operation on a designated position of the stylus-type input device, or shaking, rocking, or rotating the stylus-type input device in a predetermined manner. The embodiments of the present application do not specifically limit this.
[0617] The electronic device and the stylus-type input device can exchange information based on a preset protocol. The embodiment of the present application does not specifically limit the data transmission protocol or communication protocol of the exchange information. In some application scenarios, the stylus-type input device can be an active stylus.
[0618] The following describes the process of the electronic device determining the fourth handwritten content. The electronic device may determine the fourth handwritten content by, but not limited to, any one or more of the following embodiments.
[0619] In method 1-0, the electronic device can directly determine the handwritten content corresponding to the third handwriting input received by the lock screen interface as the fourth handwritten content.
[0620] In method 1-1, when the electronic device determines the fourth handwritten content displayed on the lock screen interface, it may determine the fourth handwritten content based on the first target operation. The electronic device may determine the handwritten content corresponding to the second handwriting input received on the lock screen interface within a fourth target time period as the fourth handwritten content, wherein the start time of the fourth target time period is the time when the first target operation is detected.
[0621] For example, the electronic device may determine handwriting input that is entered within a fourth target time period as the fourth handwriting content. In other words, the target handwriting interface may receive a portion of the fourth handwriting content within the fourth target time period. The electronic device may determine the fourth handwriting content based on handwriting input received on the target handwriting interface within the fourth target time period and handwriting input that is continuous with the handwriting input.
[0622] Optionally, the fourth target period is a preset second period. Optionally, the second period may be 1 minute or 30 seconds.
[0623] In mode 1-2, when the electronic device determines the fourth handwritten content displayed on the lock interface, the electronic device may determine the fourth handwritten content based on the first target operation and the sixth target operation. Based on the detected sixth target operation, the electronic device may determine the handwritten content corresponding to the handwriting input received on the lock interface within a fifth target period as the fourth handwritten content, where the start time of the fifth target period is the time when the fifth target operation is detected, and the end time of the fifth target period is the time when the sixth target operation is detected.
[0624] Optionally, the fifth target operation may be the same as the first target operation, and the sixth target operation may be the same as the second target operation. Alternatively, the fifth target operation may be the same as the second target operation, and the sixth target operation may be the same as the first target operation.
[0625] In method 1-3, when the electronic device determines the fourth handwritten content displayed on the lock interface, the electronic device may determine the selection range corresponding to the seventh target operation based on the detected seventh target operation, and determine the content in the selection range as the fourth handwritten content. In some scenarios, the content in the selection range may be part of the handwritten content displayed on the target display interface. In other scenarios, the content in the selection range may be content in the first handwritten content.
[0626] In this embodiment, the electronic device can determine the selection range corresponding to the seventh target operation based on the detected seventh target operation. The implementation process of the electronic device determining the selection range corresponding to the third target operation based on the third target operation in the aforementioned embodiment can be referred to, and will not be repeated here.
[0627] In one possible implementation, the handwritten content processing method may further include: after the electronic device determines the fourth handwritten content, generating or displaying a reminder message to indicate to the user whether to adjust the fourth handwritten content. After determining the fourth handwritten content, the electronic device may generate a reminder message to remind the user to check or verify the accuracy of the determined fourth handwritten content. The reminder message may indicate the fourth handwritten content.
[0628] In this embodiment, the manner in which the electronic device generates reminder information to indicate the fourth handwritten content can refer to the implementation process of the electronic device generating reminder information to indicate the second handwritten content in the aforementioned embodiment, which will not be repeated here.
[0629] The following describes the process of clearing the fourth handwritten content in the lock interface of the electronic device. The electronic device can use, but is not limited to, any one or more of the following implementations to clear the fourth handwritten content in the lock interface.
[0630] Method 2-1: Before the electronic device determines the fourth handwritten content displayed on the lock interface based on the fifth target operation, after detecting the fifth target operation, the electronic device can determine the fourth handwritten content corresponding to the third handwriting input in the lock interface based on the third handwriting input received by the lock interface, and display the fourth handwritten content or the recognition result corresponding to the fourth handwritten content.
[0631] The electronic device can utilize or create a second layer, which is used to display the preset content of the lock interface. When the electronic device displays the fourth handwritten content, it can add a new layer, which is recorded as the target layer, and the target layer is used to display the fourth handwritten content. The electronic device displays the target layer to display the fourth handwritten content on the lock interface. As can be seen, the target layer is a different layer from the aforementioned second layer.
[0632] Optionally, the electronic device may add a target layer after determining the fourth handwritten content. Alternatively, the electronic device may display the fourth handwritten content on the lock interface in response to detecting the fifth target operation. When the electronic device clears the fourth handwritten content from the lock interface, it may do so by clearing the target layer. The electronic device does not clear the second layer used to display the preset content of the lock interface, thereby retaining the preset content of the lock interface in the lock interface.
[0633] In some application scenarios, after detecting the fifth target operation, the electronic device indicates the content of the temporary handwriting requirement based on the moment when the fifth target operation is detected. The electronic device may determine the handwriting content corresponding to the handwriting input received on the lock interface during the aforementioned fourth target period as the handwriting content corresponding to the temporary handwriting requirement. Or the electronic device may determine the handwriting content corresponding to the handwriting input received on the lock interface during the fifth target period as the fourth handwriting content based on the detected sixth target operation. The electronic device may add a target layer based on detecting the fifth target operation. The target layer is used to display the fourth handwriting content. For example, the electronic device may create a new target view object and draw the fourth handwriting content on the target view object to add a target layer. The electronic device may draw the fourth handwriting content on a layer of the target view object or on a canvas. The electronic device may clear the fourth handwriting content on the lock interface by clearing the target layer. For example, the electronic device may close the target view object to clear the target layer.
[0634] In some application scenarios, electronic devices can generate handwritten traces based on the point data corresponding to the handwritten content. Alternatively, electronic devices can generate handwritten traces based on the point data corresponding to the handwritten content and a preset processing algorithm. Preset processing algorithms may include, but are not limited to, smoothing correction algorithms and interpolation algorithms, such as smoothing and interpolation using Bezier curves. Preset processing algorithms may also include trace generation algorithms. For example, trace generation algorithms may include, but are not limited to, algorithms based on line width and / or pen strokes. In some examples, the line width of handwritten content can be determined based on speed or pressure information in the point data for the handwritten content. The electronic device can use an active stylus to obtain pressure information at the time of touch for each point. The greater the pressure, the greater the line width. The smaller the pressure, the smaller the line width. In other examples, the line width of handwritten content can be determined based on speed information in the point data for the handwritten content. The greater the speed, the smaller the line width. For another example, an algorithm based on pen strokes can be based on brush strokes, which can achieve stroke effects such as non-white, starting strokes, and ending strokes.
[0635] The screen point reporting data file can be used to record the data of each screen point reporting in the target handwriting interface. In other words, the screen point reporting data file can be used to record the point reporting data of the handwritten content in the handwriting interface when the user performs the first handwriting request. Temporary handwriting requests can also be input through the target handwriting interface, and the screen point reporting data file can record the point reporting data corresponding to the temporary handwriting request. Based on the screen point reporting data file, the electronic device can also display the handwritten content corresponding to the temporary handwriting request, i.e., the second handwriting content, when displaying the handwritten content in the target handwriting interface.
[0636] In method 2-2, the electronic device can clear the second handwriting content on the target handwriting interface by clearing, removing, deleting, removing, moving out, or transferring the point reporting data of the second handwriting content from the screen point reporting data file.
[0637] In one possible design, the electronic device may determine whether the electronic device meets a preset processing condition. Optionally, the preset processing condition may include, but is not limited to, at least one of the following conditions:
[0638] Condition 1: After the fourth handwritten content is displayed on the lock screen interface, no other handwriting input is received for a continuous period reaching a third period.
[0639] Condition 2: Detecting a user's operation on a save button of the electronic device. Optionally, the save button may be a physical button, or a virtual button displayed on the electronic device.
[0640] Condition 3: Detecting a user's operation on the electronic device's lock screen button. Optionally, the lock screen button can be a physical button, or a virtual button displayed on the electronic device. When the electronic device is unlocked, the user can lock the electronic device by operating the lock screen button.
[0641] Condition 4: The fourth handwritten content includes a preset unlocking password. The electronic device can recognize the fourth handwritten content and determine whether the fourth handwritten content includes the preset unlocking password, which can also be understood as an authentication operation.
[0642] Condition 5: Detection of a preset third voice control operation. The electronic device may have audio capture capabilities. The electronic device may detect a user's preset fourth voice control operation on the electronic device. For example, the electronic device may capture audio and recognize that the audio includes a fourth preset voice command. The fourth preset voice command may include, but is not limited to, voice commands with the same or similar meaning, such as "save content" and "input completed."
[0643] Condition 6: Detection of a preset third gesture control operation. The electronic device may have image acquisition capabilities and gesture recognition capabilities. The user may perform a preset third gesture control operation by making an air gesture within the image acquisition range of the electronic device. The electronic device may detect whether the user has performed the preset third gesture control operation by detecting whether the captured image includes a preset gesture. Optionally, in this example, the air gesture may be a static gesture, or the air gesture may be a dynamic gesture.
[0644] Condition 7: Detecting an operation in which the electronic device receives a third indication signal. The electronic device may have signal receiving capabilities. The electronic device may detect the received signal. Optionally, the electronic device may interact with a stylus-type input device. The third indication signal may be a signal sent by the stylus-type input device. The user may trigger the stylus-type input device to send the third indication signal to the electronic device by performing a preset operation on the stylus-type input device.
[0645] Condition 8: An eighth preset operation on a touch display device of the electronic device is detected. Optionally, the touch display device may be implemented as a touch screen. The eighth preset operation may include, but is not limited to: sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0646] In some examples, after the electronic device clears the fourth handwritten content on the lock interface, if the electronic device is in a locked state, the user cannot view the third file on the lock interface. After the electronic device is in an unlocked state, the user can view the third file.
[0647] In some application scenarios, the user can perform the third input operation multiple times in a row through the lock interface. The fourth handwritten content corresponding to each third input operation can be stored in the same target file. Alternatively, the handwritten content corresponding to each third input operation can be stored in different target files.
[0648] In one possible implementation, the electronic device may display a password input interface in response to detecting a user pressing a save button on the electronic device. The user performs a decryption operation in the password input interface. After unlocking the electronic device, the electronic device stores the third file. Optionally, the save button may be a physical button, or a virtual button displayed on the lock screen of the electronic device.
[0649] In one possible implementation, to improve the security and reliability of the electronic device, the electronic device may store the fourth handwritten content in the third file when a preset storage condition is met. Optionally, the preset storage condition may include, but is not limited to, the fourth handwritten content including an unlock password or a save indication field.
[0650] The electronic device may recognize the fourth handwritten content and determine whether the fourth handwritten content includes a preset unlock password or a save indication field, which can also be understood as an authentication operation. If the electronic device determines that the fourth handwritten content includes the preset unlock password, the electronic device may store the fourth handwritten content in the third file. Alternatively, if the electronic device determines that the fourth handwritten content includes a preset save indication field, the electronic device may store the fourth handwritten content in the third file.
[0651] The save indication field can be user-defined and configured, and the save indication field can be used to instruct the electronic device to save the handwritten content corresponding to the handwriting operation input on the lock interface. Such a design can enable the electronic device to display the fourth handwritten content corresponding to the third handwriting input on the lock screen interface, and not display the unlock password of the electronic device, thereby improving the security of the electronic device. In some scenarios, the save indication field can be "temporary". As shown in Figure 13E, the save indication field "temporary" is shown in the dotted oval. The electronic device can detect whether the fourth handwritten content includes "temporary", and if it is determined that the fourth handwritten content includes "temporary", the fourth handwritten content is stored in the target file. Conversely, if the electronic device determines that the fourth handwritten content does not include "temporary", it may not store the fourth handwritten content.
[0652] In one possible implementation, the electronic device may store the fourth handwritten content in a temporary file. The electronic device displays a target window in an interface displayed after unlocking (this interface may be a system desktop launcher interface or an interface displayed before the electronic device is locked). The target window is used as an interface for operations on the temporary file, such as opening, browsing, storing, and saving operations.
[0653] The electronic device can display, modify, add, erase, delete, transfer, and other operations on the fourth handwritten content through the target window. The electronic device can store the fourth handwritten content in the target window in a third file. In some application scenarios, the user can perform the third input operation multiple times in a row through the lock interface. The fourth handwritten content corresponding to each third input operation can be stored in the same temporary file. Alternatively, each third input operation can store the fourth handwritten content in different temporary files.
[0654] In some other examples, when the fourth handwritten content includes a preset unlocking password, the electronic device can store the content of the fourth handwritten content except the unlocking password in a third file, thereby improving the safety and reliability of the device.
[0655] In one possible implementation, the electronic device may store the content data corresponding to the fourth handwritten content in a third file. The content data corresponding to the handwritten content may be in any one or more data formats and / or any one or more file formats. This embodiment of the application does not specifically limit the form of the content data corresponding to the handwritten content.
[0656] Optionally, the content data of the fourth handwritten content includes a picture of the fourth handwritten content, or the content data of the fourth handwritten content includes point reporting data corresponding to the fourth handwritten content, or the content data of the fourth handwritten content includes a recognition result corresponding to the fourth handwritten content.
[0657] In some examples, the electronic device may obtain a recognition result of the fourth handwritten content. The manner in which the electronic device obtains the recognition result of the handwritten content can be combined with the relevant description in the aforementioned embodiments and will not be repeated here. Optionally, the electronic device may recognize the fourth handwritten content; or, alternatively, receive a recognition result of the fourth handwritten content provided by a server.
[0658] In a possible implementation, when the electronic device stores the content data corresponding to the fourth handwritten content in the target file, the content data corresponding to the fourth handwritten content may be stored in a designated folder, for example, a folder corresponding to the inspiration pen function.
[0659] In another possible implementation, when the electronic device stores the content data corresponding to the fourth handwritten content in a target file, the electronic device may perform a classification and storage operation on the fourth handwritten content. The electronic device may determine the target file based on the content classification corresponding to the fourth handwritten content. The electronic device may then store the content data of the fourth handwritten content in the target file.
[0660] The electronic device may be configured with multiple content categories. Each content category corresponds to a file, and different content categories correspond to different files. The electronic device may determine a target content category corresponding to the fourth handwritten content. Then, based on a preset correspondence between content categories and files, the electronic device may determine a target folder corresponding to the target content category. The electronic device may store the content data of the fourth handwritten content in the target file.
[0661] In some scenarios, the target file can be implemented as a folder (also called a file directory). A folder can store multiple files. For example, in a contact folder, a phone number can be implemented as a file. Another example is in a to-do folder, a to-do item can be implemented as a file.
[0662] A file directory is a hierarchical structure used to organize and store files and folders in a computer system, often referred to as a folder. A file directory is a tree-like structure consisting of multiple directories and files, helping users organize and access data stored on a computer. Within a file directory, each directory or folder can contain other subdirectories and files.
[0663] In other scenarios, the target file can be implemented as a single file. The file includes content stored in a predetermined order. When displaying multiple contents from the file, no content overlap occurs. In other words, the multiple contents do not overlap in display position.
[0664] In some scenarios, the number of content categories can be user-configured or set. Alternatively, the number of content categories can be pre-configured by the electronic device. In some scenarios, in the correspondence between content categories and files, any one content category can be user-configured or pre-configured by the electronic device.
[0665] Optionally, content classification information of a content classification may represent the content classification. The content classification information includes at least one of the following information: a classification field, a graphic. The content classification information may include the classification field. Alternatively, the content classification information may include a graphic. Alternatively, the content classification information may include both the classification field and the graphic.
[0666] The classification field within the content classification information of a content category can represent the content category. The graphics within the content classification information of a content category can also represent the content category. A classification field can uniquely represent a content category. A graphic can uniquely represent a content category. Optionally, the content classification information of any content category within multiple content categories can be system default or user-configured. For example, a user can configure the classification field for any content category. A user can also configure the graphics for any content category.
[0667] In some examples, when the electronic device displays the lock interface, it can display a virtual button for the inspiration pen mode. By clicking the virtual button for the inspiration pen mode, the electronic device displays a secondary menu for the inspiration pen mode. The secondary menu may include virtual buttons corresponding to each of the multiple content categories. One content category corresponds to one virtual button, and different content categories correspond to different virtual buttons. Optionally, the virtual button corresponding to the content category can display the category field of the content category. The aforementioned fifth target operation can be an operation on the virtual button corresponding to any content category, such as a click operation.
[0668] If the fifth target operation is an operation on a target virtual key among virtual keys corresponding to multiple content categories, the electronic device may determine the content category corresponding to the target virtual key as the target content category based on a preset correspondence between multiple content categories and virtual keys.
[0669] In other examples, the electronic device may determine the target content category based on the recognition result of the fourth handwritten content. The electronic device may determine the content category corresponding to the target content category information in the recognition result of the fourth handwritten content as the target content category.
[0670] In some scenarios, the electronic device may obtain a text recognition result of the fourth handwritten content. The electronic device may detect whether the recognition result of the fourth handwritten content includes a classification field for any content classification. Based on the inclusion of the target classification field in the recognition result, the electronic device may classify the content corresponding to the target classification field as the target content classification.
[0671] For example, the classification field of content classification can be configured as "Tel", "Address", "Operation", or "To Do List", etc. The classification field of content classification can be configured by the user and / or by the system. The embodiment of the present application does not specifically limit the form of the classification field of content classification.
[0672] Optionally, the electronic device can detect whether the starting position of the recognition result of the fourth handwritten content includes the classification field of any content classification. As shown in (a) in Figure 11B, the fourth handwritten content is "Tel: 188****888", where the starting position includes the classification field "Tel" of the content classification. The electronic device can determine the content classification with the classification field "Tel" as the target content classification.
[0673] Alternatively, the electronic device can detect whether the end position of the recognition result of the fourth handwritten content includes any content classification field. As shown in Figure 11B (b), the fourth handwritten content is "Find a suitable target company (operation)", where the end position includes the content classification field "operation". The electronic device can determine the content classification with the classification field "operation" as the target content classification.
[0674] In other scenarios, the electronic device may obtain a graphic recognition result of the fourth handwritten content. The electronic device may detect whether the recognition result of the fourth handwritten content includes a graphic of any content category. Based on the inclusion of the target graphic in the recognition result, the electronic device may classify the content corresponding to the target graphic as the target content category.
[0675] The graphics corresponding to each content category can be configured by the user and / or by the system. This embodiment of the application does not specifically limit the form of the graphics corresponding to the content categories. The electronic device can detect whether the recognition results of the fourth handwritten content include graphics corresponding to any content category. As shown in Figure 11C, the graphic corresponding to the first content category can be a rectangle; the graphic corresponding to the second content category can be an exclamation mark; and the graphic corresponding to the third content category can be a wavy line.
[0676] In other examples, when the electronic device determines the target content category of the fourth handwritten content, it can determine the fifth handwritten content corresponding to the eighth target operation based on the detected eighth target operation, wherein the eighth target operation and the fifth target operation are associated operations.
[0677] The electronic device may then determine the fourth handwritten content and the target content category corresponding to the fourth handwritten content based on the recognition result of the fifth handwritten content; or determine the target content category corresponding to the fourth handwritten content based on the recognition result of the fifth handwritten content.
[0678] The eighth target operation can be a handwriting input operation, and the handwriting content corresponding to the handwriting input operation is recorded as the fifth handwriting content. In some scenarios, the eighth target operation and the fifth target operation are associated with each other. For example, the eighth target operation and the fifth target operation are associated with each other in the time dimension. Optionally, the time of the eighth target operation can be earlier than the time of the fifth target operation. Alternatively, the time of the fifth target operation can be earlier than the time of the eighth target operation. Alternatively, the time of the eighth target operation is in the third target time period, the starting time of the third target time period is the time of the fifth target operation, and the duration of the third target time period can be preset.
[0679] The electronic device can recognize the fifth handwritten content, such as text recognition, graphic recognition, line type recognition, graphic length, line length recognition, etc.
[0680] The electronic device may detect whether the recognition result of the fifth handwritten content includes a classification field for any content classification. Based on the inclusion of the target classification field in the recognition result of the fifth handwritten content, the electronic device may classify the content corresponding to the target classification field as the target content classification. Alternatively, the electronic device may detect whether the recognition result of the fifth handwritten content includes a graphic for any content classification. Based on the inclusion of the target graphic in the recognition result of the fifth handwritten content, the electronic device may classify the content corresponding to the target graphic as the target content classification.
[0681] Optionally, the electronic device may determine the fourth handwritten content based on the fifth handwritten content. For example, the fifth handwritten content may indicate the location or location range of the fourth handwritten content. In some scenarios, the length of the fifth handwritten content may indicate the location or location range of the fourth handwritten content. In some scenarios, the content of the fifth handwritten content is determined as the fourth handwritten content.
[0682] The handwriting content processing method provided in the embodiment of the present application may also be combined with some operations in the handwriting content processing method provided in the aforementioned embodiment.
[0683] Based on the functions or capabilities of the electronic devices provided in the aforementioned embodiments, FIG14A exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0684] S1401A, display the target handwriting interface.
[0685] S1402A: Display first handwriting content corresponding to the first handwriting input in the target handwriting interface according to the first handwriting input received in the target handwriting interface.
[0686] S1403A: Determine the second handwriting content displayed in the target handwriting interface.
[0687] S1404A: Clear the second handwriting content on the target handwriting interface.
[0688] S1405A: Store the second handwritten content in a target file.
[0689] In the embodiment of the present application, the process of the electronic device determining the second handwriting content displayed in the target handwriting interface may adopt, but is not limited to, all or part of the operations in at least one of the aforementioned designs A1 to A5.
[0690] In the embodiment of the present application, the process of clearing the second handwritten content by the electronic device may adopt, but is not limited to, all or part of the operations of at least one of the aforementioned designs B1 and B2.
[0691] In the embodiment of the present application, the process of the electronic device storing the second handwritten content into the target file may adopt, but is not limited to, all or part of the operations of at least one of the aforementioned designs C1 to C3.
[0692] The specific contents of the aforementioned Design A1 to Design A5, Design B1, Design B2, Design C1 to Design C3 can be found in the relevant introduction in the aforementioned embodiments and will not be repeated here.
[0693] Based on the functions or capabilities of the electronic devices provided in the aforementioned embodiments, FIG14B exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0694] S1401B, display the target handwriting interface.
[0695] S1402B: Display first handwriting content corresponding to the first handwriting input in the target handwriting interface according to the first handwriting input received in the target handwriting interface.
[0696] S1403B: Based on the first target operation, determine second handwriting content displayed in the target handwriting interface.
[0697] S1404B: Store the second handwritten content in a target file.
[0698] In the embodiment of the present application, the process of the electronic device determining the second handwriting content displayed in the target handwriting interface may adopt, but is not limited to, all or part of the operations in at least one of the aforementioned designs A1 to A5.
[0699] In the embodiment of the present application, the process of the electronic device storing the second handwritten content into the target file may adopt, but is not limited to, all or part of the operations of at least one of the aforementioned designs C1 to C3.
[0700] The specific contents of the above-mentioned Design A1 to Design A5 and Design C1 to Design C3 can be found in the relevant introduction in the above-mentioned embodiments, and will not be repeated here.
[0701] Based on the functions or capabilities of the electronic device provided in the aforementioned embodiments, FIG14C exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0702] S1401C: Display a target handwriting interface, where the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface.
[0703] S1402C: Based on the first target operation, determine second handwritten content displayed in the target handwriting interface, and store the second handwritten content in a target file.
[0704] In the embodiment of the present application, the process of the electronic device determining the second handwriting content displayed in the target handwriting interface may adopt, but is not limited to, all or part of the operations in at least one of the aforementioned designs A1 to A5.
[0705] In the embodiment of the present application, the process of the electronic device storing the second handwritten content into the target file may adopt, but is not limited to, all or part of the operations of at least one of the aforementioned designs C1 to C3.
[0706] The specific contents of the above-mentioned Design A1 to Design A5 and Design C1 to Design C3 can be found in the relevant introduction in the above-mentioned embodiments, and will not be repeated here.
[0707] Based on the functions or capabilities of the electronic devices provided in the aforementioned embodiments, FIG14D exemplarily illustrates a method for processing handwritten content, which can be performed by the electronic device. The method may include the following steps:
[0708] S1401D: Display a target handwriting interface, where the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface.
[0709] S1402D: Determine a content category of the second handwritten content displayed in the target handwriting interface based on the first target operation.
[0710] In the embodiment of the present application, the process of the electronic device determining the second handwriting content displayed in the target handwriting interface can adopt but is not limited to the operations in the aforementioned Designs A1 to A5.
[0711] S1403D: Store the second handwritten content into a target file according to the content classification of the second handwritten content.
[0712] In the embodiment of the present application, the process of the electronic device determining the content classification of the second handwritten content may adopt, but is not limited to, some or all of the operations of determining the content classification corresponding to the second handwritten content in the aforementioned design C3.
[0713] The implementation process of the electronic device executing each step in the embodiment of the present application can be referred to the relevant introduction in the aforementioned embodiment and will not be repeated here.
[0714] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0715] a memory for storing program instructions;
[0716] A controller is configured to call the program instructions stored in the memory to execute:
[0717] Display the target handwriting interface;
[0718] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0719] Based on the first target operation, determining second handwritten content displayed in the target handwriting interface;
[0720] Clearing the second handwritten content on the target handwriting interface and retaining at least a portion of the first handwritten content;
[0721] The second handwritten content is stored in a target file.
[0722] In one possible design, the first target operation includes any one of the following:
[0723] Preset operations on the physical structure of the electronic device;
[0724] a preset operation on at least one virtual button displayed on the electronic device;
[0725] Preset operations on the touch display device of the electronic device;
[0726] Preset voice control operations;
[0727] Preset gesture control operations;
[0728] The operation of sending an indication signal to the electronic device.
[0729] In one possible design, the controller is specifically configured to execute:
[0730] Determine the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the first target period as the second handwritten content, wherein the start time of the first target period is the time when the first target operation is detected; or
[0731] Based on the detected second target operation, the handwritten content corresponding to the second handwriting input received by the target handwriting interface within the second target time period is determined as the second handwritten content, the starting time of the second target time period is the time when the first target operation is detected, wherein the end time of the second target time period is the time when the second target operation is detected.
[0732] In one possible design, the controller is specifically configured to execute:
[0733] Based on the detected third target operation, determining a selection range corresponding to the third target operation, and determining the content in the selection range as the second handwritten content; or,
[0734] Determine the second handwritten content based on the input time corresponding to each handwritten content displayed in the target handwriting interface, wherein the input time of the second handwritten content is the handwritten content with the latest input time among the handwritten contents; or
[0735] Based on the input time and position corresponding to each handwritten content displayed in the target handwriting interface, second handwritten content displayed on the target handwriting interface is determined.
[0736] In one possible design, the controller is specifically configured to execute:
[0737] dividing the handwritten content in the target handwriting interface into rows according to the input time corresponding to each handwritten content displayed in the target handwriting interface, and determining the handwritten content in a target row as the second handwritten content, wherein the target row contains the handwritten content with the latest input time among the handwritten contents; or
[0738] The block where each handwritten content displayed in the target handwriting interface is located is determined, and the handwritten content in the target block is determined as the second handwritten content, wherein the target block includes the handwritten content with the latest input time among the handwritten contents.
[0739] In one possible design, the controller is further configured to execute:
[0740] After determining the second handwritten content displayed in the target handwriting interface, a reminder message is generated to indicate whether the user needs to adjust the second handwritten content; or a content confirmation message is generated to indicate whether the user confirms whether the second handwritten content is correct.
[0741] In one possible design, the controller is specifically configured to execute:
[0742] The second handwriting content is displayed on the target handwriting interface in the following manner:
[0743] A target layer is added and displayed, where the target layer is used to display the second handwritten content or display a recognition result of the second handwritten content.
[0744] In one possible design, the controller is further configured to execute:
[0745] Before adding the target layer, a first layer is created, where the first layer is used to display the first handwritten content, wherein the first layer is not the same layer as the target layer.
[0746] In one possible design, the controller is specifically configured to execute:
[0747] In response to the first target operation, the target layer is added.
[0748] In one possible design, the controller is specifically configured to execute:
[0749] Clears the target layer.
[0750] In one possible design, clearing the second handwritten content on the target handwriting interface includes:
[0751] The data of the second handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0752] In one possible design, storing the second handwritten content in a target file includes:
[0753] The content data corresponding to the second handwritten content is stored in a target file.
[0754] Optionally, the content data includes a picture of the second handwritten content, or the content data includes reporting point data corresponding to the second handwritten content, or the content data includes a recognition result corresponding to the second handwritten content.
[0755] In one possible design, the controller is further configured to execute:
[0756] At least a portion of the first handwritten content is stored in a first file, where the first file is different from the target file.
[0757] In one possible design, the controller is specifically configured to execute:
[0758] determining a target content category of the second handwritten content;
[0759] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0760] The content data corresponding to the second handwritten content is stored in the target file.
[0761] In one possible design, the controller is specifically configured to execute:
[0762] Obtaining a recognition result of the second handwritten content, and determining the target content category based on the recognition result of the second handwritten content; and / or,
[0763] Based on the first target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0764] In one possible design, the controller is specifically configured to execute:
[0765] determining, according to the correspondence between the content classification information and the content categories, the content category corresponding to the target content classification information in the recognition result of the second handwritten content as the target content category;
[0766] The content classification information includes at least one of the following information: classification field, graphics.
[0767] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0768] In one possible design, the controller is specifically configured to execute:
[0769] determining, based on the detected fourth target operation, third handwritten content corresponding to the fourth target operation, wherein the fourth target operation and the first target operation are associated operations;
[0770] Based on the recognition result of the third handwritten content, a target content category corresponding to the second handwritten content is determined.
[0771] In one possible design, any content category is user-configured.
[0772] In one possible design, the controller is specifically configured to execute:
[0773] While clearing the second handwritten content on the target handwriting interface, the second handwritten content is stored in a target file.
[0774] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0775] a memory for storing program instructions;
[0776] A controller is configured to call the program instructions stored in the memory to execute:
[0777] Displaying the lock screen interface of the electronic device;
[0778] Displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0779] If the preset processing conditions are met, the fourth handwritten content is cleared on the lock screen interface and the fourth handwritten content is stored in a target file.
[0780] In one possible design, the controller is specifically configured to execute:
[0781] In response to a fifth target operation, displaying, on the lock screen interface, fourth handwritten content corresponding to the third handwriting input according to the third handwriting input received on the lock screen interface;
[0782] The fifth target operation includes any one of the following:
[0783] Preset operations on the physical structure of the electronic device;
[0784] a preset operation on at least one virtual button displayed on the electronic device;
[0785] Preset operations on the touch display device of the electronic device;
[0786] Preset voice control operations;
[0787] Preset gesture control operations;
[0788] The operation of sending an indication signal to the electronic device.
[0789] In one possible design, the controller is specifically configured to execute:
[0790] The second handwritten content is displayed on the lock screen in the following manner:
[0791] A target layer is added and displayed, where the target layer is used to display the fourth handwritten content or a recognition result of the fourth handwritten content.
[0792] In one possible design, the controller is specifically configured to execute:
[0793] Before adding the target layer, a second layer is created, where the second layer is used to display the preset content of the lock screen interface, wherein the first layer and the target layer are not the same layer.
[0794] In one possible design, the controller is specifically configured to execute:
[0795] In response to the fifth target operation, the target layer is added.
[0796] In one possible design, the controller is specifically configured to execute:
[0797] Clears the target layer.
[0798] In one possible design, the controller is specifically configured to execute:
[0799] The data of the fourth handwriting content is cleared from a screen point reporting data file, where the screen point reporting data file is used to display the handwriting content in the target handwriting interface.
[0800] In one possible design, the controller is specifically configured to execute:
[0801] If the preset storage condition is met, the fourth handwritten content is stored in the target file.
[0802] In one possible design, the controller is specifically configured to execute:
[0803] The content data corresponding to the fourth handwritten content is stored in a target file.
[0804] Optionally, the content data includes a picture of the fourth handwritten content, or the content data includes reporting point data corresponding to the fourth handwritten content, or the content data includes a recognition result corresponding to the fourth handwritten content.
[0805] In one possible design, the controller is specifically configured to execute:
[0806] determining a target content category of the fourth handwritten content;
[0807] Determining a target file corresponding to the target content category based on a correspondence between content categories and files;
[0808] The fourth handwritten content is stored in the target file.
[0809] In one possible design, the controller is specifically configured to execute:
[0810] Obtaining a recognition result of the fourth handwritten content, and determining the target content category based on the recognition result of the fourth handwritten content; or,
[0811] Based on the first target operation being an operation on a target virtual key among multiple virtual keys displayed on the electronic device, according to a preset correspondence between multiple content categories and virtual keys, the content category corresponding to the target virtual key is determined as the target content category.
[0812] In one possible design, the controller is specifically configured to execute:
[0813] determining, according to a correspondence between content classification information and content categories, the content category corresponding to the target content classification information in the recognition result of the fourth handwritten content as the target content category;
[0814] The content classification information includes at least one of the following information: classification field, graphics.
[0815] In a possible design, in the correspondence between the content classification information and the content classification, any content classification information is user-defined or system-default.
[0816] In one possible design, the controller is specifically configured to execute:
[0817] determining, based on the detected sixth target operation, fifth handwritten content corresponding to the sixth target operation, wherein the sixth target operation and the fifth target operation are associated operations;
[0818] Based on the recognition result of the fifth handwritten content, a target content category corresponding to the fourth handwritten content is determined.
[0819] In one possible design, any content category is user-configured.
[0820] In one possible design, storing the fourth handwritten content in a target file includes:
[0821] While clearing the fourth handwritten content on the lock screen interface, the fourth handwritten content is stored in a target file.
[0822] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0823] a memory for storing program instructions;
[0824] A controller is configured to call the program instructions stored in the memory to execute:
[0825] Display the target handwriting interface;
[0826] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0827] Based on the preset target operation, audio is collected and stored.
[0828] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0829] a memory for storing program instructions;
[0830] A controller is configured to call the program instructions stored in the memory to execute:
[0831] Display the target handwriting interface;
[0832] displaying, in the target handwriting interface, first handwriting content corresponding to the first handwriting input according to the first handwriting input received by the target handwriting interface;
[0833] Determining second handwriting content displayed in the target handwriting interface;
[0834] Clearing the second handwritten content on the target handwriting interface and retaining at least a portion of the first handwritten content;
[0835] The second handwritten content is stored in a target file.
[0836] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0837] a memory for storing program instructions;
[0838] A controller is configured to call the program instructions stored in the memory to execute:
[0839] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0840] Based on the first target operation, second handwritten content displayed in the target handwriting interface is determined and the second handwritten content is stored in a target file.
[0841] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including:
[0842] a memory for storing program instructions;
[0843] A controller is configured to call the program instructions stored in the memory to execute:
[0844] Displaying a target handwriting interface, wherein the target handwriting interface is used to receive a handwriting input and display handwritten content corresponding to the handwriting input in the target handwriting interface;
[0845] Determining, based on the first target operation, a content category of the second handwritten content displayed in the target handwriting interface;
[0846] The second handwritten content is stored in a target file according to the content classification of the second handwritten content.
[0847] On the other hand, an embodiment of the present application also provides an electronic device that can execute the steps or operations in the method for processing handwritten content provided in any of the aforementioned embodiments, or execute the functions or operations of the electronic device in any of the aforementioned embodiments.
[0848] Based on the same concept, Figure 15 is a structural diagram of an electronic device 1800 provided in an embodiment of the present application. The electronic device 1800 may be the first device or the second device mentioned above. As shown in Figure 15, the electronic device 1800 may include: one or more processors 1801; one or more memories 1802; a communication interface 1803, and one or more computer programs 1804, and the above-mentioned devices may be connected via one or more communication buses 1805. The one or more computer programs 1804 are stored in the above-mentioned memory 1802 and are configured to be executed by the one or more processors 1801, and the one or more computer programs 1804 include instructions. For example, the above-mentioned instructions can be used to execute the relevant steps of the main device in the corresponding embodiment above. The communication interface 1803 is used to realize communication between the main device and other devices (such as the target device), for example, the communication interface can be a transceiver.
[0849] In the embodiments provided in the present application above, the methods provided in the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the various functions in the methods provided in the embodiments of the present application above, the electronic device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.
[0850] In addition, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program is run on a computer, the computer executes the steps in any one of the above-mentioned screen projection and display methods, such as executing the screen projection and display method executed by the first device, and / or, executing the screen projection and display method executed by the second device.
[0851] As used in the above embodiments, the terms “when…” or “after…” may be interpreted to mean “if…” or “after…” or “in response to determining…” or “in response to detecting…”, depending on the context. Similarly, the phrases “upon determining…” or “if (the stated condition or event) is detected” may be interpreted to mean “if determining…” or “in response to determining…” or “upon detecting (the stated condition or event)” or “in response to detecting (the stated condition or event)”, depending on the context. In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship or order between these entities.
[0852] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0853] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0854] The present application also provides a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)). In the absence of conflict, the solutions of the above embodiments can be used in combination.
[0855] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0856] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0857] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0858] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0859] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0860] Obviously, those skilled in the art may make various changes and modifications to the embodiments of the present invention without departing from the spirit and scope of the embodiments of the present invention. Thus, if such changes and modifications of the embodiments of the present invention fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.
Claims
1. A method for processing handwritten content, wherein, Applied to an electronic device, the method includes: Displaying a target handwriting interface; According to the first handwriting input received by the target handwriting interface, displaying the first handwriting content corresponding to the first handwriting input in the target handwriting interface; Based on a first target operation, determining a second handwriting content displayed in the target handwriting interface; Clearing the second handwriting content on the target handwriting interface and retaining at least a part of the first handwriting content; Storing the second handwriting content in a target file.
2. The method according to claim 1, wherein, The first target operation includes any one of the following: A preset operation on the physical structure of the electronic device; A preset operation on at least one virtual button displayed on the electronic device; A preset operation on the touch display device of the electronic device; A preset voice control operation; A preset gesture control operation; An operation of sending an indication signal to the electronic device.
3. The method according to claim 1, wherein The determining, based on the first target operation, of the second handwriting content displayed on the target handwriting interface includes: Determining, as the second handwriting content, the handwriting content corresponding to the second handwriting input received by the target handwriting interface within a first target period, where the start time of the first target period is the time when the first target operation is detected; or, Based on a detected second target operation, determining, as the second handwriting content, the handwriting content corresponding to the second handwriting input received by the target handwriting interface within a second target period, where the start time of the second target period is the time when the first target operation is detected, and the end time of the second target period is the time when the second target operation is detected.
4. The method according to claim 1, wherein The determining, based on the first target operation, of the second handwriting content displayed on the target handwriting interface includes: Based on a detected third target operation, determining a selection range corresponding to the third target operation and determining the content within the selection range as the second handwriting content; or, Based on the input time of each handwriting content displayed in the target handwriting interface, determining the second handwriting content, where the input time of the second handwriting content is the handwriting content with the latest input time among all handwriting contents; or, Based on the input time and position of each handwriting content displayed in the target handwriting interface, determining the second handwriting content displayed on the target handwriting interface.
5. The method according to claim 4, wherein The determining, based on the input time and position of each handwriting content displayed in the target handwriting interface, of the second handwriting content displayed on the target handwriting interface includes: According to the input time of each handwriting content displayed in the target handwriting interface, performing line division processing on the handwriting contents in the target handwriting interface and determining the handwriting content in the target line as the second handwriting content, where the target line includes the handwriting content with the latest input time among all handwriting contents; or, Determining the blocks where each handwriting content displayed in the target handwriting interface is located and determining the handwriting content in the target block as the second handwriting content, where the target block includes the handwriting content with the latest input time among all handwriting contents.
6. The method according to claim 1, wherein, After determining the second handwriting content displayed in the target handwriting interface, the method further includes: Generate a reminder message for indicating whether the user needs to adjust the second handwritten content; or, Generate a content confirmation message for indicating whether the user confirms that the second handwritten content is correct.
7. The method according to claim 1, wherein, The target handwriting interface displays the second handwritten content in the following manner: Add a target layer and display the target layer, where the target layer is used to display the second handwritten content or the recognition result of the second handwritten content.
8. The method according to claim 7, wherein Before adding the target layer, the method further includes: Create a first layer, where the first layer is used to display the first handwritten content, and the first layer and the target layer are not the same layer.
9. The method according to claim 7, wherein Adding the target layer includes: In response to the first target operation, add the target layer.
10. The method according to claim 7, wherein Clearing the second handwritten content on the target handwriting interface includes: Clear the target layer.
11. The method according to claim 1, wherein, Clearing the second handwritten content on the target handwriting interface includes: Clear the data of the second handwritten content from the screen touch point data file, where the screen touch point data file is used to display handwritten content on the target handwriting interface.
12. The method according to claim 1, wherein, Storing the second handwritten content into a target file includes: Store the content data corresponding to the second handwritten content into the target file.
13. The method according to claim 1, wherein The method further includes: Store at least a part of the first handwritten content into a first file, where the first file and the target file are different files.
14. The method according to claim 12, wherein, Storing the content data corresponding to the second handwritten content into the target file includes: Determine the target content classification of the second handwritten content; According to the correspondence between the content classification and the file, determine the target file corresponding to the target content classification; Store the content data corresponding to the second handwritten content into the target file.
15. The method according to claim 14, wherein, Determining the target content classification of the second handwritten content includes: Obtain the recognition result of the second handwritten content, and determine the target content classification based on the recognition result of the second handwritten content; and / or, Based on the first target operation being an operation on a target virtual button among a plurality of virtual buttons displayed on the electronic device, according to the preset correspondence between a plurality of content classifications and virtual buttons, determine the content classification corresponding to the target virtual button as the target content classification.
16. The method according to claim 15, wherein, Based on the recognition result, determining the target content classification includes: According to the correspondence between the content classification information and the content classification, determine the content classification corresponding to the target content classification information in the recognition result of the second handwritten content as the target content classification; Wherein, the content classification information includes at least one of the following information: classification field, graphic.
17. The method according to claim 16, wherein, In the correspondence between the content classification information and the content classification, any content classification information is user-defined configured or system default configured.
18. The method according to claim 14, wherein Determining the target content classification of the second handwritten content includes: Based on the detected fourth target operation, determine the third handwritten content corresponding to the fourth target operation, where the fourth target operation and the first target operation are associated operations; Based on the recognition result of the third handwritten content, determine the target content classification corresponding to the second handwritten content.
19. The method according to claim 14, wherein, Any content classification is user-defined and configured.
20. The method according to any one of claims 1-19, wherein, The storing the second handwritten content into a target file includes: While clearing the second handwritten content on the target handwriting interface, store the second handwritten content into the target file.
21. A method for processing handwritten content, wherein, Applied to an electronic device, the method includes: Display the lock screen interface of the electronic device; According to the third handwritten input received on the lock screen interface, display the fourth handwritten content corresponding to the third handwritten input on the lock screen interface; If a preset processing condition is satisfied, clear the fourth handwritten content on the lock screen interface and store the fourth handwritten content into the target file.
22. The method according to claim 21, wherein, The displaying the fourth handwritten content corresponding to the third handwritten input received on the lock screen interface on the lock screen interface includes: In response to a fifth target operation, according to the third handwritten input received on the lock screen interface, display the fourth handwritten content corresponding to the third handwritten input on the lock screen interface; Wherein, the fifth target operation includes any one of the following: A preset operation on the physical structure of the electronic device; A preset operation on at least one virtual button displayed on the electronic device; A preset operation on the touch display device of the electronic device; A preset voice control operation; A preset gesture control operation; An operation of sending an indication signal to the electronic device.
23. The method according to claim 22, wherein, The displaying the second handwritten content on the lock screen interface is performed in the following manner: Add a target layer and display the target layer, where the target layer is used to display the fourth handwritten content or the recognition result of the fourth handwritten content.
24. The method according to claim 23, wherein, Before adding the target layer, the method further includes: Create a second layer, where the second layer is used to display the preset content of the lock screen interface, and wherein the first layer and the target layer are not the same layer.
25. The method according to claim 23, wherein The adding the target layer includes: In response to the fifth target operation, add the target layer.
26. The method according to claim 23, wherein, The clearing the fourth handwritten content on the lock screen interface includes: Clear the target layer.
27. The method according to claim 21, wherein The clearing the fourth handwritten content on the lock screen interface includes: Clear the data of the fourth handwritten content from the screen reporting point data file, where the screen reporting point data file is used to display handwritten content on the target handwriting interface.
28. The method according to claim 21, wherein, The storing the fourth handwritten content into the target file includes: If a preset storage condition is satisfied, store the fourth handwritten content into the target file.
29. The method according to claim 21, wherein, The storing the fourth handwritten content into the target file includes: Store the content data corresponding to the fourth handwritten content into the target file.
30. The method according to claim 29, wherein, The storing the content data corresponding to the fourth handwritten content into the target file includes: Determine the target content classification of the fourth handwritten content; According to the correspondence between the content classification and the file, determine the target file corresponding to the target content classification; Store the fourth handwritten content into the target file.
31. The method according to claim 30, wherein, The determining the target content classification of the fourth handwritten content includes: Obtain the recognition result of the fourth handwritten content, and determine the target content classification based on the recognition result of the fourth handwritten content; or, Based on that the fifth target operation is an operation on a target virtual button among multiple virtual buttons displayed on the electronic device, determine the content classification corresponding to the target virtual button as the target content classification according to the preset corresponding relationship between multiple content classifications and virtual buttons.
32. The method according to claim 31, wherein, The determining the target content classification based on the recognition result includes: According to the corresponding relationship between content classification information and content classification, determine the content classification corresponding to the target content classification information in the recognition result of the fourth handwritten content as the target content classification; Wherein, the content classification information includes at least one of the following information: classification field, graphic.
33. The method according to claim 32, wherein, In the corresponding relationship between the content classification information and the content classification, any content classification information is user-defined or system-default configured.
34. The method according to claim 22, wherein, The determining the target content classification of the fourth handwritten content includes: Based on the detected sixth target operation, determine the fifth handwritten content corresponding to the sixth target operation, where the sixth target operation and the fifth target operation are associated operations; Based on the recognition result of the fifth handwritten content, determine the target content classification corresponding to the fourth handwritten content.
35. The method according to claim 30, wherein, Any content classification is user-defined configured.
36. The method according to any one of claims 21-35, wherein, The storing the fourth handwritten content into a target file includes: While clearing the fourth handwritten content on the lock screen interface, store the fourth handwritten content into the target file.
37. A method for processing handwritten content, wherein, The method includes: Display a target handwriting interface; According to the first handwriting input received by the target handwriting interface, display the first handwritten content corresponding to the first handwriting input in the target handwriting interface; Based on a preset target operation, collect audio and store the collected audio.
38. A method for processing handwritten content, wherein, Applied to an electronic device, the method includes: Display a target handwriting interface; According to the first handwriting input received by the target handwriting interface, display the first handwritten content corresponding to the first handwriting input in the target handwriting interface; Determine the second handwritten content displayed in the target handwriting interface; Clear the second handwritten content on the target handwriting interface and retain at least a part of the first handwritten content; Store the second handwritten content into the target file.
39. A method for processing handwritten content, wherein, Applied to an electronic device, the method includes: Display a target handwriting interface, where the target handwriting interface is used to receive handwriting input and display the handwritten content corresponding to the handwriting input in the target handwriting interface; Based on the first target operation, determine the second handwritten content displayed in the target handwriting interface and store the second handwritten content into the target file.
40. A method for processing handwritten content, wherein, Applied to an electronic device, the method includes: Display a target handwriting interface, where the target handwriting interface is used to receive handwriting input and display the handwritten content corresponding to the handwriting input; Based on the first target operation, determine the content classification of the second handwritten content displayed in the target handwriting interface; Store the second handwritten content into the target file according to the content classification of the second handwritten content.
41. An electronic device, wherein, Includes: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement execution of: Displaying a target handwriting interface; According to the first handwriting input received by the target handwriting interface, displaying the first handwriting content corresponding to the first handwriting input in the target handwriting interface; Based on a first target operation, determining second handwriting content displayed in the target handwriting interface; Clearing the second handwriting content on the target handwriting interface and retaining at least a part of the first handwriting content; Storing the second handwriting content into a target file.
42. The electronic device according to claim 41, wherein, The first target operation includes any one of the following: A preset operation on the physical structure of the electronic device; A preset operation on at least one virtual button displayed on the electronic device; A preset operation on the touch display device of the electronic device; A preset voice control operation; A preset gesture control operation; An operation of sending an indication signal to the electronic device.
43. The electronic device according to claim 41, wherein, The controller is specifically configured to execute: Determining, as the second handwriting content, the handwriting content corresponding to the second handwriting input received by the target handwriting interface within a first target period, where the start time of the first target period is the time when the first target operation is detected; or, Based on a detected second target operation, determining, as the second handwriting content, the handwriting content corresponding to the second handwriting input received by the target handwriting interface within a second target period, where the start time of the second target period is the time when the first target operation is detected, and the end time of the second target period is the time when the second target operation is detected.
44. The electronic device according to claim 41, wherein, The controller is specifically configured to execute: Based on a detected third target operation, determining a selection range corresponding to the third target operation and determining the content within the selection Range as the second handwriting content; Or, Based on the input time of each handwriting content displayed in the target handwriting interface, determining the second handwriting content, where the input time of the second handwriting content is the handwriting content with the latest input time among each handwriting content; Or, Based on the input time and position of each handwriting content displayed in the target handwriting interface, determining the second handwriting content displayed on the target handwriting interface.
45. The electronic device according to claim 44, wherein, The controller is specifically configured to execute: According to the input time of each handwriting content displayed in the target handwriting interface, performing line break processing on the handwriting content in the target handwriting interface, and determining the handwriting content in the target line as the second handwriting content, where the target line includes the handwriting content with the latest input time among each handwriting content; Or, Determining the block where each handwriting content displayed in the target handwriting interface is located and determining the handwriting content in the target block as the second handwriting content, where the target block includes the handwriting content with the latest input time among each handwriting content.
46. The electronic device according to claim 41, wherein, The controller is further configured to execute: After determining the second handwriting content displayed in the target handwriting interface: Generating a reminder message for indicating whether the user needs to adjust the second handwriting content; or, Generate content confirmation information for instructing the user to confirm whether the second handwritten content is correct.
47. The electronic device according to claim 41, wherein, The controller is specifically configured to execute: The second handwritten content is displayed on the target handwriting interface in the following manner: Add a target layer and display the target layer, where the target layer is used to display the second handwritten content or the recognition result of the second handwritten content.
48. The electronic device according to claim 47, wherein, The controller is further configured to execute: Before adding the target layer, create a first layer, where the first layer is used to display the first handwritten content, and the first layer and the target layer are not the same layer.
49. The electronic device according to claim 47, wherein, The controller is specifically configured to execute: In response to the first target operation, add the target layer.
50. The electronic device according to claim 47, wherein, The controller is specifically configured to execute: Clear the target layer.
51. The electronic device according to claim 41, wherein, Clearing the second handwritten content on the target handwriting interface includes: Clearing the data of the second handwritten content from the screen touch point data file, where the screen touch point data file is used to display handwritten content on the target handwriting interface.
52. The electronic device according to claim 41, wherein, The storing the second handwritten content into a target file includes: Storing the content data corresponding to the second handwritten content into the target file.
53. The electronic device according to claim 41, wherein, The controller is further configured to execute: Store at least a part of the first handwritten content into a first file, where the first file and the target file are different files.
54. The electronic device according to claim 52, wherein, The controller is specifically configured to execute: Determine the target content classification of the second handwritten content; According to the correspondence between the content classification and the file, determine the target file corresponding to the target content classification; Store the content data corresponding to the second handwritten content into the target file.
55. The electronic device according to claim 54, wherein, The controller is specifically configured to execute: Obtain the recognition result of the second handwritten content, and determine the target content classification based on the recognition result of the second handwritten content; and / or, Based on the first target operation being an operation on a target virtual button among a plurality of virtual buttons displayed on the electronic device, according to the preset correspondence between a plurality of content classifications and virtual buttons, determine the content classification corresponding to the target virtual button as the target content classification.
56. The electronic device according to claim 55, wherein, The controller is specifically configured to execute: According to the correspondence between the content classification information and the content classification, determine the content classification corresponding to the target content classification information in the recognition result of the second handwritten content as the target content classification; Wherein, the content classification information includes at least one of the following information: classification field, graphic.
57. The electronic device according to claim 56, wherein, In the correspondence between the content classification information and the content classification, any content classification information is user-defined configured or system default configured.
58. The electronic device according to claim 54, wherein, The controller is specifically configured to execute: Based on the detected fourth target operation, determine the third handwritten content corresponding to the fourth target operation, where the fourth target operation and the first target operation are associated operations; Based on the recognition result of the third handwritten content, determine the target content classification corresponding to the second handwritten content.
59. The electronic device according to claim 54, wherein, Any content classification is user-defined configured.
60. The electronic device according to any one of claims 41-59, wherein, The controller is specifically configured to execute: While clearing the second handwritten content on the target handwritten interface, store the second handwritten content in a target file.
61. An electronic device, wherein, Including: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement the execution of: Display the lock screen interface of the electronic device; According to the third handwritten input received on the lock screen interface, display the fourth handwritten content corresponding to the third handwritten input on the lock screen interface; If a preset processing condition is met, clear the fourth handwritten content on the lock screen interface and store the fourth handwritten content in a target file.
62. The electronic device according to claim 61, wherein, The controller is specifically configured to execute: In response to a fifth target operation, according to the third handwritten input received on the lock screen interface, display the fourth handwritten content corresponding to the third handwritten input on the lock screen interface; Wherein, the fifth target operation includes any one of the following: A preset operation on the physical structure of the electronic device; A preset operation on at least one virtual button displayed on the electronic device; A preset operation on the touch display device of the electronic device; A preset voice control operation; A preset gesture control operation; An operation of sending an indication signal to the electronic device.
63. The electronic device according to claim 62, wherein, The controller is specifically configured to execute: Use the following method to display the second handwritten content on the lock screen interface: Add a target layer and display the target layer, where the target layer is used to display the fourth handwritten content or the recognition result of the fourth handwritten content.
64. The electronic device according to claim 63, wherein, The controller is specifically configured to execute: Before adding the target layer, create a second layer, where the second layer is used to display the preset content of the lock screen interface, and the first layer and the target layer are not the same layer.
65. The electronic device according to claim 63, wherein, The controller is specifically configured to execute: In response to the fifth target operation, add the target layer.
66. The electronic device according to claim 63, wherein, The controller is specifically configured to execute: Clear the target layer.
67. The electronic device according to claim 61, wherein, The controller is specifically configured to execute: Clear the data of the fourth handwritten content from the screen reporting point data file, where the screen reporting point data file is used to display handwritten content on the target handwritten interface.
68. The electronic device according to claim 61, wherein, The controller is specifically configured to execute: If a preset storage condition is met, store the fourth handwritten content in a target file.
69. The electronic device according to claim 61, wherein, The controller is specifically configured to execute: Store the content data corresponding to the fourth handwritten content in a target file.
70. The electronic device according to claim 69, wherein, The controller is specifically configured to execute: Determine the target content classification of the fourth handwritten content; According to the correspondence between the content classification and the file, determine the target file corresponding to the target content classification; Store the fourth handwritten content in the target file.
71. The electronic device according to claim 70, wherein, The controller is specifically configured to execute: Obtain the recognition result of the fourth handwritten content, and based on the recognition result of the fourth handwritten content, determine the target content classification; or, Based on the fifth target operation being an operation on a target virtual button among multiple virtual buttons displayed on the electronic device, according to the preset correspondence between multiple content classifications and virtual buttons, determine the content classification corresponding to the target virtual button as the target content classification.
72. The electronic device according to claim 71, wherein, The controller is specifically configured to execute: According to the correspondence between the content classification information and the content classification, determine the content classification corresponding to the target content classification information in the recognition result of the fourth handwritten content as the target content classification; Wherein, the content classification information includes at least one of the following information: classification field, graph.
73. The electronic device according to claim 72, wherein, In the correspondence between the content classification information and the content classification, any content classification information is user-defined configured or system-default configured.
74. The electronic device according to claim 72, wherein, The controller is specifically configured to execute: Based on the detected sixth target operation, determine the fifth handwritten content corresponding to the sixth target operation, wherein the sixth target operation and the fifth target operation are associated operations; Based on the recognition result of the fifth handwritten content, determine the target content classification corresponding to the fourth handwritten content.
75. The electronic device according to claim 70, wherein, Any content classification is user-defined configured.
76. The electronic device according to any one of claims 61-75, wherein, The storing the fourth handwritten content into a target file includes: While clearing the fourth handwritten content on the lock screen interface, store the fourth handwritten content into the target file.
77. An electronic device, wherein, Including: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement execution of: Display a target handwriting interface; According to the first handwritten input received by the target handwriting interface, display the first handwritten content corresponding to the first handwritten input in the target handwriting interface; Based on a preset target operation, collect audio and store the collected audio.
78. An electronic device, wherein, Including: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement execution of: Display a target handwriting interface; According to the first handwritten input received by the target handwriting interface, display the first handwritten content corresponding to the first handwritten input in the target handwriting interface; Determine the second handwritten content displayed in the target handwriting interface; Clear the second handwritten content on the target handwriting interface and retain at least a part of the first handwritten content; Store the second handwritten content into the target file.
79. An electronic device, wherein, Including: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement execution of: Display a target handwriting interface, which is used to receive handwritten input and display the handwritten content corresponding to the handwritten input in the target handwriting interface; Based on the first target operation, determine the second handwritten content displayed in the target handwriting interface and store the second handwritten content into the target file.
80. An electronic device, wherein, Including: A memory for storing program instructions; A controller for calling the program instructions stored in the memory to implement execution of: Display a target handwriting interface, which is used to receive handwritten input and display the handwritten content corresponding to the handwritten input in the target handwriting interface; Based on the first target operation, determine the content classification of the second handwritten content displayed in the target handwriting interface; Store the second handwritten content into the target file according to the content classification of the second handwritten content.
81. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 1.
82. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 21.
83. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 37.
84. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 38.
85. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 39.
86. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in claim 40.
Citation Information
Patent Citations
Handwritten document processing apparatus and method
CN104737120A
Hand input method and electronic equipment
CN106502571A
Note generation method, electronic device, and computer storage medium
CN108932097A
Electronic apparatus and handwritten document processing method
US20140075302A1
Image display apparatus, non-transitory computer-readable storage medium and display control method
US20140372881A1