A method, device and display device for updating a document based on annotation content

Abstract

The application relates to the computer field and discloses a method and device for updating a document based on annotation content and a display device. The method comprises the following steps: in response to an annotation operation, displaying an annotation window above a display window of a target document; the target document can be displayed through the annotation window; in response to a touch operation in the annotation window, displaying a touch track of the touch operation in the annotation window and determining annotation content according to the touch track; determining an update strategy in response to a selection operation in the annotation window; or determining the update strategy according to the touch track or the annotation content; and updating the target document according to the update strategy and the annotation content. A transparent window is created above the document, handwriting input is performed on the transparent window, handwriting input content is automatically recognized by using a handwriting recognition algorithm, the original document is updated according to the recognized content at a determined update position, and the conference record is conveniently arranged and displayed, and the conference efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, storage medium, electronic device, and display device for updating documents based on annotation content. Background Technology

[0002] The purpose of the background description provided herein is to give an overall background to this application. The statements in this section are merely to provide background information relevant to this application and do not necessarily constitute prior art.

[0003] Currently, during meetings, people often need to record discussion content and meeting minutes while explaining the meeting content. The meeting content to be explained is usually prepared in advance and recorded in office documents (such as Office documents such as PPT, Word, Excel, etc.).

[0004] However, existing recording methods present significant inconveniences when documenting new content generated during meetings. For instance, traditional paper notebooks are cumbersome to use and inconvenient for later organization; while existing electronic devices such as whiteboards allow users to open office documents for input and modification, or use handwriting software for handwritten notes or presentations, handwritten notes taken during the meeting still need to be entered into existing office documents afterward to generate meeting minutes or final proposals, causing considerable inconvenience to users. Summary of the Invention

[0005] To address the aforementioned issues, this application proposes a method, apparatus, storage medium, electronic device, and display device for updating documents based on annotation content. This application provides a more convenient and efficient way to take meeting minutes, allowing users to directly input handwriting on a transparent window above the document. The handwritten notes are recognized as standard text in real time and automatically inserted into the corresponding positions in the document. By recording the position information of the handwritten strokes, it ensures a complete correspondence between the handwritten input and the inserted text on the document, thereby facilitating the organization and presentation of meeting minutes.

[0006] A first aspect of this application provides a method for updating a document based on annotation content, the method comprising:

[0007] In response to an annotation operation, an annotation window is displayed above the target document's display window; wherein the target document can be displayed through the annotation window;

[0008] In response to a touch operation in the annotation window, the touch trajectory of the touch operation is displayed in the annotation window and the annotation content is determined based on the touch trajectory;

[0009] The update strategy corresponding to the annotation content is determined in response to a selection operation in the annotation window; or the update strategy corresponding to the annotation content is determined based on the touch trajectory or the annotation content.

[0010] Update the target document according to the update strategy and the annotation content.

[0011] Furthermore, the annotation content includes annotation text and / or annotation images.

[0012] Further, updating the target document according to the update strategy and the annotation content includes:

[0013] The target update position is determined based on the coordinates of the touch trajectory or the annotation content;

[0014] The target document is updated at the target update location according to the update strategy and the annotation content.

[0015] Further, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0016] When the update strategy is an insertion strategy, an insertion operation is performed according to the update strategy to add the annotation content to the target update position of the target document.

[0017] Further, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0018] When the update strategy is a deletion strategy, a deletion operation is performed according to the update strategy to delete the content at the target update position from the target document, or to set the content at the target update position to a preset deletion style.

[0019] Furthermore, the method for determining the content of the annotation includes:

[0020] The touch trajectory is identified using a preset handwriting recognition model to determine the content of the annotation; or

[0021] The touch trajectory is sent to the server, which then uses a preset handwriting recognition model to identify the touch trajectory in order to determine and provide feedback on the annotation content.

[0022] Further, determining the update strategy corresponding to the annotation content based on the annotation content includes:

[0023] If the annotation content is a preset annotation type, the update strategy will be determined as an insertion strategy.

[0024] Further, determining the update strategy corresponding to the annotation content based on the touch trajectory includes:

[0025] The corresponding covered content is determined in the target document based on the touch trajectory;

[0026] If the covered content is not empty, the covered content is determined to be the annotation content, and the update strategy is determined to be the deletion strategy.

[0027] Furthermore, before adding the annotation content to the target update position of the target document, the method further includes:

[0028] When the annotation content is annotation text, the font of the annotation content is set to a preset font style.

[0029] Furthermore, the display area of ​​the annotation window and the display area of ​​the presentation window are kept in the same position and size.

[0030] Further, determining the target update position based on the coordinates of the annotation content includes:

[0031] The target update position is determined based on the coordinates of the first character in the annotation content; or

[0032] The target update position is determined based on the center coordinates of the annotation content.

[0033] Further, determining the target update position based on the touch trajectory includes:

[0034] The initial position coordinates of the touch trajectory are used as the target update position.

[0035] Furthermore, the method for updating the target document includes:

[0036] If the annotation content changes, update the target document; or,

[0037] In response to the update operation, the target document is updated according to the update strategy and the annotation content.

[0038] A second aspect of this application provides an apparatus for updating a document based on annotation content, the apparatus comprising:

[0039] The display module is used to display an annotation window above the display window of the target document in response to the annotation operation; wherein the target document can be displayed through the annotation window;

[0040] An annotation content determination module is used to respond to a touch operation in the annotation window, display the touch trajectory of the touch operation in the annotation window, and determine the annotation content based on the touch trajectory;

[0041] An update strategy determination module is used to determine the update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or to determine the update strategy corresponding to the annotation content based on the touch trajectory or the annotation content.

[0042] The update module is used to update the target document according to the update strategy and the annotation content.

[0043] A third aspect of this application provides a computer-readable storage medium storing a computer program that can be executed by one or more processors to implement the steps of the method described above.

[0044] A fourth aspect of this application provides an electronic device including a memory and one or more processors, wherein a computer program is stored on the memory, and the memory and the one or more processors are communicatively connected to each other, wherein when the computer program is executed by the one or more processors, it implements the steps of the method described above.

[0045] A fifth aspect of this application provides a display device, comprising:

[0046] The display module is configured to: display a target document through a display window of the target document, and, in response to an annotation operation, display an annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window;

[0047] The control unit, electrically connected to the display module, is configured to: in response to a touch operation in the annotation window, display the touch trajectory of the touch operation in the annotation window and determine annotation content based on the touch trajectory; in response to a selection operation in the annotation window, determine an update strategy corresponding to the annotation content; or determine an update strategy corresponding to the annotation content based on the touch trajectory or the annotation content; and update the target document based on the update strategy and the annotation content.

[0048] Compared with the prior art, the advantages or beneficial effects of the technical solution of this application include:

[0049] By creating a transparent window above the document, allowing handwriting input on the transparent window, and using a handwriting recognition algorithm to automatically recognize the handwriting input, the original document is updated at the determined update position based on the recognized content. This not only facilitates the organization and display of meeting minutes but also improves meeting efficiency. Attached Figure Description

[0050] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0051] It should also be noted that, for ease of description, only the parts relevant to this disclosure are shown in the accompanying drawings. The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions in this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0052] Figure 1 A flowchart illustrating a method for updating a document based on annotation content, provided in an embodiment of this application;

[0053] Figure 2 A flowchart illustrating another method for updating a document based on annotation content, provided in an embodiment of this application;

[0054] Figure 3 This is a schematic diagram of a device for updating the original file based on annotation content, provided in an embodiment of this application. Detailed Implementation

[0055] The following detailed description of the embodiments of this application, in conjunction with the accompanying drawings, will provide a thorough understanding of how this application uses technical means to solve technical problems and achieve corresponding technical effects, enabling its implementation. The embodiments of this application and the various features within them can be combined with each other without conflict, and all resulting technical solutions are within the protection scope of this application.

[0056] It should be clearly stated that the embodiments described below are merely some embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0057] According to the method provided in this application, a transparent window is created above an office document, and handwriting input is made on the window. A preset handwriting recognition model automatically recognizes the handwriting input and then automatically inserts the recognized content into the corresponding position in the current office document. This not only greatly facilitates the organization and presentation of meeting minutes but also improves work efficiency.

[0058] This application provides a method for updating documents based on annotation content, which can be applied to or used in smart terminals, including mobile phones, tablets, e-ink screens, and conference tablets, and can also be used in electronic whiteboards or other touch screen devices.

[0059] Figure 1 A flowchart illustrating a method for updating a document based on annotation content, as provided in this application embodiment, is shown below. Figure 1 As shown, the method for updating documents based on annotation content disclosed in this application includes the following steps:

[0060] Step 110: In response to the annotation operation, an annotation window is displayed above the display window of the target document; wherein the target document can be displayed through the annotation window.

[0061] Optionally, the target document includes office documents such as Office, PPT, or WPS.

[0062] Optionally, in order to ensure that the annotation window does not affect the normal display of the content in the target document or the display window, the annotation window can be set to a transparent window or a window with a certain degree of transparency. When added above the display window of the target document, it will not affect the normal display of the target document in the display window.

[0063] For example, taking a smart terminal running the Android system as an example, the annotation window can be a view control. The annotation window can be added to the display window or to the parent view of the display window. When the two are under the same parent view, the annotation window must be placed on top of the display window.

[0064] As an example, the display area of ​​the annotation window and the display area of ​​the presentation window are kept in the same position and size.

[0065] Furthermore, the display area of ​​the annotation window and the display area of ​​the target document's display window always maintain the same position and size. This allows for a more intuitive update of the corresponding position in the target document's display window based on the user's annotations in the annotation window.

[0066] For example, when adding a comment window to a display window, the starting position coordinates of the comment window can be set to (0, 0), and the size of the comment window (including length and width) can be the same as that of the display window; when adding a comment window to the parent view of the display window, the starting position coordinates of the comment window and the starting position coordinates of the display window can be the same, and the size of the comment window and the size of the display window can also be the same.

[0067] Step 120: In response to a touch operation in the annotation window, display the touch trajectory of the touch operation in the annotation window and determine the annotation content based on the touch trajectory.

[0068] Alternatively, the touch operation can be a handwritten operation generated directly in the annotation window using a finger or stylus.

[0069] As an example, the methods for determining the content of the annotation include:

[0070] The touch trajectory is identified using a preset handwriting recognition model to determine the content of the annotation; or

[0071] The touch trajectory is sent to the server, which then uses a preset handwriting recognition model to identify the touch trajectory in order to determine and provide feedback on the annotation content.

[0072] It is understandable that the server and the smart terminal can communicate and connect, so a preset handwriting recognition model can be deployed on the server or the smart terminal. The preset handwriting recognition model is used to recognize the touch trajectory to determine the annotation content.

[0073] The preset handwriting recognition model can be selected according to actual needs, and no special restrictions are imposed here.

[0074] As an example, the annotation content includes annotation text and / or annotation images.

[0075] For example, the annotation text can be: the recognition result of the touch trajectory through a preset handwriting recognition model, such as a piece of text recognized based on the touch trajectory; the annotation image can be: an image generated based on the touch trajectory or an image generated based on the recognition result of the touch trajectory.

[0076] Step 130: In response to the selection operation in the annotation window, determine the update strategy corresponding to the annotation content; or determine the update strategy corresponding to the annotation content based on the touch trajectory or the annotation content.

[0077] Optionally, the update strategy includes an insertion strategy and a deletion strategy, wherein the insertion strategy is used to insert the annotation content into the corresponding position in the original target document, and the deletion strategy is used to delete the annotation content from the corresponding position in the original target document.

[0078] As an example, determining the update strategy corresponding to the annotation content in response to a selection operation in the annotation window includes:

[0079] The comment window contains delete and insert controls. When the delete control is clicked, the update strategy is set to delete, and the corresponding delete operation is performed based on the comment content. When the insert control is clicked, the update strategy is set to insert, and the corresponding insert operation is performed based on the comment content. Alternatively, clicking the insert or delete control in the pop-up page of the comment window will determine the corresponding update strategy and perform the corresponding operation.

[0080] As another example, determining the update strategy corresponding to the annotation content based on the annotation content includes:

[0081] If the annotation content is a preset annotation type, the update strategy will be determined as an insertion strategy.

[0082] The preset annotation types can include text and images.

[0083] As another example, determining the update strategy corresponding to the annotation content based on the touch trajectory includes:

[0084] The corresponding covered content is determined in the target document based on the touch trajectory;

[0085] If the covered content is not empty, the covered content is determined to be the annotation content, and the update strategy is determined to be the deletion strategy.

[0086] For example, drawing a horizontal line across a line in the target document in the comment window means that line content will be deleted. One possible implementation is to determine the corresponding coordinates based on the touch trajectory in the comment window, convert them to coordinates in the target document's display window, then determine the overlaid content corresponding to the touch trajectory in the current display page based on the coordinates in the target document's display window, and use this overlaid content as the comment content; if the overlaid content is not empty (i.e., the content covered by the touch trajectory can be determined in the target document based on the touch trajectory), the update strategy is set to deletion.

[0087] Step 140: Update the target document according to the update strategy and the annotation content.

[0088] As an example, updating the target document according to the update strategy and the annotation content includes:

[0089] The target update position is determined based on the coordinates of the touch trajectory or the annotation content;

[0090] The target document is updated at the target update location according to the update strategy and the annotation content.

[0091] As an example, determining the target update position based on the coordinates of the annotation content includes:

[0092] The target update position is determined based on the coordinates of the first character in the annotation content; or

[0093] The target update position is determined based on the center coordinates of the annotation content.

[0094] Optionally, after determining the annotation content, the target update position can be determined based on the coordinates of the first character in the annotation content, or it can be determined based on the center coordinates of the entire annotation content.

[0095] Furthermore, after determining the coordinates of the first character in the annotation content or the center coordinates of the entire annotation content, the target update position is determined based on the horizontal and vertical coordinates of these coordinates.

[0096] For example, when annotating a line of text in a multi-line document, if the annotation is between two lines of text, you can first determine the position of the target update location in the original document by using the vertical axis to measure the distance from the adjacent lines above and below. For instance, if the distance from the next line is less than the distance from the previous line, then the line below the annotation is taken as the line where the target update location is located. Then, you can determine the precise position of the target update location within that line by using the horizontal axis.

[0097] As an example, determining the target update position based on the touch trajectory includes:

[0098] The initial position coordinates of the touch trajectory are used as the target update position.

[0099] Optionally, if the update strategy is a deletion strategy, the target update position can also be based on the initial position coordinates of the touch trajectory.

[0100] For example, when deleting a line of text by drawing a horizontal line, the initial coordinates of the touch trajectory can be used as the target update position.

[0101] As an example, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0102] When the update strategy is an insertion strategy, an insertion operation is performed according to the update strategy to add the annotation content to the target update position of the target document.

[0103] As an example, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0104] When the update strategy is a deletion strategy, a deletion operation is performed according to the update strategy to delete the content at the target update position from the target document, or to set the content at the target update position to a preset deletion style.

[0105] The preset deletion style can be set according to actual needs, and no special restrictions are made here.

[0106] As an example, before adding the annotation content to the target update location of the target document, the method further includes:

[0107] When the annotation content is annotation text, the font of the annotation content is set to a preset font style.

[0108] The preset font style can be set according to actual needs, and no special restrictions are made here.

[0109] As an example, the target document can be updated in the following ways:

[0110] If the annotation content changes, update the target document; or,

[0111] In response to the update operation, the target document is updated according to the update strategy and the annotation content.

[0112] Optionally, the target document can be updated whenever the annotation content changes; or, in response to an update operation, the target document can be updated uniformly based on multiple annotation contents.

[0113] Furthermore, for a better understanding of the technical solution of this application, please refer to... Figure 2 .

[0114] The method for updating documents based on annotation content provided in this application can be applied to or used in smart terminals. It involves creating a transparent window above the office document (which can be added to the document display window or its parent view), allowing handwriting input on the window, and automatically recognizing the handwriting using a preset handwriting recognition model. The recognized content is then automatically inserted into the corresponding position in the current office document. Specifically, the method includes the following steps: responding to an annotation operation, displaying an annotation window above the target document's display window; wherein the target document can be displayed through the annotation window; responding to a touch operation in the annotation window, displaying the touch trajectory of the touch operation in the annotation window and determining the annotation content based on the touch trajectory; responding to a selection operation in the annotation window, determining an update strategy corresponding to the annotation content; or determining an update strategy corresponding to the annotation content based on the touch trajectory or the annotation content; and updating the target document according to the update strategy and the annotation content. This not only greatly facilitates the organization and display of meeting minutes but also improves work efficiency.

[0115] The following example, using Office software running on a conference tablet, further explains and illustrates the method for updating documents based on annotation content disclosed in this application.

[0116] For example, suppose the Office software does not have handwriting input functionality, but it exposes interfaces. Therefore, certain operations can be performed on the current Office software through these interfaces or the SDK (Software Development Kit).

[0117] (1) Obtain information such as the current display position and content of the Office document that is currently open in the Office software;

[0118] (2) According to the interface provided by the Office software, external text or pictures can be inserted into the specified location of the Office document.

[0119] An alternative implementation method includes the following steps:

[0120] Step 1: Open the Office document on the conference tablet using Office software and present it.

[0121] Step 2: When you need to add comments, open a transparent comment window and overlay it on top of the current Office document's display window;

[0122] Step 3: Hand-written annotations and demonstrations of the document content. During the demonstration, the handwritten text can be automatically translated in real time by a handwriting recognition algorithm (e.g., a preset handwriting recognition model) and then inserted into the corresponding position in the Office document. Alternatively, you can manually operate the function and then batch insert the handwritten text into the corresponding position in the Office document.

[0123] Step 4: Handwritten annotation notes record the trajectory points of the handwriting on the screen during the handwriting process. This information is then transcribed into standard text using a handwriting recognition algorithm. The handwriting recognition algorithm can be integrated into the annotation software or deployed to the cloud. The annotation software then calls the transcription interface through the network interface to translate into standard text.

[0124] Step 5: After transcribing into standard text, each transcribed character corresponds to a position information based on the original handwriting position information. The position information can correspond to the upper left corner of the handwriting or the center point of all the handwriting in the generated character.

[0125] Step 6: Insert the transcribed text, character by character, into the specified location in the Office document using the interface provided by the Office software. The inserted text will be displayed in a special format (distinguished by color, size, thickness, underline, etc.) to facilitate modification when organizing the document.

[0126] Step 7: Users can further refine the Office document according to their actual needs, such as adjusting fonts, font colors, letter spacing, and image layout.

[0127] Understandably, in addition to inserting text into a document, it can also generate an image of the handwritten annotations and then insert the image into the Office document through an interface provided by the Office software; it also supports users selecting a portion of the handwritten text, recognizing it as text using a preset handwriting recognition model, and then inserting it into a specified location in the Office document.

[0128] It should be noted that corresponding annotation software can also be developed based on the method for updating documents based on annotation content disclosed in this application, and deployed on a conference tablet, so that the steps described above can be implemented through the annotation software on the conference tablet.

[0129] In some possible cases, corresponding functional modules have been developed based on the method for updating documents based on annotation content disclosed in this application, and deployed in office software. Then, the method steps for updating documents based on annotation content can be implemented in a conference tablet through the office software.

[0130] The following explanation uses the Office software running on the conference tablet (which integrates Office presentation, editing, and annotation functions) as an example:

[0131] The Office software's presentation and editing functions can be implemented internally or through integration with third-party Office SDKs. It includes Office presentation, editing, and handwritten annotation features. The main body of the software consists of two layers of view windows: the bottom window displays the Office document for previewing and editing; the top window is used for handwritten annotations, which are only displayed when needed (e.g., when the user has enabled annotation functionality).

[0132] An alternative implementation method includes the following steps:

[0133] Step 1: Open an Office document on the conference tablet using Office software and give a presentation;

[0134] Step 2: When you need to add comments, turn on the comment function. Then, the Office software will open a transparent comment window and overlay it on top of the current Office document display window.

[0135] Step 3: Hand-written annotations and demonstrations of the document content. During the demonstration, the handwritten text can be automatically translated in real time by the handwriting recognition algorithm and then inserted into the corresponding position in the Office document. Alternatively, you can manually operate the function and then batch insert the handwritten text into the corresponding position in the Office document.

[0136] Step 4: Handwritten annotation notes record the trajectory points of the handwriting on the screen during the handwriting process. This information is then transcribed into standard text using a handwriting recognition algorithm. The handwriting recognition algorithm can be integrated into Office software or deployed to the cloud. The annotation software then calls the transcription interface through a network interface to translate the text into standard text.

[0137] Step 5: After transcribing into standard text, each transcribed character corresponds to a position information based on the original handwriting position information. The position information can correspond to the upper left corner of the handwriting or the center point of all the handwriting in the generated character.

[0138] Step 6: Insert the transcribed text, character by character, into the designated location in the Office document. The inserted text will be displayed in a special format (distinguished by color, size, thickness, underline, etc.) to facilitate modification when organizing the document.

[0139] Step 7: Users can further refine the Office document according to their actual needs, such as adjusting fonts, font colors, letter spacing, and image layout.

[0140] This application also provides an apparatus for updating a document based on annotation content. This apparatus embodiment can be used to execute the method embodiment of this application. For details not disclosed in this apparatus embodiment, please refer to the method embodiment of this application. The apparatus for updating a document based on annotation content disclosed in this application includes:

[0141] The display module is used to display an annotation window above the display window of the target document in response to the annotation operation; wherein the target document can be displayed through the annotation window;

[0142] An annotation content determination module is used to respond to a touch operation in the annotation window, display the touch trajectory of the touch operation in the annotation window, and determine the annotation content based on the touch trajectory;

[0143] An update strategy determination module is used to determine the update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or to determine the update strategy corresponding to the annotation content based on the touch trajectory or the annotation content.

[0144] The update module is used to update the target document according to the update strategy and the annotation content.

[0145] In some embodiments, the annotation content includes annotation text and / or annotation images.

[0146] In some embodiments, updating the target document according to the update strategy and the annotation content includes:

[0147] The target update position is determined based on the coordinates of the touch trajectory or the annotation content;

[0148] The target document is updated at the target update location according to the update strategy and the annotation content.

[0149] In some embodiments, the update module is configured to perform an insertion operation according to the update strategy when the update strategy is an insertion strategy, so as to add the annotation content to the target update position of the target document.

[0150] In some embodiments, the update module is configured to perform a deletion operation according to the update strategy when the update strategy is a deletion strategy, so as to delete the content at the target update position from the target document, or set the content at the target update position to a preset deletion style.

[0151] In some embodiments, the method for determining the annotation content includes:

[0152] The touch trajectory is identified using a preset handwriting recognition model to determine the content of the annotation; or

[0153] The touch trajectory is sent to the server, which then uses a preset handwriting recognition model to identify the touch trajectory in order to determine and provide feedback on the annotation content.

[0154] In some embodiments, the update strategy determination module is used to determine the update strategy as an insertion strategy when the annotation content is a preset annotation type.

[0155] In some embodiments, the determining module further includes: an overlay content determining unit, a deletion content and deletion strategy determining unit; wherein,

[0156] The overlay content determination unit is used to determine the corresponding overlay content in the target document based on the touch trajectory;

[0157] The deletion content and deletion strategy determination unit is used to determine the covered content as the annotation content and the update strategy as the deletion strategy when the covered content is not empty.

[0158] In some embodiments, the system further includes a font style setting module, configured to set the font of the annotation content to a preset font style when the annotation content is annotation text, before adding the annotation content to the target update position of the target document.

[0159] In some embodiments, the display area of ​​the annotation window and the display area of ​​the presentation window are kept in the same position and size.

[0160] In some embodiments, determining the target update position based on the coordinates of the annotation content includes:

[0161] The target update position is determined based on the coordinates of the first character in the annotation content; or

[0162] The target update position is determined based on the center coordinates of the annotation content.

[0163] In some embodiments, determining the target update position based on the touch trajectory includes:

[0164] The initial position coordinates of the touch trajectory are used as the target update position.

[0165] In some embodiments, the method of updating the target document includes:

[0166] If the annotation content changes, update the target document; or,

[0167] In response to the update operation, the target document is updated according to the update strategy and the annotation content.

[0168] Please refer to Figure 3 In some possible cases, the device for updating documents based on annotation content can also be configured with the following structure:

[0169] The processing module is used to control the overall operation, display the handwriting recognition results in Office documents, and store the annotation results;

[0170] The storage module is used to store information such as Office documents, handwriting recognition algorithms, and target update locations;

[0171] The display module is used to display Office documents and handwritten notes, including: a transparent annotation window, which is overlaid on top of the document display window to accept handwritten input; and an Office document display window, which is used to display Office documents.

[0172] The handwriting recognition module is used to recognize handwritten notes on the annotation window;

[0173] Office processing module: Used for processing Office documents, including opening Office documents and calling externally exposed interfaces;

[0174] The interface module is the interface exposed to external modules, used to insert the recognized standard text and position information into the corresponding update position in the document.

[0175] Those skilled in the art will understand that the modules or steps described above can be implemented using general-purpose computing devices, either centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby allowing them to be stored in a storage device for execution by a computing device. Furthermore, in some cases, the steps shown or described can be performed in a different order than presented herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module.

[0176] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of each module in the device for updating documents based on annotation content can be referred to the corresponding process in the aforementioned method for updating documents based on annotation content, and will not be repeated here.

[0177] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program that, when executed by a processor, can implement all or part of the steps of the aforementioned method for updating a document based on annotation content, which will not be repeated here.

[0178] Computer-readable storage media may individually include computer programs, data files, data structures, etc., or combinations thereof. The computer-readable storage media or computer program may be specifically designed and understood by those skilled in the art of computer software, or the computer-readable storage media may be known and available to those skilled in the art of computer software. Examples of computer-readable storage media include: magnetic media, such as hard disks, floppy disks, and magnetic tapes; optical media, such as CD-ROMs and DVDs; magneto-optical media, such as optical discs; and hardware devices specifically configured to store and execute computer programs, such as read-only memory (ROM), random access memory (RAM), flash memory; or servers, application stores, etc. Examples of computer programs include machine code (e.g., code generated by a compiler) and files containing high-level code that can be executed by a computer using an interpreter. The described hardware devices may be configured to function as one or more software modules to perform the operations and methods described above, and vice versa. Furthermore, computer-readable storage media may be distributed across networked computer systems, allowing for the decentralized storage and execution of program code or computer programs.

[0179] This application also provides a computer program product. The computer program product includes a computer program or instructions that, when executed by a processor, implement all or part of the steps of the aforementioned method for updating a document based on annotation content, which will not be repeated here.

[0180] Furthermore, the computer program product may include one or more computer-executable components configured to perform the embodiments when the program is run; the computer program product may also include a computer program tangibly contained on a readable medium thereof, the computer program containing program code for performing any of the methods in the embodiments of this disclosure. In such embodiments, the computer program may be downloaded and installed from a network via a communication component, and / or installed from a removable medium.

[0181] This application also provides an electronic device that may include: one or more processors, memory, multimedia components, input / output (I / O) interfaces, and communication components.

[0182] One or more processors are used to execute all or part of the steps of the method for updating a document based on annotation content, as described above. The memory is used to store various types of data, which may include, for example, instructions for any application or method in the electronic device, as well as application-related data.

[0183] One or more processors may be implemented as Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components, and are used to perform the methods as described in the foregoing method embodiments.

[0184] Memory can be implemented from any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0185] The multimedia component may include a screen, which may be a touchscreen, and an audio component for outputting and / or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in memory or transmitted via a communication component. The audio component also includes at least one speaker for outputting audio signals.

[0186] I / O interfaces provide an interface between one or more processors and other interface modules, such as keyboards, mice, and buttons. These buttons can be virtual or physical.

[0187] Communication components are used for wired or wireless communication between the electronic device and other devices. Wired communication includes communication via network ports, serial ports, etc.; wireless communication includes Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, 5G, or one or more combinations thereof.

[0188] This application also provides a display device, which may include:

[0189] The display module is configured to: display a target document through a display window of the target document, and, in response to an annotation operation, display an annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window;

[0190] The control unit, electrically connected to the display module, is configured to: in response to a touch operation in the annotation window, display the touch trajectory of the touch operation in the annotation window and determine annotation content based on the touch trajectory; in response to a selection operation in the annotation window, determine an update strategy corresponding to the annotation content; or determine an update strategy corresponding to the annotation content based on the touch trajectory or the annotation content; and update the target document based on the update strategy and the annotation content.

[0191] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of each unit / module in the display device can be referred to the corresponding process in the aforementioned method steps, and will not be repeated here.

[0192] It should also be understood that the methods or apparatuses disclosed in the embodiments provided in this application can also be implemented in other ways. The method or apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the architecture, functions, and operations of possible implementations of methods and apparatuses according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, computer program segment, or part of a computer program, which includes one or more computer programs for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings, and may actually be executed substantially in parallel. They may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or can be implemented using a combination of dedicated hardware and computer programs.

[0193] In this application, the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "including one..." does not exclude the presence of other identical elements in the process, method, apparatus, or device that includes the element; the use of terms such as "first" and "second" is for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly indicating the number or sequence of the indicated technical features; in the description of this application, unless otherwise stated, the terms "multiple" or "many" mean at least two; if a server is described, it should be noted that a server can be an independent physical server or terminal, or a server cluster consisting of multiple physical servers, or a cloud server capable of providing basic cloud computing services such as cloud servers, cloud databases, cloud storage, and CDN; if a smart terminal or mobile device is described in this application, it should be noted that a smart terminal or mobile device can be a mobile phone, tablet computer, smartwatch, netbook, wearable electronic device, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, smart TV, smart speaker, personal computer (PC). Computer (PC) etc., but not limited to these, this application does not make any special restrictions on the specific form of smart terminals or mobile devices.

[0194] Finally, it should be noted that in the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "a single example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0195] Although embodiments of this application have been shown and described above, it is to be understood that the above embodiments are exemplary and the content is only for the purpose of facilitating understanding of this application, and is not intended to limit this application. Any person skilled in the art to which this application pertains may make any modifications and changes in form and detail of the implementation without departing from the spirit and scope disclosed in this application, but the scope of protection of this application shall still be determined by the scope defined in the appended claims.

Claims

1. A method of updating a document based on annotation content, characterized by, The method comprises: in response to an annotation operation, displaying an annotation window above a display window of a target document; wherein the target document can be displayed through the annotation window; in response to a touch operation in the annotation window, displaying a touch track of the touch operation in the annotation window and determining annotation content according to the touch track; determining an update strategy corresponding to the annotation content according to the touch track or the annotation content; updating the target document according to the update strategy and the annotation content; wherein determining the update strategy corresponding to the annotation content according to the touch track comprises: determining corresponding cover content in the target document according to the touch track, and in the case that the cover content is not empty, determining the cover content as the annotation content and determining the update strategy as a deletion strategy; determining the update strategy corresponding to the annotation content according to the annotation content comprises: in the case that the annotation content is a preset annotation type, determining the update strategy as an insertion strategy; wherein the preset annotation type includes text and pictures.

2. The method of claim 1, wherein: the annotation content includes an annotation script and / or an annotation picture.

3. The method of updating a document based on annotation content according to claim 1, wherein, updating the target document according to the update strategy and the annotation content comprises: determining a target update position according to the coordinates of the touch track or the annotation content; updating the target document at the target update position according to the update strategy and the annotation content.

4. The method for updating a document based on annotation content according to claim 3, wherein, updating the target document at the target update position according to the update strategy and the annotation content comprises: in the case that the update strategy is an insertion strategy, performing an insertion operation according to the update strategy to add the annotation content to the target document at the target update position.

5. The method for updating a document based on annotation content according to claim 3, wherein, updating the target document at the target update position according to the update strategy and the annotation content comprises: in the case that the update strategy is a deletion strategy, performing a deletion operation according to the update strategy to delete the content at the target update position from the target document or set the content at the target update position to a preset deletion style.

6. The method for updating a document based on annotation content according to claim 1, wherein, the determination method of the annotation content comprises: identifying the touch track through a preset handwriting recognition model to determine the annotation content; or sending the touch track to a server to make the server identify the touch track through a preset handwriting recognition model to determine and feed back the annotation content.

7. The method for updating a document based on annotation content according to claim 4, wherein, before adding the annotation content to the target document at the target update position, further comprising: in the case that the annotation content is an annotation script, setting the font of the annotation content to a preset font style.

8. The method of claim 1, wherein: the display area of the annotation window and the display area of the display window maintain the same position and size.

9. The method for updating a document based on annotation content according to claim 3, wherein, determining a target update position according to the coordinates of the annotation content comprises: determine the target update position according to a coordinate of a first character in the comment content; or determine the target update position according to a center coordinate of the comment content.

10. The method for updating a document based on annotation content according to claim 3, wherein, determine the target update position according to the touch track, including: determine the initial position coordinate of the touch track as the target update position.

11. The method for updating a document based on annotation content according to claim 1, wherein, the update manner of the target document, including: update the target document in a case where the comment content changes; or update the target document according to the update strategy and the comment content in response to an update operation.

12. An apparatus for updating a document based on annotation content, the apparatus comprising: including: a display module, configured to display a comment window above a display window of a target document in response to a comment operation; wherein the target document can be displayed through the comment window; a comment content determination module, configured to display a touch track of a touch operation in the comment window and determine comment content according to the touch track in response to the touch operation in the comment window; an update strategy determination module, configured to determine an update strategy corresponding to the comment content according to the touch track or the comment content; an update module, configured to update the target document according to the update strategy and the comment content; wherein the update strategy determination module includes: an overlay content determination unit, a deletion content and deletion strategy determination unit; the overlay content determination unit is configured to determine corresponding overlay content in the target document according to the touch track; and the deletion content and deletion strategy determination unit is configured to determine the overlay content as the comment content and determine the update strategy as a deletion strategy in a case where the overlay content is not empty; the update strategy determination module is further configured to determine the update strategy as an insertion strategy in a case where the comment content is a preset comment type; wherein the preset comment type includes a word and a picture.

13. A computer-readable storage medium, characterized in that, The computer program stored in the computer readable storage medium, when executed by one or more processors, implements the method for updating a document based on comment content according to any one of claims 1 to 11.

14. An electronic device, comprising: The computer program stored in the computer readable storage medium, when executed by one or more processors, implements the method for updating a document based on comment content according to any one of claims 1 to 11.

15. A display device comprising: including: a display module, configured to display a comment window above a display window of a target document in response to a comment operation; wherein the target document can be displayed through the comment window; a comment content determination module, configured to display a touch track of a touch operation in the comment window and determine comment content according to the touch track in response to the touch operation in the comment window; an update strategy determination module, configured to determine an update strategy corresponding to the comment content according to the touch track or the comment content; an update module, configured to update the target document according to the update strategy and the comment content; wherein the update strategy determination module includes: an overlay content determination unit, a deletion content and deletion strategy determination unit; the overlay content determination unit is configured to determine corresponding overlay content in the target document according to the touch track; and the deletion content and deletion strategy determination unit is configured to determine the overlay content as the comment content and determine the update strategy as a deletion strategy in a case where the overlay content is not empty; the update strategy determination module is further configured to determine the update strategy as an insertion strategy in a case where the comment content is a preset comment type; wherein the preset comment type includes a word and a picture. The computer program stored in the computer readable storage medium, when executed by one or more processors, implements the method for updating a document based on comment content according to any one of claims 1 to 11. The computer program stored in the computer readable storage medium, when executed by one or more processors, implements the method for updating a document based on comment content according to any one of claims 1 to 11. The control unit is electrically connected with the display module and is configured to: in response to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window and determine annotation content according to the touch track; determine an update strategy corresponding to the annotation content according to the touch track or the annotation content; and update the target document according to the update strategy and the annotation content; wherein determining the update strategy corresponding to the annotation content according to the touch track comprises: determining corresponding cover content in the target document according to the touch track, in a case where the cover content is not empty, determining the cover content as the annotation content, and determining the update strategy as a deletion strategy; and determining the update strategy corresponding to the annotation content according to the annotation content comprises: in a case where the annotation content is a preset annotation type, determining the update strategy as an insertion strategy; wherein the preset annotation type includes text and pictures.

Images