Method and device for updating document based on annotation content and display device

Abstract

The invention relates to the field of computers, and discloses a method and device for updating a document based on annotation content and a display device. The method comprises the steps of displaying an annotation window above a display window of a target document in response to an annotation operation; wherein the target document can be displayed through the annotation window; in response to a touch operation in the annotation window, displaying a touch track of the touch operation in the annotation window, and determining annotation content according to the touch track; determining an update policy in response to a selection operation in the annotation window; or determining an updating strategy according to the touch track or the annotation content; and updating the target document according to the updating strategy and the annotation content. The transparent window is created above the document, handwriting input is performed on the transparent window, the handwriting input content is automatically recognized by using the handwriting recognition algorithm, and then the original document is updated at the determined updating position according to the recognized content, so that conference records are convenient to organize and display, and the conference efficiency is also improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, storage medium, electronic device and display device for updating a document based on annotation content. Background Art

[0002] The purpose of the background technology description provided here is to give an overall background of the present application. The statements in this section merely provide background related to the present application and do not necessarily constitute prior art.

[0003] Currently, during meetings, people often need to record discussion content, meeting minutes, etc. while explaining the meeting content. The meeting content to be explained is generally prepared in advance and recorded in office documents (for example, Office documents such as ppt, word, excel, etc.).

[0004] However, some existing recording methods are quite inconvenient when recording new content generated during the meeting. For example, traditional paper notebooks are cumbersome to use and inconvenient to organize later; existing electronic devices such as conference whiteboards can open office documents to input and modify content, and can also open handwriting software for handwritten records or demonstrations, but the handwritten content recorded during the meeting still needs to be entered into existing office documents after the meeting to generate meeting records or final plans, which brings great inconvenience to users. Summary of the invention

[0005] In response to the above problems, the present application proposes a method, device, storage medium, electronic device and display device for updating documents based on annotation content. The present application provides a more convenient and efficient way to record meetings. Users can directly input handwriting on a transparent window located on the upper layer of the document, and the handwritten notes are recognized as standard text in real time and automatically inserted into the corresponding position of the document. By recording the handwriting position information, it can be ensured that the handwriting input and the inserted text are completely corresponding in the document, thereby facilitating the organization and display of meeting minutes.

[0006] In a first aspect of the present application, a method for updating a document based on annotation content is provided, the method comprising:

[0007] In response to the annotation operation, an annotation window is displayed above the display window of the target document; wherein the target document can be displayed through the annotation window;

[0008] In response to a touch operation in the annotation window, displaying a touch track of the touch operation in the annotation window and determining annotation content according to the touch track;

[0009] Determining an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determining an update strategy corresponding to the annotation content according to the touch track or the annotation content;

[0010] The target document is updated according to the update strategy and the annotation content.

[0011] Furthermore, the annotation content includes annotation text and / or annotation pictures.

[0012] Further, updating the target document according to the update strategy and the annotation content includes:

[0013] Determining a target update position according to the touch track or the coordinates of the annotation content;

[0014] The target document is updated at the target update location according to the update policy and the annotation content.

[0015] Further, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0016] In the case where the update strategy is an insert strategy, an insert operation is performed according to the update strategy to add the annotation content to the target update position of the target document.

[0017] Further, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0018] In the case where the update policy is a deletion policy, a deletion operation is performed according to the update policy to delete the content at the target update position from the target document, or to set the content at the target update position to a preset deletion style.

[0019] Furthermore, the method for determining the content of the annotation includes:

[0020] Recognize the touch track by using a preset handwriting recognition model to determine the annotation content; or

[0021] The touch track is sent to a server, so that the server recognizes the touch track through a preset handwriting recognition model to determine and feed back the annotation content.

[0022] Further, determining an update strategy corresponding to the annotation content according to the annotation content includes:

[0023] When the annotation content is of a preset annotation type, the update strategy is determined to be an insert strategy.

[0024] Further, determining an update strategy corresponding to the annotation content according to the touch track includes:

[0025] Determining corresponding coverage content in the target document according to the touch track;

[0026] In a case where the overlay content is not empty, the overlay content is determined as the annotation content, and the update policy is determined as a deletion policy.

[0027] Furthermore, before adding the annotation content to the target update position of the target document, the method further includes:

[0028] In the case that the annotation content is an annotation text, the font of the annotation content is set to a preset font style.

[0029] Furthermore, the position and size of the display area of ​​the annotation window and the display area of ​​the presentation window remain the same.

[0030] Further, determining the target update position according to the coordinates of the annotation content includes:

[0031] Determine the target update position according to the coordinates of the first character in the annotation content; or

[0032] The target update position is determined according to the central coordinates of the annotation content.

[0033] Further, determining the target update position according to the touch track includes:

[0034] The initial position coordinates of the touch track are used as the target update position.

[0035] Furthermore, the target document is updated in the following manner:

[0036] When the annotation content changes, updating the target document; or,

[0037] In response to an update operation, the target document is updated according to the update policy and the annotation content.

[0038] A second aspect of the present application provides a device for updating a document based on annotation content, the device comprising:

[0039] A display module, configured to display an annotation window above the display window of the target document in response to the annotation operation; wherein the target document can be displayed through the annotation window;

[0040] An annotation content determination module, configured to respond to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window, and determine the annotation content according to the touch track;

[0041] An update strategy determination module, configured to determine an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content;

[0042] An updating module is used to update the target document according to the updating strategy and the annotation content.

[0043] According to a third aspect of the present application, a computer-readable storage medium is provided, wherein a computer program stored in the computer-readable storage medium can be executed by one or more processors to implement the steps of the method described above.

[0044] The fourth aspect of the present application provides an electronic device, including a memory and one or more processors, wherein the memory stores a computer program, the memory and the one or more processors are communicatively connected to each other, and when the computer program is executed by the one or more processors, the steps of the method described above are implemented.

[0045] A fifth aspect of the present application provides a display device, including:

[0046] The display module is configured to: display the target document through the display window of the target document, and, in response to the annotation operation, display an annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window;

[0047] A control unit is electrically connected to the display module and is configured to: in response to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window and determine the annotation content according to the touch track; in response to a selection operation in the annotation window, determine an update strategy corresponding to the annotation content; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content; and update the target document according to the update strategy and the annotation content.

[0048] Compared with the prior art, the advantages or beneficial effects of the technical solution of the present application include:

[0049] By creating a transparent window above the document, performing handwriting input on the transparent window, and using a handwriting recognition algorithm to automatically recognize the handwriting input content, and then updating the original document based on the recognized content at the determined update position, it not only facilitates the organization and display of meeting minutes, but also improves meeting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in the relevant field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0051] It should also be noted that, for the convenience of description, only the parts related to the present disclosure are shown in the drawings. The drawings constituting a part of the specification of this application are used to provide a further understanding of the present application. The illustrative embodiments and their descriptions in this application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0052] Figure 1 A flowchart of a method for updating a document based on annotation content provided in an embodiment of the present application;

[0053] Figure 2 A flowchart of another method for updating a document based on annotation content provided in an embodiment of the present application;

[0054] Figure 3 A schematic diagram of the structure of a device for updating an original file based on annotation content provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The following will describe the implementation methods of the present application in detail with reference to the accompanying drawings and embodiments, so that the implementation process of how the present application applies technical means to solve technical problems and achieve corresponding technical effects can be fully understood and implemented accordingly. The embodiments of the present application and the various features in the embodiments can be combined with each other without conflict, and the technical solutions formed are all within the protection scope of the present application.

[0056] It should be clear that the embodiments described below are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by technicians in the relevant field without making creative work are within the scope of protection of the present application.

[0057] According to the method provided by the present application, by creating a transparent window above the office document and inputting handwriting on the window, the handwriting input content is automatically recognized using a preset handwriting recognition model, and then the recognized content is automatically inserted into the corresponding position of the current office document. This not only greatly facilitates the arrangement and display of meeting minutes, but also improves work efficiency.

[0058] The present application provides a method for updating a document based on annotation content, which can be applied to or used in smart terminals. Smart terminals may include: mobile phones, tablet computers, electronic ink screens and conference tablets, etc., and can also be used in electronic whiteboards or other touch-screen devices.

[0059] Figure 1 A flowchart of a method for updating a document based on annotation content provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method for updating a document based on annotation content disclosed in the present application includes the following steps:

[0060] Step 110: In response to the annotation operation, an annotation window is displayed above the display window of the target document; wherein the target document can be displayed through the annotation window.

[0061] Optionally, the target document includes office documents such as office, ppt or wps.

[0062] Optionally, in order to prevent the annotation window from affecting the normal display of the target document or content in the display window, the annotation window can be set as a transparent window, or the annotation window can be set as a window with a certain transparency. When added above the display window of the target document, it will not affect the normal display of the target document in the display window.

[0063] For example, taking a smart terminal equipped with an Android system as an example, the annotation window can be a view control. The annotation window can be added to the display window or to the parent view of the display window. Among them, when the two are the same parent view, it is necessary to ensure that the annotation window is above the display window.

[0064] As an example, the position and size of the display area of ​​the annotation window and the display area of ​​the presentation window remain the same.

[0065] Furthermore, the position and size of the display area of ​​the annotation window and the display area of ​​the target document display window are always kept the same. Thus, the corresponding position of the target document in the display window can be updated more intuitively according to the annotation content of the user in the annotation window.

[0066] For example, when the annotation window is added to the display window, the starting position coordinates of the annotation window can be set to (0, 0), and the size of the annotation window (including length and width) remains the same as the display window; when the annotation window is added to the parent view of the display window, the starting position coordinates of the annotation window remain the same as the starting position coordinates of the display window, and the size of the annotation window remains the same as the size of the display window.

[0067] Step 120: In response to a touch operation in the annotation window, a touch track of the touch operation is displayed in the annotation window and annotation content is determined according to the touch track.

[0068] Optionally, the touch operation may be a handwriting operation directly generated in the annotation window by a finger or a stylus.

[0069] As an example, the method of determining the annotation content includes:

[0070] Recognize the touch track by using a preset handwriting recognition model to determine the annotation content; or

[0071] The touch track is sent to a server, so that the server recognizes the touch track through a preset handwriting recognition model to determine and feed back the annotation content.

[0072] It is understandable that the server is communicatively connected with the smart terminal, and a preset handwriting recognition model can be deployed on the server side or on the smart terminal. The preset handwriting recognition model is used to identify the touch trajectory to determine the annotation content.

[0073] Among them, the preset handwriting recognition model can be selected according to actual needs and is not specifically limited here.

[0074] As an example, the annotation content includes annotation text and / or annotation picture.

[0075] For example, the annotation text may be: the recognition result of the touch track by a preset handwriting recognition model, such as a piece of text recognized according to the touch track; the annotation picture may be: a picture generated according to the touch track or a picture generated according to the recognition result of the touch track.

[0076] Step 130: determining an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determining an update strategy corresponding to the annotation content according to the touch track or the annotation content.

[0077] Optionally, the update strategy includes an insert strategy and a delete strategy, wherein the insert strategy is used to insert the annotation content into the corresponding position of the original target document, and the delete strategy is used to delete the annotation content from the corresponding position of the original target document.

[0078] As an example, determining the update strategy corresponding to the annotation content in response to the selection operation in the annotation window includes:

[0079] The annotation window contains delete controls and insert controls. When you click the delete control, the update strategy is determined as the delete strategy, and the corresponding delete operation is performed according to the annotation content. When you click the insert control, the update strategy is determined as the insert strategy, and the corresponding insert operation is performed according to the annotation content; or, click the insert control or delete control in the page that pops up in the annotation window to determine the corresponding update strategy and perform the corresponding operation.

[0080] As another example, determining the update strategy corresponding to the annotation content according to the annotation content includes:

[0081] When the annotation content is of a preset annotation type, the update strategy is determined to be an insert strategy.

[0082] Among them, the preset annotation types may include text and pictures.

[0083] As another example, determining an update strategy corresponding to the annotation content according to the touch track includes:

[0084] Determining corresponding coverage content in the target document according to the touch track;

[0085] In a case where the overlay content is not empty, the overlay content is determined as the annotation content, and the update policy is determined as a deletion policy.

[0086] For example, when a horizontal line is drawn across a line of content in the target document in the annotation window, it means that the content of this line will be deleted. A feasible implementation method may be: determining the corresponding coordinate information according to the touch track in the annotation window, and converting it to the coordinates in the display window of the target document, and then determining the overlay content corresponding to the touch track in the current display page according to the coordinates in the display window of the target document, and using the overlay content as the annotation content; when the overlay content is not empty (that is, the content covered by the touch track can be determined in the target document according to the touch track), the update strategy is determined as the deletion strategy.

[0087] Step 140: Update the target document according to the update strategy and the annotation content.

[0088] As an example, updating the target document according to the update strategy and the annotation content includes:

[0089] Determining a target update position according to the touch track or the coordinates of the annotation content;

[0090] The target document is updated at the target update location according to the update policy and the annotation content.

[0091] As an example, determining the target update position according to the coordinates of the annotation content includes:

[0092] Determine the target update position according to the coordinates of the first character in the annotation content; or

[0093] The target update position is determined according to the central coordinates of the annotation content.

[0094] Optionally, after the annotation content is determined, the target update position may be determined according to the coordinates of the first character in the annotation content, or the target update position may be determined according to the center coordinates of the entire annotation content.

[0095] Furthermore, after the coordinates of the first character in the annotation content or the center coordinates of the entire annotation content are determined, the target update position is determined according to the horizontal coordinate and the vertical coordinate of the coordinate.

[0096] For example, when annotating a line of text in a multi-line text, when the annotation content is between two lines of text, the position of the target update position in the original target document can be determined based on the distance between the vertical coordinate and the adjacent upper and lower lines. For example, if the distance to the next line is less than the distance to the previous line, then the next line of the annotation content will be used as the line where the target update position is located; and then the exact position of the target update position in the line can be determined based on the horizontal coordinate.

[0097] As an example, determining the target update position according to the touch track includes:

[0098] The initial position coordinates of the touch track are used as the target update position.

[0099] Optionally, when the update strategy is a deletion strategy, the initial position coordinates of the touch track may be used as the target update position.

[0100] For example, when a line of text is deleted by drawing a horizontal line through the content of the line, the initial position coordinates of the touch track can be used as the target update position.

[0101] As an example, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0102] In the case where the update strategy is an insert strategy, an insert operation is performed according to the update strategy to add the annotation content to the target update position of the target document.

[0103] As an example, updating the target document at the target update location according to the update strategy and the annotation content includes:

[0104] In the case where the update policy is a deletion policy, a deletion operation is performed according to the update policy to delete the content at the target update position from the target document, or to set the content at the target update position to a preset deletion style.

[0105] Among them, the preset deletion style can be set according to actual needs, and no special restrictions are made here.

[0106] As an example, before adding the annotation content to the target update position of the target document, the method further includes:

[0107] In the case that the annotation content is an annotation text, the font of the annotation content is set to a preset font style.

[0108] Among them, the preset font style can be set according to actual needs, and no specific restrictions are made here.

[0109] As an example, the target document is updated in the following manner:

[0110] When the annotation content changes, updating the target document; or,

[0111] In response to an update operation, the target document is updated according to the update policy and the annotation content.

[0112] Optionally, the target document is updated once every time the annotation content changes; or, in response to an update operation, the target document is updated uniformly according to multiple annotation contents.

[0113] Further, in order to facilitate understanding of the technical solution of the present application, reference may also be made to Figure 2 .

[0114] The method for updating documents based on annotation content provided in the present application can be applied to or used in smart terminals, by creating a transparent window above the office document (wherein the transparent window can be added to the document display window, or the transparent window can be added to the parent view of the document display window), and performing handwriting input on the window, automatically recognizing the handwriting input content using a preset handwriting recognition model, and then automatically inserting the recognized content into the corresponding position of the current office document. Specifically, it includes the following steps: in response to the annotation operation, displaying the annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window; in response to the touch operation in the annotation window, displaying the touch track of the touch operation in the annotation window and determining the annotation content according to the touch track; in response to the selection operation in the annotation window, determining the update strategy corresponding to the annotation content; or determining the update strategy corresponding to the annotation content according to the touch track or the annotation content; updating the target document according to the update strategy and the annotation content. It not only greatly facilitates the arrangement and display of meeting records, but also improves work efficiency.

[0115] Below, taking the office software running in the conference tablet as an example, the method for updating the document based on the annotation content disclosed in this application is further explained and illustrated by way of example.

[0116] For example, suppose the office software does not have a handwriting input function, but the office software exposes an interface to the outside world. Therefore, you can use the interface or SDK (Software Development Kit, referred to as SDK) provided by the office software to perform certain operations on the current office software, such as:

[0117] (1) Obtain information such as the current display position and content of the office document currently being opened by the office software;

[0118] (2) According to the interface provided by the office software, external text or pictures can be inserted into the specified location of the office document.

[0119] An optional implementation method includes the following steps:

[0120] Step 1: Open the office document on the conference tablet through the office software and display it;

[0121] Step 2: When you need to make comments, open a transparent comment window and cover it above the display window of the current office document;

[0122] Step 3: Handwritten annotations and demonstrations are made on the document content. During the demonstration, the handwritten text can be automatically translated in real time through a handwriting recognition algorithm (for example, a preset handwriting recognition model) and then inserted into the corresponding position of the office document. Alternatively, the handwritten text can be manually operated and then inserted into the corresponding position of the office document in batches.

[0123] Step 4: The handwritten annotation notes record the track point information of the handwriting passing through the screen during the handwriting process, and then transcribe this information into standard text through the handwriting recognition algorithm. The handwriting recognition algorithm can be integrated into the annotation software or deployed to the cloud. Then the annotation software calls the transcription interface through the network interface to translate it into standard text;

[0124] Step 5: After the standard text is transcribed, each transcribed word corresponds to a position information according to the original handwriting position information. The position information may correspond to the upper left corner of the handwriting or the center point of all the handwritings that generate the text;

[0125] Step 6: Insert the transcribed text into the designated position of the office document through the interface provided by the office software in units of single words. The inserted text is displayed in a special format (distinguished by color, size, thickness, underline, etc.), which is convenient for users to modify when organizing documents;

[0126] Step 7. Users can further organize office documents according to actual needs, such as fonts, font colors, character spacing, and image layout.

[0127] It can be understood that in addition to inserting text into a document, it is also possible to generate a picture of the annotated handwriting content as a whole, and then insert the picture into the office document through the interface provided by the office software; it also supports users to select a part of the handwriting and recognize it as text through a preset handwriting recognition model and then insert it into a specified position in the office document.

[0128] It should be noted that corresponding annotation software can also be developed according to the method for updating documents based on annotation content disclosed in this application, and deployed in a conference tablet, and then the above steps can be implemented in the conference tablet through the annotation software.

[0129] In some possible situations, a corresponding functional module is developed according to the method for updating documents based on annotation content disclosed in this application, and deployed in office software, so that the method steps for updating documents based on annotation content can be implemented in a conference tablet through the office software.

[0130] The following is an example of the office software running on the conference tablet (the office display and editing functions as well as the office annotation function are integrated into it):

[0131] Among them, the office software's Office display and editing functions can be implemented within the software, or integrated with the SDK provided by a third-party Office. This software has Office display functions, editing functions, handwriting annotation functions, etc. The main part of the software is implemented by two layers of view windows. The bottom window is used to display Office documents and perform a series of operations such as document preview and editing; the upper window is used to implement the handwriting annotation function. The annotation window is displayed only when the user needs it (for example, the annotation window is displayed only when the user turns on the annotation function).

[0132] An optional implementation method includes the following steps:

[0133] Step 1: Open the Office document on the conference tablet through the office software and make a presentation;

[0134] Step 2: When you need to make comments, turn on the comment function, and then the Office software will open a transparent comment window and cover it above the display window of the current office document;

[0135] Step 3: Make handwritten annotations and demonstrations on the document content. During the demonstration, the handwritten text can be automatically translated in real time through the handwriting recognition algorithm and then inserted into the corresponding position of the office document. You can also manually operate and then insert the handwritten text into the corresponding position of the office document in batches;

[0136] Step 4: The handwritten annotation notes record the track point information of the handwriting passing through the screen during the handwriting process, and then transcribe this information into standard text through the handwriting recognition algorithm. The handwriting recognition algorithm can be integrated into the Office software or deployed to the cloud. Then the annotation software calls the transcription interface through the network interface to translate it into standard text;

[0137] Step 5: After the standard text is transcribed, each transcribed word corresponds to a position information according to the original handwriting position information. The position information may correspond to the upper left corner of the handwriting or the center point of all the handwritings that generate the text;

[0138] Step 6: Insert the transcribed text into the specified position of the office document in units of single words. The inserted text will be displayed in a special format (distinguished by color, size, thickness, underline, etc.), which is convenient for users to modify when organizing documents.

[0139] Step 7. Users can further organize office documents according to actual needs, such as fonts, font colors, character spacing, and image layout.

[0140] The present application also provides a device for updating a document based on the annotation content. The device embodiment can be used to execute the method embodiment of the present application. For details not disclosed in the device embodiment, please refer to the method embodiment of the present application. The device for updating a document based on the annotation content disclosed in the present application includes:

[0141] A display module, configured to display an annotation window above the display window of the target document in response to the annotation operation; wherein the target document can be displayed through the annotation window;

[0142] An annotation content determination module, configured to respond to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window, and determine the annotation content according to the touch track;

[0143] An update strategy determination module, configured to determine an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content;

[0144] An updating module is used to update the target document according to the updating strategy and the annotation content.

[0145] In some embodiments, the annotation content includes annotation text and / or annotation pictures.

[0146] In some embodiments, updating the target document according to the update strategy and the annotation content includes:

[0147] Determining a target update position according to the touch track or the coordinates of the annotation content;

[0148] The target document is updated at the target update location according to the update policy and the annotation content.

[0149] In some embodiments, the update module is used to perform an insert operation according to the update strategy when the update strategy is an insert strategy, so as to add the annotation content to the target update position of the target document.

[0150] In some embodiments, the update module is used to perform a deletion operation according to the update strategy when the update strategy is a deletion strategy, so as to delete the content at the target update position from the target document, or set the content at the target update position to a preset deletion style.

[0151] In some embodiments, the method for determining the annotation content includes:

[0152] Recognize the touch track by using a preset handwriting recognition model to determine the annotation content; or

[0153] The touch track is sent to a server, so that the server recognizes the touch track through a preset handwriting recognition model to determine and feed back the annotation content.

[0154] In some embodiments, the update strategy determination module is used to determine the update strategy as an insert strategy when the annotation content is of a preset annotation type.

[0155] In some embodiments, the determination module further includes: a coverage content determination unit, a deletion content and deletion strategy determination unit; wherein,

[0156] A coverage content determination unit, configured to determine corresponding coverage content in the target document according to the touch track;

[0157] The deletion content and deletion policy determining unit is used to determine the overlay content as the annotation content and determine the update policy as the deletion policy when the overlay content is not empty.

[0158] In some embodiments, it also includes: a font style setting module, which is used to set the font of the annotation content to a preset font style before adding the annotation content to the target update position of the target document, if the annotation content is an annotation copy.

[0159] In some embodiments, the position and size of the display area of ​​the annotation window and the display area of ​​the presentation window remain the same.

[0160] In some embodiments, determining the target update position according to the coordinates of the annotation content includes:

[0161] Determine the target update position according to the coordinates of the first character in the annotation content; or

[0162] The target update position is determined according to the central coordinates of the annotation content.

[0163] In some embodiments, determining the target update position according to the touch track includes:

[0164] The initial position coordinates of the touch track are used as the target update position.

[0165] In some embodiments, the target document is updated by:

[0166] When the annotation content changes, updating the target document; or,

[0167] In response to an update operation, the target document is updated according to the update policy and the annotation content.

[0168] Please refer to Figure 3 In some possible situations, the device for updating a document based on annotation content may also be configured with the following structure:

[0169] The processing module is used to control the overall operation, display the handwriting recognition results in Office documents, and store the annotation results;

[0170] Storage module, used to store information such as office documents, handwriting recognition algorithms, and target update locations;

[0171] A display module, used to display office documents and handwritten notes, including: a transparent annotation window, used to cover the top of the document display window to accept handwriting input; an Office document display window, used to display Office documents;

[0172] A handwriting recognition module is used to recognize handwritten notes on the annotation window;

[0173] Office processing module: used for processing Office documents, including opening Office documents and calling external exposed interfaces;

[0174] The interface module is an interface exposed to external modules and is used to insert the recognized standard text and position information into the corresponding update position of the document.

[0175] It should be understood by those skilled in the art that the above modules or steps of the present application can be implemented by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices. Optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation.

[0176] Technical personnel in the relevant field can clearly understand that, for the convenience and brevity of description, the specific working process of each module in the device for updating documents based on annotation content can refer to the corresponding process in the aforementioned method for updating documents based on annotation content, and will not be repeated here.

[0177] The present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, which, when executed by a processor, can implement all or part of the steps of the method for updating a document based on annotation content as described above, and will not be repeated here.

[0178] Among them, the computer-readable storage medium may also include computer programs, data files, data structures, etc. alone, or include a combination thereof. The computer-readable storage medium or computer program may be specifically designed and understood by a technician in the field of computer software, or the computer-readable storage medium may be known and available to a technician in the field of computer software. Examples of computer-readable storage media include: magnetic media, such as hard disks, floppy disks, and tapes; optical media, such as CDROM disks and DVDs; magneto-optical media, such as optical disks; and hardware devices, specifically configured to store and execute computer programs, such as read-only memory (ROM), random access memory (RAM), flash memory; or servers, app application stores, etc. Examples of computer programs include machine code (e.g., code generated by a compiler) and files containing high-level code, which can be executed by a computer using an interpreter. The described hardware device may be configured to be used as one or more software modules to perform the operations and methods described above, and vice versa. In addition, the computer-readable storage medium may be distributed in a networked computer system, and program code or computer programs may be stored and executed in a decentralized manner.

[0179] The present application also provides a computer program product. The computer program product includes a computer program or instructions, and when the computer program or instructions are executed by a processor, all or part of the steps of the method for updating a document based on annotation content are implemented, which will not be repeated here.

[0180] Further, the computer program product may include one or more computer executable components configured to perform the embodiments when the program is run; the computer program product may also include a computer program tangibly contained on a readable medium, the computer program including program code for performing any method in the embodiments of the present disclosure. In such an embodiment, the computer program may be downloaded and installed from a network through a communication portion, and / or installed from a removable medium.

[0181] The present application also provides an electronic device, which may include: one or more processors, a memory, a multimedia component, an input / output (I / O) interface, and a communication component.

[0182] One or more processors are used to execute all or part of the steps of the method for updating a document based on annotation content as described above. The memory is used to store various types of data, which may include instructions of any application or method in the electronic device, and data related to the application.

[0183] One or more processors may be an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components, and are used to execute the method in the aforementioned method embodiment.

[0184] The memory can be implemented by any type of volatile or non-volatile storage device or a combination of them, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0185] The multimedia component may include a screen and an audio component, the screen may be a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone, and the microphone is used to receive external audio signals. The received audio signal may be further stored in a memory or sent via a communication component. The audio component also includes at least one speaker for outputting audio signals.

[0186] The I / O interface provides an interface between one or more processors and other interface modules, which may be a keyboard, a mouse, buttons, etc. These buttons may be virtual buttons or physical buttons.

[0187] The communication component is used for wired or wireless communication between the electronic device and other devices. Wired communication includes communication through network ports, serial ports, etc.; wireless communication includes: Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, 5G, or one or a combination of them.

[0188] The present application also provides a display device, which may include:

[0189] The display module is configured to: display the target document through the display window of the target document, and, in response to the annotation operation, display an annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window;

[0190] A control unit is electrically connected to the display module and is configured to: in response to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window and determine the annotation content according to the touch track; in response to a selection operation in the annotation window, determine an update strategy corresponding to the annotation content; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content; and update the target document according to the update strategy and the annotation content.

[0191] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of each unit / module in the display device can refer to the corresponding process in the aforementioned method steps, and will not be repeated here.

[0192] In addition, it should be understood that the method or device disclosed in the embodiments provided in the present application can also be implemented in other ways. The method or device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the methods and devices according to the multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a computer program segment or a part of a computer program, and the module, computer program segment or a part of a computer program contains one or more computer programs for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings, and can actually be executed in parallel. They can also be executed in the opposite order sometimes, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of dedicated hardware and computer programs.

[0193] In this application, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements that are inherent to such process, method, article, or apparatus. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, device or equipment including the elements; if there is a description of "first", "second", etc., it is only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features; in the description of this application, unless otherwise specified, the terms "multiple" and "multiple" mean at least two; if there is a description of a server, it should be noted that the server can be an independent physical server or terminal, or a server cluster composed of multiple physical servers, or a cloud server that can provide basic cloud computing services such as cloud servers, cloud databases, cloud storage and CDN; if there is a description of a smart terminal or mobile device in this application, it should be noted that the smart terminal or mobile device can be a mobile phone, a tablet computer, a smart watch, a netbook, a wearable electronic device, a personal digital assistant (PDA), an augmented reality technology device (AR), a virtual reality device (VR), a smart TV, a smart speaker, a personal computer (PC), a tablet computer, a smart phone, a smart TV, a smart speaker, a smart phone ... Computer, referred to as PC), etc., but not limited to this, the present application does not specifically limit the specific form of the smart terminal or mobile device.

[0194] Finally, it should be noted that, in the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "an example" or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0195] Although the embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary, and the contents described are only embodiments adopted for the convenience of understanding the present application, and are not intended to limit the present application. Any technician in the technical field to which the present application belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed in the present application, but the scope of protection of the present application shall still be based on the scope defined in the attached claims.

Claims

1. A method for updating a document based on annotation content, characterized in that: The method comprises: In response to the annotation operation, an annotation window is displayed above the display window of the target document; wherein the target document can be displayed through the annotation window; In response to a touch operation in the annotation window, displaying a touch track of the touch operation in the annotation window and determining annotation content according to the touch track; Determining an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determining an update strategy corresponding to the annotation content according to the touch track or the annotation content; The target document is updated according to the update strategy and the annotation content.

2. The method for updating a document based on annotation content according to claim 1, characterized in that: The annotation content includes annotation text and / or annotation picture.

3. The method for updating a document based on annotation content according to claim 1, characterized in that: The updating of the target document according to the update strategy and the annotation content includes: Determining a target update position according to the touch track or the coordinates of the annotation content; The target document is updated at the target update location according to the update policy and the annotation content.

4. The method for updating a document based on annotation content according to claim 3, characterized in that: The updating of the target document at the target update location according to the update strategy and the annotation content includes: In the case where the update strategy is an insert strategy, an insert operation is performed according to the update strategy to add the annotation content to the target update position of the target document.

5. The method for updating a document based on annotation content according to claim 3, characterized in that: The updating of the target document at the target update location according to the update strategy and the annotation content includes: In the case where the update policy is a deletion policy, a deletion operation is performed according to the update policy to delete the content at the target update position from the target document, or to set the content at the target update position to a preset deletion style.

6. The method for updating a document based on annotation content according to claim 1, characterized in that: Methods for determining the content of the annotation include: Recognize the touch track by using a preset handwriting recognition model to determine the annotation content; or The touch track is sent to a server, so that the server recognizes the touch track through a preset handwriting recognition model to determine and feed back the annotation content.

7. The method for updating a document based on annotation content according to claim 1, characterized in that: Determining an update strategy corresponding to the annotation content according to the annotation content includes: When the annotation content is of a preset annotation type, the update strategy is determined to be an insert strategy.

8. The method for updating a document based on annotation content according to claim 1, characterized in that: Determining an update strategy corresponding to the annotation content according to the touch track includes: Determining corresponding coverage content in the target document according to the touch track; In a case where the overlay content is not empty, the overlay content is determined as the annotation content, and the update policy is determined as a deletion policy.

9. The method for updating a document based on annotation content according to claim 4, characterized in that: Before adding the annotation content to the target update position of the target document, the method further includes: In the case that the annotation content is an annotation text, the font of the annotation content is set to a preset font style.

10. The method for updating a document based on annotation content according to claim 1, characterized in that: The position and size of the display area of ​​the annotation window and the display area of ​​the presentation window remain the same.

11. The method for updating a document based on annotation content according to claim 3, characterized in that: Determining a target update position according to the coordinates of the annotation content includes: Determine the target update position according to the coordinates of the first character in the annotation content; or The target update position is determined according to the central coordinates of the annotation content.

12. The method for updating a document based on annotation content according to claim 3, characterized in that: Determining a target update position according to the touch track includes: The initial position coordinates of the touch track are used as the target update position.

13. The method for updating a document based on annotation content according to claim 1, characterized in that: The target document is updated in a manner including: updating the target document when the annotation content changes; or, In response to an update operation, the target document is updated according to the update policy and the annotation content.

14. A device for updating a document based on annotation content, characterized in that: include: A display module, configured to display an annotation window above the display window of the target document in response to the annotation operation; wherein the target document can be displayed through the annotation window; An annotation content determination module, configured to respond to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window, and determine the annotation content according to the touch track; An update strategy determination module, configured to determine an update strategy corresponding to the annotation content in response to a selection operation in the annotation window; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content; An updating module is used to update the target document according to the updating strategy and the annotation content.

15. A computer-readable storage medium, characterized in that: The computer program stored in the computer-readable storage medium, when executed by one or more processors, implements the method for updating a document based on annotation content according to any one of claims 1 to 13.

16. An electronic device, characterized in that: The invention comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the method for updating a document based on annotation content as claimed in any one of claims 1 to 13 is implemented.

17. A display device, characterized in that: include: The display module is configured to: display the target document through the display window of the target document, and, in response to the annotation operation, display an annotation window above the display window of the target document; wherein the target document can be displayed through the annotation window; A control unit is electrically connected to the display module and is configured to: in response to a touch operation in the annotation window, display a touch track of the touch operation in the annotation window and determine the annotation content according to the touch track; in response to a selection operation in the annotation window, determine an update strategy corresponding to the annotation content; or determine an update strategy corresponding to the annotation content according to the touch track or the annotation content; and update the target document according to the update strategy and the annotation content.

Images