Modification document generation method and device, computer storage medium and electronic equipment

By generating a list of images to be marked and annotated, including notes and reference images, the precise annotation and batch modification of images in art projects is realized, the modification efficiency and communication effect are improved, and the shortcomings of image annotation and document generation in the prior art are solved. .

CN119005123APending Publication Date: 2024-11-22NETEASE (SHANGHAI) NETWORK CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410800283.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-20
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The prior art cannot realize accurate annotation and batch modification of images in art projects, and cannot generate modified documents, resulting in low modification efficiency and inconvenient communication.

Method used

By obtaining the image to be marked, generating a list of images to be marked, and generating an annotation group in response to the marking operation, including notes and reference images, thereby realizing batch annotation of images and modifying documents.

Benefits of technology

It improves the accuracy and efficiency of image modification, realizes batch labeling of multiple images and the generation of modified documents, and solves the problem of inconvenient operation and communication of single images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119005123A_ABST
    Figure CN119005123A_ABST
Patent Text Reader

Abstract

The invention relates to a modified document generation method and device, a computer storage medium and electronic equipment, and relates to the technical field of computers.The method comprises the steps that to-be-labeled images are obtained, a to-be-labeled image list is generated, and a current to-be-labeled image in the to-be-labeled image list is determined; in response to a first marking operation on the current to-be-marked image, generating a first marking area, and according to the first marking area, generating a first marking group corresponding to the first marking area; wherein the annotation group comprises a remark for the marked area and a reference image corresponding to the marked area; responding to the switching of the current to-be-annotated image to complete the annotation of the current to-be-annotated image, and generating a modified document based on the annotated to-be-annotated image. According to the method and the device, the image annotation integrity and the image modification efficiency are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] With the development of technology, the demand for art projects has gradually increased. Art projects are often accompanied by the modification of an image or model.

[0003] In the related art, an image that needs to be modified is communicated through application software. One method is to simply draw the image that needs to be modified and communicate the drawn image in the application software; the other method is to make various annotations or real-time annotations in the image and overlay and display the annotated content in the application software.

[0004] In the first method, it is impossible to accurately annotate images, and each communication can only be conducted on a single image, so the content lacks integrity and the operation lacks convenience. In the second method, each annotation in each image is a unit, and each annotated artwork can only be saved as an image, and it is impossible to generate a modification document.

[0005] Therefore, it is necessary to provide a method for generating a modified document.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute prior art known to ordinary technicians in the field. Summary of the invention

[0007] The present disclosure provides a modified document generation method, a modified document generation device, a computer-readable storage medium and an electronic device, thereby overcoming at least to a certain extent the problem of being unable to generate a modified document based on annotated images and low efficiency in modifying art projects due to limitations and defects of related technologies.

[0008] According to one aspect of the present disclosure, a method for generating a modified document is provided, comprising:

[0009] Acquire an image to be annotated, generate a list of images to be annotated, and determine a current image to be annotated in the list of images to be annotated;

[0010] In response to a first marking operation on the current image to be marked, a first marking area is generated, and based on the first marking area, a first marking group corresponding to the first marking area is generated; wherein the marking group includes a remark on the marking area and a reference image corresponding to the marking area;

[0011] In response to the switching of the current image to be annotated, the annotation of the current image to be annotated is completed, and a modified document is generated based on the annotated image to be annotated.

[0012] In an exemplary embodiment of the present disclosure, the step of generating a first marked area in response to a first marking operation on the current image to be marked includes:

[0013] In response to a labeling triggering operation on the current image to be labeled, receiving a first marking operation on the current image to be labeled;

[0014] According to the first marking operation, the first marking area is generated.

[0015] In an exemplary embodiment of the present disclosure, generating a first annotation group corresponding to the first marked area according to the first marked area includes:

[0016] In response to completion of the first marking operation, generating a first annotation component;

[0017] Based on the first annotation component, a remark to the first marked area and a reference image corresponding to the first marked area are added, and based on the first marked area, the remark to the first marked area and the reference image, a first annotation group corresponding to the first marked area is generated.

[0018] In an exemplary embodiment of the present disclosure, after generating the first annotation group corresponding to the first marked area, the modified document generation method further includes:

[0019] Adding the first annotation group to an annotation list, wherein the sequence number of the first annotation group in the annotation list is the same as the sequence number of the first annotation group in the image to be annotated;

[0020] Displaying the marked mark in the current image to be marked.

[0021] In an exemplary embodiment of the present disclosure, the method further includes:

[0022] In response to a request to delete the annotation group in the annotation list, the annotation group and a marked area in the image to be annotated corresponding to the annotation group are deleted.

[0023] In an exemplary embodiment of the present disclosure, after generating the annotation component, the modified document generation method further includes:

[0024] In response to a closing operation on the annotation component, a marking area corresponding to the annotation component is cancelled.

[0025] In an exemplary embodiment of the present disclosure, after generating the first marking area, the modified document generation method further includes:

[0026] The first marking area is hidden, and a second marking area is generated in response to a second marking operation on the current image to be marked.

[0027] In an exemplary embodiment of the present disclosure, the step of generating a modified document based on the annotated image to be annotated includes:

[0028] The modified document is generated based on the image to be annotated and the annotation list.

[0029] According to one aspect of the present disclosure, there is provided a modified document generating device, comprising:

[0030] The module for determining images to be annotated is used to obtain images to be annotated, generate a list of images to be annotated, and determine the current image to be annotated in the list of images to be annotated;

[0031] A marking group generating module, configured to generate a first marking area in response to a first marking operation on the current image to be marked, and to generate a first marking group corresponding to the first marking area according to the first marking area; wherein the marking group includes a remark on the marking area and a reference image corresponding to the marking area;

[0032] The modified document generation module is used to respond to the switching of the current image to be annotated to complete the annotation of the current image to be annotated, and generate a modified document based on the annotated image to be annotated.

[0033] According to one aspect of the present disclosure, a computer storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for generating a modified document described in any one of the above exemplary embodiments is implemented.

[0034] According to one aspect of the present disclosure, a computer program product is provided, including a computer program, characterized in that when the computer program is executed by a processor, the modified document generation method described in any of the above exemplary embodiments is implemented.

[0035] According to one aspect of the present disclosure, there is provided an electronic device, including:

[0036] Processor; and

[0037] A memory, configured to store executable instructions of the processor;

[0038] The processor is configured to execute the modified document generation method described in any of the above exemplary embodiments by executing the executable instructions.

[0039] According to one aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the method for generating a modified document described in any one of the above exemplary embodiments is implemented.

[0040] A modified document generation method provided by an embodiment of the present disclosure comprises the following steps: obtaining an image to be annotated, generating a list of images to be annotated, and determining a current image to be annotated in the list of images to be annotated; generating a first marking area in response to a first marking operation on the current image to be annotated, and generating a first marking group corresponding to the first marking area based on the first marking area; wherein the marking group includes remarks on the marked area and a reference image corresponding to the marked area; responding to switching of the current image to be annotated to complete the marking of the current image to be annotated, and generating a modified document based on the annotated image to be annotated. On the one hand, a list of images to be annotated is generated according to the images to be annotated, and the current image to be annotated in the list of images to be annotated is determined. When the annotation of the current image to be annotated is completed, the current image to be annotated is switched to complete the annotation of other images to be annotated in the list of images to be annotated, thereby realizing batch annotation of the images to be annotated, and solving the problem that only a single image can be annotated and communicated in the related art. On the other hand, in response to a first marking operation on the current image to be annotated, a first marking area is generated, and a first marking group corresponding to the first marking area is generated according to the first marking area, wherein the first marking group includes remarks on the marked area and a reference image corresponding to the marked area, and the reference image is used to improve the modification efficiency of the image to be annotated, improve the integrity of the annotation, and solve the problem that accurate annotation cannot be achieved in the related art. On the other hand, when the annotation of the images to be annotated in the list of images to be annotated is completed, a corresponding modification document is generated, and the modification document is used to improve the communication efficiency when modifying the images to be annotated.

[0041] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present invention, and together with the specification are used to explain the principles of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0043] Figure 1 The following schematically shows a flowchart of a method for generating a modified document according to an exemplary embodiment of the present disclosure.

[0044] Figure 2A flowchart of a method for generating a first marked area in response to a first marking operation on the current image to be marked according to an exemplary embodiment of the present disclosure is schematically shown.

[0045] Figure 3 A flowchart of a method for generating a first annotation group corresponding to the first marked area according to the first marked area is schematically shown according to an exemplary embodiment of the present disclosure.

[0046] Figure 4 A schematic diagram of generating a first annotation group according to an exemplary embodiment of the present disclosure is schematically shown.

[0047] Figure 5 A schematic diagram of modifying a labeling component according to an exemplary embodiment of the present disclosure is schematically shown.

[0048] Figure 6 A flowchart of modifying a document generation method after generating a first annotation group corresponding to the first marked area according to an exemplary embodiment of the present disclosure is schematically shown.

[0049] Figure 7 A schematic diagram schematically illustrates a method of adding a annotation group to an annotation list according to an exemplary embodiment of the present disclosure.

[0050] Figure 8 A schematic diagram schematically illustrates a label list according to an exemplary embodiment of the present disclosure.

[0051] Fig. 9 A block diagram schematically illustrates a modified document generating apparatus according to an exemplary embodiment of the present disclosure.

[0052] Fig.10 An electronic device for implementing a modification document generation method according to an exemplary embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0053] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present invention will be more comprehensive and complete, and the concept of the example embodiments will be fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present invention.

[0054] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0055] This example implementation first provides a method for generating a modified document. Figure 1 As shown, the modification document generation method may include the following steps:

[0056] Step S110: Acquire an image to be annotated, generate a list of images to be annotated, and determine the current image to be annotated in the list of images to be annotated;

[0057] Step S120. In response to a first marking operation on the current image to be marked, a first marking area is generated, and based on the first marking area, a first marking group corresponding to the first marking area is generated; wherein the marking group includes a note on the marking area and a reference image corresponding to the marking area;

[0058] Step S130: responding to the switching of the current image to be annotated to complete the annotation of the current image to be annotated, and generating a modified document based on the annotated image to be annotated.

[0059] The modified document generation method obtains an image to be annotated, generates a list of images to be annotated, and determines a current image to be annotated in the list of images to be annotated; generates a first marking area in response to a first marking operation on the current image to be annotated, and generates a first marking group corresponding to the first marking area based on the first marking area; wherein the marking group includes remarks on the marking area and a reference image corresponding to the marking area; responds to switching of the current image to be annotated to complete the marking of the current image to be annotated, and generates a modified document based on the annotated image to be annotated. On the one hand, a list of images to be annotated is generated according to the images to be annotated, and the current image to be annotated in the list of images to be annotated is determined. When the annotation of the current image to be annotated is completed, the current image to be annotated is switched to complete the annotation of other images to be annotated in the list of images to be annotated, thereby realizing batch annotation of the images to be annotated, and solving the problem that only a single image can be annotated and communicated in the related art. On the other hand, in response to a first marking operation on the current image to be annotated, a first marking area is generated, and a first marking group corresponding to the first marking area is generated according to the first marking area, wherein the first marking group includes remarks on the marked area and a reference image corresponding to the marked area, and the reference image is used to improve the modification efficiency of the image to be annotated, improve the integrity of the annotation, and solve the problem that accurate annotation cannot be achieved in the related art. On the other hand, when the annotation of the images to be annotated in the list of images to be annotated is completed, a corresponding modification document is generated, and the modification document is used to improve the communication efficiency when modifying the images to be annotated.

[0060] Hereinafter, each step involved in the modification document generation method according to the exemplary embodiment of the present disclosure is explained and illustrated in detail.

[0061] In step S110, an image to be annotated is acquired, a list of images to be annotated is generated, and a current image to be annotated in the list of images to be annotated is determined.

[0062] Among them, the image to be annotated is an image that needs to be modified in an art project. The art project can be an image-based art project or a model-based art project, which is not specifically limited in this example embodiment. When the art project is a model-based art project, the model that needs to be modified in the art project can be converted into an image. After obtaining the image to be annotated, the obtained image to be annotated can be stored in a list to generate a list of images to be annotated. The images in the list of images to be annotated are all the images that need to be annotated in the art project. The list of images to be annotated can be displayed, and the annotator can slide the currently displayed image to be annotated left and right to switch the displayed image to be annotated; or the image to be annotated can be clicked and selected in the list of images to be annotated, which is not specifically limited in this example embodiment. After the displayed image to be annotated is determined, the displayed image to be annotated is the current image to be annotated, and the annotator can perform operations such as zooming in, zooming in, and moving on the current image to be annotated. In this example embodiment, the operation methods of zooming in, zooming in, and moving are not specifically limited.

[0063] In step S120, in response to a first marking operation on the current image to be marked, a first marking area is generated, and based on the first marking area, a first marking group corresponding to the first marking area is generated; wherein the marking group includes remarks on the marked area and a reference image corresponding to the marked area.

[0064] After determining the current image to be annotated, the annotator can annotate the image to be annotated. The annotation of the image to be annotated includes marking the places that need to be modified in the image to be annotated. The marking operation for marking the image to be annotated can be to smear the places that need to be modified to generate a marked area. After marking the places that need to be modified, the marked places can also be annotated. The annotation can be a text annotation, an image annotation, or a text annotation and an image annotation. This is not specifically limited in this example embodiment.

[0065] refer to Figure 2 As shown, in response to a first marking operation on the current image to be marked, generating a first marking area may include:

[0066] Step S210. In response to a labeling triggering operation on the current image to be labeled, receiving a first labeling operation on the current image to be labeled;

[0067] Step S220: Generate the first marking area according to the first marking operation.

[0068] In the following, step S210 and step S220 will be further explained and illustrated. Specifically, respond to the annotation trigger operation of the annotator on the current image to be annotated, wherein the annotation trigger operation can be the annotator clicking the current image to be annotated, or can be long pressing the current image to be annotated, etc., which is not specifically limited in this example embodiment. After responding to the annotation trigger operation, respond to the first marking operation of the annotator on the current image to be annotated, wherein the first marking operation can be a smear operation on the image to be annotated, and the smear operation is a process from touching the screen to leaving the screen. After the first marking operation is performed on the image to be annotated, a first marking area is generated based on the position where the first marking operation has been applied, and the first marking area can be displayed differently. For example, the color of the first marking area can be set to a transparent color, or the color of the first marking area can be set to red. This is not specifically limited in this example embodiment. When there are multiple marking areas in the current image to be annotated, the color of each marking area can be set to a different color.

[0069] For further reference, Figure 3 As shown, generating a first annotation group corresponding to the first marked area according to the first marked area may include:

[0070] Step S310. In response to the completion of the first marking operation, generate a first annotation component;

[0071] Step S320. Based on the first annotation component, add comments to the first marked area and a reference image corresponding to the first marked area, and generate a first annotation group corresponding to the first marked area based on the first marked area, the comments to the first marked area and the reference image.

[0072] In the following, step S310 and step S320 will be further explained and illustrated. Specifically, in response to the completion of the first marking operation, the first marking operation is that the operating medium of the labeler leaves the screen. When the first marking operation is completed, a first labeling component is generated, and the first labeling component can be directly displayed, wherein the first labeling component can be set as a pop-up layer. That is, after the first marking area is generated, the first labeling component pops up, and remarks on the first marking area and a reference image corresponding to the first marking area are added to the first labeling component. When the addition is completed, a first labeling group is generated based on the first marking area, remarks and reference image. When the filling is completed, click the confirmation button in the first labeling component, and the pop-up layer of the first labeling component will automatically collapse.

[0073] Below, through Figure 4 The above-mentioned generation of the first annotation group is further explained and illustrated. Figure 4A is the current image to be annotated. The annotator marks the current image to be annotated through the first marking operation. Figure 4 When the marking of the first marked area 401 in B is completed, a first annotation component 402 corresponding to the first marked area is popped up, such as Figure 4 C. In the first annotation component, you can fill in the remarks for the first marked area and upload a reference image. After completing the filling of the first annotation component, click the confirmation button to collapse the first annotation component.

[0074] In this example embodiment, after the first annotation component is generated, the modified document generation method further includes:

[0075] In response to a closing operation on the annotation component, a marking area corresponding to the annotation component is cancelled.

[0076] Specifically, when the annotation of the image to be annotated is completed and a marking component corresponding to the marked area is generated, after clicking to close the marking component, the annotation of the marked area is considered incomplete and the marked area is not recorded, that is, the marked area corresponding to the marking component is cancelled.

[0077] After completing the annotation component, you can also modify the annotation component. Figure 5 If you need to modify, click Figure 5 In the marked area of ​​A, you can preview the entered comments, thumbnails of the reference images, and the number of reference images included, such as Figure 5 As shown in 501 in B, at this time, the display of the notes and reference images is displayed in the form of a group, and the group can be moved and edited. When moving the group, click the move group, and a move icon will appear at the fixed position of the group, such as Figure 5 As shown in 502 in C, the group is moved by moving the move icon; when editing the group, click Edit Annotation, and a first annotation component corresponding to the first marking area pops up, such as Figure 5 As shown in D, in the first annotation component, the remarks and reference images are edited, and after the editing is completed, click Save to update the first annotation group. When other areas outside the group in the image to be annotated are clicked, the group is exited.

[0078] In this example embodiment, reference Figure 6 As shown, after generating the first annotation group corresponding to the first marked area, the modified document generation method may further include:

[0079] Step S610. Add the first annotation group to an annotation list, wherein the sequence number of the first annotation group in the annotation list is the same as the sequence number of the first annotation group in the image to be annotated;

[0080] Step S620: Display the marked mark in the current image to be marked.

[0081] In the following, step S610 and step S620 will be further explained and illustrated. Specifically, after the first annotation group is generated, the first annotation group can be added to the annotation list. The annotation list may include multiple annotation groups, and the current image to be annotated may include multiple marking areas, and there are correspondingly multiple annotation groups, and the sequence number of each annotation group in the annotation list is the same as the label number of the annotation group in the image to be annotated. In addition, after the annotation group corresponding to the marking area is generated, the annotated mark can also be displayed in the current image to be annotated in the list of images to be annotated. Among them, the images to be annotated in the list of images to be annotated can be presented in the form of thumbnails.

[0082] refer to Figure 7 As shown, after the first annotation group is generated in the current image to be annotated, the first annotation group is added to the annotation list. After being added to the annotation list, the number of annotation groups included in the annotation list is modified, and the annotation list is shown in 701. In addition, a marked mark can also be added to the thumbnail of the current image to be annotated, and the marked mark is shown in 702.

[0083] After the annotation group corresponding to the marked area is added to the annotation list, when modifying the image, the editor can see the modification annotations of all the images to be annotated in the image list to avoid missing modifications.

[0084] In this example embodiment, the modification document generation method may further include:

[0085] In response to a request to delete the annotation group in the annotation list, the annotation group and a marked area in the image to be annotated corresponding to the annotation group are deleted.

[0086] Specifically, a marking group can be deleted in the marking list. In response to a deletion request for any marking group in the marking list, the corresponding marking group is deleted in the marking list according to the deletion request, and after the marking group is deleted in the marking list, the marked area corresponding to the deleted marking group can be deleted in the image to be marked.

[0087] Below, reference Figure 8 Further explanation and description of the annotation list. Click the annotation list to expand the annotation preview, such as Figure 8 As shown in A, the serial number of the annotation group in the annotation list is the same as the number of the marked area corresponding to the annotation group. Each annotation includes the marked area, the notes corresponding to the marked area, the reference image, and the deleted annotation. Click the drop-down menu of the reference image to expand the corresponding reference image, as shown in Figure 8As shown in B; click on the image to be annotated to expand the large image and zoom in and out; click on a single reference image to expand the large image and zoom in and out, and swipe left and right to switch the reference image in the annotation; click on Delete Annotation to delete the annotation and update the serial numbers of other annotation groups in the annotation list. When the annotation is deleted, the corresponding marked area in the image to be annotated will also be deleted, and the serial number of the marked area in the image to be annotated will be updated.

[0088] In this example embodiment, after the first marking area is generated, the modified document generation method may further include:

[0089] The first marking area is hidden, and a second marking area is generated in response to a second marking operation on the current image to be marked.

[0090] Specifically, the current image to be annotated is marked multiple times. When marking again, the displayed first marking area can be hidden. After hiding the first marking area, in response to a second marking operation on the current image to be annotated, a second marking area is generated according to the second marking operation, wherein the display color of the second marking area is different from the display color of the first marking area.

[0091] In this example embodiment, when the current image to be annotated needs to be marked again, the marked area already displayed in the current image to be annotated is hidden, thereby avoiding the influence of color block overlap on the re-marking and ensuring accurate marking of the image to be annotated.

[0092] In step S130, in response to the switching of the current image to be annotated to complete the annotation of the current image to be annotated, a modified document is generated based on the annotated image to be annotated.

[0093] After the annotation of the current image to be annotated is completed, the current image to be annotated can be updated. Specifically, the current image to be annotated can be switched in the images to be annotated. Specifically, after clicking the corresponding image to be annotated in the list of images to be annotated, the image to be annotated can be determined as the current image to be annotated. After switching the current image to be annotated, the current image to be annotated can be annotated according to the above annotation process to complete the annotation of all images to be annotated in the list of images to be annotated, thereby realizing batch annotation.

[0094] After all the images to be annotated in the list of images to be annotated are annotated, a corresponding modification document may be generated. The generation of the modification document based on the annotated images to be annotated includes:

[0095] The modified document is generated based on the image to be annotated and the annotation list.

[0096] Specifically, after all the images to be annotated are annotated, a modification document can be generated based on all the images to be annotated and the annotation list in the annotated list, and a document link of the modification document is generated and sent to the modification personnel. After the modification personnel receive the document link, they open the modification document according to the document link, click the modification list in the modification document, and they can see all the annotation groups, the notes in each annotation group, and the reference images, and modify the images to be annotated according to each annotation group in the annotation list.

[0097] This example embodiment realizes the generation of a modification document based on the image to be annotated, solves the problem in the related art that each communication can only be conducted on a single image, the content lacks integrity, and the operation lacks convenience, thereby improving the modification efficiency of the editor.

[0098] The modification document generation method provided by the exemplary embodiment of the present disclosure has at least the following advantages: on the one hand, a list of images to be annotated is generated according to the images to be annotated, and the current image to be annotated in the list of images to be annotated is determined. When the annotation of the current image to be annotated is completed, the current image to be annotated is switched to complete the annotation of other images to be annotated in the list of images to be annotated, thereby realizing batch annotation of the images to be annotated, and solving the problem that only a single image can be annotated and communicated in the related art; on the other hand, in response to a first marking operation on the current image to be annotated, a first marking area is generated, and a first marking group corresponding to the first marking area is generated according to the first marking area, wherein the first marking group includes remarks on the marked area and a reference image corresponding to the marked area, and the reference image is used to improve the modification efficiency of the image to be annotated, improve the integrity of the annotation, and solve the problem that accurate annotation cannot be achieved in the related art; on the other hand, when the annotation of the images to be annotated in the list of images to be annotated is completed, a corresponding modification document is generated, and the modification document is used to improve the communication efficiency when modifying the images to be annotated.

[0099] The exemplary embodiment of the present disclosure also provides a modified document generation device, referring to Fig. 9 As shown, it may include: a module 910 for determining images to be annotated, a module 920 for generating an annotation group, and a module 930 for generating modified documents.

[0100] The to-be-annotated image determination module 910 is used to obtain the to-be-annotated image, generate a to-be-annotated image list, and determine the current to-be-annotated image in the to-be-annotated image list;

[0101] The annotation group generating module 920 is used to generate a first marking area in response to the first marking operation on the current image to be annotated, and generate a first annotation group corresponding to the first marking area according to the first marking area; wherein the annotation group includes a remark on the marked area and a reference image corresponding to the marked area;

[0102] The modified document generating module 930 is used to respond to the switching of the current image to be annotated to complete the annotation of the current image to be annotated, and generate a modified document based on the annotated image to be annotated.

[0103] The specific details of each module in the above-mentioned modified document generation device have been described in detail in the corresponding modified document generation method, so they will not be repeated here.

[0104] In an exemplary embodiment of the present disclosure, the step of generating a first marked area in response to a first marking operation on the current image to be marked includes:

[0105] In response to a labeling triggering operation on the current image to be labeled, receiving a first marking operation on the current image to be labeled;

[0106] According to the first marking operation, the first marking area is generated.

[0107] In an exemplary embodiment of the present disclosure, generating a first annotation group corresponding to the first marked area according to the first marked area includes:

[0108] In response to completion of the first marking operation, generating a first annotation component;

[0109] Based on the first annotation component, a remark to the first marked area and a reference image corresponding to the first marked area are added, and based on the first marked area, the remark to the first marked area and the reference image, a first annotation group corresponding to the first marked area is generated.

[0110] In an exemplary embodiment of the present disclosure, after generating the first annotation group corresponding to the first marked area, the modified document generation method further includes:

[0111] Adding the first annotation group to an annotation list, wherein the sequence number of the first annotation group in the annotation list is the same as the sequence number of the first annotation group in the image to be annotated;

[0112] Displaying the marked mark in the current image to be marked.

[0113] In an exemplary embodiment of the present disclosure, the method further includes:

[0114] In response to a request to delete the annotation group in the annotation list, the annotation group and a marked area in the image to be annotated corresponding to the annotation group are deleted.

[0115] In an exemplary embodiment of the present disclosure, after generating the annotation component, the modified document generation method further includes:

[0116] In response to a closing operation on the annotation component, a marking area corresponding to the annotation component is cancelled.

[0117] In an exemplary embodiment of the present disclosure, after generating the first marking area, the modified document generation method further includes:

[0118] The first marking area is hidden, and a second marking area is generated in response to a second marking operation on the current image to be marked.

[0119] In an exemplary embodiment of the present disclosure, the step of generating a modified document based on the annotated image to be annotated includes:

[0120] The modified document is generated based on the image to be annotated and the annotation list.

[0121] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0122] In addition, although the steps of the method of the present invention are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0123] In an exemplary embodiment of the present invention, an electronic device capable of implementing the above method is also provided.

[0124] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0125] Refer to the following Fig.10 The electronic device 1000 according to this embodiment of the present invention will be described. Fig.10The electronic device 1000 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0126] like Fig.10 As shown, the electronic device 1000 is in the form of a general computing device. The components of the electronic device 1000 may include, but are not limited to: the at least one processing unit 1010, the at least one storage unit 1020, a bus 1030 connecting different system components (including the storage unit 1020 and the processing unit 1010), and a display unit 1040.

[0127] The storage unit stores program codes, which can be executed by the processing unit 1010, so that the processing unit 1010 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 1010 can perform the following steps: Figure 1 The steps S110 shown in the figure are as follows: obtaining an image to be annotated, generating a list of images to be annotated, and determining a current image to be annotated in the list of images to be annotated; S120: generating a first marking area in response to a first marking operation on the current image to be annotated, and generating a first marking group corresponding to the first marking area according to the first marking area; wherein the marking group includes remarks on the marking area and a reference image corresponding to the marking area; S130: responding to switching the current image to be annotated to complete the marking of the current image to be annotated, and generating a modified document based on the annotated image to be annotated.

[0128] The storage unit 1020 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 10201 and / or a cache storage unit 10202 , and may further include a read-only storage unit (ROM) 10203 .

[0129] The storage unit 1020 may also include a program / utility 10204 having a set (at least one) of program modules 10205, such program modules 10205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0130] Bus 1030 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0131] The electronic device 1000 may also communicate with one or more external devices 1100 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1000, and / or communicate with any device that enables the electronic device 1000 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1050. In addition, the electronic device 1000 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 1060. As shown, the network adapter 1060 communicates with other modules of the electronic device 1000 via a bus 1030. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of Independent Disks, independent redundant disk array) systems, tape drives, and data backup storage systems.

[0132] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present invention.

[0133] In an exemplary embodiment of the present invention, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of this specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of this specification.

[0134] The program product for implementing the above method according to an embodiment of the present invention may adopt a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0135] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0136] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0137] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.

[0138] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0139] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0140] Other embodiments of the invention will readily occur to those skilled in the art after considering the specification and practicing the invention invented herein. This application is intended to cover any variations, uses or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art that are not invented by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the claims.

Claims

1. A method for generating a modified document, characterized in that: include: Acquire an image to be annotated, generate a list of images to be annotated, and determine a current image to be annotated in the list of images to be annotated; In response to a first marking operation on the current image to be marked, a first marking area is generated, and based on the first marking area, a first marking group corresponding to the first marking area is generated; wherein the marking group includes a remark on the marking area and a reference image corresponding to the marking area; In response to the switching of the current image to be annotated, the annotation of the current image to be annotated is completed, and a modified document is generated based on the annotated image to be annotated.

2. The modified document generation method according to claim 1, characterized in that: The step of generating a first marked area in response to a first marking operation on the current image to be marked includes: In response to a labeling triggering operation on the current image to be labeled, receiving a first marking operation on the current image to be labeled; According to the first marking operation, the first marking area is generated.

3. The modified document generation method according to claim 2, characterized in that: The step of generating a first annotation group corresponding to the first marked area according to the first marked area includes: In response to completion of the first marking operation, generating a first annotation component; Based on the first annotation component, a remark to the first marked area and a reference image corresponding to the first marked area are added, and based on the first marked area, the remark to the first marked area and the reference image, a first annotation group corresponding to the first marked area is generated.

4. The method for generating a modified document according to claim 3, characterized in that: After generating the first annotation group corresponding to the first marked area, the modified document generation method further includes: Adding the first annotation group to an annotation list, wherein the sequence number of the first annotation group in the annotation list is the same as the sequence number of the first annotation group in the image to be annotated; Displaying the marked mark in the current image to be marked.

5. The method for generating a modified document according to claim 4, characterized in that: The method further comprises: In response to a request to delete the annotation group in the annotation list, the annotation group and a marked area in the image to be annotated corresponding to the annotation group are deleted.

6. The modified document generation method according to claim 3, characterized in that: After generating the annotation component, the modified document generation method further includes: In response to a closing operation on the annotation component, a marking area corresponding to the annotation component is cancelled.

7. The modified document generation method according to claim 1, characterized in that: After generating the first marking area, the modified document generation method further includes: The first marking area is hidden, and a second marking area is generated in response to a second marking operation on the current image to be marked.

8. The modified document generation method according to claim 1, characterized in that: The step of generating a modified document based on the annotated image to be annotated includes: The modified document is generated based on the image to be annotated and the annotation list.

9. A method for generating a modified document, characterized in that: include: The module for determining images to be annotated is used to obtain images to be annotated, generate a list of images to be annotated, and determine the current image to be annotated in the list of images to be annotated; A marking group generating module, configured to generate a first marking area in response to a first marking operation on the current image to be marked, and to generate a first marking group corresponding to the first marking area according to the first marking area; wherein the marking group includes a remark on the marking area and a reference image corresponding to the marking area; The modified document generation module is used to respond to the switching of the current image to be annotated to complete the annotation of the current image to be annotated, and generate a modified document based on the annotated image to be annotated.

10. A computer storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processing unit, the modified document generation method according to any one of claims 1 to 8 is implemented.

11. An electronic device, characterized in that: include: Processing unit; as well as A storage unit, used to store executable instructions of the processing unit; Wherein, the processing unit is configured to execute the modified document generation method according to any one of claims 1 to 8 by executing the executable instructions.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the modified document generation method according to any one of claims 1 to 8 is implemented.