Calibration support device, calibration support method, and program

Abstract

This invention provides a calibration support device, a calibration support method, and a program that can further reduce the workload of calibration work. [Solution] A proofreading support device comprising: a proofreading processing unit that proofreads production data produced based on manuscript data; and a display control unit that generates and displays an image to which the proofreading results by the proofreading processing unit have been added to the production data, wherein the proofreading processing unit performs at least a first proofreading process that compares character information contained in the manuscript data with character information contained in the production data and proofreads the production data based on the comparison result; and if, in the first proofreading process, there is character information in the manuscript data that was not detected from the production data, the proofreading support device performs a second proofreading process that compares the undetected character information with character information recognized by character recognition processing on the production data and proofreads the production data based on the comparison result.

Description

Technical Field

[0001] The present invention relates to a proofreading support apparatus, a proofreading support method, and a program.

Background Art

[0002] Conventionally, when producing printed matter such as product packages, catalogs, flyers, and booklets, the ordering party provides manuscript data to the production side, and the production side that has received the order creates design data including illustrations and the like based on the provided manuscript data. Further, the design data produced by the production side is submitted to the ordering party, and the ordering party proofreads the submitted design data visually or using document proofreading software or the like, exchanges communications, and completes the final printed matter.

[0003] Various technologies related to proofreading in the production of printed matter as described above have been disclosed. For example, Patent Document 1 below discloses a technology that combines technologies such as deep learning, natural language processing, and rule-based detection to perform document checking for notation inconsistencies, typographical errors, missing characters, kanji errors, and the like in a manuscript before printing. Further, Non-Patent Document 1 below discloses a technology that detects inconsistencies between manuscript data and design data created based on the manuscript data by collating the two, and displays the detection results with color-coded sticky notes.

Prior Art Literature

Patent Literature

[0004]

Patent Document 1

Non-Patent Literature

[0005]

Non-Patent Document 1

[0006] In the technology described in the prior art documents mentioned above, inconsistencies between manuscript data and design data are detected by text detection based on the text information contained in the manuscript data and the text information contained in the design data. If an inconsistency is detected by this text detection, a detection result indicating the location of the inconsistency is displayed. However, text detection cannot detect text contained in parts that have been outlined or converted into images in the design data. Therefore, in cases of inconsistencies caused by the inability to detect the target text from the design data, it was not possible to distinguish whether the text could not be detected because it did not exist in the design data, or because the text existed in the design data but could not be detected because it had been outlined or converted into an image. Consequently, if text could not be detected by text detection, that text had to be checked manually as before, which sometimes added a burden to the proofreading process.

[0007] In view of the above-mentioned problems, the object of the present invention is to provide a calibration support device, a calibration support method, and a program that can further reduce the workload of calibration work. [Means for solving the problem]

[0008] To solve the above-mentioned problems, a proofreading support device according to one aspect of the present invention comprises a proofreading processing unit that proofreads production data produced based on original data, and a display control unit that generates and displays an image on which the proofreading results by the proofreading processing unit have been added to the production data, wherein the proofreading processing unit performs at least a first proofreading process that compares character information contained in the original data with character information contained in the production data and proofreads the production data based on the comparison result, and if there is character information in the original data that was not detected from the production data in the first proofreading process, it performs a second proofreading process that compares the undetected character information with character information recognized by character recognition processing on the production data and proofreads the production data based on the comparison result.

[0009] A proofreading support method according to one aspect of the present invention includes a proofreading process for proofreading production data produced based on original data, and a display control process for generating and displaying an image to which the proofreading results from the proofreading process have been added to the production data, wherein the proofreading process includes at least a first proofreading process which compares character information contained in the original data with character information contained in the production data and proofreads the production data based on the comparison result, and if there is character information in the original data that was not detected from the production data in the first proofreading process, a second proofreading process which compares the undetected character information with character information recognized by character recognition processing on the production data and proofreads the production data based on the comparison result, and is a proofreading support method performed by a computer.

[0010] A program according to one aspect of the present invention causes a computer to function as a proofreading processing means for proofreading production data produced based on original data, and a display control means for generating and displaying an image to which the proofreading results from the proofreading processing means have been added to the production data. The proofreading processing means performs at least a first proofreading process which compares character information contained in the original data with character information contained in the production data and proofreads the production data based on the comparison result. If, in the first proofreading process, there is character information in the original data that was not detected in the production data, the program performs a second proofreading process which compares the undetected character information with character information recognized by character recognition processing on the production data and proofreads the production data based on the comparison result. [Effects of the Invention]

[0011] According to the present invention, the workload of calibration work can be further reduced. [Brief explanation of the drawing]

[0012] [Figure 1] This figure shows an example of the schematic configuration of a calibration support system 1 including a calibration support device 100 of the embodiment. [Figure 2] This figure shows an example of an image IM10 generated by the display control unit 160. [Figure 3] This diagram illustrates the display behavior when icon IC21 is selected. [Figure 4] This diagram illustrates the display behavior when icon IC22 is selected. [Figure 5] This figure shows an example of a comment input screen. [Figure 6] This figure illustrates an example of the display content in the detailed information display area AR24-2 after icon IC26 is selected. [Figure 7] This figure shows an example of an image displayed in erase mode. [Figure 8] This figure shows an example of an image displayed in sticky note addition mode. [Figure 9] It is a diagram showing an example of an image IM30 illustrating a comment content input screen. [Figure 10] It is a diagram for explaining a display portion of a mark image MK13 after the display of the image IM30 is completed. [Figure 11] It is a diagram for explaining an example of another image generated by the display control unit 160. [Figure 12] It is a flowchart showing an example of processing executed by the proofreading support apparatus 100. [Figure 13] It is a flowchart showing an example of third proofreading processing. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the proofreading support apparatus, proofreading support method, and program of the present invention will be described with reference to the drawings. The proofreading support apparatus described below is applied, for example, to the work of creating printed materials such as product packages, catalogs, leaflets, and booklets. In such work, for example, a production company is requested to produce a printed material based on original data (order data) including a document prepared by the ordering party. In this case, the production side that receives the order first produces design data (production data) including documents, illustrations (images), and the like based on the original data, and the produced design data is submitted to the ordering party. The ordering party proofreads the design data produced by the production side, communicates with the production side, and completes the final printed material. The original data may include, for example, image data and the like. Further, since the ordering party proofreads the design data in the following description, the ordering party may be referred to as the "proofreading side" and the orderer may be referred to as the "proofreader". Further, the object of the proofreading work in the present embodiment is not limited to sentences (character information), and may include information such as illustrations, images, and the like (for example, QR code (registered trademark) and Eco Mark (registered trademark)). Further, "proofreading" in the embodiments may include the meaning of "review".

[0014] <Proofreading Support System> FIG. 1 is a diagram illustrating an example of a schematic configuration of a calibration support system 1 including a calibration support apparatus 100 according to an embodiment. The calibration support system 1 includes, for example, the calibration support apparatus 100 and at least one or more terminal apparatuses 200-1 to 200-n. Hereinafter, unless each of the terminal apparatuses 200-1 to 200-n is described separately, the description will simply refer to them as "terminal apparatus 200". The calibration support apparatus 100 and the terminal apparatus 200 communicate with each other via, for example, a network NW. The network NW includes, for example, a cellular network, a Wi-Fi network, Bluetooth (registered trademark), the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), a public line, a provider apparatus, a dedicated line, a wireless base station, and the like.

[0015] The calibration support apparatus 100 manages manuscript data and design data, performs processing related to calibration of design data, and manages calibration results and the like. The calibration support apparatus 100 also generates an image corresponding to a calibration result, causes the image to be displayed on a display unit, or transmits the image to the terminal apparatus 200 to provide it to a user. The calibration support apparatus 100 may be, for example, a server apparatus or a PC (Personal Computer), or may be a cloud server configured by cloud computing including one or more information processing apparatuses.

[0016] The terminal apparatus 200 is a terminal used by each of one or more users (calibration-side users) who perform calibration processing and check calibration results. The terminal apparatus 200 may also include a terminal used by a production-side user who produces design data from manuscript data. The terminal apparatus 200 is, for example, a PC, a tablet terminal, or the like, but may also be a communication terminal such as a smartphone. The terminal apparatus 200 includes at least a communication function for communicating with the calibration support apparatus 100, a display unit that displays manuscript data, design data, calibration data indicating calibration results, and the like, and a reception unit that receives input from a user. For example, the terminal apparatus 200 displays design data to be calibrated, inputs comments for the design data, specifies a calibration range, displays calibration results, and the like.

[0017] Next, the functional configuration of the calibration support device 100 will be described in detail. The calibration support device 100 includes, for example, a communication unit 110, an input unit 120, an output unit 130, a management unit 140, a calibration processing unit 150, a display control unit 160, a control unit 170, and a storage unit 180. Some or all of the management unit 140, the calibration processing unit 150, the display control unit 160, the supply unit 164, and the control unit 170 are realized by a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or GPU (Graphics Processing Unit), or by the cooperation of software and hardware. The program may be stored in advance on the HDD (Hard Disk Drive) or flash memory of the calibration support device 100, or it may be stored on a removable storage medium such as a DVD or CD-ROM, and installed on the HDD or flash memory of the calibration support device 100 when the storage medium (non-transient storage medium) is inserted into the drive device.

[0018] The storage unit 180 is implemented by, for example, an HDD, flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), ROM (Read Only Memory), or RAM (Random Access Memory). The storage unit 180 stores, for example, manuscript data 182, design data 184, proofreading data 186, programs, and various other information. Manuscript data 182 is, for example, document data such as text information (string information) to be included in the design data. For example, if the printed material is a product package, the manuscript data includes product information (e.g., product name, ingredients, expiration date, storage method, seller) and product-related information (e.g., nutritional information, heating time, cooking method). Manuscript data 182 is, for example, Excel® data, but may also be CSV (Comma Separated Values) data, text data, Word document data, or other data formats. Design data 184 is, for example, data including documents and illustrations (images) created by the production side based on the manuscript data 182. The design data 184 is, for example, PDF (Portable Document Format) data, but may be in other data formats. The proofreading data 186 is data that includes the proofreading results from the proofreading side and the processing results from the proofreading processing unit 150 for the design data 184. In addition, there may be multiple data for each of the original data 182, design data 184, and proofreading data 186, in which case each is stored in a way that allows identification by identification information, etc.

[0019] Furthermore, the storage unit 180 may also manage user information for users of the calibration support device 100. User information may include, for example, identification information for identifying the user, identification information for the terminal device 200 used by the user, and user authorization information.

[0020] The communication unit 110 communicates with terminal devices 200 and other external devices, for example, via a network NW.

[0021] The input unit 120 accepts information input from, for example, a terminal device 200. Information from the terminal device 200 includes manuscript data 182, design data 184, proofreading data 186, and requests to view this data. Information from the terminal device 200 also includes information related to the proofreading of the design data 184, control information for the proofreading support device 100, terminal identification information, user identification information, and other user input information. The input unit 120 may also accept information input from a user (for example, a system administrator) using the proofreading support device 100 through the operation of various keys and buttons, or voice input via a microphone.

[0022] The output unit 130 includes, for example, a display unit and a speaker, and outputs predetermined information to each. The display unit is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display. The display unit displays images (including still images and videos) that show various information in the embodiment. The speaker outputs predetermined sound. The input unit 120 may be configured integrally with the display unit as a touch panel. For example, the output unit 130 outputs, for example, information input by the input unit 120 or images, sound, etc., generated by the display control unit 160.

[0023] The management unit 140 manages the information input and output by the proofreading support device 100. The management unit 140 also stores and manages the original data 182, design data 184, and proofreading data 186 in the storage unit 180, and manages user-specific permissions for proofreading and viewing proofreading results.

[0024] The proofreading processing unit 150 proofreads, for example, the design data 184 created based on the original data 182. The proofreading processing unit 150 also adds specific objects (e.g., mark images or comment information (sticky note information), etc.) to a range of the design data 184 selected by the user. The data processed by the proofreading processing unit 150 is stored in the storage unit 180 as proofreading data 186. Details of the functions of the proofreading processing unit 150 will be described later.

[0025] The display control unit 160 generates an image by adding the calibration results from the calibration processing unit 150 to the design data and displays it on the output unit 130 or the display unit of the terminal device 200. The display control unit 160 also generates and displays an image in which a specific object is added to the design data image including the calibration results. The display control unit 160 may also generate audio or the like corresponding to the image and output it from the output unit 130 or the terminal device 200. The display control unit 160 includes, for example, an image generation unit 162 and a providing unit 164.

[0026] The image generation unit 162 generates images related to the design data 184 processed by the proofreading processing unit 150, images related to the processed proofreading data 186, and so on. The image generation unit 162 may also generate images related to the original document data 182, or images for prompting the user to input predetermined information, or images after the input has been made, and so on. Details of the images generated by the image generation unit 162 during the proofreading process in this embodiment will be described later.

[0027] The provisioning unit 164 provides images of at least the design data 184 and proofreading data 186 generated by the image generation unit 162 to the terminal device 200 via the network NW. The provisioning unit 164 may also provide the original document data 182 to the terminal device 200. The provisioning unit 164 may also provide the data to a specific terminal device 200 from among multiple terminal devices 200-1 to 200-n that has viewing privileges, based on user information.

[0028] The control unit 170 controls the entire functional configuration of the calibration support device 100. For example, the control unit 170 controls the transmission and reception of information (data) in the communication unit 110, controls information managed by the management unit 140, controls the calibration process in the calibration processing unit 150, the display process in the display control unit 160, and so on.

[0029] <Calibration process> Next, the details of the proofreading process of the embodiment performed by the proofreading processing unit 150, etc., will be explained with reference to the figures. The proofreading process performed by the proofreading processing unit 150 includes a first proofreading process, a second proofreading process, and a third proofreading process. The first proofreading process is, for example, a process that compares the strings (character information) contained in the original data 182 with the strings (character information) contained in the design data 184 and proofreads them based on predetermined proofreading rules, etc. The second proofreading process is, for example, a process that compares the strings contained in the original data 182 with the strings recognized by character recognition processing such as OCR (Optical Character Recognition) on the design data 184 and proofreads them based on predetermined proofreading rules, etc. Character recognition processing such as OCR (Optical Character Recognition) on the design data 184 can recognize outlined character information and imaged character information contained in the design data 184. The third proofreading process is, for example, a process that applies a specific object to an area specified by the user based on information input by the user via the proofreading support device 100 or terminal device 200 and performs proofreading. The calibration processing unit 150 may selectively execute any of the first calibration process, the second calibration process, or the third calibration process, or it may execute any other calibration process (existing calibration process). The first calibration process, the second calibration process, and the third calibration process will be described in detail below. In addition, the display control performed by the display control unit 160 in response to the calibration process will also be described below.

[0030] <First calibration process> In the first proofreading process, for example, strings (words or sentences) contained in the manuscript data 182 are compared with strings (words or sentences) contained in the design data 184 to determine whether the strings in the design data 184 match the strings contained in the manuscript data 182. Note that the strings in the design data 184 may be provided in advance by the production side. Alternatively, the first proofreading process may compare the strings contained in the manuscript data 182 and the strings contained in the design data 184 character by character to determine whether they are an exact match or a partial match. If there is a partial match, the first proofreading process extracts the characters that do not match. The first proofreading process may also count the number of occurrences of the same string within the data and detect inconsistencies in the number of occurrences. Furthermore, the first proofreading process may extract non-detected strings that are contained in the manuscript data 182 but not in the design data 184, and non-detected strings that are contained in the design data 184 but not in the manuscript data 182. Note that the method for comparing strings contained in the two documents is not limited to the above example, and various other existing technologies may be combined.

[0031] Furthermore, in the first proofreading process, a combination of various existing proofreading rule technologies, such as deep learning, natural language processing, and rule-based detection, may be used to perform mechanical document checking, as shown in Patent Document 1 (Japanese Patent No. 6766972). For example, in the first proofreading process, morphological analysis is performed on the document of manuscript data 182 to obtain information such as the type of part of speech, notation, reading, and number of characters of the morphemes. In addition, in the first proofreading process, misspellings, omissions, incorrect kanji, incorrect particles, and incorrect kana are detected based on predetermined rules (e.g., a trained model, an errata sheet for correcting misspellings, etc.). In addition, in the first proofreading process, natural language processing is performed using the results of morphological analysis to extract syntax and meaning, extract corresponding expressions included in the syntax, and determine whether the notation is incorrect. In addition, in the first proofreading process, prohibited words are extracted using a rule-based dictionary, etc., and variations in notation are checked.

[0032] Furthermore, the first proofreading process may compare a pre-registered list of cautionary phrases with the strings in the design data 184. If a string matching a cautionary phrase included in the list exists in the design data 184, the process may extract that string and also extract correction candidates for the cautionary phrase. The cautionary phrases may include characters such as the aforementioned misspellings, incorrect kanji, prohibited words, and variations in display. The first proofreading process may also generate comment information for the proofreading process described above. The comment information may include, for example, information about the processing result, information about the target string, and information about the processing date and time.

[0033] The calibration processing unit 150 stores the result of the first calibration process as calibration data 186 in the storage unit 180. The calibration processing unit 150 also causes the image generation unit 162 of the display control unit 160 to generate an image based on the result of the first calibration process. The image generation unit 162 generates an image based on the result of the first calibration process. The providing unit 164 of the display control unit 160 then transmits the image generated by the image generation unit 162 to the terminal device 200 or outputs it to the output unit 130 to provide it to the user. At this time, the providing unit 164 may transmit the image only to terminal devices 200 used by users with predetermined viewing privileges, or prevent the image from being displayed on terminal devices 200 used by users without privileges.

[0034] Figure 2 shows an example of an image IM10 generated by the display control unit 160. The image IM10 shown in Figure 2 is, for example, an example of an image showing the result of the first proofreading process. Image IM10 includes, for example, a design data display area AR10 and a proofreading result display area AR20. Note that the display manner, such as the content, type, font, and layout displayed in image IM10, is not limited to the example in Figure 2. The same applies to other images described later.

[0035] The design data display area AR10 displays the design image IM12 (an example of design data) created by the production team. In the example in Figure 2, the design image IM12 includes, for example, images representing objects and text (illustration images and text images), code images such as QR codes and barcodes, and various mark images such as recycling marks.

[0036] Here, the display control unit 160 overlays a transparent mark image MK11 (an example of the first proofreading image) onto the area of ​​the design image IM12 displayed in the design data display area AR10 where the string for which the first proofreading process has been performed is displayed, as shown in Figure 2. Because the transparent mark image MK11 overlays that area with a predetermined color or pattern, the user can easily understand which character information has been marked. The display control unit 160 may also display the mark image MK11 with different colors or patterns for each proofreading type in the first proofreading process. The proofreading type is a type corresponding to the proofreading result, and includes, for example, "exact match," "partial match," "not detected," etc. The proofreading type may also include information such as "cautionary phrases." Furthermore, the display control unit 160 overlays an identification image MK12, which shows identification information (for example, a number) for identifying each mark image MK11, on or near the mark image MK11 (within a predetermined distance).

[0037] In the first proofreading process, the strings contained in the original data 182 are compared with the strings contained in the design data 184, and it is assumed that there are strings in the original data 182 that were not detected in the design data 184. That is, it is assumed that undetected strings not included in the design data 184 are extracted. In this case, the display control unit 160 displays an identification image MK12 or a mark image MK11 indicating that the configuration type is "undetected" at the position where the string should originally be detected, or at an arbitrary position. Furthermore, the display control unit 160 displays an operator (e.g., a button) on the screen for executing the second proofreading process. The proofreading processing unit 150 executes the second proofreading process when the operator is operated. The proofreading processing unit 150 may execute the second proofreading process only when the operator is operated, or it may automatically execute the second proofreading process immediately following the first proofreading process if undetected strings are extracted.

[0038] Furthermore, the display control unit 160 may generate an image of an icon IC10 for the user to select one of at least two modes included in the third calibration process described later, and display it in the design data display area AR10. The icon IC10 is, for example, a GUI (Graphical User Interface) switch. In the example in Figure 2, the icon IC10 accepts the user's selection of one of at least two modes.

[0039] The calibration result display area AR20 includes, for example, the display content specification area AR22 and the detailed information display area AR24 (an example of a second calibration image). The display content specification area AR22 is used to specify information regarding the sorting of comment information (for example, by display coordinate order, by calibration result order, etc.) and filtering conditions for the display content. Filtering conditions include, for example, exact matches, partial matches, undetected items, items extracted as cautionary words, items where "accepted" or "confirmed" (described later) is not selected, and items containing characters specified by the user. The display control unit 160 displays the comment information corresponding to the order and filtering conditions specified in the display content specification area AR22 in the detailed information display area AR24.

[0040] The detailed information display area AR24 displays, for example, a list of comment information (sticky note information) for strings on which the mark image MK11 corresponding to the identification information of the identification image MK12 described above is superimposed. In the example in Figure 2, two detailed information display areas AR24-1 and AR24-2 are displayed. The display control unit 160 may also display at least a portion of the detailed information display areas AR24-1 and AR24-2 in association with the display manner of the mark image MK11 corresponding to the identification information of the identification image MK12. In this case, the display control unit 160 displays at least a portion of the outer frame of the detailed information display areas AR24-1 and AR24-2 in the same display manner as the color and pattern of the mark image MK11 corresponding to the identification information of the identification image MK12. This allows the user to easily understand which mark image MK11 the comment information corresponds to. Furthermore, if the color and pattern of the mark image MK11 correspond to the calibration type, the calibration type can also be determined by the color and pattern of the detailed information display area AR24.

[0041] Furthermore, the comment information included in the detailed information display area AR24 includes, for example, comments generated in the first proofreading process, and specifically includes information about the proofreading type, the string to be proofread, the number of occurrences, and information about the proofreading result. Here, the contents displayed in the detailed information display area AR24 will be specifically described for each of several proofreading types. The displayed content (image) is generated by the image generation unit 162.

[0042] For example, if the proofreading type is "exact match," the detailed information display area AR24 will display information indicating an exact match (for example, text information such as "The text matches the original document."). In addition, if there is an exact match, the number of occurrences of the exact matched characters in design data 184 and the number of occurrences of the characters in original data 182 will be displayed. If there is an exact match but the number of occurrences does not match, information indicating a mismatch in the number of occurrences may be displayed. For example, if the string "Type: Fermented milk" appears once in original data 182 and twice in design data 184, text information such as "Number of occurrences does not match" will be displayed.

[0043] Furthermore, if the proofreading type is "partial match," the detailed information display area AR24 will display information indicating that a partial match occurred (for example, text information such as "There may be an error in the description"), and the matching and non-matching characters will be displayed in a way that makes them distinguishable (for example, different colors, patterns, background colors, bold text).

[0044] Furthermore, if the proofreading type is "Not Detected," the detailed information display area AR24 will display information indicating that it was not detected, as well as the text information that was not detected. Specifically, for example, text information such as "“Whole Strawberry & Yogurt” could not be detected" will be displayed. In addition, if it is not detected, information indicating how many items are missing (for example, text information such as "1 item missing") may also be displayed.

[0045] Additionally, if the proofreading type is "warning word," the detailed information display area AR24 will show information indicating that it is a warning word, the target string, and information about the suggested correction string (for example, text information such as "This is a prohibited word," "Target: Product," and "Correction suggestion: Item").

[0046] Furthermore, the calibration types are not limited to these; information corresponding to other types will be generated and displayed. In this way, by displaying the calibration results in detail, the user can gain a more detailed understanding of the calibration results, thereby reducing the burden of calibration work.

[0047] Furthermore, the detailed information display area AR24 includes icons IC21 to IC23. Icon IC21 is, for example, an icon selected when a user (proofreader) confirms the calibration results. When icon IC21 is selected, the image generation unit 162 changes the display mode of the detailed information display area AR24 to which icon IC21 is associated.

[0048] Figure 3 illustrates the display configuration when icon IC21 is selected. In the example shown in Figure 3, when icon IC21, which indicates that the calibration result has been confirmed by the user, is selected for the detailed information display area AR24-1 shown in Figure 2, the image generation unit 162 changes the color and pattern of icon IC21 itself to indicate that icon IC21 has been selected, and also changes the background color of the detailed information display area AR24-1. This allows the user to easily understand that the calibration result has been confirmed. Therefore, it is possible to suppress repeated calibration of previously calibrated parts. Furthermore, when calibration work is performed by multiple users (calibrators), it is possible to easily understand whether other users have already confirmed the calibration result, thereby suppressing unnecessary confirmation of calibration results. Therefore, the workload of the calibration work can be further reduced. The display control unit 160 may display the already performed calibration result so that all multiple calibrators can share it, or it may display it so that other calibrators cannot share it. For example, by allowing multiple calibrators to share the calibration result, it is possible to reduce manpower and improve efficiency, and by displaying it so that the calibration result is not shared, each calibrator can perform the calibration work without preconceptions, thereby improving calibration accuracy. The display control unit 160 may switch whether or not to share the calibration results based on the selection of a pre-configured authorized user. Alternatively, the display control unit 160 may share the calibration results only with some of the multiple calibrators selected by the authorized user.

[0049] Icon IC22 is selected when the user accepts the calibration result from the first calibration process. When icon IC22 is selected, the image generation unit 162 displays in a manner that indicates the corresponding detailed information display area AR24 has been selected.

[0050] Figure 4 illustrates the display behavior when icon IC22 is selected. The example in Figure 4 shows the case where icon IC22, associated with the detailed information display area AR24-2 shown in Figure 2, is selected. When icon IC22 shown in the detailed information display area AR24-2 is selected, the color and pattern of icon IC22 are displayed in a different manner than when it is not selected. This allows the user to easily understand that the calibration result has been adopted.

[0051] Furthermore, the image generation unit 162 may acquire the identification information of the user (terminal device 200) who selected icons IC21 and IC22, as well as the date and time information of the selection, and display the acquired identification information and date and time information in the detailed information display area AR24. This allows other users to easily understand which proofreader made the selection and when. As a result, proofreading work can be performed more efficiently.

[0052] Icon IC23 is selected when the user enters and saves a comment. When icon IC23 is selected, the image generation unit 162 displays a comment input area and accepts comment input from the user.

[0053] Figure 5 shows an example of a comment input screen. As shown in Figure 5, when the user selects icon IC23 in the detailed information display area AR24-2, the image generation unit 162 terminates the display of icon IC23 and displays the comment information input area AR26. The comment information input area AR26 displays user information for entering a comment, a comment input area, and icons IC24 to IC26. When text is entered in the comment input area, the entered content is displayed. Icon IC24 is an icon for selecting file data to be stored in association with the comment content. When icon IC24 is selected, file data in a predetermined directory or folder of the terminal device 200 being operated by the user is displayed, and by selecting at least one of them, the file data is saved in association with the detailed information display area AR24-2 where the comment was entered. When icon IC25 is selected, the image generation unit 162 erases the comment entered in the comment input area and does not save the comment. If a specific file data is selected, it also does not save that file and terminates the display of the comment information input area AR26.

[0054] Furthermore, if icon IC26 is selected, the image generation unit 162 stores the content entered in the comment input area and the selected file data in the storage unit 180 as calibration data 186, corresponding to the calibration result in the detailed information display area AR24-2, and the display of the comment information input area AR26 ends.

[0055] Figure 6 illustrates an example of the display content in the detailed information display area AR24-2 after icon IC26 is selected. As shown in Figure 6, if a comment has been entered after icon IC26 is selected, a comment field display area AR28 is added to the detailed information display area AR24-2. The comment field display area AR28 displays, for example, the user information of the person who entered the comment, the date and time the comment was entered, and the content of the comment. In addition, the icon IC23 for entering a comment is displayed again in the detailed information display area AR24-2, and an icon IC27 indicating the presence and number of comments is also displayed. This allows proofreaders and production users to easily understand whether user comments have been added to the proofreading results and to immediately check the content of the comments. This streamlines the proofreading process, and also allows the production side to understand the content of the proofreading results and comments in more detail.

[0056] <Second calibration process> In the second proofreading process, the proofreading processing unit 150, for example, after performing at least the first proofreading process, compares the strings (character information such as words and sentences) that were not detected in the first proofreading process with the strings recognized by OCR (optical character recognition) on the design data 184 (character information that had been outlined or converted into an image), and proofreads the design data 184 based on the comparison result. The processing content of the second proofreading process is the same as that of the first proofreading process described above, except that the strings to be compared are different. By performing the second proofreading process, strings that were not detected from the design data 184 in the first proofreading process because they had been outlined or converted into an image can be extracted. Strings that were not detected in the second proofreading process can be clearly distinguished as strings that do not exist in the design data 184. Therefore, the accuracy of proofreading can be improved by performing the second proofreading process. In addition, the user does not need to visually check why a string was not detected, thus reducing the workload of the proofreading work.

[0057] When the second proofreading process is executed, the display control unit 160 displays comment information (first sticky note information) indicating the results of the first proofreading process and comment information (second sticky note information) indicating the results of the second proofreading process on the same screen. For example, the display control unit 160 displays the comment information of the second proofreading process in the same way as the comment information of the first proofreading process shown in the detailed information display area AR24-1 and detailed information display area AR24-2, as explained with reference to Figures 2 to 6. This allows the display control unit 160 to visualize the strings that were detected by the OCR in the second proofreading process and the strings that were not detected by the OCR. Furthermore, the user can easily check not only the detection results by text detection in the first proofreading process, but also the detection results by OCR in the second proofreading process.

[0058] The display control unit 160 displays the proofreading results of the strings detected from the design data 184 by the first proofreading process and the proofreading results of the strings detected from the design data 184 by the second proofreading process in different display modes. For example, the display control unit 160 displays the detection results by text detection in the first proofreading process and the detection results by OCR in the second proofreading process in a distinguishable display mode (e.g., different colors, patterns, background colors, bold text). This allows the user to easily visually distinguish between the results of the first proofreading process and the results of the second proofreading process, and to easily grasp the results of the second proofreading process that need to be checked.

[0059] <Third calibration process> The third calibration process is, for example, a process that assists the first and second calibration processes. The third calibration process performs calibration on the image IM10 based on information received from the user via the calibration support device 100 or terminal device 200. Here, the third calibration process has at least a "clear mode" and a "sticky note addition mode". The clear mode is an example of the "first mode", and the sticky note addition mode is an example of the "second mode". These modes can be switched by the user's selection operation on the icon IC10 described above. The processing in each mode will be described below.

[0060] <About the erase mode> The "correction mode" is a mode in which the user can specify an area to indicate that that area does not require correction (in other words, that it has been proofread). Note that area specification may include, for example, specifying an area of ​​illustrations or images included in design data 184, or (or instead) specifying text. When specifying text, for example, the user may highlight the displayed text with a marker.

[0061] For example, as shown in Figure 2, there are parts of the design data display area AR10 where the mark image MK11 is not superimposed. These parts are areas that were not processed in the first or second proofreading process. In these areas, it is not possible to determine whether the proofreader has proofread them in the past (or whether they have been proofread by another proofreader), which may increase the workload of the proofreading process due to the need for verification. Therefore, in this embodiment, the erase mode of the third proofreading process is used to manually add (superimpose) a mark image (object) to the target character information, mark information, or code information to indicate that no correction is needed, thereby erasing the target area.

[0062] Figure 7 shows an example of an image displayed in the erase mode. In the example in Figure 7, a portion of the design data display area AR10 is extracted and displayed. When the erase mode is executed, the user selects the portion of icon IC10 that corresponds to the erase mode. As shown in Figure 7, the display control unit 160 changes the display mode to indicate that the erase mode has been selected from the modes that can be selected by icon IC10 and displays the icon.

[0063] In the design data display area AR10-1 shown in Figure 7, areas corrected by the first or second proofreading process are displayed by mark image MK11. When the user selects an area not displayed by mark image MK11 during the execution of the correction mode, a correction mark image MK13 is displayed in that selected area. This mark image MK13 may be displayed in a different color or pattern than the mark image MK11. Furthermore, similar to the mark image MK11, the mark image MK13 is transparent, and the area is overlaid with a predetermined color or pattern, allowing the user to easily understand which character information, mark information, or code information has been marked. In this way, the correction mode allows the user's correction results to be displayed even for parts that could not be corrected in the first or second proofreading process. Therefore, by looking at the design data display area AR10-1, each proofreader can share which parts have been corrected (and which have not), thereby suppressing unnecessary duplicate proofreading work. Consequently, the workload of proofreading can be further reduced, and work efficiency can be improved. As described above, the display control unit 160 may display the calibration results obtained in the redaction mode so that all of the multiple calibrators can share them, or it may display them so that other calibrators cannot share them. The display control unit 160 may also allow an authorized user to select whether or not to share the calibration results obtained in the redaction mode. Furthermore, the display control unit 160 may share the calibration results obtained in the redaction mode only with some of the multiple calibrators selected by an authorized user.

[0064] <About the sticky note addition mode> The sticky note addition mode is a mode in which an object containing comment information (sticky note information) is attached to an area indicated by the user and displayed in the detailed information display area AR24. The sticky note addition mode is executed, for example, when the user selects the sticky note addition mode from the icons IC10. In this case, the display control unit 160 changes the display mode to indicate that the sticky note addition mode has been selected from the modes that can be selected with icon IC10 and displays the icon accordingly.

[0065] Figure 8 shows an example of an image displayed in sticky note addition mode. In the example in Figure 8, a portion of the design data display area AR10-1 described above is shown. For example, if a predetermined area of ​​a portion of the design data display area AR10-1 (in the example in Figure 8, the QR code display area) is selected by the user's drag operation while sticky note addition mode is running, the display control unit 160 displays an image for inputting comments (points of criticism) for that selected area.

[0066] Figure 9 shows an example of image IM30, which represents a comment content input screen. Image IM30 includes, for example, a comment content input area AR31 and icons IC31 to IC33 as a comment content input screen. The comment content input area AR31 is an area that accepts input of the user's comments for a user-specified area (in the example of Figure 8, the QR code display area) and displays the accepted input information. Icon IC31 is an icon for selecting file data to be stored in association with the comments. When icon IC31 is selected, file data in a predetermined directory or folder of the terminal device 200 being operated by the user is displayed, and by selecting at least one of them, the selected file data is associated with the specified area and saved.

[0067] If icon IC32 is selected, the display control unit 160 erases the content entered in the content input area AR31 and does not save the comment. If a specific file data is selected, it also does not save that file and terminates the display of image IM30.

[0068] If icon IC33 is selected, the display control unit 160 stores the content entered in the content input area AR31 and the selected file data in the storage unit 180 as calibration data 186, associating them with the content of the issue, and then terminates the display of image IM30.

[0069] Figure 10 is a diagram illustrating the display portion of the mark image MK13 after the display of image IM30 has finished. After the content of the comments has been entered, the mark image MK13 is displayed with a color and pattern that can be distinguished from other mark images, and is displayed with identification information (identification number) to distinguish it from the mark images MK11 and MK13. The display control unit 160 also acquires the coordinates of the mark image MK13 and saves them in the calibration data 186. Furthermore, if information such as the content of the comments has been entered, the display control unit 160 may display (add) the information including the comments mentioned above as an object in the detailed information display area AR24 of the calibration result display area AR20.

[0070] In this way, the third proofreading process allows mark images and other objects to be added to parts (regions) where the first or second proofreading process was not performed, making it easier for the user to clearly understand which parts of the entire design data display area AR10 have been proofread. Furthermore, the third proofreading process allows the user to reflect the results of visual or other proofreading of a selected area by adding mark images MK13 and comment information (points raised) (sticky note addition mode).

[0071] As described above, according to this embodiment, the results of the first proofreading process, the second proofreading process, and the third proofreading process can be displayed on the same screen, allowing for a more accurate understanding of the overall proofreading results. Therefore, for example, even when multiple people are performing proofreading work, the proofreading status (progress) can be grasped in real time, thereby improving work efficiency. Furthermore, according to this embodiment, the production side can check more detailed proofreading results based on the results of the first proofreading process, the second proofreading process, and the third proofreading process, allowing for more efficient correction and other work.

[0072] <Variation> In this embodiment, the display control unit 160 may generate other images in addition to the image examples described above. Figure 11 is a diagram illustrating an example of another image generated by the display control unit 160. In the example in Figure 11, when the cursor icon IC40 indicating the position indicated by the user is positioned on the display area of ​​the mark image MK11, the image IM40 showing the calibration result associated with the mark image MK11 is displayed at the position of the mark image MK11. By displaying the image as shown in Figure 11, it is possible to immediately check what calibration results have been obtained for the data to be calibrated (such as character information) associated with the mark image MK11, or to check comments on the calibration results.

[0073] In addition, in this embodiment, the proofreading processing unit 150 may determine whether any characters remain at the time the user determines that the erasure is complete in erasure mode by performing character recognition processing such as OCR. Specifically, the proofreading processing unit 150 performs OCR processing with the text portion masked by, for example, filling the erased area with a predetermined color (for example, black). If any text (characters) is recognized as a result of the processing in this state, it is determined that there is a possibility that the erasure has not been completely completed. In this case, the display control unit 160 may display the text (characters) recognized by the OCR processing, or it may display information indicating that there is a possibility that the erasure has not been completely completed.

[0074] Furthermore, in this embodiment, the proofreading processing unit 150 may not only display (assign) a mark image MK13 (object) to the area specified by the user in the erase mode of the third proofreading process, but may also recognize the string contained in the specified area using character recognition processing such as OCR. The proofreading processing unit 150 may also perform the first proofreading process again on the recognized string. This makes it possible to acquire the string or perform the first proofreading process on a portion of the area specified by the user. Therefore, more detailed proofreading work can be achieved. In this case, instead of the erase mode, a third mode such as a "partial proofreading mode" may be implemented and displayed as selectable in the icon IC10. Also, in this embodiment, the mark image MK13 set by the third proofreading process may be deleteable by the user who set it, or it may be deleteable by other users.

[0075] Furthermore, in this embodiment, the third calibration process may be executable only by authorized users. User privileges may be set for each mode included in the third calibration process. This allows for obtaining more accurate calibration results that have been verified by authorized users.

[0076] In addition, in this embodiment, the display control unit 160 may change the color and pattern of the mark image according to the color and pattern of the design data. In this case, the display control unit 160 obtains information about the color (RGB information) and pattern of the design data of the area to which the mark image is to be applied by existing image analysis processing, and displays a mark image with a different color and pattern from the obtained color and pattern. This suppresses the mark image from becoming difficult to see due to the background color and pattern, and allows the user to more clearly understand the area marked by the mark image.

[0077] Furthermore, in this embodiment, the proofreading processing unit 150 may be controlled so that the third proofreading process can be executed on the portion of the design data 184 that was not proofread in the first and second proofreading processes. This makes it possible to suppress duplication of the results of the first, second, and third proofreading processes for the same character information, etc.

[0078] <Processing flowchart> Next, an example of processing performed by the proofreading support device 100 will be described. Figure 12 is a flowchart of an example of processing performed by the proofreading support device 100. In the example in Figure 12, the proofreading processing unit 150 acquires the original data (step S100) and acquires the design data created by the production side based on the original data (step S120). Next, the proofreading processing unit 150 performs the first proofreading process (step S140). Next, the display control unit 160 generates an image based on the proofreading result (step S160) and displays the generated image on the terminal device 200 or the output unit 130 (step S180).

[0079] If the operation to perform the second calibration process is performed at this point (step S190 / YES), the process proceeds to step S192. On the other hand, if the operation to perform the second calibration process is not performed (step S190 / NO), the process proceeds to step S200.

[0080] If the process proceeds to step S192, the calibration processing unit 150 executes the second calibration process (step S192). Next, the display control unit 160 generates an image based on the calibration result (step S194) and displays the generated image on the terminal device 200 or output unit 130 (step S196). Next, the calibration processing unit 150 executes the third calibration process based on the instruction input from the user (step S200). Details of the process in step S200 will be described later.

[0081] Next, the display control unit 160 generates an image based on the results of the third calibration process (step S220) and displays the generated image (step S240). Then, the management unit 140 stores the calibration data 186, including the calibration results, in the storage unit 180 (step S260). This completes the processing in this flowchart.

[0082] Next, an example of the third proofreading process in step S200 will be specifically described. In the following description, it will be assumed that two modes, the erase mode and the sticky note addition mode, are executable in the third proofreading process. Figure 13 is a flowchart of an example of the third proofreading process. In the example in Figure 12, the proofreading processing unit 150 determines whether or not it has received a mode specification (step S201). If it is determined that a mode specification has been received, the proofreading processing unit 150 determines whether or not the received mode is the erase mode (first mode) (step S202). If it is determined that it is the erase mode, the proofreading processing unit 150 accepts the user's specification of an area (step S203). In the process of step S203, instead of (or in addition to) the specification of an area, the user may also accept the specification of text. Next, the display control unit 160 adds a mark image to the received area and displays it (step S204). The proofreading processing unit 150 also manages the received area (erased area) as a proofreading result (step S205).

[0083] Furthermore, if it is determined in step S202 that the system is not in clearing mode, the proofreading processing unit 150 performs the following processing as sticky note addition mode (second mode). For example, the proofreading processing unit 150 accepts the user's specification of an area (step S206). Note that in step S206, the system may accept the specification of text instead of (or in addition to) the specification of an area. Next, the display control unit 160 displays an image with a mark image added to the accepted area (step S207). Next, the proofreading processing unit 150 displays an image for the display control unit 160 to input the content of the comments regarding the accepted area, and accepts the comments from the user (step S208). Next, the proofreading processing unit 150 manages the accepted content and comments as proofreading results (step S209). This completes the processing of this flowchart. Furthermore, if it is determined in step S201 that the system did not accept the mode specification, the processing of this flowchart is terminated.

[0084] As described above, the proofreading support device of the embodiment includes a proofreading processing unit that proofreads production data (design data) created based on original data, and a display control unit that generates and displays an image to which the proofreading results of the proofreading processing unit have been added to the production data. The proofreading processing unit performs at least a first proofreading process that compares character information contained in the original data with character information contained in the production data and proofreads the production data based on the comparison result. If, in the first proofreading process, there is character information in the original data that was not detected in the production data, the proofreading processing unit performs a second proofreading process that compares the undetected character information with character information recognized by character recognition processing on the production data and proofreads the production data based on the comparison result, thereby further reducing the workload of proofreading.

[0085] Specifically, according to the embodiment, by assigning a specific object to the area of ​​the design data that has been checked, the areas (regions) where proofreading has been completed can be identified at a glance. Furthermore, according to the embodiment, for example, a method of assigning an object indicating "checked" to automatically processed proofreading results on the same screen can be combined with a method in which the user directly selects a range by dragging and dropping to assign an object. Furthermore, according to the embodiment, by changing the display manner for checked and unchecked proofreading results, the user can easily grasp the proofreading status of each. In addition, according to the embodiment, by displaying the results of the first proofreading process, the second proofreading process, and the third proofreading process on the same screen, the proofreading status (progress) can be grasped in real time even when multiple people are performing proofreading work.Therefore, the burden on the user for proofreading work can be further reduced and work efficiency can be further improved.

[0086] The embodiments have been described above. Furthermore, some or all of the functions of the calibration support system 1, calibration support device 100, and terminal device 200 in the above-described embodiment may be implemented by a computer. In that case, the functions may be implemented by recording a program for implementing these functions on a computer-readable recording medium, loading the program recorded on this recording medium into a computer system, and executing it. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into a computer system. Furthermore, "computer-readable recording media" may include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs over networks such as the Internet or communication lines such as telephone lines, as well as those that hold programs for a certain period of time, such as volatile memory inside computer systems that act as servers or clients in such cases. Furthermore, the above program may be for the purpose of implementing some of the functions described above, or it may be for the purpose of implementing the above functions in combination with a program already recorded in the computer system, or it may be implemented using a programmable logic device such as an FPGA (Field Programmable Gate Array).

[0087] Although embodiments of this invention have been described in detail above with reference to the drawings, the specific configuration is not limited to those described above, and various design changes can be made without departing from the spirit of this invention. [Explanation of Symbols]

[0088] 1...Calibration support system, 100...Calibration support device, 110...Communication unit, 120...Input unit, 130...Output unit, 140...Management unit, 150...Calibration processing unit, 160...Display control unit, 162...Image generation unit, 164...Providing unit, 170...Control unit, 180...Storage unit, 200...Terminal device

Claims

1. A proofreading processing unit that corrects production data created based on manuscript data, A display control unit generates and displays an image to which the calibration results from the calibration processing unit have been added to the production data, Equipped with, The proofreading processing unit performs at least a first proofreading process which compares the character information contained in the manuscript data with the character information contained in the production data and proofreads the production data based on the comparison result. If, in the first proofreading process, there is character information in the manuscript data that was not detected in the production data, the unit performs a second proofreading process which compares the undetected character information with the character information recognized by the character recognition process on the production data and proofreads the production data based on the comparison result. Calibration support equipment.

2. When the second calibration process is executed, the display control unit displays the first sticky note information indicating the result of the first calibration process and the second sticky note information indicating the result of the second calibration process on the same screen. The calibration support device according to claim 1.

3. The display control unit displays the proofreading results of the character information detected from the production data by the first proofreading process and the proofreading results of the character information detected from the production data by the second proofreading process in different display modes. The calibration support device according to claim 1.

4. If, in the first proofreading process, there is character information in the manuscript data that was not detected from the production data, the display control unit displays an operator on the screen for executing the second proofreading process. The calibration processing unit executes the second calibration process only when the operator is operated. The calibration support device according to claim 1.

5. The proofreading process involves correcting production data created based on the original manuscript data, A display control process that generates and displays an image to which the calibration results from the aforementioned calibration process have been added to the production data, Includes, The proofreading process includes at least a first proofreading process in which the character information contained in the manuscript data is compared with the character information contained in the production data, and the production data is proofread based on the comparison result. If, in the first proofreading process, there is character information in the manuscript data that was not detected in the production data, the undetected character information is compared with the character information recognized by the character recognition process on the production data, and the production data is proofread based on the comparison result. A computer-assisted calibration method.

6. Computers, A proofreading processing means for proofreading production data created based on manuscript data, A display control means for generating and displaying an image to which the calibration results from the calibration processing means have been added to the production data, To make it function as, The proofreading processing means performs at least a first proofreading process which compares the character information contained in the manuscript data with the character information contained in the production data and proofreads the production data based on the comparison result. If, in the first proofreading process, there is character information in the manuscript data that was not detected in the production data, the proofreading processing means performs a second proofreading process which compares the undetected character information with the character information recognized by the character recognition process on the production data and proofreads the production data based on the comparison result. program.

Images