Image processing device, image processing method, and program
Patent Information
- Application Number
- JP2023087154
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-12-06
Smart Images

Figure 2024170150000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]
[0002] 2. Description of the Related Art Image forming devices (image processing devices) that have a scanning function for scanning an original to generate image data and distributing the generated image data to a predetermined destination, and a printing function for printing the image data, etc., are becoming widespread.
[0003] Furthermore, in the process of converting character data that has been recognized by an OCR (Optical Character Recognition / Reader) into data for editing, a technique is known that automatically converts characters that may be misread into correct characters (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]
[0004] There is a demand to detect errors in characters, words, sentences, etc. in image data output (distributed or printed) by an image processing device, to suppress the output of image data in which an error is detected, and to enable a user to check the errors in the image data.
[0005] For example, by applying the technology disclosed in Patent Document 1, characters that may be misread can be converted into correct characters and the output of image data in which an error is detected can be suppressed; however, there is a problem in that the user cannot confirm errors in the image data.
[0006] One embodiment of the present invention has been made in consideration of the above-mentioned problems, and in an image processing device that outputs image data, the output of image data in which an error has been detected is suppressed, and the user is allowed to confirm the error in the image data. [Means for solving the problem]
[0007] In order to solve the above problems, an image processing device according to one embodiment of the present invention has a detection unit that detects errors in characters, words, or sentences in image data, an information addition unit that, when an error is detected, adds information about the detected error to the image data as invisible information that is not visible or difficult to see in the image represented by the image data, and an output control unit that controls the output of the image data, and changes the output method of the image data in which the error has been detected based on the result of the error detection by the detection unit or the invisible information. Effect of the Invention
[0008] According to one embodiment of the present invention, in an image processing apparatus that outputs image data, output of image data in which an error has been detected is suppressed, and the user is allowed to confirm the error in the image data. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration of an image processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a system configuration of an image processing system according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of an image forming apparatus according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a functional configuration of an image forming apparatus according to an embodiment. [Figure 6] 1 is a flowchart (1) illustrating an example of a distribution process according to the first embodiment. [Figure 7] 11A and 11B are diagrams for explaining information added to image data according to an embodiment; [Figure 8] FIG. 11 is a diagram for explaining an example of an OCR result according to an embodiment. [Figure 9]11 is a flowchart (2) illustrating an example of a distribution process according to the first embodiment. [Figure 10] 11 is a flowchart (1) illustrating an example of a printing process according to the second embodiment. [Figure 11] 13 is a flowchart (2) illustrating an example of an output process according to the second embodiment. [Figure 12] 13 is a flowchart showing an example of an output process according to the third embodiment. [Figure 13] FIG. 13 is a diagram for explaining an example of an output process according to the third embodiment. [Figure 14] FIG. 1 is a diagram illustrating an example of a functional configuration of an image processing system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention (the present embodiment) will be described in detail with reference to the drawings.
[0011] <System configuration> Fig. 1 is a diagram (1) showing an example of a system configuration of an image processing system according to an embodiment. In the example of Fig. 1, the image processing system 1 includes a server device 10, a user terminal 20, and an image forming device 100, which are connected to a communication network N such as the Internet and a LAN (Local Area Network).
[0012] The server device 10 is, for example, an information processing device having a computer configuration, or a system configured by a plurality of computers. For example, the server device 10 receives a print job transmitted from a user terminal 20 used by a user, and stores and manages the received print job in a storage unit or the like. In addition, in response to a request from the image forming device 100 to which the user has logged in, the server device 10 provides the image forming device 100 with a list of print jobs registered by the user, or the print job, etc. In addition, the server device 10 has a folder for storing image data (such as a scanned image scanned by the image forming device 100) addressed to a user that has been registered in advance.
[0013] The user terminal 20 is an information processing device used by a user, such as a PC (Personal Computer), a tablet terminal, or a smartphone. The user terminal 20 can register a print job including print target data, such as document data, image data, or print data, and print information, in the server device 10 according to an operation by the user. The user terminal 20 can also acquire image data stored in a folder addressed to the user of the server device 10 according to an operation by the user.
[0014] The image forming apparatus (image processing apparatus) 100 is an image processing apparatus having an image forming function such as a printing function or a scanning function, for example, an MFP (Multifunction Peripheral), a printer, or a scanner. Here, the following description will be given assuming that the image forming apparatus 100 is an MFP having a printing function and a scanning function. Note that the image forming apparatus 100 is an example of an image processing apparatus according to this embodiment.
[0015] For example, a user can use image forming apparatus 100 to display a list of print jobs registered by the user in server apparatus 10 and select a print job from the list of print jobs, thereby printing data to be printed.
[0016] In addition, a user can specify a destination user on the operation screen of image forming device 100, scan a document using image forming device 100, and deliver the scanned image or the like to the destination user's folder on server device 10.
[0017] 1 is an example. For example, the server device 10 is not limited to a physical machine (computer) and may be realized by a virtual machine on a cloud. Also, unlike the image processing system 1 shown in FIG. 1, the server device 10 may not be included.
[0018] 2, the user terminal 20 and the image forming apparatus 100 are communicatively connected via a communication network N. In this case, the user terminal 20 can transmit a print job including print target data, such as document data, image data, or print data, and print information to the image forming apparatus 100 in accordance with an operation by a user. Furthermore, the image forming apparatus 100 executes a print process to print the print target data based on the print job received from the user terminal 20. Furthermore, the image forming apparatus 100 can deliver a scanned image or the like scanned by the user with the image forming apparatus 100 to a predetermined folder in the user terminal 20.
[0019] 1 and 2 are merely examples. The image processing system 1 may be any system that allows a user to perform a printing process in which the user uses the image forming apparatus 100 to print (output) image data, or a process in which the user distributes (outputs) image data scanned by the image forming apparatus 100. For example, in FIG. 2, the user terminal 20 and the image forming apparatus 100 may be connected to each other so as to be able to communicate with each other via a wired cable or the like. The image processing system 1 may also be composed of only the image forming apparatus 100.
[0020] (Processing Overview) There is a demand to detect errors in characters, words, sentences, etc. in image data output (distributed or printed) by image forming device 100, suppress the output of image data in which an error is detected, and enable a user to check the errors in the image data.
[0021] For example, by applying the technology disclosed in Patent Document 1, characters that may be misread can be converted to correct characters and the output of image data in which an error is detected can be suppressed. However, with this method, it is difficult for the user to confirm the error in the image data. In addition, it is difficult to apply this method to printing processing.
[0022] Therefore, the image forming apparatus 100 according to this embodiment detects errors in characters, words, or sentences in image data, and adds information about the detected errors to the image data as invisible information that is not visible or is difficult to see in the image represented by the image data.
[0023] As an example, the image forming apparatus 100 adds information about the detected error as metadata of the image data. Here, metadata is data that describes various information related to the image data. Note that metadata may also be called bibliographic information or bibliographic data. The metadata includes, for example, property information of the image data, or header information (or tag information) of a JPEG file.
[0024] As another example, the image forming apparatus 100 may add information about the detected error to the image data using a known digital watermark technique.
[0025] Furthermore, the image forming apparatus 100 changes the output method of the image data in which an error has been detected, based on the result of the detection of the error in the image data or invisible information added to the image data. For example, the image forming apparatus 100 may sort the image data in which an error has been detected into a predetermined folder. Furthermore, the image forming apparatus 100 may stop or suspend the output of the image data in which an error has been detected. Furthermore, the image forming apparatus 100 may output an alert before outputting the image data in which an error has been detected. Furthermore, the image forming apparatus 100 may present a selection screen to the user to select whether to output the image data or to stop the output.
[0026] In addition, the image forming device 100 may use corrective information such as dictionary data to correctly correct characters, words, sentences, etc. in which errors have been detected, and deliver the corrected image data (scanned image, etc.) to a specified destination, as in the technology disclosed in Patent Document 1, for example.
[0027] This allows the image forming device (image processing device) 100, which outputs image data, to suppress output of image data in which an error has been detected, and allows the user to confirm the error in the image data. For example, the user can confirm the error in the image data by checking the metadata of the image data whose output has been stopped or the image data sorted into a predetermined folder using a predetermined viewer or a viewer function of the image forming device 100, etc.
[0028] Furthermore, in this embodiment, information about the detected error is added to the image data as invisible information that is not visible or difficult to see in the image represented by the image data, so that the image data in which the error was detected can be output as is, depending on the user's judgment.
[0029] <Hardware configuration> (Hardware configuration of server device and user terminal) The server device 10 and the user terminal 20 have, for example, the hardware configuration of a computer 300 as shown in Fig. 3. The server device 10 may be configured by a plurality of computers 300.
[0030] Fig. 3 is a diagram showing an example of a hardware configuration of a computer according to an embodiment. For example, as shown in Fig. 3, a computer 300 includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, a HD (Hard Disk) 304, a HDD (Hard Disk Drive) controller 305, a display 306, an external device connection I / F (Interface) 307, a network I / F 308, a keyboard 309, a pointing device 310, a DVD-RW (Digital Versatile Disk Rewritable) drive 312, a media I / F 314, and a bus line 315.
[0031] Of these, the CPU 301 controls the overall operation of the computer 300. The ROM 302 stores programs used to start up the computer 300, such as an IPL (Initial Program Loader). The RAM 303 is used, for example, as a work area for the CPU 301. The HD 304 stores programs such as an OS (Operating System), applications, and printer drivers, as well as various types of data. The HDD controller 305 controls the reading and writing of various types of data from and to the HD 304 under the control of the CPU 301, for example.
[0032] The display 306 displays various types of information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 307 is an interface that connects various external devices to the computer 300. The network I / F 308 is an interface that connects the computer 300 to a communication network N. The keyboard 309 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 310 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc.
[0033] The DVD-RW drive 312 controls reading and writing of various data from and to a DVD-RW 311, which is an example of a removable recording medium. The DVD-RW 311 is not limited to a DVD-RW, and may be another removable recording medium. The media I / F 314 controls reading and writing (storing) of data from and to a medium 313 such as a flash memory. The bus line 315 includes an address bus, a data bus, various control signals, and the like for electrically connecting the above components.
[0034] (Hardware configuration of image forming device) Fig. 4 is a diagram showing an example of a hardware configuration of an image forming apparatus according to an embodiment. Image forming apparatus 100 includes, for example, a controller 410, a short-range communication circuit 420, an engine control unit 430, an operation panel 440, and a network I / F 450, as shown in Fig. 4.
[0035] Of these, the controller 410 has a CPU 401, which is the main part of the computer, a system memory (MEM-P) 402, a north bridge (NB) 403, a south bridge (SB) 404, an ASIC (Application Specific Integrated Circuit) 405, a local memory (MEM-C) 406, an HDD controller 407, and an HD 408, etc., and is configured such that the NB 403 and the ASIC 405 are connected by an AGP (Accelerated Graphics Port) bus 411.
[0036] Of these, the CPU 401 is a control unit that performs overall control of the image forming apparatus 100. The NB 403 is a bridge for connecting the CPU 401 with the MEM-P 402, the SB 404, and the AGP bus 411, and includes a memory controller that controls reading and writing to the MEM-P 402, a PCI (Peripheral Component Interconnect) master, and an AGP target.
[0037] The MEM-P 402 is composed of a ROM 402a which is a memory for storing programs and data for implementing the various functions of the controller 410, and a RAM 402b which is used for developing the programs and data, and as a drawing memory during memory printing, etc. The programs stored in the RAM 402b may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, CD-R, or DVD in the form of an installable or executable file.
[0038] The SB404 is a bridge for connecting the NB403 to a PCI device and a peripheral device. The ASIC405 is an IC (Integrated Circuit) for image processing purposes having hardware elements for image processing, and plays the role of a bridge connecting the AGP bus 411, the PCI bus 412, the HDD controller 407, and the MEM-C406. The ASIC405 is composed of a PCI target and an AGP master, an arbiter (ARB) that is the core of the ASIC405, a memory controller that controls the MEM-C406, a plurality of DMACs (Direct Memory Access Controllers) that rotate image data using hardware logic, and a PCI unit that transfers data between the scanner unit 431 and the printer unit 432 via the PCI bus 412. The ASIC405 may be connected to a USB interface or an IEEE1394 (Institute of Electrical and Electronics Engineers 1394) interface.
[0039] The MEM-C 406 is a local memory used as a copy image buffer and a code buffer. The HD 408 is a storage for storing image data, font data used during printing, and forms. The HDD controller 407 controls reading and writing of data from and to the HD 408 under the control of the CPU 401. The AGP bus 411 is a bus interface for a graphics accelerator card proposed to speed up graphic processing, and by directly accessing the MEM-P 402 at high throughput, the graphics accelerator card can be made faster.
[0040] The short-distance communication circuit 420 performs various short-distance wireless communications using an antenna 420a for the short-distance communication circuit, etc. The engine control unit 430 is composed of, for example, a scanner unit 431 and a printer unit 432, etc. The scanner unit 431 is a reading device that reads documents, etc. The printer unit 432 is a printing device that prints print data on a print medium. The scanner unit 431 or the printer unit 432 includes, for example, an image processing unit such as error diffusion or gamma conversion.
[0041] Operation panel 440 includes panel display section 440a such as a touch panel that displays current settings and a selection screen and receives input from an operator, and operation buttons 440b including a numeric keypad that receives settings for image formation conditions such as density settings and a start key that receives a copy start command. Controller 410 controls image forming apparatus 100 as a whole, and controls, for example, drawing, communication, and input from operation panel 440.
[0042] The network I / F 450 is an interface for performing data communication using a network. The short-range communication circuit 420 and the network I / F 450 are electrically connected to the ASIC 405 via a PCI bus 412, for example.
[0043] <Functional configuration> 5 is a diagram showing an example of the functional configuration of an image forming apparatus according to an embodiment. Image forming apparatus 100 realizes functional configurations such as a communication unit 501, a reading unit 502, a printing unit 503, a display unit 504, an operation reception unit 505, a detection unit 506, an information addition unit 507, an output control unit 508, and a distribution unit 509 by executing a predetermined program in CPU 401. At least a part of the above functional configurations may be realized by hardware.
[0044] Furthermore, the image forming apparatus 100 implements a storage unit 510 using, for example, the HD 408, the HDD controller 407, the MEM-C 406, and the MEM-P.
[0045] The communication unit 501 connects the image forming apparatus 100 to the communication network N using, for example, the network I / F 450 and executes communication processing for communicating with the server device 10, the user terminal 20, or the like.
[0046] The reading unit 502 controls, for example, the engine control unit 430 and the scanner unit 431 to execute a reading process for scanning (reading) an original and generating image data. The printing unit 503 controls, for example, the engine control unit 430 and the printer unit 432 to execute a printing process for printing print data (image data).
[0047] The display unit 504 executes, for example, a display process for displaying various display screens on the operation panel 440 etc. The operation acceptance unit 505 executes, for example, an operation acceptance process for accepting an input operation on the operation panel 440 by a user.
[0048] The detection unit 506 executes a detection process to detect errors in characters, words, or sentences in the image data. As an example, the detection unit 506 extracts characters by applying a known character recognition technology such as OCR (Optical Character Recognition / Reader) to the image data. Furthermore, the detection unit 506 determines errors in characters, words, or sentences in a scanned image in the image data based on the character extraction result by OCR or the like. Here, the image data includes a scanned image scanned by the reading unit 502, print data printed by the printing unit 503, etc.
[0049] As another example, the detection unit 506 may detect an error in a character, a word, or a sentence by using, for example, a spell check function of a text creation application that has created the text data to be printed. For example, the user terminal 20 may transmit a print job including a spell check result executed by the text creation application to the server device 10 or the image forming device 100, and the detection unit 506 may detect an error in a character, a word, or a sentence based on the spell check result. Alternatively, the user terminal 20 may transmit a print job including text data created by the text creation application to the server device 10 or the image forming device 100. In this case, the server device 10 or the image forming device 100 may perform a spell check of the text data by using, for example, a spell check function of the text application, and detect an error in a character, a word, or a sentence based on the spell check result.
[0050] When an error is detected by the detection unit 506, the information addition unit 507 executes an information addition process to add information on the detected error to the image data as invisible information that is not visible or difficult to be visible in the image represented by the image data. As an example, the information addition unit 507 adds information on the error detected by the detection unit 506 as metadata of the image data. As another example, the image forming apparatus 100 may add information on the detected error to the image data as a digital watermark. Note that the information on the error detected by the detection unit 506 includes, for example, information on the presence or absence of an error, the number of errors, the range of the errors, or the contents of the errors (OCR results, spell check results, etc.).
[0051] The output control unit 508 executes an output control process for controlling the output (distribution or printing) of image data. In addition, the output control unit 508 changes the output method of image data in which an error has been detected, based on the information of the error detected by the detection unit 506, or the invisible information added to the image data by the information addition unit 507, etc.
[0052] For example, the output control unit 508 halts or suspends the output of image data in which an error has been detected based on the error information or invisible information. This allows the output control unit 508 to suppress the output of image data in which an error has been detected. Furthermore, when the output of image data is halted, the user can know that there is an error in the image data, making it easier to check the image data that contains the error.
[0053] Alternatively, the output control unit 508 may sort the image data in which an error has been detected into a predetermined folder based on the error information or invisible information. This makes it easy for the user to check the image data in which an error has been detected by checking the predetermined folder. In addition, the output control unit 508 can suppress the output of the image data in which an error has been detected by suspending or suspending the output of the image data stored in the predetermined folder.
[0054] Alternatively, the output control unit 508 may notify the user that there is an error in the image data before outputting the image data in which an error has been detected based on the error information or invisible information. Furthermore, the output control unit 508 may provide the content of the error in the image data to the user through this notification, and allow the user to select whether to output or cancel the output.
[0055] Alternatively, the output control unit 508 may correct the error in the image data in which an error has been detected based on the error information or invisible information. For example, the output control unit 508 may use corrective information such as dictionary data to correctly correct the character, word, sentence, etc. in which an error has been detected, as in the technique disclosed in Patent Document 1. Note that in this embodiment, the language of the character, word, sentence, etc. may be any language.
[0056] Preferably, when the output control unit 508 corrects an error in image data in which an error has been detected, the information addition unit adds correction information indicating that the error in the image data has been corrected to the image data as the aforementioned invisible information.
[0057] The distribution unit 509 executes a distribution process for distributing the image data to a predetermined destination under the control of the output control unit 508. The storage unit 510 stores various data, information, programs, etc. used by the image forming apparatus 100.
[0058] 5 is an example of the functional configuration of the image forming apparatus 100. As described later, some of the functional configurations of the image forming apparatus 100 may be provided in the server device 10 or the like.
[0059] <Processing flow> Next, the flow of processing of the image processing method according to this embodiment will be described.
[0060] [First embodiment] (Distribution process 1) Fig. 6 is a flowchart (1) showing an example of a distribution process according to the first embodiment. This process shows an example of a distribution process in which the image forming apparatus 100 having the functional configurations described in Fig. 5 distributes a scanned image (image data) to a predetermined destination.
[0061] In step S601, the reading unit 502 executes scanning using the scanner unit 431 to generate a scanned image of a document.
[0062] In step S602, the detection unit 506 extracts character data from the scanned image by performing OCR on the scanned image generated by the reading unit 502. Note that the process of step S602 may be performed by the reading unit 502.
[0063] In step S603, the detection unit 506 detects errors in characters, words, or sentences from the character extraction results obtained by OCR.
[0064] In step S604, the output control unit 508 determines whether or not an error has been detected by the detection unit 506. If an error has not been detected, the output control unit 508 shifts the process to step S605. On the other hand, if an error has been detected, the output control unit 508 shifts the process to step S606.
[0065] When the process proceeds to step S605, the output control unit 508 uses the delivery unit 509 to deliver the image data to a predetermined delivery destination. For example, the output control unit 508 delivers the image data to a destination folder designated by a user of the server device 10. Note that the image data to be delivered may be a scanned image scanned by the reading unit 502, or an OCR image in which character data extracted by OCR is added to a scanned image.
[0066] In step S606, the information adding unit 507 adds information about the detected error to the image data as invisible data. For example, the information adding unit 507 adds information about the detected error to metadata of the image data.
[0067] 7 is a diagram for explaining error information added to image data according to one embodiment. This diagram shows an example in which a property screen 700 of image data is displayed using a function of the OS. In this manner, the information adding unit 507 may add information on the detected error as property information of the image data.
[0068] In the example of Figure 7, information such as "whether there are errors," "number of errors," "spelling check results," "OCR results," "number of corrections," and "content of corrections" has been added as error information 701 to the image data property screen 700.
[0069] "Presence or absence of errors" is information indicating whether or not there are detected errors. "Number of errors" is information indicating the number of detected errors. Note that when the error information includes the "number of errors," information adding unit 507 may indicate the presence or absence of errors based on whether the "number of errors" is "0" or not, instead of "presence or absence of errors."
[0070] "Spell check result" is information indicating the result of a spell check. For example, if an error is found in a spell check, "spelling check result" stores a list of information such as the characters, words, or sentences in which the error was found.
[0071] "OCR result" is information indicating the result of OCR. For example, if an error is found in the result of extracting characters by OCR, the "OCR" result includes the character, word, or sentence in which the error was found, and coordinate information indicating the position of the character, word, or sentence in which the error was found. For example, as shown in FIG. 8, the word "tomato" in the manuscript data is extracted as the word "te-wait" in the OCR and the OCR image data in which the error was detected. In this case, the "OCR result" stores the start coordinates (x1, y1) and end coordinates (x1, y2) of the word "te-wait" in which the error was found.
[0072] The information adding unit 507 may add information on the detected error not only to property information but also to, for example, header information or tag information of the image data. The information adding unit 507 may add information on the detected error to the image data by digital watermarking. Furthermore, the information adding unit 507 may add information on the detected error to, for example, a layer separate from the image of the image data. Furthermore, the information adding unit 507 may add the character, word, sentence, etc. in which the error was detected as visible information such as a marker.
[0073] Returning now to FIG. 6, the description of the flowchart will continue. In step S607, the output control unit 508 sorts the image data into folders. For example, the output control unit 508 sorts the image data in which an error is detected into a predetermined folder. Alternatively, the output control unit 508 may store the image data in which no error is detected into a first folder, and store the image data in which an error is detected into a second folder different from the first folder. Furthermore, the output control unit 508 may sort the image data in which an error is detected into different folders according to, for example, error information (the number of errors, the contents of the errors, etc.).
[0074] Through the process of FIG. 6, the output control unit 508 can change the output method of the image data in which an error has been detected, based on the result of the error detection by the detection unit 506.
[0075] (Distribution process 2) Fig. 9 is a flowchart (2) showing an example of a distribution process according to the first embodiment. This process shows another example of a distribution process in which the image forming apparatus 100 having the functional configurations described in Fig. 5 distributes a read scanned image (image data) to a predetermined distribution destination. Among the processes shown in Fig. 9, the processes of steps S601 to S603 are similar to the processes described in Fig. 6, and therefore will not be described here.
[0076] In step S901, the information adding unit 507 adds the error detection result by the detection unit 506 to the image data as invisible information. For example, the information adding unit 507 adds the error detection result to metadata of the image data. In this way, the information adding unit 507 may add the error detection result as invisible information to image data in which no error was detected.
[0077] In step S902, the output control unit 508 determines whether or not the image data contains an error detected by the detection unit 506, based on the invisible information added to the image data. If no error is detected, the output control unit 508 shifts the process to step S903. On the other hand, if an error is detected, the output control unit 508 shifts the process to step S904. In this way, the output control unit 508 may determine whether or not the image data contains an error detected, based on the invisible information added to the image data.
[0078] In step S903, the output control unit 508 distributes the image data to a predetermined distribution destination using the distribution unit 509. This process may be similar to the process in step S605 in FIG.
[0079] When the process proceeds to step S904, the output control unit 508 notifies the user that an error has been detected from the image data. For example, the output control unit 508 uses the display unit 504 to display a notification screen indicating that an error has been detected from the image data on the operation panel 440 or the like. The output control unit 508 may display information on the detected error on the notification screen indicating that an error has been detected from the image data. Furthermore, the output control unit 508 may display a selection button for selecting whether to deliver or cancel the image data on the notification screen indicating that an error has been detected from the image data, and may determine whether to deliver or cancel the image data in response to a selection operation by the user.
[0080] In step S905, the output control unit 508 sorts the image data in which an error has been detected into a predetermined folder. In this manner, the output control unit 508 may omit sorting the distributed image data.
[0081] By the process of FIG. 9, the output control unit 508 can change the output method of image data in which an error has been detected, based on the invisible information added to the image data.
[0082] [Second embodiment] (Printing process 1) Fig. 10 is a flowchart (1) showing an example of a print process according to the second embodiment. This process shows an example of a print process in which the image forming apparatus 100 having the functional configurations described in Fig. 5 prints data to be printed.
[0083] In step S1001, the printing unit 503 acquires data to be printed from the server device 10 or the user terminal 20, for example.
[0084] In step S1002, the detection unit 506 detects errors from the spell check result of the data to be printed. For example, if the acquired data to be printed (print data) includes the spell check result executed by a word processing application, the detection unit 506 detects errors in characters, words, or sentences of the data to be printed based on the spell check result.
[0085] Alternatively, if the acquired data to be printed (print job) includes text data created by a text creation application, the detection unit 506 performs a spell check on the text data using a spell check function of the text application, etc. The detection unit 506 may also detect errors in characters, words, or sentences based on the results of this spell check.
[0086] In step S1003, the output control unit 508 determines whether or not an error has been detected by the detection unit 506. If no error has been detected, the output control unit 508 shifts the process to step S1004. On the other hand, if an error has been detected, the output control unit 508 shifts the process to step S1005.
[0087] In step S1004, the printing unit 503 prints the data to be printed. In step S1004, the information adding unit 507 adds information about the detected error to the image data as invisible data. For example, the information adding unit 507 adds information about the detected error to metadata of the image data.
[0088] In step S1006, the output control unit 508 sorts the print target data to which the information about the detected error has been added into a predetermined folder.
[0089] Through the process of FIG. 10, the output control unit 508 can change the output method of the print target data in which an error has been detected, based on the result of the spell check of the print target data (image data).
[0090] (Printing process 2) Fig. 11 is a flowchart (2) showing an example of a print process according to the second embodiment. This process shows another example of a print process in which the image forming apparatus 100 having the functional configurations described in Fig. 5 prints data to be printed.
[0091] In step S1101, the detection unit 506 performs OCR on the image data to be printed. Here, the image data to be printed may be, for example, a scanned image scanned by the reading unit 502, or may be print data acquired from the server device 10 or the user terminal 20.
[0092] In step S1102, the detection unit 506 detects errors in characters, words, or sentences from the character extraction results by OCR.
[0093] In step S1103, the output control unit 508 determines whether or not an error has been detected by the detection unit 506. If an error has not been detected, the output control unit 508 shifts the process to step S1105. On the other hand, if an error has been detected, the output control unit 508 shifts the process to step S1104.
[0094] In step S1104, the information adding unit 507 adds information about the detected error to the image data as invisible data. For example, the information adding unit 507 adds information about the detected error to metadata of the image data.
[0095] In step S1005, the output control unit 508 sorts the image data into folders depending on the presence or absence of an error in the image data, or the content of the error.
[0096] In step S1006, the output control unit 508 uses the printing unit 503 to print the image data sorted into a predetermined folder.
[0097] By the process of FIG. 11, the output control unit 508 can change the output method of the print target data in which an error is detected, regardless of the result of the spell check of the print target data (image data).
[0098] [Third embodiment] FIG. 12 is a flowchart showing an example of an output process of image data according to the third embodiment.
[0099] In step S1201, the image forming apparatus 100 starts output processing of the image data (distribution processing of the image data, or printing processing of the image data).
[0100] In step S1202, the detection unit 506 detects errors in characters, words, or sentences from the image data. The method of detecting errors may be based on the results of character extraction by OCR or the results of a spell check on the image data.
[0101] In step S1203, the output control unit 508 determines whether or not an error has been detected by the detection unit 506. If no error has been detected, the output control unit 508 shifts the process to step S1204. On the other hand, if an error has been detected, the output control unit 508 shifts the process to step S1205.
[0102] In step S1204, the output control unit 508 outputs (distributes or prints) the image data.
[0103] In step S1205, the information adding unit 507 adds information about the detected error to the image data as invisible data. For example, the information adding unit 507 adds information about the detected error to metadata of the image data.
[0104] In step S1206, the output control unit 508 determines whether or not to correct the error detected from the image data. As an example, it is assumed that in the image forming apparatus 100, when an error is detected from the image data, whether or not to correct the error is set as setting information that can be set by a user, an administrator, or the like. In this case, the output control unit 508 determines whether or not to correct the error detected from the image data based on the setting information set by the user, an administrator, or the like.
[0105] As another example, the output control unit 508 may use the display unit 504 to display a selection screen on the operation panel 440, etc., which allows the user to select whether or not to correct the error, and may decide whether or not to correct the error detected from the image data in accordance with the user's selection operation.
[0106] In step S1208, the output control unit 508 corrects the errors detected from the image data. For example, the output control unit 508 may use correct information such as dictionary data to correctly correct the characters, words, sentences, etc. in which errors have been detected, as in the technique disclosed in Patent Document 1. Alternatively, the output control unit 508 may use an external cloud service or the like that corrects errors in characters, words, sentences, etc. to correctly correct the characters, words, sentences, etc. in which errors have been detected.
[0107] In step S1208, the information adding unit 507 adds correction information indicating that the image data has been corrected to the image data as invisible data. For example, the information adding unit 507 adds the correction information to metadata of the image data.
[0108] In step S1209, the output control unit 508 sorts the image data into different folders depending on whether or not the image data has been corrected. In this way, the output control unit 508 may change the output method of the image data in which an error has been detected in various ways.
[0109] 13 is a diagram for explaining an example of output processing of image data according to the third embodiment. For example, the detection unit 506 executes OCR on manuscript data 1301 and detects errors in characters, words, or sentences from OCR image data 1302.
[0110] Furthermore, when an error is detected in the OCR image data 1302, the output control unit 508 determines whether or not to correct the error. When the error is to be corrected, the output control unit 508 outputs (distributes or prints) corrected image data 1303 obtained by correcting the error in the OCR image data 1302, for example, by sorting the corrected image data into a folder for output. On the other hand, when the error is not to be corrected, the output control unit 508 stops outputting the image data by sorting the uncorrected OCR image data 1302, for example, into a folder for canceling output.
[0111] (Functional configuration of image processing system) Fig. 14 is a diagram showing an example of a functional configuration of an image forming system according to an embodiment. As shown in Fig. 14, at least a part of the functional configuration of the image forming apparatus 100 described in Fig. 5 may be included in the server apparatus 10. In the example of Fig. 14, the server apparatus (image processing apparatus) includes a detection unit 506, an information addition unit 507, an output control unit 508, and a distribution unit 509 among the functional configuration of the image forming apparatus 100 described in Fig. 5. Note that the communication unit 1401 is a communication unit included in the server apparatus 10, and the storage unit 1402 is a storage unit included in the server apparatus 10.
[0112] 6, for example, the process of step S601 is executed by the reading unit 502 of the image forming apparatus 100, and the scanned image is transmitted to the server device 10. In addition, the process of step S602 and subsequent steps is executed by the server device 10.
[0113] Also, in the example of FIG. 10, the processes of steps S1001 to S1003, S1005, and S1006 are executed by the server device 10, and the process of step S1004 is executed by the printing unit 503 of the image forming device 100 as a result of the server device 10 sending the data to be printed to the image forming device 100.
[0114] In this manner, the image processing apparatus according to the present embodiment may be the server apparatus 10. In this case, the image processing system 1 according to the present embodiment can be realized by utilizing an existing image forming apparatus 100.
[0115] As described above, according to each embodiment of the present invention, in an image processing apparatus that outputs image data, output of image data in which an error has been detected is suppressed, and the user is allowed to confirm the error in the image data.
[0116] <Supplementary Information> Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.
[0117] <Additional Notes> This specification discloses the following image processing apparatus, image processing method, and program. (Section 1) A detection unit that detects errors in characters, words, or sentences in image data; an information adding unit that, when the error is detected, adds information about the detected error to the image data as invisible information that is not visible or is difficult to see in an image represented by the image data; an output control unit that controls output of the image data, and changes an output method of the image data in which the error has been detected based on a result of the error detected by the detection unit or the invisible information; The image processing device includes: (Section 2) 2. The image processing device according to claim 1, wherein the output control unit sorts the image data in which the error has been detected into a predetermined folder based on the error information or the invisibility information. (Section 3) 3. The image processing device according to claim 1, wherein the output control unit stops or suspends output of the image data in which the error is detected based on the error information or the invisibility information. (Section 4) The image processing device described in claim 1 or 2, wherein the output control unit notifies a user that the error has been detected in the image data before outputting the image data in which the error has been detected, based on the error information or the invisibility information. (Section 5) The output control unit corrects an error in the image data based on the error information or the invisible information, The information adding unit adds correction information indicating that an error in the image data has been corrected to the image data as the invisible information. 2. An image processing device according to claim 1. (Section 6) a reading unit that scans an original and generates the image data; The detection unit detects the error using a processing result of an OCR process that recognizes characters in the image data and converts them into text data, The output control unit controls the delivery of the image data or the printing of the image data. 6. The image processing device according to any one of items 1 to 5. (Section 7) a printing unit that prints the image data; The detection unit detects the error using a spell check result of the image data, The output control unit controls printing of the image data. 6. The image processing device according to any one of items 1 to 5. (Section 8) the information addition unit adds information about the detected error as metadata of the image data; The information on the errors includes one or more pieces of information on the presence or absence of the errors, the number of the errors, the range of the errors, and the contents of the errors. 8. The image processing device according to any one of items 1 to 7. (Section 9) a detection process for detecting errors in characters, words, or sentences in the image data; an information addition process in which, when the error is detected, information on the detected error is added to the image data as invisible information that is not visible or is difficult to see in the image represented by the image data; an output control process for controlling an output of the image data and changing an output method of the image data in which the error has been detected based on the result of the error detection process or the invisible information; The computer performs an image processing method. (Section 10) a detection process for detecting errors in characters, words, or sentences in the image data; an information addition process in which, when the error is detected, information on the detected error is added to the image data as invisible information that is not visible or is difficult to see in the image represented by the image data; an output control process for controlling an output of the image data and changing an output method of the image data in which the error has been detected based on the result of the error detection process or the invisible information; A program that causes a computer to execute the following.
[0118] Although an embodiment of the present invention has been described above, the present invention is not limited to such a specific embodiment, and various modifications and applications are possible within the scope of the gist of the present invention described in the claims. [Explanation of symbols]
[0119] 1. Image Processing System 10 Server device (another example of an image processing device) 20 User terminal 100 Image forming apparatus (an example of an image processing apparatus) 300 Computers 502 Reading unit 503 Printing Department 506 Detection Unit 507 Information Addition Department 508 Output control section [Prior art documents] [Patent documents]
[0120] [Patent Document 1] JP 2011-150436 A
Claims
1. A detection unit that detects errors in characters, words, or sentences in image data; an information adding unit that, when the error is detected, adds information about the detected error to the image data as invisible information that is not visible or is difficult to see in an image represented by the image data; an output control unit that controls output of the image data, and changes an output method of the image data in which the error has been detected based on a result of the error detected by the detection unit or the invisible information; The image processing device includes:
2. The image processing device according to claim 1 , wherein the output control unit sorts the image data in which the error has been detected into a predetermined folder based on the error information or the invisible information.
3. The image processing device according to claim 1 , wherein the output control unit halts or suspends output of the image data in which the error is detected, based on the error information or the invisibility information.
4. The image processing device according to claim 1 , wherein the output control unit notifies a user that the error has been detected in the image data before outputting the image data in which the error has been detected, based on the error information or the invisible information.
5. The output control unit corrects an error in the image data based on the error information or the invisible information, The information adding unit adds correction information indicating that an error in the image data has been corrected to the image data as the invisible information. The image processing device according to claim 1 .
6. a reading unit that scans an original and generates the image data; The detection unit detects the error using a processing result of an OCR process that recognizes characters in the image data and converts them into text data, The output control unit controls the delivery of the image data or the printing of the image data. The image processing device according to claim 1 .
7. a printing unit that prints the image data; The detection unit detects the error using a spell check result of the image data, The output control unit controls printing of the image data. The image processing device according to claim 1 .
8. the information addition unit adds information about the detected error as metadata of the image data; The information on the errors includes one or more pieces of information on the presence or absence of the errors, the number of the errors, the range of the errors, and the contents of the errors. The image processing device according to claim 1 .
9. The image processing device a detection process for detecting errors in characters, words, or sentences in the image data; an information addition process in which, when the error is detected, information on the detected error is added to the image data as invisible information that is not visible or is difficult to see in the image represented by the image data; an output control process for controlling an output of the image data and changing an output method of the image data in which the error has been detected based on the result of the error detection process or the invisible information; The image processing method according to claim 1,
10. a detection process for detecting errors in characters, words, or sentences in the image data; an information addition process in which, when the error is detected, information on the detected error is added to the image data as invisible information that is not visible or is difficult to see in the image represented by the image data; an output control process for controlling an output of the image data and changing an output method of the image data in which the error has been detected based on the result of the error detection process or the invisible information; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Method for substituting character data
JP2011150436A
