Image processing apparatus, image processing method, and program

Abstract

To provide an image processing device, an image processing method, and a program that can prompt a user to introduce a function to be a trial target while enabling the use of the function with the same operation as when the function has been introduced without degrading the function.SOLUTION: An image processing device that has a function to superimpose a character string obtained by OCR processing from an image containing a character string as a transparent character layer on the image as a trial target, an OCR processing unit that performs OCR processing on a scanned image read from a document by a reading unit to obtain an OCR result that is character information, a first generating unit that determines an area occupied by a trial pattern indicating that the function is in a trial period on the basis of at least the trial use history of the function, and generates trial pattern information having a size corresponding to the area, and a second generation unit that generates a file in which the OCR result is converted into a transparent text layer and trial pattern information is superimposed on the scanned image.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] There is a known technology for generating a searchable PDF to improve searchability by adding text recognized by OCR (Optical Character Recognition) processing to PDF (Portable Document Format) data generated from a scanned image read by a scanner unit in an MFP (Multifunction Peripheral). A searchable PDF is generated by arranging a transparent text layer obtained by OCR processing on the scanned data. Here, the MFP is an image forming device having at least two of the following functions: copy function, printer function, scanner function, and fax function. In addition, since the function for generating a searchable PDF is usually provided as an optional function of the MFP for a fee, it is known that a trial period is provided for officially adopting the optional function.

[0003] As a technique for using such a function that is the subject of a trial, a technique for setting a trial period for the function that is the subject of a trial, or a technique for setting the function to a trial mode in order to test the function, has been disclosed (for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology of Patent Document 1 has a problem in that complicated operations must be performed in order to try out the function to be tested, and the function cannot be used with the same operations as if the function were officially installed.

[0005] The present invention has been made in view of the above, and an object thereof is to provide an image processing apparatus, an image processing method, and a program that can prompt a user to introduce a function while enabling the use of the function with the same operation as when the function is introduced without degrading the function to be tested.

Means for Solving the Problems

[0006] In order to solve the above-described problems and achieve the object, the present invention is an image processing apparatus having, as a function to be tested, a function of superimposing, as a character layer in which the character string obtained by OCR processing from an image including a character string is made transparent, on the image, an OCR processing unit that executes OCR processing on a scanned image read by a reading unit from a document to obtain an OCR result that is character information, a first generation unit that determines an area occupied by a trial pattern indicating that it is during a trial period of the function based on at least a trial history of the function, and generates trial pattern information having a size corresponding to the area, and a second generation unit that generates a file in which a character layer in which the OCR result is in a transparent text state and the trial pattern information are superimposed on the scanned image.

Effects of the Invention

[0007] According to the present invention, it is possible to prompt a user to introduce a function while enabling the use of the function with the same operation as when the function is introduced without degrading the function to be tested.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the image processing apparatus, image processing method, and program according to the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the following embodiments, and the constituent elements in the following embodiments include those that can be easily conceived by those skilled in the art, substantially the same ones, and those within the so-called equivalent range. Furthermore, various omissions, substitutions, changes, and combinations of the constituent elements can be made without departing from the gist of the following embodiments.

[0010] (Overall Configuration of Information Processing System) FIG. 1 is a diagram showing an example of the overall configuration of the information processing system according to the embodiment. While referring to FIG. 1, the overall configuration of the information processing system 1 according to the present embodiment will be described.

[0011] As shown in FIG. 1, the information processing system 1 includes an image forming apparatus 10 and a PC (Personal Computer) 20. Data communication is possible between these devices via the network 2. The network 2 is a network configured by at least any one of a LAN (Local Area Network), a VPN (Virtual Private Network), or the Internet.

[0012] The image forming apparatus 10 is an MFP equipped with at least a scanner unit for reading a document and having a function of generating PDF data from the scanned image read by the scanner unit. The image forming apparatus 10 is an example of an image processing apparatus. Note that the image processing apparatus is not limited to an MFP, and for example, a scanner apparatus having the above-described function may be used.

[0013] As will be described later, the PC 20 is an information processing apparatus for changing the content of a trial pattern to be added to a scanned image in the function of generating a searchable PDF that is a trial target.

[0014] In the configuration of the information processing system 1 shown in FIG. 1, the image forming apparatus 10 and the PC 20 are each included as one unit, but the present invention is not limited to this, and at least any one of them may be plural.

[0015] (Hardware Configuration of Image Forming Apparatus) FIG. 2 is a diagram showing an example of the hardware configuration of the image forming apparatus according to the embodiment. While referring to FIG. 2, the hardware configuration of the image forming apparatus 10 according to the present embodiment will be described.

[0016] As shown in FIG. 2, the image forming apparatus 10 has a configuration in which a controller 500, an operation display unit 510, an FCU (Facsimile Control Unit) 520, a plotter 531, and a scanner 532 are connected by a PCI (Peripheral Component Interface) bus.

[0017] The controller 500 is a device that controls the entire image forming apparatus 10, performs drawing, communication, and controls inputs from the operation display unit 510.

[0018] The operation display unit 510 is, for example, a touch panel or the like, and is a device that accepts inputs to the controller 500 (input function) and displays the state of the image forming apparatus 10 and the like (display function), and is directly connected to an ASIC (Application Specific Integrated Circuit) 506 described later.

[0019] The FCU 520 is a device that realizes a facsimile function, and is connected to the ASIC 506 by, for example, a PCI bus.

[0020] The plotter 531 is a device that realizes a printing function, and is connected to the ASIC 506 by, for example, a PCI bus. The scanner 532 is a function that realizes a scanner function, and is connected to the ASIC 506 by, for example, a PCI bus.

[0021] The controller 500 includes a CPU (Central Processing Unit) 501, a system memory (MEM-P) 502, a north bridge (NB) 503, a south bridge (SB) 504a, a network I / F 504b, a USB (Universal Serial Bus) I / F 504c, a Centronics I / F 504d, a sensor I / F 504e, an ASIC 506, a local memory (MEM-C) 507, and an auxiliary storage device 508.

[0022] The CPU 501 is an arithmetic unit that performs overall control of the image forming apparatus 10, and is connected to a chipset including a system memory 502, a north bridge 503, and a south bridge 504a, and is connected to other devices via this chipset.

[0023] The system memory 502 is a memory used as a memory for storing programs and data, a memory for expanding programs and data, and a memory for printing of a printer, etc., and has a ROM (Read Only Memory) and a RAM (Random Access Memory). Among these, the ROM is a read-only memory used as a memory for storing programs and data, and the RAM is a writable and readable memory used as a memory for expanding programs and data, and a memory for printing of a printer, etc.

[0024] The north bridge 503 is a bridge for connecting the CPU 501 to the system memory 502, the south bridge 504a, and an AGP (Accelerated Graphics Port) bus 505, and has a memory controller for controlling reading and writing to the system memory 502, a PCI master, and an AGP target.

[0025] The south bridge 504a is a bridge for connecting the north bridge 503 to PCI devices and peripheral devices. The south bridge 504a is connected to the north bridge 503 via a PCI bus, and a network I / F 504b, a USB I / F 504c, a Centronics I / F 504d, a sensor I / F 504e, etc. are connected to the PCI bus.

[0026] The AGP bus 505 is a bus interface for a graphics accelerator card proposed for accelerating graphic processing. The AGP bus 505 is a bus that speeds up the graphics accelerator card by directly accessing the system memory 502 with high throughput.

[0027] ASIC506 is an IC (Integrated Circuit) for image processing applications that has hardware elements for image processing, and serves as a bridge for connecting the AGP bus 505, PCI bus, auxiliary storage device 508, and local memory 507 respectively. ASIC506 consists of a PCI target and AGP master, an arbiter (ARB) that forms the core of ASIC506, a memory controller that controls the local memory 507, multiple DMACs (Direct Memory Access Controllers) that perform operations such as rotation of image data by means of hardware logic, etc., and a PCI unit that transfers data via the PCI bus between the plotter 531 and scanner 532. To ASIC506, for example, the FCU520, plotter 531, and scanner 532 are connected via the PCI bus. Also, ASIC506 is connected to a host PC (Personal Computer) and network, etc. not shown in the figure.

[0028] The local memory 507 is a memory used as a copy image buffer and a code buffer.

[0029] The auxiliary storage device 508 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), SD (Secure Digital) card, or flash memory, and is a storage for accumulating image data, programs, font data, forms, etc.

[0030] Note that the hardware configuration of the image forming apparatus 10 shown in FIG. 2 is an example, and it is not necessary to include all the constituent devices, and other constituent devices may be included. For example, the image forming apparatus 10 may include an ADF (Automatic Document Feeder), etc.

[0031] (Configuration and Operation of Functional Blocks of Image Forming Apparatus) FIG. 3 is a diagram showing an example of the configuration of the functional blocks of the image forming apparatus according to the embodiment. With reference to FIG. 3, the configuration and operation of the functional blocks of the image forming apparatus 10 according to the present embodiment will be described.

[0032] As shown in FIG. 3, the image forming apparatus 10 includes a reading unit 101, an OCR processing unit 102, a margin detection unit 103 (detection unit), a display level determination unit 104, a trial pattern generation unit 105 (first generation unit), an image synthesis unit 106 (first synthesis unit), a PDF generation unit 107 (second generation unit), a communication unit 108 (transmission unit), a setting unit 109, a storage unit 110, an input unit 111, and a display control unit 112.

[0033] The reading unit 101 is a functional unit that reads a scan document placed on the reading document table of the image forming apparatus 10 and converts it into data as a scan image. The reading unit 101 outputs the scan image to the OCR processing unit 102, the margin detection unit 103, and the image synthesis unit 106. The reading unit 101 is realized by the scanner 532 shown in FIG. 2.

[0034] The OCR processing unit 102 is a functional unit that extracts text such as characters from the scan image read by the reading unit 101 and outputs text information (character information), which is a set of information such as character code, character size, and position, as an OCR result. The OCR processing unit 102 outputs the OCR result to the PDF generation unit 107. The OCR processing unit 102 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0035] The margin detection unit 103 is a functional unit that detects a margin area for superimposing a trial pattern image, which will be described later, within the scanned image read by the reading unit 101. Here, the margin area refers to an area that does not include objects such as characters and photos, and is extracted as a pixel area of a smooth part, for example, by a morphological filter or the like. After detecting the margin part, the margin detection unit 103 performs labeling on the continuous pixel area of the margin part, and outputs it to the trial pattern generation unit 105 as a pattern candidate area (candidate area) including information such as the range and area of the area for each labeled area. The margin detection unit 103 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0036] The display level determination unit 104 is a functional unit that determines a pattern addition level indicating the intensity of a trial pattern based on the trial history of the generation function of the searchable PDF of the service usage history information stored in the storage unit 110. The pattern addition level indicates the intensity of the trial pattern as described above and represents the degree of trial of the generation function of the searchable PDF, which is the function to be tried. The pattern addition level is set in a numerical range of 0 to 255, for example, based on the trial history of the generation function of the searchable PDF. In this case, when the pattern addition level is 0, it indicates a state where no trial pattern is added. Also, when the pattern addition level is 255, it indicates a state where the intensity of the trial pattern is maximum. Here, the service usage history information is assumed to be information that records the usage history of functions in the image forming apparatus 10, and for the generation function of the searchable PDF, the usage date and time, the number of used pages, the number and frequency of trials, and the user, etc. are held as the trial history. For example, when the trial history of the generation function of the searchable PDF indicates that the cumulative number of used pages is large but the number of recent used pages is small, the display level determination unit 104 may lower the pattern addition level. Also, when the trial history indicates that it is within one month from the start of the trial, the display level determination unit 104 may not increase the pattern addition level. Thus, the display level determination unit 104 determines the pattern addition level from the trial history of the generation function of the searchable PDF by a predetermined method based on the intention of the provider of the function for the trial.

[0037] Also, when the display level determination unit 104 can obtain the license information of the generation function of the searchable PDF from the license information stored in the storage unit 110, it determines the pattern addition level to be 0 regardless of the trial history of the generation function. Here, the license information is information indicating the presence or absence of a license for functions that require a license in the image forming apparatus 10. The display level determination unit 104 outputs the determined pattern addition level to the trial pattern generation unit 105. The display level determination unit 104 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0038] The trial pattern generation unit 105 is a functional unit that generates a trial pattern image (an example of trial pattern information) for overlapping the pattern candidate area of the scanned image based on the pattern addition level determined by the display level determination unit 104, the pattern candidate area detected by the margin detection unit 103, and the trial pattern prototype information stored in the storage unit 110. Here, the trial pattern prototype information is data that serves as a prototype of the trial pattern indicating that it is during the trial period. Since it assumes enlargement or reduction, it is assumed to be text information or a vector image. Further, the trial pattern prototype information includes one or more trial patterns as prototypes, and the trial pattern generation unit 105 appropriately selects a trial pattern from among them to generate a trial pattern image.

[0039] For example, when the trial pattern of the trial pattern prototype information is an image (vector image), the trial pattern generation unit 105 determines the area that the trial pattern should occupy based on the pattern addition level and the image size of the scanned image, searches for a pattern candidate area corresponding to that area, and enlarges or reduces the trial pattern so that it can be superimposed on the found pattern candidate area to generate a trial pattern image. Note that if the trial pattern generation unit 105 does not find a pattern candidate area corresponding to the determined area, it may combine a plurality of pattern candidate areas to form an area corresponding to that area. Further, the trial pattern generation unit 105 may generate a trial pattern image by arranging a plurality of trial patterns so that they can be superimposed on the found pattern candidate area.

[0040] In addition, when the trial pattern of the trial pattern prototype information is text, the trial pattern generation unit 105 determines the area that the trial pattern should occupy based on the pattern addition level and the image size of the scanned image, searches for a pattern candidate area corresponding to the area, and enlarges or reduces the font size of the trial pattern so that it can be superimposed on the found pattern candidate area to generate a trial pattern image. Note that when the trial pattern generation unit 105 cannot find a pattern candidate area corresponding to the determined area, it may combine a plurality of pattern candidate areas to form an area corresponding to the area. In addition, the trial pattern generation unit 105 may generate a trial pattern image by arranging a plurality of texts of the trial pattern so that they can be superimposed on the found pattern candidate area.

[0041] Note that the trial pattern generation unit 105 may change the color in the trial pattern image or the content of the trial pattern according to the pattern addition level and the image size of the scanned image.

[0042] The trial pattern generation unit 105 outputs the generated trial pattern image to the image composition unit 106. The trial pattern generation unit 105 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0043] The image composition unit 106 is a functional unit that generates a composite image by superimposing (composing) the trial pattern image generated by the trial pattern generation unit 105 on the pattern candidate area found by the trial pattern generation unit 105 in the scanned image. The image composition unit 106 outputs the generated composite image to the PDF generation unit 107. The image composition unit 106 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0044] The PDF generation unit 107 is a functional unit that generates a searchable PDF (an example of a file) by superimposing the OCR result by the OCR processing unit 102 on the composite image generated by the image composition unit 106 as a character layer in a state of transparent text. The PDF generation unit 107 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0045] The communication unit 108 is a functional unit that performs data communication with an external device such as a PC 20 via the network 2. The communication unit 108 is realized, for example, by the network I / F 504b shown in FIG. 2 and the execution of a program by the CPU 501.

[0046] The setting unit 109 is a functional unit that receives the content edited for the trial pattern in the PC 20 via the communication unit 108 and reflects (sets) the content in the trial pattern template information of the storage unit 110. The setting unit 109 is realized, for example, by the execution of a program by the CPU 501 shown in FIG. 2. Note that the communication unit 108 may transmit the trial history of the generation function of the searchable PDF of the service usage history information stored in the storage unit 110 to the PC 20. Thereby, the user using the PC 20 can edit the trial pattern based on the trial history of the generation function of the searchable PDF transmitted from the setting unit 109 of the image forming apparatus 10.

[0047] The storage unit 110 is a functional unit that stores information such as trial pattern template information, license information, and service usage history information, for example. The storage unit 110 is realized by the auxiliary storage device 508 shown in FIG. 2.

[0048] The input unit 111 is a functional unit that receives operation inputs. The input unit 111 is realized by the input function of the operation display unit 510 shown in FIG. 2.

[0049] The display control unit 112 is a functional unit that controls the display operation based on the display function of the operation display unit 510. The display control unit 112 is realized, for example, by the execution of a program by the CPU 501 shown in FIG. 2.

[0050] Note that the OCR processing unit 102, margin detection unit 103, display level determination unit 104, trial pattern generation unit 105, image composition unit 106, PDF generation unit 107, setting unit 109, and display control unit 112 shown in FIG. 3 are not limited to being realized by the CPU 501 in FIG. 2 executing a program. For example, they may be realized by hardware such as an integrated circuit, or may be realized by a combination of software and hardware.

[0051] Also, each functional unit of the image forming apparatus 10 shown in FIG. 3 conceptually shows the functions and is not limited to such a configuration. For example, a plurality of functional units shown as independent functional units in FIG. 3 may be configured as one functional unit. On the other hand, the functions of one functional unit in FIG. 3 may be divided into a plurality, and may be configured as a plurality of functional units.

[0052] (Example of a searchable PDF including a trial pattern image) FIG. 4 is a diagram showing an example of a scanned document before a trial pattern is added. FIG. 5 is a diagram showing an example of a searchable PDF to which a trial pattern with a low pattern addition level is added. FIG. 6 is a diagram showing an example of a searchable PDF to which a trial pattern with a medium pattern addition level is added. FIG. 7 is a diagram showing an example of a searchable PDF to which a trial pattern with a high pattern addition level is added. FIG. 8 is a diagram showing an example of a searchable PDF when the trial pattern is emphasized. FIG. 9 is a diagram showing an example of a searchable PDF when a plurality of trial patterns are arranged. FIG. 10 is a diagram showing an example of a search when a two-dimensional code-encoded trial pattern is added. With reference to FIGS. 4 to 10, an example of a searchable PDF generated by the image forming apparatus 10 will be described.

[0053] FIG. 4 shows an example of a scanned document before a trial pattern is added. Hereinafter, a case where the scanned document shown in FIG. 4 is read by the reading unit 101 and converted into data as a scanned image will be described.

[0054] FIG. 5 shows an example of a searchable PDF to which a trial pattern image PN1 generated by a trial pattern generation unit 105 is added when the pattern addition level determined by a display level determination unit 104 is small because the degree of trial of the searchable PDF generation function is small. In this case, since the degree of trial of the searchable PDF generation function is small, it is a searchable PDF in which the small-area trial pattern image PN1 is superimposed on a small-area and inconspicuous pattern candidate region detected by a margin detection unit 103.

[0055] FIG. 6 shows an example of a searchable PDF to which a trial pattern image PN2 generated by a trial pattern generation unit 105 is added when the degree of trial of the searchable PDF generation function is more advanced than in the case of FIG. 5 and the pattern addition level determined by a display level determination unit 104 is larger than in the case of FIG. 5. In this case, since the degree of trial of the searchable PDF generation function is more advanced than in the case of FIG. 5, it is a searchable PDF in which a trial pattern image PN2 larger than the trial pattern image PN1 shown in FIG. 5 is superimposed on a somewhat larger pattern candidate region detected by a margin detection unit 103 and located closer to the center than in the case of FIG. 5.

[0056] FIG. 7 shows an example of a searchable PDF to which a trial pattern image PN3 generated by a trial pattern generation unit 105 is added when the degree of trial of the searchable PDF generation function is further advanced than in the case of FIG. 6 and the pattern addition level determined by a display level determination unit 104 is even larger than in the case of FIG. 6. In this case, since the degree of trial of the searchable PDF generation function is further advanced than in the case of FIG. 6, it is a searchable PDF in which a trial pattern image PN3 larger than the trial pattern image PN2 shown in FIG. 6 is superimposed on a larger pattern candidate region detected by a margin detection unit 103. Note that, as shown in FIG. 7, the pattern candidate region detected by the margin detection unit 103 is not limited to a rectangular region, and a region combining a plurality of rectangular regions may be used as the pattern candidate region.

[0057] Also, as shown in FIG. 8, the trial pattern generation unit 105 may generate a trial pattern image PN4 in which the trial pattern image is emphasized by inversion display or the like according to the pattern addition level determined by the display level determination unit 104. This can be made conspicuous by highlighting, for example, when there is no pattern candidate area corresponding to the area of the trial pattern determined according to the pattern addition level by the trial pattern generation unit 105.

[0058] Also, as shown in FIG. 9, instead of enlarging the trial pattern for the pattern candidate area corresponding to the area of the trial pattern determined according to the pattern addition level, the trial pattern generation unit 105 may generate a trial pattern image PN5 in which the trial patterns are arranged. This can correspond to the area of the trial pattern determined according to the pattern addition level by arranging the trial patterns, for example, when the trial pattern is text and cannot be output as a font of a predetermined size or more.

[0059] Also, as shown in FIG. 10, the trial pattern generation unit 105 may generate, as the trial pattern image PN6, a two-dimensional code in which, as the trial pattern, the inquiry destination or the like for the generation function of the searchable PDF is encoded according to the area of the trial pattern determined according to the pattern addition level. In this case, as shown in FIG. 10, the trial pattern generation unit 105 may generate a trial pattern image in which a trial pattern indicating that it is in use is also written for the two-dimensional code.

[0060] As described above, the image forming apparatus 10 according to the present embodiment has, as a function to be tried, a function of superimposing, as a character layer in which the character string obtained by OCR processing from an image including a character string is in a transparent state, on the image. The OCR processing unit 102 executes OCR processing on the scanned image read by the reading unit 101 from the scanned document to obtain an OCR result which is character information. The trial pattern generation unit 105 determines the area occupied by the trial pattern indicating that it is during the trial period of the function to be tried, based on at least the trial history of the function to be tried, generates a trial pattern image having a size corresponding to the area, and the PDF generation unit 107 generates a searchable PDF in which a character layer in which the OCR result is in a transparent text state and the trial pattern image are superimposed on the scanned image. Further, the trial pattern generation unit 105 generates a trial pattern image having a size corresponding to the area, the image composition unit 106 generates a composite image by superimposing the trial pattern image on the scanned image, and the PDF generation unit 107 generates a searchable PDF by superimposing, as a character layer in which the OCR result is in a transparent text state, on the composite image. Thus, the user can execute the function of performing OCR processing to be tried and generating a searchable PDF by a normal operation in the case of generating a PDF file, such as causing the reading unit 101 to read the scanned document. Therefore, without degrading the function to be tried, it is possible to use the function with the same operation as when the function is introduced, and it is possible to prompt the user to introduce the function.

[0061] Note that the trial pattern image is superimposed on the pattern candidate area, but is not limited thereto. The PDF generation unit 107 may generate a searchable PDF in a state where at least a part of the trial pattern image overlaps an object in the scanned image. In this case, the image forming apparatus 10 may not include the margin detection unit 103. In this way, by overlapping at least a part of the trial pattern image on an object in the scanned image, it is possible to more strongly emphasize that the searchable PDF generation function is the function to be tried.

[0062] (Modification Example 1) Regarding the image forming apparatus according to Modification Example 1, the differences from the image forming apparatus 10 according to the above-described embodiment will be mainly described. In the above-described embodiment, the operation of generating a searchable PDF by superimposing an OCR result as a character layer in a transparent state on a composite image obtained by generating a trial pattern image and superimposing it on a scanned image was described. In this modification example, the operation of generating a searchable PDF by superimposing not only the OCR result based on the scanned image but also the character layer of the transparent text of the trial pattern on the composite image will be described. Note that the overall configuration of the information processing system according to this modification example and the hardware configuration of the image forming apparatus are the same as those described in the above-described embodiment.

[0063] FIG. 11 is a diagram showing an example of the configuration of the functional blocks of the image forming apparatus according to Modification Example 1. With reference to FIG. 11, the configuration and operation of the image forming apparatus 10a according to this modification example will be described.

[0064] As shown in FIG. 11, the image forming apparatus 10a includes a reading unit 101, an OCR processing unit 102, a margin detection unit 103 (detection unit), a display level determination unit 104, a trial pattern generation unit 105 (first generation unit), an image synthesis unit 106 (first synthesis unit), a PDF generation unit 107 (second generation unit), a communication unit 108 (transmission unit), a setting unit 109, a storage unit 110, an input unit 111, a display control unit 112, and a text synthesis unit 113 (second synthesis unit). Note that, among the above-described functional units, the operations of the reading unit 101, the margin detection unit 103, the display level determination unit 104, the image synthesis unit 106, the communication unit 108, the setting unit 109, the storage unit 110, the input unit 111, and the display control unit 112 are the same as those described in the above-described embodiment.

[0065] The OCR processing unit 102 extracts text such as characters from the scanned image read by the reading unit 101, and outputs the text information as an aggregate of information such as character code, character size, and position as an OCR result. Then, the OCR processing unit 102 outputs the OCR result to the text synthesis unit 113.

[0066] The trial pattern generation unit 105 generates a trial pattern image for superimposing on the pattern candidate area of the scanned image based on the pattern addition level determined by the display level determination unit 104, the pattern candidate area detected by the margin detection unit 103, and the trial pattern template information stored in the storage unit 110. Then, the trial pattern generation unit 105 outputs the generated trial pattern image to the image composition unit 106. Here, it is assumed that the trial pattern of the trial pattern template information is text, and the trial pattern generation unit 105 further outputs the text information of the trial pattern to the text composition unit 113.

[0067] The text composition unit 113 is a functional unit that generates composite text by combining the OCR result by the OCR processing unit 102 and the text information of the trial pattern received from the trial pattern generation unit 105. The text composition unit 113 outputs the generated composite text to the PDF generation unit 107. The text composition unit 113 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0068] The PDF generation unit 107 generates a searchable PDF (an example of a file) by superimposing the composite text generated by the text composition unit 113 as a character layer in a transparent state on the composite image generated by the image composition unit 106.

[0069] Note that the OCR processing unit 102, margin detection unit 103, display level determination unit 104, trial pattern generation unit 105, image composition unit 106, PDF generation unit 107, setting unit 109, display control unit 112, and text composition unit 113 shown in FIG. 11 are not limited to being realized by a program being executed by the CPU 501 in FIG. 2. For example, they may be realized by hardware such as an integrated circuit, or may be realized by a combination of software and hardware.

[0070] In addition, each functional unit of the image forming apparatus 10a shown in FIG. 11 conceptually shows the functions and is not limited to such a configuration. For example, a plurality of functional units illustrated as independent functional units in FIG. 11 may be configured as one functional unit. On the other hand, the functions of one functional unit in FIG. 11 may be divided into a plurality and configured as a plurality of functional units.

[0071] As described above, in the image forming apparatus 10a according to this modification example, the trial pattern of the trial pattern template information is text (character information), and the text synthesis unit 113 synthesizes the OCR result and the trial pattern to generate a synthesized text, and the PDF generation unit 107 superimposes the synthesized text as a character layer in a transparent state on the synthesized image to generate a searchable PDF. Even in such a configuration, the same effects as those of the above-described embodiment are achieved.

[0072] (Modification Example 2) The image forming apparatus according to Modification Example 2 will be described centering on the points different from the image forming apparatus 10 according to the above-described embodiment. In the above-described embodiment, the operation of generating a searchable PDF by superimposing the OCR result as a character layer in a transparent state on a synthesized image obtained by generating a trial pattern image and superimposing it on a scanned image was described. In this modification example, the operation of treating the trial pattern as text information instead of a trial pattern image will be described. Note that the overall configuration of the information processing system and the hardware configuration of the image forming apparatus according to this modification example are the same as those described in the above-described embodiment.

[0073] FIG. 12 is a diagram showing an example of the configuration of the functional blocks of the image forming apparatus according to Modification Example 2. The configuration and operation of the image forming apparatus 10b according to this modification example will be described with reference to FIG. 12.

[0074] As shown in FIG. 12, the image forming apparatus 10b includes a reading unit 101, an OCR processing unit 102, a margin detection unit 103 (detection unit), a display level determination unit 104, a trial pattern generation unit 105 (first generation unit), a PDF generation unit 107 (second generation unit), a communication unit 108 (transmission unit), a setting unit 109, a storage unit 110, an input unit 111, a display control unit 112, and a text synthesis unit 113 (synthesis unit). Among the above-described functional units, the operations of the margin detection unit 103, the display level determination unit 104, the communication unit 108, the setting unit 109, the storage unit 110, the input unit 111, and the display control unit 112 are the same as those described in the above embodiment.

[0075] The reading unit 101 reads a scan document placed on the reading document table of the image forming apparatus 10 and converts it into data as a scan image. Then, the reading unit 101 outputs the scan image to the OCR processing unit 102, the margin detection unit 103, and the PDF generation unit 107.

[0076] The OCR processing unit 102 extracts text such as characters from the scan image read by the reading unit 101, and outputs text information as an aggregate of information such as character code, character size, and position as an OCR result. Then, the OCR processing unit 102 outputs the OCR result to the text synthesis unit 113.

[0077] The trial pattern generation unit 105 generates a colored trial pattern text (an example of trial pattern information) for overlapping the pattern candidate area of the scan image based on the pattern addition level determined by the display level determination unit 104, the pattern candidate area detected by the margin detection unit 103, and the trial pattern template information which is text information stored in the storage unit 110. Specifically, the trial pattern generation unit 105 determines the area that the trial pattern should occupy based on the pattern addition level and the image size of the scan image, searches for a pattern candidate area corresponding to the area, and enlarges or reduces the font size of the trial pattern so that it can overlap the found pattern candidate area to generate the trial pattern text. Then, the trial pattern generation unit 105 outputs the generated trial pattern text to the text synthesis unit 113.

[0078] The text synthesis unit 113 is a functional unit that synthesizes the OCR result by the OCR processing unit 102 and the trial pattern text received from the trial pattern generation unit 105 to generate a synthesized text. The text synthesis unit 113 outputs the generated synthesized text to the PDF generation unit 107. The text synthesis unit 113 is realized, for example, by a program being executed by the CPU 501 shown in FIG. 2.

[0079] The PDF generation unit 107 superimposes, on the scanned image read by the reading unit 101, the text layer of the OCR result portion of the synthesized text generated by the text synthesis unit 113 in a transparent text state, and superimposes, on the pattern candidate region searched by the trial pattern generation unit 105, the text layer of the trial pattern text portion of the synthesized text in a colored state to generate a searchable PDF (an example of a file). In this case, the trial pattern text portion of the synthesized text is superimposed on the pattern candidate region found by the trial pattern generation unit 105 in the scanned image.

[0080] Note that the OCR processing unit 102, the margin detection unit 103, the display level determination unit 104, the trial pattern generation unit 105, the PDF generation unit 107, the setting unit 109, the display control unit 112, and the text synthesis unit 113 shown in FIG. 12 are not limited to being realized by a program being executed by the CPU 501 in FIG. 2. For example, they may be realized by hardware such as an integrated circuit, or may be realized by a combination of software and hardware.

[0081] Also, each functional unit of the image forming apparatus 10b shown in FIG. 12 conceptually shows the functions and is not limited to such a configuration. For example, a plurality of functional units illustrated as independent functional units in FIG. 12 may be configured as one functional unit. On the other hand, the functions of one functional unit in FIG. 12 may be divided into a plurality and configured as a plurality of functional units.

[0082] As described above, in the image forming apparatus 10b according to this modification example, the trial pattern of the trial pattern template information is character information, and the trial pattern generation unit 105 generates a trial pattern text having a size corresponding to the determined area. The text synthesis unit 113 synthesizes the OCR result and the trial pattern text to generate a synthesized text. The PDF generation unit 107 superimposes the synthesized text on the scanned image as a character layer with the OCR result part of the synthesized text in a transparent state and as a character layer with the trial pattern text part in a colored state to generate a searchable PDF. As a result, the same effects as those of the above-described embodiment are achieved, and the text information about the trial pattern is also included in the searchable PDF and can be used as the character to be searched.

[0083] Note that the above-described embodiment, modification example 1, and modification example 2 can be combined with each other.

[0084] Also, each function of the above-described embodiment and each modification example can be realized by one or a plurality of processing circuits. Here, the "processing circuit" includes a processor programmed to execute each function by software like a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), which are designed to execute each function described above, and a device such as a conventional circuit module.

[0085] Also, the program executed by the image forming apparatuses 10, 10a, and 10b of the above-described embodiment and each modification example may be configured to be provided by being pre-embedded in a ROM or the like.

[0086] Also, the programs executed by the image forming apparatuses 10, 10a, and 10b of the above-described embodiments and each modification example may be recorded on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), a flexible disk (FD), a CD-R (Compact Disk-Recordable), or a DVD (Digital Versatile Disk) in an installable format or an executable format file, and provided as a computer program product.

[0087] Further, the programs executed by the image forming apparatuses 10, 10a, and 10b of the above-described embodiments and each modification example may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by the image forming apparatuses 10, 10a, and 10b of the above-described embodiments and each modification example may be configured to be provided or distributed via a network such as the Internet.

[0088] Also, the programs executed by the image forming apparatuses 10, 10a, and 10b of the above-described embodiments and each modification example have a module configuration including the above-described respective functional units. As actual hardware, the CPU (processor) reads the program from the ROM and executes it, so that the above-described respective functional units are loaded onto the main storage device, and each functional unit is generated on the main storage device.

Explanation of Signs

[0089] 1 Information processing system 2 Network 10, 10a, 10b Image forming apparatus 20 PC 101 Reading unit 102 OCR processing unit 103 Margin detection unit 104 Display level determination unit 105 Trial pattern generation unit 106 Image synthesis unit 107 PDF Generation Unit 108 Communication Unit 109 Setting Unit 110 Memory Unit 111 Input Unit 112 Display Control Unit 113 Text Composition Unit 500 Controller 501 CPU 502 System Memory (MEM-P) 503 North Bridge (NB) 504a South Bridge (SB) 504b Network I / F 504c USB I / F 504d Centronics I / F 504e Sensor I / F 505 AGP 506 ASIC 507 Local Memory (MEM-C) 508 Auxiliary Storage Device 510 Operation Display Unit 520 FCU 531 Plotter 532 Scanner PN1~PN6 Trial Pattern Images

Prior Art Documents

Patent Documents

[0090]

Patent Document 1

Claims

1. An image processing apparatus having, as a function to be tested, a function of superimposing, on an image, a character layer obtained by OCR processing from an image containing a character string with the character string in a transparent state, an OCR processing unit that executes OCR processing on a scanned image read by a reading unit from a document to obtain an OCR result that is character information, a first generation unit that determines an area occupied by a trial pattern indicating that it is during a trial period of the function based on at least a trial history of the function, and generates trial pattern information having a size corresponding to the area, a second generation unit that generates a file in which a character layer with the OCR result in a transparent text state and the trial pattern information are superimposed on the scanned image, and an image processing apparatus comprising the same.

2. The first generation unit generates a trial pattern image as the trial pattern information having a size corresponding to the area, and further includes a first composition unit that generates a composite image by superimposing the trial pattern image on the scanned image, The second generation unit superimposes, on the composite image, a character layer with the OCR result in a transparent text state to generate the file, according to the image processing apparatus according to claim 1.

3. The trial pattern is character information, and further includes a second composition unit that composes the OCR result and the trial pattern to generate composite text, The second generation unit superimposes, on the composite image, a character layer with the composite text in a transparent state to generate the file, according to the image processing apparatus according to claim 2.

4. The trial pattern is character information, The first generation unit generates a trial pattern text as the trial pattern information having a size corresponding to the area, and further includes a composition unit that composes the OCR result and the trial pattern text to generate composite text, The second generation unit superimposes the composite text on the scanned image as a character layer with the portion of the OCR result in the composite text in a transparent state, and superimposes it as a character layer with the portion of the trial patent text in a colored state to generate the file. The image processing apparatus according to claim 1.

5. The image processing apparatus further includes a detection unit that detects a candidate region for superimposing the trial pattern information, which is a blank region in the scanned image that does not contain an object. The first generation unit generates the trial pattern information based on the trial pattern so as to be superimposable on the candidate region corresponding to the area among the candidate regions detected by the detection unit. The second generation unit generates the file in a state where the trial pattern information is superimposed on the candidate region corresponding to the area in the scanned image. The image processing apparatus according to any one of claims 1 to 4.

6. The second generation unit generates the file in which at least a part of the trial pattern information overlaps an object in the scanned image. The image processing apparatus according to any one of claims 1 to 4.

7. The image processing apparatus further includes a setting unit that sets the trial pattern based on editing content for the trial pattern in an external device. The first generation unit generates the trial pattern information based on the trial pattern set by the setting unit. The image processing apparatus according to any one of claims 1 to 6.

8. The image processing apparatus according to claim 7, further including a transmission unit that transmits the trial history to the external device.

9. An image processing method for an image processing apparatus having, as a trial target, a function of superimposing, on an image, a character layer in which a character obtained by OCR processing from an image including the character is in a transparent state. An OCR processing step of performing OCR processing on a scanned image read from a document by a reading unit to obtain an OCR result which is character information, A first generation step of determining an area occupied by a trial pattern indicating that it is during a trial period of the function based on at least the trial history of the function, and generating trial pattern information having a size corresponding to the area, A second generation step of generating a file in which a character layer with the OCR result in a transparent text state and the trial pattern information are superimposed on the scanned image, An image processing method having the above.

10. On a computer having, as a trial target, a function of superimposing, on an image, a character layer in which the character obtained by OCR processing from an image including characters is in a transparent state, An OCR processing step of performing OCR processing on a scanned image read from a document by a reading unit to obtain an OCR result which is character information, A first generation step of determining an area occupied by a trial pattern indicating that it is during a trial period of the function based on at least the trial history of the function, and generating trial pattern information having a size corresponding to the area, A second generation step of generating a file in which a character layer with the OCR result in a transparent text state and the trial pattern information are superimposed on the scanned image, A program for causing the above to be executed.

Images