Information processing apparatus, method for controlling the same, and program

Abstract

To provide a mechanism that checks if RIP data has an abnormality even when, for example, the order of extraction of PDL text data and the order of recognition of OCR text data are different from each other.SOLUTION: The information processing apparatus acquires, from PDL data that is print data, PDL text data related to a text included in the PDL data, and converts the PDL data into RIP data that is raster image data. The information processing apparatus acquires, from the RIP data, OCR text data related to the text included in the RIP data, compares the PDL text data with the OCR text data by using position information of the text, and checks if the RIP data has an abnormality.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method thereof, and a program. [Background technology]

[0002] In digital printing systems in the commercial printing field, a scanner is placed inline inside the image forming device, and abnormalities in the printed matter are detected from the images read from the printed matter. When performing abnormality detection, there is a detection method (hereinafter referred to as RIP inspection) that compares the image data of the bitmap raster image generated in the RIP process with the image data read by the scanner, and detects differences as abnormalities. RIP is an abbreviation for raster image processor.

[0003] Such RIP inspection has the following problems. In digital printing systems, the creator of the print data can specify in detail in the print data the type of font to be used. However, there are cases where the font specified in the print data cannot be used by the image forming device, and in such cases the image forming device replaces it with another font. In such cases, the characters after RIP development may change to characters that the creator did not intend, resulting in so-called "garbled characters." It is also known that the combination of fonts with transparency effects and special effects can cause problems such as garbled characters, skipped characters, and missing characters.

[0004] Thus, there is a possibility that character problems such as garbled characters, skipped characters, and missing characters may occur in bitmap image data after RIP processing. Therefore, when performing RIP inspection on an image read by a scanner, there is a problem that the existence of character problems cannot be detected by comparing with the data after the character problems have occurred. In other words, if character problems occur equally in both the image data generated by RIP processing and the read image data, there is a problem that they are determined to be normal. Patent Document 1 proposes a technology for inspecting garbled characters by comparing PDL text data extracted from print data written in a PDL language before RIP processing with text data recognized by OCR of bitmap RIP image data after RIP processing. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2017-121769 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, the above conventional technology has the following problems. In the above conventional technology, the extraction order of PDL text data extracted from PDL data must match the recognition order of OCR text data recognized by OCR of RIP image. PRL is an abbreviation of page-description language, and OCR is an abbreviation of optical character recognition. If the extraction order and the recognition order match, it is possible to detect garbled characters by comparing the character information in order. However, the extraction order of PDL text data does not necessarily match the recognition order of OCR text data recognized by OCR of RIP image. The above conventional technology does not take the order into consideration, and there is a problem that correct inspection cannot be performed if the order is different.

[0007] For example, when PDL data is created from an application such as Notepad or WordPad, PDL drawing commands for text objects are issued in a regular order from the top left to the bottom right, with the top left as the base. Therefore, PDL text data extracted from the PDL data is extracted in a regular order from the top left to the bottom right, with the top left as the base. On the other hand, when PDL data is created from an application that allows free layout, such as PowerPoint or InDesign, there is no regularity in the order of PDL drawing commands for text objects issued. In that case, PDL drawing commands are issued in the order in which the user arranged them. Therefore, PDL text data extracted from the PDL data is extracted in an irregular order that depends on the creator.

[0008] In addition, OCR of RIP images generally recognizes text in a regular order from the top left to the bottom right, with the top left as the base. In this case, if the PDL data is created using an application such as Notepad or WordPad, the order will match and it is possible to make a correct comparison. However, there is a problem in that it cannot be compared correctly when comparing with PDL data in which the text order is irregular. Regarding OCR, there are not only those that use the top left as the base, but also those that recognize by taking into account vertical writing, tables, columns, etc., and those that obtain the location of text in advance based on RIP processing and image processing information as in the above-mentioned conventional technology, and perform OCR only on the places where text is present. However, none of these methods take into account the order of PDL text data extracted from PDL data, and there is a problem in that they cannot be compared correctly.

[0009] The present invention has been made in consideration of at least one of the above problems, and provides a mechanism for inspecting RIP data for abnormalities even when the extraction order of PDL text data and the recognition order of OCR text data are different. [Means for solving the problem]

[0010] The present invention is characterized in that, for example, an information processing device includes a first acquisition means for acquiring first text data relating to text contained in first data from first data, which is print data, a conversion means for converting the first data into second data, which is raster image data, a second acquisition means for acquiring second text data relating to text contained in the second data from the second data, and an inspection means for comparing the first text data and the second text data using positional information of the text and inspecting whether there are any abnormalities in the second data. Effect of the Invention

[0011] According to the present invention, even if the extraction order of PDL text data and the recognition order of OCR text data are different, it is possible to check for abnormalities in RIP data. [Brief description of the drawings]

[0012] [Figure 1] FIG. 2 is a block diagram showing an example of a hardware configuration of an image forming apparatus according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a software configuration of an image forming apparatus according to an embodiment. [Diagram 3] 11 is a flowchart illustrating an embodiment of the present invention, in which text data is extracted from PDL data and a RIP image, and a list of the text data is created. [Figure 4] 11A and 11B are diagrams showing an example of correspondence between drawing contents and commands in PDL data in which text data is irregularly arranged according to an embodiment; [Diagram 5] FIG. 4 is a diagram showing an example of a text data list extracted from PDL data according to an embodiment. [Figure 6] FIG. 13 is a diagram showing an example of an OCR text data list of a normal RIP image according to an embodiment. [Figure 7] FIG. 13 is a diagram showing an example of an OCR text data list of a garbled RIP image according to an embodiment. [Figure 8] FIG. 13 is a diagram showing an example of an OCR text data list of an RIP image with missing characters according to an embodiment. [Figure 9] 11 is a flowchart showing a flow of text inspection after RIP processing according to an embodiment. [Figure 10] 11 is a flowchart illustrating an embodiment of a process for searching for OCR text data having coordinate information similar to coordinate information of PDL text data and comparing the texts. [Figure 11] 11A and 11B are diagrams illustrating an example of searching and comparing text data when the text data matches, according to an embodiment. [Figure 12] 11A and 11B are diagrams illustrating an example of searching and comparing text data when garbled characters are present according to an embodiment. [Figure 13] 11A and 11B are diagrams showing an example of searching and comparing text data when a character is missing or skipped, according to an embodiment; [Figure 14] 11A and 11B are views showing an example of aggregating a plurality of pages into 2-in-1 and performing RIP processing according to an embodiment; [Figure 15] 11 is a flowchart for extracting text data from PDL data and a RIP image, respectively, to create a list of the text data, and correcting the list of PDL text data in accordance with an edit setting during RIP processing according to an embodiment. [Figure 16] FIG. 4 is a diagram showing an example of a text data list extracted from PDL data according to an embodiment. [Figure 17] FIG. 13 is a diagram showing an example of an OCR text data list of a normal 2-in-1 RIP image according to an embodiment. [Figure 18] 11A and 11B are diagrams showing an example of 2-in-1 correction of a PDL text data list according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0014] <First embodiment> <Hardware configuration> The first embodiment of the present invention will be described below. In this embodiment, an inspection control will be described when the extraction order of PDL text data extracted from PDL (print data) data differs from the recognition order of OCR text data recognized by OCR of RIP images (raster image data). This embodiment is characterized in that an information processing device described below inspects whether there are any abnormalities in the RIP data of correct answer data used in an inspection device that inspects printed matter.

[0015] First, an example of a hardware configuration of an information processing device 100 according to the present embodiment will be described with reference to FIG. 1. The information processing device 100 includes a CPU 101, a RAM 102, a ROM 103, a network I / F 104, and a storage device 105, which are connected to each other via a system bus 106. The CPU 101 is a central control unit of the information processing device 100. The RAM 102 is a storage device accessible by the CPU 101, and is used as a work memory for the CPU 101 to operate in this embodiment. The ROM 103 stores a program, and the CPU 101 loads the program onto the RAM 102 and executes it, thereby operating each software module shown in FIG. 2, which will be described later. The network I / F 104 is an interface that is connected to an external device 108 (such as a server or other device) via a network 107 and inputs and outputs information. The storage device 105 is an auxiliary storage device such as an HDD or SSD, and is used as a work area for the CPU 101 and for storing data such as documents. In this embodiment, the document is acquired from the external device 108 via the network I / F 104 or from the storage device 105.

[0016] In this embodiment, an information processing device will be described as an example of a device to which the present invention is applied. Therefore, the information processing device according to this embodiment inspects the RIP data itself, which is the correct data in the inspection of the printed matter, for abnormalities such as garbled characters and missing characters, and provides the inspection result and the corrected RIP data, etc. to the image forming device or image processing device that inspects the printed matter. However, there is no intention to limit the present invention, and the present invention may be applied to an image processing device that includes at least one of a printer that forms an image on a sheet and a scanner that reads an image from a document. In other words, the inspection of the RIP data, which is the correct data in the inspection of the printed matter, may be performed in the image processing device that inspects the printed matter.

[0017] <Software configuration> Next, an example of the software configuration of the information processing device 100 according to this embodiment will be described with reference to Fig. 2. As shown in Fig. 2, the information processing device 100 includes, as software modules, a PDL data receiving unit 201, a PDL data analyzing unit 202, a RIP unit 203, an OCR unit 204, and a text checking unit 205. When the present invention is applied as an image processing device, it may further include a printer unit that controls printing and a scanner unit that controls reading of an original.

[0018] As described above, these software modules operate when CPU 101 executes the program loaded from ROM 103 onto RAM 102. PDL data receiving unit 201 receives PDL data, which is print data (first data), from an external device such as external device 108 via a network. PDL data analyzing unit 202 is an example of a first obtaining means, and analyzes the PDL data received by PDL data receiving unit 201 and obtains PDL text data (first text data) from drawing commands in the PDL data.

[0019] The RIP unit 203 is an example of a conversion means, and performs so-called RIP processing, which develops the acquired PDL data into a bitmap image of a specified resolution, to generate raster image data (second data). The OCR unit 204 is an example of a second acquisition means, and performs OCR processing on the image obtained by the RIP processing to generate OCR text data (second text data). The text inspection unit 205 is an example of an inspection means, and searches for OCR text data (second data) at a corresponding position based on coordinate information of the extracted PDL text data (first data), and inspects the text after the RIP processing.

[0020] <Creating text data> Next, the procedure for creating text data according to this embodiment will be described with reference to Fig. 3. Here, the procedure for extracting text data from PDL data and RIP images and creating a list of the text data will be described. The processing described below is realized, for example, by the CPU 101 reading a program stored in the ROM 103 or storage device 105 into the RAM 102 and executing it.

[0021] (PDL text data) First, in S301, the PDL data receiving unit 201 receives PDL data via the network I / F 104. Next, in S302, the PDL data analyzing unit 202 extracts PDL text data from the received PDL data and creates a list of the PDL text data for each page.

[0022] Here, an example of creating a list of PDL text data from PDL data of a specified page will be described with reference to Figs. 4 and 5. Fig. 4 shows a PDF document, which is a type of PDL, as an example. PDL data 400 in Fig. 4(A) indicates drawing contents, and PDL data 400 in Fig. 4(B) indicates PDL drawing commands corresponding to the drawing contents. When drawing, text objects are drawn in the order of PDL drawing commands 401, 402, 403, and 404, in accordance with the instructions of PDL drawing commands 401 to 404 in Fig. 4(B). The meanings of symbols included in the PDL drawing commands 401 to 404 are as follows: "BT" is the start of drawing a text object, "Tf" is the font resource name and font size, "Tm" is the start position of the text object, "g" is the gray value used to fill the interior of the text object, "G" is the gray value of the outline of the text object, "TJ" is the content of the text to be displayed, "ET" is the end of drawing a text object, The font actually used is defined in the font information referenced from the font resource name.

[0023] For example, the PDL drawing command 401 is Font resource: Refer to / F1 and get font information 405. Font: Calibri, Font size: 36pt, Start position: (x,y)=(658.61,26.472), A text object "P.1" is drawn with black fill and outline colors. Similarly, PDL drawing commands 402 to 404 are interpreted and drawn. In this embodiment, PDF is used as an example, but other PDL types such as LIPSLX and PCL6 may be used.

[0024] The PDL data analysis unit 202 sequentially analyzes the PDL drawing commands 401 to 404 in the PDL data 400. More specifically, for each command, the PDL data analysis unit 202 breaks down the text object into text data for each character, and extracts information on the character, font, coordinates of a rectangular area (hereinafter, bbox) surrounding the character, and color value.

[0025] FIG. 5 shows a list of text data obtained by extracting text data for each character from the PDL data 400 in FIG. 5. Reference numeral 500 in FIG. 5 shows the entire list of PDL text data. For example, text data 501 is information extracted by interpreting the PDL drawing command 401. Letter: "P" Font:Calibri bbox coordinates:(659,487,677,523) color:0(black) This shows that.

[0026] The text data 502 is information extracted by interpreting the PDL drawing command 404. Letter: "A" Font:Calibri bbox coordinates:(110,137,131,173) color:0(black) As shown, it can be seen that the PDL text data list 500 is organized in the order in which the text data was extracted by the PDL drawing commands 401 to 404.

[0027] (OCR text data) Returning now to the explanation of Fig. 3, in S303, the RIP unit 203 develops the acquired PDL data into a bitmap image of a specified resolution to create a RIP image. In S304, the OCR unit 204 executes OCR processing for each RIP image, creates a list of OCR text data, and ends the processing of this flowchart. Here, an example of the list of OCR text data will be explained with reference to Figs. 6 to 8.

[0028] FIG. 6 shows an example of an OCR text data list created from a RIP image when PDL data 400 has been properly RIP-processed. FIG. 6(A) shows a RIP image when RIP-processing has been properly performed, and 600 in FIG. 6(B) shows the entire list of OCR text data. FIG. 6 shows an example in which text data is listed in the order in which it is recognized from the top left to the bottom right, with the top left as the base point, when performing OCR processing. For example, character 601 in FIG. 6(A) corresponds to the OCR text data recognized by 601 in FIG. 6(B). Therefore, it can be seen that the text data for "A" in OCR text data 601 has been recognized from the top left to the bottom right, and that it has been recognized after "YYYY / MM / DD". The information in OCR text data 601, like PDL text data, is Letter: "A" Font:Calibri bbox coordinates:(110,130,131,173) color:0(black) It has information on characters, fonts, bbox coordinates, and color values.

[0029] Also, 602 in Fig. 6(A) corresponds to the OCR text data recognized in 602 in Fig. 6(B). As such, it can be seen that the order of the OCR text data list 600 is different from that of the PDL text data list 500. As for the method of recognition in OCR processing, an example is given in which recognition is performed from the top left to the bottom right with the top left as the base, but this is not limiting. It is also possible to use a method in which recognition is performed taking into account vertical writing, tables, columns, etc., or a method in which the location of text is acquired in advance based on RIP processing or image processing information and only the location of text is recognized.

[0030] (Data in case of garbled characters) Fig. 7 shows an example of an OCR text data list created from a RIP image in which characters have been garbled when PDL data 400 has been RIP-processed. Fig. 7(A) shows a RIP image containing garbled characters, and Fig. 7(B) 700 shows the entire OCR text data list. Fig. 7(A) shows that the "A" in character 601 in Fig. 6 has been replaced with character 701 "?". Meanwhile, Fig. 7(B) shows that garbled characters 701 are also included in the OCR text data list 700 created from the RIP image.

[0031] (Data with skipped characters) Fig. 8 shows an example of an OCR text data list created from a RIP image in which characters have been skipped when PDL data 400 was RIP-processed. Fig. 8(A) shows a RIP image including skipped characters, and 800 in Fig. 8(B) shows the entire OCR text data list. Fig. 8(A) shows that the "A" in character 601 in Fig. 6 has been skipped to the position of "A" in character 801. Meanwhile, Fig. 8(B) shows that character 801 is also located after the character "Z" in the OCR text data list 800 created from the RIP image, and the skipped characters are included as is.

[0032] In this way, if character garbling or character skipping occurs during RIP processing, these abnormalities will be directly reflected in the list of OCR text data created from the RIP image. Therefore, even if the printed matter is inspected using these data as correct data, there is a problem that the correct data contains abnormalities and the inspection cannot be performed normally. Thus, in the present embodiment, even when abnormalities such as character garbling or character skipping occur in the RIP processing as described above, control is provided to accurately inspect the printed matter. The list 500 of PDL text data and the lists 600, 700, and 800 of OCR text data each contain position information (coordinate information) of each character. The information processing apparatus according to the present embodiment preferably performs inspection of the printed matter using this position information. The inspection procedure will be described in detail below.

[0033] <Inspection Procedure after RIP Processing> Next, with reference to FIG. 9, the processing procedure for inspecting the text after RIP processing in the information processing apparatus 100 according to the present embodiment will be described. The processing described below is realized, for example, by the CPU 101 reading out the programs stored in the ROM 103 and the storage device 105 into the RAM 102 and executing them. The processing from S901 to S908 is the processing that the CPU 101 causes the text inspection unit 205 to execute.

[0034] In S901, the text inspection unit 205 acquires the list of PDL text data for each page created as shown in FIG. 3 and the list of OCR text data. Specifically, the text inspection unit 205 acquires those lists by reading out the data created in advance according to the flowchart shown in FIG. 3 and stored in a memory or the like. Note that the list data created by an external device may be acquired by receiving it via a network.

[0035] Next, in S902, the text inspection unit 205 determines whether there is any text data to read from the list of PDL text data. If there is any text data to read (YES in S902), the process proceeds to S903; if there is no text data to read (NO in S902), the process proceeds to S906. In S903, the text inspection unit 205 performs text inspection based on the information of the read PDL text data. Details of the text inspection will be described later with reference to FIG. 10. Next, in S904, the text inspection unit 205 determines whether there is any text data to read next from the list of PDL text data. If there is any next text data (YES in S904), the process proceeds to S905; if there is no next text data (NO in S904), the process proceeds to S906.

[0036] In S905, the text inspection unit 205 reads the next text data, returns the process to S903, and performs text inspection. This is repeated until the reading of the text data is completed. In S906, the text inspection unit 205 determines whether there is a next page. If there is a next page (YES in S906), the next page is read in S907, and the process returns to S901. That is, the processes from S901 to S905 are repeated until there is no next page. If all pages have been read and there is no next page (NO in S906), the process proceeds to S908. In S908, the CPU 101 functions as a result output unit, notifies the inspection result, and ends the process of this flowchart. Here, the inspection result may be displayed on the display unit of the information processing device 100, may be stored in the storage unit, or may be transmitted to an external device.

[0037] <Details of Text Inspection (S903)> Next, a detailed processing procedure of the text inspection in S903 in Fig. 9 will be described with reference to Fig. 10. The processing described below is realized, for example, by the CPU 101 reading a program stored in the ROM 103 or the storage device 105 into the RAM 102 and executing it. The processing from S1001 to S1005 is processing that the CPU 101 causes the text inspection unit 205 to execute.

[0038] In S1001, the text inspection unit 205 uses the coordinate information (position information) of the PDL text data for the text of interest to search the list of OCR text data for OCR text data having similar coordinate information. In S1002, the text inspection unit 205 determines whether there is corresponding OCR text data. If there is corresponding OCR text data (YES in S1002), the process proceeds to S1003, and if there is no corresponding OCR text data (NO in S1002), the process proceeds to S1005.

[0039] In S1003, the text inspection unit 205 compares the character information of the PDL text data with the corresponding OCR text data to determine whether they match. If they match (YES in S1003), proceed to S1004, and if they do not match (NO in S1003), proceed to S1005. In S1004, the text inspection unit 205 stores the comparison result as no abnormality and ends the processing of this flowchart. On the other hand, in S1005, the text inspection unit 205 stores the abnormality content, character, and coordinate information as an abnormality and ends the processing of this flowchart.

[0040] <Comparison with normal RIP image> With reference to Fig. 11, a comparison with the list of OCR text data of the normal RIP image in Fig. 6 will be described. Fig. 11(A) is an image diagram showing how, using the coordinate information of "P" in PDL text data 501, a list of OCR text data 600 is searched for OCR text data having similar coordinate information, and the corresponding OCR text data 602 is found.

[0041] 11B shows the actual search process. In S1001 above, the text inspection unit 205 performs a search by sequentially comparing the bbox coordinates (659,487,677,523) of "P" in the PDL text data 501 with the bbox coordinates of each piece of text data in the OCR text data list 600. Furthermore, in S1002, the text inspection unit 205 determines that the bbox coordinates of "P" in the PDL text data 501 and the bbox coordinates (661,476,678,524) of "P" in the OCR text data 602 are similar, and determines that there is a match (YES in S1002).

[0042] The bbox coordinates of the PDL text data extracted from the PDL data and the bbox coordinates of the OCR text data recognized by OCR of the RIP image may not necessarily match. Therefore, it is desirable to perform a judgment with ambiguity by setting a tolerance value rather than a perfect match. For example, if the bbox coordinates of the PDL text data 501 and the OCR text data 602 do not match perfectly, but the coordinate positions overlap and the errors in width and height (i.e., position errors) are less than a predetermined threshold, they are judged to be similar coordinates. The method of judgment with ambiguity is not limited to this.

[0043] FIG. 11C shows a comparison of character information in two text data. In S1003, the text inspection unit 205 compares the character information of the PDL text data 501 and the OCR text data 602, and since both are "P", it is determined that they match (YES in S1003). In this embodiment, only character information is used to determine whether the text data match, but a method of determining by combining other parameters such as color values ​​may also be used. In addition, if there are multiple texts that fall within the allowable value in S1002, if any of the character information of the multiple text data matches in S1003, it may be determined that there is no abnormality. In S1004, the text inspection unit 205 stores the comparison result as no abnormality as a result of the inspection. In the comparison between the PDL text data list 500 and the OCR text data list 600, since there are no abnormalities in all the text data, the result of no abnormality is notified in S908.

[0044] <Comparison with RIP image containing garbled characters> With reference to Fig. 12, a comparison with the list of OCR text data of the RIP image including garbled characters in Fig. 7 will be described. Fig. 12(A) is an image diagram showing how, using the coordinate information of "A" in PDL text data 502, OCR text data having similar coordinate information is searched for in OCR text data list 700, and the corresponding OCR text data 701 is found.

[0045] 12B shows the actual search process. In S1001 above, the text inspection unit 205 performs a search by sequentially comparing the bbox coordinates (110, 137, 131, 173) of "A" in the PDL text data 502 with the bbox coordinates of the text data in the OCR text data list 700. In S1002, the text inspection unit 205 determines that the bbox coordinates of "A" in the PDL text data 502 and the bbox coordinates (111, 130, 131, 173) of "?" in the OCR text data 701 are similar, and determines that there is a match (YES in S1002).

[0046] 12C shows a comparison of character information in two text data. In S1003, text inspection unit 205 compares the character information of PDL text data 502 and OCR text data 701, and determines that they do not match because "A" ≠ "?" (NO in S1003). In S1005, text inspection unit 205 stores the comparison result indicating that there is an abnormality in the form of garbled characters as a result of the inspection. Since an abnormality was found in the comparison between PDL text data list 500 and OCR text data list 700, the result that there is an abnormality is notified in S908.

[0047] <Comparison with RIP image including missing characters> With reference to Fig. 13, a comparison with the list of OCR text data of the RIP image including missing characters in Fig. 8 will be described. Fig. 13(A) is an image diagram showing how the coordinate information of "A" in PDL text data 502 is used to search for OCR text data having similar coordinate information from OCR text data list 800, and no corresponding OCR text data is found.

[0048] FIG. 13B shows the actual search process. In S1001, the text inspection unit 205 searches by sequentially comparing the bbox coordinates (110, 137, 131, 173) of "A" in the PDL text data 502 with the bbox coordinates of the text data in the list 700 of OCR text data. In S1002, the text inspection unit 205 does not find any OCR text data with similar coordinates and determines that there is no match (NO in S1002). In S1005, the text inspection unit 205 stores the comparison result as the inspection result that there is an abnormality such as a missing character or a skipped character. Since an abnormality was found in the comparison between the list 500 of PDL text data and the list 800 of OCR text data, the result of the abnormality is notified in S908. It should be noted that the detected abnormality may be controlled to be corrected if it is correctable. In that case, it is desirable to output the correction content together with the result.

[0049] As described above, the information processing apparatus according to the present embodiment obtains PDL text data related to text included in PDL data from PDL data, which is print data, and converts the PDL data into RIP data, which is raster image data. The information processing apparatus also obtains OCR text data related to text included in RIP data from RIP data, and compares the PDL text data and the OCR text data using position information of the text to check whether there is an abnormality in the RIP data. The information processing apparatus also performs text inspection by searching for OCR text data at a corresponding position using coordinate information (position information) of the PDL text data. Therefore, even if the extraction order of the PDL text data extracted from the PDL data and the recognition order of the OCR text data recognized by OCR of the RIP image are different, it is possible to inspect for garbled characters that occur after RIP processing. Furthermore, it is possible to inspect not only garbled characters but also character troubles such as missing characters and character skipping. Thus, according to the present embodiment, even if the extraction order of the PDL text data and the recognition order of the OCR text data are different, it is possible to inspect for abnormalities in the RIP data.

[0050] <Second Embodiment> Hereinafter, a second embodiment of the present invention will be described with reference to the drawings. In this embodiment, text comparison in the case where editing is performed during RIP processing on PDL data will be described as an example. Note that the configuration of the information processing apparatus in this embodiment is the same as the configuration of the first embodiment shown in FIG. 1. Hereinafter, differences from the first embodiment will be mainly described.

[0051] <Editing during RIP Processing> First, referring to FIG. 14, an example in which editing is performed on PDL data during RIP processing will be described. As shown in FIG. 14, there may be a case where PDL data 1401 divided into two pages is subjected to RIP processing in a setting where it is aggregated into 2 in 1, and a 1-page RIP image 1402 aggregated into 2 in 1 is created.

[0052] <Creation of Text Data> Next, referring to FIG. 15, the procedure for creating text data according to this embodiment will be described. Here, a procedure for extracting text data from PDL data and RIP images respectively to create a list of text data and correcting the list of PDL text data according to the editing settings during RIP processing will be described. The processes described below are realized, for example, by the CPU 101 reading out a program stored in the ROM 103 or the storage device 105 into the RAM 102 and executing it.

[0053] First, in S1501, the PDL data reception unit 201 receives PDL data via the network I / F 104. Subsequently, in S1502, the PDL data analysis unit 202 extracts PDL text data from the received PDL data and creates a list of PDL text data for each page.

[0054] Here, the list of PDL text data for each page will be described with reference to Fig. 16. Regarding the list of extracted PDL text data, reference numeral 1601 indicates the PDL text data list for the first page. Reference numeral 1602 indicates the PDL text data list for the second page. In this way, it can be seen that at the stage when the PDL text data is extracted from the PDL data, it is divided into two PDL text data.

[0055] In S1503, the RIP unit 203 develops the acquired PDL data into a bitmap image according to the specified resolution and edit settings, and creates a RIP image. In S1504, the RIP unit 203 acquires RIP processing parameters according to the edit settings. The edit settings allow settings such as paper size, paper orientation, and page aggregation. The RIP unit 203 creates a RIP image by performing conversion such as page aggregation, rotation according to paper size, and enlargement / reduction on the acquired PDL data according to the edit settings. Here, a 2-in-1 aggregated RIP image is created. Therefore, the RIP processing parameters indicate the content of the edit settings, and if the edit processing is page aggregation, for example, the value indicates 2-in-1.

[0056] Next, in S1505, the OCR unit 204 executes OCR processing for each RIP image and creates a list of OCR text data. An example of the list of OCR text data is shown in Fig. 17. Fig. 17 shows an example of an OCR text data list created from a RIP image 1402 in which 2-in-1 processing is performed on PDL data 1401 and RIP processing is normally performed.

[0057] Because 2-in-1 processing has been performed, only one OCR text data list is created. The PDL text data list created from the original PDL data is divided into two, and the OCR text data list has been edited to make it one, so in this state it is not possible to compare the coordinate information and inspect the text.

[0058] Therefore, in S1506, the text inspection unit 205 performs conversion on the PDL text data list using the RIP processing parameters acquired in S1504, and creates a corrected PDL text data list. Fig. 18 shows a PDL text data list 1801 created by performing correction on the PDL text data lists 1601 and 1602. The correction method may be a method of correcting and comparing the text data when inspecting each character. Alternatively, a method of performing inverse conversion on the OCR text data list using the RIP processing parameters and then performing correction may be used.

[0059] As described above, the information processing apparatus according to the present embodiment edits the PDL data according to the print settings, converts it into RIP data, and further corrects the acquired PDL text data according to the parameters related to the editing. Furthermore, the information processing apparatus acquires OCR text data from the RIP data according to the parameters related to the editing. In this manner, in the present embodiment, when the PDL data is edited during the RIP process, the PDL text data is corrected in consideration of the RIP process parameters. This makes it possible to compare and inspect the PDL text data and the OCR text data even when the PDL data is edited during the RIP process, and to inspect character troubles such as garbled characters, missing characters, and character skipping. Therefore, according to the present embodiment, even when the PDL data is edited according to the print settings during the RIP process, it is possible to obtain the same effect as the first embodiment.

[0060] The disclosure of this specification includes the following information processing device, control method thereof, and program. (Item 1) An information processing device, A first acquisition means for acquiring first text data relating to text included in the first data from the first data, which is print data; a conversion means for converting the first data into second data, which is raster image data; A second obtaining means for obtaining second text data related to text included in the second data from the second data; an inspection means for comparing the first text data with the second text data using text position information and inspecting whether the second data has an abnormality; An information processing device comprising: (Item 2) 2. The information processing device according to item 1, further comprising a result output means for storing the test results by the test means in a storage unit and displaying them on a display unit. (Item 3) 3. The information processing device according to item 2, wherein the result output means further transmits the test results to an external device. (Item 4) The inspection means includes: a search means for searching the second text data for text data similar to position information of a text of interest for each text included in the first text data; a determination means for determining whether or not corresponding texts in the first text data and the second text data match each other when text data similar to the position information of the target text is searched for in the second text data; 4. The information processing device according to any one of items 1 to 3, comprising: (Item 5) 5. The information processing device according to item 4, wherein the determination means determines that the second data is abnormal if corresponding texts in the first text data and the second text data do not match, or if the search means does not search for text data similar to position information of the text of interest in the second text data. (Item 6) The information processing device according to item 4 or 5, characterized in that the text data similar to the position information of the text of interest is text data included in the second text data having position information with an error less than a predetermined threshold from the position information. (Item 7) 7. The information processing device according to any one of items 1 to 6, wherein the position information is coordinate information. (Item 8) the conversion means converts the first data into the second data after editing the first data in accordance with a print setting; The first acquisition means further corrects the acquired first text data in accordance with a parameter related to the editing performed by the conversion means; 8. The information processing device according to any one of items 1 to 7, wherein the second acquisition means acquires the second text data from the second data in accordance with a parameter related to the editing performed by the conversion means. (Item 9) 9. The information processing device according to item 8, wherein the editing performed by the conversion means includes page aggregation and image processing of rotating, enlarging and reducing images according to paper size and paper orientation. (Item 10) a printer for forming an image on a sheet; A scanner that reads images from documents Further equipped with 10. The information processing device according to any one of items 1 to 9, wherein the information processing device is an image processing device. (Item 11) A method for controlling an information processing device, comprising: A first acquisition step in which a first acquisition means acquires first text data related to text included in the first data, the first data being print data; a conversion step in which a conversion means converts the first data into second data which is raster image data; a second obtaining step of obtaining second text data related to text included in the second data from the second data by a second obtaining means; an inspection step in which an inspection means compares the first text data with the second text data using text position information and inspects whether the second data has an abnormality; 23. A method for controlling an information processing apparatus comprising: (Item 12) A program for causing a computer to execute each step of a control method for an information processing device, the control method comprising: A first acquisition step in which a first acquisition means acquires first text data related to text included in the first data, the first data being print data; a conversion step in which a conversion means converts the first data into second data which is raster image data; a second obtaining step of obtaining second text data related to text included in the second data from the second data by a second obtaining means; an inspection step in which an inspection means compares the first text data with the second text data using text position information and inspects whether the second data has an abnormality; A program comprising:

[0061] <Other embodiments> The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0062] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0063] 201: PDL data receiving unit, 202: PDL data analyzing unit, 203: RIP unit, 204: OCR unit, 205: text inspection unit

Claims

1. An information processing device, a first acquiring means for acquiring first text data relating to text included in the first data from the first data, the first data being print data; a conversion means for converting the first data into second data, which is raster image data; A second acquiring means for acquiring second text data relating to text included in the second data from the second data; an inspection means for comparing the first text data with the second text data using text position information and inspecting whether the second data has an abnormality; An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, further comprising result output means for storing the inspection results by said inspection means in a storage section and displaying them on a display section.

3. 3. The information processing apparatus according to claim 2, wherein the result output means further transmits the inspection result to an external device.

4. The inspection means includes: a searching means for searching the second text data for each text included in the first text data for text data similar to position information of a text of interest; a determination means for determining whether or not corresponding texts of the first text data and the second text data match each other when text data similar to the position information of the target text is searched for in the second text data; 4. The information processing apparatus according to claim 1, further comprising:

5. The information processing device according to claim 4, characterized in that the judgment means judges the second data to be abnormal if corresponding text between the first text data and the second text data does not match, or if the search means does not search for text data similar to the position information of the text of interest in the second text data.

6. 6. The information processing apparatus according to claim 5, wherein the text data similar to the position information of the text of interest is text data included in the second text data and having position information with an error less than a predetermined threshold value from the position information of the text of interest.

7. 7. The information processing apparatus according to claim 6, wherein the position information is coordinate information.

8. the conversion means converts the first data into the second data after editing the first data in accordance with a print setting; The first acquisition means further corrects the acquired first text data in accordance with a parameter related to the editing performed by the conversion means; 5. The information processing apparatus according to claim 4, wherein the second obtaining means obtains the second text data from the second data in accordance with a parameter related to the editing performed by the conversion means.

9. 9. The information processing apparatus according to claim 8, wherein the editing performed by said conversion means includes page aggregation, and image processing such as rotation, enlargement and reduction of an image in accordance with a paper size and a paper orientation.

10. a printer for forming an image on a sheet; A scanner that reads images from documents Further equipped with 5. The information processing apparatus according to claim 4, wherein the information processing apparatus is an image processing apparatus.

11. A method for controlling an information processing device, comprising: A first acquisition step in which a first acquisition means acquires first text data relating to text included in the first data, the first data being print data; a conversion step in which a conversion means converts the first data into second data which is raster image data; a second acquisition step of acquiring second text data related to text included in the second data from the second data by a second acquisition means; an inspection step in which an inspection means compares the first text data with the second text data using text position information and inspects whether the second data has an abnormality; 23. A method for controlling an information processing apparatus comprising:

12. A program for causing a computer to execute each step of a control method for an information processing device, the control method comprising: A first acquisition step in which a first acquisition means acquires first text data relating to text included in the first data, the first data being print data; a conversion step in which a conversion means converts the first data into second data which is raster image data; a second acquisition step of acquiring second text data related to text included in the second data from the second data by a second acquisition means; an inspection step in which an inspection means compares the first text data with the second text data using text position information and inspects whether the second data has an abnormality; A program comprising:

Images