Processing system, processing device, processing method, and program

Abstract

To provide a processing system, a processing apparatus, a processing method and a program that are capable of more easily extracting desired image data from job data and performing color adjustment.SOLUTION: A processing system comprises: first acquisition means that acquires first read data of a sample image for image data included in user-desired job data for image formation; detection means that detects, from job data stored in a storage unit, data of an image similar to an image included in the acquired first read data; output means that outputs a list of the detected data of the image; formation control means that causes an image forming unit to form an image based on selected data selected from the data included in the list; second acquisition means that acquires second read data of the formed image; and adjustment means that performs color adjustment of the image relevant to the selected data based on the first read data and the second read data.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] This invention relates to a processing system, a processing apparatus, a processing method, and a program.

Background Art

[0002] There is an image forming apparatus that forms an image subjected to high-precision calibration such as for industrial use. Calibration in this image forming apparatus includes color adjustment in the actual formed image with respect to the target image data to be formed.

[0003] In many cases, job data including image data to be formed is sent from an external computer to the image forming apparatus via a network, and at the time of color adjustment or actual image formation, the sent job data and further a part such as a page in the image data are selected and processed. In Patent Document 1, when there is a related job for which color adjustment has already been made, such as an already published volume of a series of books, by determining the correspondence between the luminance value of new image data and the gradation distribution related to image formation using the result obtained by the color adjustment of the job, a technique for color matching throughout the series is disclosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in an image forming apparatus accessed by a plurality of users from a plurality of computers, often a large number of job data are registered, and the registered job data is not always immediately adjusted and used. There is a problem that it takes time to extract a desired image from the images included in these plurality of job data at the time of execution such as color adjustment.

[0006] The object of this invention is to provide a processing system, processing device, processing method, and program that can more easily extract desired image data from job data and perform color adjustment. [Means for solving the problem]

[0007] To achieve the above objective, the invention described in claim 1 is: A first acquisition means for acquiring first read data of a sample image of image data included in user-requested job data related to image formation, A detection means for detecting image data similar to the image included in the first read data obtained by the first acquisition means from the job data stored in the storage unit, An output means for outputting a list of image data detected by the detection means, Forming control means for causing an image forming unit to form an image based on selected data selected from the data included in the list, A second acquisition means for acquiring second read data of the formed image, The system includes an adjustment means for performing color adjustment of the image relating to the selected data based on the first read data and the second read data. 、 The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. This is a processing system characterized by the following features.

[0009] Furthermore, claims 2 The invention described is, 1 In the processing system described, The detection means is characterized by detecting image data similar to the overall image, and if no data that satisfies a predetermined standard of similarity is detected, it detects data that includes images similar to the individual images.

[0010] Furthermore, claims 3In the processing system according to claim 1, the detection means respectively obtains the degree of similarity of the data of the detected image, the output means generates the list in descending order of the degree of similarity. This is the gist.

[0011] Also, claim 4 In the invention described, in the processing system according to claim 1 the detection means respectively obtains the degree of similarity of the data of the detected image, the output means generates the list in descending order of the degree of similarity, and the degree of similarity is higher for an image similar to the whole image than for an image similar to the individual image. This is the gist. This is the gist.

[0012] Also, claim 5 In the invention described, in the processing system according to any one of claims 1 to 4 an input means for receiving the content of an input operation, a selection control means for determining the selection data according to the content received by the input means, are provided. This is the gist.

[0013] Also, claim 6 In the invention described, in the processing system according to any one of claims 1 to 4 when no data satisfying a predetermined criterion is detected for the degree of similarity, the output means performs a predetermined notification operation indicating that no detected data exists. This is the gist.

[0014] Also, claim 7 In the invention described, in the processing system according to any one of claims 1 to 4 it is characterized by comprising an image forming unit that forms the image whose color is adjusted by the adjustment means. This is the gist.

[0015] Further, the invention according to claim 8 is a first acquisition means for acquiring first read data of a sample image of image data included in user-desired job data related to image formation; a detection means for detecting data of an image similar to the image included in the first read data obtained by the first acquisition means from job data stored in a storage unit; an output means for outputting a list of the data of the image detected by the detection means; a formation control means for causing an image forming unit to form the image based on selection data selected from the data included in the list; a second acquisition means for acquiring second read data of the formed image; an adjustment means for performing color adjustment of the image related to the selection data based on the first read data and the second read data and comprising 、 The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. which is a processing apparatus characterized by the above. ing

[0016] Further, the invention according to claim 9 is a first acquisition step of acquiring first read data of a sample image of image data included in user-desired job data related to image formation; a detection step of detecting data of an image similar to the image included in the first read data obtained in the first acquisition step from job data stored in a storage unit; an output step of outputting a list of the data of the image detected in the detection step; a formation control step of causing an image forming unit to form the image based on selection data selected from the data included in the list; a second acquisition step of acquiring second read data of the formed image; An adjustment step in which the color of the image relating to the selected data is adjusted based on the first read data and the second read data. Includes fruit, In the aforementioned detection step, It is possible to detect image data similar to the overall image of the first read data obtained in the first acquisition step, and to detect data containing images similar to multiple individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. This is a processing method characterized by the following:

[0017] Furthermore, claims 10 The invention described is, Computer A first acquisition means for acquiring first read data of a sample image of image data included in user-requested job data related to image formation, A detection means for detecting image data similar to the image included in the first read data obtained by the first acquisition means from the job data stored in the storage unit. An output means that outputs a list of image data detected by the detection means. Forming control means that causes the image forming unit to form the image based on selected data selected from the data included in the list, A second acquisition means for acquiring second read data of the formed image, Adjustment means for performing color adjustment of the image related to the selected data based on the first read data and the second read data. It is a program designed to function as such. The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. It is a program. [Effects of the Invention]

[0018] According to the present invention, it is possible to more easily extract desired image data from registered job data and perform color adjustment. [Brief explanation of the drawing]

[0019] [Figure 1]This diagram illustrates the configuration of the processing system in this embodiment. [Figure 2] This is a block diagram showing the functional configuration of the search server. [Figure 3] This figure shows an example of image search. [Figure 4] This is an example of the search results display screen. [Figure 5] This is a diagram illustrating partial search. [Figure 6] This figure shows an example of a screen that displays the results of a partial search. [Figure 7] This flowchart shows the control procedure for the color adjustment control process performed on the search server. [Figure 8] This figure shows an example of a display screen that simultaneously shows the results of a full search and a partial search. [Figure 9] This flowchart shows another example of color adjustment control processing. [Modes for carrying out the invention]

[0020] Hereinafter, embodiments of the present invention will be described based on the drawings. Figure 1 is a diagram illustrating the configuration of the processing system 100 in this embodiment. The processing system 100 includes an image forming apparatus 1, a print server 2, a search server 3, a data storage device 4, a terminal device 5, and the like.

[0021] The image forming apparatus 1 includes an image forming unit that acquires job data including data of the image to be formed and setting information related to the forming operation, and forms the image using a coloring material. The image data of the image to be formed included in the job data may consist of multiple pages (including data for multiple pages). The image forming apparatus 1 is, for example, an electrophotographic type, but is not limited to this, and may be of other types, such as an inkjet type. Furthermore, the image forming apparatus 1 of this embodiment can perform a scanning operation to read and generate read image data by capturing (imaging) an image of the target medium surface (mainly a paper surface). For this purpose, the image forming apparatus 1 has, for example, a well-known visible light line sensor such as a CCD sensor or a CMOS sensor, and can obtain color image data by capturing images in each RGB wavelength band.

[0022] The print server 2 is equipped with a CPU 21. The CPU 21 acquires job data 22 from multiple external terminal devices 5, processes and adjusts the image data as needed to a format suitable for image formation, and controls the order of image formation before outputting it sequentially to the image forming apparatus 1.

[0023] The search server 3 searches and extracts data containing images that match the image to be searched from the job data 22 acquired in the past and held by the print server 2, and the archive data 41 held by the data storage device 4.

[0024] The data storage device 4 acquires job data related to image formation that has been performed in the past from the print server 2 and retains it as archive data 41 for an appropriate period and / or amount.

[0025] Terminal device 5 is an electronic computer such as a PC (Personal Computer), tablet terminal, or mobile terminal (smartphone) that can connect to a network and request image formation from the image forming apparatus 1. Furthermore, among these components, those other than terminal device 5 may be partially or entirely identical in terms of hardware. That is, for example, print server 2 and search server 3 may be the same computer and operate integrally.

[0026] Figure 2 is a block diagram showing the functional configuration of search server 3. The search server 3 includes a CPU 31 (Central Processing Unit), RAM 32 (Random Access Memory), a storage unit 33, a communication unit 34, an operation reception unit 35 (input means), a display unit 36, and the like.

[0027] The CPU 31 is a hardware processor that performs arithmetic processing and centrally controls the overall operation of the search server 3. The CPU 31 may be a single unit, multiple units may execute processing in parallel, or units may perform processing independently depending on the application.

[0028] RAM32 provides CPU31 with working memory space and stores temporary data. CPU31 is not particularly limited, but for example, it may be DRAM. Temporary data includes image data retrieved in the job search process described later.

[0029] The storage unit 33 is a non-volatile memory that stores data. The storage unit 33 may be, for example, an HDD (Hard Disk Drive) or flash memory. The storage unit 33 stores the program 331 and various setting data. The program 331 includes the job search process described later. The storage unit 33 may be an external peripheral device, or an external configuration such as a cloud server or network drive on a network, which is outside the search server 3.

[0030] The communication unit 34 controls communication with the outside world according to a predetermined communication standard. This communication standard includes standard specifications related to LANs (Local Area Networks), such as TCP / IP. The communication unit 34 may also have terminals for connecting peripheral devices, such as USB (Universal Serial Bus) terminals.

[0031] The operation reception unit 35 receives input operations from external sources, such as a user, and transmits them to the CPU 31 as input signals. The operation reception unit 35 may include, for example, a push-button switch, a keyboard, a mouse, or other pointing device. The operation reception unit 35 may also have a touch panel that overlaps with the display screen of the display unit 36.

[0032] The display unit 36 ​​has a display screen and displays various information on the display screen based on the control of the CPU 31. The display screen is, for example, a liquid crystal display (LCD), but is not limited to this. The display unit 36 ​​may also have LED lamps for notifying specific states or abnormalities. Some or all of the configurations of the operation reception unit 35 and the display unit 36 ​​described above may not be part of the configuration of the search server 3 itself, but may be peripheral devices connected externally via the communication unit 34. Alternatively, the search server 3 may be configured to only receive input related to processing requests from external devices (terminal devices 5) via the communication unit 34 and output information of the display content to the external devices via the communication unit 34, and may have only the minimum configurations such as a reset button and LED lamps as the operation reception unit 35 and the display unit 36.

[0033] Next, we will explain the search process for images that are subject to color correction. As described above, the image forming apparatus 1 forms many images based on multiple job data 22 sent from multiple (many) terminal devices 5. In image forming for industrial applications, especially when many color images (photographs, paintings, charts, etc.) are included, the recording media are usually appropriately changed and set up, and the color tone and density gradation are precisely calibrated (color adjustment) for each before the final image forming is performed. Therefore, image forming based on the job data 22 received and held by the print server 2 is not always executed immediately. Consequently, the print server 2 may hold a large number of job data 22 from various users.

[0034] When a large number of job data files 22 are stored in this manner, if color adjustment and image formation are performed some time after sending the job data files 22 to the print server 2, it may become difficult for the user to identify the desired job / page data. Although job data files 22 are assigned file names as appropriate, users often do not properly recognize or forget the file names, or they forget the correspondence between the file name and the image content.

[0035] In color adjustment, in order to bring the formed image in the image forming apparatus 1 closer to its sample image (actual object), scan data (first read data) is acquired by having the sample image read by the imaging device (reading device) as a comparison target, and adjustments are made to bring the scan data of the formed image (second read data) closer to the said scan data (adjustment standard). In this embodiment, the search server 3 also acquires scan data of sample images associated with the image data to be color-corrected at the time of acquisition, and uses this data to search and extract (detect) the image data to be color-corrected from a large number of job data (job data 22 and archive data 41) stored in the storage units of the print server 2 and the data storage device 4. The sample image may be a part of an image included in a page of the job data to be image-formed.

[0036] Figure 3 shows an example of image search. When a scanned image I0 of a color adjustment sample image is obtained, the search server 3 checks for a match with the image data contained in the job data stored in the print server 2 and the data storage device 4. Here, three files, File.A to C, are shown as an example, but in reality, more files may be included in the search.

[0037] The image of each page of each file (the overall image) is compared with the scanned image I0. The image comparison is performed using well-known techniques, such as comparing the contour shape identified by contour recognition and the size and color within that contour. If there are multiple colors, the degree of agreement of the histogram separated by brightness gradation may be evaluated. Contour recognition may be performed by edge detection (Laplacian filter), or by using a trained machine learning model. Note that angular shifts between images (including 90-degree rotation, 180-degree rotation, etc., and any angle of tilt) due to the scanning operation of the sample image may be tolerated. Here, Page 3 of File.A is detected as a match with scanned image I0. In the search, images that meet a predetermined standard of similarity should be extracted as matching images; that is, slight differences in hue before and after color adjustment, slight size adjustments when images are incorporated into the job data, and distortions in shape due to reading the sample image may be tolerated to the extent that images to be extracted are not excluded.

[0038] The scanning operation of the source data (sample image) does not need to be performed by the search server 3 itself, which is equipped with a reading unit; the scanned data (data of scanned image I0) of the sample image read by an external scanner (reading device) may be acquired. For example, data obtained by the scanning operation of the image forming apparatus 1 may be acquired. The destination for acquiring the scanned data can be registered and configured, and the scanned data should be acquired from the registered destination in response to an acquisition request operation on the search server 3. Alternatively, the scanning operation itself may be performed in conjunction with the registered reading device.

[0039] Figure 4 shows an example of the search results display screen. As described above, this display screen may be displayed by the display unit 36 ​​of the search server 3, or it may be sent as display data to an external device (terminal device 5) and displayed by the display unit of the terminal device 5.

[0040] As described above, once the data for scanned image I0 is acquired, the scanned image I0 is automatically compared with each page image in the image data included in the job data to be searched, and matching page images are extracted. As shown in Figure 2, the image (page image) of Page 3 of File.A is the only page image (overall match image) that matches the entire scanned image I0 and is listed here. The items displayed in the list include, for example, the file name related to the job, the page number, the date and time the file was updated (acquired), and a preview of the page image. Such overall match images are selected by default (a check mark indicating selection is shown in the checkbox on the far left), and the user can approve them as is (by selecting the "Next" button).

[0041] On the other hand, in the data for each page image targeted for image formation included in the job data, the placement of images within the page may be adjusted as appropriate, or explanatory text may be added. Furthermore, in scanned image I0 related to a sample image containing multiple images (individual images), only some of the individual images may be included in the page image, or multiple individual images within a sample image may be divided and included across multiple pages. In such cases, the search should be performed on an image basis rather than a page basis.

[0042] If the scanned image I0, as described above, has multiple recognizable contours that can be separated (separated from each other and not in a containment relationship), then each contour is divided and extracted, and each is treated as a separate image. Similarly, when the print server 2 acquires job data, the search server 3 should analyze the image data within the job data and generate partial image data (partial image data) by dividing each separable image. For images that include a background, such as photographs, it is not necessary to individually separate the objects depicted in the photograph; the entire photographic image may be treated as a partial image. Also, if the contour of the image is not closed, such as when the frame surrounding a figure is not closed, the range of the partial image may be defined by setting a range that is circumstantial to the contour extracted from the image and is mutually exclusive with other partial images. Furthermore, text (sentences) may or may not be included in the image. Alternatively, only colored text or special fonts (decorative fonts, etc.) may be included in the image. If at least a part of the text is included in the image, the range of the partial image may be set to include the entire area where the text is written together. Once generated, the partial image data is stored in association with the original job data. This eliminates the need to perform image segmentation every time in subsequent search processes, even after it has been archived in the data storage device 4; each partial image only needs to be used for comparison. The segmentation of contours (partial images) within the job data may be performed by the print server 2.

[0043] Whether or not such a partial image comparison search (partial search) is performed may be toggled between a full search and a general search based on user input. Alternatively, a general search (partial search) may be performed only if no matching page images are found, or both general and partial searches may be performed together, but if a general match is found, the list of pages containing matching (similar) images from the partial search may not be displayed. In this case, the search type (general search or partial search) may be switched automatically, or it may be switched when no pages with a general match are found or when inappropriate results are obtained, for example, by the user selecting the "Next" button without selecting a page using the checkbox on the far left. In other words, if a partial search is executable on search server 3, whether or not it is actually executed should be determined based on the situation and settings.

[0044] Figure 5 illustrates partial search. As described above, the three images contained in scanned image I0 are separated into individual images, which are then referred to as individual images I0a to I0c for comparison. As shown in Figure 3, the three partial images contained in Page 3 of File A are extracted as matching the individual images I0a to I0c. Here, in the case of partial searches, the position of the partial images may not be considered. Here, the positional relationship (including orientation) of the three partial images in the extracted page image is different from the positional relationship of the three individual images I0a to I0c in scanned image I0, so they are not judged as a match in a whole search, but in a partial search, the three partial images may be extracted as a perfect match, all matching the individual images I0a to I0c.

[0045] Furthermore, the two images on Page 3 of File 3 can be detected as having nearly identical shapes to individual images I0a and I0b, but with slightly different color tones. Also, one of the two images on Page 3 of File B (the left one) is similar to individual image I0c, and one of the images on Page 4 of File 1 (the right one) is similar to individual image I0b. Thus, even if there is no match for all three images, a partial match can be selected.

[0046] Figure 6 shows an example of a screen that displays the results of a partial search. As described above, in a partial search, pages containing partial images that match any of the individual images I0a to I0c (such as Page 3 of File.A) are extracted simply as matching the three individual images I0a to I0c, regardless of the relative positions of the partial images. In addition, the partial search also lists the three pages mentioned above that contain partial images that match only some (one or two) of the three individual images I0a to I0c, which are partial matches (similar to the standard). The display order can be set to the lowest degree of similarity. As a quantitative method for determining the degree of similarity, for example, pages with a large number of partial images that match individual images I0a to I0c may be given a higher degree of similarity. Priority can also be set based on matching items such as shape, size, and color tone. Note that even if some items are similar, if other items differ significantly beyond the acceptable range, for example, if the shape is almost the same but the color is significantly different, it may be considered not to be similar. Here, Page 3 of File.C, which contains individual images that match (are similar to) the two individual images I0a and I0b, is displayed second. If there are many similar pages, you may set an upper limit on the number of pages displayed, sorting by the degree of similarity.

[0047] In this case, the preview images of each page displayed in the list may show the matching sub-images in an identifiable manner. Here, each matching sub-image is shown with a dashed border.

[0048] In the case of partial matching, it is possible that the intended job page data may not be detected at all (for example, the user may have thought they submitted the job but it was not actually submitted). In this case, the user may select the "Cancel" button to cancel the color adjustment process and then restart the process from submitting the job data.

[0049] Figure 7 is a flowchart showing the control procedure for the color adjustment control process performed in the processing system 100 of this embodiment. This control process is performed, for example, by the CPU 31 of the search server 3 and the CPU of the print server 2. This color adjustment control process, which includes the processing method of this embodiment, is started by the search server 3 when, for example, the CPU 31 determines that the operation reception unit 35 has received an input operation related to a user's request to start the color adjustment control process.

[0050] When the color adjustment control process is started, the CPU 31 acquires scan data of a sample image of the image to be corrected (the image desired by the user) (step S101; first acquisition means). The scan data may be sent to the print server 2 at the same time as the image acquisition is performed by the image forming apparatus 1 and sent to the search server 3, or the scan data may be sent from the search server 3 to the print server 2 after the target of color adjustment has been determined (step S111 described later). The CPU 31 analyzes the scan data to extract the contours of the images contained therein and determines the shape of the contours, the size within the contours, and other characteristics such as color tone (step S102).

[0051] The CPU 31 compares each page image of the job data stored in the print server 2 and the data storage device 4 with the acquired scan image I0 to search for and extract (detect) those that match (that meet a predetermined standard of similarity) (step S103; detection means).

[0052] The CPU 31 determines whether or not there is a page image that matches (a complete match) the scanned image I0 (step S104). If it is determined that there is a page image that matches ("YES" in step S104), the CPU 31 proceeds to step S107.

[0053] If it is determined that there is no overall matching page image (not detected) ("NO" in step S104), the CPU 31 separates the scanned image I0 into individual images I0a to I0c based on contours that are separated from each other, and also separates the characteristic information of each (step S105). For each page of the job image, the CPU 31 performs a partial search, comparing the partial images contained in that page with the individual images I0a to I0c to find any matches (step S106). Then, the CPU 31 proceeds to step S107.

[0054] When the process moves to step S107, the CPU 31 determines whether or not a matching image was detected (step S107). If it is determined that no matching image (job / page data) was detected ("NO" in step S107), the CPU 31 performs a predetermined notification operation indicating no detection result (step S115). The notification operation may, for example, display text or a sign to that effect on the display screen, or in addition to or instead of this, an audio output may be made. In this case, the image and operation reception may be changed so that the "Next" button cannot be selected. Then, the CPU 31 terminates the color adjustment control process.

[0055] If it is determined that a detection result was found ("YES" in step S107), the CPU 31 lists the jobs / pages that contain the image detected as containing an image that matches the scanned image (step S108). The CPU 31 determines whether each listed page is a partial image due to a partial search (step S109). If it is determined to be a partial image ("YES" in step S109), the CPU 31 configures the preview of the page images included in the list to add a display that allows the matched partial image to be identified (step S110). Then, the CPU 31 proceeds to step S111. If the determination process in step S109 determines that the detection was not a partial image (it was a whole image) ("NO" in step S109), the CPU 31 proceeds to step S111.

[0056] When the process moves to step S111, the CPU 31 has the display unit 36 ​​display the listed contents, waits for a selection operation to be made to the operation reception unit 35 according to the contents displayed on the display unit 36, and determines the job / page to be selected from the list (list) as the target of color adjustment (step S111; output means, selection control means). The CPU 31 has the image data (selection data) and job settings of the determined job / page sent from the print server 2 to the image forming apparatus 1, and hands over the following color adjustment control processing to the CPU of the print server 2. The CPU 21 of the print server 2 has the image forming apparatus 1 form an image according to the selection data, and also has the formed image read (scan) to generate scan data (step S112; formation control means). In order to prevent adjustment deviations due to differences in reading characteristics, it is preferable that the reading device that reads the scan image I0 and the reading device that reads this formed image are the same.

[0057] The CPU 21 acquires scan data (second read data) of the formed image from the image forming apparatus 1 (step S113; second acquisition means). The CPU 21 compares the scanned image related to the acquired scan data of the job / page with the scanned image of the sample image acquired initially or together with the selected data, and performs color adjustment (step S114; adjustment means). Then, the CPU 21 terminates the color adjustment control process.

[0058] Figure 8 shows an example of a display screen that simultaneously shows the results of a full search and a partial search based on each file image in Figure 3. As described above, the results of partial matches may be displayed in a list together with the results of full matches from the beginning, or the results of partial matches may be displayed in addition to the results of full matches in response to a predetermined input operation to the operation reception unit 35.

[0059] In such cases, indicating whether the match is whole or partial allows the user to better understand the degree of the match. The image on Page 3 of File.A shown at the top matches in a whole search as described above, and therefore the search type is indicated as a "whole" search. As shown above, items that match in a whole search will also be exact matches in a partial search.

[0060] The search results on the other three pages are all partial matches obtained through partial searches, so the "Partial" label is displayed along with the "Partial" result, indicating that the degree of similarity is reasonably high as a result of the "Partial Search" comparison. Thus, the results of the overall search and the partial search may be displayed simultaneously from the beginning, regardless of the results of the overall search, or the results of the partial search may be added to the results of the overall search in response to a predetermined input operation by the user. In these cases, the match (similarity) obtained through the overall search may be given a higher priority than the match (similarity) obtained through the partial search.

[0061] Figure 9 is a flowchart showing another example of color adjustment control processing. In this example, the color adjustment control process differs from the color adjustment control process shown in Figure 7 in that the position of step S104 is changed, step S108 is split into steps S108a and S108b, step S109 is deleted, step S111 is split into steps S111a to S111c, and step S121 is added. Other processes are the same, and the same reference numerals are used for identical processes, and detailed explanations are omitted.

[0062] After the processing in step S103, the CPU 31 proceeds to step S105. Also, if the determination process in step S107 branches to "YES", the determination process in step S104 is executed.

[0063] If the determination process in step S104 determines that there was a file / page that was an exact match ("YES" in step S104), the CPU 31 lists the jobs / pages that contain the page image that was an exact match (step S108a). At this time, the CPU 31 may set a flag or the like to identify that it is an "exact match" as shown in Figure 8. The CPU 31 obtains the content of the input operation received by the operation reception unit 35 (step S111a). The CPU 31 determines whether or not a request to display the results of a partial match has been received (step S121). If it is determined that the received content is not a request to display the results of a partial match (for example, if any file / page is selected and the "Next" button is selected) ("NO" in step S121), the CPU 31's processing proceeds to step S111c.

[0064] If the determination process in step S121 determines that an operation requesting the display of partial match results has been received (for example, if the "Next" button is selected without any files / pages being selected), the processing of CUP31 proceeds to step S108b. If the determination process in step S104 determines that there were no files / pages that were a complete match ("NO" in step S104), the processing of CPU31 also proceeds to step S108b.

[0065] When the process moves to step S108b, the CPU 31 lists the jobs / pages that contain the detected partial match partial images (step S108b). At this time, the CPU 31 may set a flag or other identifier to identify that it is a "partial match," as shown in Figure 8. Also, if a list of jobs / pages containing page images that are a full match has already been set in step S108a, the CPU 31 can add a list of jobs / pages with partial matches without deleting this set data.

[0066] After executing the process in step S110, the CPU 31 obtains the details of the operation received by the operation reception unit 35 (step S111b). Then, the CPU 31 proceeds to step S111c.

[0067] When the process moves to step S111c, CPU 31 determines the job / page to be color-adjusted (step S111c). Then, CPU 31 proceeds to step S112, handing over the process to CPU 21 of print server 2, which then controls the execution of the color-adjustment process.

[0068] As described above, the processing system 100 of this embodiment includes a search server 3 equipped with a CPU 31 and a print server 2 equipped with a CPU 21. The CPU 31, as a first acquisition means, acquires scan data (first read data) of sample image data included in user-requested job data related to image formation; as a detection means, detects image data similar to the image included in the acquired first read data from the job data stored as job data 22 and archive data 41; and as an output means, outputs a list of the detected image data. The CPU 21, as a formation control means, causes the image forming apparatus 1 to form an image based on the selected data selected from the image data included in the list; as a second acquisition means, acquires second read data of the formed image; and as an adjustment means, performs color adjustment of the image related to the selected data based on the first read data and the second read data. In this way, by acquiring the initial reading data of a sample image to be used later for color adjustment in advance, and detecting images similar (matching) to the sample image from the image data contained in the job data, the user's effort involved in color adjustment and image formation is greatly reduced, allowing for quick acquisition of an appropriate setting image and a transition to image formation. Furthermore, since the system automatically narrows down to the most likely images, the number of images that the user needs to check is greatly reduced, thus reducing the possibility of the user selecting the wrong image.

[0069] Furthermore, the CPU 31 can perform detection means such as detecting image data that matches (satisfies the similarity criterion) the entire image, which is the entirety of the acquired scan image I0, and detecting data that includes images that match individual images, which are parts of the entire image. By enabling image detection based on individual images in this way, it becomes possible to properly detect images even in jobs designed so that images are not formed in the same arrangement as sample images containing multiple images.

[0070] Furthermore, the CPU 31, as a detection means, first detects image data that matches the overall image. If no data is found that meets a predetermined standard of similarity beyond what is considered a match, it then detects data containing images similar to the individual images. If there is job / page data that matches the overall image, it is highly likely to be what the user wants. In such cases, by not performing a partial search, the processing effort is reduced, and the user can easily select the desired job / page data and proceed with the color adjustment process.

[0071] Furthermore, the CPU 31, as a detection means, calculates the degree of similarity of the data in each detected image, and as an output means, generates a list in descending order of similarity. Generally, the more similar an image is to a sample image, the more likely it is to be the desired data. Therefore, by displaying and outputting the detection results in order of similarity, the user can easily select the desired job / page data.

[0072] Furthermore, CPU31 may determine that the degree of similarity is higher for images that closely match (are similar to) the overall image than for images that closely match (are similar to) individual images. As described above, if an image is almost identical to the overall image, there is a very high probability that it is the image the user wants. Therefore, by prioritizing the display output of such images over images that match individual images, the user can easily select the desired job / page data.

[0073] Furthermore, the processing system 100 includes an operation reception unit 35 that receives the content of input operations, and the CPU 31, as a selection control means, determines the selection data according to the content received by the operation reception unit 35. As described above, the possibility of false detection is low, especially when only one matching image is detected in a whole search, but by ultimately determining the selection data after obtaining user approval, it is possible to suppress the waste of color correction occurring on images included in the page data of the wrong job, including in the case of partial searches.

[0074] Furthermore, the CPU 31, as an output means, performs a predetermined notification operation to indicate that no data was detected if no data meeting a predetermined standard of similarity is found. If it is determined that the desired job / page data was not found, it is possible that the job data was not sent in the first place or that the sample image is incorrect. By proactively performing the notification operation, the user can be promptly prompted to check these possibilities.

[0075] Furthermore, the processing system 100 includes an image forming apparatus 1 that forms a color-adjusted image by the CPU 21. In other words, this processing system 100 can appropriately perform color adjustment to suit the image forming in a specific image forming apparatus 1.

[0076] Furthermore, in this embodiment, the CPU (for example, CPU 31) of a device integrating the print server 2 and the search server 3 may perform all of the operations of the first acquisition means, detection means, output means, formation control means, second acquisition means, and adjustment means described above. Even with such a configuration, by acquiring first reading data of a sample image to be used later for color adjustment in advance and detecting an image similar (matching) to the sample image from the image data contained in the job data, the effort required of the user for color adjustment and image formation can be greatly reduced, and an appropriate setting image can be obtained quickly, allowing for a transition to image formation. In addition, since processing is consistently performed by one of the CPUs, there is no need for handover of processing, making it easier to manage control procedures.

[0077] Furthermore, the processing method of this embodiment includes: a first acquisition step of acquiring scan data (first read data) of a sample image of image data included in user-requested job data related to image formation; a detection step of detecting image data similar to the image included in the first read data obtained in the first acquisition step from job data stored as job data 22 or archive data 41; an output step of outputting a list of image data detected in the detection step; a formation control step of causing the image forming apparatus 1 to form an image based on selected data selected from the data included in the output list; a second acquisition step of acquiring scan data (second read data) of the formed image; and an adjustment step of performing color adjustment of the image related to the selected data based on the first read data and the second read data. This processing method allows for the acquisition of initial reading data of a sample image to be used later for color adjustment. By detecting images similar to (matching) the sample image from the image data contained in the job data, the user's effort involved in color adjustment and image formation is significantly reduced, enabling the rapid acquisition of an appropriate setting image and subsequent image formation.

[0078] Furthermore, by installing the program 331 related to the above processing method on a computer and executing it in software, it becomes possible to easily detect the desired image contained in multiple (especially numerous) job data acquired, determine the selected data, and perform color adjustment on the selected data, without requiring any special hardware configuration and simply by reusing the scan data that is originally used for color adjustment.

[0079] It should be noted that the present invention is not limited to the embodiments described above, and various modifications are possible. For example, although the above embodiment was described as being capable of partial searching, it is not limited to this. Only full-match searches are possible. In this case, for example, the range of similarity for full matches may be defined more broadly than in the above embodiment, and partial differences, even if they are large, may be allowed and included in the extraction target.

[0080] Furthermore, the predetermined criteria for similarity determination that must be met may differ between a full search and a partial search.

[0081] Furthermore, the process of splitting the image into partial images for partial searches does not have to be performed at the timing shown in the above embodiment. For example, partial images of a job may be generated at the time the first search is performed after the job is acquired, or partial images of job data for which partial images have not yet been obtained may be generated periodically at predetermined times.

[0082] Furthermore, the output order (display order) of matching data does not necessarily have to be predetermined. It may simply be sorted in the order it was detected, or sorted in order of the job data acquisition date. Also, only exact matches may be displayed at the top, and no priority may be set for partial matches.

[0083] Furthermore, although the above embodiment was described as performing some kind of notification action if no matching image was found through the search, direct notification action is not required as long as the user can understand that no matching image was found. For example, if the message "Search complete" is simply displayed and there is nothing to display in the list, it can be understood indirectly that no matching image was found.

[0084] Furthermore, although the above embodiment was described as displaying a list of jobs / pages extracted as matching images using the display unit 36 ​​and accepting selection operations using the operation reception unit 35, it is not limited to this. The display image data may be output to an external device for display, and the selection operations from the operation reception unit 35 of the external device or its peripheral devices may be received via the communication unit 34 to determine the selected data. In this case, the communication unit 34 can function as an input means in this embodiment.

[0085] Furthermore, in the above embodiment, in addition to the job data 22 of the print server 2, the job data of the archive data 41 of the data storage device 4 was also included in the search target. However, the archive data 41 for which images have already been formed may be excluded from the search target.

[0086] Furthermore, although the data storage device 4 has been described as storing job data after image formation, it is not limited to this. Job data received by the print server 2 but not immediately used for image formation may be sent to the data storage device 4 and stored at appropriate intervals. In this case, if the data is identified as subject to color adjustment through a search including the archive data 41 as described above, the job data may be returned from the data storage device 4 to the print server 2, where it may be processed and adjusted, such as color adjustment, before being sent to the image forming apparatus 1 for use in image formation.

[0087] Furthermore, in the above embodiment, it was explained that the search server 3 performs processing related to the detection of job / page data, and then the print server 2 performs processing related to the color adjustment of the image based on the detected data. However, these processes may be distributed and executed by other processing devices. For example, the process of determining the target of color adjustment may be distributed and executed by multiple processing devices. For example, the search server 3 may send scanned sample image data to the print server 2 and the data storage device 4, respectively, to search for job data stored in each device, and then perform processes such as integrating, judging, outputting, and deciding on the results.

[0088] Furthermore, while the above description has used a storage unit 33 consisting of an HDD, flash memory, or other non-volatile memory as an example of a computer-readable medium for storing the program 331 related to color adjustment control of the present invention, the invention is not limited to these. Other computer-readable mediums that can be used include other non-volatile memories such as MRAM, and portable recording media such as CD-ROMs and DVD discs. In addition, a carrier wave can also be used as a medium for providing the program data of the present invention via a communication line. Furthermore, the specific configurations, processing operations, and procedures shown in the above embodiments can be modified as appropriate without departing from the spirit of the present invention. The scope of the present invention includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0089] 1. Image forming apparatus 2 Print Server 21 CPU 22 Job Data 3 Search Servers 31 CPU 32 RAM 33 Storage section 331 Programs 34 Communications Department 35 Operation reception section 36 Display section 4. Data storage devices 41 Archived Data 5 Terminal devices 100 Processing Systems I0 Scanned image I0a~I0c Individual Images

Claims

1. A first acquisition means for acquiring first read data of a sample image of image data included in user-specified job data related to image formation, A detection means for detecting image data similar to the image included in the first read data obtained by the first acquisition means from the job data stored in the storage unit, An output means for outputting a list of image data detected by the detection means, Forming control means for causing an image forming unit to form an image based on selected data selected from the data included in the list, A second acquisition means for acquiring second read data of the formed image, An adjustment means for performing color adjustment of the image relating to the selected data based on the first read data and the second read data. Equipped with, The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. A processing system characterized by the following:

2. The processing system according to claim 1, characterized in that the detection means detects image data similar to the overall image, and if no data satisfying a predetermined standard of similarity is detected, it detects data including an image similar to the individual image.

3. The detection means determines the degree of similarity of the detected image data, The output means generates the list in descending order of similarity. The processing system according to claim 1, characterized in that it is the same as described in claim 1.

4. The detection means determines the degree of similarity of the detected image data, The output means generates the list in descending order of similarity, The degree of similarity is higher for images that are similar to the overall image than for images that are similar to the individual images. The processing system according to claim 1, characterized in that it is the same as described in claim 1.

5. An input means that accepts the content of an input operation, A selection control means that determines the selection data according to the content received by the input means, The processing system according to any one of claims 1 to 4, characterized by comprising:

6. The processing system according to any one of claims 1 to 4, characterized in that the output means performs a predetermined notification operation indicating that no data was detected when no data satisfying a predetermined standard of similarity is detected.

7. The processing system according to any one of claims 1 to 4, further comprising an image forming unit that forms the color-adjusted image by the adjustment means.

8. A first acquisition means for acquiring first read data of a sample image of image data included in user-specified job data related to image formation, A detection means for detecting image data similar to the image included in the first read data obtained by the first acquisition means from the job data stored in the storage unit, An output means for outputting a list of image data detected by the detection means, Forming control means for causing an image forming unit to form an image based on selected data selected from the data included in the list, A second acquisition means for acquiring second read data of the formed image, An adjustment means for performing color adjustment of the image relating to the selected data based on the first read data and the second read data. Equipped with, The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. A processing apparatus characterized by the following:

9. A first acquisition step involves obtaining first read data of a sample image of image data included in user-requested job data related to image formation. A detection step in which image data similar to the image included in the first read data obtained in the first acquisition step is detected from the job data stored in the storage unit. An output step that outputs a list of the image data detected in the above detection step, A formation control step in which an image forming unit forms the image based on selected data selected from the data included in the list, A second acquisition step to acquire second read data of the formed image, An adjustment step in which the color of the image relating to the selected data is adjusted based on the first read data and the second read data. Includes, In the aforementioned detection step, It is possible to detect image data similar to the overall image of the first read data obtained in the first acquisition step, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. A processing method characterized by the following.

10. Computer A first acquisition means for acquiring first read data of a sample image of image data included in user-specified job data related to image formation, A detection means for detecting image data similar to the image included in the first read data obtained by the first acquisition means from the job data stored in the storage unit. An output means that outputs a list of image data detected by the detection means. Forming control means that causes the image forming unit to form the image based on selected data selected from the data included in the list, A second acquisition means for acquiring second read data of the formed image, Adjustment means for adjusting the color of the image related to the selected data based on the first read data and the second read data. It is a program designed to function as such. The detection means is The first acquisition means makes it possible to detect image data similar to the overall image of the first read data obtained by the first acquisition means, and to detect data containing images similar to a plurality of individual images that are parts of the overall image, respectively. The system identifies the multiple individual images from the overall image and detects data containing images similar to each of the individual images, regardless of their respective positions. program.

Images