Information processing device and program

Abstract

To provide an information processing apparatus and a program that, in correcting one image including two or more objects to obtain uniformity in image quality between a plurality of images, inform a user of one of the objects suitable for the correction.SOLUTION: An information processing apparatus 10 comprises a processor. The processor acquires a plurality of images each including any of a plurality of objects, and outputs notification information that is information for notifying a user of one of two or more objects of the plurality of objects suitable for correction of one image created based on an analysis result related to the plurality of objects in the plurality of images and including the two or more objects.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] Patent document 1 describes an information processing device having an attribution rate calculation means for calculating, for each scene category, a attribution rate which is the probability that the scene category belongs to an input image, an acquisition means for acquiring environmental information which is information indicating the environment at the time of shooting, a correction value calculation means for calculating a composite correction value by reflecting the environmental information in the attribution rate for each scene category, and an image correction means for correcting the image using the composite correction value.

[0003] Patent document 2 describes an image processing method that involves identifying subjects present in an image, dividing the image into multiple parts, and creating a subject pattern for each divided image that can be processed in a manner determined based on its relationship with other images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-69148 A [Patent Document 2] JP 2004-234069 A Summary of the Invention [Problem to be solved by the invention]

[0005] When it is desired to correct an image so as to obtain a sense of uniformity in image quality among a plurality of images, the image may contain two or more objects. In such a case, it is conceivable to correct the image to match one of the two or more objects. However, if a configuration is adopted in which the image is corrected without outputting which object the image is to be corrected to match, it is not possible to inform the user which object the image is to be corrected to match.

[0006] The object of the present invention is to inform a user which object to correct when correcting an image containing two or more objects so as to achieve a sense of uniformity in image quality among multiple images. [Means for solving the problem]

[0007] The invention described in claim 1 includes a processor, and the processor is configured to generate a plurality of images each including any one of a plurality of objects. From a printed manuscript including the Get The above Information informing which of the two or more objects an image containing two or more objects among a plurality of objects is to be corrected to and information indicating that, when the number of images including one of the two or more objects is greater than the number of images including the other of the two or more objects, the one object is prioritized over the other objects. The information processing device outputs notification information that is Claim 2 The invention described in is characterized in that the one image is included in the plurality of images acquired from the document. Claim 1 The present invention relates to an information processing device. Claim 3 In the invention described in Indicates that the one object is preferred over the other object. 2. The information processing device according to claim 1, further comprising an order of the plurality of objects. Claim 4 The invention described in is characterized in that the order of the plurality of objects is an order of a part of the plurality of objects. Claim 3 The present invention relates to an information processing device. Claim 5 The invention described in The above The part of the plurality of objects is a specific object among the plurality of objects. Number of images containing Below standard If The part is characterized in that it is a part excluding the specific object. Claim 4 The present invention relates to an information processing device. Claim 6 The invention described in is characterized in that the part of the plurality of objects is a part excluding a specific object when there is no image including the specific object and another object among the plurality of objects. Claim 4 The present invention relates to an information processing device. Claim 7The invention described in is characterized in that the processor changes the order of the plurality of objects in response to a user operation. Claim 3 The present invention relates to an information processing device. Claim 8 In the invention described in the above, the processor outputs influence information indicating an influence that a change in the order of a first object and a second object among the plurality of objects has on correction of the one image including the first object and the second object. The influence information includes information for comparing an image obtained by correcting the first image including the first object and the second object to match the first object with an image obtained by correcting the first image including the first object and the second object to match the second object. Characterized by Claim 7 The present invention relates to an information processing device. Claim 9 The invention described in the item (1) is a method for acquiring a plurality of images each including one of a plurality of objects, From a printed manuscript including the The ability to obtain The above Information informing which of the two or more objects an image containing two or more objects among a plurality of objects is to be corrected to and information indicating that, when the number of images including one of the two or more objects is greater than the number of images including the other of the two or more objects, the one object is prioritized over the other objects. The program is for realizing the function of outputting the notification information. Effect of the Invention

[0008] According to the invention of claim 1, In the manuscript When correcting an image including two or more objects so as to obtain a sense of uniformity in image quality between the images, the user can be informed of which object the correction should be performed for. Claim 2 According to the invention, when correcting an image that contains two or more objects in a document so as to achieve a sense of uniformity in image quality within the document, the user can be informed of which object the correction should be applied to. Claim 3 According to the invention, it is possible to inform a user of which object an image should be adjusted for correction based on the order of a plurality of objects. Claim 4 According to the invention, waste caused by outputting the entire sequence of a plurality of objects in order to inform the user of which object an image should be corrected for is eliminated. Claim 5According to the invention, there is no waste caused by outputting the order of multiple objects, including objects whose importance in multiple images is below a certain level, in order to inform a user of which object an image should be corrected for. Claim 6 According to the invention, there is no waste caused by outputting multiple objects, including objects that do not have images included with other objects, in order to inform the user of which object an image should be corrected to. Claim 7 According to the invention, the order of a plurality of objects, which is used to determine which object an image is to be adjusted to correct, can be changed by a user operation. Claim 8 According to the invention, it is possible to inform a user of the effect that changing the order of a first object and a second object has on correction of an image including the first object and the second object. Claim 9 According to the invention, In the manuscript When correcting an image including two or more objects so as to obtain a sense of uniformity in image quality between the images, the user can be informed of which object the correction should be performed for. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of a hardware configuration of an image processing device according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an example of a functional configuration of an image processing device according to an embodiment of the present invention; [Figure 3-1] 4 is a flowchart showing an example of an operation of the image processing device according to the embodiment of the present invention. [Figure 3-2] 4 is a flowchart showing an example of an operation of the image processing device according to the embodiment of the present invention. [Figure 3-3] 4 is a flowchart showing an example of an operation of the image processing device according to the embodiment of the present invention. [Figure 4] 13A and 13B are diagrams showing an example of a correction setting screen that is displayed before the document obtaining unit obtains a document. [Diagram 5] 13 is a diagram showing an example of scene information after a scene determination unit counts up the number of images for each scene for a plurality of images. FIG. [Figure 6] FIG. 13 is a diagram showing a first example of a priority order confirmation screen displayed by a priority order change unit. [Figure 7] FIG. 13 is a diagram showing a second example of a priority order confirmation screen displayed by the priority order change unit. [Figure 8] FIG. 13 is a diagram showing a third example of a priority order confirmation screen displayed by the priority order change unit. [Figure 9] FIG. 13 is a diagram showing a first example of a priority order confirmation screen including changed priorities displayed by a priority order change section. [Figure 10] 1A is a diagram showing a second example of a priority confirmation screen including the changed priority displayed by the priority change unit, and FIG. 1B is a diagram showing an example of a change result confirmation screen displayed by the priority change unit. [Figure 11] 11 is a diagram showing an example of correction content information to which a correction content determination unit refers when determining correction content. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0011] [Outline of this embodiment] This embodiment provides an information processing device that acquires multiple images, each of which includes one of multiple objects, and outputs notification information that is generated based on analysis results regarding the multiple objects in the multiple images, and is information that notifies the user as to which of the two or more objects an image that includes two or more of the multiple objects should be corrected to match.

[0012] Here, the information processing device may acquire multiple images from any unit of data, such as a printed manuscript or a page containing multiple images, but in the following, it will be described as acquiring multiple images from a printed manuscript containing multiple images.

[0013] In this case, an image to be corrected according to which of two or more objects is to be determined may or may not be included in the multiple images acquired from the document. The former is a case where an image within the document is corrected to obtain a sense of unity within the document, and the latter is a case where an image outside the document is corrected to obtain a sense of unity within the document. The information processing device may perform either of these corrections, but the following description will be given assuming that the information processing device performs the former correction.

[0014] Furthermore, the notification information may include an order of two or more objects contained in one image in order to determine which of the two or more objects to correct before correcting the image. Alternatively, the notification information may include an order of multiple objects in order to determine which of the two or more objects contained in each image in order to correct before correcting multiple images each containing one of the multiple objects. The following description will be given taking the latter case as an example of notification information.

[0015] In this case, the order of the multiple objects may be the order of all of the multiple objects or the order of some of the multiple objects. The former is a case where the notification information includes the order of the multiple objects without omitting any of the objects, and the latter is a case where the notification information includes the order of the multiple objects with omitting some of the objects.

[0016] At this time, the part of the plurality of objects may be determined by any method, but in the following, the following two methods are used as examples for explanation.

[0017] The first method is a method in which the analysis result indicates the importance of each of a plurality of objects in a plurality of images, and in which, when the analysis result indicates that the importance of a particular object among the plurality of objects is below a standard, the portion excluding the particular object is treated as part of the plurality of objects.

[0018] The second method is to consider the portion excluding a specific object as part of the multiple objects when there is no image that includes a specific object among the multiple objects as well as other objects.

[0019] In this case, the information processing device may then change the order of the multiple objects in response to a user operation. Although the information processing device does not necessarily have to change the order of the multiple objects, the following description will be given assuming that the order of the multiple objects is changed.

[0020] The information processing device may output influence information indicating an influence that a change in the order of a first object and a second object among a plurality of objects has on correction of an image including the first object and the second object. The information processing device does not necessarily have to output the influence information, but hereinafter, the information processing device is described as outputting the influence information.

[0021] The influence information may be any information indicating such an influence. In the following, an example of influence information including information for comparing an image obtained by correcting an image including a first object and a second object so as to match the first object with an image obtained by correcting an image including the first object and a second object so as to match the second object will be described.

[0022] In the following, an image processing device will be described as an example of an information processing device. Here, the image processing device may be a PC (Personal Computer) or the like in which image processing software is installed, and may be connected to a printing device that prints images after image processing.

[0023] [Hardware configuration of image processing device] FIG. 1 is a diagram showing an example of a hardware configuration of an image processing device 10 according to the present embodiment. As shown in the figure, the image processing device 10 includes a processor 11, a main memory 12, and an HDD (Hard Disk Drive) 13. Here, the processor 11 executes various software such as an OS (Operating System) and applications to realize various functions described later. The main memory 12 is a storage area for storing various software and data used for executing the software, and the HDD 13 is a storage area for storing input data for the various software and output data from the various software. Furthermore, the image processing device 10 includes a communication interface (hereinafter, referred to as "I / F") 14 for communicating with the outside, a display device 15 such as a display, and an input device 16 such as a keyboard and a mouse.

[0024] [Functional configuration of image processing device] 2 is a block diagram showing an example of a functional configuration of the image processing device 10 according to the present embodiment. As shown in the figure, the image processing device 10 includes a document acquisition unit 21, an image acquisition unit 22, a scene determination unit 23, a scene information storage unit 24, a priority determination unit 25, a priority storage unit 26, a priority change unit 27, a correction content determination unit 28, and a correction processing unit 29.

[0025] The manuscript acquisition unit 21 acquires a manuscript of a printed matter including a plurality of images. Here, a printed matter refers to a matter that is printed by a printing device on a recording medium such as paper and is used for a specific purpose. Examples of printed matter include photo books and food products. A manuscript refers to data that is output to a printing device to create the printed matter. Examples of manuscripts include data of photo books and food products created by software.

[0026] The image acquisition unit 22 acquires a plurality of images from the document acquired by the document acquisition unit 21. Here, the plurality of images are preferably all images contained in the document, but in cases where there are too many images if all images are acquired, a portion of the images contained in the document may be acquired. Each of the plurality of images includes one of a plurality of scenes prepared in advance. Here, a scene refers to an object included in the image. For example, if the image is a photograph, a scene refers to a subject included in the image, that is, a photographed object. Examples of scenes include landscapes, people, animals, and food. For example, scenes that can be identified by an image discrimination technique using AI may be prepared in advance as the scene. In this embodiment, the processing of the image acquisition unit 22 is performed as an example of acquiring a plurality of images each including one of a plurality of objects.

[0027] The scene determination unit 23 creates scene information regarding scenes in the manuscript by determining the scenes contained in each of the multiple images acquired by the image acquisition unit 22. The scene determination unit 23 may determine the scenes using, for example, an AI-based image discrimination technique. The scene determination unit 23 counts the number of images containing each scene, and creates information on the number of images containing each scene as scene information.

[0028] Here, the scenes determined by the AI ​​image discrimination technology and the scenes managed by the scene information do not necessarily have to correspond one-to-one. In AI, many labels are sometimes prepared as labels representing scenes to improve learning accuracy, but if these are displayed as they are, the number of items increases and it is difficult for the user to select. Therefore, it is sufficient to use a collection of several scenes determined by AI as the scene to be displayed to the user. For example, it is possible to group mammals and reptiles together as animals, dishes and ingredients together as food, trees and flowers together as plants, glass and metal together as industrial products, etc.

[0029] Furthermore, the scene determination unit 23 may separately count the number of images including only a certain scene and the number of images including that scene and other scenes. Alternatively, the scene determination unit 23 may separately count the number of images including at least a certain scene and the number of images including that scene and other scenes. The former counting method will be described below as an example. However, regardless of which counting method is adopted, the number of images for each scene refers to the number of images including at least that scene. Furthermore, for a scene that combines a certain scene and other scenes, the scene determination unit 23 associates not only the number of images but also the images themselves.

[0030] Each time the scene determination unit 23 determines the scene contained in an image acquired by the image acquisition unit 22, the scene determination unit 23 passes the image to the correction content determination unit .

[0031] The scene information storage unit 24 stores the scene information created by the scene determination unit 23. In this embodiment, the scene information is used as an example of an analysis result regarding a plurality of objects in a plurality of images. In this embodiment, the scene information is also used as an example of an analysis result indicating the importance of each of the plurality of objects in a plurality of images.

[0032] The priority order determination unit 25 determines the priority order of scenes based on the scene information stored in the scene information storage unit 24 to determine which of the two or more scenes an image including two or more scenes should be corrected to. For example, the priority order determination unit 25 determines the priority order so that a scene included in many images in the document has a higher priority. Also, if there are two or more scenes included in the same number of images in the document, the priority order determination unit 25 determines the priority order so that the scene with a higher priority in the predetermined recommended priority order has a higher priority. Here, examples of the predetermined recommended priority order are people, landscapes, animals, food, plants, and industrial products. This is an order that is considered to be weak in the degree of influence obtained by taking into account the degree of influence of correction.

[0033] The priority order storage unit 26 stores the priorities determined by the priority order determination unit 25.

[0034] The priority order change unit 27 creates a priority order confirmation screen including the priorities stored in the priority order storage unit 26 as they are, and outputs the priority order confirmation screen to the display device 15. In this embodiment, the priority order confirmation screen is used as an example of notification information that is information generated based on the analysis result and that notifies which of the two or more objects an image including two or more objects should be corrected to match with. In this embodiment, the priority order confirmation screen is also used as an example of notification information that includes the order of the multiple objects for determining which of the two or more objects an image should be corrected to match with. Furthermore, in this embodiment, this process of the priority order change unit 27 is performed as an example of outputting notification information.

[0035] The priority change unit 27 may also create a priority confirmation screen including the priorities stored in the priority storage unit 26 in a narrowed-down state, and output the priority confirmation screen to the display device 15. The priority confirmation screen may include a screen including the priority of scenes after excluding scenes included in only a few images, or a screen including the priority of scenes after excluding scenes that are not included in one image together with other scenes. In the former case, the priority change unit 27 may exclude a scene when the number of images for a certain scene is equal to or less than a reference in the scene information stored in the scene information storage unit 24. In the latter case, the priority change unit 27 may exclude a scene when the number of images for a scene that is a combination of a certain scene and another scene is 0 in the scene information stored in the scene information storage unit 24. In this embodiment, the priority confirmation screen is used as an example of notification information including the order of a plurality of objects, which is the order of a part of the plurality of objects. In this embodiment, the priority confirmation screen is also used as an example of notification information including the order of a plurality of objects, which is the order of a part excluding a specific object, when the analysis result indicates that the importance of a specific object among the plurality of objects is equal to or less than a reference. Furthermore, in this embodiment, the priority confirmation screen is also used as an example of notification information including the order of multiple objects, which is the order of the parts excluding a specific object when there is no image including the specific object among the multiple objects and other objects.

[0036] Furthermore, the priority change unit 27 changes the priority stored in the priority storage unit 26 in response to a user operation on a priority confirmation screen displayed on the display device 15. Prior to changing the priority, the priority change unit 27 may create a change result confirmation screen showing the effect of changing the priority on image correction, and output the change result confirmation screen to the display device 15. In this case, the priority change unit 27 may extract, in the scene information stored in the scene information storage unit 24, an image associated with a scene in which the scene whose priority has been changed and another scene are combined, as an image affected by changing the priority. Then, the priority change unit 27 may create information for comparing an image after correction of the image before changing the priority with an image after correction of the image after changing the priority, and output this information to the display device 15 by including it in the change result confirmation screen. In this embodiment, this process of the priority change unit 27 is performed as an example of changing the order of multiple objects in response to a user operation. In addition, in this embodiment, the change result confirmation screen is used as an example of influence information indicating the influence that a change in the order of a first object and a second object among a plurality of objects has on the correction of an image including the first object and the second object. Furthermore, in this embodiment, the change result confirmation screen is also used as an example of influence information including information for comparing an image after an image including the first object and the second object is corrected to match the first object with an image after an image including the first object and the second object is corrected to match the second object. Furthermore, in this embodiment, this process of the priority order change unit 27 is performed as an example of outputting influence information.

[0037] The correction content determination unit 28 determines which of the two or more scenes an image including two or more scenes sent from the scene determination unit 23 should be corrected to, based on the priorities stored in the priority order storage unit 26. Then, the correction content determination unit 28 determines the correction content to be used when correcting the image to match the scene, based on a predetermined correspondence between the scene and the correction content.

[0038] When the correction processing unit 29 receives the image and the correction content from the correction content determination unit 28, the correction processing unit 29 performs a correction process on the received image using the received correction content.

[0039] It should be noted that the image processing device 10 does not necessarily have to include all of the document acquisition unit 21, the image acquisition unit 22, the scene determination unit 23, the scene information storage unit 24, the correction content determination unit 28, and the correction processing unit 29. For example, the image processing device 10 does not have to include the document acquisition unit 21. In that case, in the image processing device 10, the image acquisition unit 22 may acquire a plurality of images before being included in the document. Alternatively, the image processing device 10 does not have to include the correction processing unit 29. In that case, the image processing device 10 may communicate the correction content determined by the correction content determination unit 28 to another device, and the other device may perform correction on the image to be corrected using the communicated correction content.

[0040] [Operation of image processing device] 3-1 to 3-3 are flowcharts showing an example of the operation of the image processing device 10 in this embodiment. In the following, for simplicity of explanation, it is assumed that one image includes at most two scenes.

[0041] As shown in FIG. 3-1, in the image processing device 10, first, the document obtaining unit 21 obtains a document (step 201).

[0042] Next, the image acquisition unit 22 acquires a plurality of images from the document acquired in step 201 (step 202).

[0043] Next, the scene determination unit 23 focuses on one image among the multiple images acquired in step 202 (step 203). Then, the scene determination unit 23 determines the scene of the image focused on in step 203 (step 204). As a result, the scene determination unit 23 counts up the number of images for each scene in the scene information stored in the scene information storage unit 24 (step 205). Thereafter, the scene determination unit 23 determines whether or not there is an unprocessed image among the multiple images acquired in step 202 (step 206). Then, if the scene determination unit 23 determines that there is an unprocessed image, it returns the process to step 203, and if it determines that there is no unprocessed image, it proceeds to step 207.

[0044] Next, the priority order determination unit 25 determines the priority order of the scenes by referring to the scene information stored in the scene information storage unit 24. Specifically, the priority order determination unit 25 determines the priority order so that the priority is increased from the scene with the largest number of images per scene (step 207). Then, the priority order determination unit 25 determines whether or not there are multiple scenes with the same number of images per scene in the scene information stored in the scene information storage unit 24 (step 208). If it is determined that there are multiple scenes with the same number of images per scene, the priority order determination unit 25 determines the priority order so that the scene with a higher predetermined recommended priority is increased (step 209). If it is determined that there are not multiple scenes with the same number of images per scene, the priority order determination unit 25 proceeds directly to step 210. Then, the priority order determination unit 25 stores the priority order determined in this manner in the priority order storage unit 26 (step 210).

[0045] Next, as shown in FIG. 3-2, the priority order changing unit 27 outputs a priority order confirmation screen including the priorities stored in the priority order storage unit 26 to the display device 15 (step 221).

[0046] This allows the user to perform an operation to change the priority order on the priority order confirmation screen. The priority order change unit 27 then determines whether or not the user has performed an operation to change the priority order (step 222). If it is determined that the user has not performed an operation to change the priority order, the priority order change unit 27 advances the process to step 226. If it is determined that the user has performed an operation to change the priority order, the priority order change unit 27 outputs the changed priority order to the display device 15 so as to be displayed on the priority order confirmation screen (step 223).

[0047] This allows the user to confirm the result of the change of the priority order, that is, how the change of the priority order affects the correction of the image. Therefore, the priority order change unit 27 judges whether or not the user has performed an operation to request confirmation of the change result (step 224). If it is determined that the user has not performed an operation to request confirmation of the change result, the priority order change unit 27 advances the process to step 226. If it is determined that the user has performed an operation to request confirmation of the change result, the priority order change unit 27 outputs a change result confirmation screen to the display device 15 for allowing the user to confirm the change result of the priority order (step 225). Then, the priority order change unit 27 returns the process to step 224. For example, the priority order change unit 27 may return the process to step 224 when approval is input on the change result confirmation screen or when a predetermined time has elapsed since the change result confirmation screen was displayed.

[0048] Thereafter, the priority change unit 27 judges whether or not the user has performed an operation to confirm the priority (step 226). If it is judged that the user has not performed an operation to confirm the priority, the priority change unit 27 returns the process to step 221. If it is judged that the user has performed an operation to confirm the priority, the priority change unit 27 confirms the priority (step 227). Specifically, if step 227 is executed because there was no operation to change the priority by the user in step 222, the priority change unit 27 confirms the priority stored in the priority storage unit 26 as it is. Also, if step 227 is executed because there was no operation to request confirmation of the change result by the user in step 224, the priority change unit 27 overwrites the priority stored in the priority storage unit 26 with the priority changed by the user and confirms it.

[0049] Next, as shown in FIG. 3-3, the correction content determination unit 28 focuses on one image among the multiple images used in the scene determination in step 204 (step 241). Then, the correction content determination unit 28 determines whether the image focused on in step 241 includes two scenes (step 242). If it is determined in step 242 that the image does not include two scenes, the correction content determination unit 28 determines correction content suited to the one scene included in the image (step 243).

[0050] If it is determined in step 242 that the image includes two scenes, the correction content determination unit 28 acquires the priorities stored in the priority order storage unit 26 (step 244). Then, the correction content determination unit 28 refers to the priorities acquired in step 244 to determine the correction content suited to the scene with the higher priority order of the two scenes (step 245).

[0051] Next, the correction processing unit 29 corrects the image focused on in step 241 with the correction content determined in step 243 or step 245 (step 246). After that, the correction processing unit 29 determines whether or not there is an unprocessed image among the multiple images used for scene determination in step 204 (step 247). If the correction processing unit 29 determines that there is an unprocessed image, it returns the process to step 241, and if it determines that there is no unprocessed image, it ends the process.

[0052] [Specific example of operation of image processing device] 4(a) and (b) are diagrams showing an example of a correction setting screen 300 displayed on the display device 15 before the document acquisition unit 21 acquires the document in step 201 of FIG. 3-1. As shown in the figure, the correction setting screen 300 includes a pull-down list 310. In the pull-down list 310, whether to correct the image by automatic correction or manual correction is selected.

[0053] 4(a) shows the state of the correction setting screen 300 when manual correction is selected from the pull-down list 310. In this case, check boxes 331, 332 and slider bars 333, 334 are displayed as active, and other items are displayed as inactive. The check boxes 331, 332 indicate that skin correction and noise correction will be performed, respectively. The slider bars 333, 334 indicate the degree of brightness and vividness, respectively.

[0054] FIG. 4(b) shows the state of the correction setting screen 300 when automatic correction is selected in the pull-down list 310. In this case, check box 321 is displayed as active, and other items are displayed as inactive. Check box 321 instructs that correction be optimized according to the use of the document. Furthermore, when such an instruction is given in check box 321, button 322 is also displayed as active. Button 322 is a button for confirming which of the two or more scenes an image containing two or more scenes will be corrected to. When button 322 is pressed, the operation of this embodiment is performed.

[0055] Fig. 5 is a diagram showing an example of scene information 600 after the scene determination unit 23 counts up the number of images for each scene for multiple images in step 205 of Fig. 3-1. As shown in the figure, the scene information 600 associates a scene name, the number of images, and an image ID.

[0056] The scene name is the name of the scene. The scene name includes a scene name of only one scene and a scene name of a combination of two scenes.

[0057] The number of images is the number of images that contain the corresponding scene. This figure shows that the images acquired in step 202 of FIG. 3-1 included 20 images that contained only landscapes, 40 images that contained only people, 3 images that contained only animals, 17 images that contained only food, and 0 images that contained only plants. This figure also shows that the images acquired in step 202 of FIG. 3-1 included 2 images that contained people and animals, and 8 images that contained people and food.

[0058] The image ID is identification information of an image that includes a corresponding scene. This figure shows that, among the images acquired in step 202 in FIG. 3-1, the image with the image ID "P02" contains people and animals, and the image with the image ID "P04" contains people and food.

[0059] In this example, the scene name includes a scene name of only one scene and a scene name of a combination of two scenes, but it may include a scene name including at least one scene and a scene name of a combination of two scenes. In this case, when one image includes multiple scenes, each of the multiple scenes is counted as one. For example, if an image includes a person and food, the image is counted as one image including a person and one image including food.

[0060] 6 is a diagram showing an example of a priority order confirmation screen 400 that the priority order change unit 27 displays on the display device 15 in step 221 of FIG. 3-2. As shown in the figure, the priority order confirmation screen 400 includes a priority order display field 401, a cancel button 411, and a confirm button 412.

[0061] The priority display field 401 indicates that the priority is given in the order of people, food, landscape, animals, and plants. The priority display field 401 also displays the number of images including each scene as information for allowing the user to recognize the extent of the influence of each scene. In FIG. 5, the number of images including only people is 40, the number of images including people and animals is 2, and the number of images including people and food is 8, so that the total of these, 50, is displayed as the number of images including people. In FIG. 5, the number of images including only animals is 3, and the number of images including people and animals is 2, so that the total of these, 5, is displayed as the number of images including animals. In FIG. 5, the number of images including only food is 17, and the number of images including people and food is 8, so that the total of these, 25, is displayed as the number of images including food. However, the number of images is merely an example of information for allowing the user to recognize the extent of the influence of each scene, and the ratio of the number of images of each scene to the total number of images may be displayed.

[0062] A cancel button 411 is pressed when canceling this process, and a confirm button 412 is pressed when confirming the priority currently displayed in the priority display field 401. Furthermore, no button for confirming the result of changing the priority is provided on this priority confirmation screen 400. Therefore, this priority confirmation screen 400 is a screen that is displayed when, after step 223 is executed in FIG. 3-2, step 226 is executed without executing steps 224 and 225.

[0063] 7 is a diagram showing an example of a priority confirmation screen 420 that the priority change unit 27 displays on the display device 15 in step 221 of FIG. 3-2. The priority confirmation screen 420 is based on the idea that, as a result of scene determination, scenes with a small proportion of images do not need to be displayed, or scenes with a high proportion of images may be displayed. As shown in the figure, the priority confirmation screen 420 includes a priority display field 421, a cancel button 431, and a confirm button 432.

[0064] Only people, food, and scenery are displayed in the priority display field 421. On the other hand, animals and plants are not displayed because images including these both account for 5% or less of the total. The cancel button 431 and the confirm button 432 are the same as the cancel button 411 and the confirm button 412 in Fig. 6. Moreover, this priority confirmation screen 420 is also a screen that is displayed when step 226 is executed without executing steps 224 and 225 after step 223 is executed in Fig. 3-2.

[0065] 8 is a diagram showing an example of a priority confirmation screen 440 that the priority change unit 27 displays on the display device 15 in step 221 of FIG. 3-2. This priority confirmation screen 440 is based on the idea that if there is a scene in one image that does not overlap with any other scene, changing the priority of that scene will not affect image correction, and therefore it is not necessary to include that scene as a candidate for changing the priority. As shown in the figure, the priority confirmation screen 440 includes a priority display field 441, a cancel button 451, and a confirm button 452.

[0066] In the priority display field 441, only people, food, and animals that overlap with any other scenes in one image are displayed. On the other hand, landscapes and plants are not displayed because they do not overlap with any other scenes in one image and changing the priority does not affect the correction. In addition, in the figure, a statement 442 is also displayed to more clearly indicate this. The cancel button 451 and the confirm button 452 are the same as the cancel button 411 and the confirm button 412 in FIG. 6. In addition, this priority confirmation screen 440 is also a screen that is displayed when step 226 is executed without executing steps 224 and 225 after step 223 is executed in FIG. 3-2.

[0067] Fig. 9 is a diagram showing an example of a priority confirmation screen 400 including the changed priorities displayed on the display device 15 by the priority change unit 27 in step 223 of Fig. 3-2. In this way, the user can rearrange the scene names and change the scenes to be prioritized in the correction. In Fig. 6, the priority display field 401 displayed the order of priority as people, food, scenery, animals, and plants, but in Fig. 9, the priority display field 401 displays the order of priority as people, scenery, animals, food, and plants.

[0068] Fig. 10(a) is a diagram showing an example of a priority order confirmation screen 460 including the changed priorities displayed on the display device 15 by the priority order change unit 27 in step 223 of Fig. 3-2. As shown in the figure, the priority order confirmation screen 460 includes a priority order display field 461, a cancel button 471, a confirm button 472, and a change result confirmation button 473. Here, in the priority order display field 461, the priority order of food is set higher than the priority order of people.

[0069] FIG. 10B is a diagram showing an example of a change result confirmation screen 500 displayed on the display device 15 by the priority order change unit 27 in step 225 of FIG. 3-2. When the change result confirmation button 473 is pressed on the priority order confirmation screen 460 of FIG. 10A, this change result confirmation screen 500 is displayed. The change result confirmation screen 500 is a screen for displaying an image affected when the priority order is changed, to allow the user to confirm the correction contents. As shown in the figure, the change result confirmation screen 500 includes a pre-change image 501, a post-change image 502, and an OK button 511. Here, the priority order of food is set higher than that of people, which affects the correction of an image including people and food. Therefore, images including people and food are displayed as the pre-change image 501 and the post-change image 502. At that time, the pre-change image 501 is displayed as a post-change image before the priority order is changed, and the post-change image 502 is displayed as a post-change image after the priority order is changed.

[0070] FIG. 11 is a diagram showing an example of correction content information 700 to which the correction content determination unit 28 refers when determining the correction content in step 243 or step 245 in FIG. 3-3.

[0071] As shown in the figure, the correction content information 700 associates a scene name, brightness correction information, contrast correction information, noise correction information, sharpness correction information, saturation correction information, and skin color correction information. The scene name is the name of the scene. The brightness correction information, contrast correction information, noise correction information, saturation correction information, and skin color correction information are information that defines whether or not the corresponding correction is to be performed when an image includes the corresponding scene. Moreover, the sharpness correction information is information that defines the degree of sharpness correction to be performed when an image includes the corresponding scene.

[0072] For example, consider the case of correcting an image containing a person and food. If this image is to be corrected to match the person, brightness correction, contrast correction, noise correction, and skin color correction will be performed. On the other hand, if this image is to be corrected to match the food, brightness correction, contrast correction, and saturation correction will be performed, and sharpness correction will be performed to a lesser extent. Note that the combination of corrections for the scene shown in FIG. 11 is merely an example.

[0073] [Processor] In this embodiment, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0074] In addition, the operations of the processor in this embodiment may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. The order of the operations of the processor is not limited to the order described in this embodiment, and may be changed.

[0075] [program] The processes performed by the image processing device 10 in this embodiment are prepared as a program such as application software, for example.

[0076] In other words, the program realizing this embodiment can be understood as a program for enabling a computer to realize the functions of acquiring multiple images, each of which includes one of multiple objects, and outputting notification information, which is information generated based on analysis results regarding the multiple objects in the multiple images and is information that notifies the user as to which of the two or more objects an image that includes two or more of the multiple objects should be corrected to match.

[0077] The program for realizing the present embodiment can be provided not only by communication means but also by being stored in a recording medium such as a CD-ROM. [Explanation of symbols]

[0078] 10: image processing device, 21: manuscript acquisition section, 22: image acquisition section, 23: scene determination section, 24: scene information storage section, 25: priority determination section, 26: priority storage section, 27: priority change section, 28: correction content determination section, 29: correction processing section

Claims

1. A processor is provided. The processor, acquiring a plurality of images from a printed manuscript including the plurality of images, each of the images including any of a plurality of objects; outputting notification information indicating which of the two or more objects an image including two or more objects among the plurality of objects should be corrected to, and indicating that the one object is prioritized over the other objects when the number of images including the one object among the two or more objects is greater than the number of images including the other objects among the two or more objects; 23. An information processing apparatus comprising:

2. The information processing apparatus according to claim 1 , wherein the one image is included in the plurality of images acquired from the document.

3. The information processing apparatus according to claim 1 , wherein the notification information includes an order of the plurality of objects indicating that the one object is given priority over the other objects.

4. The information processing apparatus according to claim 3 , wherein the order of the plurality of objects is an order of a portion of the plurality of objects.

5. The information processing device described in Claim 4, characterized in that the portion of the plurality of objects is a portion excluding a specific object when the number of images containing the specific object among the plurality of objects is below a reference value.

6. The information processing device according to claim 4, characterized in that the portion of the plurality of objects is a portion excluding a specific object when there is no image including the specific object among the plurality of objects and another object.

7. The information processing apparatus according to claim 3 , wherein the processor changes the order of the plurality of objects in response to a user operation.

8. The processor outputs influence information indicating an influence of changing an order of a first object and a second object among the plurality of objects on correction of the one image including the first object and the second object; The information processing device according to claim 7, characterized in that the influence information includes information for comparing an image obtained by correcting the one image including the first object and the second object to match the first object with an image obtained by correcting the one image including the first object and the second object to match the second object.

9. On the computer, A function of acquiring a plurality of images from a printed manuscript including a plurality of images each including any one of a plurality of objects; a function of outputting notification information indicating which of the two or more objects an image including two or more objects among the plurality of objects should be corrected to, the notification information indicating that the one object is prioritized over the other objects when the number of images including the one object among the two or more objects is greater than the number of images including the other objects among the two or more objects; A program to achieve this.

Images