Image processing apparatus, method for controlling image processing apparatus, and program

Abstract

To provide a mechanism that, when a determination is required as to whether an image is created on the basis of a learning model in executing output processing of outputting image data, can change the output processing according to the determination.SOLUTION: In an image processing apparatus, a controller unit 503 comprises: output means (an image forming unit through a printer I / F 605, a network I / F 610) that can execute output processing of outputting image data; and determination means (an AI image identification unit 608) that determines whether the image data is the one generated on the basis of a learning model prior to the output processing. When the image data is determined to be the one generated on the basis of the learning model as a result of the determination made by the determination means, the output means does not execute the output processing.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, a control method thereof, and a program.

Background Art

[0002] In recent years, image generation technology using AI has become widespread. As a result, even individuals can easily generate, for example, realistic images. On the other hand, there have been cases where image generation technology using AI is maliciously used, which has become a problem. For example, photos of fictional events and accidents related to real people and facilities are fabricated. In order to prevent such abuse of image generation technology using AI, various countries are urgently developing laws and development guidelines related to AI-generated content. As such a law, for example, laws that stipulate that it is necessary to clearly indicate that the content has been generated by AI for AI-generated content are being considered. In the future, it is also highly likely that it will be required that AI-generated content and other content be clearly distinguished. Patent Document 1 discloses an image processing apparatus that has means for preventing abuse of image data, such as restricting output to paper, storage, and transfer to an external device, for image data of banknotes, securities, etc. whose reproduction is generally prohibited. And it is considered that there may be cases where restrictions are also necessary for the processing of images generated using AI for the image processing apparatus.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the image processing apparatus described in Patent Document 1 has a problem that even when it is necessary to determine whether an image is generated using AI, the determination is not made.

[0005] The present invention has been made in view of the above problems. The object of the present invention is to provide a mechanism that can be changed to an output process according to a determination when it is necessary to determine whether an image is an image generated based on a learning model when executing an output process for outputting image data.

Means for Solving the Problems

[0006] In order to achieve the above object, an image processing apparatus according to the present invention includes an output unit capable of executing an output process for outputting image data, and a determination unit that determines whether the image data is image data generated based on a learning model prior to the output process. The output unit is characterized in that when it is determined by the determination unit that the image data is image data generated based on the learning model, the output process is not executed.

Effects of the Invention

[0007] According to the present invention, when it is necessary to determine whether an image is an image generated based on a learning model when executing an output process for outputting image data, it becomes possible to change to an output process according to the determination.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Embodiments for Carrying Out the Invention

[0009] Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment. For example, each part constituting the present invention can be replaced with any configuration that can exhibit the same function. Also, any component may be added. Further, any two or more configurations (features) among the embodiments can be combined.

[0010] <<First Embodiment>> Hereinafter, the first embodiment will be described with reference to FIGS. 1 to 13.

[0011] <Configuration of Image Processing System> FIG. 1 is a block diagram showing the hardware configuration of an image processing system according to the first embodiment. As shown in FIG. 1, the image processing system 10 includes an AI image generation server 101 and a general-purpose terminal 102, which are communicably connected to each other via a network 100. The AI image generation server 101 is an external device that generates image data based on a learning model. Hereinafter, generating image data based on a learning model (including a learned model) may be referred to as "AI image generation". This image data is transmitted to the general-purpose terminal 102. The general-purpose terminal 102 is a device capable of executing various processes on the image data transmitted from the AI image generation server 101. The general-purpose terminal 102 is not particularly limited, and for example, a desktop or notebook personal computer, a tablet terminal, a smartphone, etc. can be used. Note that, in this embodiment, AI image generation is performed by the AI image generation server 101, but it is not limited thereto, and for example, it may be performed by the general-purpose terminal 102.

[0012] Figure 2 is a block diagram showing the hardware configuration of the AI image generation server. As shown in Figure 2, the AI image generation server 101 includes a CPU 201, a RAM 202, a ROM 203, a storage unit 204, a GPU 207, an AI identification information adding unit 208, and a network I / F 209. The CPU 201 controls the operation of the AI image generation server 101 based on the program expanded in the RAM 202. The ROM 203 is a boot ROM, and stores, for example, the boot program of the image processing system 10. The storage unit 204 is a non-volatile device composed of an HDD, an SSD, etc. The storage unit 204 stores a learned model 205 used for AI image generation, an AI image generation program 206, etc. In AI image generation, although it is possible to use an arbitrary learned model 205 and an existing AI image generation program 206 such as Stable DI / Ffusion, it is not limited to these uses. The learned model 205 and the AI image generation program 206 are loaded into the RAM 202 and executed by the CPU 201. Since the technology related to AI image generation is a known technology, it is omitted here.

[0013] AI image generation is executed in response to a request for AI image generation from the general-purpose terminal 102. The CPU 201 instructs the GPU 207 to respond to this request. The GPU 207 performs AI image generation processing according to this instruction. As a result, image data is generated. The image data includes identification information that can identify that the image data is image data generated by AI image generation, that is, image data generated based on a learning model. The addition of identification information to the image data is performed by the AI identification information addition unit 208. Note that the identification information may further include, for example, information about the learned model 205 and the AI image generation program 206, information about the AI image generation request, and the like. Also, the identification information may be added as metadata similar to the header information of the image file, or may be superimposed and added as an invisible digital watermark or a visualized text on the image itself. The network I / F 209 is connected to the network 100 and is responsible for input / output of various information. The connection between the network I / F 209 and the network 100 may be in a wired format or a wireless format.

[0014] Figure 3 is a block diagram showing the hardware configuration of the general-purpose terminal. As shown in Figure 3, the general-purpose terminal 102 has a CPU 301, a RAM 302, an SSD 303, a user I / F 304, and a network I / F 305. The CPU 301 controls the operation of the general-purpose terminal 102 based on a program expanded in the RAM 302. Various programs and the like are stored in the SSD 303. This program includes, for example, a system program and an AI image generation application. The user I / F 304 has, for example, a display, a touch panel, a keyboard, a mouse, etc., and performs input / output processing for the user. The network I / F 305 is connected to the network 100 and is responsible for input / output of various information. The connection between the network I / F 305 and the network 100 may be in a wired format or a wireless format. Note that the general-purpose terminal 102 may have, for example, a telephone function or a camera function.

[0015] FIG. 4 is a flowchart showing the processes executed by the general-purpose terminal and the AI image generation server. FIG. 4(a) is a flowchart showing the process executed by the general-purpose terminal. FIG. 4(b) is a flowchart showing the process executed by the AI image generation server. As shown in FIG. 4(a), in step S401, the CPU 301 of the general-purpose terminal 102 determines that it has received from the user via the user I / F 304 the parameters regarding the image generated by the AI image generation server 101. These parameters are not particularly limited and are, for example, those used in known AI image generation technologies such as keywords, sentences, images, etc. related to the image.

[0016] In step S402, the CPU 301 transmits an image generation request based on the parameters in step S401 to the AI image generation server 101 via the network I / F 305.

[0017] As shown in FIG. 4(b), in step S411, the CPU 201 of the AI image generation server 101 determines that it has received via the network I / F 209 the image generation request transmitted in step S402.

[0018] In step S412, the CPU 201 controls the GPU 207 to perform AI image generation using the learned model 205, etc. as described above.

[0019] In step S413, the CPU 201 controls the AI identification information adding unit 208 to add identification information to the image data generated in step S412. Hereinafter, the image data obtained by AI image generation may sometimes be referred to as "AI image data". Also, the AI image with the identification information added may sometimes be referred to as "identification information added image data".

[0020] In step S414, the CPU 201 transmits the image data with the identification information added in step S413 to the general-purpose terminal 102 via the network I / F 209. As a result, the general-purpose terminal 102 can receive the identification information added image data.

[0021] <Configuration of the Image Processing Apparatus> FIG. 5 is a block diagram showing the hardware configuration of the image processing system. As shown in FIG. 5, in the image processing system 10, the image processing apparatus 500 and the AI image identification server 701 are connected to the general-purpose terminal 102 via the network 100. Further, the general-purpose terminal 102 is equipped with an application capable of remotely submitting jobs to the image processing apparatus 500. The application is not particularly limited, and for example, it may be a driver application for the image processing apparatus 500, or in the case where the general-purpose terminal 102 is a tablet terminal or the like, it may be a mobile application corresponding to the image processing apparatus 500. The AI image identification server 701 is equipped with an AI image identification application using a known technique (for example, a learning model by machine learning). Thereby, the AI image identification server 701 can analyze the image data input via the network 100 and determine whether the image data was created by AI generation technology. Then, the AI image identification server 701 can notify the general-purpose terminal 102 of this determination result. Note that, in this embodiment, the general-purpose terminal 102 is connected to the AI image generation server 101, the image processing apparatus 500, and the AI image identification server 701 via the network 100, but is not limited thereto. For example, the network connecting the general-purpose terminal 102 and the AI image generation server 101 may be different from the network connecting the general-purpose terminal 102 and the image processing apparatus 500 and the AI image identification server 701.

[0022] FIG. 6 is a block diagram showing the hardware configuration of the image processing apparatus. As shown in FIG. 6, the image processing apparatus 500 includes an ADF (Automatic Document Feeder) 501, an image reading unit 502, a controller unit 503, and an image forming unit 504. The ADF 501 exchanges control signals with the image reading unit 502 via a data bus and conveys the document. The ADF 501 also has various sensors such as a document detection sensor for detecting a document, and notifies the values of the respective sensors during document conveyance. The image reading unit 502 reads the document together with the ADF 501 in accordance with the document reading instruction received from the controller unit 503 via the data bus. The controller unit 503 controls the entire image processing apparatus 500 including the ADF 501, the image reading unit 502, and the image forming unit 504 via the data bus. The controller unit 503 also analyzes the input image data and appropriately performs image processing to generate image data to be output. The image forming unit 504 prints the image data acquired from the controller unit 503 via the data bus as a visible image on the recording paper while conveying the recording paper. This printed matter is discharged from the image processing apparatus 500. Thus, in this embodiment, the image forming unit 504 functions as output means capable of printing processing for printing the image data as output processing for outputting the image data (output step).

[0023] FIG. 7 is a block diagram showing the hardware configuration of the controller unit of the image processing apparatus. As shown in FIG. 7, the controller unit 503 includes a CPU 601, an eMMC 602, a storage unit 603, a scanner I / F 604, a printer I / F 605, an image memory 606, an operation unit 607, an AI image identification unit 608, an image processing unit 609, and a network I / F 610. The CPU 601 is a computer that controls the entire image processing apparatus 500. The eMMC 602 is composed of a flash memory and stores the control program executed by the CPU 601. This control program includes, for example, programs for causing a computer to execute each part and each means of the image processing apparatus 500 (control method of the image processing apparatus). The storage unit 603 is a non-volatile memory for holding information necessary for various controls. The scanner I / F 604 transmits and receives data to and from the image reading unit 502. The printer I / F 605 transmits and receives data to and from the image forming unit 504. The image memory 606 stores image data and the like acquired via the scanner I / F 604. The operation unit 607 has a touch panel and hard keys. The touch panel, for example, displays information to the user and accepts operations such as job input and various settings.

[0024] The AI image identification unit 608 functions as a determination means for determining whether the image data transmitted from, for example, the general-purpose terminal 102 is image data generated by AI image generation prior to the output process (determination step). This determination is made based on the identification information. Specifically, the AI image identification unit 608 determines that the image data to be determined is image data generated by AI image generation when the identification information is included in the image data to be determined, that is, when there is identification information. Also, the AI image identification unit 608 determines that the image data to be determined is not image data generated by AI image generation when the identification information is not included in the image data to be determined, that is, when there is no identification information. The image processing unit 609 processes the image data. The network I / F 610 is connected to the network 100 and controls the input / output of various information and image data and the like.

[0025] <Restricted Printing for AI-Generated Images> FIG. 8 is a flowchart showing a process (restricted printing process for AI-generated images) executed by the image processing apparatus. When the image processing apparatus 500 receives a print job sent from the general-purpose terminal 102 via the network 100 at the network I / F 610, it starts executing the print job. The print job includes, in addition to the image data, information necessary for the image processing apparatus 500 to perform printing, such as the output size and resolution.

[0026] In step S801, the CPU 601 (controller unit 503) of the image processing apparatus 500 controls the AI image identification unit 608 to determine whether the print job received at the network I / F 610 includes AI image data (AI-generated image). Specifically, the AI image identification unit 608 determines whether the identification information indicating whether the image data is AI image data is included in the image data by referring to the metadata of the image data to be determined in the print job and performing image analysis. When the identification information is included in the image data, the AI image identification unit 608 determines that the print job includes AI image data. Also, when the identification information is not included in the image data, the AI image identification unit 608 determines that the print job does not include AI image data. Then, as a result of the determination in step S801, if it is determined that the print job includes AI image data, the process proceeds to step S802. At this time, the identification information is stored in the storage unit 603. On the other hand, as a result of the determination in step S801, if it is determined that the print job does not include AI image data, the process proceeds to step S803.

[0027] In addition, in this embodiment, the determination of whether or not the print job includes AI image data is made based on the presence or absence of identification information, but it is not limited to this. For example, the identification information can be quantified by a probability, a score, etc. indicating how much a specific part of the image data (image) to be determined resembles AI image data (AI-generated image). In this case, the AI image identification unit 608 converts the identification information into a percentage, and if the numerical value of the identification information is equal to or greater than a threshold value (N%), it determines that the print job includes AI image data. Also, if the numerical value of the identification information is less than the threshold value (N%), the AI image identification unit 608 determines that the print job does not include AI image data. The threshold value may be stored in the storage unit 603 in advance, may be included in the print job, or may be set by the operation unit 607 before job execution. Also, it is preferable that the threshold value can be changed as appropriate. Further, when the entire image of the image data to be determined is not an AI-generated image but a part of the image is an AI-generated image, the identification information may include information for specifying the AI-generated image part. As the specific information of the AI-generated image part, for example, it may be indicated by the coordinates of the upper left and lower right of the image, or may be pixel information constituting the AI-generated image part. Also, in this embodiment, the determination of whether or not the print job includes AI image data is performed by the AI image identification unit 608, but it is not limited thereto, and for example, it may be performed by the AI image identification server 701.

[0028] In step S803, the CPU 601 controls the image forming unit 504 to execute the print job, that is, executes normal printing processing as a document that does not include an AI-generated image. After step S803 is executed, the process ends.

[0029] In step S802, the CPU 601 notifies the user who uses the image processing apparatus 500 that the document to be printed contains an AI-generated image, and also notifies whether to perform restricted printing or cancel the printing. FIG. 9 is a diagram showing an example of a notification screen displayed on the image processing apparatus. The notification screen 900 shown in FIG. 9 is displayed on the touch panel of the operation unit 607. The notification screen 900 includes a preview image 901, a preview image 903, a print cancellation button 905, and a continue button 906 for restricted printing. The preview image 901 is an image showing the state of the original document image as it is. This preview image 901 includes a partial image 902 that is an AI-generated image. The preview image 903 is an image showing the predicted output result when restricted printing is performed. The preview image 901 and the preview image 903 are objects to be compared with each other. The preview image 903 includes a partial image 904 that is an AI-generated image. The partial image 904 is an image in which an image frame 908 and the character "AI" 909 are superimposed as information indicating that it is an AI-generated image. Thereby, the user can grasp that when the image data is printed, the printed matter will be the same as the printed matter with the preview image 903 printed. Note that the character 909 is "AI", but is not limited thereto, and any character indicating that it is an AI-generated image may be used. Also, the partial image 902 and the partial image 904 are respectively specified based on the identification information stored in the storage unit 603 in step S801. Also, the preview image 901 and the preview image 903 completely match when no AI-generated image is included or when it is shown that the entire image is an AI-generated image.

[0030] In step S804, the CPU 601 determines whether the continue button 906 for restricted printing on the notification screen 900 displayed in step S802 has been operated. As a result of the determination in step S804, if it is determined that the continue button 906 for restricted printing has been operated, the process proceeds to step S805. On the other hand, as a result of the determination in step S804, if it is determined that the continue button 906 for restricted printing has not been operated, that is, the print cancellation button 905 has been operated, the process ends.

[0031] In step S805, the CPU 601 controls the image forming unit 504 to perform restricted printing. Specifically, the CPU 601 refers to the identification information stored in the storage unit 603 and the setting of the restricted print output pattern. Then, the CPU 601 controls the image processing unit 609 to perform image processing for performing processing according to the restricted print output pattern setting on the AI-generated image portion included in the original image. After that, the CPU 601 controls the image forming unit 504 to output the image processed by the image processing unit 609. Thereby, a printed matter on which the same image as the preview image 903 is printed is obtained. After step S805 is executed, the process ends.

[0032] FIG. 10 is a diagram showing an example of a printed matter printed by the image processing apparatus. In the printed matter 1000 shown in FIG. 10(a), in the partial image 1001 which is an AI-generated image, a very light color is entirely overlaid, or a mark such as a star is superimposed, for example. Thereby, the user can recognize that the partial image 1001 is an AI-generated image. In the printed matter 1002 shown in FIG. 10(b), the partial image 1003 which is an AI-generated image is an image filled with black. Thereby, the user can recognize that the printed matter 1002 is a printed matter including an AI-generated image. Note that the printed matter including the AI-generated image is not limited to the printed matter 1000 and the printed matter 1002. For example, invisible information such as an electronic watermark may be superimposed on the entire image or a partial image. Further, information indicating that it is a printed matter including an AI-generated image may be set in advance by the administrator of the image processing apparatus 500 and stored in the storage unit 603, or may be set by the user and stored in the storage unit 603.

[0033] FIG. 11 is a diagram showing an example of an operation screen displayed on the image processing apparatus during restricted printing. The operation screen 1100 shown in FIG. 11 is displayed on the touch panel of the operation unit 607. The operation screen 1100 includes preview images 1101 to 1104, radio buttons 1105 to 1107, and an OK button 1108. The preview image 1101 is an image showing the state of the original image as it is. This preview image 1101 includes a partial image 1109 that is an AI-generated image. The preview image 1102 is an image (part 1) showing the prediction of the output result when restricted printing is performed. This preview image 1102 includes a partial image 1110 that is an AI-generated image. The partial image 1110 is the same as the partial image 904. The preview image 1103 is an image (part 2) showing the prediction of the output result when restricted printing is performed. This preview image 1103 includes a partial image 1111 that is an AI-generated image. The partial image 1111 is the same as the partial image 1001. The preview image 1104 is an image (part 3) showing the prediction of the output result when restricted printing is performed. This preview image 1104 includes a partial image 1112 that is an AI-generated image. The partial image 1112 is the same as the partial image 1003. The radio button 1105 is selected when it is desired to obtain a printed matter with the same image as the preview image 1102 as the printed matter. The radio button 1106 is selected when it is desired to obtain a printed matter with the same image as the preview image 1103 as the printed matter. The radio button 1107 is selected when it is desired to obtain a printed matter with the same image as the preview image 1104 as the printed matter. Then, one of the radio buttons 1105 to 1107 can be selected and the OK button 1108 can be operated. Thereby, a printed matter of the preview image corresponding to the selected radio button can be obtained.

[0034] As described above, in the image processing apparatus 500, depending on the result of the determination by the AI image identification unit 608, there are cases where the image data to be printed (output processed) is determined to be image data by AI image generation and cases where it is determined not to be image data by AI image generation. And when it is necessary to determine whether it is an AI image or not, the printing process can be changed according to the determination. Hereinafter, the case where it is determined that the image data is by AI image generation is referred to as "the first case", and the case where it is determined that the image data is not by AI image generation is referred to as "the second case". In the first case, the printing process is executed with the image data to be printed processed. As the processing for this image data, processing is performed to visualize that the printed matter obtained by the printing process is a printed matter of image data including identification information. Thereby, for example, a printed matter with the same image as the preview image 903 (see FIG. 9) or the printed matter 1000 (see FIG. 10(a)) is obtained. The partial image 904 of the preview image 903 is a superimposition of the image frame 908 and the character 909 "AI". The partial image 1001 of the printed matter 1000 has a very light color over the whole or a mark such as a star superimposed, for example. In addition, for the part that becomes an AI image, the printing process may not be executed. Thereby, for example, a printed matter with the same image as the printed matter 1002 (see FIG. 10(b)) is obtained. The partial image 1003 of the printed matter 1002 is an image filled with black. With such a printed matter, it can be grasped that the printed matter includes an AI image. Thereby, for example, it can be once suspected that the AI image might be a fake image. On the other hand, in the second case, the printing process is executed as it is without processing the image data to be printed.

[0035] <Configuration of restricted printing that performs AI image identification, etc. outside the image processing apparatus> In this embodiment, the AI image identification unit 608 is configured to be included in the image processing apparatus 500. However, for example, an AI image identification unit (hereinafter referred to as the "AI image identification unit for terminal") having the same functions as the AI image identification unit 608 may be included in the general-purpose terminal 102. Here, the description will focus on the differences from the configuration in which the above-described AI image identification unit 608 is included in the image processing apparatus 500, and the description of similar matters will be omitted. FIG. 12 is a flowchart showing the processing (print job processing for restricted printing of AI-generated images) executed on the general-purpose terminal. As shown in FIG. 12, in step S1201, the CPU 301 of the general-purpose terminal 102 controls the AI image identification unit for terminal to determine whether the print job includes AI image data (AI-generated image). If it is determined in step S1201 that the print job includes AI image data, the process proceeds to step S1202. On the other hand, if it is determined in step S1201 that the print job does not include AI image data, the process proceeds to step S1203.

[0036] In step S1202, the CPU 301 transmits a print job including the restricted printing specification and the AI identification result to the image processing apparatus 500 via the network I / F 209. Thereby, restricted printing is performed by the image processing apparatus 500 (see step S805 of the flowchart shown in FIG. 8). After step S1202 is executed, the process ends.

[0037] In step S1203, the CPU 301 transmits a print job including a normal printing specification that does not include the AI-generated image to the image processing apparatus 500 via the network I / F 305. Thereby, normal printing is performed by the image processing apparatus 500 (see step S803 of the flowchart shown in FIG. 8). After step S1203 is executed, the process ends.

[0038] In addition, in this embodiment, the image processing unit 609 is included in the image processing apparatus 500. However, for example, an image processing unit having the same function as the image processing unit 609 (hereinafter referred to as the "image processing unit for terminal") may be included in the general-purpose terminal 102. Here, the description will focus on the differences from the configuration in which the above-described image processing unit 609 is included in the image processing apparatus 500, and the description of similar matters will be omitted. FIG. 13 is a flowchart showing a modification of the process (print job process for restricted printing of AI-generated images) executed on the general-purpose terminal. As shown in FIG. 13, in step S1301, the CPU 301 of the general-purpose terminal 102 controls the AI image identification unit for terminal to determine whether the print job includes AI image data. If it is determined in step S1301 that the print job includes AI image data, the process proceeds to step S1302. At this time, the identification information is stored in the SSD 303. On the other hand, if it is determined in step S1301 that the print job does not include AI image data, the process proceeds to step S1303.

[0039] In step S1303, the CPU 301 transmits a print job including a normal print specification that does not include the AI-generated image to the image processing apparatus 500 via the network I / F 305. At this time, the AI-generated image of the print job is not processed by the image processing unit for terminal. As a result, normal printing is performed by the image processing apparatus 500. After step S1303 is executed, the process ends.

[0040] In step S1302, the CPU 301 notifies the user using the general-purpose terminal 102 that the original document contains an AI-generated image and also notifies whether to perform restricted printing or cancel the printing. This notification is made by displaying the notification screen 900 shown in FIG. 9 on the touch panel of the user I / F 304 or the like. Note that the information necessary for displaying the notification screen 900 shown in FIG. 9 is used with reference to the identification information stored in the SSD 303 in step S1301.

[0041] In step S1304, the CPU 301 determines whether the continue button 906 has been operated in the restricted printing of the notification screen 900 displayed in step S1302. As a result of the determination in step S1304, if it is determined that the continue button 906 has been operated in the restricted printing, the process proceeds to step S1305. On the other hand, as a result of the determination in step S1304, if it is determined that the continue button 906 has not been operated in the restricted printing, that is, the print cancel button 905 has been operated, the process ends.

[0042] In step S1305, the CPU 301 refers to the identification information stored in the SSD 303 and the setting of the restricted print output pattern. Then, the CPU 301 controls the image processing unit for the terminal to perform image processing for performing processing according to the restricted print output pattern setting on the AI-generated image portion included in the original image. After that, the CPU 301 transmits a print job including the image data on which the image processing has been performed to the image processing apparatus 500 via the network I / F 305. As a result, the image processing apparatus 500 obtains a printed matter on which the same image as the preview image 903 is printed. After executing step S1305, the process ends.

[0043] <<Second Embodiment>> Hereinafter, the second embodiment will be described with reference to FIGS. 14 to 19. The description will focus on the differences from the above-described embodiment, and the description of the same matters will be omitted. This embodiment is the same as the first embodiment except that the output process in the image processing apparatus is different. Specifically, as the output process for outputting the image data in this embodiment, a transmission process of transmitting the image data to a device other than the image processing apparatus 500, that is, a device different from the image processing apparatus 500 (for example, the general-purpose terminal 102) is handled. Further, in this embodiment, the network I / F 610 of the image processing apparatus 500 functions as an output means capable of performing the transmission process (output step).

[0044] <Restricted Transmission for AI-Generated Images> FIG. 14 is a flowchart showing a process (restricted transmission process for AI-generated images) executed by the image processing apparatus according to the second embodiment. When the image processing apparatus 500 receives a transmission job sent from the general-purpose terminal 102 via the network 100 at the network I / F 610, it starts executing the transmission job. The transmission job includes, in addition to the image data, information necessary for the image processing apparatus 500 to perform printing, such as the output size and resolution.

[0045] In step S1401, the CPU 601 (controller unit 503) of the image processing apparatus 500 controls the AI image identification unit 608 to determine whether the transmission job received at the network I / F 610 includes AI image data (AI-generated image). Specifically, the AI image identification unit 608 determines whether the identification information indicating whether the image data is AI image data is included in the image data by referring to the metadata of the image data to be determined in the transmission job and performing image analysis. When the identification information is included in the image data, the AI image identification unit 608 determines that the transmission job includes AI image data. Also, when the identification information is not included in the image data, the AI image identification unit 608 determines that the transmission job does not include AI image data. Then, as a result of the determination in step S1401, if it is determined that the transmission job includes AI image data, the process proceeds to step S1402. At this time, the identification information is stored in the storage unit 603. On the other hand, as a result of the determination in step S1401, if it is determined that the transmission job does not include AI image data, the process proceeds to step S1403.

[0046] In step S1403, the CPU 601 executes the transmission job, that is, performs the normal transmission process as a document that does not include the AI-generated image. After step S1403 is executed, the process ends.

[0047] In step S1402, the CPU 601 notifies the user who uses the image processing apparatus 500 that the image data includes an AI-generated image, and also notifies whether to perform restricted transmission or cancel the transmission. FIG. 15 is a diagram showing an example of a notification screen displayed on the image processing apparatus. The notification screen 1500 shown in FIG. 15 is displayed on the touch panel of the operation unit 607. The notification screen 1500 includes a preview image 1501, a preview image 1503, a transmission cancellation button 1505, and a continue button 1506 for restricted transmission. The preview image 1501 is an image showing the original image as it is. This preview image 1501 includes a partial image 1502 that is an AI-generated image. The preview image 1503 is an image showing a print result prediction when restricted transmission is performed. The preview image 1503 includes a partial image 1504 that is an AI-generated image. The partial image 1504 is an image in which an image frame 1508 and the character "AI" 1509 are superimposed as information indicating that it is an AI-generated image. Thereby, the user can grasp that when the image data to be subjected to restricted transmission is printed, the printed matter will be the same as the printed matter with the same image as the preview image 1503 printed.

[0048] In step S1404, the CPU 601 determines whether the continue button 1506 for restricted transmission on the notification screen 1500 displayed in step S1402 has been operated. As a result of the determination in step S1404, if it is determined that the continue button 1506 for restricted transmission has been operated, the process proceeds to step S1405. On the other hand, as a result of the determination in step S1404, if it is determined that the continue button 1506 for restricted transmission has not been operated, that is, the transmission cancellation button 1505 has been operated, the process ends.

[0049] In step S1405, the CPU 601 controls the network I / F 610 to perform restricted transmission. Specifically, the CPU 601 refers to the identification information stored in the storage unit 603 and the setting of the restricted print output pattern. Then, the CPU 601 controls the image processing unit 609 to perform image processing for performing processing according to the restricted print output pattern setting on the AI-generated image portion included in the original image. After that, the CPU 601 transmits a transmission job including the image data on which the image processing has been performed to a device other than the image processing apparatus 500 via the network I / F 610. After step S1405 is executed, the process ends.

[0050] FIG. 16 is a diagram showing an example of a printed matter printed by the printing apparatus when the apparatus other than the image processing apparatus is a printing apparatus. In the printed matter 1600 shown in FIG. 16(a), the partial image 1601 which is an AI-generated image has a very light color over the whole or a mark such as a star is superimposed thereon. Thus, the user can recognize that the partial image 1601 is an AI-generated image. In the printed matter 1602 shown in FIG. 16(b), the partial image 1603 which is an AI-generated image is an image filled with black. Thus, the user can recognize that the printed matter 1602 is a printed matter including an AI-generated image.

[0051] FIG. 17 is a diagram showing an example of an operation screen displayed on the image processing apparatus during restricted transmission. The operation screen 1700 shown in FIG. 17 is displayed on the touch panel of the operation unit 607. The operation screen 1700 includes preview images 1701 to 1704, radio buttons 1705 to 1707, and an OK button 1708. The preview image 1701 is an image showing the original image as it is. This preview image 1701 includes a partial image 1709 that is an AI-generated image. The preview image 1702 is an image (part 1) showing the expected printing result at the destination when restricted transmission is performed. This preview image 1702 includes a partial image 1710 that is an AI-generated image. The partial image 1710 is the same as the partial image 1504. The preview image 1703 is an image (part 2) showing the expected printing result at the destination when restricted transmission is performed. This preview image 1703 includes a partial image 1711 that is an AI-generated image. The partial image 1711 is the same as the partial image 1601. The preview image 1704 is an image (part 3) showing the expected printing result at the destination when restricted transmission is performed. This preview image 1704 includes a partial image 1712 that is an AI-generated image. The partial image 1712 is the same as the partial image 1603. The radio button 1705 is selected when it is desired to obtain a printed material with the same image as the preview image 1702 as the printed material. The radio button 1706 is selected when it is desired to obtain a printed material with the same image as the preview image 1703 as the printed material. The radio button 1707 is selected when it is desired to obtain a printed material with the same image as the preview image 1704 as the printed material. Then, one of the radio buttons 1705 to 1707 can be selected and the OK button 1708 can be operated. Thereby, at the destination when restricted transmission is performed, a printed material of the preview image corresponding to the radio button selected within the operation screen 1700 can be obtained.

[0052] As described above, in the image processing apparatus 500 of the present embodiment, depending on the result of the determination by the AI image identification unit 608, there are cases where the image data to be subjected to the transmission process is determined to be image data by AI image generation and cases where it is determined not to be image data by AI image generation. And when it is necessary to determine whether it is an AI image or not, the transmission process can be changed according to the determination. Hereinafter, as in the first embodiment, the case where it is determined that the image data is image data by AI image generation is referred to as "the first case", and the case where it is determined that the image data is not image data by AI image generation is referred to as "the second case". In the first case, the transmission process is executed in a state where the image data to be subjected to the transmission process is processed. As the processing of this image data, processing is performed so that the printed matter obtained by the printing process at the transmission destination is visualized as a printed matter of image data including identification information. Thereby, at the transmission destination, for example, a printed matter with the same image as the preview image 1503 (see FIG. 15) or the printed matter 1600 (see FIG. 16(a)) is obtained. The partial image 1504 of the preview image 1503 is an image in which the image frame 1508 and the character "AI" 1509 are superimposed. The partial image 1601 of the printed matter 1600 has a very light color over the whole or a mark such as a star is superimposed, for example. In addition, the transmission process may not be executed for the part that becomes the AI image. Thereby, for example, a printed matter with the same image as the printed matter 1602 (see FIG. 16(b)) is obtained. The partial image 1603 of the printed matter 1602 is an image filled with black. With such a printed matter, it can be grasped that the printed matter includes an AI image. Thereby, for example, it can be once suspected that the AI image might be a fake image. On the other hand, in the second case, the transmission process is executed as it is without processing the image data to be subjected to the transmission process.

[0053] <Configuration of restricted transmission for performing AI image identification, etc. outside the image processing apparatus> In this embodiment, the AI image identification unit 608 is included in the image processing apparatus 500. However, for example, a terminal AI image identification unit having the same function as the AI image identification unit 608 may be included in the general-purpose terminal 102. Here, the description will focus on the differences from the configuration in which the above-described AI image identification unit 608 is included in the image processing apparatus 500, and the description of similar matters will be omitted. FIG. 18 is a flowchart showing a process (transmission job process for restricted transmission of AI-generated images) executed on a general-purpose terminal. As shown in FIG. 18, in step S1801, the CPU 301 of the general-purpose terminal 102 controls the terminal AI image identification unit to determine whether AI image data (AI-generated image) is included in the transmission job. If it is determined in step S1801 that the transmission job includes AI image data, the process proceeds to step S1802. On the other hand, if it is determined in step S1801 that the transmission job does not include AI image data, the process proceeds to step S1803.

[0054] In step S1802, the CPU 301 transmits a transmission job including the restricted transmission designation and the AI identification result to, for example, the image processing apparatus 500 via the network I / F 209. Thereby, restricted printing is performed by the image processing apparatus 500 (see step S805 of the flowchart shown in FIG. 8). After step S1802 is executed, the process ends.

[0055] In step S1803, the CPU 301 transmits a transmission job including a normal transmission designation not including the AI-generated image to, for example, the image processing apparatus 500 via the network I / F 305. Thereby, normal printing is performed by the image processing apparatus 500 (see step S803 of the flowchart shown in FIG. 8). After step S1803 is executed, the process ends.

[0056] In addition, in this embodiment, the image processing unit 609 is included in the image processing apparatus 500. However, for example, a terminal image processing unit having the same function as the image processing unit 609 may be included in the general-purpose terminal 102. Here, the description will focus on the differences from the configuration in which the above-described image processing unit 609 is included in the image processing apparatus 500, and the description of the same matters will be omitted. FIG. 19 is a flowchart showing a modification of the process (transmission job process for restricted transmission of AI-generated images) executed on a general-purpose terminal. As shown in FIG. 19, in step S1901, the CPU 301 of the general-purpose terminal 102 controls the terminal AI image identification unit to determine whether the transmission job includes AI image data. If it is determined in step S1901 that the transmission job includes AI image data, the process proceeds to step S1902. At this time, the identification information is stored in the SSD 303. On the other hand, if it is determined in step S1901 that the transmission job does not include AI image data, the process proceeds to step S1903.

[0057] In step S1903, the CPU 301 transmits a transmission job including a normal transmission specification that does not include the AI-generated image to, for example, the image processing apparatus 500 via the network I / F 305. The AI-generated image of the transmission job at this time is not processed by the terminal image processing unit. As a result, normal printing is performed by the image processing apparatus 500. After step S1903 is executed, the process ends.

[0058] In step S1902, the CPU 301 notifies the user using the general-purpose terminal 102 that the transmission of image data including the AI-generated image is to be performed, and also notifies whether to perform restricted transmission or cancel the transmission. This notification is made by displaying the notification screen 900 shown in FIG. 15 on the touch panel of the user I / F 304 or the like.

[0059] In step S1904, the CPU 301 determines whether the continue button 1506 has been operated in the restricted transmission of the notification screen 900 displayed in step S1902. As a result of the determination in step S1904, if it is determined that the continue button 1506 has been operated in the restricted transmission, the process proceeds to step S1905. On the other hand, as a result of the determination in step S1904, if it is determined that the continue button 1506 has not been operated in the restricted transmission, that is, the transmission cancel button 1505 has been operated, the process ends.

[0060] In step S1905, the CPU 301 refers to the identification information stored in the SSD 303 and the setting of the restricted print output pattern. Then, the CPU 301 controls the image processing unit for the terminal to perform image processing for performing processing according to the restricted print output pattern setting on the AI-generated image portion included in the original image. After that, the CPU 301 transmits a transmission job including the image data on which the image processing has been performed to, for example, the image processing apparatus 500 via the network I / F 305. As a result, in the image processing apparatus 500, a printed matter on which the same image as the preview image 1503 is printed can be obtained. After step S1905 is executed, the process ends.

[0061] As described above, the preferred embodiments of the present invention have been explained. However, the present invention is not limited to the above-described embodiments, and various modifications and changes are possible within the scope of the gist thereof. The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors of a computer of the system or device read and execute the program. Further, the present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions. Also, the image data that is the target of the output process is data that has been transmitted from the AI image generation server 101 to the image processing apparatus 500 via the general-purpose terminal 102 in the above-described embodiments, but is not limited thereto. For example, the image data that is the target of the output process may be data read by the image reading unit 502 of the image processing apparatus 500. In this case, it is preferable that the image data is, for example, data for which it is determined whether it is an AI image through analysis or the like.

[0062] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) Output means capable of executing an output process for outputting image data, and determination means for determining, prior to the output process, whether the image data is image data generated based on a learning model, and is characterized in that when it is determined by the determination means that the image data is image data generated based on the learning model as a result of the determination, the output means does not execute the output process. An image processing apparatus. (Configuration 2) The image processing apparatus according to Configuration 1, wherein the output means is capable of a printing process of printing the image data as the output process. (Configuration 3) The image processing apparatus according to Configuration 1, wherein the output means is capable of a transmission process of transmitting the image data to a device different from the image processing apparatus as the output process. (Configuration 4) The output means, when it is determined by the determination means that the image data is not the image data generated based on the learning model as a result of the determination in the determination means, executes the output process, and is the image processing apparatus according to any one of Configurations 1 to 3. (Configuration 5) An output means capable of executing an output process for outputting image data, A determination means for determining whether or not the image data is the image data generated based on a learning model prior to the output process, and includes: The output means, when it is determined by the determination means that the image data is the image data generated based on the learning model as a result of the determination in the determination means, executes the output process in a state where the image data is processed, and is an image processing apparatus. (Configuration 6) The output means, as the output process, is capable of a printing process for printing the image data, and is the image processing apparatus according to Configuration 5. (Configuration 7) The image data includes identification information capable of identifying that the image data is the image data generated based on the learning model, The output means, as processing on the image data, performs processing for visualizing that the printed matter obtained by the printing process is the printed matter of the image data including the identification information, and is the image processing apparatus according to Configuration 6. (Configuration 8) The output means, as the output process, is capable of a transmission process for transmitting the image data to a device different from the image processing apparatus, and is the image processing apparatus according to Configuration 5. (Configuration 9) The image data includes identification information capable of identifying that the image data is the image data generated based on the learning model, The output means, as processing on the image data, performs processing for visualizing that the printed matter when the image data transmitted by the transmission process is printed is the printed matter of the image data including the identification information, and is the image processing apparatus according to Configuration 8. (Configuration 10) The output means, when it is determined by the determination means that the image data is not the image data generated based on the learning model as a result of the determination, executes the output process as it is without performing any processing on the image data, which is characterized by the image processing apparatus according to any one of Configurations 5 to 10. (Configuration 11) The image data may include identification information that can identify that the image data is the image data generated based on the learning model. The determination means determines whether the image data is the image data generated based on the learning model based on the identification information, which is characterized by the image processing apparatus according to any one of Configurations 1 to 10. (Configuration 12) The determination means determines that the image data is the image data generated based on the learning model when there is the identification information, and determines that the image data is not the image data generated based on the learning model when there is no identification information, which is characterized by the image processing apparatus according to Configuration 11. (Configuration 13) The identification information is digitized. The determination means determines that the image data is the image data generated based on the learning model when the value of the identification information is equal to or greater than a threshold, and determines that the image data is not the image data generated based on the learning model when the value of the identification information is less than the threshold, which is characterized by the image processing apparatus according to Configuration 11. (Configuration 14) The image processing apparatus is communicably connected to an external device capable of transmitting the image data to the image processing apparatus. The output means executes the output process on the image data transmitted from the external device, which is characterized by the image processing apparatus according to any one of Configurations 1 to 13. (Method 1) A method for controlling an image processing apparatus, comprising: an output step capable of executing an output process for outputting image data; Prior to the output process, a determination step of determining whether the image data is image data generated based on a learning model is included. In the output step, when it is determined in the determination step that the image data is image data generated based on the learning model as a result of the determination in the determination step, the output process is not executed. A control method for an image processing apparatus characterized by this. (Method 2) A method for controlling an image processing apparatus, An output step capable of executing an output process of outputting image data, Prior to the output process, a determination step of determining whether the image data is image data generated based on a learning model is included. In the output step, when it is determined in the determination step that the image data is image data generated based on the learning model as a result of the determination in the determination step, the output process is executed with the image data being processed. A control method for an image processing apparatus characterized by this. (Program 1) A program for causing a computer to execute each means of the image processing apparatus according to any one of Configurations 1 to 14.

Explanation of Signs

[0063] 500 Image processing apparatus 504 Image forming unit 608 AI image identification unit 609 Image processing unit 610 Network I / F

Claims

1. Output means capable of executing an output process for outputting image data, Determination means for determining, prior to the output process, whether the image data is image data generated based on a learning model, and The output means is characterized in that, as a result of the determination by the determination means, when it is determined that the image data is image data generated based on the learning model, the output process is not executed. An image processing apparatus.

2. The output means is characterized in that, as the output process, a printing process for printing the image data is possible. The image processing apparatus according to claim 1.

3. The output means is characterized in that, as the output process, a transmission process for transmitting the image data to a device different from the image processing apparatus is possible. The image processing apparatus according to claim 1.

4. The output means is characterized in that, as a result of the determination by the determination means, when it is determined that the image data is not image data generated based on the learning model, the output process is executed. The image processing apparatus according to claim 1.

5. Output means capable of executing an output process for outputting image data, Determination means for determining, prior to the output process, whether the image data is image data generated based on a learning model, and The output means is characterized in that, as a result of the determination by the determination means, when it is determined that the image data is image data generated based on the learning model, the output process is executed in a state where the image data is processed. An image processing apparatus.

6. The output means is characterized in that, as the output process, a printing process for printing the image data is possible. The image processing apparatus according to claim 5.

7. The image data includes identification information capable of identifying that the image data is image data generated based on the learning model, The output means is characterized in that, as processing on the image data, processing for visualizing that a printed matter obtained by the printing process is a printed matter of the image data including the identification information is performed. The image processing apparatus according to claim 6.

8. The output means is characterized in that, as the output process, a transmission process for transmitting the image data to a device different from the image processing apparatus is possible. The image processing apparatus according to claim 5.

9. The image data includes identification information that can identify that the image data is image data generated based on the learning model. The output means, as processing on the image data, when printing the image data transmitted by the transmission process, performs processing to visualize that the printed matter is a printed matter of the image data including the identification information, according to the image processing apparatus described in claim 8.

10. When the determination means determines, as a result of determination, that the image data is not image data generated based on the learning model, the output means executes the output process as it is without performing processing on the image data, according to the image processing apparatus described in claim 5.

11. There may be a case where the image data includes identification information that can identify that the image data is image data generated based on the learning model. The determination means determines whether the image data is image data generated based on the learning model based on the identification information, according to the image processing apparatus described in claim 1 or 5.

12. When there is the identification information, the determination means determines that the image data is image data generated based on the learning model, and when there is no identification information, the determination means determines that the image data is not image data generated based on the learning model, according to the image processing apparatus described in claim 11.

13. The identification information is digitized. When the numerical value of the identification information is equal to or greater than a threshold value, the determination means determines that the image data is image data generated based on the learning model, and when the numerical value of the identification information is less than the threshold value, the determination means determines that the image data is not image data generated based on the learning model, according to the image processing apparatus described in claim 11.

14. The image processing apparatus is communicably connected to an external device capable of transmitting the image data to the image processing apparatus. The output means executes the output process on the image data transmitted from the external device, according to the image processing apparatus described in claim 1 or 5.

15. A method for controlling an image processing apparatus, comprising: an output step capable of executing an output process for outputting image data. Before the output process, there is a determination step of determining whether the image data is image data generated based on a learning model. In the output step, when it is determined in the determination step that the image data is image data generated based on the learning model as a result of the determination in the determination step, the output process is not executed. A control method for an image processing apparatus characterized by this.

16. A method for controlling an image processing apparatus, An output step capable of executing an output process for outputting image data, Before the output process, there is a determination step of determining whether the image data is image data generated based on a learning model. In the output step, when it is determined in the determination step that the image data is image data generated based on the learning model as a result of the determination in the determination step, the output process is executed with the image data being processed. A control method for an image processing apparatus characterized by this.

17. A program for causing a computer to execute each means of the image processing apparatus according to claim 1 or 5.

Images