Image processing device, method for controlling the image processing device, and program

Abstract

This provides a mechanism that allows for appropriate instructions to be given to the generation AI for image generation. [Solution] The image processing device 1 communicates with the generating AI server 10, which generates AI image data. The image processing device 1 is equipped with a scanner device that reads the original document. The image processing device 1 scans the original document, which is a rough sketch of an object drawn by the user by hand, and generates scanned image data of this document. Based on this scanned image data, the image processing device 1 causes the generating AI server 10 to generate AI image data.

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, a control method of the image processing apparatus, and a program.

Background Art

[0002] An AIGC (AI-Generated Content) system that generates an image using a keyword input by a user is known. In the AIGC system, as a keyword, for example, a prompt consisting of a character string of natural language is input (see Patent Document 1). The AIGC system generates an image including an object corresponding to the prompt input by the user. Thereby, the user can obtain an image including an object corresponding to this prompt, such as a person or a car, by simply inputting the prompt to the AIGC system.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the configuration using the above-described prompt as an instruction for image generation, the user may not be able to appropriately give an instruction regarding the composition, such as the direction in which a person is facing, or an instruction regarding the background.

[0005] An object of the present invention is to provide a mechanism capable of appropriately giving an instruction for image generation to a generative AI.

Means for Solving the Problems

[0006] To achieve the above objective, the image processing apparatus of the present invention is characterized by comprising: a reading means for reading a document; a means for causing a generating AI to generate second image data based on first image data obtained by reading the document by the reading means; and a means for receiving the second image data generated by the generating AI. [Effects of the Invention]

[0007] According to the present invention, it is possible to appropriately instruct the generation AI to generate images. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram showing the configuration of an AIGC system including an image processing device according to this embodiment. [Figure 2] This is a block diagram illustrating the configuration of the controller shown in Figure 1. [Figure 3] This is a block diagram that schematically shows the configuration of the generation AI server in Figure 1. [Figure 4] Figure 1 illustrates the processing performed by the image processing device using AI image data received from the AI ​​generation server. [Figure 5] This figure shows an example of the UI screen displayed on the control panel in Figure 1. [Figure 6] This figure shows an example of the settings screen displayed on the control panel in Figure 1. [Figure 7] Figure 6 is a diagram illustrating the settings for the operation buttons on the settings screen. [Figure 8] This flowchart shows the procedure for the AI ​​image data generation control process performed by the image processing device shown in Figure 1. [Figure 9] Figure 8 is a diagram illustrating the details of each step in the AI ​​image data generation control process. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the scope of the present invention as defined in the claims, and not all combinations of features described in these embodiments are necessarily essential to the solution of the present invention.

[0010] Figure 1 is a schematic diagram showing the configuration of an AIGC system (AI-Generated Content) including an image processing device 1 according to this embodiment. AI stands for Artificial Intelligence. In Figure 1, this AIGC system consists of an image processing device 1, a computer 9, and a generation AI server 10. The image processing device 1, the computer 9, and the generation AI server 10 can communicate with each other via LAN / Internet 8. In this AIGC system, the image processing device 1 reads a rough sketch of an object roughly drawn by hand by a user and generates digital image data of this sketch (hereinafter referred to as "scanned image data"). Based on this scanned image data, the image processing device 1 sends an image generation request to the generation AI server 10. The generation AI server 10 is equipped with a generation AI that generates colored, realistic image data (hereinafter referred to as "AI image data") according to the received image generation request. The generation AI server 10 sends the generated AI image data to the destination specified in the image generation request, such as the image processing device 1 or the computer 9.

[0011] Next, the configuration of the image processing device 1 will be described. As shown in Figure 1, the image processing device 1 comprises a scanner device 2, a controller 3, a printer device 4, an operation unit 5, a storage device 6, and a fax device 7. The controller 3 is connected to the scanner device 2, the printer device 4, the operation unit 5, the storage device 6, and the fax device 7, respectively.

[0012] The scanner device 2 includes a document feeder unit 21 capable of automatically and sequentially replacing a stack of documents, and a scanner unit 22 capable of optically scanning a document and converting it into scanned image data. The scanner device 2 optically reads an image from a document, converts it into scanned image data, and transmits this scanned image data to the controller 3.

[0013] The controller 3 executes a job by issuing instructions to the connected modules. The printer device 4 prints image data on paper. The printer device 4 includes a paper feeder unit 42 capable of sequentially feeding sheets one by one from a stack of papers, a marking unit 41 for printing image data on the fed paper, and a paper discharge unit 43 for discharging the printed paper. [[ID=…]]

[0014] The operation unit 5 receives various instructions from the user and also displays various information regarding the image processing device 1. The storage device 6 stores image data, control programs, etc. The FAX device 7 transmits scanned image data, etc. to an external device via a telephone line or the like.

[0015] The image processing device 1 performs transmission and reception of image data with the computer 9 via, for example, the LAN / Internet 8. Also, the image processing device 1 receives an instruction for issuing a job transmitted from the computer 9 via the LAN / Internet 8.

[0016] Also, the computer 9 controls the operation of the image processing device 1 via the LAN / Internet 8. For example, the computer 9 outputs a power OFF instruction to the controller 3 of the image processing device 1 via the LAN / Internet 8. The controller 3 controls the power OFF sequence of the image processing device 1 according to the received power OFF instruction.

[0017] The image processing apparatus 1 has a plurality of functions such as a copying function, an image transmission function, an image storage function, an image printing function, etc. The copying function is a function of recording the scanned image data generated by the scanner device 2 optically scanning a document in the storage device 6 and printing this scanned image data by the printer device 4. The image transmission function is a function of transmitting the scanned image data generated by the scanner device 2 optically scanning a document to an external device such as a computer 9 via the LAN / Internet 8. The image storage function is a function of recording the scanned image data generated by the scanner device 2 optically scanning a document in the storage device 6 and performing transmission and printing of this scanned image data as necessary. The image printing function is a function of analyzing the PDL data transmitted from the computer 9 and causing the printer device 4 to execute a printing process.

[0018] Next, the configuration of the controller 3 of the image processing apparatus 1 will be described. FIG. 2 is a block diagram schematically showing the configuration of the controller 3 in FIG. 1. In FIG. 2, the controller 3 is composed of a main system 200 and a subsystem 220.

[0019] The main system 200 is connected with a USB memory 209, an operation unit 5, a storage device 6, etc. The main system 200 is a so-called general-purpose CPU system. The main system 200 includes a main CPU 201, a boot ROM 202, a memory 203, a bus controller 204, a non-volatile memory 205, and a disk controller 206. The main system 200 further includes a flash disk 207, a USB controller 208, a network interface 210, and an RTC 211.

[0020] The main CPU 201 controls the entire main system 200. The boot ROM 202 stores the boot program. Memory 203 is used as the work memory for the main CPU 201. The bus controller 204 has a bridging function with the external bus. The non-volatile memory 205 is a storage device that can retain data even when the main system 200 is powered off. The disk controller 206 controls storage devices such as the flash disk 207 and the storage device 6. The flash disk 207 is a relatively small-capacity non-volatile storage device made of semiconductor devices, such as an SSD. The USB controller 208 controls USB devices connected to the image processing device 1. For example, the USB controller 208 performs processes such as saving image data to the USB memory 209 connected to the image processing device 1 and reading image data stored in the USB memory 209. The network interface 210 communicates data with external devices such as the computer 9 and the generation AI server 10 via LAN / Internet 8. The RTC 211 has a clock function.

[0021] The subsystem 220 is connected to a printer device 4, a scanner device 2, a fax device 7, and the like. The subsystem 220 consists of a relatively small general-purpose subCPU system and image processing hardware. The subsystem 220 includes a subCPU 221, memory 223, bus controller 224, non-volatile memory 225, image processing processor 226, printer controller 227, and scanner controller 228.

[0022] The sub-CPU 221 controls the entire subsystem 220. The sub-CPU 221 also controls the fax machine 7. Memory 223 is used as the work memory for the sub-CPU 221. The bus controller 224 has a bridging function with an external bus. The non-volatile memory 225 is a storage device that can retain data even when the subsystem 220 is powered off. The image processing processor 226 performs real-time digital image processing. The printer controller 227 controls the printing process by the printer machine 4. For example, the printer controller 227 sends image data to be printed to the printer machine 4. The scanner controller 228 controls the scanning process by the scanner machine 2. For example, the scanner controller 228 instructs the scanner machine 2 to perform a scan and retrieves the scanned image data generated during this scan from the scanner machine 2.

[0023] Here, the operation of controller 3 will be explained using the copying function as an example. When the user issues an image copying instruction from the operation unit 5, the main CPU 201 sends an image reading command to the scanner device 2 via the sub-CPU 221. The scanner device 2 optically scans the set document and converts it into scanned image data, and sends this scanned image data to the image processing processor 226 via the printer controller 227. The image processing processor 226 performs a DMA transfer to the memory 223 via the sub-CPU 221 to temporarily store this scanned image data.

[0024] When the main CPU 201 confirms that a certain amount or all of the scanned image data has been stored in memory 223, it issues an image output instruction to the printer device 4 via the sub-CPU 221. The sub-CPU 221 informs the image processing processor 226 of the storage area of ​​the scanned image data in memory 223. The scanned image data stored in memory 223 is transmitted to the printer device 4 via the image processing processor 226 and the printer controller 227 according to the synchronization signal output by the printer device 4. The printer device 4 prints the received scanned image data onto paper.

[0025] When printing multiple copies, the main CPU 201 saves the scanned image data stored in memory 223 to the storage device 6. By saving the scanned image data to the storage device 6 in this way, it becomes possible to send the scanned image data for the second and subsequent copies to the printer device 4 without having to retrieve it again from the scanner device 2.

[0026] Figure 3 is a block diagram schematically showing the configuration of the generation AI server 10 shown in Figure 1. In Figure 3, the generation AI server 10 comprises an AIGC front-end server 101, an AIGC back-end server 102, and a learning database 103.

[0027] The AIGC front-end server 101 requests the AIGC back-end server 102 to generate an image based on an image generation request received from an external device such as a computer 9 or an image processing device 1. The AIGC back-end server 102 generates AI image data by performing image generation processing using a trained model stored in the training database 103. The AIGC back-end server 102 also sends the generated AI image data via the front-end server 101 to the destination specified in the image generation request (such as the image processing device 1 or computer 9). For example, if the image data is sent to the image processing device 1, the image processing device 1 prints the received image data on paper as shown in Figure 4A. The image processing device 1 also transfers the received image data to other devices such as computer 9 or the smartphone 12 in Figure 4 as shown in Figure 4B. The training database 103 stores a trained model that has been trained to output a colored, realistic image from a line drawing.

[0028] Next, the UI configuration of the image processing device 1 will be described. Figure 5 shows an example of the UI screen 500 displayed on the operation unit 5 in Figure 1. The UI screen 500 displays several operation buttons corresponding to the functions available on the image processing device 1, such as the "Copy" button 501, the "Scan Send" button 502, the "Use AIGC" button 503, and the "Device Settings" button 504. Note that the configuration of the UI screen 500 is just an example, and the UI screen 500 may include operation buttons other than those listed above.

[0029] The "Copy" button 501 is an operation button for using the copying function of the image processing device 1. The "Scan and Send" button 502 is an operation button for using the image transmission function of the image processing device 1. The "Device Settings" button 504 is an operation button for making various settings of the image processing device 1. The "Use AIGC" button 503 is an operation button for using the AIGC system in this embodiment. When the user selects the "Use AIGC" button 503, an AIGC application (not shown) installed on the image processing device 1 is launched, and the settings screen 600 shown in Figure 6 is displayed on the operation unit 5. The settings screen 600 includes operation buttons 601 to 605.

[0030] Operation button 601 is a button for setting whether to use only images or both images and text as input to the AIGC system. For example, if "use only images as input to the AIGC system" is set, the image processing device 1 generates intermediate data based on the objects identified from the generated scan image data and sends this intermediate data to the generation AI server 10 along with the image generation request. The intermediate data is, for example, a prompt consisting of natural language strings that represent the characteristics of the rough drawing. The prompt includes, for example, a string indicating the type of object included in the scan image data ("person" or "cat," etc.), a string indicating the position of the object included in the scan image data ("center," etc.), and a string indicating the style of the AI ​​image data ("cartoon style," etc.). Note that the intermediate data is not limited to prompts, but may also be a command that the generation AI server 10 can interpret as an instruction to generate colored, realistic AI image data from this rough drawing, and which includes characteristic information of the objects included in the scan image data.

[0031] If the setting is to "use images and text as input to the AIGC system," the image processing device 1 generates intermediate data based on the object and text information identified from the generated scanned image data. The image processing device 1 also sends this intermediate data to the generating AI server 10 along with the image generation request. For example, if the scanned image data contains the string "manga style" next to an object, the image processing device 1 generates intermediate data that includes a natural language string representing the characteristics of this object and the string "manga style."

[0032] Operation button 602 is a button for setting object correction. When the user enables the object correction setting, the image processing device 1, if the rough drawing is ambiguous and the object's characteristic information cannot be narrowed down, will have the user select the object's characteristic information from several possible candidates.

[0033] Here, we will explain the case where the setting for operation button 601 is set to "Use only images as input for the AIGC system". In this case, as shown in Figure 7(a), when a rough sketch original 701 with a background and a person is set in the image processing device 1, the image processing device 1 performs object identification processing on the scanned image data of this original. The image processing device 1 can identify that the object in the scanned image data is a "human", but because the rough sketch is ambiguous, it cannot identify whether the object is a "male", "female", or "child". For this reason, the image processing device 1 displays a selection screen 702 on the operation unit 5, allowing the user to select characteristic information of the object from several possible candidates. The image processing device 1 generates intermediate data based on the characteristic information selected on the selection screen 702.

[0034] Similarly, if the setting for operation button 601 is set to "Use images and text as input for the AIGC system," the same selection screen will be displayed. For example, as shown in Figure 7(b), when a rough sketch manuscript 703 with the text "cartoon style" drawn next to a person is set in the image processing device 1, the image processing device 1 performs object identification processing on the scanned image data of this manuscript. The image processing device 1 can identify that the object in the scanned image data is a "human," but because the rough sketch is ambiguous, it cannot identify whether the object is a "male," "female," or "child." Therefore, the image processing device 1 displays a selection screen 704 on the operation unit 5, allowing the user to select characteristic information of the object from several possible candidates. The image processing device 1 generates intermediate data based on the characteristic information selected on the selection screen 704.

[0035] Operation button 603 is used to instruct the system to read the rough sketch and generate scanned image data of that sketch.

[0036] Operation button 604 is a button for configuring settings related to the output. In this embodiment, for example, it is possible to print the AI ​​image data generated by the generation AI server 10, or to transfer this AI image data to a computer 9 operated by the user. It is also possible to display this AI image data on the computer 9, or to set whether or not to reuse intermediate data such as prompts.

[0037] Operation button 605 is used to configure print settings. When "Print AI image data" is selected in the settings for operation button 604, the print settings used for this printing process are set. For example, it is possible to set it to output in poster format or booklet format.

[0038] Figure 8 is a flowchart showing the procedure for AI image data generation control processing performed by the image processing device 1 in Figure 1. AI image data generation control processing is achieved by the controller 3 executing a program stored in memory 203, memory 223, etc. AI image data generation control processing is performed when the user sets a rough sketch document and selects operation button 603.

[0039] In Figure 8, first, the controller 3 scans the set rough sketch document (S801). This generates scanned image data of the document. Next, the controller 3 performs object identification processing on the generated scanned image data. This identifies objects such as people contained in the scanned image data. Furthermore, if the setting for operation button 601 is set to "Use images and text as input for the AIGC system," text information contained in the scanned image data is also identified.

[0040] Next, controller 3 determines whether or not the object correction setting is enabled (S802).

[0041] If it is determined in S802 that the object correction setting is not enabled, this process proceeds to S804, which will be described later. If it is determined in S802 that the object correction setting is enabled, the controller 3 displays a selection screen on the operation unit 5 for the user to select characteristic information of the object based on the results of the identification process (S803). As an example, let's explain the case where a rough sketch manuscript 901 is set, as shown in Figure 9, in which a background and a person are drawn and the text "manga style" is written next to the person. In the object identification process of the scanned image data of manuscript 901, the controller 3 can identify that a background and a person are drawn, but because the rough sketch is ambiguous, it cannot identify whether the person is "male," "female," or "child." For this reason, the controller 3 displays a selection screen 902 on the operation unit 5 for the user to select characteristic information of the person from among several candidates. When the user selects one from among the multiple candidates on the selection screen 902, this process proceeds to S804.

[0042] In S804, controller 3 generates intermediate data to allow the generation AI server 10 to generate an AI image. For example, if the object correction setting is not enabled, controller 3 generates intermediate data based on the feature information of the object identified in the identification process. As mentioned above, the intermediate data is a prompt consisting of a natural language string representing the features of the identified object. On the other hand, if the object correction setting is enabled, controller 3 generates intermediate data 904 based on the feature information 903 selected on the selection screen 902.

[0043] Next, the controller 3 displays the generated intermediate data on the operation unit 5 and confirms with the user whether or not to generate an image using this intermediate data (S805).

[0044] In S805, if the controller 3 receives an instruction from the user to generate an image using this intermediate data, the controller 3 sends the intermediate data generated in S804 and the image generation request to the generation AI server 10 (S806). The generation AI server 10 uses the received intermediate data as input and performs image generation processing. This generates, for example, AI image data 905 that depicts a rough sketch drawn on the manuscript 901 in a realistic and cartoon-like style. The generation AI server 10 then sends the generated AI image data 905 to the destination specified in the image generation request, for example, the image processing device 1.

[0045] Next, the controller 3 receives the AI ​​image data 905 from the generation AI server 10 (S807). The controller 3 then prints the received AI image data 905 onto paper, for example, as shown in Figure 4A above, or transmits the received AI image data 905 to an external device such as a computer 9 or a smartphone 12, as shown in Figure 4B above. After that, this process ends.

[0046] In S805, if the user instructs that image generation should not be performed using this intermediate data, the controller 3 modifies the intermediate data according to the modification instructions received from the user (S808). Next, in S806, the controller 3 sends the modified intermediate data and the image generation request to the generation AI server 10. After that, the above-mentioned S807 is performed, and this process is completed.

[0047] According to the embodiment described above, the AI ​​generation server 10 is instructed to generate AI image data based on scanned image data obtained by scanning a document. This allows the instructions for image generation given to the AI ​​generation server 10 to include information about the composition and background obtained from the scanned image data, thereby enabling appropriate instructions for image generation to be given to the AI ​​generation server 10.

[0048] Furthermore, in the embodiment described above, the manuscript includes objects drawn by the user by hand. This allows the user to appropriately provide instructions regarding composition and background to the generation AI server 10 simply by preparing a manuscript with hand-drawn objects.

[0049] Furthermore, in the embodiment described above, intermediate data containing characteristic information of objects identified from scanned image data is generated, and this intermediate data is sent to the generation AI server 10. This allows the generation AI server 10 to receive characteristic information of objects identified from scanned image data.

[0050] Furthermore, in the embodiment described above, a selection screen is displayed on the operation unit 5 that allows the user to select information to be included in the intermediate data from among multiple candidates that represent the characteristic information of the identified object. This allows the user's intentions to be reflected in the information to be included in the intermediate data.

[0051] Furthermore, in the embodiment described above, the original document has a string of characters indicating the characteristics of the object drawn next to it, and the intermediate data further includes strings of characters identified from the scanned image data. This allows the user to combine the rough sketch and the characters to instruct the generation AI server 10 to generate an image.

[0052] Furthermore, in the embodiment described above, the user is allowed to edit the intermediate data. This allows the generation AI server 10 to receive instructions that better reflect the user's intentions.

[0053] Furthermore, in the embodiment described above, the received AI image data is printed. This makes it possible to obtain a printed copy of the AI ​​image data generated by the AI ​​generation server 10.

[0054] Furthermore, in the embodiment described above, the generation AI is provided by a generation AI server 10, which is an external device separate from the image processing device 1. This allows for appropriate instructions to be given to the generation AI server 10, which is an external device, for image generation.

[0055] In this embodiment, the image processing device 1 is not limited to a device equipped with a scanning function. For example, it may be a device such as a smartphone, tablet terminal, or PC equipped with a shooting function. The control unit of the device equipped with a shooting function, or an application installed on this device, performs a process to photograph the rough sketch original and generate captured image data of the original, and then performs the S802 to S808 processes described above using the generated captured image data. Even with a device equipped with a shooting function in this way, it is possible to appropriately instruct the generation AI server 10 to generate images.

[0056] Furthermore, in this embodiment, the image processing device 1 may be configured to include a generation AI. This allows the image processing device 1 equipped with a generation AI to appropriately issue instructions for image generation to the generation AI.

[0057] Furthermore, in this embodiment, the process of recognizing objects from scanned image data or captured image data may be performed using the AI ​​provided by the image processing device 1. Modern CPUs often have dedicated circuitry for object recognition, and by using this circuitry in conjunction with the AI, the processing load for object recognition can be minimized while the process can be performed with high accuracy.

[0058] Furthermore, in this embodiment, the image processing device 1 may cause the generation AI server 10 to generate AI image data corresponding to the print settings. For example, if a 2-in-1 setting is selected in the print settings, the image processing device 1 generates intermediate data that causes the generation AI server 10 to generate one AI image data by assigning the two image data. This allows the image processing device 1 to instruct the generation AI server 10 to generate AI image data corresponding to the print settings.

[0059] Furthermore, in this embodiment, if the generation AI server 10 is configured to generate AI image data using rough sketch image data as input, scanned image data or captured image data may be sent to the generation AI server 10 along with the image generation request, instead of intermediate data. This allows the image processing device 1 to appropriately instruct the generation AI server 10 to generate images without allocating its resources to generating intermediate data.

[0060] Examples of applications for the technology according to this embodiment include creating flowcharts and posters (for example, sketching a person with lines to show their posture in a rough drawing, and adding text such as "cartoon style" next to it to indicate the style). Other applications include creating slide templates, New Year's cards, letters, flyers, and personal fanzines.

[0061] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0062] Furthermore, the disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An image processing apparatus comprising: a reading means for reading a document; a means for causing a generating AI to generate second image data based on first image data obtained by reading the document by the reading means; and a means for receiving the second image data generated by the generating AI. (Configuration 2) An image processing apparatus comprising: a shooting means for photographing a document; a means for causing a generating AI to generate second image data based on first image data obtained by photographing the document with the shooting means; and a means for receiving the second image data generated by the generating AI. (Configuration 3) The image processing apparatus according to Configuration 1 or 2, characterized in that the original document includes an object drawn by hand by the user. (Configuration 4) The image processing apparatus according to Configuration 3, wherein the means for generating the image identifies the object from the first image data, generates intermediate data including characteristic information of the identified object, and transmits the intermediate data to the generating AI. (Configuration 5) The image processing apparatus according to Configuration 4, further comprising means for allowing the user to select feature information to be included in the intermediate data from among a plurality of candidates that constitute feature information of the identified object. (Configuration 6) The image processing apparatus according to Configuration 4 or 5, characterized in that the original document has a string of characters indicating the characteristics of the object drawn next to the object, and the intermediate data further includes a string of characters identified from the first image data. (Configuration 7) An image processing apparatus according to any one of Configurations 4 to 6, further comprising means for allowing a user to edit the intermediate data. (Configuration 8) The image processing apparatus according to any one of Configurations 1 to 3, characterized in that the means for generating the image transmits the first image data to the generating AI. (Configuration 9) An image processing apparatus according to any one of Configurations 1 to 8, further comprising means for printing the received second image data. (Configuration 10) The image processing apparatus according to Configuration 9, characterized in that the means for generating the image causes the generation AI to generate a second image data corresponding to the print settings set by the user. (Configuration 11) The image processing apparatus according to any one of Configurations 1 to 10, characterized in that the generating AI is provided by an external device different from the image processing apparatus. (Configuration 12) An image processing apparatus according to any one of Configurations 1 to 10, further comprising the generation AI. (Control method 13) A control method for an image processing apparatus, comprising: a reading step of reading a document; a step of causing a generating AI to generate second image data based on first image data obtained by reading the document in the reading step; and a step of receiving the second image data generated by the generating AI. (Control method 14) A control method for an image processing apparatus, characterized by comprising: a shooting step of photographing a document; a step of causing a generating AI to generate second image data based on first image data obtained by photographing the document in the shooting step; and a step of receiving the second image data generated by the generating AI. A program for causing a computer to execute the control method of the image processing apparatus described in control method 13 or 14. [Explanation of Symbols]

[0063] 1 Image Processing Device 2 Scanner device 3 Controllers 4. Printer device 5 Control section 10 AI Generator Servers 210 Network Interfaces 702 Selection screen 704 Selection screen 902 Selection screen 905 AI image data

Claims

1. A means of reading the manuscript, A means for causing a generating AI to generate second image data based on first image data obtained by reading the document with the reading means, An image processing apparatus characterized by comprising means for receiving a second image data generated by the aforementioned generation AI.

2. The means of photographing the manuscript, A means for causing a generating AI to generate second image data based on first image data obtained by photographing the document with the aforementioned photographing means, An image processing apparatus characterized by comprising means for receiving a second image data generated by the aforementioned generation AI.

3. The image processing apparatus according to claim 1 or 2, characterized in that the aforementioned manuscript includes an object drawn by hand by a user.

4. The image processing apparatus according to claim 3, wherein the means for generating the object identifies the object from the first image data, generates intermediate data including characteristic information of the identified object, and transmits the intermediate data to the generating AI.

5. The image processing apparatus according to claim 4, further comprising means for allowing the user to select feature information to be included in the intermediate data from among a plurality of candidates that constitute feature information of the identified object.

6. In the aforementioned manuscript, a string of characters indicating the characteristics of the object is drawn next to the object. The image processing apparatus according to claim 4, characterized in that the intermediate data further includes a string identified from the first image data.

7. The image processing apparatus according to claim 4, further comprising means for allowing the user to edit the aforementioned intermediate data.

8. The image processing apparatus according to claim 1 or 2, characterized in that the means for generating the image data transmits the first image data to the generating AI.

9. The image processing apparatus according to claim 1 or 2, further comprising means for printing the received second image data.

10. The image processing apparatus according to claim 9, characterized in that the means for generating the image causes the generating AI to generate a second image data corresponding to the print settings set by the user.

11. The image processing apparatus according to claim 1 or 2, characterized in that the generating AI is provided by an external device different from the image processing apparatus.

12. The image processing apparatus according to claim 1 or 2, further comprising the aforementioned generation AI.

13. The process of reading the document, A step of causing a generating AI to generate second image data based on the first image data obtained by reading the document in the reading step, A control method for an image processing apparatus, characterized by comprising the step of receiving a second image data generated by the aforementioned generation AI.

14. The process of photographing the manuscript, A step of causing a generating AI to generate second image data based on the first image data obtained by photographing the document in the aforementioned shooting step, A control method for an image processing apparatus, characterized by comprising the step of receiving a second image data generated by the aforementioned generation AI.

15. A program for causing a computer to execute the control method of the image processing apparatus according to claim 13 or 14.

Images