Program product, information processing device, and information processing method

Abstract

The invention provides a program product, an information processing apparatus, and an information processing method. The information processing apparatus provides and performs: accepting an input of a prompt by a user; and outputting image data of the image, the image data being generated by adding code information providing access to the input image data to the image generated by the generative AI by using the input hint and the input image data.

Description

Technical Field

[0001] This disclosure relates to program products, information processing devices, and information processing methods. Background Technology

[0002] Japanese Patent Application Publication No. 2023-034015 describes a scanning system in which a QR code (registered trademark) is added to a black-and-white image generated by performing a black-and-white scan of a color image, and a user can refer to the color image by reading the QR code.

[0003] In addition, services using generative artificial intelligence (generative AI) have developed rapidly in recent years, and a mechanism is being developed that allows users to access various services through natural language input.

[0004] When editing an image using generative AI, or when generating another image based on a specific image using generative AI, users may want to inspect the image before editing or the base image.

[0005] According to Japanese Patent Application Publication No. 2023-034015, adding a QR code to a black and white image has been considered when converting a color image to a black and white image, but in cases such as editing an image using generative AI, the addition of code information for checking the image before editing has not been considered. Summary of the Invention

[0006] This disclosure is made in view of the above-mentioned problems, and the purpose of this disclosure is to provide a technique that enables reference to an original image of an image generated by generative AI based on an image generated by generative AI.

[0007] The program enables the information processing device to provide and execute: accepting user input to prompts and outputting image data, which is generated by adding code information that provides access to the input image data to an image generated by generative AI using the input prompts and the input image data.

[0008] The features of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of the embodiments is by way of example. Attached Figure Description

[0009] Figure 1 An example of the system disclosed herein is shown.

[0010] Figure 2 Examples of hardware configurations of the computer, smartphone, generative AI server, and ID management server disclosed herein are shown.

[0011] Figure 3 An example of the hardware construction of the MFP of this disclosure is shown.

[0012] Figure 4 Examples of software architectures for computers, smartphones, generative AI servers, and ID management servers disclosed herein are shown.

[0013] Figure 5A Examples of screens displayed by a document processing application and screens displayed on a smartphone are shown.

[0014] Figure 5B Examples of screens displayed by a document processing application and screens displayed on a smartphone are shown.

[0015] Figure 6 This shows an example of an instruction sent by a computer to generative AI.

[0016] Figure 7A This shows an example of the content before editing.

[0017] Figure 7B An example of the edited content is shown.

[0018] Figure 8 This shows an example of information managed by an ID management server.

[0019] Figure 9A This is a timing diagram illustrating an example of the processing of the system of this disclosure.

[0020] Figure 9B This is a timing diagram illustrating an example of the processing of the system of this disclosure.

[0021] Figure 10 This is a flowchart illustrating an example of generative AI processing.

[0022] Figure 11 An example of the software architecture of MFP is shown.

[0023] Figure 12 An example of a LUI displayed on a display unit of an MFP is shown.

[0024] Figure 13A This is a timing diagram illustrating an example of the processing of the system of this disclosure.

[0025] Figure 13B This is a timing diagram illustrating an example of the processing of the system of this disclosure. Detailed Implementation

[0026] In the following, embodiments will be described in detail with reference to the accompanying drawings. Note that the embodiments do not limit the scope of this disclosure according to the claims. Several features are described in the embodiments, but not all of these features are essential to this disclosure, and the features may be selectively combined. (The QR codes in the embodiments and drawings are schematic diagrams of QR codes.)

[0027] First Embodiment

[0028] System Construction

[0029] The first embodiment of this disclosure will be described below. First, reference will be made to... Figure 1 Describes the network configuration of the printing system according to this disclosure.

[0030] like Figure 1 As shown, the printing system 10 includes a computer 100, a smartphone 200, a multifunction peripheral (MFP) 300, a generative AI server 400, and an ID management server 500, which serve as terminal devices, information processing devices, etc. For example, the computer 100, smartphone 200, and MFP 300 are located in an office and are communicatively connected to each other via an internal network 600. The internal network 600 is connected to the external Internet 700 via a router (not shown). In this document, the computer 100 is an example of a terminal device or information processing device, while the generative AI server 400 and ID management server 500 are examples of information processing devices.

[0031] Generative AI server 400 is communicatively connected to computer 100, smartphone 200, MFP 300, and ID management server 500 via Internet 700 and internal network 600. Generative AI server 400 is a server managed by an operator providing generative AI services. ID management server 500 is communicatively connected to computer 100 and generative AI server 400 via Internet 700 and internal network 600. ID management server 500 is a server managed by an operator providing printing services. Note that computer 100, smartphone 200, generative AI server 400, and ID management server 500 can be separate or integrated, residing on the same hardware. Furthermore, internal network 600 can be based on a wired connection or a wireless connection.

[0032] Hardware Construction

[0033] Reference Figure 2 and Figure 3 The hardware structure of each device in the printing system 10 is described. Figure 2 The hardware structure of computer 100, smartphone 200, generative AI server 400 and ID management server 500 is shown. Figure 3The hardware structure of the MFP 300 is shown.

[0034] like Figure 2 As shown, computer 100 includes a display unit 101, an operation unit 102, a storage unit 103, a control unit 104, and a network communication unit 105, and these components are communicatively connected to each other. There are no particular limitations on computer 100, and for example, desktop or laptop personal computers, tablet computers, smartphones, etc., can be used as computer 100. Control unit 104 is configured to include a central processing unit (CPU) 141 and a memory 142 and controls the entire computer 100.

[0035] The display unit 101 is, for example, a display such as a liquid crystal display panel, and is capable of displaying images. The operation unit 102 is, for example, a mouse, a keyboard, etc., and is capable of accepting input operations performed by the user. The storage unit 103 is, for example, a storage medium such as a hard disk drive or a solid-state drive (SSD), and stores various programs (software) used by the computer 100 for operation. The programs are loaded into the memory 142 when needed and executed by the CPU 141. The programs include programs for the CPU 141 to execute the various units and functions of the printing system 10. Note that the programs are not limited to those stored in the computer 100. The programs may be stored, for example, in the generative AI server 400 or the ID management server 500, or they may be distributed and stored in the computer 100, the generative AI server 400, and the ID management server 500. The network communication unit 105 is a network interface (I / F) and transmits and receives data with external devices via an external network.

[0036] Since the hardware structure of the smartphone 200 is almost identical to that of the computer 100, the description of the hardware structure of the smartphone 200 will be omitted in this embodiment.

[0037] The generative AI server 400 includes a display unit 401, an operation unit 402, a storage unit 403, a control unit 404, and a network communication unit 405, and these components are communicatively connected to each other. The control unit 404 is configured to include a CPU 441, a memory 442, and a graphics processing unit (GPU) 443 and controls the entire generative AI server 400.

[0038] In this way, since the hardware structure of the generative AI server 400 is almost identical to that of the computer 100, its detailed description will be omitted.

[0039] ID management server 500 includes display unit 501, operation unit 502, storage unit 503, control unit 504 and network communication unit 505, and these components are communicatively connected to each other.

[0040] The control unit 504 includes a CPU 541, a memory 542, and a GPU 543. Since the hardware architecture of the ID management server 500 is almost identical to that of the generative AI server 400, its detailed description will be omitted.

[0041] like Figure 3 As shown, the MFP 300, used as a printing device, scanning device, image forming device, or image processing device, includes a display unit 301, an operation unit 302, a storage unit 303, a control unit 304, a network communication unit 305, a scanning unit 306, and a printing unit 307. These components are communicatively connected to each other. The control unit 304 is configured to include a CPU 341 and a memory 342 and controls the entire MFP 300. The scanning unit 306 reads an image of the original document to generate image data. The generated image data can be transmitted to an external device via the network communication unit 305. Additionally, the printing unit 307 can print an image on a sheet based on the generated image data. The network communication unit 305 is a network I / F and transmits and receives information such as image data via wired or wireless communication. The printing unit 307 can print an image based on image data received from an external device by the network communication unit 305.

[0042] Software Construction

[0043] Reference Figure 4 The software architecture of the various devices included in the printing system 10 is described.

[0044] Computer 100 includes application 1100, generative AI client 1200, and operating system (OS) 1400. For example, application 1100 includes any software such as security software, spreadsheet software, or browser software, and... Figure 4 The examples include document processing application 1110. Document processing application 1110 is an application for editing and displaying content such as text (sentences), photos, or chart data. There are no particular limitations on document processing application 1110, and examples of document processing application 1110 include, for example, spreadsheet software, browser software, and presentation software.

[0045] Generative AI client 1200 refers to client software to be executed by computer 100. Generative AI client 1200 accepts user input of instructions (prompts) and generates... Figure 5AThe instruction sentence shown is used to send the instruction sentence to the generative AI server 400. In this document, the instruction sentence for sending is obtained by adding additional instructions to an instruction sentence already input from the user. Note that the combination of the generative AI server 400 and the generative AI client 1200 can be referred to as a generative AI system. Furthermore, in this specification, the content generation process implemented by the generative AI system can be referred to as a transformation process.

[0046] OS1400 is the software that performs basic operations on computer 100. OS1400 includes GDI 1410, printer driver 1420, and background printing program 1430. Printer driver 1420 is provided by the operator providing OS1400 or MFP 300. Either application 1100 or printer driver 1420 is managed by OS1400 and can be used when installed on OS1400. Alternatively, printer driver 1420 may be pre-integrated into OS1400.

[0047] The GDI 1410 is an internal component of the OS1400, providing an interface related to rendering (such as printing). The printer driver 1420 displays the user interface (UI) for printing settings in the MFP 300. Additionally, during printing, the printer driver 1420 generates rendering data (Page Description Language: PDL) that can be accepted by the MFP 300. The background printing program 1430 processes the sending of the PDL generated by the printer driver 1420 to the MFP 300.

[0048] Note that the construction using Microsoft Windows (registered trademark) as the operating system (OS) has been described here, but other OSes can be used as OS1400. Furthermore, the print data received by the printer driver 1420 from the printing application can be not only in GDI format but also in XML file specification format (XPS format).

[0049] Note that the generative AI client 1200, printer drivers 1420 and 1410, and spooler 1430 can be installed as a single program in OS1400.

[0050] For example, a single program can accept user input for prompts; the input prompts and input image data can be sent to a generative AI server 400, or they can be displayed. Figure 5A The screen size is 6000. Additionally, it can be executed by a single application. Figure 9A and Figure 9B The entire process of computer 100 in the sequence.

[0051] The smartphone 200 has application 2100 and OS 2400. Note that the software architecture of OS 2400 is almost identical to that of OS 1400, therefore a description of the software architecture of OS 2400 will be omitted in this document. Application 2100 includes arbitrary software, and... Figure 4 Examples include a document processing application 2110 and a QR code reading application 2120. Similarly, like in document processing application 1110, document processing application 2110 is an application for editing and displaying content such as text (sentences), photos, or chart data. Additionally, QR code reading application 2120 is an application that can read code information such as QR codes installed by the user using a camera installed in smart camera 200. Note that QR code reading application 2120 can read not only QR codes but also one-dimensional codes such as barcodes.

[0052] The generative AI server 400 includes an application 4100, an OS 4120, and a large language model (LLM) 4130. Note that the software architecture of OS 4120 is almost identical to that of OS 1400; therefore, a description of the software architecture of OS 4120 will be omitted in this document. The application 4100 includes arbitrary software, and... Figure 4 Examples include generative AI application 4110. Generative AI application 4110 is an application with generative AI interpretation processing capabilities. Generative AI application 4110 sends instructions from the user, already sent from generative AI client 1200, to LLM 4130, and sends responses received from LLM 4130 back to generative AI client 1200. LLM 4130 is a language model (learned model) that has been learned from data such as large amounts of text data. LLM 4130 interprets the instructions sent from generative AI application 4110 and replies with interpretation results to generative AI application 4110. Examples of LLM 4130 include GPT-4, GPT-4o, BERT, Transformer models, etc.

[0053] ID management server 500 has application 5100, OS 5120, and ID management database 5130. Note that the software architecture of OS 5120 is almost identical to that of OS 1400, and therefore a description of the software architecture of OS 5120 will be omitted in this document. Application 5100 includes arbitrary software, and... Figure 4The example includes an ID management application 5110. The ID management application 5110 generates IDs upon receiving an ID generation request from any application, including a generative AI application 4110. In this document, an ID refers to a non-repeating, unique ID consisting of one or more data values. IDs generated by the ID management application 5110 are either stored in an ID management database 5130 or returned to the application. The ID management database 5130 stores and... Figure 8 The data shown is related to the ID.

[0054] Figure 5A and Figure 5B Examples are shown of screen 6000 displayed on display unit 101 by document processing application 1110 of computer 100 and screen 6100 displayed on smartphone 200. Document processing application 1110 displays screen 6000, which includes a generative AI client UI 1250 that performs UI display in generative AI client 1200. Furthermore, document processing application 1110 displays screen 6000, which includes a preview display unit (image data display unit) 6005 and a print button 6006, in which a preview display of the image to be printed is shown. Generative AI client UI 1250 includes a chat unit 6002, which displays messages to be sent and received by the user between generative AI client 1200 and generative AI server 400. The generative AI client UI 1250 also includes a prompt input section 6003 (area display section) and an execution button 6004. A prompt is entered in the prompt input section 6003, and the execution button 6004 is used to send the entered prompt to the generative AI server 400 or to obtain a prompt by editing the entered prompt. The prompt (string) entered by the user is displayed in the chat section 6002. Furthermore, the prompt is determined by the LLM 4130 of the generative AI server 400, and a message as a response output is also displayed. Since the user enters a prompt in the prompt input section 6003 and clicks the execution button 6004, the document processing application 1110 sends an instruction sentence to the generative AI server 400. The document processing application 1110 receives a conversion command output as a response to the prompt from the generative AI server 400, converts the document based on the conversion command, and displays the edited document in the preview display section 6005. As an example of conversion processing, in the case of sending the instruction sentence "Summarize the content in one page or less," the document processing application 1110 will... Figure 7AContent 5001 is converted into content 5101 to be displayed. Then, when the user confirms the edited document is appropriate and presses the print button 6006, a print instruction, including the image data generated through the conversion and settings for printing the image data, is sent to the MFP 300. Subsequently, an image based on the image data generated through editing is printed. In this way, on the same screen, a prompt input section 6003 serves as an area for user input prompts, and a preview display section 6005 displays the image with a QR code already added.

[0055] Note that an example of document processing application 1110 converting a document (input image data) based on a conversion command received from generative AI server 400 has been described, but the example is not limited to this. For example, document processing application 1110 can convert image data based on prompts and image data already received by generative AI server 400 by sending prompts and unedited image data (input image data) to generative AI server 400. Subsequently, the converted image data can be sent to document processing application 1110. In the above case, document processing application 1110 displays the edited image data received from generative AI server 400 in preview display unit 6005.

[0056] Note that, as described above, the generative AI client UI 1250, the preview display unit 6005 for previewing the image to be printed, and the print button 6006 can be displayed by a single application installed on the computer 100. In other words, the processing of the document processing application 1110 described above and the processing of the generative AI client UI 1250 can be performed by a single application. For example, input from user prompts, selection of the execute button 6004, and selection of the print button 6006 can be received by a single application. Furthermore, the following processing can be performed: sending image data of prompts and inputs to the generative AI server 400 and receiving image data generated by the transformation performed by the generative AI server 400, so as to display the image data in the preview display unit 6005.

[0057] An example of the UI displayed on a document processing application 2110 on a smartphone 200 is shown. The document processing application 2110 has an image reading unit 6102, a summary pre-content display unit 6103, a difference display unit 6104, and a prompt display unit 6105, which are features of a QR code reading application 2120.

[0058] The image reading unit 6102 displays a video captured by a camera installed in the smartphone 200, and the user captures a QR code in the video to read the QR code. In this document, the QR code includes some or all of data such as ID 901 and Uniform Resource Locator (URL) 902, and may also include other data, which will be discussed below. Figure 8 The description of ID 901 and Uniform Resource Locator (URL) 902 indicates that they will be stored in storage unit 503 of ID management server 500. Then, smartphone 200 sends the ID, including the QR code, to ID management server 500, and displays the content received from ID management server 500 in summary pre-content display unit 6103. In the case of QR code indicating URL (information indicating the storage location of image data), smartphone 200 accesses the server indicated by the URL. Information received from the server is displayed in summary pre-content display unit 6103. Summary pre-content display unit 6103 displays image data with the QR code read by the camera added, as well as image data received from ID management server 500 or the server indicated by the URL, which is image data before editing, summarizing, etc., by generative AI. In other words, ID management server 500 or the server indicated by the URL stores image data before editing, summarizing, etc., by generative AI. In other words, the code information, such as that added to the image data, includes information indicating the storage location of the image data as input to the computer 100, before it was edited by the generative AI.

[0059] In the difference display unit 6104, the differences between the content before and after the summary are displayed as the differences. In other words, the differences between the image data before and after editing by the generative AI are displayed in text form. Using this configuration, through the editing of image data by generative AI, users can easily check what information has been lost, added, or changed.

[0060] In the prompt display unit 6105, when the document processing application 1110 performs the process of generating the summary content based on the previous content, a prompt entered by the user is displayed. In other words, a prompt for the generative AI to generate and edit the image data is displayed in text form. In other words, on the display unit of the terminal device that has already read code information such as a QR code, the image data input to the computer 100 and the prompt entered by the user are displayed on the same screen. With this configuration, the user can easily check how the image data (original document) generated by the generative AI was generated.

[0061] The prompt can be stored in the storage unit of any of the following: computer 100, smartphone 200, printer 300, generative AI server 400, and ID management server 500.

[0062] For example, the prompt can be stored in an ID management server 500 associated with an ID indicated by a QR code, and the smartphone 200 can receive the prompt from the ID management server 500. Alternatively, the prompt can be stored together with the image data before editing (image data input to the computer 100) in a server at a storage location indicated by a URL indicated by the QR code, and the smartphone 200 can receive the prompt from the server at the storage location.

[0063] Furthermore, since the QR code has been read, it can also be displayed in the document processing application 2110. Figure 5B The screen 6100 displays version information of the generative AI that has generated and edited the image data. Similar to the prompt, this version information can be stored in the ID management server 500 or in a server at the storage location indicated by the URL specified by the QR code.

[0064] Note that in Figure 5B Some or all of the version information displayed on screen 6100 can be contained in codes such as QR codes. In other words, not only URLs or IDs, but also version information, prompts, etc., of generative AI can be directly contained in the information indicated by the QR code.

[0065] Figure 6 An example of a prompt sent from computer 100 to generative AI server 400 is shown. The prompt consists, for example, of prompt 801 and additional content 802.

[0066] Prompt 801 includes a prompt input by the user to the prompt input unit 6003 of application 1110. Additionally, if the user wishes to use an object containing content stored in storage unit 103 of computer 100 as input to the LLM of generative AI server 400, the instruction includes the filename and path of the additional content 802.

[0067] Figure 7A and Figure 7BExamples of content before and after editing are shown. This document describes the content before and after editing of a prompt based on user input, performed by generative AI. Assume the input prompt "Summarize the content in one page or less" is entered into the prompt input unit 6003 by the user. Content 5001 is content related to the curry recipe before editing and is image data including text 5002, illustration 5003, etc. Content 5101 is the content obtained when the generative AI summarizes content 5001, including text 5102 obtained by summarizing (abbreviating) it as a sentence included in the image, and illustration 5003 is removed. Using this structure, the curry recipe is presented on a single page. In other words, the image generated by the generative AI is an image containing sentences generated by summarizing sentences in the image data input to the computer 100 (the image before editing). Alternatively, the image generated by the generative AI can be an image generated by removing sentences and photos (illustrations) from the image data input to the computer 100 (the image before editing).

[0068] In addition to text 5102, content 5101 also includes QR code 5103.

[0069] As described above, QR code 5103 is information used to access image data (image data input to computer 100) before it is edited by generative AI. In other words, image data is generated based on prompts input by the user and image data input to computer 100. Subsequently, the image data of the image generated (obtained) by adding code information for accessing the image data input to computer 100 to the image data is output to the display unit 101 of computer 100.

[0070] While displaying an image with added code information, the user can input a prompt indicating the insertion position of the specified QR code in the prompt input section 6003.

[0071] In the above scenario, computer 100 sends an input prompt to generative AI server 400, causing generative AI server 400 to generate image data with the QR code added to the user-specified location. Note that when computer 100 adds the QR code, while the image with the added code information is displayed, the user selects a button (not shown in the image) and is given the option to specify the QR code's location. Subsequently, computer 100 inserts the QR code into the position corresponding to the selected button (bottom right, top right, bottom left, top left, etc.).

[0072] The generative AI server 400 can generate image data with added code information such as QR codes. When the generative AI server 400 generates this image data, it stores the image data input to the computer 100 in a predetermined storage location and generates a QR code as information indicating the storage location. Subsequently, the generative AI server 400 adds the generated QR code to the image data that has been edited based on the image data input to the computer 100. The generative AI server 400 sends the image data with the added QR code to the computer 100. Using this configuration, the image data with the added QR code (content 5101) is displayed in the preview display unit 6005 of the display unit 101 of the computer 100.

[0073] Computer 100 can generate image data with added code information such as a QR code. In the above case, computer 100 stores the image data input to computer 100 in a predetermined storage location and generates a QR code as information indicating the storage location. Subsequently, generative AI server 400 sends the input image data to computer 100. Subsequently, computer 100 receives image data generated by editing performed by generative AI server 400. Computer 100 generates image data by adding a QR code to the image of the received image data. Using this configuration, the image data with added QR code (content 5101) is displayed in the preview display unit 6005 of display unit 101 of computer 100. Subsequently, computer 100 sends print data of the image data with added code information to MFP 300. The print data sent herein includes print settings accepted by computer 100. MFP 300 prints the image with added code information on a sheet based on the print settings included in the received print data. This process corresponds to the processes in S1724 to S1726, which will be described below. Through these processes, image data of an image generated by the generative AI using input prompts and input image data can be output, with added code information for accessing the input image data.

[0074] The MFP 300 can generate image data with added code information such as QR codes. In the above case, the computer 100 stores the image data input to the computer 100 in a predetermined storage location and sends information indicating the storage location to the MFP 300. Furthermore, the generative AI server 400 sends print data to the MFP 300, which includes image data obtained by editing the image data input to the computer 100 and subsequently sent to the computer 100. Using this configuration, the MFP 300 receives the edited image data and the code information indicating the storage location of the original image data. The MFP 300 then uses this information to generate image data with added QR codes (content 5101) and prints the generated image data.

[0075] exist Figure 8 The document describes a list of IDs stored in the ID management database 5130 of the ID management server 500. The ID list includes information associated with content such as ID 901, URL 902, content name 903, and page number 904. This information is used as search keywords when searching for content prior to editing by the ID management server 500 using a QR code read from a smartphone 200, or as related information to be provided to the user.

[0076] In column ID 901, the identifiers “X3G9-4PQ7” and “N7B6-Z1K8” are described. In column URL 902, the URLs “https: / / www.example.com / AAA.docx” and “https: / / www.example.com / BBB.pdf”, which serve as links to access the various data, are included. In column Content Name 903, the document file names “AAA.docx” and “BBB.pdf” are described. In column Page Number 904, the page numbers “5 pages” and “2 pages” for each content item are described. When the ID management server 500 receives a QR code generation instruction from the generative AI server 400, it adds a row to the ID list and stores a series of information related to the content 5001 before editing. That is, the ID included in the generated QR code is stored in column ID 901, and the URL, content name, and page number of the content 5001 before editing are stored in URL 902, content name 903, and page number 904, respectively.

[0077] When a user reads a QR code via smartphone 200 and ID management server 500 receives an instruction to send the unedited content from smartphone 200, a search for the unedited content is performed based on the ID corresponding to the QR code read by smartphone 200. Subsequently, if relevant content is found, that content is returned to smartphone 200. Figure 9A and Figure 9B The details are described in the instructions.

[0078] Note that this description has already illustrated an example of values ​​such as ID 901, URL 902, content name 903, and page number 904 being stored in an ID list maintained by the ID management server 500. However, the values ​​stored in the ID list are not limited to those mentioned above. For example, values ​​such as content size, content creator name, and organization information can be stored in the ID list.

[0079] Note that this description has described an embodiment of searching for relevant content from an ID list using ID 901, but the method of searching for such content is not limited to this. For example, if the ID management server 500 stores data about previously searched content (referred to as previous search data) in storage unit 403 and learns patterns from the previous search data, the following configuration can be adopted. For example, the ID management server 500 can search for content by using such a recommendation function.

[0080] Furthermore, while this description already outlines an example of searching related content by verifying only a single ID, searching related content can also be achieved using non-unique IDs or multiple IDs. Alternatively, the URL of the server storing the content before editing can be embedded in a QR code, and the content before editing can be searched based on the URL of the QR code read by the ID management server 500.

[0081] Reference Figure 9A and Figure 9B The processing procedure of the printing system 10 according to this embodiment is described below. The processing described below corresponds to a series of processes starting from S701 in the timing diagram shown.

[0082] In S701, the user inputs an instruction (prompt) into the generative AI client 1200: "Transform the content in one page or less."

[0083] In S702, the CPU 141 of computer 100 executes generative AI client 1200, receives prompts from user and creates instructions to be sent to generative AI server 400.

[0084] In S703, the CPU 141 of computer 100 executes generative AI client 1200 and sends the created instruction to generative AI application 4110 of generative AI server 400.

[0085] In S704, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and requests the LLM 4130 to interpret the instruction statement.

[0086] In S705, the control unit 404 of the generative AI server 400 controls the LLM 4130 to interpret the instruction and generate interpretation results. These interpretation results include content transformation requests.

[0087] In S706, the control unit 404 of the generative AI server 400 controls the LLM 4130 to reply with explanation results to the generative AI application 4110.

[0088] In S707, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and replies with the explanation results to the generative AI client 1200.

[0089] In S708, the CPU 141 of computer 100 executes generative AI client 1200 and replies with explanation results to document processing application 1110.

[0090] In S709, the CPU 141 of the computer 100 executes the document processing application 1110 and edits the content 5001 before editing to the content 5101 after editing based on the interpretation results. Note that the generative AI application 4110 of the generative AI server 400 can perform this editing process. In the above case, the computer 100 receives and displays the edited content 5101 that has been generated by the generative AI application 4110.

[0091] In S710, the CPU 141 of computer 100 executes document processing application 1110 and sends the content 5001 before editing to generative AI client 1200.

[0092] In S711, the CPU 141 of computer 100 executes generative AI client 1200 and sends the unedited content 5001 to generative AI application 4110.

[0093] In S712, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and sends the content 5001 before editing to the ID management application 5110.

[0094] In S713, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and sends a request to generate a QR code 5103 to the ID management application 5110.

[0095] In the S714, the CPU 541 of the ID management server 500 executes the ID management application 5110 and generates a QR code 5103 that includes the ID data.

[0096] Note that, as mentioned above, the QR code can be generated by computer 100, generative AI server 400, or MFP 300. Furthermore, the information indicated by the QR code may not be an ID, but rather a URL indicating the storage location of the image data. In these cases, the process differs from the following, and information needs to be exchanged between the aforementioned devices.

[0097] In S715, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and saves the content 5001 before editing and the ID list in the ID management database 5130.

[0098] In the S716, the CPU 541 of the ID management server 500 executes the ID management application 5110 and sends the generated QR code 5103 to the generative AI application 4110.

[0099] In S717, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and adds the QR code 5103 to the edited content 5101.

[0100] In S718, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and returns the edited content 5101 to the generative AI client 1200.

[0101] In S719, the CPU 141 of computer 100 executes generative AI client 1200 and returns the edited content 5101 to document processing application 1110.

[0102] In the S720, the CPU 141 of the computer 100 executes the document processing application 1110 and displays the edited content 5101 on the preview display unit 6005.

[0103] In S721, the user presses the print button 6006 of the document processing application 1110.

[0104] In S722, the CPU 141 of computer 100 executes document processing application 1110 and sends print data to background printing program 1430. The print data sent here is as described above.

[0105] In S723, the CPU 141 of computer 100 controls the background printing program 1430 to send printing data to the printer driver 1420.

[0106] In the S724, the CPU 141 of the computer 100 controls the printer driver 1420 to generate print jobs.

[0107] In the S725, the CPU 141 of the computer 100 controls the printer driver 1420 to send print jobs to the MFP 300.

[0108] In the S726, the MFP 300 prints images on a sheet based on the received print job.

[0109] In S727, the user reads the QR code 5103 of the content read by the application 2120 via the QR code of the smartphone 200.

[0110] In S728, the CPU 241 of the smartphone 200 executes the document processing application 2110 and sends a request to the ID management application 5110 to retrieve the content 5001 before editing. The retrieval request includes the ID 901 of the read QR code.

[0111] In S729, the CPU 241 of the smartphone 200 executes the document processing application 2110. Additionally, the CPU 541 of the ID management server 500 executes the ID management application 5110 and sends a request to the ID management database 5130 to retrieve the content 5001 before editing.

[0112] In S730, the CPU 541 of ID management server 500 controls ID management database 5130 to determine the pre-edited content 5001 to be sent based on ID 901 obtained from document processing application 2110.

[0113] In S731, the CPU 541 of the ID management server 500 controls the ID management database 5130 to send the content 5001 before editing to the ID management application 5110.

[0114] In the S732, the CPU 541 of the ID management server 500 controls the ID management application 5110 to send the pre-edited content 5001 to the document processing application 2110.

[0115] In the S733, the CPU 241 of the smartphone 200 executes the document processing application 2110 and displays the previously obtained content 5001 on the display unit 6103.

[0116] When the above processing is implemented, users can easily refer to the original content based on the edited content.

[0117] Figure 10 This is a flowchart illustrating an example of processing performed by the generative AI server 400. For example, the processing described below is implemented when the CPU 441 of the generative AI server 400 reads a program stored in storage unit 403 into memory 442 for execution.

[0118] In S101, this process begins when the generative AI server 400 receives an instruction (hint 801) from the generative AI client 1200. The instruction is, for example, the object "Transform the content with one page or less".

[0119] In S102, the generative AI application 4110 of the generative AI server 400 adds appropriate information to the instruction sentence. For example, information such as content-related information, device model information, or organizational information is added through a mechanism called retrieval-augmented generation (RAG) or system prompts. Using this construction, it is expected to increase the accuracy of the interpretation in LLM 4130.

[0120] In S103, the generative AI application 4110 sends an instruction to the LLM 4130.

[0121] In S104, the LLM 4130 implements the interpretation processing of the instruction sentence. In this paper, the interpretation processing implemented by the LLM 4130 includes one or more of the following: text preprocessing, text tokenization and vectorization, text understanding, text generation and prediction, and response sentence generation.

[0122] In S105, LLM 4130 sends the response sentence generated in S104 to generative AI application 4110.

[0123] In S106, the generative AI application 4110 determines whether the received interpretation result is an object related to content editing. When it is determined that the received interpretation result is an object related to content editing, the generative AI application 4110 generates a content transformation instruction in S107 and sends a response sentence and the content editing instruction to the generative AI client 1200 in S108. Then, the processing ends in S110. If, in S106, it is determined that the response sentence is not an object related to content transformation, the generative AI application 4110 does not generate a content transformation instruction, but instead sends only a response sentence to the generative AI client 1200 in S109 and ends the processing in S110.

[0124] When the above processing is performed, the generative AI server 400 can modify the response to be sent to the generative AI client 1200 based on whether the prompts input by the user include editing instructions for the content. As a result, the generative AI client 1200 can provide the document processing application 1110 with units configured to determine whether to summarize the content.

[0125] As described above, the printing system according to this embodiment includes a computer 100, a smartphone 200, a generative AI server 400 that provides generative AI services, an ID management server 500 that provides ID management services, and an MFP 300.

[0126] In one example, when the generative AI server 400 performs content editing based on prompts input by the user, it requests the ID management server 500 to generate and save a QR code. Subsequently, the content with the generated QR code attached is returned to the document processing application 1110, and the summarized content is printed based on the user's print instruction. Afterward, because the user reads the QR code of the summarized content via smartphone 200, a search is performed on the content before editing by the ID management server 500, allowing the user to easily refer to the content before editing.

[0127] Second Embodiment

[0128] According to the second embodiment, an embodiment will be described in the following case: the MFP 300 has a generative AI client 1200, and the user transforms the image scanned by the MFP 300 by using the generative AI system.

[0129] like Figure 11 As shown, the MFP 300 includes an application 3100, a generative AI client 3200, a controller 3300, and an OS 3400. The application 3100 includes arbitrary software, and... Figure 11The examples include a scanning application 3110 that controls the scanning process and a preview display application 3120 that controls the preview display.

[0130] The generative AI client 3200 is an application that controls the operation of the scanning unit 306. The generative AI client 3200 refers to the client software executed by the MFP 300. The generative AI client 3200 receives instructions (prompts) from the user and generates, for example... Figure 5A The instruction sent to the generative AI server 400 is shown in the example.

[0131] Controller 3300 refers to a controller configured to perform functions such as sending and receiving data from scanning unit 306 or any computer, network management, etc.

[0132] OS 3400 is the OS for managing tasks, memory, files, and peripheral devices in the MFP 300.

[0133] Figure 12 This is an example of a local user interface (LUI) 1401 displayed on display unit 301 of an MFP 300.

[0134] LUI 1401 has a scan button 1402, a preview display 1403, a generative AI client 1404, and a print button 1406.

[0135] The scan button 1402 is a button that, when selected, enables the scanning unit 306 to perform scanning of the original document. The user sets the sheet to be scanned on the document positioning plate of the MFP300 and presses the scan button 1402, causing the scanning process to be performed in the scanning unit 306. Note that the scanning unit 306 can also read original documents placed on a glass plate and can also scan original documents being transported by an automatic document feeder (ADF) while they are being transported on the document positioning plate.

[0136] The print button 1406 is a button used to print an image on a sheet when selected by the user. The image to be printed herein is an image of image data input to the MFP 300 by various methods. For example, the image data may be image data included in a print job received from the computer 100, or it may be image data obtained from a USB memory. Alternatively, the image data may be image data generated by scanning the original document by the scanning unit 306, or image data stored in the storage unit 303. The user sets the sheet to be printed in the MFP 300 and presses the print button 1406, causing the printing process to be executed in the printing unit 307.

[0137] The preview display unit 1403 can display any content, such as image data generated by scanning the original document by the scanning unit 306 or content after image data has been processed by generative AI. Figure 12 The example shows an image of image data processed by generative AI, along with a QR code 1405 indicating information corresponding to the image data before generative AI processing.

[0138] Since the generative AI client UI 1404 has a similar construction to the generative AI client UI 1250, its description will be omitted.

[0139] When the user presses the scan button 1402 and inputs the prompt in the generative AI client UI 1404, a new data structure is obtained that can generate new data based on the image data generated by the scan.

[0140] Reference Figure 13A and Figure 13B The processing procedure of the printing system 10 according to this embodiment is described.

[0141] In S1701, the user inputs the instruction (prompt) "Scan the content and extract only the text" into the generative AI client 3200 of the MFP 300. Note that the user inputs the above prompt while the original document is placed on the document positioning plate of the scanning unit 306.

[0142] In S1702, the CPU 341 of the MFP 300 executes the generative AI client 3200, receives prompts from the user, and creates instructions to be sent to the generative AI server 400.

[0143] In S1703, the CPU 341 of the MFP 300 executes the generative AI client 3200 and sends the creation instruction to the generative AI application 4110 of the generative AI server 400.

[0144] In S1704, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and requests the LLM 4130 to interpret the instruction statement.

[0145] In S1705, the control unit 404 of the generative AI server 400 controls the LLM 4130 to interpret the instruction and generate the interpretation result. The interpretation result includes a content transformation request.

[0146] In S1706, the control unit 404 of the generative AI server 400 controls the LLM 4130 to reply with the interpretation results to the generative AI application 4110.

[0147] In S1707, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and replies with the explanation results to the generative AI client 3200.

[0148] In S1708, the CPU 341 of the MFP 300 executes the generative AI client 3200 and sends a scan instruction to the controller 3300 based on the interpretation results.

[0149] In S1709, the CPU 341 of the MFP 300 controls the controller 3300 to send a scan instruction to the scanning unit 306.

[0150] In S1710, the CPU 341 of the MFP 300 controls the scanning unit 306 to scan the original document placed on the document positioning plate of the MFP 300.

[0151] In S1711, the CPU 341 of the MFP 300 controls the scanning unit 306 to send scan data (image data generated by scanning) to the controller 3300. The image file itself of the scanned image data can be sent as this scan data. Alternatively, optical character recognition (OCR) processing can be performed on the image data to obtain a string, and the obtained string (text data) can be sent.

[0152] In S1712, the CPU 341 of the MFP 300 controls the controller 3300 to send pre-edit scan data to the generative AI application 4110.

[0153] In S1713, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and performs editing processing on the scanned data before editing based on prompts. For example, given the prompt "scan content and extract only text", the generative AI application 4110 performs processing to extract only text from the scanned data and generate image data.

[0154] In S1714, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and sends the scan data before editing to the ID management application 5110.

[0155] In S1715, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and sends a QR code generation request to the ID management application 5110.

[0156] In S1716, the CPU 541 of the ID management server 500 executes the ID management application 5110 and generates a QR code 5103 containing built-in ID data. Note that, similar to the first embodiment, it is sufficient if the QR code generated here indicates information for accessing the scanned data before editing. For example, the information could be a URL indicating the storage location where the scanned data before editing is stored.

[0157] In S1717, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and saves the scan data before editing and the ID list ID in the ID management database 5130.

[0158] In S1718, the CPU 541 of the ID management server 500 executes the ID management application 5110 and sends the generated QR code 5103 to the generative AI application 4110.

[0159] In S1719, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and adds a QR code 5103 to the edited scan data.

[0160] In S1720, the control unit 404 of the generative AI server 400 executes the generative AI application 4110 and returns the edited scan data to the generative AI client 3200.

[0161] In S1721, the CPU 341 of the MFP 300 executes the generative AI client 3200 and returns the edited scan data to the controller 3300.

[0162] In S1722, the CPU 341 of the MFP 300 controls the controller 3300 to send the edited scan data and the display instructions for the edited scan data to the display unit 301.

[0163] In S1723, the CPU 341 of the MFP 300 controls the display unit 301 to display the edited scan data with the generated QR code added in the preview display unit 1403.

[0164] In S1724, the user presses the print button 1406 to send a print instruction to the controller 3300 for the edited scan data displayed in the preview display unit 1403.

[0165] In S1725, the CPU 341 of the MFP 300 controls the controller 3300 to send a print instruction for the edited scan data to the print unit 307.

[0166] In S1726, the CPU 341 of the MFP 300 controls the printing unit 307 to perform image printing processing, printing the image data as edited scanned data onto the sheet. Note that the user can input print settings at any time via LUI 1401 (setting receiving unit).

[0167] In S1727, the user reads the QR code 5103 printed on the sheet in S1726 using the QR code reading application 2120 on the smartphone 200.

[0168] In S1728, the CPU 241 of the smartphone 200 executes the document processing application 2110 and sends a request to the ID management application 5110 to obtain scanned data before editing.

[0169] In S1729, the CPU 541 of the ID management server 500 executes the ID management application 5110 and sends a request to the ID management database 5130 to retrieve scan data before editing.

[0170] In S1730, the CPU 541 of the ID management server 500 controls the ID management database 5130 to determine the pre-edit scan data to be sent based on ID 901.

[0171] In S1731, the CPU 541 of the ID management server 500 controls the ID management database 5130 to send scan data before editing to the ID management application 5110.

[0172] In S1732, the CPU 541 of the ID management server 500 executes the ID management application 5110 and sends the pre-editing scan data to the document processing application 2110.

[0173] In S1733, the CPU 241 of the smartphone 200 executes the document processing application 1110 and displays the scanned data obtained before editing on the display unit 6103.

[0174] The processing procedure of this embodiment in the printing system 10 according to this embodiment has been described above. When the above processing procedure is implemented, the user can seamlessly perform scanning and data conversion processing on the original document set in the MFP 300.

[0175] In the first and second embodiments, the printing system according to this embodiment has been described above. However, it should be noted that this disclosure is not limited to the above embodiments, and various modifications and alterations are possible within the scope of the spirit. This disclosure can also be implemented by providing a program that implements one or more functions of the above embodiments to a system or device via a network or storage medium, and one or more processors of the computer of the system or device reading out the program for execution. Alternatively, this disclosure can be implemented by a circuit (e.g., an application-specific integrated circuit) that implements one or more functions.

[0176] Additionally, in the above embodiments, the computer 100 of the MFP 300 has an operating unit configured to input output conditions into the MFP 300. However, this disclosure is not limited to this, and it is sufficient if at least one of the following devices—computer 100, smartphone 200, MFP 300, generative AI server 400, and ID management server 500—has an operating unit. The operating unit may be displayed on a browser UI such as Microsoft Edge or Google Chrome. Alternatively, the operating unit may be displayed on a generative application UI such as ChatGPT, a printing application UI such as Microsoft Office, or a chat application UI such as Microsoft Teams.

[0177] Furthermore, in the above embodiments, as the print settings stored in the storage unit, it is conceivable that the data formats used for sending and receiving, such as PrintTicket and devmode, can be different, depending on the differences between OS1400 and printer driver 1420. This disclosure can also be applied to the sending and receiving of such multiple data formats. Moreover, in the above embodiments, it is desirable that in S637, printer driver 1420 sends a print job to MFP 300 connected to the same network 600 as computer 100. However, this disclosure is not limited to this. For example, it is possible to use a configuration where, in S725, printer driver 1420 uploads the print job to a print service in the cloud, and prints it via the cloud through a printer connected to a network different from computer 100.

[0178] Furthermore, in the printing system 10, for example, the generative AI server 400 (hereinafter referred to as the "server") can be located outside Japan, and the computer 100 used as a terminal device (hereinafter referred to as the "terminal device") can be located within Japan. Similarly, in this case, various files and data can be sent from the server to the terminal device, and the terminal device can receive various files and data. In this way, even when the server is located outside Japan, the sending and receiving of files and data in the system is performed uniformly (sending and receiving processing). Therefore, since the system operates by receiving various files and data from a terminal device within Japan, sending and receiving processing within Japan can be considered. In this system, for example, even when the server is located outside Japan and the terminal device is located within Japan, the terminal device can perform the main functions of the system, and the effects of functions based on Japan's domestic context can also be achieved.

[0179] For example, even if the server is located outside Japan, if the terminal device constituting the system is located within Japan, the system can be used domestically by using the terminal device. Thus, for example, the use of the system may affect the economic interests of the patent holder.

[0180] Additionally, a method for creating content using the document processing application 1110 in the above embodiments has been described. However, this disclosure is not limited thereto, and content may not be created using the document processing application 1110, and for example, content stored in the storage unit 103 of the computer 100 may be retrieved, or content may be retrieved from an external storage device such as a USB or SD card.

[0181] Furthermore, according to this embodiment, the document processing application 1110 and the generative AI client 3200 have been described as separate constructions, but the processing of the generative AI client 1200 can be included in the document processing application 1110.

[0182] Furthermore, the printer driver 1420 displaying a print preview image has been described in the first embodiment above. However, the print preview image can be displayed by different programs that have a print preview image display function. For example, a document processing application 1110 can display a print preview image. This disclosure is not limited to the above embodiments, and various modifications and changes can be made without departing from the spirit and scope of this disclosure.

[0183] According to this disclosure, it is possible to refer to the original image of the image generated by generative AI based on the image generated by generative AI.

[0184] Other embodiments

[0185] The embodiments of this disclosure can also be implemented by a computer in a system or apparatus that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more comprehensively referred to as a "non-transitory computer-readable storage medium") to perform the functions of one or more embodiments described above and / or includes one or more circuits (e.g., application-specific integrated circuits (ASICs)) to perform the functions of one or more embodiments described above, and by a method executed by the computer in the system or apparatus, such as reading and executing computer-executable instructions from the storage medium to perform the functions of one or more embodiments described above and / or controlling one or more circuits to perform the functions of one or more embodiments described above. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessor unit (MPU)) and may include separate computers or a network of separate processors to read and execute the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, a hard disk, random access memory (RAM), read-only memory (ROM), the memory of a distributed computing system, an optical disk (e.g., an optical disc (CD), a digital versatile optical disc (DVD), or a Blu-ray disc (BD)). TM One or more of the following: flash memory devices, memory cards, etc.

[0186] Although this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the appended claims should be interpreted in the broadest possible sense to cover all such variations and equivalent structures and functions.

Claims

1. A program product for causing an information processing device to execute: Accept user input on prompts; and Output image data, which is generated by adding code information that provides access to the input image data to an image generated by generative AI using input prompts and input image data.

2. The program product according to claim 1, wherein, The information processing device shall further perform: Print data is sent to the printing device, the print data including image data of an image for which the code information has been added.

3. The program product according to claim 2, wherein, The information processing device shall further perform: Accept print settings, and The print data includes image data of the image for which the code information has been added and the print settings.

4. The program product according to claim 1, wherein, The information processing device shall further perform: Display an area on the screen for accepting input to the prompts; as well as The image displays an image with the added code information, wherein... The area and the image with the added code information are displayed on the same screen.

5. The program product according to claim 4, wherein, While displaying an image with the code information already added, the system accepts user input to specify the location where the code information should be added to the image.

6. The program product according to claim 1, wherein, The code information includes information indicating the storage location of the input image data.

7. The program product according to claim 6, wherein, The information indicating the storage location is a URL.

8. The program product according to claim 6, wherein, The entered prompts are also stored in the storage location, and The input image data and the input prompt are displayed on the display unit of the terminal device that has read the code information.

9. The program product according to claim 6, wherein, The version information of the generative AI is also included in the storage location, and The input image data and version information are displayed on the display unit of the terminal device that has read the code information.

10. The program product according to claim 1, wherein, The code information is a QR code.

11. The program product according to claim 1, wherein, The information processing device shall further perform: Send the input prompt and the input image data to the generative AI server that provides the generative AI; Receive image data of images generated by the generative AI server; as well as Add the code information to the image data that has already been received.

12. The program product according to claim 1, wherein, The image generated by the generative AI is an image of a sentence generated by summarizing sentences in the image data from the input image data.

13. The program product according to claim 1, wherein, The image generated by the generative AI is generated by removing the photo from the image data input by the sentence and the photo.

14. An information processing apparatus comprising: The receiving section is used to accept user input for prompts; as well as An output unit is used to output image data, which is generated by adding code information that provides access to the input image data to an image generated by generative AI using input prompts and input image data.

15. The information processing apparatus according to claim 14, further comprising: A sending unit is used to send printing data to a printing device, the printing data including image data of an image to which the code information has been added.

16. The information processing apparatus according to claim 15, further comprising: A receiving section is configured to receive print settings, wherein... The print data includes image data of the image for which the code information has been added and the print settings.

17. The information processing apparatus according to claim 14, further comprising: A region display unit, which is used to display on the screen the area where input to prompts is received; as well as An image data display unit is used to display an image for which the code information has been added, and The area and the image with the added code information are displayed on the same screen.

18. The information processing apparatus according to claim 14, wherein, While displaying an image with the code information already added, the receiving unit accepts user input to specify the location where the code information should be added to the image.

19. The information processing apparatus according to claim 14, wherein, The code information includes information indicating the storage location of the input image data.

20. The information processing apparatus according to claim 19, wherein, The information indicating the storage location is a URL.

21. The information processing apparatus according to claim 19, wherein, The entered prompts are also stored in the storage location, and The input image data and the input prompt are displayed on the display unit of the terminal device that has read the code information.

22. The information processing apparatus according to claim 19, wherein, The version information of the generative AI is also included in the storage location, and The input image data and version information are displayed on the display unit of the terminal device that has read the code information.

23. The information processing apparatus according to claim 14, wherein, The code information is a QR code.

24. The information processing apparatus according to claim 14, further comprising: Send the input prompt and the input image data to the generative AI server that provides the generative AI; Receive image data of images generated by the generative AI server; and The adding unit is used to add the code information to the image data that has already been received.

25. The information processing apparatus according to claim 14, wherein, The image generated by the generative AI is an image of a sentence generated by summarizing sentences in the image data from the input image data.

26. The information processing apparatus according to claim 14, wherein, The image generated by the generative AI is generated by removing the photo from the image data input by the sentence and the photo.

27. An information processing method, comprising: Accept user input for prompts; as well as Output image data, which is generated by adding code information that provides access to the input image data to an image generated by generative AI using input prompts and input image data.

Images