Printing system, control method and program of printing system

Abstract

To provide a printing system capable of easily and accurately setting when an output condition in a printing device is set, and a control method and a program of the printing system.SOLUTION: A printing system comprises a terminal device, a server and a printing device. The terminal device includes a print application 1110 being input means for inputting an output condition including a print condition when printing is executed by the printing device. The output condition includes an output item which can be input in a natural language by the input means. The server includes primary data conversion means which digitizes the output item on the basis of a learned model so as to convert it into primary data, and secondary data conversion means which converts the primary data into secondary data capable of being processed by the printing device.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a printing system, a control method for the printing system, and a program.

Background Art

[0002] In recent years, conversational AIs such as chatbots and generative AIs have been rapidly developed. Along with this development, various services using conversational AIs are provided. For example, in a printing service, a printing assistance system is known that can perform automatic printing settings for a printing job via a chatbot (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the printing assistance system described in Patent Document 1, for example, when text other than a pre-specified format is input, there is a problem that the input text cannot be accurately (appropriately) interpreted, making it difficult to perform automatic printing settings for a printing job.

[0005] The present invention has been made in view of the above problems. An object of the present invention is to provide a printing system, a control method for the printing system, and a program that can easily and accurately set output conditions in a printing device.

Means for Solving the Problems

[0006] In order to achieve the above object, a printing system according to the present invention is a printing system including a terminal device, a server, and a printing device that are communicably connected to each other, wherein at least one of the terminal device, the server, and the printing device includes an input unit that inputs output conditions including printing conditions when performing the printing by the printing device, the output conditions include output items that can be input in natural language by the input unit, and the server includes a primary data conversion unit that quantifies the output items input by the input unit based on a learned model and converts them into primary data, and a secondary data conversion unit that converts the primary data into secondary data that can be processed by the printing device.

Effect of the Invention

[0007] According to the present invention, when setting output conditions in a printing device, the setting can be easily and accurately set.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10A

Figure 10B

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the embodiments. For example, each part constituting the present invention can be replaced with any configuration that can exhibit the same function. Also, any component may be added.

[0010] FIG. 1 is a block diagram showing an example of the network configuration of a printing system. As shown in FIG. 1, the printing system 100 includes a computer 1000 which is a terminal device, a printer (printing device) 2000 configured to be printable, and a generative AI server (server) 3000. For example, the computer 1000 and the printer 2000 are arranged within an office and are communicably connected to each other via an in-house network 4000. The in-house network 4000 is connected to an external Internet 5000 via a router (not shown). The generative AI server 3000 is communicably connected to the computer 1000 and the printer 2000 via the Internet 5000 and the in-house network 4000. The generative AI server 3000 is a server managed by an operator who provides a generative AI service. In the present embodiment, the generative AI server 3000 and the generative AI control 1150 on the computer 1000 shown in FIG. 6 may be collectively referred to as a "generative AI system". Note that the generative AI server 3000 and the hardware on which the generative AI control 1150 exists may be separate or may exist on the same hardware integrally. Also, the in-house network 4000 may be by a wired connection or may be by a wireless connection.

[0011] FIG. 2 is a block diagram showing the hardware configuration of a computer and a generative AI server. As shown in FIG. 2(a), the computer 1000 has a display unit (display means) 1010, an operation unit 1020, a storage unit 1030, a control unit 1040, and a network communication unit 1050, which are connected to each other so as to be able to communicate with each other. The computer 1000 is not particularly limited, and may be, for example, a desktop or notebook personal computer, a tablet terminal, a smartphone, or the like. The control unit 1040 is composed of a CPU (Central Processing Unit) 1041 and a memory 1042, and controls the entire computer 1000. The display unit 1010 is composed of a display such as a liquid crystal panel, and can display, for example, images, etc. The operation unit 1020 is composed of, for example, a mouse, a keyboard, etc., and is capable of input operations by a user. The storage unit 1030 is composed of a storage medium such as a hard disk or SSD, and various programs (software) etc. required for the computer 1000 to operate are stored therein. The programs are loaded into memory 1042 as necessary and executed by CPU 1041. The programs include programs for causing CPU 1041 (computer) to execute each part and each means (control method of the printing system) of printing system 100. Note that this program is not limited to being stored in computer 1000. For example, the programs may be stored in printer 2000 or generative AI server 3000, or may be stored in a distributed manner in computer 1000, printer 2000, and generative AI server 3000. Network communication unit 1050 inputs and outputs data to and from external devices via an external network.

[0012] As shown in FIG. 2(b), the generative AI server 3000 includes a display unit 3010, an operation unit 3020, a storage unit 3030, a control unit 3040, and a network communication unit 3050, which are communicably connected to each other. The control unit 3040 is composed of a CPU 3041 and a memory 3042, and controls the entire generative AI server 3000. Thus, the hardware configuration of the generative AI server 3000 is substantially the same as that of the computer 1000. Therefore, in this embodiment, the description of the hardware configuration of the generative AI server 3000 is omitted. Note that the generative AI server 3000 preferably has a GPU (Graphics Processing Unit) 3043.

[0013] FIG. 3 is a block diagram showing the hardware configuration of the printer. As shown in FIG. 3, the printer 2000 includes a display unit (display means) 2010, an operation unit 2020, a storage unit 2030, a control unit 2040, a network communication unit 2050, and a printing unit 2060, which are connected to be communicable with each other. The printer 2000 is not particularly limited as long as it has a printing function. For example, a (Multi-Function Printer / Peripheral) or an SFP (Single Function Printer) can be used. The control unit 2040 is composed of a CPU 2041 and a memory 2042, and controls the entire printer 2000. The display unit 2010 is composed of a display such as a liquid crystal panel, and can display, for example, an image. The operation unit 2020 is composed of a touch panel, various buttons, etc., and enables input operations by the user. The storage unit 2030 is composed of a storage medium such as a hard disk or an SSD, and stores various programs (software) necessary when the printer 2000 operates. The program is loaded into the memory 2042 as necessary and executed by the CPU 2041. The network communication unit 2050 inputs and outputs data to and from an external device via an external network. The printing unit 2060 images the digital data stored in the storage unit 2030 or the memory 2042 and prints it on printing paper according to the instruction of the control unit 2040. The printing method is not particularly limited, and for example, an ink method, a toner method, or other methods can be used.

[0014] FIG. 4 is a block diagram showing the software configuration of a computer and a generative AI server. FIG. 4(a) is a block diagram showing modules related to printing in the software configuration of the computer. As shown in FIG. 4(a), the computer 1000 has an application 1100 and an OS (Operating System) 1200. The application 1100 includes any software such as security software, spreadsheet software, browser software, etc., and in FIG. 4(a), a printing application 1110 is included. The printing application 1110 is an application having a printing function. The printing application 1110 is not particularly limited, and examples include spreadsheet software and browser software having a printing function. When the printing function of the printing application 1110 is executed by a user operation, information displayed on the display unit 1010 of the computer 1000 is transmitted to the printer 2000, and printing is performed. The printing function is realized by calling an interface of the GDI (Graphic Device Interface) 1210 described later.

[0015] The OS 1200 is software that controls the basic operations of the computer 1000. The OS 1200 includes a GDI 1210, a printer driver 1220, and a spooler 1230. The application 1100, the printer driver 1220, etc. are all managed by the OS 1200 and can be used by being installed on the OS 1200. The GDI 1210 is a component inside the OS 1200 that provides an interface related to drawing such as printing to the outside. The printer driver 1220 displays printing settings for printing on the printer 2000 on the UI (User Interface). Also, the printer driver 1220 generates drawing data (PDL: Page Description Language) that can be interpreted by the printer 2000 at the time of printing. The spooler 1230 performs a process of sending the PDL generated by the printer driver 1220 to the printer 2000.

[0016] Figure 4(b) is a block diagram showing the software configuration related to the interpretation process of the generative AI server. As shown in Figure 4(b), the generative AI server 3000 has an application 3100 and an OS 3200. Since the OS 3200 is almost the same as the OS 1200 in terms of software configuration, the description of the OOS 3200 is omitted here. The application 3100 contains arbitrary software, and in Figure 4(b), a generative AI application 3110 is included. The generative AI application 3110 is an application having the interpretation processing function of the generative AI. When the generative AI server 3000 receives interpretation instruction data for instructing the execution of data interpretation processing, the generative AI application 3110 executes the interpretation process. The interpretation instruction data is Bool-type data taking a value of True or False. When the value of the interpretation instruction data is True, the generative AI application 3110 executes an API for performing data interpretation processing and sets the value of the interpretation instruction data to False. On the other hand, when the value of the interpretation instruction data is False, the generative AI application 3110 does not execute data interpretation processing.

[0017] FIG. 5 is a diagram showing an example of an image for a UI (User Interface) displayed by a printer driver. The UI 400 shown in FIG. 5 is displayed as an image on the display unit 1010 by the printer driver 1220. This display request is received by the printer driver 1220 from the printing application 1110 or the spooler 1230 via the GDI 1210. A plurality of sheets called tabs where various settings are possible are arranged in the UI 400. These tabs include a basic settings tab 401. In the basic settings tab 401, for example, settings such as the size of the original document used for printing and the page layout in the original document can be made. The basic settings tab 401 includes a color mode dropdown 402 and an OK button 403. In the color mode dropdown 402, as color mode setting values (hereinafter sometimes referred to as "setting values"), "Color" for setting color printing and "Monochrome" for setting monochrome printing can be selected. Then, in a state where either "Color" or "Monochrome" is selected, by pressing (depressing) the OK button 403, the selected state is set. Regarding various setting information in the UI 400, when control is performed from the printing application 1110, it is transmitted to the printing application 1110, and when control is performed from the spooler 1230, it is transmitted to the spooler 1230. After this transmission, the printer driver 1220 closes the UI 400.

[0018] FIG. 6 is a diagram showing an example of an image of a printing application. The printing application 1110 shown in FIG. 6 is displayed as an image on the display unit 1010, and output conditions including printing conditions and the like when printing is performed by the printer 2000 are input (input step). Thus, in the present embodiment, the printing application 1110 functions as input means for inputting output conditions. The printing application 1110 includes a printer selection control 1120, a printing setting control 1130, a printer driver control 1140, and a generation system AI control 1150 as printing conditions. Note that the printing application 1110 may include other output conditions in addition to these printing conditions. For example, when the printer 2000 is configured to be able to perform staple processing, staple conditions for setting the position and number of staples may be included. Also, when the printer 2000 is configured to be able to perform cut processing, cut conditions for setting the position of the cut may be included. The printing application 1110 also includes a print button 1160, a cancel button 1161, and an image display area 1170.

[0019] In the printer selection control 1120, a list of printers that can be used by the computer 1000, that is, printers that can receive print jobs from the computer 1000, is displayed on the UI based on printer data previously stored in the storage unit 1030. The user can select the printer 2000 as the transmission target for transmitting the print job by operating the printer selection control 1120. In FIG. 6, the name of the printer 2000 is "Printer X".

[0020] The print setting control 1130 includes a copy number control 1131, a layout control 1132, and a color mode control 1133. The copy number control 1131 is an item for setting the number of copies to be printed. In FIG. 6, the copy number control 1131 is set to "1". The layout control 1132 is an item for selecting the printing orientation with respect to the paper. In this embodiment, it is possible to select "portrait" with the printing orientation being vertical and "landscape" with the printing orientation being horizontal. In FIG. 6, the layout control 1132 is set to "portrait". The color mode control 1133 is an item for selecting "color" for setting color printing and "monochrome" for setting monochrome printing. In FIG. 6, the color mode control 1133 is set to "color". Note that the print setting control 1130 is not limited to including the copy number control 1131 to the color mode control 1133, and it may include at least one of these items. Further, the print setting control 1130 may include, for example, an item for selecting the paper size, an item for selecting single-sided printing or double-sided printing, an item for selecting the number of pages arranged per sheet of paper, and the like.

[0021] When the user operates the printer driver control 1140, the printer driver control 1140 displays the UI 400 of the printer driver corresponding to "Printer X" displayed on the printer selection control 1120. Thereby, the user can change the print setting values on the UI 400. When the UI 400 is closed, the changed content of the print setting values on the UI 400 is stored in the storage unit 1030.

[0022] The generation AI control 1150 includes a text box 1151, an execution button 1152, and an execution result display section 1153. The text box 1151 is an output item for setting one of the output conditions. In this text box 1151, for example, a message to change the printing color can be input in a natural language such as Japanese. In FIG. 6, the text "Change to dark color" for changing the printing color to a dark color is input in Japanese in the text box 1151. Note that the text input in the text box 1151 is not limited to the text for changing the printing color, and can be arbitrary text such as changing the printing range, that is, enlarging or reducing the printing range. Then, the execution button 1152 can be operated with text input in the text box 1151. Thereby, pre-interpretation data is transmitted to the generation AI server 3000. This pre-interpretation data includes the data of the text input in the text box 1151 (hereinafter referred to as "text data") and the data of each printing setting value set in the printing setting control 1130 (hereinafter referred to as "printing setting list data"). Further, the pre-interpretation data also includes the above-described interpretation instruction data. In the execution result display section 1153, the post-interpretation data (execution result) obtained by the generation AI server 3000 interpreting the pre-interpretation data is displayed as text. In FIG. 6, "Changed to monochrome" is displayed as the post-interpretation data in the execution result display section 1153.

[0023] In the image display area 1170, a preview of the printed image is displayed. As the preview image, an image in which the printing setting values set in the printing setting control 1130 of the printing application 1110, the generation AI control 1150, etc. are reflected in the image data to be printed is displayed. Thereby, the user can confirm the printed matter to be printed by the printer 2000 before obtaining the printed matter. When the user wants to print the preview image, the print job can be transmitted to the printer 2000 by operating the print button 1160. Thereby, the printer 2000 can execute the print job and output the printed matter.

[0024] FIG. 7 is a flowchart showing an example of data interpretation processing executed by a generative AI server. FIG. 8 is a diagram showing an example of the relationship between print setting list data, a tipping score, a similarity score, and post-interpretation data in the data interpretation processing. Further, all the processes in the flowchart shown in FIG. 7 are executed by the CPU 3041 after the application 3100 stored in the storage unit 3030 of the generative AI server 3000 is loaded into the memory 3042. Further, the process in the flowchart shown in FIG. 7 is started when the network communication unit 3050 receives pre-interpretation data. As shown in FIG. 7, in step S3130, the CPU 3041 of the generative AI server 3000 reads out the pre-interpretation data and executes data interpretation processing for interpreting the pre-interpretation data. This data interpretation processing will be described with reference to FIG. 8.

[0025] As shown in FIG. 8, the print setting list data includes "portrait", "landscape", "color", and "monochrome". Further, the text data includes "change to dark color". First, the generative AI server 3000 receives the print setting list data and the text data. The generative AI server 3000 can interpret the print setting list data based on data specified in advance in the generative AI server 3000. On the other hand, since the text data is text arbitrarily input by the user, it may be difficult to interpret based on data specified in advance in the generative AI server 3000.

[0026] Therefore, the CPU 3041 calculates a tendency score for each piece of data. When calculating the tendency score, the print setting list data and the text data are decomposed into components A, B, C, D, and E, respectively. As a result, numerical vector data in components A to E is obtained as the tendency score. Then, the tendency scores of the print setting list data and the text data are calculated (quantified) based on the learned model so that the difference between the data is relatively large. For example, for "monochrome", component A is "-0.8", component B is "-0.4", component C is "0.2", component D is "-0.1", and component E is "-0.3". Also, for "change to a dark color", component A is "-0.8", component B is "-0.1", component C is "0.1", component D is "-0.1", and component E is "-0.2". Thus, in this embodiment, the CPU 3041 functions as primary data conversion means for digitizing the print setting list data and the text data based on the learned model and converting them into primary data (primary data conversion step). Note that in the generation-type AI server 3000, a part that functions as primary data conversion means may be provided separately from the CPU 3041. Also, the learned model is not particularly limited, and for example, a Transformer or the like can be used. With a Transformer, the tendency scores of the print setting list data and the text data can be calculated so that the difference between the data is as large as possible. Also, components A to E are not particularly limited, and for example, component A can be set as "beauty", component B as "line formation", component C as "sweetness", component D as "verticality", and component E as "happiness" so that they are easily interpretable by humans.

[0027] Next, the CPU 3041 compares the trend score of the print setting list data with the trend score of the text data to calculate their similarity score (closeness). For calculating this similarity score, methods such as cosine similarity, inner product, Mahalanobis distance, etc. can be used. The trend score of the print setting list data and the trend score of the text data indicate that the higher the similarity score is close to 1, the higher the similarity; the closer it is to -1, the lower the similarity; and the closer it is to 0, the lower the correlation. In FIG. 8, the similarity score between "vertical" and "change to dark color" is "0.2". The similarity score between "horizontal" and "change to dark color" is "0.2". The similarity score between "color" and "change to dark color" is "-0.8". The similarity score between "monochrome" and "change to dark color" is "0.8". And when the threshold of the similarity score for determining that the trend score of the print setting list data and the trend score of the text data are similar is, for example, "0.5", the CPU 3041 can determine that "monochrome" and "change to dark color" are similar. The similarity score between "monochrome" and "change to dark color" is "0.8", which is equal to or higher than the threshold "0.5".

[0028] Next, the CPU 3041 generates, as the interpreted data, data obtained by processing "change to dark color" as "set to monochrome". This "monochrome setting data" is data that can be processed by the printer 2000. Thus, in this embodiment, the CPU 3041 also functions as secondary data conversion means for converting the text data "change to dark color" that has been primary data into secondary data "monochrome setting data" that can be processed by the printer 2000 (secondary data conversion step). Note that in the generation-type AI server 3000, a part that functions as secondary data conversion means may be provided separately from the CPU 3041.

[0029] As shown in FIG. 7, in step S3140, the CPU 3041 of the generative AI server 3000 compares the trend score of the print setting list data with the trend score of the text data as described above, and calculates the similarity score between them. Then, the CPU 3041 determines whether there is only one print setting value (print setting list data) whose calculation result is equal to or greater than the threshold. If it is determined in step S3140 that there is only one, the process proceeds to step S3150. On the other hand, if it is determined in step S3140 that there is not only one, that is, if it is determined that there are multiple, the process proceeds to step S3160.

[0030] In step S3150, the CPU 3041 transmits the data of the print setting value determined to be equal to or greater than the threshold in step S3140 to the computer 1000, which is the data transmission source of the print setting list data and the text data. This print setting value data is the "monochrome setting data" described above in this embodiment. After step S3150 is executed, the process ends.

[0031] In step S3160, the CPU 3041 transmits error data to the computer 1000. Then, the error data is displayed on the display unit 1010 of the computer 1000. The error data is not particularly limited, and examples include data indicating "unable to interpret text data". Further, candidates for print setting values replacing the text data may be displayed on the display unit 1010. Thus, in this embodiment, the display unit 1010 functions as a notification means for notifying that the conversion of the primary data or the secondary data has failed. Thereby, the user can grasp that the text data has not been automatically converted into data interpretable by the printer 2000. Note that the notification means is not limited to being possessed by the computer 1000, and it may be possessed by at least one of the computer 1000, the generative AI server 3000, and the printer 2000. After step S3160 is executed, the process ends.

[0032] Regarding the display of error data in the printing system 100, it is not limited to displaying a message indicating "incomprehensible text data". For example, it is also possible to display a message indicating "unable to set the driver or printer". In this case, it is preferable to display candidates for the settable driver or printer. Also, regarding the display of error data in the printing system 100, it is also possible to display a message indicating that "an option setting that cannot be processed by the printer (for example, a finish processing setting such as staple processing or cut processing) has been set". In this case, it is preferable to display a proposal for a printing setting without making the option setting. Also, regarding the display of error data in the printing system 100, it is also possible to display a message indicating that "the network is offline" or the like. In this case, it is preferable to display the available networks.

[0033] FIG. 9 is a flowchart showing an example of a printing process executed in a printing application. FIGS. 10A and 10B are diagrams each showing an example of an image of the printing application sequentially displayed during the printing process executed in the printing application. Further, the processes in the flowchart shown in FIG. 9 are all executed by the CPU 1041 after the printing application 1110 stored in the storage unit 1030 of the computer 1000 is loaded into the memory 1042. Further, the processes in the flowchart shown in FIG. 9 are started when the operation unit 1020 receives a UI display request for the printing application 1110. As shown in FIG. 9, in step S1310, the CPU 1041 displays the printing application 1110 on the display unit 1010. Thereby, the user can perform an operation event on the printing application 1110. The "operation event" means performing a setting operation on the printer selection control 1120, the number control 1131 to color mode control 1133 of the print setting control 1130, and the text box 1151 of the generative AI control 1150. The user sets the printing application 1110 to the state shown in FIG. 10A, for example. In the state shown in FIG. 10A, the printer selection control 1120 is set to "Printer X". The number control 1131 of the print setting control 1130 is set to "1". The layout control 1132 is set to "portrait". The color mode control 1133 is set to "color". The text "Change to dark colors" is input and set in the text box 1151 of the generative AI control 1150. Note that the execution result display section 1153 and the image display area 1170 are each blank.

[0034] In step S1320, the CPU 1041 receives an operation event for the printing application 1110.

[0035] In step S1330, the CPU 1041 determines whether the execution button 1152 of the generation-based AI control 1150 has been operated, i.e., pressed, with respect to the printing application 1110 in the state shown in FIG. 10A. If, as a result of the determination in step S1330, it is determined that the execution button 1152 has been operated, the process proceeds to step S1340. On the other hand, if, as a result of the determination in step S1330, it is determined that the execution button 1152 has not been operated, the process proceeds to step S1400.

[0036] In step S1340, the CPU 1041 transmits the pre-interpretation data to the network communication unit 3050 of the generation-based AI server 3000 via the network communication unit 1050. Then, when the generation-based AI server 3000 receives the pre-interpretation data via the network communication unit 3050, a program based on the flowchart shown in FIG. 7 is executed. As a result, post-interpretation data is obtained in the generation-based AI server 3000. The generation-based AI server 3000 transmits the post-interpretation data to the network communication unit 1050 of the computer 1000 via the network communication unit 3050.

[0037] In step S1350, the CPU 1041 receives the post-interpretation data from the network communication unit 3050 of the generation-based AI server 3000 via the network communication unit 1050.

[0038] In step S1360, the CPU 1041 determines whether the post-interpretation data received in step S1350 is print setting value data. Here, as an example of the print setting value data, the above-described "monochrome setting data" is used. If, as a result of the determination in step S1360, it is determined that the data is print setting value data, the process proceeds to step S1370. On the other hand, if, as a result of the determination in step S1360, it is determined that the data is not print setting value data, the process proceeds to step S1390.

[0039] In step S1370, the CPU 1041 updates the print setting data stored in the storage unit 1030. As a result, on the display unit 1010, the print setting value of the color mode control 1133 is forcibly changed from "Color (see Fig. 10A)" to "Monochrome (see Fig. 10B)" and displayed. Note that the print setting value of the color mode control 1133 is not limited to being forcibly changed from "Color" to "Monochrome". For example, a message box (not shown) or the image display area 1170 may display a message such as "Do you want to change from 'Color' to 'Monochrome'?" In this case, if the OK button (not shown) is operated, it is preferable to change the print setting value of the color mode control 1133 from "Color" to "Monochrome" and display it on the display unit 1010.

[0040] In step S1380, the CPU 1041 displays the text "Changed to monochrome" on the execution result display unit 1153 based on the result determined in step S1360 that the post-interpretation data is the print setting value data "monochrome setting data" (see Fig. 10B). Also, the CPU 1041 displays a preview image (print result based on secondary data) in which "Changed to dark colors" input and set in the text box 1151 is reflected in the image display area 1170 (see Fig. 10B). Thereby, the user can confirm how "Changed to dark colors" is reflected in the printed matter before obtaining the printed matter. After step S1380 is executed, the process returns to step S1320, and the subsequent steps are sequentially executed.

[0041] In step S1390 after step S1360 is executed, the CPU 1041 displays an error message (e.g., "Failed to interpret text") on the image display area 1170 of the execution result display unit 1153. After step S1390 is executed, the process returns to step S1320, and the subsequent steps are sequentially executed.

[0042] After the execution of step S1330, in step S1400, the CPU 1041 determines whether the printer driver control 1140 has been operated on the printing application 1110 in the state shown in FIG. 10A. As a result of the determination in step S1400, if it is determined that the printer driver control 1140 has been operated, the process proceeds to step S1410. On the other hand, as a result of the determination in step S1400, if it is determined that the printer driver control 1140 has not been operated, the process proceeds to step S1430.

[0043] In step S1410, the CPU 1041 acquires the print setting values stored in the storage unit 1030.

[0044] In step S1420, the CPU 1041 displays the driver UI 400 (see FIG. 5) on the display unit 1010. At this time, the printing application 1110 in the state shown in FIG. 10A is erased from the display unit 1010. After the execution of step S1420, the process returns to step S1320, and the subsequent steps are sequentially executed.

[0045] After the execution of step S1400, in step S1430, the CPU 1041 determines whether the print button 1160 has been operated on the printing application 1110 in the state shown in FIG. 10A. As a result of the determination in step S1430, if it is determined that the print button 1160 has been operated, the process proceeds to step S1440. On the other hand, as a result of the determination in step S1430, if it is determined that the print button 1160 has not been operated, the process returns to step S1320, and the subsequent steps are sequentially executed.

[0046] In step S1440, the CPU 1041 acquires the print setting values stored in the storage unit 1030, and transmits a print job including the print setting values to the network communication unit 2050 of the printer 2000 via the network communication unit 1050. After step S1440 is executed, the process ends. Also, when the printer 2000 receives a print job via the network communication unit 2050, it executes the print job to perform printing.

[0047] In the printing system 100 configured as described above, even when text that is difficult to interpret by the printer 2000 is input to the text box 1151 of the print application 1110, the text can be accurately (appropriately) interpreted by the generative AI server 3000. Then, this interpretation result can be reflected in the print application 1110 (print job), and thus, the printer 2000 can also print a printed matter that reflects the interpretation result. In this way, in the printing system 100, when setting the output conditions for the printer 2000, the setting can be easily and accurately automatically set with the support (assistance) of the generative AI server 3000.

[0048] As described above, the preferred embodiments of the present invention have been described. However, the present invention is not limited to the above-described embodiments, and various modifications and changes are possible within the scope of the gist thereof. The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors of a computer in the system or device read and execute the program. Further, the present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0049] Also, in the above embodiment, the input means for inputting the output conditions in the printer 2000 is provided in the computer 1000, but is not limited thereto, and at least one of the computer 1000, the generative AI server 3000, and the printer 2000 may have it. The input means may be displayed on a browser UI such as Microsoft (registered trademark) Edge or Google (registered trademark) Chrome, a printing application UI, or a chat application UI such as Microsoft Teams.

[0050] Also, in the above embodiment, printing settings installed in the standard printer driver 1220, such as the number of copies, layout, color mode, etc., have been described, but are not limited thereto. Depending on the printer 2000, there may be differences in the availability of functions such as staple settings and binding settings. Even in this case, by performing processes such as acquiring the device information of the printer 2000 in advance, automatic setting of printing settings as in the above embodiment becomes possible. Further, in the above embodiment, it is conceivable that the data formats for transmitting and receiving PrintTicket, devmode, etc. are different in the printing setting data stored in the storage unit due to the actual differences between the OS 1200 and the printer driver 1220. The above embodiment is applicable even in the transmission and reception of such various data formats. Also, in the above embodiment, the process of automatically setting printing settings on the computer 1000 has been described, but is not limited thereto. For example, when using the copy function of the printer 2000, it is also possible to automatically set printing settings on the printer 2000. Further, in the above embodiment, the description has been made assuming that the print job is transmitted to the printer 2000, but is not limited thereto. For example, it is also possible to transmit the print job to a cloud service existing on the application 1100.

[0051] In addition, in the printing system 100, for example, the generative AI server 3000 (hereinafter referred to as the "server") may be located outside Japan, and the computer 1000 which is a terminal device (hereinafter referred to as the "terminal device") may be located within Japan. Even in this case, each file and data can be transmitted from the server to the terminal device, and the terminal device can receive each file and data. Even when the server is located outside Japan, the transmission and reception (transmission / reception) of files and data in this system are performed integrally. And since the system functions when the terminal device in Japan receives each file and data, the said transmission / reception can be regarded as having been performed within the country. In this system, for example, even when the server is located outside Japan and the terminal device is located within Japan, the terminal device can perform the main functions of this system, and the effects of those functions can be manifested within Japan. For example, even if the server is located outside Japan, if the terminal device constituting this system is located within Japan, it is possible to use this system within the country using the said terminal device. And the use of the said system can affect economic benefits for the patent holder, for example.

[0052] The disclosure of this embodiment includes the following configurations, methods, and programs. (Configuration 1) A printing system including a terminal device, a server, and a printing device that are communicably connected to each other, at least one of the terminal device, the server, and the printing device, is provided with input means for inputting output conditions including printing conditions when printing is performed by the printing device, the output conditions include output items that can be input in natural language by the input means, the server, is provided with primary data conversion means for quantifying the output items input by the input means based on a learned model and converting them into primary data, and secondary data conversion means for converting the primary data into secondary data that can be processed by the printing device, and is characterized by a printing system. (Configuration 2) The primary data conversion means uses a Transformer as the learned model, and the printing system according to Configuration 1 is characterized in that. (Configuration 3) The secondary data conversion means uses, as the secondary data, those that are equal to or greater than a threshold value, and the printing system according to Configuration 1 or 2 is characterized in that. (Configuration 4) In the output items, it is possible to input that the color of the printing is to be changed, and the printing system according to any one of Configurations 1 to 3 is characterized in that. (Configuration 5) The output conditions include at least one of an item for selecting color printing and monochrome printing, an item for selecting a paper size, an item for selecting the printing orientation with respect to the paper, an item for selecting single-sided printing and double-sided printing, and an item for selecting the number of pages arranged per sheet of paper, and the printing system according to any one of Configurations 1 to 4 is characterized in that. (Configuration 6) At least one of the terminal device, the server, and the printing device includes notification means for notifying that the conversion of the primary data by the primary data conversion means or the conversion of the secondary data by the secondary data conversion means has failed, and the printing system according to any one of Configurations 1 to 5 is characterized in that. (Configuration 7) The terminal device includes display means for displaying an image. The input means is characterized in that it is displayed as an image on the display means, and the printing system according to any one of Configurations 1 to 6 is characterized in that. (Configuration 8) The secondary data is displayed on the display means, and the printing system according to Configuration 7 is characterized in that. (Configuration 9) A printing result based on the secondary data is displayed as a preview image on the display means, and the printing system according to Configuration 7 or 8 is characterized in that. (Configuration 10) The printing device is capable of printing based on the secondary data, and the printing system according to any one of Configurations 1 to 9 is characterized in that. (Method 1) A method for controlling a printing system including a terminal device, a server, and a printing device that are communicably connected to each other. A process executed by at least one of the terminal device, the server, and the printing device includes an input step of inputting output conditions including printing conditions when printing is performed by the printing device, the output conditions include output items that can be input in natural language by the input step, A process executed by the server includes a primary data conversion step of quantifying the output items input in the input step based on a learned model and converting them into primary data, a secondary data conversion step of converting the primary data into secondary data that can be processed by the printing device, and a control method for a printing system characterized by including the above. (Program 1) A program for causing a computer to execute each means of the printing system according to any one of Configurations 1 to 10.

Explanation of Signs

[0053] 100 Printing system 1000 Computer 1010 Display unit 1110 Printing application 1133 Color mode control 1150 Generation AI control 1151 Text box 1153 Execution result display unit 2000 Printer 3000 Generation AI server

Claims

1. A printing system comprising a terminal device, a server, and a printing device that are communicably connected to each other, wherein at least one of the terminal device, the server, and the printing device includes input means for inputting output conditions including printing conditions when printing is performed by the printing device, the output conditions include output items that can be input in natural language by the input means, the server includes primary data conversion means for quantifying the output items input by the input means based on a learned model and converting them into primary data, and secondary data conversion means for converting the primary data into secondary data that can be processed by the printing device, and is characterized by the printing system.

2. The printing system according to claim 1, wherein the primary data conversion means uses a Transformer as the learned model.

3. The printing system according to claim 1, wherein the secondary data conversion means sets values equal to or greater than a threshold value as the secondary data.

4. The printing system according to claim 1, wherein it is possible to input a request to change the color of the printing in the output item.

5. The output conditions include at least one of an item for selecting color printing or monochrome printing, an item for selecting a paper size, an item for selecting a printing orientation for the paper, an item for selecting single-sided printing or double-sided printing, and an item for selecting the number of pages arranged per sheet of paper. The printing system according to claim 1 is characterized by this.

6. The printing system according to claim 1, wherein at least one of the terminal device, the server, and the printing device includes notification means for notifying that the conversion of the primary data by the primary data conversion means or the conversion of the secondary data by the secondary data conversion means has failed.

7. The terminal device includes display means for displaying an image, and the input means is characterized in that it is displayed as an image on the display means. The printing system according to claim 1.

8. The printing system according to claim 7, wherein the secondary data is displayed on the display means.

9. The printing system according to claim 7, wherein a printing result based on the secondary data is displayed as a preview image on the display means.

10. The printing system according to claim 1, wherein the printing apparatus is capable of printing based on the secondary data.

11. A method for controlling a printing system including a terminal device, a server, and a printing apparatus that are communicably connected to each other, the method comprising: In a process executed by at least one of the terminal device, the server, and the printing apparatus, an input process of inputting output conditions including printing conditions when printing is performed by the printing apparatus is included, the output conditions include output items that can be input in natural language by the input process, In a process executed by the server, a primary data conversion process of quantifying the output items input in the input process based on a learned model and converting them into primary data, and a secondary data conversion process of converting the primary data into secondary data that can be processed by the printing apparatus are included, and a method for controlling a printing system is characterized by this.

12. A program for causing a computer to execute each means of the printing system according to claim 1.

Images