Image forming system

Abstract

To provide an image forming system capable of printing an illustration according to a user's request on a medium.SOLUTION: According to an embodiment, an image forming system includes a server and an image forming apparatus. The server includes a first communication interface and a processor. The first communication interface performs communication via a network. The processor is configured to generate an illustration using an illustration generation condition specified by a user in a device that performs communication via the network by the first communication interface. The image forming apparatus includes a second communication interface, a controller, and a printer. The second communication interface communicates with the server. The controller is configured to acquire the illustration generated using the illustration generation condition from the server by the second communication interface. The printer prints the illustration acquired from the server on a medium.SELECTED DRAWING: Figure 1

Description

Technical Field

[0004] , The memory stores the illustration generation model for each illustrator. , , , ,

[0005] , , , , ,

[0003] , , , , memory and

[0001] Embodiments of the present invention relate to an image forming system.

Background Art

[0002] Some image forming apparatuses such as digital multi-function peripherals have a function of printing images on a plurality of types of special media (special media) in addition to ordinary paper. Conventionally, there is a system that provides a service for printing an image such as a pre-prepared illustration on special media using an image forming apparatus. In such a system, the image forming apparatus prints an image selected by the user from fixed images without problems such as copyrights prepared in advance on special media. That is, the conventional system has a problem that the image printed on the special media by the image forming apparatus is limited to being selected from fixed images prepared in advance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to provide an image forming system capable of printing an illustration according to a user's request on a medium in order to solve the above-described problems.

Means for Solving the Problems

[0005] According to an embodiment, the image forming system includes a server and an image forming apparatus. The server includes a first communication interface and memory and a processor. The first communication interface communicates via a network. The memory stores the illustration generation model for each illustrator. The processor is in a device that communicates via a network by the first communication interface Using the illustration generation model of the illustrator specified by the user, The image forming apparatus generates illustrations according to user-specified illustration generation conditions. The image forming apparatus comprises a second communication interface, a controller, and a printer. The second communication interface communicates with a server. The controller obtains illustrations generated according to the illustration generation conditions from the server via the second communication interface. The printer prints the illustrations obtained from the server onto a medium. [Brief explanation of the drawing]

[0006] [Figure 1] Figure 1 is a cross-sectional view showing an example of the configuration of an image forming system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing an example of the server configuration in the image forming system according to the embodiment. [Figure 3] Figure 3 is a cross-sectional view showing an example of the configuration of an MFP as an image forming apparatus according to the embodiment. [Figure 4] Figure 4 is a block diagram showing an example of the control system configuration in an MFP (Multi-Function Processor) as an image forming apparatus according to the embodiment. [Figure 5] Figure 5 is a schematic diagram showing the model creation process in which the server of the image forming system according to the embodiment creates an illustration generation model for each illustrator. [Figure 6] Figure 6 is a sequence illustrating the model creation process in which the server of the image forming system according to the embodiment creates an illustration generation model for each illustrator. [Figure 7] Figure 7 is a schematic diagram showing the illustration generation process in which the server of the image forming system according to the embodiment generates an illustration in accordance with the user's request. [Figure 8] Figure 8 is a sequence illustrating the illustration generation process in which the server of the image forming system according to the embodiment generates an illustration in accordance with the user's request. [Figure 9] Figure 9 is a schematic diagram showing the illustration printing process in which an MFP prints an illustration generated by a server of the image forming system according to the embodiment onto a medium. [Figure 10]Figure 10 is a sequence illustrating the illustration printing process in which an MFP prints an illustration generated by a server of the image forming system according to the embodiment onto a medium. [Modes for carrying out the invention]

[0007] This embodiment will be described below with reference to the drawings. First, the image forming system 1 according to this embodiment will be described in general terms. Figure 1 is a schematic block diagram showing an example of the configuration of the image forming system 1 according to the embodiment. As shown in Figure 1, the image forming system 1 consists of a server 2, an MFP (Multi-Functional Peripheral) 3, and a user terminal 4. In the image forming system 1, the server 2 connects to the MFP 3 and the user terminal 4 via a network.

[0008] Server 2 is a device that provides illustrations as images to be printed. Server 2 is a platform (content platform) that provides illustrations to be printed as a single piece of content. However, in this embodiment, the illustrations are not limited to illustrations used for commercial purposes, but may also include paintings and the like. In other words, the illustrations in this embodiment are broadly defined paintings created by a specific author (illustrator).

[0009] Server 2 communicates with MFP3 and user terminal 4 via the network. Server 2 manages information for each account. Server 2 generates illustrations according to requests (illustration generation conditions) from users logged in with a specific account. Server 2 also generates illustrations that reflect the style of a specific illustrator specified by the user, based on the illustration generation conditions specified by the user.

[0010] For example, Server 2 acquires training illustrations provided by illustrators who have given prior agreement (agreement to provide illustrations to third parties). Here, the training illustrations only need to be able to detect the characteristics of the pictures created by the illustrators, and may include paintings, etc. Server 2 generates an illustration generation model (a program for generating illustrations) for each illustrator by using machine learning with the training illustrations set for each illustrator.

[0011] Server 2 generates illustrations that reflect the individuality of each illustrator by using illustration generation models specific to each illustrator. Server 2 creates an illustration generation model for each illustrator and maintains the created illustration generation models for each illustrator. Server 2 generates illustrations according to the illustration generation conditions (user requests) specified by the user, using the illustration generation model of the illustrator specified by the user. Server 2 stores the illustrations generated according to the user's requests using the illustration generation model of the illustrator specified by the user in storage and provides them to the user upon request.

[0012] The MFP3 is an image forming apparatus that forms images on a medium. The MFP3 has the ability to form images not only on paper but also on various special media. The MFP3 communicates with Server 2 and obtains images such as illustrations from Server 2. For example, the MFP3 obtains an illustration generated according to the user's request from Server 2 and prints the illustration obtained from Server 2 onto the special media specified by the user.

[0013] User terminal 4 is a terminal device operated by the user. User terminal 4 can be any information processing device that communicates with server 2 via a network. For example, user terminal 4 may be a personal computer (PC), or it may be a mobile device such as a smartphone or tablet PC.

[0014] Next, the configuration of the server 2 in the image forming system 1 according to the embodiment will be described. FIG. 2 is a block diagram schematically showing a configuration example of the server 2 in the image forming system 1 according to the embodiment. As shown in FIG. 2, the server 2 is composed of a processor 11, a system memory 12, a communication interface (I / F) 13, a storage unit 14, and the like.

[0015] The processor 11 executes various processes by executing a program. The processor 11 is, for example, a CPU (Central Processing Unit). The processor 11 executes various processes described later by executing a program stored in the system memory 12 or the storage unit 14.

[0016] The system memory 12 includes memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an NVM. The RAM functions as a working memory or a buffer memory. The ROM is a non-rewritable non-volatile memory. The ROM functions as a program memory. The NVM is a rewritable non-volatile memory. The NVM stores programs, setting data, and the like.

[0017] The communication I / F 13 is an interface for performing data communication with an external device. The communication I / F 13 includes an interface for communicating with the MFP 3 and the user terminal 4 via a network. The communication I / F 13 may include an interface for wireless communication or may include an interface for wired communication.

[0018] The storage unit 14 is composed of a rewritable non-volatile memory. For example, the storage unit 14 is composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 14 stores various setting information, image data such as illustrations, and data such as various programs. For example, the storage unit 14 is a memory for storing user information. The storage unit 14 is also a storage device for storing image data as an illustration generated under conditions specified by the user.

[0019] Furthermore, the storage unit 14 of the server 2 according to this embodiment stores the illustration generation models created for each illustrator, which will be described later. In Figure 2, A model 141, B model 142, and C model 143 are shown as examples of illustration generation models for each illustrator. A model 141 is the illustration generation model for illustrator A, which is created by the model creation process described later. B model 142 is the illustration generation model for illustrator B, and C model 143 is the illustration generation model for illustrator C.

[0020] Next, the configuration of the MFP3 as an image forming apparatus in the image forming system 1 according to the embodiment will be described. Figure 3 is a schematic cross-sectional view showing an example of the configuration of an MFP3 as an image forming apparatus in the image forming system 1 according to the embodiment. As shown in Figure 3, the MFP3 includes a printer 20, a scanner 30, and an operation panel 40, among other things.

[0021] The scanner 30 is installed on top of the MFP3 main unit. The scanner 30 is a device that optically reads images from a document. The scanner 30 has a document glass on which the document to be scanned is placed. The scanner 30 has an image reading mechanism for scanning the document on the document glass. The image reading mechanism of the scanner 30 consists of a carriage and a photoelectric converter unit installed below the document glass. The scanner 30 may also be equipped with an automatic document feeder (ADF).

[0022] The printer 20 has paper feed cassettes 211, 212, 213, and 214. These paper feed cassettes 211, 212, 213, and 214 store media such as paper on which images are formed. The manual feed tray 22 is a supply unit that supplies the set media to the printer 20. The media stored in the paper feed cassettes 211, 212, 213, and 214 can be any media that can be transported by the transport system described later. For example, each paper feed cassette 211, 212, 213, and 214 is detachable from the bottom of the digital multifunction printer body.

[0023] Furthermore, the printer 20 has a manual feed tray 22. The manual feed tray 22 holds media such as paper on which an image is formed. The manual feed tray 22 is a supply unit that supplies the set media to the printer 20. Any media that can be transported by the transport system described later is acceptable to be placed in the manual feed tray 22.

[0024] Each paper feed cassette 211, 212, 213, and 214 has a paper feed roller 231, 232, 233, and 234, respectively. Each paper feed roller 231, 232, 233, and 234 takes out one sheet of media at a time from each paper feed cassette 211, 212, 213, and 214. The manual feed tray 22 also has a paper feed roller 235. The paper feed roller 235 takes out one sheet of media at a time from the manual feed tray 22.

[0025] The paper feed cassettes 211, 212, 213, and 214, which act as supply units, are each loaded with various media (Pa, Pb, Pc, and Pd) on which the printer 20 can print images. The manual feed tray 22, also acting as a supply unit, is loaded with media on which the printer 20 can print images. The types of media that can be loaded into the paper feed cassettes 211, 212, 213, 214 and the manual feed tray 22 are predetermined. For example, some media cannot be stored in the paper feed cassettes 211-214 but can be loaded into the manual feed tray 22.

[0026] The transport system (transport mechanism) 23 transports the medium (hereinafter referred to as paper) within the printer 20. The transport system 23 is composed of multiple transport rollers. The transport system 23 transports the paper picked up by the paper feed rollers 231, 232, 233, 234, and 235 using transport rollers provided at various points along the transport path. The transport rollers that make up the transport system 23 include a registration roller 24. The registration roller 24 is provided on the transport path just before the image transfer position where an image is transferred to the paper. The registration roller 24 supplies the paper to the image transfer position at the timing of image transfer.

[0027] The image forming unit 25 is composed of multiple image forming units 251, 252, 253, and 254. Each of the multiple image forming units 251, 252, 253, and 254 forms an image using the toner set in each unit. For example, each of the image forming units 251, 252, 253, and 254 forms an image using yellow, magenta, cyan, and black toners, respectively.

[0028] The exposure device 26 forms electrostatic latent images as images to be developed in each color on each image carrier in each image forming unit 251, 252, 253, and 254. The exposure device 26 forms electrostatic latent images on the image carrier by scanning it with light emitted according to the image data. For example, the exposure device 26 scans the photosensitive drum, which serves as the image carrier, in the main scanning direction by irradiating it with light emitted from the light-emitting unit via a rotating polygon mirror. The irradiation position of the light from the exposure device 26 moves in the sub-scanning direction as the photosensitive drum rotates. The position and magnification of the image formed by the image forming unit 25 are adjusted by controlling the exposure device 26.

[0029] Each image forming unit 251, 252, 253, and 254 develops the electrostatic latent image on each image carrier with its respective color (yellow, magenta, cyan, and black) toner. The intermediate transfer belt 27 is an intermediate transfer body. Each image forming unit 25 transfers the toner images of each color developed with their respective toners on their respective image carriers onto the intermediate transfer belt 27 (primary transfer).

[0030] The intermediate transfer belt 27 holds the transferred toner image and sends it to the secondary transfer position (image transfer position on the paper). The secondary transfer position is the position where the toner image on the intermediate transfer belt 27 is transferred to the paper. The secondary transfer position is the position where one support roller supporting the intermediate transfer belt 27 and the secondary transfer roller 28 face each other. The secondary transfer roller 28 and the support roller facing the secondary transfer roller constitute the image transfer section. The registration roller 24 transports the paper to the secondary transfer position in time with the toner image on the intermediate transfer belt 27. The transfer section, consisting of the secondary transfer roller 28 and the support roller, transfers the toner image held on the intermediate transfer belt 27 to the paper at the secondary transfer position (image transfer position).

[0031] For example, when forming a color image, each image forming unit 251, 252, 253, and 254 transfers toner images developed with each color (yellow, magenta, cyan, and black) onto the intermediate transfer belt 27. The intermediate transfer belt 27 holds the color image formed by the overlapping toner images of each color. The transfer unit 28 transfers the color image formed by the multiple toners on the intermediate transfer belt 27 to the paper at the secondary transfer position. The registration roller 24 transports the paper to the secondary transfer position in time with the toner image on the intermediate transfer belt 27. As a result, the color image is transferred to the paper.

[0032] The transfer unit, consisting of a secondary transfer roller 28 and a support roller, supplies the paper onto which the toner image has been transferred to the fuser unit 29. The fuser unit 29 fixes the toner image to the paper. The fuser unit 29 includes a heating unit, a heat roller, and a pressure roller. The heating unit heats the heat roller. The heat roller and pressure roller perform a fixing process on the paper onto which the toner image has been transferred by the transfer unit by heating under pressure. The paper that has been fixed by the heat roller and pressure roller in the fuser unit 29 is transported via transport rollers to the output tray or duplex unit.

[0033] The output tray is a platform from which printed media, including image transfer and fixing processes, are ejected. Furthermore, the double-sided unit resupplies the medium, after image formation has been completed on the first side (front), in a state where image formation is possible on the second side (back). For example, the double-sided unit reverses the front and back sides of the medium by switching it back using a roller or the like, and resupplies it to the resist roller 24.

[0034] The operation panel 40 is the user interface. The operation panel 40 displays instructions and accepts input to the operation buttons. For example, the user inputs setting information on the operation panel 40. The operation panel 40 has a display unit (display device) 41 and an operation unit (input device) 42. For example, the display unit 41 and the operation unit 42 are made up of display devices with touch panels. The touch panel, which is the operation unit 42, is provided on the display screen of the display device, which is the display unit 41. The touch panel, which is the operation unit 42, detects the area on the display screen of the display unit 41 that the user touches.

[0035] Next, we will explain the configuration of the control system in the MFP3, which is configured as described above. Figure 4 is a block diagram illustrating an example of the control system configuration in the MFP3 according to this embodiment. The MFP3 has a system control unit (controller) 50 that controls the entire device. The system control unit 50 is connected to the scanner 30, printer 20, and operation panel 40. In the configuration example shown in Figure 4, the system control unit 50 includes a processor 51, memory 52, image memory 53, image processing unit 54, storage device 55, and communication interface (I / F) 56, etc.

[0036] The processor 51 controls each part of the system control unit 50 and performs various data processing. The processor 51 realizes various processing functions by executing programs stored in the memory 52 or storage device 55. For example, by executing programs stored in the memory 52, the processor 51 outputs operation instructions to each part and processes various information from each part. The processor 51 also connects to the processors 61 of the scanner 30 and printer 20, and the processor 71 of the operation panel 40 via interfaces, etc.

[0037] Memory 52 includes RAM (Random Access Memory), ROM (Read-Only Memory), and NVM (Non-Variable Memory). RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. NVM is rewritable, non-volatile memory. NVM stores configuration data, etc. The image memory 53 stores image data. For example, the image memory 53 functions as a page memory for expanding the image data to be processed.

[0038] The image processing unit 54 processes the image data. For example, the image processing unit 54 outputs image data that has undergone image processing such as correction, compression, or decompression on the input image data. For example, the image processing unit 54 may also include an image processing processor. The image processing unit 54 may also perform image processing on the image for printing according to the characteristics of the medium, such as special paper on which the image is printed.

[0039] The storage device 55 stores data such as control data, control programs, and configuration information. The storage device 55 is composed of rewritable, non-volatile memory. For example, the storage device 55 is composed of a storage device such as an HDD (hard disk drive) or an SSD (solid state drive).

[0040] Communication I / F56 is an interface for data communication with external devices. Communication I / F56 includes an interface for communicating with Server 2 via a network. It may also include an interface for connecting to User Terminal 4. Furthermore, Communication I / F56 may include an interface for communicating with external devices on the local area network.

[0041] Next, we will describe an example of the control system configuration in printer 20. As shown in Figure 4, the printer 20 includes a processor 61, memory 62, transport system 23, image forming unit 25, exposure unit 26, transfer unit 28, and fuser 29. The processor 61 performs various processes by executing programs stored in the memory 62. For example, the processor 61 controls the operation of various parts within the printer 20 and monitors the operating status of each part by executing programs. The processor 61 is also connected to the processor 51 of the system control unit 50 via an interface. The processor 61 performs print processing and other operations in response to operation instructions from the system control unit 50.

[0042] Memory 62 includes various types of memory, such as RAM (Random Access Memory), ROM (Read-Only Memory), and data memory. RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. Data memory is rewritable, non-volatile memory.

[0043] The transport system 23 transports paper within the printer 20 under the control of the processor 61. The transport system 23 drives the paper feed rollers 231, 232, 233, 234, and 235 located in the paper feed cassette 21 (211, 212, 213, 214) or manual feed tray 22, which contain the paper selected by the user, in response to operation instructions from the processor 61. By driving the transport rollers in each part, the transport system 23 transports the paper picked up by the specific paper feed rollers 231, 232, 233, 234, and 235.

[0044] The exposure apparatus 26 irradiates each photoreceptor drum of the image forming unit 25 with light (laser light) to form an electrostatic latent image, in response to operation instructions from the processor 61. The processor 61 adjusts the printing position and magnification by controlling the irradiation position of the laser light on the photoreceptor drum by the exposure apparatus 26. The processor 61 performs image adjustment by operation control according to the printing range, starting from the printing reference described later, so that the desired printing range is achieved.

[0045] Each image forming unit 25 (251, 252, 253, 254) develops the electrostatic latent image formed on the photoreceptor drum with toner of each color in accordance with the operation instructions from the processor 61. The image forming unit 25 also transfers the toner formed on the photoreceptor drum to the intermediate transfer belt 27 (primary transfer).

[0046] The transfer roller, acting as the transfer unit 28, transfers the toner image transferred to the intermediate transfer belt 27 to the paper (secondary transfer) in response to operation instructions from the processor 61. The fuser unit 29 drives the heat roller and pressure roller in response to operation instructions from the processor 61. The heating unit of the fuser unit 29 also raises the surface temperature of the heat roller to the desired fixing temperature in accordance with the control of the processor 61. When the fuser unit 29 is controlled to the fixing temperature, it fixes the toner image transferred to the paper to the paper.

[0047] Next, we will describe an example of the control system configuration in the operation panel 40. As shown in Figure 4, the operation panel 40 includes a processor 71, memory 72, display unit (display device) 41, and operation unit (input device) 42, among others. The processor 71 performs various processes by executing programs stored in the memory 72. For example, the processor 71 controls the operation of each part of the operation panel 40 and monitors the operating status of each part by executing programs. The processor 71 is also connected to the processor 51 of the system control unit 50 via an interface. For example, the processor 71 notifies the system control unit 50 of information entered by the user.

[0048] Memory 72 includes various types of memory, such as RAM (Random Access Memory), ROM (Read-Only Memory), and data memory. RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. Data memory is rewritable, non-volatile memory.

[0049] The display unit 41's display content is controlled according to operation instructions from the processor 71. The touch panel, which functions as the operation unit 42, is provided on the display screen of the display unit 41 and detects the touch position on the display screen. For example, the processor 71 displays icons that can be selected on the operation unit (touch panel) 42 on the display screen of the display unit 41 along with operation guidance. The processor 71 determines the information to be entered by the user according to the touch position detected by the touch panel, which functions as the operation unit 42. The operation panel 40 may also be provided with operation buttons such as hard keys such as a start key and a reset key.

[0050] Next, we will describe the model creation process in which the server 2 in the image forming system 1 according to the embodiment creates an illustration generation model for each illustrator. Figure 5 is a schematic diagram showing the model creation process in the image forming system 1 according to the embodiment, in which the server 2 creates an illustration generation model for each illustrator. Here, Server 2 will implement a service (illustration provision service) that provides users with automatically generated illustrations according to their requests. Service providers that provide illustrations using Server 2 will enter into agreements with individual illustrators regarding the provision of illustrations. Illustrators will agree with the service provider to provide automatically generated illustrations that reflect the characteristics of the illustrations they have created to third parties (users).

[0051] Server 2 obtains a set of training illustrations from an illustrator with whom an agreement (agreement for illustration provision) has been made in advance. In the example shown in Figure 5, Server 2 obtains a set of training illustrations provided by illustrator A, with whom an agreement for illustration provision has been made. Server 2 creates Model A 141 as an illustration generation model (generative AI model) through machine learning using the set of illustrations obtained from illustrator A. Server 2 stores the created Model A in the storage unit 14.

[0052] Model A141 is an AI that automatically generates illustrations that reflect the characteristics of illustrations created by illustrator A (a group of training illustrations). As an illustration generation model, Model A141 generates illustrations that reflect the characteristics of illustrations created by illustrator A, according to various specified illustration generation conditions (situation, background, text, printing medium, etc.). In other words, Model A141 is a program that creates illustrations with characteristics similar to those created by illustrator A, according to the user's requests.

[0053] The service provider operating Server 2 similarly enters into agreements with illustrators B and C for the provision of illustrations. Server 2 creates illustration generation models B model 142 and C model 143 through machine learning using the training illustration sets provided by illustrators B and C. As a result, Server 2 stores the individual illustration generation models for illustrators A, B, and C, A model 141, B model 142, and C model 143, in the storage unit 14.

[0054] Next, we will describe the model creation process flow in the image forming system according to the embodiment, where Server 2 creates an illustration generation model for each illustrator. Figure 6 is a sequence illustrating the model creation process in the image forming system according to the embodiment, in which Server 2 creates an illustration generation model for each illustrator. First, the service provider operating Server 2 enters into an agreement with individual illustrators regarding the provision of illustrations (ACT 11). The processor 11 of Server 2 requests the illustrators with whom it has entered into an agreement to provide a set of illustrations for training (ACT 12). For example, the processor 11 of Server 2 sends a request to the illustrator's contact information for the provision of several illustrations necessary to create an illustration generation model for that illustrator.

[0055] An illustrator who has been requested to provide illustrations supplies data of the learning illustration set (illustration data) to Server 2 using an information processing device (or storage medium) that can connect to Server 2. The processor 11 of Server 2 acquires the illustration data provided by the illustrator (ACT 13).

[0056] For example, an illustrator inputs illustration data into an information processing device connected to server 2 via a network, and the information processing device transmits the illustration data to server 2. In this case, server 2 acquires the illustration data from the information processing device operated by the illustrator via the communication interface 13. Alternatively, the illustrator may submit a storage medium or portable storage device that is readable by server 2 and contains the illustration data. In this case, server 2 should be configured to read the illustration data from the storage medium or portable storage device submitted by the illustrator.

[0057] When the processor 11 of server 2 acquires illustration data as a set of training illustrations, it creates an illustration generation model (generative AI model) using machine learning with the training illustration set (ACT 14). The illustration generation model is an AI program that generates illustrations in the style of an illustrator according to the input illustration generation conditions. The processor 11 of server 2 stores the created illustration generation model in the memory unit 14, associating it with the illustrator information (ACT 15).

[0058] The processor 11 of server 2 executes the model creation process described above for each illustrator who has entered into an agreement to provide illustrations. As a result, the storage unit 14 of server 2 stores the illustration generation model of each illustrator. Server 2 may also update the illustration generation models of each illustrator as needed. For example, when processor 11 updates an illustration generation model, it requests the illustrator to provide additional training illustrations. Processor 11 can then update the illustrator's illustration generation model by performing machine learning using the additional training illustrations obtained from the illustrator.

[0059] Next, we will describe the illustration generation process in which the server 2 in the image forming system 1 according to the embodiment generates an illustration using an illustration generation model. Figure 7 is a schematic diagram showing the illustration generation process in the image forming system 1 according to the embodiment, in which the server 2 generates an illustration using an illustration generation model. First, the user registers an account to receive the illustration service. For example, the user connects to the server 2 using the user terminal 4 and registers their user information for the illustration service. The server 2 stores the user information of the registered user (e.g., authentication information such as user ID and password) in the storage unit 14. Once the user information has been registered by the server 2, the user is ready to receive the illustration service.

[0060] Once user registration is complete, users who wish to use the illustration provision service enter their user information using user terminal 4. User terminal 4 sends a login request to server 2 for the illustration provision service using the user information entered by the user. Server 2 performs user authentication using the user information received from user terminal 4 along with the login request. If user authentication is successful, server 2 sets the user terminal to a logged-in state.

[0061] Note that when a user receives the illustration provision service, they may log in to server 2 from MFP3 instead of user terminal 4. In this case, the processing on user terminal 4 described later should be performed by MFP3. However, here we will explain the illustration generation process assuming that the user logs in to server 2 using user terminal 4.

[0062] When user terminal 4 logs in to server 2 (illustration generation service), it accepts the selection of an illustrator and the user's request. For example, to allow the user to select an illustrator, user terminal 4 obtains a list of available illustrators from server 2. User terminal 4 accepts the selection of an illustrator from the list of available illustrators obtained from server 2. Once user terminal 4 has selected (specified) an illustrator for the illustration the user wants to generate, it sends information indicating the selected illustrator to server 2.

[0063] When Server 2 receives information indicating the illustrator from User Terminal 4, it selects an illustration generation model that generates an illustration reflecting the characteristics of the selected illustrator. If Server 2 has selected an illustration generation model, it accepts user requests for the illustration generation conditions. These requests can include the situation, background, text, and special printing media.

[0064] Furthermore, user terminal 4 accepts input of user requests to be used as illustration generation conditions. For example, user terminal 4 displays an input screen on its display for users to input their requests and accepts the input of requests. When user terminal 4 receives input from the user regarding the illustration they want to generate (illustration generation conditions), it sends information indicating the input user requests to server 2. Note that user terminal 4 may also input the illustration generation conditions (user requests) together with the illustrator.

[0065] When Server 2 receives information indicating the user's request from User Terminal 4, it sets the illustration generation conditions corresponding to the user's request in the illustration generation model of the selected illustrator. Server 2 generates an illustration using the illustration generation model with the conditions set according to the user's request. Server 2 stores the illustration generated using the illustration generation model in the storage unit 14, associating it with the user's user information. As a result, Server 2 can provide the illustration generated according to the user's request, which is stored in the storage unit 14, upon request from the user.

[0066] Next, we will describe the illustration generation process in which the server 2 in the image forming system 1 according to the embodiment generates an illustration using an illustration generation model. Figure 8 is a sequence illustrating the illustration generation process in the image forming system 1 according to the embodiment, in which the server 2 generates an illustration.

[0067] First, the user logs in to the illustration provision service using user terminal 4 (or MFP3). Here, we assume that the user logs in to server 2 from user terminal 4. User terminal 4 (or MFP3) connects to server 2 and accepts user information (authentication information) from the user as part of the login operation to the illustration provision service (ACT31). User terminal 4 sends the user information, including the authentication information entered by the user, to server 2 along with the login request to the illustration provision service (ACT32).

[0068] Server 2 receives a login request for the illustration provision service from user terminal 4 via the communication interface 13. Server 2's processor 11 performs user authentication using user information, including authentication information received along with the login request (ACT33). If user authentication is successful, Server 2's processor 11 puts the user terminal into a logged-in state and sends a notification to user terminal 4 indicating successful authentication (authentication OK).

[0069] When user terminal 4 receives a notification indicating successful authentication, it notifies that login is complete and that server 2 (illustration provision service) is now able to generate illustrations. After logging in to server 2, user terminal 4 requests server 2 to start generating illustrations in response to user input (ACT35).

[0070] Server 2 receives a request from user terminal 4 to start generating an illustration via the illustration provision service through the communication interface 13. Upon receiving the request to start generating an illustration, the processor 11 of Server 2 sends information indicating the selectable illustrators to user terminal 4 (ACT36). For example, as information indicating the selectable illustrators, Server 2 sends information indicating a list of illustrators for which illustration generation models have been created to user terminal 4. Here, the processor 11 of Server 2 sends an illustrator selection screen to user terminal 4, prompting the user to select a specific illustrator from the list of selectable illustrators.

[0071] User terminal 4 displays an Illustrator selection screen on its display based on information obtained from server 2 (ACT37). With the Illustrator selection screen displayed, user terminal 4 accepts the selection of a specific Illustrator. When the Illustrator for the illustration to be generated is selected (specified), user terminal 4 sends information indicating the selected Illustrator to server 2.

[0072] Server 2 receives information from user terminal 4 indicating a specified illustrator via communication interface 13 (ACT 38). Upon receiving the information indicating a specified illustrator, Server 2's processor 11 selects the illustration generation model for the specified illustrator (ACT 39). After selecting the illustration generation model, Server 2's processor 11 accepts the user's requests for the illustration generation conditions (ACT 40). Here, Server 2's processor 11 sends a request input screen to user terminal 4 to accept the user's requests regarding the illustration to be generated.

[0073] When user terminal 4 receives a request input screen from server 2, it displays a request input screen on its display for entering the user's request received from server 2 (ACT41). With the request input screen displayed, user terminal 4 accepts input of the user's request to be used as the illustration generation condition. For example, the user inputs the situation, background, text, and printing medium to user terminal 4 as the request to be used as the illustration generation condition. Once user terminal 4 receives the user's request, it sends the entered user request to server 2 (ACT42).

[0074] Server 2 receives user requests entered on user terminal 4 via communication interface 13 (ACT 42). Upon receiving user requests, Server 2's processor 11 analyzes the user requests to identify illustration generation conditions to be set in the selected illustration generation model (ACT 43). Server 2's processor 11 sets the illustration generation conditions identified from the user requests in the illustration generation model of the selected illustrator.

[0075] The processor 11 of server 2 generates an illustration using an illustration generation model that has been configured with illustration generation conditions according to the user's request (ACT44). The processor 11 of server 2 sends the illustration generated using the illustration generation model to the user terminal 4 for the user to confirm (ACT45). Here, the processor 11 of server 2 sends an illustration confirmation screen displaying the generated illustration to the user terminal 4 for the user to confirm the generated illustration.

[0076] After the user terminal 4 sends a request, it receives an illustration confirmation screen containing the illustration generated by server 2. User terminal 4 displays the illustration confirmation screen received from server 2 on its display (ACT46). While the illustration confirmation screen is displayed, user terminal 4 accepts input indicating whether or not to save the displayed illustration. If user terminal 4 is instructed to save the illustration, it sends a save instruction for the generated illustration to server 2 (ACT47).

[0077] Server 2 receives a save command for the illustration entered by the user terminal 4 via the communication interface 13 (ACT 47). Upon receiving the save command, the processor 11 of Server 2 saves the displayed illustration to the storage unit 14, associating it with information indicating the logged-in user (ACT 45).

[0078] Through the illustration generation process described above, the server according to the embodiment can generate illustrations according to the user's requests using the illustration generation model of an illustrator specified by the user. Furthermore, the server according to the embodiment can store the illustrations generated according to the user's requests in a storage unit (memory device) and provide them upon request from the user.

[0079] Next, we will describe the illustration printing process in which the MFP3 prints the illustration generated by the server 2 on special media in the image forming system 1 according to the embodiment. Figure 9 is a schematic diagram illustrating the illustration printing process in which the MFP3 prints an illustration generated by the server 2 onto special media in the image forming system 1 according to this embodiment. Here, the user prints the illustration generated by the illustration generation process described above onto special media using the MFP3. The user enters user information to log in to Server 2 (illustration provision service) using the operation unit 42 of the MFP3's operation panel 40. For example, the system control unit 50 of the MFP3 sends a login request to Server 2 for the illustration provision service using the user information entered in the operation unit 42. Server 2 performs user authentication using the user information received from the MFP3 along with the login request. If user authentication is successful, Server 2 sets the user to a logged-in state on the MFP3.

[0080] When MFP3 logs into Server 2 (illustration generation service), it accepts the user's request to select an illustration from the generated illustrations to be printed on special media. For example, in order to allow the user to select the illustration to be printed, MFP3 retrieves information on the generated illustrations saved by the user from Server 2. MFP3 accepts the user's selection of the illustration to be printed from the list of selectable illustrations obtained from Server 2. Once the user has selected (specified) the illustration to be printed, MFP3 sends information indicating the selected illustration to Server 2.

[0081] When Server 2 receives information indicating an illustration from MFP3, it downloads the illustration data for the selected illustration to MFP3. When MFP3 obtains the illustration data for the selected illustration from server 2, it accepts the selection of a special media to be used for printing the obtained illustration. For example, MFP3 displays a selection screen for selecting a special media on display unit 41 and accepts the selection of a special media to print the illustration on. When a special media is selected by the operation unit 42, MFP3 executes printing of the illustration on the selected special media.

[0082] Next, we will describe the flow of the illustration printing process in which the MFP3 prints the illustration generated by the server 2 on special media in the image forming system 1 according to the embodiment. Figure 10 is a sequence illustrating the illustration printing process in which the MFP3 prints an illustration generated by the server 2 onto special media in the image forming system 1 according to this embodiment. The user selects illustration printing on the MFP3's control panel 40 to print illustrations stored on server 2 onto special media. When illustration printing is selected, the MFP3's system control unit (controller) 50 connects to server 2 via the communication interface 56.

[0083] When the MFP3's system control unit 50 connects to the server 2, it accepts user information (authentication information) input from the user as a login operation for the illustration provision service (ACT 51). The MFP3's system control unit 50 sends the user information, including the authentication information entered by the user, to the server 2 along with a login request for the illustration provision service (ACT 52).

[0084] Server 2 receives a login request for the illustration provision service from MFP3 via the communication interface 13. The processor 11 of Server 2 performs user authentication using user information, including authentication information received along with the login request (ACT 53). If user authentication is successful, the processor 11 of Server 2 sets the user to a logged-in state and sends a notification to MFP3 indicating successful authentication (authentication OK).

[0085] When the system control unit 50 of the MFP3 receives a successful authentication, it displays an illustration printing screen on the display unit 41, indicating that the user is logged in and that illustration printing is possible (ACT 55). For example, when the illustration printing screen is displayed, the user uses the operation unit 42 to instruct the server 2 to start printing with a pre-generated illustration saved there. The processor 51 of the MFP3 requests the pre-generated illustration from the server 2 in response to the user's instructions and the request of the logged-in user (ACT 56).

[0086] Server 2 receives an illustration request from MFP3 via the communication interface 13, requesting a pre-generated illustration. Upon receiving the illustration request, Server 2's processor 11 extracts an illustration generated according to the request of the logged-in user from the storage unit 14 (ACT 57). For example, the processor 11 searches the storage unit 14 for an illustration associated with the logged-in user. The processor 11 then sends the pre-generated illustration corresponding to the logged-in user (an illustration generated according to the user's request) extracted from the storage unit 14 to MFP3 (ACT 58).

[0087] The system control unit 50 of the MFP3 receives the user's generated illustrations (group of illustrations) transmitted from the server 2 via the communication interface 56. The processor 51 of the system control unit 50 of the MFP3 displays the generated illustrations received from the server 2 on the display unit 41 (ACT 59). With the generated illustrations acquired from the server 2 displayed on the display unit 41, the system control unit 50 accepts a selection instruction for the illustration to be printed (ACT 60). For example, the processor 51 displays a list of multiple illustrations (group of illustrations) received from the server 2 on the display unit 41 and accepts the selection of the illustration to be printed by the operation unit 42.

[0088] When an illustration to be printed is selected, the system control unit 50 of the MFP3 accepts the selection of a special medium to be used as the printing medium for the selected illustration (ACT61). For example, the processor 51 displays a list of special media that can be used to print the illustration (special media selection screen) on the display unit 41 and accepts the selection of a special medium by the operation unit 42.

[0089] The system control unit 50 of the MFP3 processes payment for printing the illustration on the special media when an illustration and special media are selected or when printing is instructed to start (ACT62, 63). For example, the processor 51 calculates the printing fee when the illustration and special media to be printed are confirmed. Once the processor 51 has calculated the printing fee, it accepts the selection of a payment method as part of the payment process (ACT62). Once a payment method is selected, the processor 51 processes the settlement of the fee according to the selected payment method (ACT63). However, if settlement of fees for each printing process is not performed in practice, the processes in ACT62 and 63 may be omitted.

[0090] The system control unit 50 of the MFP3 processes the illustration to be printed according to the selected special media when payment is completed (when printing is confirmed) (ACT64). For example, the processor 51 performs image processing by the image processing unit 54 to correct the image as an illustration to be printed according to the characteristics of the special media. Specifically, the image processing unit 54 may correct the illustration or the background color of the illustration according to the color of the special media. The image processing unit 54 may also correct the density, brightness, or sharpness of the illustration to be printed according to the material of the special media.

[0091] The system control unit 50 of the MFP3 processes the illustration according to the special media, and then prints the processed illustration onto the special media using the printer 20 (ACT65). For example, the printer 20 feeds the selected special media and forms an image on the fed special media as the processed illustration supplied by the system control unit 50.

[0092] As described above, the image forming system according to the embodiment includes a server that generates illustrations according to user requests and an MFP that prints the illustrations generated by the server onto a medium. Thus, the image forming system makes it possible to print illustrations generated in accordance with user requests onto special media.

[0093] Furthermore, in the image forming system according to this embodiment, the server can generate illustrations according to the user's requests using the illustration generation model of an illustrator selected by the user. As a result, by selecting an illustrator, the user can receive a service to print illustrations generated in the style of the selected illustrator onto special media or other media.

[0094] Furthermore, in the image forming system according to the embodiment, the server acquires a set of training illustrations provided by illustrators who have agreed to provide illustrations, and the server creates or updates an illustration generation model for each illustrator by machine learning using the training illustrations provided by the illustrators. As a result, the image forming system can configure an illustration generation model that can generate illustrations that reflect the individuality of the illustrators using the training illustrations from the illustrators.

[0095] Furthermore, in the image forming system according to the embodiment, the server stores the illustrations generated according to the user's request. The MFP retrieves the illustrations generated according to the user's request from the server when the user is able to log in to the server. The MFP prints the illustrations retrieved from the server onto a special medium selected by the user. As a result, the MFP can retrieve pre-generated illustrations from the server according to the user's request and print the illustrations retrieved from the server onto a special medium selected by the user.

[0096] Furthermore, in the image forming system according to the embodiment, the MFP prints the image-processed illustration onto the special medium selected by the user. This allows the MFP to provide the user with an illustration generated according to the user's request, printed in an image-processed state according to the special medium selected by the user.

[0097] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. The following is an appendix to the claims originally filed for this application. [1] An image forming system comprising a server and an image forming apparatus, The aforementioned server, A first communication interface that communicates over a network, The device communicates via the network using the first communication interface and includes a processor that generates illustrations according to illustration generation conditions specified by the user. The image forming apparatus is A second communication interface that communicates with the aforementioned server, A controller that acquires illustrations generated from the server according to the illustration generation conditions via the second communication interface, A printer that prints the illustration acquired from the server onto a medium, Image forming system. [2] The server has memory for storing illustration generation models for each illustrator, and the processor of the server generates illustrations using the illustration generation model of the illustrator specified by the user, according to the illustration generation conditions specified by the user. The image forming system described in [1]. [3] The processor of the server creates an illustration generation model for each illustrator by machine learning using a set of illustrations for each illustrator. The image forming system described in [2]. [4] The server has memory for storing user information, The processor of the server stores the illustrations generated according to the illustration generation conditions specified by the user authenticated by the user information stored in the memory into the storage device. The image forming apparatus has an input device for inputting user operations, The controller of the image forming apparatus, when the user operating the input device is authenticated by the server, retrieves an illustration generated according to the illustration generation conditions specified by the authenticated user from the server, and causes the printer to print the illustration retrieved from the server onto the medium selected by the input device. The image forming system described in [1]. [5] The controller of the image forming apparatus further processes the illustration according to the medium selected by the input device. The image forming system described in [4]. [Explanation of symbols]

[0098] 1…Image forming system, 2…Server, 3…Digital multifunction printer (image forming device), 4…User terminal, 20…Printer, 21…Paper feed cassette, 22…Manual feed tray, 23…Transport system (transport mechanism), 30…Scanner, 40…Operation panel, 41…Display unit, 42…Operation unit (input device), 50…System control unit (controller), 51…Processor, 52…Memory, 53…Image memory, 54…Image processing unit, 55…Storage device, 56…Communication interface.

Claims

1. An image forming system comprising a server and an image forming apparatus, The aforementioned server, A first communication interface that communicates over a network, Memory to store illustration generation models for each illustrator, A device that communicates via the network using the first communication interface has a processor that generates an illustration using an illustration generation model of an illustrator specified by the user and under illustration generation conditions specified by the user, The image forming apparatus is A second communication interface that communicates with the aforementioned server, A controller that acquires an illustration generated from the server according to the illustration generation conditions via the second communication interface, A printer that prints the illustration acquired from the server onto a medium, Image forming system.

2. The processor of the server creates an illustration generation model for each illustrator by machine learning using a set of illustrations for each illustrator. The image forming system according to claim 1.

3. An image forming system comprising a server and an image forming apparatus, The aforementioned server, A first communication interface that communicates over a network, Memory for storing user information, The device communicates via the network using the first communication interface and includes a processor that generates an illustration according to illustration generation conditions specified by a user authenticated by user information stored in the memory, and saves the illustration generated according to the user's specified illustration generation conditions to a storage device. The image forming apparatus is A second communication interface that communicates with the aforementioned server, A printer that prints images onto a medium, An input device for receiving user input, The system includes a controller that, when a user operating the input device is authenticated by the server, retrieves an illustration generated according to the illustration generation conditions specified by the authenticated user from the server via the second communication interface, and causes the printer to print the illustration retrieved from the server onto a medium selected by the input device. Image forming system.

4. The controller of the image forming apparatus further processes the illustration according to the medium selected by the input device. The image forming system according to claim 3.

Images