Image forming system

Abstract

To provide an image forming system capable of printing an illustration according to a user's request on a medium.SOLUTION: According to an embodiment, an image forming system includes a server and an image forming apparatus. The server includes a first communication interface and a processor. The first communication interface performs communication via a network. The processor is configured to generate an illustration using an illustration generation condition specified by a user in a device that performs communication via the network by the first communication interface. The image forming apparatus includes a second communication interface, a controller, and a printer. The second communication interface communicates with the server. The controller is configured to acquire the illustration generated using the illustration generation condition from the server by the second communication interface. The printer prints the illustration acquired from the server on a medium.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Embodiments of the present invention relate to an image forming system.

Background Art

[0002] Some image forming apparatuses such as digital multi-function peripherals have a function of printing images not only on ordinary paper but also on a plurality of types of special media (special media). Conventionally, there is a system that provides a service for printing an image such as a pre-prepared illustration on special media using an image forming apparatus. In such a system, the image forming apparatus prints an image selected by the user from fixed images without prior problems such as copyright on special media. That is, the conventional system has a problem that the image printed on the special media by the image forming apparatus is limited to being selected from pre-prepared fixed images.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to provide an image forming system capable of printing an illustration according to a user's request on a medium in order to solve the above-described problems.

Means for Solving the Problems

[0005] According to an embodiment, an image forming system includes a server and an image forming apparatus. The server includes a first communication interface and a processor. The first communication interface communicates via a network. The processor generates an illustration under illustration generation conditions specified by a user in a device that communicates via the network by the first communication interface. The image forming apparatus includes a second communication interface, a controller, and a printer. The second communication interface communicates with the server. The controller acquires the illustration generated under the illustration generation conditions from the server by the second communication interface. The printer prints the illustration acquired from the server on a medium.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0007] Hereinafter, the present embodiment will be described with reference to the drawings. First, the image forming system 1 according to the embodiment will be schematically described. FIG. 1 is a block diagram schematically showing a configuration example of the image forming system 1 according to the embodiment. As shown in FIG. 1, the image forming system 1 includes a server 2, an MFP (Multi-Functional Peripheral) 3, and a user terminal 4. In the image forming system 1, the server 2 is connected to the MFP 3 and the user terminal 4 via a network.

[0008] The server 2 is a device that provides an illustration (illustration, Illustration) as an image to be printed. The server 2 is a platform (content platform) that provides an illustration to be printed as one piece of content. However, in the present embodiment, the illustration is not limited to a drawing used for commercial purposes, and may include a painting or the like. That is, the illustration according to the present embodiment is a broad sense picture created by a specific author (illustrator).

[0009] Server 2 communicates with the MFP 3 and the user terminal 4 via a network. Server 2 manages information for each account. Server 2 generates illustrations according to requests (illustration generation conditions) from users logged in with a specific account. In addition, Server 2 generates an illustration that reflects the individuality of a specific illustrator designated by the user under the illustration generation conditions designated by the user.

[0010] For example, Server 2 acquires learning illustrations provided by an illustrator who has reached a prior agreement (agreement on providing illustrations to a third party). Here, the learning illustrations only need to be able to detect the characteristics of the pictures created by the illustrator, and may include paintings and the like. Server 2 generates an illustration generation model (program for illustration generation) for each illustrator by performing machine learning using a group of learning illustrations for each illustrator.

[0011] Server 2 can generate an illustration that reflects the individuality of each illustrator by creating an illustration using the illustration generation model for each illustrator. Server 2 creates an illustration generation model for each illustrator and holds the illustration generation model for each created illustrator. Server 2 generates an illustration according to the illustration generation conditions (user requests) designated by the user using the illustration generation model of the illustrator designated by the user. Server 2 stores the illustration generated according to the user's request in the storage device using the illustration generation model of the illustrator designated by the user and provides it in response to a request from the user.

[0012] The MFP 3 is an image forming apparatus that forms an image on a medium. The MFP 3 has a function of forming an image not only on paper but also on various special media. The MFP 3 communicates with Server 2 and acquires images such as illustrations from Server 2. For example, the MFP 3 acquires an illustration generated according to the user's request from Server 2 and prints the illustration acquired from Server 2 on a special media designated by the user.

[0013] The user terminal 4 is a terminal device operated by the user. The user terminal 4 may be any information processing device that communicates with the server 2 via a network. For example, the user terminal 4 may be a personal computer (PC), or may be a mobile terminal such as a smartphone or a tablet PC.

[0014] Next, the configuration of the server 2 in the image forming system 1 according to the embodiment will be described. FIG. 2 is a block diagram schematically showing a configuration example of the server 2 in the image forming system 1 according to the embodiment. As shown in FIG. 2, the server 2 is composed of a processor 11, a system memory 12, a communication interface (I / F) 13, a storage unit 14, and the like.

[0015] The processor 11 executes various processes by executing a program. The processor 11 is, for example, a CPU (Central Processing Unit). The processor 11 executes various processes described later by executing a program stored in the system memory 12 or the storage unit 14.

[0016] The system memory 12 includes memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an NVM. The RAM functions as a working memory or a buffer memory. The ROM is a non-rewritable non-volatile memory. The ROM functions as a program memory. The NVM is a rewritable non-volatile memory. The NVM stores programs, setting data, and the like.

[0017] The communication I / F 13 is an interface for performing data communication with an external device. The communication I / F 13 includes an interface for communicating with the MFP 3 and the user terminal 4 via a network. The communication I / F 13 may include an interface for wireless communication, or may include an interface for wired communication.

[0018] The storage unit 14 is composed of a rewritable non-volatile memory. For example, the storage unit 14 is composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 14 stores various setting information, image data such as illustrations, and data such as various programs. For example, the storage unit 14 is a memory that stores user information. Also, the storage unit 14 is also a storage device that stores image data as an illustration generated under conditions specified by the user.

[0019] Also, the storage unit 14 of the server 2 according to the embodiment is assumed to store an illustration generation model created for each illustrator described later. In FIG. 2, as the illustration generation model for each illustrator, an A model 141, a B model 142, and a C model 143 are exemplified. The A model 141 is assumed to be an illustration generation model of illustrator A created by the model creation process described later. The B model 142 is an illustration generation model of illustrator B, and the C model 143 is an illustration generation model of illustrator C.

[0020] Next, the configuration of the MFP 3 as an image forming apparatus in the image forming system 1 according to the embodiment will be described. FIG. 3 is a cross-sectional view schematically showing a configuration example of the MFP 3 as an image forming apparatus in the image forming system 1 according to the embodiment. As shown in FIG. 3, the MFP 3 includes a printer 20, a scanner 30, an operation panel 40, and the like.

[0021] The scanner 30 is installed on the upper part of the main body of the MFP 3. The scanner 30 is a device that optically reads an image of a document. The scanner 30 has a document table glass on which a document to be scanned is placed. The scanner 30 has an image reading mechanism for scanning a document on the document table glass. The image reading mechanism of the scanner 30 is composed of a carriage and a photoelectric conversion unit installed below the document table glass. Also, the scanner 30 may be provided with an automatic document feeder (ADF: Auto Document Feeder).

[0022] The printer 20 has paper feed cassettes 211, 212, 213, and 214. These paper feed cassettes 211, 212, 213, and 214 store media such as paper on which images are to be formed. The manual tray 22 is a supply unit that supplies the set media to the printer 20. The media stored in the paper feed cassettes 211, 212, 213, and 214 may be any media that can be conveyed by the conveyance system described later. For example, each of the paper feed cassettes 211, 212, 213, and 214 is detachable from the lower part of the digital multi-function machine main body.

[0023] Furthermore, the printer 20 has a manual tray 22. The manual tray 22 places media such as paper on which images are to be formed. The manual tray 22 is a supply unit that supplies the set media to the printer 20. The media set on the manual tray 22 may be any media that can be conveyed by the conveyance system described later.

[0024] Each of the paper feed cassettes 211, 212, 213, and 214 has a paper feed roller 231, 232, 233, and 234, respectively. Each of the paper feed rollers 231, 232, 233, and 234 takes out media one by one from each of the paper feed cassettes 211, 212, 213, and 214. Also, the manual tray 22 has a paper feed roller 235. The paper feed roller 235 takes out the media set on the manual tray 22 one by one.

[0025] Various media Pa, Pb, Pc, and Pd on which the printer 20 can print images are set in the paper feed cassettes 211, 212, 213, and 214 as supply units, respectively. Also, a media on which the printer 20 can print an image is set in the manual tray 22 as a supply unit. The types of media that can be set in the paper feed cassettes 211, 212, 213, and 214 and the manual tray 22 are determined in advance. For example, there are media that cannot be stored in the paper feed cassettes 211 - 214 but can be set in the manual tray 22.

[0026] The conveyance system (conveyance mechanism) 23 conveys a medium (hereinafter referred to as paper) within the printer 20. The conveyance system 23 is composed of a plurality of conveyance rollers and the like. The conveyance system 23 conveys the paper taken out by the paper feed rollers 231, 232, 233, 234, 235 by the conveyance rollers provided at various positions on the conveyance path. The conveyance rollers constituting the conveyance system 23 include the registration roller 24. The registration roller 24 is provided in front of the image transfer position where an image is transferred onto the paper on the conveyance path. The registration roller 24 supplies the paper to the image transfer position at the timing of transferring the image.

[0027] The image forming unit 25 is composed of a plurality of image forming units 251, 252, 253, 254. The plurality of image forming units 251, 252, 253, 254 form images with the toner set in each of them. For example, the image forming units 251, 252, 253, 254 form images with toner of yellow, magenta, cyan, and black colors respectively.

[0028] The exposure device 26 forms an electrostatic latent image as an image to be developed in each color on each image carrier in each of the image forming units 251, 252, 253, 254. The exposure device 26 forms an electrostatic latent image on the image carrier by scanning the image carrier with light that emits according to the image data. For example, the exposure device 26 irradiates the photosensitive drum as the image carrier through a polygon mirror that rotates the light emitted from the light emitting unit, thereby scanning in the main scanning direction. Also, the irradiation position of the light from the exposure device 26 moves in the sub-scanning direction as the photosensitive drum rotates. The position and magnification of the image formed by the image forming unit 25 are adjusted by controlling the exposure device 26.

[0029] Each of the image forming units 251, 252, 253, 254 develops the electrostatic latent image on each image carrier with toner of each color (yellow, magenta, cyan, black). The intermediate transfer belt 27 is an intermediate transfer member. Each image forming unit 25 transfers (performs primary transfer) the toner images of each color developed with toner of each color on each image carrier onto the intermediate transfer belt 27.

[0030] The intermediate transfer belt 27 holds the transferred toner image and conveys it to the secondary transfer position (the image transfer position onto the paper). The secondary transfer position is the position where the toner image on the intermediate transfer belt 27 is transferred onto the paper. The secondary transfer position is the position where one support roller that supports the intermediate transfer belt 27 and the secondary transfer roller 28 face each other. The secondary transfer roller 28 and the support roller facing the secondary transfer roller constitute the image transfer unit. The registration roller 24 conveys the paper to the secondary transfer position in synchronization with the toner image on the intermediate transfer belt 27. The transfer unit composed of the secondary transfer roller 28 and the support roller transfers the toner image held on the intermediate transfer belt 27 onto the paper at the secondary transfer position (image transfer position).

[0031] For example, when forming a color image, each image forming unit 251, 252, 253, and 254 transfers the toner images developed with toners of respective colors (yellow, magenta, cyan, black) onto the intermediate transfer belt 27 in an overlapping manner. The intermediate transfer belt 27 holds the color image in which the toner images of respective colors overlap. The transfer unit 28 transfers the color image formed by the toners of multiple colors on the intermediate transfer belt 27 onto the paper at the secondary transfer position. The registration roller 24 conveys the paper to the secondary transfer position in synchronization with the toner image on the intermediate transfer belt 27. As a result, the color image is transferred onto the paper.

[0032] The transfer unit composed of the secondary transfer roller 28 and the support roller supplies the paper onto which the toner image has been transferred to the fuser 29. The fuser 29 fixes the toner image onto the paper. The fuser 29 includes a heating unit, a heat roller, a pressure roller, and the like. The heating unit heats the heat roller. The heat roller and the pressure roller perform a fixing process of heating the paper onto which the toner image has been transferred by the transfer unit under pressure. The paper that has undergone the fixing process by the heat roller and the pressure roller in the fuser 29 is conveyed to the paper discharge tray or the duplex unit via the conveying roller.

[0033] The paper discharge tray is a platform where the medium that has completed the printing process including image transfer and fixing processes is discharged. Further, the duplex unit re-supplies the medium on which image formation on the first surface (front surface) has been completed in a state where image formation can be performed on the second surface (back surface). For example, the duplex unit reverses the front and back of the medium by switching back the medium after the fixing process using a roller or the like and re-supplies it to the resist roller 24.

[0034] The operation panel 40 is a user interface. The operation panel 40 displays guidance and accepts input to operation buttons. For example, the user inputs setting information on the operation panel 40. The operation panel 40 has a display unit (display device) 41 and an operation unit (input device) 42. For example, the display unit 41 and the operation unit 42 are configured by a display device with a touch panel. The touch panel as the operation unit 42 is provided on the display screen of the display device as the display unit 41. The touch panel as the operation unit 42 detects the part touched by the user on the display screen of the display unit 41.

[0035] Next, the configuration of the control system in the MFP 3 configured as described above will be described. FIG. 4 is a block diagram for explaining a configuration example of the control system in the MFP 3 according to the embodiment. The MFP 3 has a system control unit (controller) 50 that controls the entire apparatus. The system control unit 50 is connected to the scanner 30, the printer 20, and the operation panel 40. In the configuration example shown in FIG. 4, the system control unit 50 includes a processor 51, a memory 52, an image memory 53, an image processing unit 54, a storage device 55, and a communication interface (I / F) 56, and the like.

[0036] The processor 51 controls each part in the system control unit 50 and performs various data processes. The processor 51 realizes various processing functions by executing programs stored in the memory 52 or the storage device 55. For example, the processor 51 outputs operation instructions to each part and processes various information from each part by executing the programs stored in the memory 52. Also, the processor 51 is connected to the processor 61 of the scanner 30, the printer 20, and the processor 71 of the operation panel 40 via an interface or the like.

[0037] The memory 52 includes memories such as RAM (Random Access Memory), ROM (Read Only Memory), and NVM. The RAM functions as a working memory or a buffer memory. The ROM is a non-rewritable non-volatile memory. The ROM functions as a program memory. The NVM is a rewritable non-volatile memory. The NVM stores setting data and the like. The image memory 53 stores image data. For example, the image memory 53 functions as a page memory for expanding the image data to be processed.

[0038] The image processing unit 54 processes image data. The image processing unit 54 outputs, for example, image data obtained by performing image processes such as correction, compression, or expansion on the input image data. For example, the image processing unit 54 may include a processor for image processing. The image processing unit 54 may perform image processing on the printing image according to the characteristics of a medium such as special paper for printing an image.

[0039] The storage device 55 stores data such as control data, control programs, and setting information. The storage device 55 is composed of a rewritable non-volatile memory. For example, the storage device 55 is composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0040] The communication I / F 56 is an interface for performing data communication with an external device. The communication I / F 56 includes an interface for communicating with the server 2 via a network. Also, the communication I / F 56 may include an interface for communicatively connecting to the user terminal 4. Further, the communication I / F 56 may include an interface for communicating with an external device of a local area network.

[0041] Next, a configuration example of the control system in the printer 20 will be described. As shown in FIG. 4, the printer 20 includes a processor 61, a memory 62, a conveyance system 23, an image forming unit 25, an exposure device 26, a transfer unit 28, a fixing device 29, and the like. The processor 61 realizes various processes by executing a program stored in the memory 62. For example, the processor 61 performs operation control of each unit within the printer 20 and monitoring of the operation status of each unit by executing a program. Also, the processor 61 is connected to the processor 51 of the system control unit 50 via an interface. The processor 61 executes print processing and the like in response to an operation instruction from the system control unit 50.

[0042] The memory 62 includes memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a data memory. The RAM functions as a working memory or a buffer memory. The ROM is a non-rewritable non-volatile memory. The ROM functions as a program memory. The data memory is a rewritable non-volatile memory.

[0043] The conveyance system 23 conveys paper within the printer 20 under the control of the processor 61. The conveyance system 23 drives the paper feed rollers 231, 232, 233, 234, 235 provided in the paper feed cassette 21 (211, 212, 213, 214) or the manual feed tray 22 in which the paper selected by the user is stored in response to an operation instruction from the processor 61. The conveyance system 23 conveys the paper picked up by the specific paper feed rollers 231, 232, 233, 234, 235 by driving the conveyance rollers of each part.

[0044] The exposure device 26 irradiates light (laser light) for forming an electrostatic latent image on each photosensitive drum of the image forming unit 25 in response to an operation instruction from the processor 61. The processor 61 adjusts the printing position, magnification, etc. by controlling the irradiation position of the laser light on the photosensitive drum by the exposure device 26. The processor 61 executes image adjustment so as to obtain a desired printing range by operation control according to the printing range starting from the printing reference described later.

[0045] Each image forming unit 25 (251, 252, 253, 254) develops the electrostatic latent image formed on the photosensitive drum with toner of each color in response to an operation instruction from the processor 61. Further, the image forming unit 25 transfers (primary transfer) the toner formed on the photosensitive drum to the intermediate transfer belt 27.

[0046] The transfer roller as the transfer unit 28 transfers (secondary transfer) the toner image transferred to the intermediate transfer belt 27 to the paper in response to an operation instruction from the processor 61. The fixing device 29 drives the heat roller and the pressure roller in response to an operation instruction from the processor 61. Further, the heating unit of the fixing device 29 sets the surface temperature of the heat roller to a desired fixing temperature according to the control by the processor 61. The fixing device 29 fixes the toner image transferred to the paper to the paper in a state where it is controlled to the fixing temperature.

[0047] Next, a configuration example of the control system in the operation panel 40 will be described. As shown in FIG. 4, the operation panel 40 includes a processor 71, a memory 72, a display unit (display device) 41, an operation unit (input device) 42, and the like. The processor 71 realizes various processes by executing programs stored in the memory 72. For example, the processor 71 controls the operations of each part of the operation panel 40 and monitors the operation status of each part by executing programs. Further, the processor 71 is connected to the processor 51 of the system control unit 50 via an interface. For example, the processor 71 notifies the system control unit 50 of information input by the user.

[0048] The memory 72 includes memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a data memory. The RAM functions as a working memory or a buffer memory. The ROM is a non-rewritable non-volatile memory. The ROM functions as a program memory. The data memory is a rewritable non-volatile memory.

[0049] The display content of the display unit 41 is controlled according to the operation instructions from the processor 71. The touch panel as the operation unit 42 is provided on the display screen of the display unit 41 and detects the touched position on the display screen. For example, the processor 71 displays icons selectable by the operation unit (touch panel) 42 on the display screen of the display unit 41 together with operation guides. The processor 71 discriminates information input by the user according to the touch position detected by the touch panel as the operation unit 42. Further, the operation panel 40 may be provided with operation buttons such as hard keys such as a start key and a reset key.

[0050] Next, the model creation process in which the server 2 in the image forming system 1 according to the embodiment creates an illustration generation model for each illustrator will be described. FIG. 5 is a diagram schematically showing the model creation process in which the server 2 in the image forming system 1 according to the embodiment creates an illustration generation model for each illustrator. Here, it is assumed that the server 2 provides a service (illustration providing service) that provides the user with illustrations automatically generated according to the user's requests. A service provider that provides illustrations using the server 2 makes agreements regarding illustration provision with individual illustrators. The illustrator agrees with the service provider to provide a third party (user) with automatically generated illustrations that reflect the characteristics of the illustrations created by the illustrator himself / herself.

[0051] The server 2 acquires a group of learning illustrations from an illustrator with whom a prior agreement (agreement regarding illustration provision) has been made. In the example shown in FIG. 5, the server 2 acquires a group of learning illustrations provided by Illustrator A with whom an agreement regarding illustration provision has been made. The server 2 creates a Model A 141 as an illustration generation model (generative AI model) through machine learning using the group of illustrations acquired from Illustrator A. The server 2 stores the created Model A in the storage unit 14.

[0052] Model A 141 is an AI that automatically generates illustrations that reflect the characteristics of the illustrations (group of learning illustrations) created by Illustrator A. Model A 141 as an illustration generation model generates illustrations that reflect the characteristics of the illustrations created by Illustrator A according to various specified illustration generation conditions (situations, backgrounds, characters, media to be printed, etc.). In other words, Model A 141 is a program that creates illustrations with characteristics similar to those created by Illustrator A according to the user's requests.

[0053] Similarly, the service provider operating the server 2 also makes agreements regarding illustration provision with both Illustrator B and Illustrator C. The server 2 creates a Model B 142 and a Model C 143 as illustration generation models through machine learning using the groups of learning illustrations provided by Illustrator B and C. As a result, the server 2 stores Model A 141, Model B 142, and Model C 143 as illustration generation models for individual illustrators A, B, and C in the storage unit 14.

[0054] Next, the flow of the model creation process in which the server 2 in the image forming system according to the embodiment creates an illustration generation model for each illustrator will be described. FIG. 6 is a sequence for explaining the model creation process in which the server 2 in the image forming system according to the embodiment creates an illustration generation model for each illustrator. First, a service provider operating the server 2 makes an agreement regarding illustration provision with each individual illustrator (ACT11). The processor 11 of the server 2 requests the provision of a group of learning illustrations to the illustrator with whom the illustration provision agreement has been made (ACT12). For example, the processor 11 of the server 2 transmits a request for the provision of a plurality of illustrations necessary for creating an illustration generation model for the illustrator to the contact information of the illustrator.

[0055] The illustrator that has received the request for illustration provision supplies data (illustration data) of a group of learning illustrations to the server 2 using an information processing device (or storage medium) connectable to the server 2. The processor 11 of the server 2 acquires the illustration data provided by the illustrator (ACT13).

[0056] For example, the illustrator inputs illustration data into an information processing device connected to the server 2 via a network and transmits the illustration data from the information processing device to the server 2. In this case, the server 2 acquires the illustration data from the information processing device operated by the illustrator through the communication interface 13. Further, the illustrator may submit a storage medium or a portable storage device readable by the server 2 storing the illustration data. In this case, the server 2 may be configured to read the illustration data from the storage medium or the portable storage device submitted by the illustrator.

[0057] When the processor 11 of server 2 acquires illustration data as a group of learning illustrations, it creates an illustration generation model (generative AI model) by machine learning using the group of learning illustrations (ACT14). The illustration generation model is an AI program that generates illustrations in the style of an illustrator according to the input illustration generation conditions. The processor 11 of server 2 stores the created illustration generation model in the storage unit 14 in association with the illustrator information (ACT15).

[0058] The processor 11 of server 2 executes the above-described model creation process for each individual illustrator that has concluded an agreement for illustration provision. As a result, the illustration generation models of each illustrator are stored in the storage unit 14 of server 2. Note that server 2 may appropriately update the illustration generation model of each illustrator. For example, when updating the illustration generation model, the processor 11 requests the illustrator to provide an additional group of learning illustrations. The processor 11 may update the illustration generation model of the illustrator by performing machine learning using the additional group of learning illustrations acquired from the illustrator.

[0059] Next, an illustration generation process in which server 2 in the image forming system 1 according to the embodiment generates an illustration using the illustration generation model will be described. FIG. 7 is a diagram schematically showing an illustration generation process in which server 2 in the image forming system 1 according to the embodiment generates an illustration using the illustration generation model. First, the user registers a user (account) to receive the illustration provision service. For example, the user connects to server 2 using the user terminal 4 and registers the user information of the illustration provision service. Server 2 stores the user information (for example, authentication information such as a user ID and password) of the user registered through a predetermined procedure in the storage unit 14. The user whose user information has been registered by server 2 is in a state where they can receive the illustration provision service.

[0060] When a user who has completed user registration uses the illustration providing service, the user inputs user information using the user terminal 4. The user terminal 4 transmits a login request to the server 2 for the illustration providing service based on the user information input by the user. The server 2 performs user authentication based on the user information received together with the login request from the user terminal 4. When the user authentication is successful, the server 2 sets the user terminal to the logged-in state.

[0061] In addition, when receiving the illustration providing service, the user may log in to the server 2 from the MFP3 instead of the user terminal 4. In this case, the processing of the user terminal 4 described later may be executed by the MFP3. However, here, the illustration generation process will be described assuming that the user logs in to the server 2 using the user terminal 4.

[0062] When the user terminal 4 logs in to the server 2 (illustration generation service), it accepts the selection of an illustrator and the user's requests. For example, the user terminal 4 obtains list information of selectable illustrators from the server 2 in order to allow the user to select an illustrator. The user terminal 4 accepts the selection of an illustrator from the list of selectable illustrators obtained from the server 2. When the user terminal 4 selects (designates) the illustrator of the illustration to be generated by the user, it transmits information indicating the selected illustrator to the server 2.

[0063] When the server 2 receives information indicating an illustrator from the user terminal 4, it selects an illustration generation model that generates an illustration reflecting the characteristics of the selected illustrator. When the server 2 selects an illustration generation model, it accepts the user's requests as illustration generation conditions for generating an illustration. Examples of the user's requests as illustration generation conditions include situations, backgrounds, text, and special media to be printed.

[0064] Further, the user terminal 4 receives an input of the user's request as an illustration generation condition. For example, the user terminal 4 displays an input screen or the like for the user to input a request on the display and receives the input of the request. When the user inputs a request for an illustration to be generated (illustration generation condition), the user terminal 4 transmits information indicating the input user request to the server 2. Note that the user terminal 4 may be configured to input an illustration generation condition (user request) together with an illustrator.

[0065] When the server 2 receives information indicating the user's request from the user terminal 4, the server 2 sets the illustration generation model of the illustrator that has selected the illustration generation condition according to the user's request. The server 2 generates an illustration using the illustration generation model in which the illustration generation condition according to the user's request is set. The server 2 stores the illustration generated using the illustration generation model in the storage unit 14 in association with the user information of the user. Thereby, the server 2 can provide the illustration generated according to the user's request stored in the storage unit 14 in response to a request from the user.

[0066] Next, an illustration generation process in which the server 2 in the image forming system 1 according to the embodiment generates an illustration using an illustration generation model will be described. FIG. 8 is a sequence for explaining an illustration generation process in which the server 2 in the image forming system 1 according to the embodiment generates an illustration.

[0067] First, the user performs a login operation to the illustration providing service by the user terminal 4 (or the MFP 3). Here, it is assumed that the user logs in to the server 2 from the user terminal 4. The user terminal 4 (or the MFP 3) connects to the server 2 and receives an input of user information (authentication information) by the user as a login operation to the illustration providing service (ACT31). The user terminal 4 transmits the user information including the authentication information input by the user to the server 2 together with a login request to the illustration providing service (ACT32).

[0068] Server 2 receives a login request to the illustration providing service from user terminal 4 via communication interface 13. The processor 11 of server 2 performs user authentication (ACT33) using user information including authentication information received together with the login request. When the user authentication is successful, the processor 11 of server 2 sets the user terminal to the logged-in state and sends a notification indicating authentication success (authentication OK) to user terminal 4.

[0069] When user terminal 4 receives a notification indicating authentication success, it notifies the completion of login and notifies that generation of an illustration by server 2 (illustration providing service) has become possible. After logging in to server 2, user terminal 4 requests server 2 to start generating an illustration (ACT35) according to the user's operation.

[0070] Server 2 receives a request to start generating an illustration by the illustration providing service from user terminal 4 via communication interface 13. When the processor 11 of server 2 receives the request to start generating an illustration, it sends information indicating selectable illustrators to user terminal 4 (ACT36). For example, server 2 sends information indicating a list of illustrators for which illustration generation models have been created as information indicating selectable illustrators to user terminal 4. Here, it is assumed that the processor 11 of server 2 sends an illustrator selection screen for allowing selection of a specific illustrator from the list of selectable illustrators to user terminal 4.

[0071] User terminal 4 displays an illustrator selection screen on the display based on the information obtained from server 2 (ACT37). User terminal 4 accepts the selection of a specific illustrator while the illustrator selection screen is being displayed. When the illustrator for the illustration to be generated is selected (designated), user terminal 4 sends information indicating the selected illustrator to server 2.

[0072] Server 2 receives information indicating the illustrator specified by the user terminal 4 via the communication interface 13 (ACT38). When the processor 11 of server 2 receives the information indicating the specified illustrator, it selects the illustration generation model of the specified illustrator (ACT39). When the processor 11 of server 2 selects the illustration generation model, it receives the user's request as the illustration generation condition for generating an illustration (ACT40). Here, it is assumed that the processor 11 of server 2 transmits a request input screen for receiving the user's request regarding the illustration to be generated to the user terminal 4.

[0073] When the user terminal 4 receives the request input screen from server 2, it displays on the display a request input screen for inputting the user's request received from server 2 (ACT41). In a state where the user terminal 4 displays the request input screen, it receives the input of the user's request as the illustration generation condition. For example, the user inputs, as a request for the illustration generation condition, a situation, background, text, medium to be printed, etc. to the user terminal 4. When the user's request is input, the user terminal 4 transmits the input user's request to server 2 (ACT42).

[0074] Server 2 receives the user's request input by the user terminal 4 via the communication interface 13 (ACT42). When the processor 11 of server 2 receives the user's request, it specifies the illustration generation conditions to be set in the illustration generation model selected by analyzing the user's request (ACT43). The processor 11 of server 2 sets the illustration generation conditions specified from the user's request in the illustration generation model of the selected illustrator.

[0075] The processor 11 of server 2 executes the generation of an illustration (ACT44) using an illustration generation model that sets illustration generation conditions according to the user's request. The processor 11 of server 2 transmits the illustration generated using the illustration generation model to the user terminal 4 in order to have the user confirm the illustration (ACT45). Here, the processor 11 of server 2 transmits an illustration confirmation screen for displaying the generated illustration to the user terminal 4 in order to have the generated illustration confirmed.

[0076] After transmitting the user's request, the user terminal 4 receives an illustration confirmation screen including the illustration generated by server 2. The user terminal 4 displays the illustration confirmation screen received from server 2 on the display (ACT46). The user terminal 4 accepts an input as to whether or not to save the displayed illustration while the illustration confirmation screen is being displayed. When instructed to save the illustration, the user terminal 4 transmits an instruction to save the generated illustration to server 2 (ACT47).

[0077] Server 2 receives the instruction to save the illustration input by user terminal 4 via communication interface 13 (ACT47). When the processor 11 of server 2 receives the instruction to save the illustration, it saves the displayed illustration in storage unit 14 in association with information indicating the logged-in user (ACT45).

[0078] Through the illustration generation process as described above, the server according to the embodiment can generate an illustration according to the user's request using the illustration generation model of the illustrator specified by the user. Also, the server according to the embodiment can save the illustration generated according to the user's request in the storage unit (storage device) and provide it in response to a request from the user.

[0079] Next, an illustration printing process in which the MFP 3 prints the illustration generated by server 2 in the image forming system 1 according to the embodiment on special media will be described. FIG. 9 is a diagram schematically showing an illustration printing process in which an MFP 3 prints an illustration generated by a server 2 in an image forming system 1 according to an embodiment on a special medium. Here, it is assumed that the user prints an illustration generated by the illustration generation process as described above on a special medium using the MFP 3. The user inputs user information for logging in to the server 2 (illustration providing service) using the operation unit 42 of the operation panel 40 of the MPF 3. For example, the system control unit 50 of the MFP 3 transmits a login request to the illustration providing service based on the user information input by the operation unit 42 to the server 2. The server 2 performs user authentication based on the user information received together with the login request from the MFP 3. When the user authentication is successful, the server 2 sets the user in a logged-in state on the MFP 3.

[0080] When the MFP 3 logs in to the server 2 (illustration generation service), it accepts a selection of an illustration to be printed on a special medium from the generated illustrations according to the user's request. For example, the MFP 3 acquires information on the generated illustrations saved by the user from the server 2 in order to allow the user to select an illustration to be printed. The MFP 3 accepts a selection of an illustration to be printed from the list of selectable illustrations acquired from the server 2. When the user selects (designates) an illustration to be printed, the MFP 3 transmits information indicating the selected illustration to the server 2.

[0081] When the server 2 receives information indicating an illustration from the MFP 3, it downloads the illustration data of the selected illustration to the MFP 3. When the MFP 3 acquires the illustration data of the illustration selected from the server 2, it accepts a selection of a special medium to be the medium for printing the acquired illustration. For example, the MFP 3 displays a selection screen for selecting a special medium on the display unit 41 and accepts a selection of a special medium for printing the illustration. When a special medium is selected by the operation unit 42, the MFP 3 executes printing of the illustration on the selected special medium.

[0082] Next, the flow of the illustration printing process in which the MFP 3 prints the illustration generated by the server 2 in the image forming system 1 according to the embodiment will be described. FIG. 10 is a sequence for explaining the illustration printing process in which the MFP 3 prints the illustration generated by the server 2 in the image forming system 1 according to the embodiment. The user selects illustration printing to print the illustration stored in the server 2 on special media on the operation panel 40 of the MFP 3. When illustration printing is selected, the system control unit (controller) 50 of the MFP 3 connects to the server 2 via the communication interface 56.

[0083] When the system control unit 50 of the MFP 3 connects to the server 2, it accepts the input of user information (authentication information) by the user as a login operation to the illustration providing service (ACT51). The system control unit 50 of the MFP 3 transmits the user information including the authentication information input by the user to the server 2 together with a login request to the illustration providing service (ACT52).

[0084] The server 2 receives a login request to the illustration providing service from the MFP 3 via the communication interface 13. The processor 11 of the server 2 executes user authentication using the user information including the authentication information received together with the login request (ACT53). When the user authentication is successful, the processor 11 of the server 2 sets the user in the logged-in state and transmits a notification indicating authentication success (authentication OK) to the MFP 3.

[0085] When the system control unit 50 of the MFP 3 receives authentication success, it notifies that it is logged in and displays an illustration printing screen for notifying that illustration printing is possible on the display unit 41 (ACT55). For example, when the illustration printing screen is displayed, the user instructs the start of printing with the generated illustration stored in the server 2 using the operation unit 42. The processor 51 of the MFP 3 requests the generated illustration from the server 2 according to the request of the logged-in user in response to the user's instruction (ACT56).

[0086] The server 2 receives an illustration request for requesting the generated illustration from the MFP 3 via the communication interface 13. When receiving the illustration request, the processor 11 of the server 2 extracts from the storage unit 14 the illustration generated according to the request of the logged-in user (ACT57). For example, the processor 11 searches the storage unit 14 for the illustration stored in association with the logged-in user. The processor 11 transmits to the MFP 3 the generated illustration corresponding to the logged-in user extracted from the storage unit 14 (the illustration generated according to the request of the user) (ACT58).

[0087] The system control unit 50 of the MFP 3 receives, via the communication interface 56, the generated illustration (illustration group) of the user transmitted from the server 2. The processor 51 of the system control unit 50 of the MFP 3 displays the generated illustration received from the server 2 on the display unit 41 (ACT59). The system control unit 50 accepts a selection instruction for the illustration to be printed in a state where the generated illustration acquired from the server 2 is displayed on the display unit 41 (ACT60). For example, the processor 51 displays a list of a plurality of illustrations (illustration group) received from the server 2 on the display unit 41 and accepts the selection of the illustration to be printed by the operation unit 42.

[0088] When the illustration to be printed is selected, the system control unit 50 of the MFP 3 accepts the selection of the special medium as the medium for printing the selected illustration (ACT61). For example, the processor 51 displays on the display unit 41 a list of special media (special medium selection screen) as the media on which the illustration can be printed and accepts the selection of the special medium by the operation unit 42.

[0089] When an illustration and special media are selected or when printing start is instructed, the system control unit 50 of MFP3 performs payment processing for the fee required for printing the illustration on the special media (ACT62, 63). For example, when the illustration to be printed and the special media are determined, the processor 51 calculates the fee required for printing. When the processor 51 calculates the fee required for printing, it accepts selection of a payment method as payment processing for the fee (ACT62). When the payment method is selected, the processor 51 performs settlement processing for the fee according to the selected payment method (ACT63). However, as an operation, when settlement processing for each printing process is not performed, the processes of ACT62 and 63 may be omitted.

[0090] When the payment of the fee is completed (when printing execution is determined), the system control unit 50 of MFP3 performs image processing on the illustration to be printed according to the selected special media (ACT64). For example, the processor 51 performs image processing in which the image as the illustration to be printed is corrected according to the characteristics of the special media by the image processing unit 54. As a specific example, the image processing unit 54 may correct the illustration or the background color of the illustration according to the color of the special media. Also, the image processing unit 54 may correct the density, brightness, or vividness of the illustration to be printed according to the material of the special media.

[0091] When the system control unit 50 of MFP3 performs image processing on the illustration according to the special media, it prints the illustration that has been image processed using the printer 20 on the special media (ACT65). For example, the printer 20 feeds the selected special media and forms an image as the illustration after image processing supplied from the system control unit 50 on the fed special media.

[0092] As described above, the image forming system according to the embodiment includes a server that generates an illustration according to a user's request and an MFP that prints the illustration generated by the server on a medium. Thereby, according to the image forming system, the generated illustration that conforms to the user's request can be printed on the special media.

[0093] Also, in the image forming system according to the embodiment, the server can generate an illustration according to the user's request using the illustration generation model of the illustrator selected by the user. As a result, the user can receive a service of printing an illustration generated in the style of the selected illustrator on a medium such as a special medium by selecting the illustrator.

[0094] Also, in the image forming system according to the embodiment, the server acquires a group of learning illustrations provided by the illustrator with which an agreement on illustration provision has been obtained, and the server creates or updates an illustration generation model for each illustrator by machine learning using the group of learning illustrations provided by the illustrator. As a result, the image forming system can configure an illustration generation model capable of generating an illustration reflecting the individuality of the illustrator using the group of learning illustrations from the illustrator.

[0095] Also, in the image forming system according to the embodiment, the server saves the illustration generated according to the user's request. The MFP acquires, from the server, the illustration generated according to the user's request when the user can log in to the server. The MFP prints the illustration acquired from the server on the special medium selected by the user. As a result, the MFP can acquire the illustration that has been generated according to the user's request from the server and print the illustration acquired from the server on the special medium selected by the user.

[0096] Furthermore, in the image forming system according to the embodiment, the MFP prints the illustration image-processed according to the special medium selected by the user on the special medium. As a result, the MFP can provide the user with a printout of the illustration generated according to the user's request in a state where the illustration has been image-processed according to the special medium selected by the user.

[0097] Although some embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof.

Description of Reference Numerals

[0098] 1…Image forming system, 2…Server, 3…Digital multifunction machine (image forming apparatus), 4…User terminal, 20…Printer, 21…Paper feed cassette, 22…Manual feed tray, 23…Conveying system (conveying mechanism), 30…Scanner, 40…Operation panel, 41…Display unit, 42…Operation unit (input device), 50…System control unit (controller), 51…Processor, 52…Memory, 53…Image memory, 54…Image processing unit, 55…Storage device, 56…Communication interface.

Claims

1. An image forming system having a server and an image forming apparatus, wherein the server has: a first communication interface for communicating via a network; and a processor that generates an illustration under illustration generation conditions specified by a user in a device that communicates via the network by means of the first communication interface, and the image forming apparatus has: a second communication interface for communicating with the server; a controller that acquires, from the server, the illustration generated under the illustration generation conditions by means of the second communication interface; and a printer that prints the illustration acquired from the server on a medium, the image forming system.

2. The server has a memory that stores an illustration generation model for each illustrator, and the processor of the server generates an illustration under the illustration generation conditions specified by the user using the illustration generation model of the illustrator specified by the user, the image forming system according to Claim 1.

3. The processor of the server creates an illustration generation model for each illustrator by machine learning using an illustration group for each illustrator. the image forming system according to Claim 2.

4. The server has a memory that stores user information, and the processor of the server stores, in a storage device, an illustration generated under the illustration generation conditions specified by a user authenticated based on the user information stored in the memory, the image forming apparatus has an input device for inputting a user operation, and the controller of the image forming apparatus acquires, from the server, an illustration generated under the illustration generation conditions specified by the user who has been authenticated by the server when the user operating the input device has been authenticated by the server, and causes the printer to print the illustration acquired from the server on the medium selected by the input device, the image forming system according to Claim 1.

5. The controller of the image forming apparatus further performs image processing on the illustration according to the medium selected by the input device, the image forming system according to Claim 4.

Images