Printing system

Abstract

When a message server (3) receives printing data from one of electronic terminals (2) registered in a group via a talk screen of the group and then receives a printing instruction from said one of the electronic terminals (2), a chatbot server (4) transfers the printing data received via the message server (3) to a print server (5), and the print server (5) transfers the printing data received from the chatbot server (4) to an image-forming device (1) to cause the same to execute a printing operation. Furthermore, when an error occurs in the image-forming device (1), printing based on the printing data is not normally completed in the image-forming device (1), and a predetermined fixed time has elapsed from the time of occurrence of the error without resolving the error, the chatbot server (4) or the print server (5) executes processing for stopping execution of the printing by the image-forming device (1).

Description

Printing system

[0001] The present invention relates to a printing system using a message application.

[0002] There is a printing service that connects an electronic terminal (for example, a mobile terminal device such as a smartphone) and a printer via a network so that an image based on an image transmitted from the electronic terminal can be printed by the printer. Also, a message application that enables message exchanges in an interactive format within a conversation group composed of multiple members is widely used. In recent years, bot services using a chatbot server that automatically responds to messages transmitted from electronic terminals have also become popular.

[0003] Then, various services have been proposed and put into practical use, which link the above-described printing service and bot service so that an image based on an image transmitted from an electronic terminal can be printed by a printer using a message application.

[0004] For example, Patent Document [1] below describes an invention that gives a print instruction for an image based on an image transmitted from a message application to a printer, performs print settings, and enables reuse of past print settings. Also, Patent Document [2] below describes an invention that gives a print instruction for an image based on an image transmitted from a message application to a printer and enables the output result to be confirmed on the message application before giving the print instruction.

[0005] Japanese Unexamined Patent Application Publication No. 2022-185142 Japanese Unexamined Patent Application Publication No. 2021-114218

[0006] In a printing service using a message application, the user is made to input a registration code (a printer-specific code) on the printer registration screen on the message application, and thus the use registration of the printer is completed.

[0007] Printing services using messaging applications are based on the premise of a one-to-one relationship between an electronic device and a chatbot server. In other words, conventional printing services like those described above are not designed for shared use of printers within a conversation group consisting of multiple members.

[0008] In this process, the image forming machine may encounter errors such as running out of paper or ink, preventing printing from starting and putting the device into a print queue. Once the error is resolved, the pending print job will automatically begin.

[0009] The printing service using the messaging application described above is often initiated by the user from a location away from the image forming machine. Therefore, if printing is interrupted, and printing automatically resumes when the error is resolved (i.e., at a time that is difficult for the user to predict), it becomes difficult to retrieve the printed materials at that time, raising the risk that the printed materials may be seen or taken away by a third party.

[0010] This invention has been made in view of the above circumstances, and aims to reduce the risk that printed materials may be seen or taken away by a third party, even if a printing error occurs when an image forming apparatus is jointly used within a conversation group consisting of multiple members.

[0011] A printing system according to one aspect of the present invention comprises: a print server that controls printing of an image forming apparatus; an electronic terminal that has a messaging application installed that enables message exchange via a network in a chat format and displays a talk screen indicating the message exchange on a display unit; a message server that registers a plurality of the electronic terminals as members of a group capable of exchanging messages and provides a messaging service capable of exchanging messages; and a chatbot server that is registered with the message server as a member of the group and sends and receives data between the message server and the print server, wherein the chatbot server is registered with the message server as a member of the group. After receiving print data from one of the recorded electronic terminals via the group's chat screen, if the chatbot server receives a print command from one of the electronic terminals, the chatbot server transfers the received print data to the print server via the message server. The print server then transfers the print data received from the chatbot server to the image forming apparatus to execute the print operation. Furthermore, if an error occurs in the image forming apparatus and printing based on the print data is not completed successfully by the image forming apparatus, and a predetermined period of time has elapsed since the error occurred without the error being resolved, the chatbot server or the print server executes a process to stop the image forming apparatus from performing the print operation.

[0012] A printing system according to one aspect of the present invention comprises: an electronic terminal having a messaging application installed that enables message exchange via a network in a chat format and displays a talk screen showing the message exchange on a display unit; a message server that registers a plurality of the electronic terminals as members of a group capable of message exchange and provides a messaging service capable of message exchange; and a communication server that is registered with the message server as a member of the group, performs print control and print operation settings for an image forming apparatus, and sends and receives data with the message server. The communication server, after the message server receives print data from one of the electronic terminals registered in the group via the group's talk screen, and then receives a print instruction from one of the electronic terminals, transfers the print data received via the message server to the image forming apparatus and executes the print operation. Furthermore, if an error occurs in the image forming apparatus and printing based on the print data is not completed normally by the image forming apparatus, and a predetermined period of time has elapsed since the error occurred without the error being resolved, the communication server executes a process to stop the image forming apparatus from performing the print operation.

[0013] According to the present invention, when an image forming apparatus is shared among multiple members in a conversation group, even if a printing error occurs, the risk of the printed material being seen or taken away by a third party can be reduced.

[0014] This is a diagram showing the overall layout of a printing system according to one embodiment of the present invention. This is a diagram showing an example of the electrical configuration of an electronic terminal. This is a diagram showing an example of the electrical configuration of a message server. This is a functional block diagram schematically showing the main internal configuration of an image forming apparatus. This is a functional block diagram schematically showing the main internal configuration of a chatbot server according to the first embodiment. This is a diagram showing an example of the data configuration stored in the group member information storage unit. This is a diagram showing an example of the data configuration stored in the print permission printer storage unit. This is a functional block diagram schematically showing the main internal configuration of a print server. This is a diagram showing an example of the data configuration stored in the device information storage unit. This is a diagram showing an example of the data configuration stored in the registration code storage unit. This is a diagram showing an example of the operation screen displayed on the display unit of an image forming apparatus. This is a sequence diagram showing an example of the process for registering shared use of an image forming apparatus in a conversation group. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a sequence diagram showing an example of the process for printing in an image forming apparatus based on instructions from an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This is a diagram showing an example of the operation screen displayed on the display unit of an electronic terminal. This figure shows an example of an operation screen displayed on the display unit of an electronic terminal. This is a sequence diagram showing an example of processing when an error occurs in an image forming apparatus. This figure shows an example of an operation screen displayed on the display unit of an image forming apparatus. This figure shows an example of an operation screen displayed on the display unit of an electronic terminal.

[0015] A printing system according to one embodiment of the present invention will be described below with reference to the drawings. Figure 1 is a diagram showing the overall structure of the printing system according to one embodiment of the present invention.

[0016] A printing system Sy according to one embodiment of the present invention comprises a plurality of electronic terminals 2A to 2E (hereinafter collectively referred to as "electronic terminal 2"), a message server 3, a chatbot server 4, and a print server 5.

[0017] The image forming apparatus 1 is, for example, a printer or a multifunction device with printer functionality. The image forming apparatus 1 is equipped with a communication unit 14 (Figure 2C) that enables data communication with the outside world and is connected to a print server 5 via a network N.

[0018] The electronic terminal 2 is, for example, a portable terminal device such as a smartphone, and is equipped with a display unit 21 having a touch panel function, as well as a communication unit consisting of a communication interface that enables data communication with the outside, and is connected to the message server 3 via a network N. The electronic terminal 2 is also equipped with a messaging application such as LINE® that enables the exchange of messages (e.g., text and images) in a conversational format among multiple members that constitute a conversation group.

[0019] Message server 3 provides a messaging service that enables message exchange over network N. Message server 3 also registers electronic terminal 2 and chatbot server 4 as members of a group capable of exchanging messages (group members). In other words, message server 3 is a server that manages and relays messages exchanged within a conversation group composed of multiple members.

[0020] The chatbot server 4 sends and receives data with the message server 3 and the print server 5 via the network N. The chatbot server 4 performs processing on messages received by the message server 3 according to their content. Specifically, the chatbot server 4 creates a message in response to a message received from the electronic terminal 2 via the messaging service, and sends an instruction to the print server 5 in response to a print command from the electronic terminal 2.

[0021] The print server 5 transmits and receives data with the image forming apparatus 1 via the network N and controls the printing of the image forming apparatus 1. The print server 5 performs processing such as sending print data and print instructions to the image forming apparatus 1. The image forming apparatus 1 prints images on paper according to the print data transmitted from the print server 5 or the print data obtained by user operation.

[0022] The printing system Sy is a system that enables the shared use of the image forming apparatus 1 within a conversation group. The electronic terminal 2, in accordance with user operations, uses a messaging application to send an image as print data to the chatbot server 4 via the message server 3, and requests the printing of an image based on that image. The chatbot server 4 requests the print server 5 to perform a print operation based on the above image. The print server 5 instructs the image forming apparatus 1 to execute the printing of the image based on the above image. The image forming apparatus 1 then performs the printing.

[0023] Figure 2A shows an example of the electrical configuration of an electronic terminal 2. The electronic terminal 2 is, for example, a smartphone and includes a control unit 20, an input receiving unit 22, a storage unit 23, and a communication unit 14, etc. The control unit 20 consists of a processor, RAM (Random Access Memory), and ROM (Read Only Memory), etc. The processor is a CPU (Central Processing Unit), MPU (Micro Processing Unit), or ASIC (Application Specific Integrated Circuit), etc. The control unit 20 functions as a control unit 201 when the processor executes a control program stored in the ROM, etc. The control unit 201 is responsible for the overall operation control of the electronic terminal 2.

[0024] The input receiving unit 22 is a hard button, touch panel, etc., that accepts input operations from the user. The input receiving unit 22 also has a display unit 21 that displays operation screens, messages, etc., and in this embodiment, the display unit 21 and the touch panel are integrally configured. The communication unit 24 is composed of a communication module, etc., and transmits and receives data with external devices via the network N. The display unit 21 is, for example, an LCD (liquid crystal display).

[0025] The storage unit 23 is, for example, a non-volatile memory that stores various programs and data tables, and stores the message application 231 for using the messaging service described above. The control unit 201 executes the message application 231 and performs the necessary processes to use the messaging service provided by the message server 3.

[0026] Figure 2B shows an example of the electrical configuration of the message server 3. The message server 3 consists of, for example, a computer, and includes a control unit 31, a storage unit 32, and a communication unit 33. The control unit 31 consists of a processor, RAM, and ROM. The processor is a CPU, MPU, or ASIC. The control unit 31 functions as a control unit 311 when the processor executes a control program stored in the ROM, etc. The control unit 311 is responsible for the overall operation control of the message server 3.

[0027] The storage unit 32 is a large-capacity storage device consisting of an SSD (Solid State Drive) or HDD (Hard Disk Drive) that stores various programs and data tables. The storage unit 32 also stores the message application 321. The control unit 311 executes the message application 321, performing various processes to provide messaging services to the electronic terminal 2 or image forming apparatus 1 on which the message application is installed. The communication unit 33 consists of a communication module and the like, and transmits and receives data with external devices via the network N.

[0028] Figure 2C is a functional block diagram schematically showing the main internal configuration of the image forming apparatus 1. The image forming apparatus 1 is a multifunction device that combines multiple functions, such as a copy function, a printer function, a scanner function, and a facsimile function.

[0029] The image forming apparatus 1 comprises a control unit 10, an image reading unit 11, an image forming unit 12, an operation unit 13, a communication unit 14, and a storage unit 15. The image reading unit 11 is equipped with a scanner or the like, and optically reads an image from a document to generate image data.

[0030] The image forming unit 12 is an electrophotographic image forming mechanism that includes a photoreceptor drum, charging device, exposure device, developing device, and primary transfer device for each color, and forms an image on recording paper, which serves as a recording medium, by secondary transfer via an intermediate transfer belt. Based on image data generated by the document reading operation, image data stored in image memory, image data received from a network-connected computer, etc., the image forming unit 12 forms a toner image on the recording paper fed from a paper feeding unit (not shown) to create a printed document. The recording paper on which the toner image has been formed by the image forming unit 12 is subjected to a fixing process in a fixing unit (not shown).

[0031] The operation unit 13 is equipped with various hard keys operated by the user, and in response to the operation of the hard keys, it receives instructions from the user, such as instructions to execute image forming operations, regarding various operations and processes that the image forming apparatus 1 can perform.

[0032] The operation unit 13 is equipped with a display unit 130 that displays operation instructions and other information to the operator. The operation unit 13 also accepts user input based on user operations (touch operations) on the screen displayed on the display unit 130 via the touch panel of the display unit 130.

[0033] The display unit 130 consists of an LCD (Liquid Crystal Display) or the like. When an operator touches a button or key displayed on the screen, the touch panel receives an instruction corresponding to the touched location. In this case, the touch panel functions as an operation unit.

[0034] The communication unit 14 is a communication interface that sends and receives various types of data with external devices (for example, a print server 5) within the local area network or on the internet.

[0035] The storage unit 15 is a high-capacity storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various control programs and the like.

[0036] The control unit 10 comprises a processor, RAM (Random Access Memory), ROM (Read Only Memory), and dedicated hardware circuits. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100.

[0037] The control unit 10 functions as a control unit 100 through the operation of the processor in accordance with the control program stored in the memory unit 15. However, the control unit 100 can also be configured by hardware circuits, rather than by operation in accordance with the control program of the control unit 10. The same applies to each embodiment below unless otherwise specified.

[0038] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the image reading unit 11, the image forming unit 12, the operation unit 13, the communication unit 14, and the storage unit 15, and performs drive control and other operations on each of these units. For example, the control unit 100 performs various processes necessary for image forming by the image forming apparatus 1.

[0039] Figure 3 is a functional block diagram schematically showing the main internal configuration of the chatbot server 4. The chatbot server 4 comprises a control unit 40, a communication unit 41, and a storage unit 42.

[0040] The communication unit 41 is a communication interface that performs data communication with external devices on the network N. For example, the communication unit 41 performs data communication with the message server 3 and the print server 5.

[0041] The storage unit 42 is a high-capacity storage device such as an HDD or SSD. The storage unit 42 stores various control programs and the like, and as part of its storage area, it includes a group member storage unit 420, a print permission device storage unit 421, and an image storage unit 422 that stores images transmitted from the electronic terminal 2.

[0042] The storage unit 42 stores the bot application 423. The control unit 400 executes the bot application 423, sending and receiving data between the message server 3 and the print server 5. For example, the chatbot server 4 creates a reply message to a message received from the message server 3 and sends it to the message server 3, and also sends print data to the print server 5.

[0043] The group member storage unit 420 stores member information that constitutes a conversation group that exchanges messages using a messaging application. Figure 4A shows an example of the data structure stored in the group member storage unit 420. The group member storage unit 420 stores the user IDs of members belonging to the conversation group indicated by the group ID, which is associated with the group ID that identifies each conversation group. The user ID and group ID are identifiers issued by the message server 3, respectively.

[0044] The print permission device storage unit 421 stores information on the image forming apparatus 1 (printer) permitted for shared use within the conversation group. FIG. 4B is a diagram showing an example of the data configuration stored in the print permission device storage unit 421. In the print permission device storage unit 421, associated with the group ID, there are stored the printer ID and model name indicating the image forming apparatus 1 permitted for shared use within the conversation group indicated by the group ID, the user ID of the permission application member who applied for permission for shared use, and the user ID of the members belonging to the conversation group (that is, the members permitted to use the image forming apparatus 1).

[0045] The control unit 40 is configured to include a processor, a RAM, a ROM, and a dedicated hardware circuit. The control unit 40 includes a control section 400 and a request section 401. The control unit 40 functions as the control section 400 and the request section 401 by the operation of the above-mentioned processor according to the control program and the like stored in the storage unit 42.

[0046] The control section 400 is in charge of the overall operation control of the chatbot server 4. The control section 400 is connected to the communication section 41 and the storage unit 42, and performs drive control and the like of these respective sections.

[0047] When an image as print data and a message indicating a print request for the image are received by the communication section  41, the request section 401 causes the communication section 41 to transmit the image and the message, and a print request for causing the image forming apparatus 1 to print the image based on the above-mentioned image, from the communication section 41 to the print server 5.

[0048] FIG. 5 is a functional block diagram schematically showing the main internal configuration of the print server 5. The print server 5 includes a control unit 50, a communication section 51, and a storage unit 52.

[0049] The communication section 51 is a communication interface for performing data communication with external devices on the network N . The communication section 51 performs data communication with, for example, the image forming apparatus 1 or the chatbot server 4.

[0050] The storage unit 52 is a high-capacity storage device such as an HDD or SSD. The storage unit 52 stores various control programs and the like, and also includes a device information storage unit 520, a registration code storage unit 521, and a print data storage unit 522 as part of its storage area.

[0051] The device information storage unit 520 stores information for each image forming apparatus 1 managed by the print server 5. Figure 6A shows an example of the data structure stored in the device information storage unit 520. The device information storage unit 520 stores information such as the model name and IP address, associated with the printer ID that identifies the image forming apparatus 1.

[0052] The registration code storage unit 521 stores a registration code unique to the image forming apparatus 1. Figure 6B shows an example of the data structure stored in the registration code storage unit 521. The registration code storage unit 521 stores the registration code and the number of times the registration code has been issued (number of issuances), associated with the printer ID that identifies the image forming apparatus 1. The print data storage unit 522 stores the print data sent from the chatbot server 4.

[0053] The control unit 50 comprises a processor, RAM, ROM, and dedicated hardware circuits. The control unit 50 includes a control unit 500, an instruction unit 501, an issuing unit 502, an authorization unit 504, and a cancellation unit 505.

[0054] The control unit 50 functions as a control unit 500, instruction unit 501, issuance unit 502, permission unit 504, and cancellation unit 505 through operation by the processor in accordance with the control program stored in the storage unit 52. The control unit 500 is responsible for the overall operation control of the print server 5. The control unit 500 is connected to the communication unit 51 and the storage unit 52 and performs drive control of these units, etc.

[0055] The instruction unit 501 transmits the print data to the image forming apparatus 1 in accordance with the print request from the chatbot server 4 and instructs the image forming apparatus 1 to perform printing based on the print data.

[0056] The issuing unit 502, in response to a request from the image forming apparatus 1, randomly issues a registration code unique to the image forming apparatus 1, associates the issued registration code and the number of times the registration code has been issued with the printer ID of the image forming apparatus 1, and registers them in the registration code storage unit 521 (Figure 6B). The issuing unit 502 issues a registration code each time a request is made from the image forming apparatus 1, but from the second time onward, it issues the same registration code as the first time and counts up the number of issuances.

[0057] The control unit 500 transmits image data showing a notification screen G1 (Figure 7) that notifies the user of the registration code issued by the issuing unit 502 to the image forming apparatus 1 via the communication unit 51.

[0058] When the control unit 100 (Figure 2C) of the image forming apparatus 1 receives the above data transmitted from the print server 5, it displays a notification screen G1 on the display unit 130, as shown in Figure 7. The notification screen G1 displays the registration code (a 5-character code CD1) issued by the print server 5 (issuance unit 502), along with an operation button B1 labeled "Complete".

[0059] When the authorization unit 504 receives a registration code unique to the image forming apparatus 1 transmitted from the electronic terminal 2 of a member belonging to the conversation group, it authorizes the joint use of the image forming apparatus 1 within the conversation group.

[0060] When the cancellation unit 505 receives error information from the image forming apparatus 1 indicating that the printing instructed by the instruction unit 501 has not been completed successfully and an error has occurred in the image forming apparatus 1, the cancellation unit 505 cancels the execution of the printing by the image forming apparatus 1 after a predetermined period of time has elapsed since the receipt of the error information.

[0061] Next, an example of the process for registering the joint use of the image forming apparatus 1 within a conversation group will be explained using the sequence diagram shown in Figure 8.

[0062] Based on the user's operation of the input receiving unit 22 of the electronic terminal 2A, the control unit 201 of the electronic terminal 2 starts the message application 231 and begins executing the necessary processes to use the messaging service (group talk service) provided by the message server 3.

[0063] In this state, based on the user's operation of the input receiving unit 22 of the electronic terminal 2A, the control unit 201 of the electronic terminal 2A sends a predetermined text message, "Printer Registration," with the user ID and group ID attached, to the messaging service (message server 3) via the communication unit 24 (S1).

[0064] When the message server 3 receives the text "Printer Registration" sent from electronic terminal 2A via the communication unit 34, it sends the text "Printer Registration" to the chatbot server 4 and the group members electronic terminals 2B to 2E via the communication unit 34 (S2). At this time, as shown in the example in Figure 9, the control unit 201 of electronic terminal 2A displays an image 215A indicating "Printer Registration" in the chat screen displayed on the display unit 21. In addition, the control units 201 of the group members electronic terminals 2B to 2E display the image indicating "Printer Registration" sent by electronic terminal 2A in the chat screen displayed on the display unit 21.

[0065] In the chatbot server 4, when the control unit 400 receives the text "Printer Registration" via the communication unit 41, it sends a message to the message server 3 from the communication unit 41 requesting the input of a registration code (code) (S3).

[0066] In the message server 3, when the control unit 311 receives the above message sent from the chatbot server 4 via the communication unit 33, it transmits the message from the communication unit 33 to each electronic terminal 2A to 2E that is a member of the group (S4).

[0067] When the control unit 201 receives the above message via the communication unit 24 in each electronic terminal 2 that is a group member, it displays a message 216A, as shown in Figure 10 as an example, in the talk screen displayed on the display unit 21 (S5). The message 216A displays the text 2161A, which says, "Please enter your registration code."

[0068] Here, we assume that a user who knows the registration code of the image forming apparatus 1 used for printing, for example, a user of an electronic terminal 2A who saw the notification screen G1 displayed on the display unit 130 of the image forming apparatus 1, operates the input receiving unit 22 of the electronic terminal 2A and enters the registration code.

[0069] When the input receiving unit 22 of the electronic terminal 2A receives the registration code (S6), the control unit 201 displays it as a message from the electronic terminal 2A on the talk screen of the display unit 21, as shown in the example in Figure 11. The control unit 201 then transmits the registration code to the message server 3 via the communication unit 24 (S7).

[0070] In the message server 3, when the control unit 311 receives the registration code via the communication unit 33, the communication unit 33 transmits the registration code to the chatbot server 4 (S8).

[0071] In the chatbot server 4, when the control unit 400 receives a registration code via the communication unit 41, it transmits the received registration code and its authentication request to the print server 5 from the communication unit 41 (S9).

[0072] In the print server 5, when the control unit 500 receives the registration code and authentication request via the communication unit 51, the authorization unit 504 determines whether the registration code is stored in the registration code storage unit 521, that is, it determines the validity of the registration code (S10). If the authorization unit 504 determines that the registration code is valid, it retrieves the printer ID stored in association with the registration code from the registration code storage unit 521 (S11), and further retrieves the model name of the image forming apparatus 1 associated with the retrieved printer ID (for example, "4053ci for the sales department," not the registration code) from the device information storage unit 520 (S12).

[0073] Next, the authorization unit 504 transmits the acquired printer ID and model name from the communication unit 51 to the chatbot server 4 (S13).

[0074] Furthermore, if the authorization unit 504 determines in S10 that the registration code is invalid, it will not authorize the registration of the image forming apparatus corresponding to the registration code as an image forming apparatus for shared use by the conversation group. In this case, the authorization unit 504 will send a message from the communication unit 51 to the message server 3 indicating that it will not authorize the registration of the image forming apparatus corresponding to the registration code.

[0075] After S13, the chatbot server 4, when the control unit 400 receives the printer ID and model name sent from the print server 5 via the communication unit 41, registers the received printer ID and model name, the applicant member's user ID (the user ID of the user of the electronic terminal 2A that sent the predetermined text "Printer Registration" in S1), and the user IDs of each member currently belonging to the conversation group in the print permission device storage unit 421, associating them with the group ID of the sender of the registration code (i.e., the group ID indicating the conversation group to which the applicant member for permission to use the shared use belongs) (S14). As a result, the image forming apparatus 1 indicated by the registration code is set in the chatbot server 4 as an image forming apparatus that performs printing operations according to the print instructions from each electronic terminal 2 that is a member of the conversation group.

[0076] Subsequently, the control unit 400 of the chatbot server 4 sends a registration completion message (preferably including the model name) to the message server 3 via the communication unit 41, indicating that the printer registration is complete (S15).

[0077] When the message server 3 receives the registration completion message sent from the chatbot server 4 via the communication unit 33, it sends the registration completion message from the communication unit 33 to each member's electronic terminal 2 (S16).

[0078] On each member's electronic terminal 2, when the control unit 201 receives the registration completion message via the communication unit 24, it displays a message 216B, as exemplified in Figure 12, on the talk screen of the display unit 21 (S17). Message 216B includes "Image forming apparatus registration complete" and the model name "4053ci for sales department". This allows the user to confirm that the printer with model name "4053ci for sales department" has been registered.

[0079] Next, an example of the printing process in the image forming apparatus 1 based on instructions from each electronic terminal 2, which are members of the conversation group, will be explained using the sequence diagram shown in Figure 13.

[0080] Based on the user's operation of the input receiving unit 22 of the electronic terminal 2A, the control unit 201 of the electronic terminal 2 starts the message application 231 and begins executing the necessary processes to use the messaging service (group talk service) provided by the message server 3.

[0081] In this state, based on the user's operation of the input receiving unit 22 of the electronic terminal 2A, the control unit 201 of the electronic terminal 2A sends, via the communication unit 24, a user ID and group ID to the messaging service (message server 3) and transmits, for example, an image as print data from the communication unit 24 (S21). At this time, the control unit 201 displays a message 611A indicating the image on the talk screen of the display unit 21 (an example is shown in Figure 14A).

[0082] When the message server 3 receives an image transmitted from the electronic terminal 2 via the communication unit 33, it transmits the image to the chatbot server 4 from the communication unit 33 (S22).

[0083] In the chatbot server 4, when the control unit 400 receives the image via the communication unit 41, it stores the image in the image storage unit 422 (S23), searches the print permission device storage unit 421 (Figure 4B) using the group ID of the image sender as a search key, and determines whether an image forming apparatus 1 (printer ID) that is permitted for shared use within the conversation group indicated by the group ID is stored there (S24).

[0084] When the control unit 400 of the chatbot server 4 determines that an image forming apparatus 1 that is permitted for shared use within the conversation group indicated by the group ID is stored, it creates an image reception message as a reply message and has the communication unit 41 send the image reception message to the message server 3 (S25). When the communication unit 33 of the message server 3 receives the image reception message, the control unit 311 sends the image reception message from the communication unit 33 to all electronic terminals 2 that are members of the group (S26).

[0085] On the other hand, if the control unit 400 of the chatbot server 4 determines that no image forming apparatus 1 permitted for shared use within the conversation group indicated by the group ID is stored, it sends a message containing the text "No available printers are registered" to the message server 3 via the communication unit 41. Further processing in this case will not be explained.

[0086] In each electronic terminal 2, when the control unit 201 receives the image reception message via the communication unit 24, it displays a message 612A, as exemplified in Figure 14B, on the talk screen of the display unit 21 (S27). The message 612A includes a thumbnail image showing the image as print data, an operation button 6121A labeled "Print", and an operation button 6122A labeled "Print Settings".

[0087] In the electronic terminal 2, when the control unit 201 receives a print command from the input reception unit 22 based on a touch operation of the operation button 6121A labeled "Print" (S28), it adds the user ID and group ID and sends the print command for the image to the message server 3 from the communication unit 24 (S29). At this time, the control unit 201 displays the "Print" message 615A on the talk screen of the display unit 21, as shown in the example in Figure 15A.

[0088] In the message server 3, when the control unit 311 receives the print instruction, user ID, and group ID via the communication unit 33, it sends the print instruction, etc., to the chatbot server 4 from the communication unit 33 (S30).

[0089] When the chatbot server 4 receives the print instruction etc. via the communication unit 41, the request unit 401 searches the print permission device storage unit 421 using the group ID of the sender of the print instruction as a search key, and obtains a printer ID that indicates the image forming apparatus 1 that is permitted for shared use within the conversation group indicated by the group ID (S31). The request unit 401 sends the image stored in the image storage unit 422 in S23, along with the obtained printer ID and the print instruction for the image, to the print server 5 via the communication unit 41 (S32).

[0090] At this time, the control unit 400 of the chatbot server 4 sends a message containing the text "Please wait until it is printed" to the message server 3 via the communication unit 41 (S33).

[0091] In the message server 3, when the control unit 311 receives the above message sent from the chatbot server 4 via the communication unit 33, it transmits the message from the communication unit 33 to each electronic terminal 2 of the group members (S34).

[0092] When the control unit 201 receives the above text via the communication unit 24 on each electronic terminal 2 of the group members, it displays a message 616A containing the text "Please wait until it is printed" on the display unit 21, as shown in the example in Figure 15B (S35).

[0093] In the print server 5, when the instruction unit 501 receives print instructions from the chatbot server 4 via the communication unit 41, it stores the image as print data in the print data storage unit 522 (S36). Using the received printer ID as a search key, it searches the device information storage unit 520 and identifies the IP address indicating the image forming apparatus 1 to be used for printing (S37). Furthermore, the instruction unit 501 generates a print job based on the image and transmits the generated print job and print execution instructions to the image forming apparatus 1 indicated by the IP address via the communication unit 51 (S38).

[0094] In the image forming apparatus 1, when the control unit 100 receives the print job and print execution instruction via the communication unit 14, it temporarily stores the print data included in the print job in the memory built into the control unit 10, and executes printing according to the image as said print data (S39). When printing is complete, the control unit 100 sends a completion message indicating the completion of printing to the print server 5 via the communication unit 14 (S40).

[0095] In the print server 5, when the control unit 500 receives a completion message transmitted from the image forming apparatus 1 via the communication unit 51, the communication unit 51 transmits the completion message to the chatbot server 4 (S41).

[0096] In the chatbot server 4, when the control unit 400 receives a completion message sent from the print server 5 via the communication unit 51, it sends a message containing predetermined text, such as "Printing complete," from the communication unit 41 to the message server 3 via the communication unit 41 (S42).

[0097] In the message server 3, when the control unit 311 receives the above message sent from the chatbot server 4 via the communication unit 33, it sends the message from the communication unit 33 to each electronic terminal 2 that is a group member (S43).

[0098] When each electronic terminal 2, a group member, receives the above text via the communication unit 24, it displays a message 616B containing the text "Printing complete" on the talk screen of the display unit 21, as shown in the example in Figure 15B (S44).

[0099] Next, an example of the processing that occurs when an error occurs in the image forming apparatus 1 will be explained using the sequence diagram shown in Figure 16.

[0100] As explained using the sequence diagram above, in the image forming apparatus 1, when the control unit 100 receives a print job from the print server 5, it executes printing using the print data indicated by the received print job (S39).

[0101] During the execution of this printing operation, if the control unit 100 of the image forming apparatus 1 detects an error that prevents printing, such as running out of paper or running out of toner (S51), it displays a notification screen G2, as exemplified in Figure 17, on the display unit 130 (S52), and sends an error notification to the print server 5 via the communication unit 14 (S53). The error is detected by a known paper presence / absence sensor installed in the paper feed cassette of the image forming apparatus 1, or by a known toner empty detection sensor installed in the toner container or developing device. The control unit 100 detects the paper out error or toner empty error based on the detection signal output from the paper presence / absence sensor or toner empty detection sensor.

[0102] In the print server 5, when the cancellation unit 505 receives an error notification transmitted from the image forming apparatus 1 via the communication unit 51, it starts measuring time from the time the error notification was received and determines whether the elapsed time measured by the time measurement has exceeded a predetermined fixed time T without the error being resolved (S54).

[0103] If the cancellation unit 505 determines that the elapsed time has exceeded a certain period T, it sends a print cancellation instruction to the image forming apparatus 1 via the communication unit 51 (S55). Furthermore, the cancellation unit 505 deletes the print data (data related to the cancelled print) stored in the print data storage unit 522 (S56), and sends a print cancellation notification to the chatbot server 4 via the communication unit 51 (S57).

[0104] In the image forming apparatus 1, when the control unit 100 receives a print execution cancellation instruction from the print server 5 via the communication unit 14, it cancels the print in accordance with the cancellation instruction (S58) and deletes the print data stored in the memory or storage unit 15 (S59). The control unit 100 may continue to display the notification screen G2 on the display unit 130, or it may hide it from the display unit 130.

[0105] Meanwhile, in the chatbot server 4, when the control unit 400 receives a print cancellation notification sent from the print server 5 via the communication unit 41, it sends a predetermined text message, for example, "Printing has been canceled due to an error in the image forming apparatus," from the communication unit 41 to the message server 3 (S60).

[0106] In the message server 3, when the control unit 311 receives the text sent from the chatbot server 4 via the communication unit 333, it sends the text to the electronic terminal 2 from the communication unit 3 (S61).

[0107] In the electronic terminal 2, when the control unit 201 receives the above text via the communication unit 24, it displays a message 616C containing the text "Printing was canceled due to a printing error" on the display unit 21, as shown in the example in Figure 18 (S62).

[0108] According to the above embodiment, when an image forming apparatus is shared within a conversation group consisting of multiple members, even if a printing error occurs, it is possible to reduce the risk that the printed material may be seen or taken away by a third party.

[0109] In another embodiment, the cancellation unit 505 basically cancels printing if a printing error occurs in the image forming apparatus 1 and the above-mentioned fixed time T has elapsed. However, if a predetermined cancellation invalidation condition is met, the unit exceptionally refrains from canceling printing in the image forming apparatus 1 even if a printing error occurs and the above-mentioned fixed time T has elapsed.

[0110] If the cancellation unit 505 determines, based on the group member count information received by the communication unit 51 via the chatbot server 4 from the message server 3, that the cancellation invalidation condition, which is that there is only one group member, is met, then even if a printing error occurs and the above-mentioned certain period of time T has elapsed, the unit does not perform the process to cancel printing on the image forming apparatus 1.

[0111] For example, if there is only one group member, even if the electronic terminal 2 sends print data from the group's chat screen and the image forming apparatus 1 performs printing, there is little risk of others finding out that printing is taking place. Therefore, the risk of the printed material being seen or taken away by a third party is low. In such cases, even if a printing error occurs in the image forming apparatus 1 and the aforementioned period T has elapsed, it is more convenient to have the image forming apparatus 1 resume printing when the error is resolved rather than stopping the printing process.

[0112] Furthermore, the cancellation unit 505 stores in the device information storage unit 520, based on the usage information received from the image forming apparatus 1 via the communication unit 51, information indicating whether the image forming apparatus 1, as indicated by the usage information, is a public device shared by multiple people or a private device used by only one person. If the cancellation invalidation condition, which is that the image forming apparatus 1 is a private device, is met, the unit does not perform the process to cancel printing on the image forming apparatus 1, even if a printing error occurs and the above-mentioned certain period T has elapsed.

[0113] Furthermore, the cancellation unit 505 stores the installation location of the image forming apparatus 1 (for example, GPS (Global Positioning System) information) indicated by the installation location information received from the image forming apparatus 1 by the communication unit 51 in the device information storage unit 520. If the cancellation invalidation condition is met, which is that the installation location indicated by the installation location information is a location other than a predetermined public place (company, convenience store, etc.) (a predetermined private area), then the unit does not perform the process to cancel printing on the image forming apparatus 1, even if a printing error occurs and the above-mentioned certain period of time T has elapsed.

[0114] Alternatively, the cancellation unit 505 may be provided in the control unit 40 of the chatbot server 4 instead of the print server 5, so that the chatbot server 4 performs the functions of the print server 5 that would otherwise be handled by the cancellation unit 505.

[0115] The present invention is not limited to the configuration of the above embodiment and various modifications are possible. For example, although the above embodiment shows a configuration in which the print server 5 and the chatbot server 4 are separate servers, it is not limited to this, and it is also possible to adopt a configuration in which one server (for example, a communication server) operates as both the print server 5 and the chatbot server 4. Furthermore, it is also possible to adopt a configuration in which the message server 3, the print server 5, and the chatbot server 4 are all on a single server.

[0116] Furthermore, in the above embodiments, the configurations and processes shown in Figures 1 to 18 are merely one embodiment of the present invention, and the present invention is not intended to be limited to these configurations and processes.

Claims

1. The system comprises: a print server that controls printing for an image forming apparatus; an electronic terminal that has a messaging application installed that enables message exchange via a network in a chat format and displays a talk screen showing the message exchange on a display unit; a message server that registers multiple of the electronic terminals as members of a group capable of exchanging messages and provides a messaging service capable of exchanging messages; and a chatbot server that is registered with the message server as a member of the group and sends and receives data between the message server and the print server. The chatbot server, when the message server receives print data from one of the electronic terminals registered in the group via the group's talk screen and then receives a print command from one of the electronic terminals, transfers the print data received via the message server to the print server; the print server transfers the print data received from the chatbot server to the image forming apparatus and executes a print operation; and further, the chatbot server or the print server, A printing system that, if an error occurs in the image forming apparatus, printing based on the print data is not completed successfully by the image forming apparatus, and a predetermined period of time has elapsed since the error occurred without the error being resolved, executes a process to stop the image forming apparatus from performing the printing.

2. The printing system according to claim 1, wherein when the print server stops the execution of the printing by the image forming apparatus, the print server deletes the print data used for the printing stored in the print server, or causes the image forming apparatus to delete the print data.

3. The printing system according to claim 1, wherein the chatbot server or the print server does not perform the process to stop the execution of printing by the image forming apparatus even after a certain period of time has elapsed if a predetermined cancellation invalidation condition is met.

4. The printing system according to claim 3, wherein the chatbot server or the print server has a condition for cancellation of the group being that there is only one member.

5. The printing system according to claim 3, wherein the chatbot server or the print server is located in a predetermined private area, which is the condition for invalidating the termination.

6. The printing system according to claim 3, wherein the chatbot server or the print server is the private device among the public devices shared by multiple people and the private devices used by only one person, the condition for termination invalidation.

7. A printing system comprising: an electronic terminal having a messaging application installed that enables message exchange over a network in a chat format and displays a talk screen showing the message exchange on a display unit; a message server that registers multiple electronic terminals as members of a group capable of message exchange and provides a messaging service capable of message exchange; and a communication server that is registered with the message server as a member of the group, performs print control and print operation settings for an image forming apparatus, and sends and receives data with the message server, wherein the communication server, after the message server receives print data from one of the electronic terminals registered in the group via the group's talk screen, and then receives a print instruction from one of the electronic terminals, transfers the print data received via the message server to the image forming apparatus and performs a print operation; and further, if an error occurs in the image forming apparatus and printing based on the print data is not completed normally by the image forming apparatus, and a predetermined period of time has elapsed since the error occurred without the error being resolved, the communication server executes a process to stop the image forming apparatus from performing the print.

Images