Image processing apparatus, method for controlling image processing apparatus, and program

Abstract

To improve usability by performing, on the basis of a reaction in a chat, predetermined processing designated to image data transmitted from an image forming apparatus comprising a scanner.SOLUTION: An image processing apparatus communicable with an information processing apparatus providing a chat service comprises: transmission means that transmits image data transmitted from an image forming apparatus comprising a scanner to the information processing apparatus so as to upload the image data to a talk room in the chat service; receiving means that receives a response to the details of the image data in the chat service from the information processing apparatus; and control means that performs predetermined processing designated to the image data on the basis of the response received by the receiving means.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to an image processing device, a control method for an image processing device, and a program. [Background technology]

[0002] Patent Literature 1 discloses that an image forming device equipped with a scanner such as an MFP scans an image of an original document and generates image data, which is then transmitted to, for example, a chat server that provides a chat service. As a result, the image data is shared in a chat room of the chat service. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-078084 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for users of the chat service to perform image processing such as image synthesis on the uploaded images. It is time-consuming for users to manually perform image processing on the uploaded images using a PC or the like. The technique of Patent Document 1 allows an image forming device to scan an image of a document and transmit the generated image data to the chat service, but does not allow any processing to be performed on the uploaded image data based on the chat reaction.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to improve usability by performing specified predetermined processing on image data sent from an image forming device equipped with a scanner based on chat reactions. [Means for solving the problem]

[0006] The image processing device of the present disclosure is an image processing device capable of communicating with an information processing device that provides a chat service, and is characterized in that it comprises a transmitting means for transmitting image data sent from an image forming device equipped with a scanner to the information processing device so as to upload the image data to a talk room of the chat service, a receiving means for receiving a response to the contents of the image data in the chat service from the information processing device, and a control means for performing a predetermined processing specified for the image data based on the response received by the receiving means. Effect of the Invention

[0007] According to the technology of the present disclosure, it is possible to improve usability by performing a specified process on image data sent from an image forming device equipped with a scanner based on reactions in chat. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration according to the present disclosure. [Diagram 2] FIG. 2 is a diagram showing an example of the hardware configuration of an MFP 110. [Diagram 3] FIG. 2 is a diagram showing an example of the hardware configuration of a client PC, an MFP linkage service, and a message application service. [Figure 4] FIG. 2 is a diagram showing an example of a software configuration of the present disclosure. [Diagram 5] FIG. 2 shows an example of a home screen displayed on the operation unit 220 of the MFP 110. [Figure 6] FIG. 4 is a diagram showing an example of a sequence illustrating a process flow between each device. [Figure 7] FIG. 11 is a diagram showing an example of a screen transition in a scan-to-chat process. [Figure 8] FIG. 13 is a diagram showing an example of a message screen of a message application. [Figure 9] FIG. 4 is a diagram showing an example of a sequence illustrating a process flow between each device. [Figure 10] FIG. 13 is a diagram showing an example of a screen for scan-to-chat processing. [Figure 11] FIG. 13 is a diagram showing an example of a message screen of a message application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments do not limit the present disclosure, and not all of the combinations of features described in the embodiments are necessarily essential to the solutions of the present disclosure. Note that the same configurations will be described with the same reference numerals. Also, each process (step) in the flow chart will be indicated with a reference numeral beginning with "S".

[0010] [First embodiment] The first embodiment of the present disclosure will be described below.

[0011] 1 is a diagram showing an example of an overall configuration diagram of a system according to the present disclosure. The image processing system includes an MFP (Multifunction Peripheral) 110, a client PC 111, an MFP linkage service 120, a message application service 130, and cloud storage 140. The MFP 110 and the client PC 111 are communicably connected to a server that provides various services on the Internet via a LAN (Local Area Network) or a wireless LAN, etc.

[0012] The MFP 110 is an example of an image forming apparatus or image processing apparatus having multiple functions such as a scanner and a printer. The client PC 111 is a computer or application that receives a service requested from the MFP cooperation service 120. Although described as a PC here, it may be a tablet terminal or a mobile terminal such as a smartphone.

[0013] The MFP linkage service 120 is an example of an image processing device having a function of saving an image file scanned by the MFP 110 on its own server, performing image processing such as image synthesis, and transferring the file to a service capable of saving the file, such as another storage service. The message application service 130 is a server (information processing device) such as a chat server that receives messages or image data sent from the MFP linkage service 120 or a user terminal such as the client PC 111. The message application service 130 also manages a chat service that is displayed on the user terminal in response to a user operation. The cloud storage 140 is used for a service that can save files via the Internet and retrieve files via a web browser.

[0014] The image processing system of this embodiment includes, but is not limited to, an MFP 110, a client PC 111, an MFP collaboration service 120, a message application service 130, and a cloud storage 140. For example, the MFP 110 may serve both the roles of the client PC 111 and the MFP collaboration service 120. The MFP collaboration service 120 may be connected to a server on a LAN rather than on the Internet. The cloud storage 140 may be replaced with a mail server or the like, and a scanned image may be attached to an email and sent.

[0015] FIG. 2 is a hardware configuration diagram of the MFP 110. The MFP 110 includes a control unit 210, an operation unit 220, a printer unit 221, a scanner unit 222, and a modem 223. The control unit 210 is composed of the following units 211 to 219, and controls the operation of the entire MFP 110. The CPU 211 reads out a control program stored in a ROM 212, and executes and controls various functions of the MFP 110, such as reading, printing, and communication. The RAM 213 is used as a main memory of the CPU 211 and a temporary storage area such as a work area. In this embodiment, one CPU 211 executes the process shown in the flowchart described later using one memory (RAM 213 or HDD 214), but is not limited to this. For example, a plurality of CPUs and a plurality of RAMs or HDDs may cooperate to execute the process. The HDD 214 is a large-capacity storage unit that stores image data and various programs. The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 includes a touch panel and a keyboard, and receives operations, inputs, or instructions from a user. The printer I / F 216 is an interface that connects the printer unit 221 and the control unit 210. Image data for printing is transferred from the control unit 210 to the printer unit 221 via the printer I / F 216, and is printed on a recording medium. The scanner I / F 217 is an interface that connects the scanner unit 222 and the control unit 210. The scanner unit 222 generates image data by reading an original placed on an original table or an ADF (Auto Document Feeder), not shown, and inputs the image data to the control unit 210 via the scanner I / F 217. The MFP 110 prints (copies) the image data generated by the scanner unit 222 from the printer unit 221. The MFP 110 can also transmit the image data by file transmission or email transmission. The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. A modem 223 communicates image data by facsimile between the MFP 110 and a facsimile device on the PSTN. A network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN.The MFP 110 transmits image data or information to various services on the Internet via a network I / F 219, and receives various types of information.

[0016] 3 is a hardware configuration diagram of the client PC 111, the MFP collaboration service 120, and the message application service 130. The client PC 111, the MFP collaboration service 120, and the message application service 130 include a CPU 311, a ROM 312, a RAM 313, a HDD 314, and a network I / F 315. The CPU 311 reads out a control program stored in the ROM 312, executes various processes, and controls the overall operation. The RAM 313 is used as a main memory of the CPU 311 and a temporary storage area such as a work area. The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects to the Internet, and can transmit and receive data to and from devices such as the MFP 110. In addition, an operation panel (not shown) may be provided to present the transmitted and received data to a user.

[0017] 4 is a diagram showing the software configuration of the image processing system according to this embodiment. The software configuration of the MFP 110 is roughly divided into a native function unit 410 and an additional function unit 420. Each unit included in the native function unit 410 is provided as standard in the MFP 110. The additional function unit 420 is an application additionally installed in the MFP 110. The additional function unit 420 is an application based on Java (registered trademark), and can easily realize the addition of functions to the MFP 110. Note that other additional applications not shown may be installed in the MFP 110.

[0018] The native function unit 410 includes a scan execution unit 411 and an image data storage unit 412. The additional function unit 420 includes a display control unit 421, a scan instruction unit 422, and a cooperation service request unit 423.

[0019] The scan execution unit 411 receives a scan request including scan settings from the scan instruction unit 422. In accordance with the scan request, the scan execution unit 411 generates scan image data by reading a document placed on a platen glass with the scanner unit 222 via the scanner I / F 217. The generated scan image data is sent to the image data storage unit 412. The scan execution unit 411 sends a scan image identifier that uniquely identifies the stored scan image data to the scan instruction unit 422. The scan image identifier (not shown) is a number, symbol, alphabet, or the like that uniquely identifies an image scanned in the MFP 110. The image data storage unit 412 stores the scan image data received from the scan execution unit 411 in the HDD 214 as image file data.

[0020] The display control unit 421 displays a UI screen for accepting operations by a user on a display unit having a touch panel function of the operation unit 220 of the MFP 110. For example, the display control unit 421 displays UI screens for inputting authentication information for accessing the MFP linkage service 120, scan settings, operations for starting scanning, preview screens, etc. The scan instruction unit 422 requests the scan execution unit 411 to perform scan processing according to scan settings based on user instructions input via the UI screen.

[0021] The scan instruction unit 422 acquires from the image data storage unit 412 the scan image data corresponding to the scan image identifier received from the scan execution unit 411. The scan instruction unit 422 requests the linked service request unit 423 to instruct the MFP collaboration service 120 to process the acquired scan image data. The linked service request unit 423 requests various processes from the MFP collaboration service 120. For example, the linkage service request unit 423 requests login, acquisition of executable workflow information, transmission of a scanned image, execution of a workflow, etc. Protocols such as REST or SOAP are used for communication with the MFP collaboration service 120, but other communication means may also be used.

[0022] The MFP cooperation service 120 includes a request control unit 431, an image processing unit 432, a data management unit 434, a display control unit 435, and a workflow processing unit 440. The request control unit 431 waits in a state in which it can receive a request from an external device. When it receives a processing request, it instructs the image processing unit 432, the data management unit 434, the display control unit 435, and the workflow processing unit 440 to perform processing as appropriate in response to the request. The image processing unit 432 performs image synthesis processing such as synthesizing an imprint image with an image. The image processing unit 432 can also perform OCR (Optical Character Recognition) processing (character recognition processing) on ​​an image, conversion processing (image correction processing) such as image rotation and tilt correction, and electronic signature addition processing. The data management unit 434 holds user information and various setting data managed by the MFP cooperation service 120, and definition information of a workflow executed by the workflow processing unit 440.

[0023] Display control unit 435 receives a request from a web browser running on a user terminal such as PC 111 or a smartphone connected via the Internet, and returns screen configuration information (HTML, CSS, etc.) required for screen display. The user can change the settings of MFP linkage service 120 via a screen displayed on the web browser. For example, the user can set authentication information when MFP linkage service 120 connects to message app service 130 or cloud storage 140, or check and set user information registered in MFP linkage service 120.

[0024] The workflow processing unit 440 executes workflow processing according to the workflow definition information held in the data management unit 434 and the workflow execution request received from the MFP 110. Here, the workflow processing unit 440 posts (transmits) the scanned image received from the MFP 110 together with the workflow execution request to the message app service 130. After that, when it detects that a predetermined user operation has been performed on the posted message, the workflow processing unit 440 requests the image processing unit 432 to perform a specified predetermined process such as image synthesis processing. The workflow processing unit 440 transmits the image data on which the specified predetermined process such as image synthesis processing has been performed to the message app service 130 or the cloud storage 140. The image or image data on which the specified process has been performed may be stored in the HDD 314 of the MFP cooperation service 120 or the cloud storage 140. Note that the message app service 130 or the cloud service such as the cloud storage 140 generally publishes an interface that enables various processing requests using a protocol such as REST or SOAP. The workflow processing unit 440 operates the message app service 130 or the cloud storage 140 using the published interface.

[0025] 4 illustrates an example of a configuration in which the additional function unit 420 is installed in the MFP 110, but the present invention is not limited to this configuration. The client PC 111 may include the functions of the additional function unit 420. Also, the MFP 110 may be configured to include various functions of the MFP cooperation service 120.

[0026] 5 is a diagram showing an example of a home screen displayed on operation unit 220 of MFP 110. Operation unit 220 includes touch panel 501 that displays an operation screen, and LEDs 510 and 511. Touch panel 501 is an instruction means, and functions as a receiving means that receives instructions from a user, and also functions as a display means that displays a screen. A user directly touches an object on a screen displayed on touch panel 501 with a finger or a stylus, etc., to instruct execution of each function based on the displayed screen. In addition, the touch panel 501 may have a function of reading an ID card (contactless card) to authenticate a user.

[0027] 5 displays a home screen 508. The home screen 508 is the first screen for instructing the execution of each function of the MFP 110. In other words, the home screen 508 is a screen for selecting a screen display for performing various settings for functions executed by the MFP 110, such as copy, fax, scan, and media print.

[0028] The status check button 505 is an object for displaying a screen for checking the status of the MFP 110 (status check screen). It is possible to display the transmission history and job execution history from the status check screen (not shown). The scan-to-chat button 502 is an object for displaying an execution screen for the scan-to-chat process. Details of the scan-to-chat process will be described with reference to FIG. 6. When the scan-to-chat button 502 is selected by the user, a scan-to-chat login screen 701, which will be described later with reference to FIG. 7, is displayed on the operation unit 220.

[0029] Scan button 503 is an object for displaying a scan selection screen (not shown) from MFP 110. The scan selection screen is a screen for selecting a transmission function such as electronic mail transmission (E-mail), file transmission by SMB, FTP, or HTTP, and Internet fax (I-fax) transmission. Here, SMB is an abbreviation for Server Message Block. Touching an object indicating a displayed transmission function displays a setting screen for each transmission function. Address book button 504 is an object for displaying an address book screen of MFP 110 when selected by the user.

[0030] LEDs 510 and 511 notify the user of the status of MFP 110. LED 510 lights up when an e-mail or a print job is being received or executed. LED 511 lights up when an error occurs in MFP 110. Stop button 506 is an object for canceling various operations, and is an object that is constantly displayed on operation unit 220. HOME button 507 is an object for displaying home screen 508, and is an object that is constantly displayed on operation unit 220. Menu button 512 is an object for displaying a screen for setting the environment, such as the display language, or for setting each function.

[0031] 6 is a sequence diagram showing the flow of processing in this embodiment. Specifically, the flow of processing between each device when an image scanned by MFP 110 is converted into a file, transmitted to message application service 130 via MFP linkage service 120, subjected to image synthesis processing, and transmitted to cloud storage 140 is shown. Here, the image synthesis processing is an example of a specified processing.

[0032] In the normal state, the MFP 110 displays on the touch panel a main screen on which buttons for implementing each function it provides are arranged. When an additional application for sending scanned forms to the MFP collaboration service 120 is installed in the MFP 110, a scan-to-chat button 502 that uses the application's function is displayed on the main screen of the MFP 110, as shown in Fig. 5. When the user presses the scan-to-chat button 502, a screen for sending the scanned form to the MFP collaboration service 120 is displayed, and the process shown in the sequence diagram of Fig. 6 is performed.

[0033] In S601, the MFP 110 displays a login screen (a scan-to-chat login screen 701, which will be described later in FIG. 7) for inputting authentication information for accessing the MFP collaboration service 120. Then, upon receiving a login instruction input from the user, the MFP collaboration service 120 transmits the authentication information to the MFP collaboration service 120 in S602. In S603, the MFP collaboration service 120 verifies whether the user name and password included in the login request are correct, and if correct, returns an access token to the MFP 110. Subsequent requests made from the MFP 110 to the MFP collaboration service 120 are issued together with this access token, and the user to be processed can be identified by the information included in the access token. The user authentication is performed using a generally known method (Basic authentication, Digest authentication, authorization using OAuth, etc.).

[0034] After the login process is completed, in S604, the MFP 110 requests the MFP collaboration service 120 to obtain workflow information executable by the logged-in user. In S605, the MFP collaboration service 120 obtains the workflow information executable by the logged-in user from the data management unit 434. In S606, the MFP collaboration service 120 transmits the obtained executable workflow information to the MFP 110. The workflow information includes, for example, an ID for identifying the workflow, a workflow name, a default file name, a destination talk room (an upload destination talk room), approved user information, and the like.

[0035] In S607, the MFP 110 displays a scan setting screen (scan-to-chat setting screen 711, which will be described later in FIG. 7). The screen accepts the workflow to be executed, various settings related to the workflow (such as approver), and settings related to scan reading. When the paper form to be scanned is placed on the platen glass or the ADF and the scan start button is pressed, in S608 the MFP 110 executes scanning and generates image data that digitizes the paper form. In S609, the MFP 110 transmits the scanned image generated by the scan process and various settings related to the workflow to the MFP collaboration service 120. Here, information related to the specified process is also transmitted from the MFP 110 to the MFP collaboration service 120 via the collaboration service request unit 423 of the MFP 110 and the request control unit 431 of the MFP collaboration service 120.

[0036] In S610, the MFP cooperation service 120 requests the workflow processing unit 440 to execute a workflow in accordance with various information received by the request control unit 431 from the MFP 110. The workflow processing unit 440 executes the workflow indicated in S611 to S617.

[0037] In S611, the workflow processing unit 440 posts (transmits) the scanned image to the message app service 130. In S612, information indicating that the posting has been accepted is received from the message app service 130. This information includes a message ID that uniquely identifies the posted message. When posting a scanned image, a comment (character string) may be sent together with the image.

[0038] In S613, the workflow processing unit 440 requests the message application service 130 to acquire the message information posted in S611. In S614, the workflow processing unit 440 receives the message information from the message application service 130. As described later with reference to Figs. 8(a) and 8(b), the message information includes response information indicating whether or not a reaction such as "Like!" has been made to the posted message, user information on the user who made the reaction, and the like.

[0039] In S615, the workflow processing unit 440 refers to the message information received in S614 and determines whether a predetermined user process (reaction) has been performed by the user (approver) designated on the scan-to-chat setting screen 711. If it is determined that the predetermined user process has been performed, the process proceeds to S616. If it is determined that the predetermined user process has not been performed, the process returns to the process of S613. In this case, the processes from S613 to S615 are repeated. If the process does not proceed to S616 within a predetermined period, the workflow processing unit 440 may treat the workflow as having failed and notify the user of the failure of the workflow by using a means such as sending a message to the message app service 130. In other words, if the process does not proceed to S616 within a predetermined period, the workflow processing unit 440 determines that approval by the user (approver) has not been obtained, and does not instruct the image processing unit 432 to execute the designated predetermined process.

[0040] In S616, the workflow processing unit 440 uses the function of the image processing unit 432 to perform a predetermined image composition on the scanned image. Here, it is assumed that an image of a seal of the approved user's name is composed at the coordinates of an image predefined in the workflow. In S617, the workflow processing unit 440 transmits a file of the composite image obtained by the image composition process to the cloud storage 140. At this time, the composite image file may also be stored in the HDD 314 of the MFP cooperation service 120. When transmission of the composite image file is completed, the process of the sequence diagram shown in FIG. 6 ends.

[0041] Fig. 7 is a diagram showing an example of screen transitions in scan-to-chat processing. When the scan-to-chat button 502 displayed on the home screen 508 shown in Fig. 7(a) is pressed, a scan-to-chat login screen 701 shown in Fig. 7(b) is displayed on the touch panel 501 of the operation unit 220.

[0042] A scan-to-chat login screen 701 is a screen for logging in to the MFP linkage service 120. A user name input field 702 and a password input field 703 accept input of authentication information (user name and password) required to log in to the MFP linkage service 120. When a login button 704 is pressed, a login process to the MFP linkage service 120 is performed using the authentication information whose input has been accepted. Here, the user name and password are used as the authentication information. Alternatively, a configuration may be adopted in which reading of an ID card (contactless card) is accepted and login to the MFP linkage service 120 is performed using the ID card information.

[0043] When login to the MFP linkage service 120 is successful and acquisition of workflow information that the logged-in user can execute is completed, a scan-to-chat setting screen 711 shown in Fig. 7(c) is displayed on the touch panel 501 of the operation unit 220. The scan-to-chat setting screen 711 is a screen for receiving the workflow to be executed, various settings related to the workflow (such as approver), settings related to scan reading, and the like.

[0044] The workflow selection field 712 accepts the designation of a workflow to be executed from candidates presented in a pull-down menu based on the workflow information received from the MFP collaboration service 120. Here, the workflow "Stamp on invoice A" is selected. The file name input field 713 accepts input of a file name when the scanned image data obtained by scanning and digitizing a paper document is saved in the message app service 130 or cloud storage 140. When the scan to chat setting screen 711 is displayed, the file name input field 713 is in a state where the default file name included in the workflow information received from the MFP collaboration service 120 is input. It may be configured not to accept input of a file name (the file name cannot be changed from the default file name).

[0045] The destination input field 714 accepts input of the destination talk room of the message app service 130. When the scan-to-chat setting screen 711 is displayed, the destination input field 714 is in a state where the destination talk room included in the workflow information received from the MFP collaboration service 120 is input. This input field may also be configured not to accept input (the destination talk room cannot be changed from the one included in the workflow information). The approver selection field 715 accepts designation of an approving user from candidates presented in a pull-down menu based on the workflow information received from the MFP collaboration service 120. Here, the approver "Section Manager userD" is selected by a user operation.

[0046] Scan setting buttons 721 to 724 accept settings for generating image data by reading a document set on a document tray or an ADF (Auto Document Feeder), not shown. When a scan start button 731 is pressed, a scan is executed to generate scanned image data by digitizing a paper document, and the generated scanned image and various settings related to the workflow are sent to the MFP cooperation service 120.

[0047] 8(a) and 8(b) are diagrams showing a screen that is received by a user terminal (such as the client PC 111) and displayed on a display panel of the user terminal. A user ID and a password for a user to log in to the message app service 130 are registered in the user terminal in advance. Then, in order for the user to use the message app service 130 using the user terminal, the user ID and the password are transmitted to the message app service 130. The message app service 130 performs user authentication based on the received user ID and password. Then, the message app service 130 transmits screen data of the message app service 130 for the authenticated user to the user terminal. As a result, the user terminal displays the screen shown in FIG. 8(a).

[0048] A screen 801 shown in FIG. 8(a) and a screen 821 shown in FIG. 8(b) are diagrams showing a series of message screens displayed on a user terminal. In an area 802, user information of a user (a logged-in user) who operates the user terminal and group information to which the user belongs are displayed. This information is registered in association with the authenticated user by the message app service 130 that authenticated the logged-in user. The message app service 130 transmits this information to the user terminal. In an area 803, channel information to which the logged-in user belongs is displayed. This channel information is also registered in association with the authenticated user by the message app service 130 that authenticated the logged-in user. The message app service 130 transmits this channel information (talk room information) to the user terminal. The logged-in user selects any channel information (talk room information) from the area 803 and enters the channel (talk room). This enables the logged-in user to exchange messages with all members who belong to the selected channel (talk room).

[0049] Area 804 displays a history of messages sent to people registered in the channel selected by the user in area 803. Here, messages are displayed in area 804 in chronological order. In other words, the lower a message is displayed in area 804, the newer it is. Area 805 displays a history of messages sent by the logged-in user. Messages may be just text, like the comments in area 805, or may include file information.

[0050] A notification message from the MFP collaboration service 120 is displayed in message 811. Here, a message including a scanned image and a comment text transmitted from the MFP collaboration service 120 to the message application service 130 in S611 is displayed. That is, as described in the section of FIG. 7(c), a file (image data) specified on a channel (talk room) specified on the scan to chat setting screen 711 shown in FIG. 7(c) is transmitted to a specified user. A file information field 812 displayed in message 811 displays file information of the scanned image. By selecting the file information field 812, the file can be downloaded or the file contents can be referred to.

[0051] The reaction button 813 accepts reactions from logged-in users to the message 811. When the reaction button 813 is pressed, a reaction information field 831 is displayed in a screen 821 shown in Fig. 8(b). Here, only the reaction "Like!" can be selected, but other reactions may also be selectable.

[0052] The reaction information field 831 displays information on reactions made to the message 811. Here, an example is shown in which a user (Section Manager User D) who has logged in to the message app service 130 has pressed the reaction button 813. That is, it is shown that one user has made a reaction of "Like!". When the above-mentioned processes of S613 and S614 are performed in this state, the information on the message 811 includes information that the approving user (Section Manager User D) specified in the approver selection field 715 has made a predetermined reaction. Then, it is determined in the process of S615 that a predetermined user operation has been performed, and the process proceeds to S616 and subsequent processes. It is also possible to cancel the reaction or refer to a list of users who have made reactions by selecting the reaction button 813.

[0053] In addition, if the approval user accidentally presses the reaction button, there may be cases where the reaction is cancelled afterwards. In consideration of such cases, in the process of S615, if a state where a predetermined user process has been performed continues for a certain period of time, the process may proceed to S616. In addition, in the present embodiment, the configuration has been described in which workflow information is stored in the data management unit 434 in advance. A configuration in which a user creates a workflow definition or the like via the display control unit 435, and the created workflow information may be stored in the data management unit 434.

[0054] In this embodiment, image synthesis is exemplified as an example of the specified predetermined processing, but the specified predetermined processing is not limited to this. For example, the specified predetermined processing also includes OCR processing for a scanned image, image correction processing such as image rotation or tilt correction, and electronic signature addition processing. Specific operations of the OCR processing, image correction processing, and electronic signature addition processing will be described below.

[0055] In OCR processing of a scanned image, an applicant requesting permission for OCR processing sets approval for "permission of OCR processing" in MFP 110. When a document is scanned in MFP 110, the scanned image is sent to MFP collaboration service 120. MFP collaboration service 120 attaches the scanned image and sends a message requesting permission for OCR processing to an approver who provides approval on message app service 130. When the approver executes a reaction indicating approval of OCR processing, OCR processing is performed on the scanned image.

[0056] In image correction processing on a scanned image, an applicant requesting permission for image correction processing sets approval for "permission of image correction processing" in MFP 110. When a document is scanned in MFP 110, the scanned image is sent to MFP collaboration service 120. MFP collaboration service 120 attaches the scanned image and sends a message requesting permission for image correction processing to an approver who will provide approval on message app service 130. When the approver executes a reaction indicating approval of the image correction processing, the scanned image is subjected to image correction processing.

[0057] In the process of adding a digital signature to a scanned image, an applicant requesting permission for the process of adding a digital signature sets approval for "permission for the process of adding a digital signature" in MFP 110. When a document is scanned in MFP 110, the scanned image is sent to MFP cooperation service 120. MFP cooperation service 120 sends a message, with the scanned image attached, requesting permission for the process of adding a digital signature to an approver on message app service 130 who will provide approval. When the approver executes a reaction indicating approval for the process of adding a digital signature, the process of adding a digital signature to the scanned image is performed.

[0058] Furthermore, the user may be allowed to select one or a combination of the above four processes. Examples of multiple combinations of the four processes are described below. For example, the content of the approval may be to perform an image synthesis process after performing an image correction process. That is, if the original document is skewed when the applicant scans the original document using the MFP 110, the skewed image data is sent to the approver on the message application service 130. When the approver performs an approval reaction, the image is made upright by the image correction process, and an image synthesis indicating "approval" can be automatically performed on the upright image. Alternatively, the content of the approval may be to perform an image correction process, an OCR process, and then an electronic signature addition process.

[0059] As described above, according to this embodiment, the approver can check scanned images of application documents, etc., on the chat service. Then, by simply making a predetermined reaction, the specified predetermined processing required after approval, such as image synthesis, can be automatically performed, eliminating the need to perform the specified predetermined processing, such as image synthesis. Therefore, usability can be improved by performing the specified predetermined processing on image data transmitted from an image forming device equipped with a scanner based on the chat reaction.

[0060] [Second embodiment] Next, a second embodiment of the present disclosure will be described. In the first embodiment, it is possible to perform a specified predetermined process such as image synthesis by one designated approved user performing a specified reaction. In the second embodiment, an example in which a specified predetermined process such as image synthesis is performed by a plurality of approved users performing a specified reaction will be described. In this embodiment, an example of the specified predetermined process is image synthesis. Note that a description of the same parts as in the first embodiment, such as the system configuration and the hardware configuration of the device, will be omitted.

[0061] 9 is a sequence diagram showing the flow of processing in this embodiment. Specifically, it shows the flow of processing between each device when an image scanned by MFP 110 is converted into a file, transmitted to message application service 130 via MFP linkage service 120, subjected to image synthesis processing, and transmitted to cloud storage 140. Only differences from the first embodiment will be described here.

[0062] The processing from S901 to S906 is the same as the processing from S601 to S606, and therefore the description will be omitted. In S907, the MFP 110 displays a scan setting screen and accepts user input. Here, the processing when a workflow different from that of the first embodiment is selected in the workflow selection field 712 (or 1012) will be described. An example of a scan setting screen 1011 in this embodiment will be described below with reference to FIG. 10.

[0063] The workflow selection field 1012 accepts the designation of a workflow to be executed from candidates presented in a pull-down menu based on the workflow information received from the MFP collaboration service 120. Here, unlike the first embodiment, it is assumed that a workflow requiring approval by multiple people (workflow name is "Stamp on invoice B") has been selected. When a workflow requiring approval by multiple people is selected, multiple approver selection fields are displayed, such as a first approver selection field 1015 and a second approver selection field 1016. Here, an approver named "Section Manager userD" has been selected in the first approver selection field 1015, and an approver named "Director userE" has been selected in the second approver selection field 1016.

[0064] Returning to the description of FIG. 9, the processing from S908 to S914 is the same as the processing from S608 to S614, and therefore the description will be omitted. In S915, the workflow processing unit 440 refers to the message information received in S914 and determines whether or not a predetermined user process (reaction) has been performed by the user designated in the first approver selection field 1015. If the workflow processing unit 440 determines that the predetermined user process has been performed by the designated user, the processing proceeds to S916. If the workflow processing unit 440 determines that the predetermined user process has not been performed by the designated user, the processing returns to S913.

[0065] In S916, the workflow processing unit 440 performs a first predetermined image synthesis on the scanned image using the function of the image processing unit 432. Here, a seal image of the user name of the user specified in the first approver selection field 1015 is synthesized at the coordinates of an image predefined in the workflow. In S917, the workflow processing unit 440 again transmits the file of the synthesized image obtained by this process to the message app service 130. In S918, the workflow processing unit 440 receives information including a message ID that uniquely identifies the message transmitted in S917 from the message app service 130.

[0066] In S919, the workflow processing unit 440 requests the message application service 130 to acquire the message information posted in S917. In S920, the workflow processing unit 440 receives the message information from the message application service 130. In S921, the workflow processing unit 440 refers to the message information received in S920 and determines whether or not a predetermined user process (reaction) has been performed by the user designated in the second approver selection field 1016. If the workflow processing unit 440 determines that the predetermined user process has been performed by the designated user, the process proceeds to S923. If the workflow processing unit 440 determines that the predetermined user process has not been performed by the designated user, the process returns to S920.

[0067] In S922, the workflow processing unit 440 uses the function of the image processing unit 432 to perform a second predetermined image composition on the image file on which the first predetermined image composition was performed in S916. Here, a seal image of the user name of the user specified in the second approver selection field 1016 is composed at coordinates predefined in the workflow, different from the coordinates used in the first predetermined image composition. In S923, the workflow processing unit 440 transmits the file of the composite image obtained by this process to the cloud storage 140.

[0068] 11(a) and 11(b) are diagrams showing screens that are received by a user terminal (such as the client PC 111) and displayed on a display panel or the like of the user terminal when screen data generated by the message app service 130 is received by the user terminal. A screen 1101 in FIG. 11(a) is a diagram showing a message screen that is displayed on the user terminal when the processing up to S918 has been performed. Here, it is assumed that the user who has logged in to the message app service 130 is the manager of userE.

[0069] Area 1122 displays a list of users who reacted to message 1111. Message 1131 is an example of a notification message sent from the MFP linkage service 120 to the message application service 130 in the processing of S917. File information field 1132 displayed in message 1131 displays file information of the composite image generated in the processing of S916. When file information field 1132 is selected, the file can be downloaded and the file contents can be referenced.

[0070] The reaction button 1133 accepts a reaction from a user to the message 1131. When the logged-in user (Manager userE) presses the reaction button 1133, the screen transitions to a screen 1141 shown in FIG. 11(b). The reaction information field 1134 shows an example in which the logged-in user (Manager userE) presses the reaction button 1133, and indicates that one user has made a reaction of "Like!". The area 1135 displays a list of users who have made a reaction to the message 1131. When the above-mentioned processes of S919 and S920 are performed in this state, the information of the message 1131 includes that the approval user (Manager userE) specified in the second approver selection field 1016 has made a predetermined reaction. When it is determined in the process of S921 that a predetermined user operation has been performed, the process proceeds to the process of S923 and subsequent processes.

[0071] As described above, according to this embodiment, even if there are multiple approvers, it is possible to improve usability by performing a specified processing on image data sent from an image forming device equipped with a scanner based on reactions in chat.

[0072] [Third embodiment] In the first embodiment, an example of image synthesis has been described as the specified predetermined process. Specifically, an example has been shown in which the workflow processing unit 440 synthesizes images and transmits the synthesized image to the cloud storage 140 when the specified approved user performs a predetermined reaction. In this configuration, in order to check the synthesized image, it is necessary to access the cloud storage 140, and it is not possible to check the image on the chat service. Therefore, a configuration in which the synthesized image is sent to the cloud storage 140 in S617 and the synthesized image is also sent to the message app service 130 may be used.

[0073] Alternatively, before transmitting the composite image to the cloud storage 140, the workflow processing unit 440 may transmit the composite image to the message app service 130 and perform the same process as the process from S613 to S615. After that, the workflow processing unit 440 may transmit the composite image to the cloud storage 140 after determining that a user process has been performed on the message in which the composite image has been posted.

[0074] According to these configurations, it becomes possible to check the contents of the composite image on the message application service 130. Note that image composition is merely one example of the specified predetermined processing. The specified predetermined processing also includes processing such as OCR processing for a scanned image, image correction processing such as image rotation and tilt correction, and digital signature addition processing. The specified predetermined processing may also be a combination of the above processing.

[0075] [Other embodiments] The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.

[0076] The disclosure of the above-described embodiment includes the following configurations.

[0077] (Configuration 1) An image processing device capable of communicating with an information processing device that provides a chat service, comprising: a transmitting means for transmitting image data sent from an image forming device equipped with a scanner to the information processing device so that the image data is uploaded to a talk room of the chat service; a receiving means for receiving a response to the contents of the image data in the chat service from the information processing device; and a control means for performing a predetermined processing specified for the image data based on the response received by the receiving means.

[0078] (Configuration 2) The image processing device according to configuration 1, wherein, when the response is an approval for the contents of the image data, the control means performs the specified predetermined processing on the image data.

[0079] (Configuration 3) The image processing device according to configuration 1, wherein if the response is not an approval of the contents of the image data, the control means does not perform the specified processing on the image data.

[0080] (Configuration 4) The image processing device according to configuration 3, characterized in that if the response to the contents of the image data is not obtained within a predetermined period of time, the control means determines that the response is not an approval of the contents of the image data.

[0081] (Configuration 5) The image processing device according to configuration 1, wherein the specified processing is one or more combinations of an image synthesis processing for synthesizing another image with the image data, a character recognition processing for the image data, an image correction processing for the image data, or a processing for adding an electronic signature to the image data.

[0082] (Configuration 6) The image processing device described in Configuration 1, characterized in that the sending means sends a message including the image data to a user on a talk room of the chat service specified by user operation on an image forming device equipped with the scanner.

[0083] (Configuration 7) The image processing device according to configuration 6, wherein the users in the specified talk room of the chat service are multiple users.

[0084] (Configuration 8) The image processing apparatus according to configuration 1, further comprising a storage means for storing the image data after the specified processing has been performed.

[0085] (Configuration 9) A control method for an image processing device capable of communicating with an information processing device providing a chat service, comprising the steps of: sending image data sent from an image forming device equipped with a scanner to the information processing device so as to upload the image data to a talk room of the chat service; receiving a response to the contents of the image data in the chat service from the information processing device; and performing a predetermined processing specified for the image data based on the response in the receiving step.

[0086] (Configuration 10) A program for causing a computer to function as the image processing device according to any one of configurations 1 to 8.

Claims

1. An image processing device capable of communicating with an information processing device that provides a chat service, a transmitting means for transmitting image data transmitted from an image forming apparatus having a scanner to the information processing apparatus so as to upload the image data to a talk room of the chat service; a receiving means for receiving a response to the content of the image data in the chat service from the information processing device; a control means for performing a predetermined process designated for the image data based on the response received by the receiving means; An image processing device comprising:

2. 2. The image processing apparatus according to claim 1, wherein, when the response is an approval for the content of the image data, the control means performs the specified process on the image data.

3. 2. The image processing apparatus according to claim 1, wherein if the response is not an approval for the contents of the image data, the control means does not perform the specified process on the image data.

4. 4. The image processing apparatus according to claim 3, wherein, if the response to the content of the image data is not received within a predetermined period of time, the control means determines that the response is not an approval of the content of the image data.

5. 2. The image processing device according to claim 1, wherein the specified processing is one or more combinations of an image synthesis processing for synthesizing another image with the image data, a character recognition processing for the image data, an image correction processing for the image data, or a processing for adding an electronic signature to the image data.

6. The image processing apparatus according to claim 1 , wherein the sending unit sends a message including the image data to a user on a talk room of the chat service that is specified by a user operation on an image forming apparatus equipped with the scanner.

7. 7. The image processing apparatus according to claim 6, wherein a plurality of users are in the specified talk room of the chat service.

8. 2. The image processing apparatus according to claim 1, further comprising a storage unit for storing the image data after the specified processing has been performed.

9. A method for controlling an image processing device capable of communicating with an information processing device that provides a chat service, comprising the steps of: transmitting image data transmitted from an image forming apparatus having a scanner to the information processing apparatus so as to upload the image data to a talk room of the chat service; receiving a response to the content of the image data in the chat service from the information processing device; performing a predetermined process designated for the image data based on the response in the receiving step; 13. A method for controlling an image processing device, comprising:

10. A program for causing a computer to function as the image processing device according to any one of claims 1 to 8.

Images