Information processing device, information processing method, and computer program

Abstract

To provide an information processing device that can transmit to a specified destination when a predetermined operation is performed by a predetermined user on a post to a message application server.SOLUTION: An information processing device is capable of communicating with an image processing device and a message application server. The information processing device includes: posting means for posting an image acquired by the information processing device to the message application server; user operation information acquisition means for acquiring user operation information for the posting; and control means for transmitting the posted image to a pre-specified storage destination when a predetermined operation by the user is detected by the user operation information acquisition means.SELECTED DRAWING: Figure 6B

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, a computer program, and the like. [Background technology]

[0002] Patent Document 1 discloses that an image processing device scans an image of a document, generates image data, and transmits the image data to a chat server that provides a chat service. As a result, the image data is uploaded to a chat room of the chat service and shared.

[0003] Patent Document 2 describes a configuration in which, when a predetermined user operation is performed on a comment posted to a chat service with a file attached, a list of image processing devices is displayed in a selectable format. It also discloses that, when the selection of an image processing device is detected, the file is sent to the selected image processing device and printed. This allows a user to issue a print instruction for a file posted in a chat room of the chat service. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-78084 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-106915 Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, an image processing device can scan an image of a document and generate image data, which can be sent to a chat room. In Patent Document 2, when a user performs a predetermined operation on a comment posted with image data sent to a chat room, a print instruction for the image data can be issued.

[0006] However, there are cases where scanned documents are checked by multiple people before being sent to a predetermined destination. In such cases, the scanned documents are checked by a user (approver) via email or chat, and once they confirm there are no problems, they are sent to the destination. It is cumbersome for users to perform all of this work manually.

[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an information processing device that can send to a specified destination when a specified user performs a specified operation on a post to a message app server. [Means for solving the problem]

[0008] An information processing device capable of communicating with an image processing device and a message application server, posting means for posting an image acquired by the information processing device to the message application server; user operation information acquisition means for acquiring user operation information on the post; a control means for transmitting the posted image to a pre-designated storage destination when a predetermined operation of the user is detected by the user operation information acquisition means; The present invention is characterized by having the following. [Effects of the Invention]

[0009] According to the present invention, it is possible to realize an information processing device that can transmit to a specified destination when a predetermined operation is performed by a predetermined user on a post to a message application server. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the configuration of an image processing system 100 according to a first embodiment of the present invention. [Figure 2] 2 is a diagram illustrating an example of the hardware configuration of an MFP 110 according to the first embodiment. [Figure 3]1 is a diagram illustrating an example of the hardware configuration of a client PC 111, an MFP linkage server 120, and a message application server 130 according to the first embodiment. [Figure 4] 1 is a functional block diagram showing an example of the configuration of an MFP linkage server 120 and an MFP 110 according to the first embodiment. [Figure 5] FIG. 10 is a diagram showing an example of a home screen displayed on an operation unit 220 of the MFP 110 according to the first embodiment. [Figure 6A] 4 is a sequence diagram showing an example of the processing flow of an information processing method according to the first embodiment. FIG. [Figure 6B] FIG. 6B is a sequence diagram showing a continuation of the example in FIG. 6A. [Figure 7A] 10A to 10C are diagrams illustrating an example of screen transitions in scan-to-chat processing according to the first embodiment. [Figure 7B] FIG. 7B is a diagram showing a continuation of the example shown in FIG. 7A. [Figure 7C] FIG. 7B is a diagram showing a continuation of the example shown in FIG. 7B. [Figure 8] 10A and 10B are diagrams showing examples of message screens generated by the message application server 130 according to the first embodiment. [Figure 9A] FIG. 10 is a sequence diagram showing an example of the processing flow of an information processing method according to the second embodiment. [Figure 9B] FIG. 9B is a sequence diagram showing an example following FIG. 9A. [Figure 10] FIG. 10 is a diagram showing an example of a message screen of a message application according to a second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a screen for scan-to-chat processing according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiment. In each drawing, the same members or elements are given the same reference numerals, and duplicated descriptions will be omitted or simplified.

[0012] <Embodiment 1> A first embodiment of the present invention will be described.

[0013] 1 is a diagram showing an example of the configuration of an image processing system 100 according to a first embodiment of the present invention. Image processing system 100 includes an MFP (Multifunction Peripheral) 110, a client PC 111, an MFP cooperation server 120, a message application server 130, and cloud storage 140.

[0014] The MFP 110 and the client PC 111 are communicably connected to various servers that provide various services on the Internet via a LAN (Local Area Network).

[0015] MFP 110 is a multifunction peripheral with multiple functions such as a scanner and a printer, and functions as an image processing device. Client PC 111 is a computer or application that receives a service requested from MFP linked server 120. Note that client PC 111 also includes mobile terminals such as smartphones.

[0016] MFP linkage server 120 has functions to save image files scanned by MFP 110, perform image composition, and transfer files to other servers capable of saving files, such as other storage servers. Note that MFP linkage server 120 functions as an information processing device capable of communicating with MPF 110 as an image processing device and message application server 130.

[0017] Message app server 130 is a chat server that receives messages and image data sent from user terminals such as MFP linkage server 120 and client PC 111, and manages a chat service that displays the messages and image data on the user terminals in response to user operations. Cloud storage 140 is a storage server that can store files via the Internet and retrieve files using a web browser.

[0018] Note that, although image processing system 100 of the present embodiment is configured to include MFP 110, client PC 111, MFP linkage server 120, message application server 130, and cloud storage 140, the configuration is not limited to this.

[0019] For example, MFP 110 may also serve as client PC 111 and MFP linked server 120. Also, MFP linked server 120 may be connected to a server on a LAN rather than on the Internet. Also, cloud storage 140 may be replaced with a mail server or the like, and scanned images may be attached to emails and sent.

[0020] 2 is a diagram showing an example of the hardware configuration of the MFP 110 according to embodiment 1. The MFP 110 is made up of a control unit 210, an operation unit 220, a printer 221, a scanner 222, a modem 223, etc. The control unit 210 is made up of the following components 211 to 219, and controls the overall operation of the MFP 110.

[0021] A CPU 211 as a computer reads out a control program stored in a ROM 212 as a storage medium, and executes and controls various functions of the MFP 110, such as reading, printing, and communication. A RAM 213 is used as a temporary storage area such as the main memory and work area of ​​the CPU 211.

[0022] In this embodiment, one CPU 211 executes each process shown in the flowcharts described below using one memory (RAM 213 or HDD 214), but this is not limiting. For example, each process may be executed by multiple CPUs or multiple RAMs or HDDs working together.

[0023] The HDD 214 is a large-capacity storage unit that stores image data and various programs. The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 is equipped with a touch panel, a keyboard, and the like, and accepts operations / inputs / instructions from the user.

[0024] The printer I / F 216 is an interface that connects the printer 221 and the control unit 210. Image data to be printed is transferred from the control unit 210 to the printer 221 via the printer I / F 216 and printed on a recording medium such as paper. The scanner I / F 217 is an interface that connects the scanner 222 and the control unit 210.

[0025] The scanner 222 reads an original placed on a platen or an ADF (Auto Document Feeder), not shown, to generate image data, and inputs the image data to the control unit 210 via the scanner I / F 217. The MFP 110 can print (copy) the image data generated by the scanner 222 from the printer 221, as well as send the image data as a file or by email.

[0026] The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. The modem 223 communicates image data via facsimile with a facsimile device on the PSTN.

[0027] The network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN. The MFP 110 uses the network I / F 219 to transmit image data and information to servers on the Internet and to receive various types of information.

[0028] 3 is a diagram showing an example of the hardware configuration of client PC 111, MFP linked server 120, and message application server 130 according to embodiment 1. Client PC 111, MFP linked server 120, and message application server 130 each include a CPU 311, a ROM 312, a RAM 313, an HDD 314, and a network I / F 315.

[0029] A CPU 311 as a computer controls the overall operation by reading out a control program stored in a ROM 312 as a storage medium and executing various processes. A RAM 313 is used as a temporary storage area such as a main memory and a work area for the CPU 311.

[0030] The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects to the Internet and can send and receive data to and from various devices such as the MFP 110. The device may also have an operation panel (not shown) or the like to present sent and received data to the user.

[0031] Fig. 4 is a functional block diagram showing an example configuration of MFP linked server 120 and MFP 110 according to embodiment 1. Note that some of the functional blocks shown in Fig. 4 are realized by causing a CPU or the like serving as a computer included in MFP linked server 120 or MFP 110 to execute a computer program stored in a memory serving as a storage medium.

[0032] However, some or all of these functions may be implemented by hardware. Examples of hardware that can be used include dedicated circuits (ASICs) and processors (reconfigurable processors, DSPs). Furthermore, the functional blocks shown in Fig. 4 do not have to be built into the same housing, and may be configured as separate devices connected to each other via signal paths.

[0033] The MFP 110 is roughly divided into two parts: a native function unit 410 and an additional function unit 420. The units included in the native function unit 410 are standard units provided in the MFP 110, whereas the additional function unit 420 is an application or the like that is additionally installed on the MFP 110.

[0034] The additional function unit 420 is, for example, a Java (registered trademark)-based application, and can easily add functions to the MFP 110. Note that the MFP 110 may also have other additional applications (not shown) installed therein.

[0035] The native function unit 410 includes a scan execution unit 411 and an image data storage unit 412. The additional function unit 420 includes a display control unit 421, a scan instruction unit 422, and a cooperation service request unit 423.

[0036] Display control unit 421 displays UI screens for accepting user operations on a liquid crystal display unit with a touch panel function of operation unit 220 of MFP 110. For example, it displays UI screens for inputting authentication information for accessing MFP linked server 120, scan settings, operations for starting scans, preview screens, and the like.

[0037] The scan instruction unit 422 requests the scan execution unit 411 to perform a scan process together with scan settings according to user instructions input via the UI screen.

[0038] The scan execution unit 411 receives a scan request including scan settings from the scan instruction unit 422. In accordance with the scan request, the scan execution unit 411 generates scanned image data by reading a document placed on the document glass platen with the scanner 222 via the scanner I / F 217.

[0039] The generated scan image data is sent to the image data storage unit 412. The scan execution unit 411 sends to the scan instruction unit 422 a scan image identifier that uniquely identifies the stored scan image data.

[0040] The scanned image identifier is a number, symbol, alphabet, or the like (not shown) for uniquely identifying an image scanned by the MFP 110. The image data storage unit 412 stores the scanned image data received from the scan execution unit 411 in the HDD 214.

[0041] Scan instruction unit 422 acquires, from image data storage unit 412, scan image data corresponding to the scan image identifier received from scan execution unit 411. Scan instruction unit 422 requests cooperation service request unit 423 to issue an instruction to process the acquired scan image data in MFP cooperation server 120.

[0042] Linked service request unit 423 requests various processes from MFP linked server 120. For example, it requests login, acquisition of executable workflow information, transmission of scanned images, and execution of workflows. Protocols such as REST and SOAP are used for communication with MFP linked server 120, but other communication methods may also be used.

[0043] The MFP cooperation server 120 includes a request control unit 431 , an image processing unit 432 , a data management unit 434 , a display control unit 435 , and a workflow processing unit 440 .

[0044] The request control unit 431 stands by in a state where it can receive requests from external devices. Upon receiving a processing request, it instructs the image processing unit 432, data management unit 434, display control unit 435, and workflow processing unit 440 to perform processing as appropriate according to the request content.

[0045] The image processing unit 432 performs image synthesis processing, such as synthesizing an electronic signature (an image of the approver's seal of approval or signature, etc.) onto the image. The electronic signature (an image of the approver's seal of approval or signature, etc.) may simply be an image of the seal of approval or signature, but it is preferable that identification information such as the name of the creator of the seal of approval or signature and a timestamp are incorporated in a way that prevents tampering.

[0046] The image processing unit 432 can also perform recognition processing and conversion processing on images, such as OCR (Optical Character Recognition), image rotation and tilt correction, on images.

[0047] Data management unit 434 holds user information and various setting data managed by MFP linkage server 120, definition information of workflows executed by workflow processing unit 440, and the like.

[0048] The display control unit 435 receives a request from a web browser running on a client PC 111 (including a user terminal such as a smartphone) connected via the Internet and returns screen configuration information (HTML, CSS, etc.) required for screen display.

[0049] A user can change the settings of MFP linked server 120 via a screen displayed in a web browser. For example, the user can set authentication information when MFP linked server 120 connects to message app server 130 or cloud storage 140, or check and set user information registered on MFP linked server 120.

[0050] The workflow processing unit 440 executes workflow processing in accordance with the workflow definition information held in the data management unit 434 and the workflow execution request received from the MFP 110. In this embodiment, the scanned image received from the MFP 110 together with the workflow execution request is posted (transmitted) to the message application server 130.

[0051] After that, when it detects that a predetermined user operation has been performed on the posted message, it requests image synthesis processing from image processing unit 432. Then, the synthesized image is sent to message application server 130 or cloud storage 140.

[0052] Cloud servers such as the message app server 130 and cloud storage 140 generally have interfaces that enable various processing requests using protocols such as REST and SOAP. The workflow processing unit 440 operates the message app server and cloud storage using the above interfaces.

[0053] 4 illustrates an example of a configuration in which additional function unit 420 is installed in MFP 110, but the present invention is not limited to this configuration, and the functions of additional function unit 420 may be included in client PC 111. Also, various functions of the MFP-linked server may be included in MFP 110.

[0054] 5 is a diagram showing an example of a home screen displayed on the operation unit 220 of the MFP 110 according to the first embodiment. The operation unit 220 is made up of a touch panel 501 that displays an operation screen, and LEDs 510 and 511. The touch panel 501 functions as an instruction unit and also as a receiving unit that receives instructions from the user. It also functions as a display unit that displays a screen.

[0055] The user directly touches the screen displayed on the touch panel 501 with a finger, a stylus, or other object to instruct the execution of each function based on the displayed screen. The operation unit 220 may have an ID card (contactless card) reading function to authenticate the user.

[0056] 5, the touch panel 501 displays a home screen 508. The home screen 508 is the initial screen for instructing the execution of each function of the MFP 110, and allows the user to select a screen display for making various settings for each function executed by the MFP 110, such as copy, fax, scan, and media print.

[0057] A status check button 505 is a button for displaying a screen (status check screen) for checking the status of the MFP 110, and the status check screen (not shown) can display a transmission history and a job execution history.

[0058] The scan-to-chat button 502 is a button for displaying an execution screen for the scan-to-chat process. When the scan-to-chat button 502 is clicked by the user, a scan-to-chat screen 701, which will be described later with reference to Fig. 7, is displayed on the operation unit 220. The scan-to-chat process will be described later with reference to Figs. 6A and 6B.

[0059] The scan button 503 is a button for displaying a scan selection screen (not shown) from the MFP 110. The scan selection screen is a screen for selecting a transmission function such as email transmission (E-mail), file transmission via SMB, FTP, or HTTP, and Internet fax (I-fax) transmission. Touching the displayed button indicating a transmission function displays a setting screen for that transmission function.

[0060] An address book button 504 is an object for displaying an address book screen of the MFP 110 when selected by the user.

[0061] LEDs 510 and 511 notify the user of the status of the MFP 110. LED 510 lights up while an e-mail or print job is being received or executed, and LED 511 lights up when an error occurs in the MFP 110.

[0062] A stop button 506 is a button for canceling various operations, and is a button that is always displayed on the operation unit 220. A home button 507 is a button for displaying a home screen 508, and is an object that is always displayed on the operation unit 220. A menu button 512 is a button for displaying a screen for setting the environment, such as the display language, and for setting each function.

[0063] Next, Fig. 6A is a sequence diagram showing an example of the flow of an information processing method in embodiment 1, and Fig. 6B is a sequence diagram showing an example following Fig. 6A. Note that the operations of the steps in the sequence diagrams of Fig. 6A and Fig. 6B are performed sequentially by a CPU or the like serving as a computer in each device constituting the image processing system of Fig. 1 executing a computer program stored in memory.

[0064] 6A and 6B show the flow of processing between each device when an image scanned by MFP 110 is converted into a file, sent to message app server 130 via MFP linkage server 120, and then subjected to image synthesis processing and sent to cloud storage 140.

[0065] In the normal state, the MFP 110 displays a main screen on the touch panel, on which buttons for executing the various functions it provides are arranged.

[0066] Note that an additional application for sending, for example, a scanned form to MFP linked server 120 is installed on MFP 110. As a result, scan-to-chat button 502, which uses the application's function, is displayed on the main screen of MFP 110, as shown in Fig. 5. Pressing scan-to-chat button 502 displays a screen for sending the scanned form to MFP linked server 120, and the processing shown in the sequences of Figs. 6A and 6B is performed.

[0067] In step S601, MFP 110 displays a login screen (scan-to-chat screen 701, which will be described later with reference to FIGS. 7A to 7C) for inputting authentication information for accessing MFP linked server 120. Then, upon receiving a login instruction, MFP 110 transmits the authentication information to MFP linked server 120 in step S602.

[0068] In step S603, MFP linkage server 120 performs login processing. That is, it verifies whether the username and password included in the login request are correct, and if correct, returns an access token to MFP 110.

[0069] The access token is sent along with each subsequent request made from MFP 110 to MFP linked server 120, thereby identifying the user to be processed. User authentication in the login process of step S603 is performed using a commonly known method (Basic authentication, Digest authentication, authorization using OAuth, etc.).

[0070] After completing the login process, in step S604, MFP 110 requests MFP cooperation server 120 to acquire workflow information that can be executed by the logged-in user. In step S605, MFP cooperation server 120 acquires workflow information (WF data) that can be executed by the logged-in user from data management unit 434, and sends the WF data to MFP 110 in step S606.

[0071] The workflow information (WF data) includes, for example, an ID that can identify the workflow, the workflow name, the default file name, the destination talk room, and approved user information.

[0072] In step S607, the MFP 110 displays a scan setting screen (scan-to-chat screen 711, which will be described later with reference to FIGS. 7A to 7C) and accepts settings such as the workflow to be executed, various settings related to the workflow (such as approver), and settings related to scan reading.

[0073] When a paper document or the like to be scanned is placed on the platen glass or ADF and the scan start button is pressed, scanning is performed in step S608 to generate digitized image data from the paper document. Then, in step S609, the image generated by the scan process and various settings related to the workflow (execution WF) are sent to MFP linked server 120.

[0074] The above is the flow of processing between MFP 110 and MFP linkage server 120. From this point on, the flow of processing between MFP linkage server 120, message application server 130, and cloud storage 140 will be shown with reference to FIG.

[0075] In step S610, MFP cooperation server 120 requests workflow processing unit 440 to execute a workflow, in accordance with the various information that request control unit 431 received from MFP 110 in step S609.

[0076] Then, the workflow processing unit 440 executes the workflow as shown in steps S611 to S617. That is, the workflow processing unit 440 posts (transmits) the scanned image to the message application server 130 in step S611, and receives information indicating that the posting has been accepted (such as an OK comment) from the message application server 130 in step S612.

[0077] Here, step S611 functions as a posting step (posting means) that posts the image acquired by MFP linkage server 120 as an information processing apparatus to message application server 130.

[0078] This information includes a message ID that uniquely identifies the posted message. When posting a scanned image, a comment (character string) may be sent along with the image.

[0079] In step S613, the workflow processing unit 440 requests the message application server 130 to acquire the message information (posted comment information) posted in step S611. Then, in step S614, the workflow processing unit 440 receives the message information (posted comment information) from the message application server 130.

[0080] That is, in step S614, in order to acquire user operation information, message information accompanying the user operation is acquired from the message application server 130. Here, step S614 functions as a user operation information acquisition step (user operation information acquisition means) that acquires user operation information on the post.

[0081] As will be described later with reference to FIG. 8, the message information (posted comment information) includes whether or not a reaction such as "Like!" has been made to the posted message, and information about the user who made the reaction.

[0082] Next, in step S615, the workflow processing unit 440 refers to the message information (posted comment information) received in step S614, and determines whether a predetermined user process (reaction) has been performed by the user (approver) specified on the scan setting screen (711).

[0083] That is, in step S615, it is determined whether or not a predetermined user operation (pressing "Like!", "Approve", etc.) has been detected in the user operation information acquisition step. Also, in step S615, if a predetermined operation has been detected, it is determined whether or not it is a predetermined operation by a pre-designated user. Here, the predetermined operation is a predetermined evaluation ("Like!") of the post or a button operation for approval.

[0084] If it is determined that a predetermined user operation (such as pressing "Like!" or "Approve") has been performed by the user (approver), the process proceeds to step S616. If it is determined that no predetermined operation has been performed, the process returns to step S613.

[0085] The processes of steps S613 to S615 are repeated, but if the process cannot proceed to step S616 for a predetermined period of time, it is determined that the workflow has failed. Then, the user may be notified that the workflow has failed by sending a predetermined failure message to the message application server 130, for example.

[0086] Note that the step of acquiring posted comment information in step S613 is not necessary if message application server 130 has a function of detecting a predetermined reaction and notifying MFP linkage server 120. In that case, workflow processing unit 440 can transmit the information necessary for notification when posting in step S611, and then wait for notification in step S614.

[0087] In step S616, the workflow processing unit 440 transmits a command to synthesize a predetermined image onto the scanned image to the image processing unit 432. In response, the image processing unit 432 synthesizes an electronic signature of the approved user name (such as an image of the approver's seal of approval or signature) onto the coordinates of the image defined in advance in the workflow, and returns the result to the workflow processing unit 440.

[0088] In step S617, the workflow processing unit 440 transmits the composite image file thus obtained to the cloud storage 140. Here, step S617 functions as a control step (control means) that transmits the posted image to a pre-specified storage destination when a predetermined operation by the user is detected in the user operation information acquisition step.

[0089] In step S617, when the posted image is sent to a pre-specified destination, a composite image is sent in which, for example, a digital signature is combined with the image as a predetermined image. When the transmission is complete, the cloud storage 140 returns a signal indicating this. This completes the series of processes shown in Figures 6A and 6B.

[0090] Fig. 7A is a diagram showing an example of screen transitions in the scan-to-chat process according to the first embodiment, Fig. 7B is a diagram showing an example continuing from Fig. 7A, and Fig. 7C is a diagram showing an example continuing from Fig. 7B. When the scan-to-chat button 502 displayed on the home screen 508 in Fig. 7A is pressed, the scan-to-chat screen 701 in Fig. 7B is displayed on the touch panel 501 of the operation unit 220.

[0091] Scan-to-chat screen 701 is a screen for logging in to MFP linked server 120. User name input field 702 and password input field 703 accept input of authentication information (user name and password) required to log in to MFP linked server 120.

[0092] After entering the authentication information (user name and password), when login button 704 is pressed, login processing to MFP linkage server 120 is performed using the authentication information (step S602).

[0093] Although a username and password are used as authentication information here, a configuration may be adopted in which, instead, for example, an ID card (contactless card) is read and the ID card information is used to log in to MFP linked server 120.

[0094] When the login is successful and the acquisition of workflow information that the logged-in user can execute (steps S604 to S605) is completed, scan-to-chat screen 711 of FIG. 7C is displayed on touch panel 501 of operation unit 220 (step S607).

[0095] The scan-to-chat screen 711 is a screen for accepting the selection of a workflow to be executed, various settings (such as approver) related to the selected workflow, and settings related to scanning and reading.

[0096] Workflow selection field 712 accepts the specification of a workflow to be executed from among multiple workflow candidates presented in a pull-down menu based on the workflow information received from MFP linked server 120. In Fig. 7C, the workflow "Stamp on invoice A" is selected.

[0097] The file name input field 713 accepts input of a file name when image data obtained by scanning and digitizing a paper document is saved in the message application server 130 or the cloud storage 140 .

[0098] When scan-to-chat screen 711 is displayed, file name input field 713 is set to the default file name included in the workflow information received from MFP linked server 120. Note that a configuration may also be adopted in which file name input by the user is not accepted (the file name cannot be changed from the default file name).

[0099] Destination input field 714 accepts input of the destination talk room of message app server 130. When scan-to-chat screen 711 is displayed, destination input field 714 is populated with the destination talk room included in the workflow information received from MFP linked server 120. This input field may also be configured not to accept user input (to prevent the destination talk room from being changed from the one included in the workflow information).

[0100] Approver selection field 715 accepts the designation of an approving user from among multiple approver name candidates presented in a pull-down menu based on the workflow information received from MFP linked server 120. In FIG. 7C, the approver "Section Manager userD" is selected.

[0101] Scan setting buttons 721 to 724 accept settings for generating image data by reading a document set on a document table or an ADF (Auto Document Feeder), not shown.

[0102] When the user presses start scan button 731, the printer executes a scan to generate image data by digitizing the paper form (step S608).Then, the printer sends the generated image and various workflow-related settings (execution WF) to MFP linked server 120 (step S609).

[0103] 8(A) and 8(B) are diagrams showing examples of message screens generated by the message application server 130 according to embodiment 1. That is, Fig. 8(A) and 8(B) show screens that are displayed on a display panel or the like of a user terminal such as the client PC 111 after the user terminal receives screen data generated by the message application server 130.

[0104] A user ID and a password for the user to log in to the message application server 130 are registered in advance in the user terminal. Then, the user inputs the user ID and password into the user terminal and transmits them to the message application server 130.

[0105] The message app server 130 performs user authentication based on the received user ID and password. Then, the message app server 130 transmits screen data of the message app server 130 for the authenticated user to the user terminal. As a result, the user terminal displays, for example, the screen shown in FIG. 8.

[0106] 801 shows a series of message screens displayed on a user terminal, and 802 shows user information about the user operating the user terminal and information about the group to which the user belongs.

[0107] This information is also registered by the message app server 130 that authenticates the user in association with the authenticated user, and the message app server 130 transmits this information to the user terminal.

[0108] Reference numeral 803 indicates channel information (talk room information) to which the user belongs. This channel information is also registered in association with the authenticated user by the message app server 130 that authenticated the user, and the message app server 130 transmits this channel information to the user terminal.

[0109] By selecting any channel information (talk room information) from 803, the user can exchange messages with all members belonging to the channel (talk room). 804 displays the history of messages with people registered in the channel selected by the user in 803. Here, multiple messages are displayed in 804 in chronological order. In other words, the messages displayed lower in 804 are the newest.

[0110] Reference numeral 805 displays the history of messages sent by the user. Messages may consist of text only, as in the comment in 805, or may also include file information. Reference numeral 811 is a notification message from MFP linked server 120. Here, the message displayed includes a scanned image and a post (comment text) that was sent from MFP linked server 120 to message app server 130 in step S611.

[0111] File information of the scanned image is displayed in a file information field 812 displayed in the message 811. By selecting the file information field 812, the file can be downloaded or the file contents can be referenced.

[0112] The reaction button 813 accepts a reaction from the user to the message 811. When the reaction button 813 is pressed, a reaction information field 821 in Fig. 8(B) is displayed.

[0113] Here, only the reaction "Like!" can be selected, but other reactions may also be selectable. For example, an "Approve" button for approval may be displayed as one of the reactions, and a "Reject" button for rejection may also be displayed as one of the reactions.

[0114] The reaction information field 821 displays information about reactions made to the message 811. Here, an example is shown in which a user (Section Manager userD) who logged in to the message app server 130 pressed the reaction button 813, and one user reacted with "Like!"

[0115] If you perform a reaction other than "Like," the relevant information will be displayed. For example, if you press the "Approve" button, it will say "Approved," and if you press the "Reject" button, it will say "Rejected."

[0116] When the processes in steps S613 and S614 in FIG. 6B are performed in this state, the information in the message 811 includes information that the approving user (section manager userD) specified in the approver selection field 715 has made a predetermined reaction.

[0117] Then, in the process of step S615, it is determined that a predetermined user operation (pressing "Like!" or "Approve", etc.) has been performed, and the process proceeds to step S616 and subsequent steps. Note that by selecting the reaction button 813, it may be possible to cancel the reaction or refer to a list of users who have made reactions.

[0118] Furthermore, when multiple reaction buttons are displayed, the approving user (Section Manager user D) specified in the approver selection field 715 may press a reaction button 813 other than the predetermined reaction. In this case, the workflow may be canceled and a predetermined message, such as a rejection message, may be sent to the message application server 130 to notify the user that the request has not been approved and has been rejected.

[0119] In addition, if the approved user presses the wrong reaction button, there may be cases where the reaction is subsequently canceled. In consideration of such cases, in the process of step S615, if a predetermined user process continues for a certain period of time, the process may proceed to the next step S616.

[0120] In addition, in this embodiment, the configuration has been described in which workflow information is stored in advance in the data management unit 434, but it is also possible to configure the user to create a workflow definition, etc. via the display control unit 435, and store the created workflow information in the data management unit 434.

[0121] As explained above, according to this embodiment, the approver can check the application documents on the chat service. Then, by simply performing a predetermined reaction, the approved image can be sent to the specified destination, eliminating the need to manually request confirmation or send the image to the specified destination.

[0122] Furthermore, while approval and image synthesis often require the use of dedicated approval flow systems, this embodiment allows approval flows to be carried out using familiar chat services, thereby reducing the learning and operation burden on users.

[0123] <Embodiment 2> Next, a description will be given of a second embodiment of the present invention. In the first embodiment, it is possible to synthesize an image such as an electronic signature by having one designated authorized user perform a predetermined reaction, and to transmit the image to a designated destination.

[0124] In the second embodiment, an example will be described in which another user approves on behalf of the designated approving user when it is difficult for the designated approving user to immediately check the scanned image. Note that the explanation of the same parts as in the first embodiment, such as the system configuration and the hardware configuration of the device, will be omitted.

[0125] Fig. 9A is a sequence diagram showing an example of the processing flow of an information processing method according to embodiment 2, and Fig. 9B is a sequence diagram showing an example following Fig. 9A. Note that the operations of the steps in the sequence diagrams of Fig. 9A and Fig. 9B are performed sequentially by a CPU or the like serving as a computer in each device constituting the image processing system of Fig. 1 executing a computer program stored in memory.

[0126] 9, an image scanned by MFP 110 is converted into a file, transmitted to message application server 130 via MFP linkage server 120, and further subjected to image synthesis processing before being transmitted to cloud storage 140.

[0127] Only the differences from the first embodiment will be explained here. Steps S901 to S912 are the same as steps S601 to S612, so explanations will be omitted. Here, unlike the first embodiment, the processing when the approving user does not press the reaction button 813 (or 1013 in FIG. 10) but mentions (requests) another user will be explained.

[0128] Fig. 10 is a diagram showing an example of a message screen of a message application according to embodiment 2. That is, Fig. 10 shows a screen that is received by a user terminal (such as the client PC 111) from screen data generated by the message application server 130 and displayed on a display panel or the like of the user terminal.

[0129] Reference numeral 1001 is a diagram showing an example of a user operation after the processing up to step S911 is performed. Here, it is assumed that the user who has logged in to the message application server 130 is section manager userD.

[0130] Message 1031 is an example of a message sent when the logged-in user (section manager userD) mentions the second approval user (userE) in the form of a reply to message 1011 and requests approval on his / her behalf.

[0131] 1021 indicates that the second approving user (user E) has received the message 1031 and pressed the reaction button 1013. 1022 displays the user who has given the approval.

[0132] In this state, the posted comment information is acquired in step S913 of Fig. 9. Then, the posted comment information in step S914 includes information on message 1031 that replied to message 1011, information on the user who replied (Manager UserD), whether there was a reaction, and information on the user who reacted (Manager UserD). Furthermore, if there is a user mentioned in message 1031, information on the mentioned user (UserE) is also included.

[0133] In step S915, the workflow processing unit 440 refers to the message information received in step S914 and determines whether a proxy approver has been designated by the user (approver) specified on the scan setting screen (711) and whether the approver needs to be changed.

[0134] Here, if the designated user (approver) mentions another user and replies to the message 1011, it is determined that the approver needs to be changed. If it is determined that the approver needs to be changed, in step S916, the workflow processing unit 440 designates the user (userE) mentioned in the message 1031 as the new approver (second approver).

[0135] Next, in step S917, it is determined whether a predetermined user process (such as pressing "Like!" or "Approve") has been performed by the second approver (user E) designated in step S916. If it is determined that a predetermined user process has been performed, the process proceeds to step S918, and if it is determined that a predetermined user process has not been performed, the process returns to step S913. In this way, in steps S915 to S918, if it is detected that a second user (second approver) has been designated by a pre-designated user, and if a predetermined operation by the second user is detected, the posted image is sent to a pre-designated storage destination.

[0136] Steps S918 to S919 are the same as steps S616 to S617, and therefore their explanations are omitted. If it is determined in step S915 that the approver does not need to be changed, the process proceeds to step S917, where it is determined whether a predetermined user process (reaction) has been performed by the approver specified on the scan screen (711). If it is determined that a predetermined user process (reaction) has been performed, the process proceeds to step S918, and if it is determined that a predetermined user process has not been performed, the process returns to step S913.

[0137] The difference between the first embodiment and the second embodiment is whether or not there is a determination of whether or not to change the approved user and whether or not there is a change process in steps S915 and S916. Whether or not these processes are performed can be specified in advance for each workflow when the user creates a workflow definition via the display control unit 435.

[0138] As explained above, according to the second embodiment, in addition to the first embodiment, if the approver cannot immediately check the application documents, another user can be designated as the second approver. This makes it possible to avoid the trouble of having to execute the workflow again because the predetermined reaction of the initially designated approver is not obtained.

[0139] <Embodiment 3> In the first and second embodiments, examples were shown in which an approval user was specified when using a workflow. In these embodiments, there are cases in which the workflow has already been executed once and the approver has instructed that if the pointed-out parts are corrected, the next time the document can be sent to the specified destination without approval. For this reason, in the third embodiment, it is possible to select to skip approval, as shown in FIG. 11.

[0140] 11 is a diagram showing an example of a screen for scan-to-chat processing according to the third embodiment. As shown in an approver selection field 1115 on the scan settings screen, the approver can be set to "none (skip)." Alternatively, a check box for skipping approval may be placed on the scan settings screen.

[0141] In this way, in the third embodiment, it is possible to skip posting to the message app server by the posting means and send to the pre-specified storage destination, which allows for flexible response even when approval is not required, improving the convenience of the workflow.

[0142] The present invention has been described above in detail based on its preferred embodiments, but the present invention is not limited to the above embodiments, and various modifications and combinations of the above embodiments are possible based on the spirit of the present invention, and these are not excluded from the scope of the present invention.

[0143] The present invention also includes those that realize the functions of the above embodiments using, for example, at least one processor such as a CPU, memory, or circuit (for example, ASIC). Also, multiple processors may be used to perform distributed processing.

[0144] In order to realize part or all of the control in the above-described embodiments, a computer program that realizes the functions of the above-described embodiments may be supplied to an information processing device or the like via a network or various storage media. Then, a computer (or a CPU, MPU, or the like) in the information processing device or the like may read and execute the program. In this case, the program and the storage medium storing the program constitute the present invention. The present invention also includes the following combinations.

[0145] (Configuration 1) An information processing device capable of communicating with an image processing device and a message application server, comprising: a posting means for posting an image acquired by the information processing device to the message application server; a user operation information acquisition means for acquiring user operation information regarding the post; and a control means for transmitting the posted image to a pre-specified storage destination when a predetermined operation of the user is detected by the user operation information acquisition means.

[0146] (Configuration 2) The information processing device according to configuration 1, wherein the user operation information acquisition means acquires message information accompanying a user operation from the message application server in order to acquire the operation information of the user.

[0147] (Configuration 3) The information processing device according to configuration 1 or 2, characterized in that when the predetermined operation is detected, it is determined whether the predetermined operation is performed by the user designated in advance.

[0148] (Configuration 4) The information processing device according to configuration 3, characterized in that when the control means detects that a second user has been designated by the previously designated user, and when the control means detects the predetermined operation by the second user, it sends the posted image to the previously designated storage destination.

[0149] (Configuration 5) The information processing device according to any one of configurations 1 to 4, characterized in that the information processing device can skip the posting by the posting means to the message application server and transmit the information to the pre-specified storage destination.

[0150] (Configuration 6) The information processing device according to any one of configurations 1 to 5, wherein the predetermined operation is a button operation for a predetermined evaluation or approval of the post.

[0151] (Configuration 7) The information processing device described in any one of configurations 1 to 6, characterized in that when the control means sends the posted image to the pre-specified storage destination, it sends a composite image in which a predetermined image is combined with the image.

[0152] (Configuration 8) The information processing device described in Configuration 7, characterized in that when the control means sends the posted image to the pre-specified storage destination, it sends the composite image in which a predetermined electronic signature is combined with the image.

[0153] (Method) An information processing method using an image processing device and an information processing device that communicates with a message app server, comprising: a posting step of posting an image acquired by the information processing device to the message app server; a user operation information acquisition step of acquiring user operation information regarding the post; and a control step of sending the posted image to a pre-specified storage destination when a predetermined operation by the user is detected by the user operation information acquisition step.

[0154] (Program) A computer program for controlling each means of the information processing device according to any one of configurations 1 to 8 by a computer. [Explanation of symbols]

[0155] 110:MFP 111: Client PC 120: MFP Collaboration Server 130: Message app server 140: Cloud storage

Claims

1. An information processing device capable of communicating with an image processing device and a message application server, posting means for posting an image acquired by the information processing device to the message application server; user operation information acquisition means for acquiring user operation information on the post; a control means for transmitting the posted image to a pre-designated storage destination when a predetermined operation of the user is detected by the user operation information acquisition means; An information processing device comprising:

2. 2 . The information processing apparatus according to claim 1 , wherein the user operation information acquisition means acquires message information accompanying a user operation from the message application server in order to acquire the operation information of the user.

3. The information processing apparatus according to claim 1 , wherein when the predetermined operation is detected, it is determined whether the predetermined operation is performed by the user designated in advance.

4. when the control means detects that a second user has been designated by the pre-designated user, and when the control means detects the predetermined operation by the second user, transmits the posted image to the pre-designated storage destination; 4. The information processing device according to claim 3,

5. The information processing device according to claim 1 , wherein the information processing device is capable of skipping the posting by the posting means to the message application server and transmitting the information to the pre-specified storage destination.

6. The predetermined operation is a button operation for a predetermined evaluation or approval of the post, 2. The information processing device according to claim 1,

7. The information processing device according to claim 1 , wherein the control means transmits a composite image obtained by combining the posted image with a predetermined image when transmitting the posted image to the pre-specified storage destination.

8. The information processing device according to claim 7, characterized in that, when transmitting the posted image to the pre-specified storage destination, the control means transmits the composite image obtained by combining the image with a predetermined electronic signature.

9. An information processing method using an information processing device that communicates with an image processing device and a message application server, a posting step of posting the image acquired by the information processing device to the message application server; a user operation information acquisition step of acquiring user operation information on the post; a control step of transmitting the posted image to a pre-designated storage destination when a predetermined operation of the user is detected by the user operation information acquisition step; An information processing method comprising:

10. A computer program for controlling each means of the information processing device according to any one of claims 1 to 8 by a computer.

Images