Image processing device, control method thereof, and program
The image processing device addresses the challenge of identifying the correct group for image data sharing by using a chat server to associate data with groups, enabling easy determination and transmission to the appropriate chat room or group.
Patent Information
- Application Number
- JP2021009129
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-06-29
- Filing Date
- 2021-01-22
- Publication Date
- 2024-12-23
- Estimated Expiration
- 2041-01-22
AI Technical Summary
Existing image processing systems struggle to easily identify the specific group or chat room for sharing image data when multiple objects are registered for each talk room, making it difficult for users to determine the correct destination for image data sharing.
An image processing device that communicates with a chat server to control data sharing based on group information, using a registration mechanism, acquisition of identification information, and display means to associate image data with a group, allowing easy determination of the sharing group by selecting a registered object.
Enables users to easily determine the group for sharing image data by selecting a registered object, facilitating efficient data transmission to the correct chat room or group.
Smart Images

Figure 0007604246000001 
Figure 0007604246000002 
Figure 0007604246000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing apparatus, a control method thereof, and a program. [Background technology]
[0002] Patent Document 1 discloses an image processing device that displays the title and icon of an acquired application as an object, in order to make it easy to know which application an object for executing the application belongs to. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-133000 A Summary of the Invention [Problem to be solved by the invention]
[0004] When a user uses a chat service available on the Internet to share scanned and generated image data in a specific chat room of the chat service, there are problems such as the following: For example, it is possible to associate an object with information about the specific chat room (group information) in which image data is to be shared, and store the information in advance, and then send the image data to the specific chat room by operating the object.
[0005] In this case, as in Patent Document 1, while the application title and icon are displayed, it is possible to determine which chat service the object belongs to, but it is not easy to determine which group the object is for sharing image data.
[0006] In particular, in a case where multiple objects are registered for each talk room in order to share image data in each talk room, it is difficult for a user to easily determine which object is for which talk room.
[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a mechanism that allows a group with which image data is shared to be easily identified from a registered object by selecting the object. [Means for solving the problem]
[0008] The image processing device of the present invention is an image processing device that communicates with a chat server that controls sharing of received image data within a group based on information of the group of the received destination, and includes a registration means that registers the group of the chat server, which is a destination of the image data, in association with an object, an acquisition means that acquires identification information corresponding to the group from the chat server, and a display means that displays the registered object. a transmission means for transmitting image data and information about the destination group to the chat server when the displayed object is selected, includes the identification information It is characterized by: Effect of the Invention
[0009] By selecting a registered object, a mechanism can be provided that allows a group with which image data is shared to be easily identified from the object. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration of the present invention. [Diagram 2] A diagram showing an example of the hardware configuration of the MFP101. [Diagram 3] FIG. 2 is a diagram showing an example of a hardware configuration of a mobile terminal 200. [Figure 4]FIG. 2 is a diagram showing an example of a hardware configuration of a message application server 300. [Diagram 5] FIG. 4 shows an example of the hardware configuration of the bot server 400. [Figure 6] FIG. 13 is a diagram showing an example of a sequence in which the MFP 101 transmits a file generated by scanning to the message application server 300. [Figure 7] A flowchart showing an example of scan-to-chat processing executed by the MFP101. [Figure 8] FIG. 13 is a diagram showing an example of a sequence in which the MFP 101 transmits a file generated by scanning to the message application server 300 via the bot server 400. [Figure 9] Flowchart showing an example of scan to chat processing [Figure 10] A diagram showing an example of the file structure in a message app server [Figure 11] A diagram showing an example of a message screen of a message app [Figure 12] FIG. 13 is a diagram showing an example of a setting registration screen. [Figure 13] FIG. 1 shows an example of a home screen displayed on an operation unit 116 of the MFP 101. [Figure 14] A diagram showing an example of the screen transition for scan-to-chat processing [Figure 15] A diagram showing an example of the screen transition for scan-to-chat processing [Figure 16] A diagram showing an example of association between ID and token information [Figure 17] FIG. 13 is a diagram showing an example of a button setting registration screen. [Figure 18] Diagram showing each element of the message service and its corresponding icon [Figure 19] Flowchart showing the process of obtaining an icon DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the configurations shown in the drawings. EXAMPLES
[0012] FIG. 1 is a diagram showing an example of a system configuration of the present invention. The system configuration of this embodiment includes an MFP (Multi Function Peripheral) 101, which is an image processing device capable of communicating with a mobile terminal 200, which is an example of a terminal device, via a network 100, and a message app server 300. A bot server 400 is also connected via the network 100 and is capable of communication. The message app server 300 is a chat server that receives messages and image data transmitted from the MFP 101 and the mobile terminal 200, and manages a chat service that displays the messages and image data on the mobile terminal 200 or a PC (not shown) by a user operation. The bot server 400 associates the MFP 101 with information (token information) corresponding to a bot app installed in the message app server 300 connected to the MFP 101, and transfers a request from the MFP 101 to the message app server 300. The network 100 of this embodiment may be the Internet or a LAN (Local Area Network). The network 100 may be wired or wireless.
[0013] 2 is a diagram showing an example of the hardware configuration of the MFP 101. The MFP 101 includes a CPU 111, a ROM 112, a RAM 113, a storage 114, an operation unit I / F 115, an operation unit 116, a reading unit I / F 117, a reading unit 118, a printing unit I / F 119, a printing unit 120, a wireless communication unit I / F 121, and a wireless communication unit 122. The MFP 101 also includes a FAX unit I / F 123, a FAX communication unit 124, a communication unit I / F 125, and a communication unit 126.
[0014] The control unit 110 including the CPU 111 controls the operation of the entire MFP 101. The CPU 111 reads out a control program stored in the ROM 112 or the storage 114 to the RAM 113, and performs various controls such as reading control and printing control. The ROM 112 stores a control program executable by the CPU 111. The ROM 112 also stores a boot program, font data, and the like. The RAM 113 is a main memory, and is used as a work area, and a temporary storage area for developing various control programs stored in the ROM 112 and the storage 114. The storage 114 stores image data, print data, various programs, and various setting information. In this embodiment, a flash memory is assumed as the storage 114, but an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disc Drive) may be used. An eMMC (embedded Multi Media Card) may also be used.
[0015] In the MFP 101 of this embodiment, one CPU 111 executes each process shown in the flowcharts described later using one memory (RAM 113), but this is not limited to this. For example, each process shown in the flowcharts described later can be executed by using multiple CPUs, RAMs, ROMs, and storages in cooperation. Also, some of the processes can be executed using hardware circuits such as ASICs and FPGAs.
[0016] An operation unit I / F 115 connects an operation unit 116 including a display unit such as a touch panel and hard keys to the control unit 110. The operation unit 116 displays information to the user and detects inputs from the user.
[0017] The reading unit I / F 117 connects a reading unit 118, such as a scanner, to the control unit 110. The reading unit 118 reads an image of a document, and the CPU 111 converts the image into image data such as binary data. Image data generated based on the image read by the reading unit 118 is transmitted to an external device or printed on recording paper.
[0018] The printing unit I / F 119 connects the control unit 110 to a printing unit 120, such as a printer. The CPU 111 transfers image data (print data) stored in the RAM 113 to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints an image based on the transferred image data on recording paper fed from a paper feed cassette.
[0019] The wireless communication unit I / F 121 is an I / F for controlling the wireless communication unit 122, and connects to the control unit 110 via wireless communication with an external wireless device (here, the mobile terminal 200).
[0020] The control unit 110 is connected to the public line network 107 by controlling a FAX communication unit 124 such as a facsimile via a FAX unit I / F 123. The FAX unit I / F 123 is an I / F for controlling the FAX communication unit 124, and by controlling a modem and an NCU for facsimile communication, it is possible to connect to the public line network, control the facsimile communication protocol, and the like.
[0021] The communication unit I / F 125 connects the control unit 110 and the network 100. The communication unit I / F 125 allows the communication unit 126 to transmit image data and various information inside the device to an external device on the network 100, and receives print data and information on the network 100 from an information processing device on the network 100. As a method of transmission and reception via the network 100, transmission and reception using e-mail and file transmission using other protocols (for example, FTP, SMB, WEBDAV, etc.) can be performed. Furthermore, image data and various setting data can be transmitted and received over the network 100 by accessing from the mobile terminal 200, the message application server 300, and the bot server 400 via HTTP communication.
[0022] 3 is a diagram showing an example of a hardware configuration of the mobile terminal 200. Note that the mobile terminal 200 of the present embodiment is assumed to be a device such as a smartphone or a tablet PC, but may be any other device as long as it is an information processing device capable of Wi-Fi communication.
[0023] The CPU 207 reads out a control program stored in the ROM 208 and executes various processes for controlling the operation of the mobile terminal 200. The ROM 208 stores the control program. The RAM 209 is used as a temporary storage area such as a main memory and a work area for the CPU 207. The HDD 210 stores various data such as photographs and electronic documents.
[0024] The operation panel 201 has a touch panel function capable of detecting a user's touch operation, and displays various screens provided by the OS and an e-mail sending application. The operation panel 201 is also used to check information stored in the message application server 300. The user can input a desired operation instruction to the mobile terminal 200 by inputting a touch operation to the operation panel 201. The mobile terminal 200 has a hardware key (not shown), and the user can input an operation instruction to the mobile terminal 200 using this hardware key.
[0025] The camera 204 captures an image in response to an image capture instruction from the user. The photograph captured by the camera 204 is stored in a predetermined area of the HDD 210. It is also possible to obtain information from a QR code read by the camera 204 using a program capable of analyzing QR codes (registered trademark).
[0026] The mobile terminal 200 can transmit and receive data to and from various peripheral devices via an NFC communication unit 205, a Bluetooth (registered trademark) communication unit 206, and a wireless LAN communication unit 211. The Bluetooth communication unit 206 of the mobile terminal 200 may be compatible with Bluetooth (registered trademark) Low Energy. Terminals are beginning to become widespread.
[0027] 4 is a diagram showing an example of a hardware configuration of the message application server 300. The CPU 301 reads out a control program stored in the ROM 302 and executes various processes for controlling the operation of the message application server 300. The ROM 302 stores the control program. The RAM 303 is used as a temporary storage area such as the main memory and work area of the CPU 301. The HDD 305 stores various data such as messages, images, and channel information. Data can be exchanged with various devices such as the mobile terminal 200 and the MFP 101 via the communication unit 304. The communication unit 304 may perform wired communication using Ethernet (registered trademark) or wireless communication such as Wi-Fi.
[0028] 5 is a diagram showing an example of the hardware configuration of the bot server 400. The CPU 401 reads out a control program stored in the ROM 402 and executes various processes for controlling the operation of the message app server. The ROM 402 stores the control program. The RAM 403 is used as a temporary storage area such as the main memory and work area of the CPU 401. The HDD 405 stores various data such as messages, image data, and channel information. Data can be transmitted and received via the communication unit 404 to and from various models such as the mobile terminal 200, the MFP 101, and the message app server 300.
[0029] 13 is a diagram showing an example of a home screen displayed on operation unit 116 of MFP 101. Operation unit 116 is made up of touch panel 601 that displays an operation screen, and LEDs 610 and 611. Touch panel 601 is an instruction means, and functions as a receiving means that receives instructions from a user, and also functions as a display means that displays a screen. A user directly touches the screen displayed on touch panel 601 with a finger, a stylus, or other object, and instructs the execution of each function based on the displayed screen.
[0030] 13 displays a home screen 608. The home screen 608 is the first screen for instructing the execution of each function of the MFP 101, and is a screen for selecting a screen display for making various settings for each function executed by the MFP 101, such as copy, fax, scan, and media print.
[0031] A status check button 605 is an object for displaying a screen (status check screen) for checking the status of the MFP 101. It is possible to display a transmission history or a job execution history from the status check screen (not shown).
[0032] The scan-to-chat button 602 is an object for executing the scan-to-chat process. When the scan-to-chat button 602 is selected by the user, a predetermined screen of Fig. 14 or Fig. 15 is displayed on the operation unit 116 according to the setting information of the button. The scan-to-chat process will be described in detail with reference to Figs. 6 and 7. The scan-to-chat button 602 can be registered on a button setting registration screen 1701 of Fig. 17.
[0033] Also, the user can register another scan-to-chat button 609 on the button setting registration screen 1701 in FIG.
[0034] A scan button 603 is an object for displaying a scan selection screen (not shown). The scan selection screen is a screen for selecting a transmission function such as electronic mail transmission (E-mail), file transmission via SMB, FTP, or HTTP, and Internet fax (I-fax) transmission. Touching an object indicating a displayed transmission function displays a setting screen for each transmission function.
[0035] An address book button 604 is an object for displaying an address book screen of the MFP 101 when selected by the user. LEDs 610 and 611 notify the user of the status of the MFP 101. The LED 610 lights up when an e-mail or a print job is being received or executed, and the LED 611 lights up when an error occurs in the MFP 101. The stop button 606 is an object for canceling various operations, and is an object that is constantly displayed on the operation unit 116. The HOME button 607 is an object for displaying a home screen 608, and is an object that is constantly displayed on the operation unit 116. The menu button 612 is an object for displaying a screen for setting the environment, such as the language used, and for setting each function.
[0036] Fig. 6 is a diagram showing an example of a sequence in which the MFP 101 transmits a file generated by scanning a document to the message app server 300. The sequence in Fig. 6 is started by selecting a scan-to-chat button 602 in this embodiment. The processing of the MFP 101 is realized by the CPU 111 of the MFP 101 reading a program stored in the ROM 112 into the RAM 113 and executing it. The processing of the message app server 300 is realized by the CPU of the message app server 300 reading a program stored in the ROM 302 into the RAM 303 and executing it.
[0037] In S901, the CPU 111 of the MFP 101 accepts the selection of the scan-to-chat button 602, which is an instruction to start scanning. Note that, if a screen for accepting the selection of a channel, a mention user, or a fixed phrase is displayed by selecting the scan-to-chat button 602, scanning is started by accepting the selection. Details will be described in the screen flows of FIGS. 14 and 15.
[0038] In S902, the CPU 111 controls the reading unit 118 to read an image of the document based on the scan settings set on a button setting registration screen 1701 in Fig. 17, which will be described later. In S903, the CPU 111 generates image data (file) based on the read image.
[0039] In S904, the CPU 111 controls the communication unit 126 to execute a transmission process for posting image data to the message app server 300 by HTTP communication. Here, the token information registered on the button setting registration screen 1701 in Fig. 17, the channel information set on the setting registration screen 1701 or the screens in Figs. 14 and 15, the user information of the mention target, comments, etc. are transmitted together with the image data. In addition, the above information is transmitted by executing the command "HTTP POST https: / / message.com / api / files.upload".
[0040] Here, the token information is information corresponding to a bot app installed in the message app server 300, and is information that can uniquely identify the bot app. Note that this bot app is information corresponding to a workspace registered in the message app server 300, and is information that can uniquely identify the workspace. In other words, the token information is information corresponding to a workspace registered in the message app server 300, and is information that can uniquely identify the workspace.
[0041] Here, a workspace is like an organization or group to which multiple users belong in a messaging app. Also, a channel is like a chat room in a workspace. The chat room here is a mechanism for multiple users participating in a chat room to send and receive messages to each other and exchange messages like a conversation. Also, in this embodiment, a channel is described as a chat room, but it is not limited to this as long as it is a mechanism for multiple users to send and receive messages and exchange messages like a conversation. For example, it may be something like a group chat, a room, a talk room, or a group.
[0042] Here, the bot application is an application for registering the MFP 101 as a user in the message application and posting messages and image data, and is installed in the message application server 300. By specifying the bot application and transmitting image data to the message application server 300, the bot application posts the transmitted image data in the message application. In addition, the HDD 305 of the message application server 300 stores the bot application and token information in association with each other, and also associates the bot application with a workspace. Therefore, by receiving the token information from the MFP 101, the message application server 300 can return information on the workspace associated with the bot application associated with the token information. Note that the token information, the bot application, and the workspace may be directly associated with each other. This allows a workspace (a workspace to which the user wants to send image data) corresponding to the token information registered in advance to be selected from among a large number of workspaces.
[0043] In S905, the CPU 301 of the message app server 300 searches for registered workspace information and app information using the token information received in S904, and associates the received image data and channel information with the specified channel and stores them. That is, the CPU 301 controls the posting of the received image data and comment to the specified channel. In addition, if a mention user is specified, the CPU 301 further associates the received image data with the channel and the posting destination user and stores them. As a result, when the user starts the message app on the mobile terminal 200 and specifies a channel to check the contents of the conversation on the previous channel, a screen on which the received image data is posted is displayed.
[0044] In S906, the CPU 301 of the message application server 300 transmits a result corresponding to whether or not the posting was successful to the MFP 101 as response information of the HTTP communication. If the posting is successful, the CPU 111 of the MFP 101 may display a notification that the posting was successful on the operation unit 116. If the posting is unsuccessful, the CPU 111 of the MFP 101 may display a notification that the posting was unsuccessful on the operation unit 116. Alternatively, no notification may be displayed when the posting is successful, and a notification that the posting was unsuccessful may be displayed only when the posting is unsuccessful.
[0045] Fig. 7 is a flowchart showing an example of scan-to-chat processing executed by MFP 101. CPU 111 reads a program stored in ROM 112 into RAM 113 and executes it to execute the processing of the flowchart in Fig. 7. The flow in Fig. 7 is started when MFP 101 is powered on. Note that the flow in Fig. 7 is based on the premise that a service, token information, and channel have been set on button setting registration screen 1701 in Fig. 17.
[0046] In S1001, the CPU 111 determines whether or not the scan-to-chat button 602 has been selected. If it is determined that the button has been selected, the process proceeds to S1002. If not, the process returns to S1001.
[0047] In S1002, the CPU 111 executes a process of transmitting, to the message application server 300, information indicating a request for channel list information by HTTP communication, using the token information 1503 registered in advance.
[0048] In S1003, the CPU 111 determines whether or not channel list information has been received from the message application server 300 in response to the request to obtain channel list information sent in S1002. Specifically, it determines that channel list information has not been received if the status code in the HTTP communication response is an error or if the body information of the response includes a parameter indicating that the information cannot be obtained. If it is determined that the channel list information has been received, the process proceeds to S1010. If not, the process proceeds to S1004.
[0049] In S1004, the CPU 111 identifies the cause of the error based on the result acquired in S1003, and if it determines that the error code is caused by the channel not existing in the message application server 300, the process proceeds to S1005. If not, the process proceeds to S1007.
[0050] In S1005, the CPU 111 displays on the operation unit 116 information indicating that the channel list information could not be received.
[0051] In S1006, the CPU 111 determines whether or not the back button has been selected. If it is determined that the back button has been selected, the process returns to S1001. If not, the process returns to S1006.
[0052] In S1007, the CPU 111 requests icon information for other channels in the target workspace from the message application server 300 and acquires it.
[0053] In S1008, the CPU 111 displays the acquired list of icons and channel names on the channel selection screen on the operation unit 116.
[0054] In S1009, the CPU 111 determines whether or not a channel has been selected. If it is determined that a channel has been selected, the process proceeds to S1010. If not, the process returns to S1009.
[0055] In S1010, the CPU 111 determines whether the scan to chat operation is in the mention-each-time mode. If it is in the mention-each-time mode, the process proceeds to S1012, and if not, the process proceeds to S1011.
[0056] In S1011, the CPU 111 determines from the received channel list information whether or not a user set as a user to be mentioned in the mention user selection field 1721 exists in the channel to which the post is made. If it is determined that a user to be mentioned exists in the channel, the process proceeds to S1015, and if not, the process proceeds to S1012.
[0057] In S1012 , the CPU 111 acquires, from the message application server 300 , icon information of users who belong to the target channel.
[0058] 14 on the touch panel 601 of the operation unit 116. Note that after selecting a mention target user in S1013, a selection of whether or not to register the selected user as a mention target user in a fixed mention may be displayed.
[0059] In S1014, the CPU 111 determines whether or not a destination mention has been selected. If it is determined that a destination mention has been selected, the process proceeds to S1015. If not, the process returns to S1014.
[0060] 15 on the operation unit 116. If it is detected in S1015 that all settings of the mention target user to be set in scan to chat and the comment selection screen have been finalized, the process proceeds to S1016.
[0061] In S1016, the CPU 111 controls the reading unit 118 based on the scan settings to read the image of the document and generate image data. The scan settings used are those designated by the user on the button setting registration screen 1701 in FIG.
[0062] In S1017, the CPU 111 converts the image data generated in S1016 into the file format set on the transmission setting screen.
[0063] In S1018, the CPU 111 generates posting parameters. The posting parameters include channel information of the posting destination, a file name, mention information, and a posting comment. The file format is set to the file format set in the transmission settings. The file name is specified as the file name specified in the transmission settings.
[0064] In S1019, the CPU 111 transmits, by the POST method of HTTP communication, the token information 1503 registered in advance and the files and posting parameters generated in S1017 and S1018 to the message application server 300. Note that the token information 1503 is the token information input in the token information input field 1711 in FIG. 17.
[0065] By transmitting these data (files converted from image data and posting parameters) to the message app server 300, the message app server 300 executes the following process: The process controls so that the received file is posted to the user indicated by the received mention information on the channel indicated by the received channel information.
[0066] In S1020, the CPU 111 receives the posting result from the message application server 300, and displays it on the touch panel 601 of the operation unit 116. According to this embodiment, the user can easily post a file from the MFP 101 to a channel of the message application server.
[0067] In this embodiment, it is assumed that only one piece of token information is registered, but if multiple pieces of token information are registered, the processes related to the token information, such as S1002, S1003, and S1019, are executed for each registered token.
[0068] An example of a screen displayed on the operation panel 201 of the mobile terminal 200 by transmitting the file obtained by converting the image data and the posting parameters to the message application server 300 in the process of S1019 will be described later with reference to FIG.
[0069] 14 and 15 are diagrams showing an example of screen transitions in the scan-to-chat process. The screens in Fig. 14 and 15 are displayed on the touch panel 601 of the operation unit 116. When the scan-to-chat button 602 displayed on the home screen 608 is selected, the scan-to-chat screen is displayed on the touch panel 601 of the operation unit 116.
[0070] The icon of the button that is displayed differs depending on the settings of the scan-to-chat button. When only the application service information of the destination is registered, a scan-to-chat button 708 is displayed on the home screen 704.
[0071] When the scan-to-chat button 708 is selected, an organization selection screen 712 is displayed on the touch panel 601 of the operation unit 116. On the organization selection screen 712, a screen is displayed for the user to select an organization included in the service registered in association with the scan-to-chat button 708.
[0072] When an organization is selected on organization selection screen 712 and the OK button is selected, a channel selection screen 713 is displayed for selecting a destination (posting destination) channel from among the channels included in the selected organization.
[0073] When a destination (posting destination) channel is selected on the channel selection screen 713 and the OK button is selected, a mention user selection screen 714 for selecting a mention user is displayed.
[0074] A mention user is selected on the mention user selection screen 714, and an OK button is selected, whereby a fixed phrase selection screen 715, a destination confirmation screen 716, or a sending screen 717 is displayed. When the fixed phrase selection setting is ON by the user, the fixed phrase selection screen 715 is displayed and accepts the selection of a sentence to be displayed together with image data. When a fixed phrase is selected on the fixed phrase selection screen 715 and an OK button is selected, a destination confirmation screen 716 is displayed. On the destination confirmation screen 716, the user name of the mention user and the fixed phrase to be posted are displayed as a destination mention, and the user can confirm the posted content. In addition, when the fixed phrase selection setting is set OFF by the user and the destination confirmation setting is set ON, the destination confirmation screen 716 is displayed when a mention user is selected on the mention user selection screen 714 and an OK button is pressed.
[0075] When the OK button is selected on the destination confirmation screen 716, scanning of the document is performed, image data generated by scanning is transmitted, and a sending screen 717 is displayed. The sending screen may be displayed while scanning of the document, or may be displayed after scanning of the document is completed and transmission of image data is started. In addition, scanning of the document is performed when the user sets the fixed phrase selection setting and the destination confirmation setting to OFF, selects a mention user on the mention user selection screen 714, and presses the OK button. Then, image data generated by scanning is transmitted, and a sending screen 717 is displayed. The sending screen 717 may be displayed while scanning is in progress, or may be displayed while scanning is completed and transmission is in progress.
[0076] When the organization of the destination is registered in the scan-to-chat button, a scan-to-chat button 709 is displayed on the home screen 705 .
[0077] Selecting the scan to chat button 709 displays a channel selection screen 713. If the organization registered in association with the scan to chat button does not exist on the registered service, an organization selection screen 712 is displayed to accept the selection of an organization.
[0078] When the destination channel is also registered in the scan to chat button, a scan to chat button 710 is displayed on the home screen 706 .
[0079] Selecting the scan to chat button 710 displays a mention user selection screen 714. If the channel registered in association with the scan to chat button does not exist in the registered service, a channel selection screen 713 is displayed to accept the selection of a channel.
[0080] When a mentioned user is also registered in the scan-to-chat button, a scan-to-chat button 711 is displayed on the home screen 707 .
[0081] Selecting the scan-to-chat button 711 displays a template selection screen 715. If a mention user registered in association with the scan-to-chat button does not exist in the registered service or if the mention mode is set to the scan-to-chat button, a mention user selection screen 714 is displayed to accept the selection of a mention user.
[0082] In addition, when the scan-to-chat button is selected, the organization, channel, and mention user registered in the scan-to-chat button acquire the latest information (channel list information, etc.) from the message app server 300, and it is determined whether the acquired information includes the information registered in association with the button. This realizes the above process.
[0083] Furthermore, when information registered in association with a button does not exist on the service, that is, when there is information that is not included in the information acquired from the message application server 300, an update screen 718 is displayed. When the YES button is selected on this update screen 718, information that does not exist on the service and therefore has been selected by the user is registered in association with the selected button. When the NO button is selected, information is not registered in association with the button. When the YES or NO button is selected, a fixed phrase selection screen 715 is displayed.
[0084] In this embodiment, when the destination (posting destination) channel is set in the scan-to-chat button, even if a mention user is not set, the mention user selection screen 714, the template selection screen 715, and the destination confirmation screen 716 do not need to be displayed. In other words, the configuration may be such that, when the scan-to-chat button is selected, scanning of a document is started and the generated image data is sent.
[0085] Fig. 11 is a diagram showing an example of a message screen of a message application. A message screen 1201 in Fig. 11 is displayed when the message application is started on the mobile terminal 200 and the process of S1019 is executed on the MFP 101. In addition, the mobile terminal 200 is in communication with the message application server 300.
[0086] When a user starts a message application on the mobile terminal 200 and logs in by inputting the ID and password of the user's account, a screen dedicated to that user is displayed.
[0087] Message 1204 is a message that is displayed (posted) by a user having an account of User 1 using MFP 101 to send image data generated by scanning and posting parameters to message app server 300. In the example of FIG. 11, "Channel 1" is specified as the channel to post to in the posting parameters, and "User 3" belonging to Channel 1 is specified as the mentioned user. Also, "document.pdf" is specified as the file name in the posting parameters, and "Send." is specified as the comment. The file name and comment are specified by the user on a scan-to-chat advanced settings screen (not shown).
[0088] The message screen 1201 also displays the names and icons of the channels (1208), groups (1209), and users (1210) in which the logged-in user is participating. The icon (1205) of the logged-in messaging app is also displayed, and for the logged-in workspace (organization), the workspace name and icon are displayed (1206). Also, posting destination information (1202) and message exchanges are displayed (1203). When posting, a comment with "@" at the beginning of the user's name indicates that the posting recipient wishes to notify a specific user in the channel (1204).
[0089] In the case of FIG. 11, the message application notifies the mobile terminal of user 3 that the posting has been received. This makes it easier for user 3 to notice the posting of user 1. If the mobile terminal 200 used by user 3 is a smartphone, the user is notified by an icon notification function, vibration, or ringtone. If the mobile terminal 200 used by user 3 is a desktop terminal, the user is notified by a desktop notification function or the like. In addition, when displaying this screen, the message application server 300 searches for and displays necessary information from the data structure shown in FIG. 10. For example, the posting of message 1204 corresponds to "comment 3 + file 1" in the exchange content 505, and attribute information such as the name of file 1 is obtained from 504 and displayed in the form of a file icon on the message. When the user selects this file icon, file 1 belonging to file 504 can be obtained. Note that the files posted to this channel are displayed as icons here, but a preview image of the file may be displayed.
[0090] FIG. 10 is a diagram showing an example of a file structure in the message app server. This file structure is stored in the HDD 305 of the message app server 300, and the screen of FIG. 11 is displayed based on this file structure. The message app server 300 has smaller groups such as channels, groups, users, and files in the largest group called workspace, and manages data. The channel 501 is a type of chat room in which all members of the workspace can participate, and all posted content can be searched by anyone. The group 502 is a channel for discussion that should not be made public to all members, and requires an invitation to view and participate. The user 503 is a user who participates in this workspace. The file 504 stores an attached file. Furthermore, the contents 505 of the exchange between the channel, group, and user are stored in association with each other. For example, the users who participate in the channel 1 are stored in association with the channel 1, and messages and image data exchanged in the channel 1 are also stored in association with the channel 1. By storing in this way, when a channel is selected on the channel selection screen 713, it is possible to display the users corresponding to the specified channel information. It is possible to display the users who participate in the channel.
[0091] 17 is a diagram showing an example of a button setting registration screen 1701. The setting registration screen 1701 is a screen displayed on the operation unit 116 of the MFP 101. Note that the setting registration screen 1701 may also be displayed as a Web page on the operation unit of an information processing device such as a PC connected to the MFP 101 via a network.
[0092] 17, a service 1712, a connection destination input field 1710, and a token information input field 1711 are displayed, and can be changed by inputting using a keyboard or the like. When the connection destination and token information are input, the CPU 111 checks whether the connection destination is a compatible application service. At this time, if the application service of the connection destination has an API for providing service information, an inquiry is made to the service. If the application service does not have an API for providing service information, it is determined that the service is compatible based on the domain name in the URL information registered with the new registration button 1507 in FIG. 12.
[0093] Next, channel list information including information on channels and users existing in the workspace corresponding to the token information input in the token information input field 1711, and an icon image which is identification information for each channel are obtained from the message app server 300. At this time, icon images of each user belonging to each channel and an icon image of the workspace corresponding to the token information input in the token information input field 1711 are also obtained. Once the acquisition of the channel list information and icon images is complete, it becomes possible to select a channel in the channel selection field 1720 of the button setting registration screen 1701. The user selects a channel to post scanned image data from the list of channels.
[0094] In this manner, on the button setting registration screen 1701, a group (workspace or channel) to which image data is to be sent can be set in association with a button.
[0095] When the CPU 111 detects that the channel set in the channel selection field 1720 has been changed, the CPU 111 obtains a mention user list, which is a list of users who belong to the channel set in the channel selection field 1720 and can specify a mention, from the channel list information.
[0096] When the mention user list is acquired from the channel list information, it becomes possible to select a user to be mentioned in the mention user selection field 1721. The user selects a user to be mentioned from the mention user list displayed in the mention user selection field 1721. It is possible to omit setting the mention user selection field 1721, and in the case where no setting is made, scan to chat may be performed according to the screen flow of "mention each time" shown in Figures 14 and 15. Alternatively, an option indicating mention each time may be displayed in the mention user selection field 1721, and scan to chat may be performed according to the screen flow of mention each time by selecting an option indicating mention each time.
[0097] Also, when a mention user is set in the mention user selection field 1721, scan to chat may be executed according to the screen flow of "static mention" shown in Figures 14 and 15. Also, when no mention is set in the mention user selection field 1721, scan to chat may be executed according to the screen flow of "no mention" shown in Figures 14 and 15. The screen flow of "no mention" is, for example, a flow in which the fixed phrase selection screen 715 is displayed after the scan to chat button 711 is selected in the flow of Figures 14 and 15.
[0098] In the channel selection field 1720, multiple channels can also be selected. In that case, multiple channel information is transmitted to the message app server 300, and image data is posted to multiple channels. In addition, when multiple channels are selected, a mention user can be selected for each selected channel. Even if only one channel is selected, in the mention user selection field 1721, multiple users belonging to that channel can be selected.
[0099] In the icon image display field 1730, an icon image is displayed according to the settings. For example, when one channel is set and multiple mention users are set, or when one channel is set and no mention user is set, the icon image of the channel set in the channel selection field 1720 is automatically displayed. In other words, the icon image of the channel is selected without accepting a user operation. When multiple channels are set, a workspace icon corresponding to the token information input in the token information input field 1711 is displayed.
[0100] When the workspace cannot be specified, the icon image of the service 1712 is displayed. The icon image displayed in the icon image display field 1730 is displayed as the icon image of the button when a scan-to-chat button is registered on the home screen 608.
[0101] If an icon image is not registered in the channel, a predetermined image may be displayed. Also, the icon to be displayed may be changed within a selectable range. For example, even if the icon image of the user in the mention user selection field 1721 is displayed, the icon image of the service 1712 may be displayed.
[0102] In this way, on the button setting registration screen 1701, the icon image of the button can be set by acquiring the icon image of a workspace, a channel, etc., which is identification information of a group such as a workspace or a channel, from the message app server 300. Similarly, the icon image of a mentioned user, who is a notification destination user, can be acquired from the message app server 300 and used as the icon image of the button.
[0103] In the button name setting field 1731, a character string to be displayed as the name of the button when the scan-to-chat button is added to the home screen 608 is input. This character string is automatically set to a name corresponding to the icon image selected by the user as the icon image. For example, in FIG. 17, the icon image of channel 1 is registered as the icon image and is displayed in the icon image display field 1730, so that the name of the channel "channel 1" corresponding to the icon image is input. When an icon image corresponding to a user is selected as the icon image, the user name of the user (for example, "user 1") is input. Here, the names of the channel, user, etc. input are information included in the channel list information acquired from the message app server. In this way, in the button setting registration screen 1701, the name of the button can be set by acquiring the workspace name or channel name, which is identification information of a group such as a workspace or channel, from the message app server 300. Similarly, the user name of the mention user, who is the user to be notified, can be acquired from the message app server 300 and used as the name of the button.
[0104] The character string displayed as the name of the button may be set automatically to the name of the channel selected in channel selection field 1720 without receiving any operation from the user.
[0105] The input character string can be changed later by the user at will, and character strings can be deleted, added, or changed using a keyboard, etc. The name of the button set here is displayed as "Channel 1" on the button, such as the Scan to Chat button 602 displayed on the home screen in FIG.
[0106] In the fixed phrase mode selection field 1732, the setting of the comment to be transmitted together with the scanned image data can be selected. In the fixed phrase mode selection field 1732, for example, a "selection mode" that allows a fixed phrase previously set in the fixed phrase setting field 1733 to be selected when performing scan to chat is displayed as an option. In addition, a "fixed mode" that transmits one fixed fixed phrase previously set in the fixed phrase setting field 1733, and a "no comment mode" that transmits image data without adding a comment are displayed as options.
[0107] Scan settings can also be set on the button setting registration screen 1701. In a double-sided setting field 1740, it is possible to select whether to scan both sides of a document or one side of a document. By selecting the double-sided setting field 1740, the user can select from "single-sided" or "double-sided" from a pull-down menu.
[0108] Moreover, the user can select whether to scan the document in color or monochrome in a color setting field 1741. By selecting the color setting field 1741, the user can select from "color" or "monochrome" from a pull-down menu.
[0109] After making settings on the setting registration screen 1701, the user confirms the settings by pressing a set button 1750. The setting values set here are stored in the storage 114. In a second embodiment described later, the setting values are stored in the HDD 405.
[0110] When a generate button 1506 on the setting registration screen 1501 is pressed, a button for performing scan-to-chat according to the settings registered on the button setting registration screen 1701 is additionally displayed on the home screen 608 .
[0111] FIG. 18 shows a correspondence table listing categories handled by the message application server 300, names, icon images, and sources from which the MFP 101 obtains the icon images.
[0112] The icon image of service A is managed by service A, which is a message service provided by the message application server 300, and the MFP 101 can acquire the icon image from the message application server 300. The icon image of service B is recorded in the MFP 101 device.
[0113] The icon images of organization A and organization B are included in the management information of service A. That is, the MFP 101 transmits token information corresponding to a workspace managed by the message app server to the message app server 300, whereby the icon image of organization A or organization B is acquired from the message app server.
[0114] The icon images of channels, groups, and users are information included in the channel list information of organization A, and are acquired by the MFP 101 from the message application server 300.
[0115] Fig. 19 is a flowchart showing an example of processing in which CPU 111 of MFP 101 acquires an icon image for displaying scan-to-chat button 602 on home screen 608. This flowchart is executed when MFP 101 acquires icon information in S1007 and S1012 of Fig. 7, S1307 and S1312 of Fig. 9, Fig. 17, Fig. 14, and Fig. 15, and when operation unit 116 starts up and displays home screen 608. The flow in Fig. 19 is realized by CPU 111 of MFP 101 reading a program stored in ROM 112 into RAM 113 and executing it.
[0116] In step S1901, the CPU 111 acquires the button information registered on the screen of FIG.
[0117] In S1902, the CPU 111 acquires an icon image corresponding to the target X from the message application server 300 and the storage 114. Here, the target X is information registered in the button information and indicates an object that is a destination. In order from the highest level concept, the target X includes an application service, a workspace, a channel, and a user.
[0118] In S1903, the CPU 111 requests the icon image acquisition source shown in Fig. 18 to acquire an icon image corresponding to the target X. If the icon image can be acquired here, the process proceeds to S1904, and if the icon image cannot be acquired, the process proceeds to S1905.
[0119] In step S1904, the CPU 111 displays the icon image on the operation unit 116.
[0120] In S1905, the CPU 111 checks whether or not there is a concept higher than the object X, and if there is, the process proceeds to S1906. If there is no concept higher than the object X, the process proceeds to S1907.
[0121] In S1906, the CPU 111 determines the existing superordinate concept item as object X, and proceeds to the process of S1902.
[0122] In S1907, the CPU 111 acquires a specific default icon from the storage 114. That is, the process of S1907 is performed when no icon image exists for an application service, a workspace, a channel, or a user.
[0123] According to this embodiment, by selecting a registered object, it is possible to easily identify from the object a group with which image data generated by scanning with an image processing device is shared. EXAMPLES
[0124] In the first embodiment, an example has been described in which the MFP 101 transmits image data and posting parameters directly to the message application server 300. In the present embodiment, an example will be described in which the MFP 101 transmits image data and posting parameters to the message application server 300 via the bot server 400.
[0125] FIG. 8 is a diagram showing an example of a sequence in which the MFP 101 transmits a file generated by scanning to the message application server 300 via the bot server 400. In FIG.
[0126] In S1101, the CPU 111 of the MFP 101 accepts the selection of the scan-to-chat button 602, which is an instruction to start scanning. Note that, if a screen for accepting the selection of a channel, a mention user, or a fixed phrase is displayed by selecting the scan-to-chat button 602, scanning is started by accepting the selection.
[0127] In S1102, the CPU 111 controls the reading unit 118 to read an image of the document based on the scan settings set on the button setting registration screen 1701 in Fig. 17. In S1103, the CPU 111 generates image data (file) based on the read image.
[0128] In S1104, the CPU 111 controls the communication unit 126 to transmit various information for posting image data, etc., to the bot server 400. Here, the token information registered on the button setting registration screen 1701 in Fig. 17, the channel information set on the setting registration screen 1701 or the screens in Figs. 14 and 15, the user information to be mentioned, the comment, etc. are transmitted together with the image data.
[0129] In S1105, the CPU 401 of the bot server transmits the received various information to the message application server 300. In addition, the above information is transmitted by executing the command "HTTP POST https: / / message.com / api / files.upload".
[0130] In S1106, the CPU 301 of the message app server 300 searches for registered workspace information and app information using the token information received in S1105, and associates the received image data and channel information with the specified channel and stores them. That is, the CPU 301 controls the posting of the received image data and comment to the specified channel. In addition, if a mention user is specified, the CPU 301 further associates the received image data with the channel and the user to which the image data is to be posted, and stores them. As a result, when the user starts the message app on the mobile terminal 200 and specifies a channel to check the contents of the conversation on the previous channel, a screen on which the received image data is posted is displayed.
[0131] In S1107, the CPU 301 of the message application server 300 transmits a result indicating whether the posting was successful or not to the bot server 400 as response information of the HTTP communication.
[0132] In S1108, CPU 401 of bot server 400 transmits the result received in S1107 to MFP 101. If the posting is successful, CPU 111 of MFP 101 may display a notification that the posting was successful on operation unit 116. If the posting is unsuccessful, CPU 111 of MFP 101 may display a notification that the posting was unsuccessful on operation unit 116. If the posting is successful, no notification may be displayed, and only if the posting is unsuccessful, a notification that the posting was unsuccessful may be displayed.
[0133] FIG. 16 is a diagram showing an example of the association between IDs and token information. In the table of FIG. 16, user IDs or device IDs are registered in association with authentication information (token information). This table is stored in HDD 405 of bot server 400. Here, the user ID and device ID are information stored in MFP 101, and the user ID is user identification information set for each user who uses MFP 101. The device ID is device identification information set for each MFP. The user ID is identification information set by the user when generating a user account for logging in to MFP 101, and the device ID is identification information unique to MFP 101 set at the time of shipment from the factory.
[0134] The token information in FIG. 16 is used when executing scan to chat without selecting the scan to chat button 602 .
[0135] Fig. 9 is a flowchart showing an example of processing when the scan-to-chat button 602 in this embodiment is selected. Note that each operation (step) of the flowchart in this embodiment is executed by the CPU 111 reading a control program recorded in the ROM 112 or storage 114 into the RAM 113. The explanation of the steps in the flow of Fig. 9 where the same processing as in Fig. 7 is executed will be omitted.
[0136] S1301 is the same process as S1001 in FIG.
[0137] In S1302, the CPU 111 transmits information requesting channel list information to the bot server 400. At that time, the CPU 111 transmits the token information 1503 registered in advance to the bot server. As a result, the CPU 401 of the bot server 400 transmits the received token information and information requesting channel list information to the message application server 300.
[0138] In S1303, the CPU 111 determines whether or not channel list information has been received from the message application server 300 in response to the request to obtain channel list information sent in S1302. Specifically, the bot server 400 receives the channel list information from the message application server 300, and determines whether the MFP 101 has received the channel list information from the bot server 400. Also, if the status code in the HTTP communication response is an error or if the body information of the response includes a parameter indicating that information cannot be obtained, it is determined that the channel list information has not been received.
[0139] Steps S1304 to S1306 are similar to steps S1004 to S1005 in FIG.
[0140] In S1307, the CPU 111 transmits a request for icon information of other channels of the target workspace to the bot server 400, and the bot server 400 transmits the request to the message app server 300. As a result, the MFP 101 obtains icon information of other channels of the target workspace from the message app server 300 via the bot server 400.
[0141] Steps S1308 to S1311 are similar to the steps S1008 to S1011 in FIG.
[0142] In S1312, the CPU 111 acquires icon information of users belonging to the target channel from the message application server 300 via the bot server 400 as described above.
[0143] Steps S1313 to S1318 are similar to the steps S1013 to S1018 in FIG.
[0144] In S1319, the CPU 111 transmits the token information 1503 registered in advance to the bot server 400, and the file and posting parameters generated in S1317 and S1318. The bot server 400 then transmits the token information 1503, the file and posting parameters generated in S1317 and S1318 to the message app server 300 by the POST method of HTTP communication. By transmitting this data (the file converted from image data and the posting parameters) to the message app server 300, the message app server 300 controls the message app server 300 to post the received file to the user indicated by the received mention information on the channel indicated by the received channel information.
[0145] In S1320, the CPU 111 receives the posting result from the message application server 300 via the bot server 400, and displays it on the touch panel 601 of the operation unit .
[0146] In this embodiment, it is assumed that only one piece of token information is registered, but if multiple pieces of token information are registered, the processes related to the token information, such as S1302, S1303, and S1319, are executed for each registered token.
[0147] According to this embodiment, even if the interface specifications of the message application server 300 are changed, this can be realized by simply updating the program of the bot server without uploading the program of the MFP 101. Furthermore, in a workplace with multiple MFPs, file posting can be performed without setting a token for each MFP individually.
[0148] <Other embodiments> The present invention can be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium. Then, one or more processors in the computer of the system or device can read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]
[0149] 101 MFP 300 Message App Server 400 Bot Server 111 CPU 118 Reading unit
Claims
1. a registration means for registering a group of chat servers, the group being a destination of image data, in association with an object; an acquisition means for acquiring identification information corresponding to the group from the chat server; a display means for displaying the registered object; a transmission means for transmitting the image data and information on the destination group to the chat server when the displayed object is selected, The image processing device according to claim 1, wherein the object includes the identification information.
2. a reading means for reading an image of a document and generating image data based on the image; Further comprising an operation unit, The image processing device according to claim 1, characterized in that, when the object is selected, the reading means reads an image of the original document and generates image data based on the image, and the transmitting means transmits the image data and information about the destination group to the chat server.
3. The registration means further associates scan settings with the object and registers them; The image processing device according to claim 2, characterized in that, when the object is selected, the reading means reads an image of the original document based on the scan settings and generates image data based on the image, and the transmitting means transmits the image data and information about the destination group to the chat server.
4. The registration means registers identification information corresponding to the group in association with the object; 4. The image processing device according to claim 1, wherein the identification information of the group to be registered in the registration means is selected by selecting the group of the chat server to be registered by the registration means, without accepting a user operation.
5. 5. The image processing device according to claim 1, wherein, when the acquisition means is unable to acquire the identification information, the display means displays the object including predetermined identification information stored in the image processing device.
6. The identification information is an icon image, 6. The image processing apparatus according to claim 1, wherein the display means displays the icon image as an object.
7. the identification information is stored in the chat server in association with the group; 7. The image processing device according to claim 1, wherein the acquisition means acquires identification information corresponding to each of the plurality of groups from the chat server, and the image processing device stores the identification information corresponding to each of the plurality of groups.
8. 8. The image processing apparatus according to claim 1, wherein the registration means further registers a comment in association with the object.
9. 9. The image processing apparatus according to claim 1, wherein the group is a talk room of the chat server.
10. a registration step of registering a group of chat servers, which is a destination of image data, in association with the object; acquiring identification information corresponding to the group from the chat server; a display step of displaying the registered object; a transmission step of transmitting the image data and information on the destination group to the chat server by selecting the displayed object, The method for controlling an image processing apparatus, wherein the object includes the identification information.
11. 10. A program for causing a computer to execute each of the means of the image processing apparatus according to claim 1.
Citation Information
Patent Citations
Document management system, management device, document management method, and computer program
JP2014203325A
Information processing device and control method therefor
JP2018133000A
