Image processing apparatus, control method thereof, and program

Abstract

To provide a mechanism that allows a user to select whether to use an operation panel of a digital multifunction peripheral or a screen of another device for configuring settings required for a series of processing for scanned document transmission.SOLUTION: An image processing apparatus having a function of transmitting image data obtained through scanning by a scanner includes: display control means which displays a first screen configured to receive, from a user, settings for a recipient of the image data obtained through scanning by the scanner; receiving means which receives, from the user, an operation for setting the recipient of the image data on a device different from the image processing apparatus; and transmission means which transmits, when receiving the operation, an instruction based on the operation to a server that provides a message exchange service, and transmits the image data when receiving settings for the recipient on the first screen without the operation. The server provides a second screen according to the instruction.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The present invention relates to display of a setting screen when image data obtained by scanning with an image processing apparatus is transmitted to an external storage device. [Background technology]

[0002] Systems in which a digital multifunction device and a cloud storage service work together to perform processing are becoming more common. In these systems, a function is realized for sending documents scanned by the digital multifunction device to external storage provided by the cloud storage service. In this case, the digital multifunction device has a function for providing an operation screen on its operation panel for performing settings (such as the destination folder path) required for a series of processes for sending scanned documents (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-107698 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, some users may wish to configure settings required for a series of processes for sending scanned documents not on a digital multifunction device but on another device such as a PC or a smartphone. For example, Patent Document 1 does not take into consideration the possibility of configuring settings required for sending scanned documents on a screen for a message exchange service such as a chat service displayed on a PC or a smartphone.

[0005] Therefore, an object of the present invention is to provide a mechanism that allows a user to select whether to perform settings required for a series of processes for sending scanned documents on the operation panel of a digital multifunction peripheral or on the screen of another device. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the image processing device of the present invention is an image processing device equipped with a scanner and having a function of transmitting image data obtained by scanning with the scanner, and is characterized in that it has a display control means for displaying a first screen on which a user can receive a setting of a destination for the image data obtained by scanning with the scanner, a reception means for receiving an operation from a user to set a destination for the image data on a device other than the image processing device, and a transmission means for transmitting the image data when the operation is received, an instruction based on the operation to a server providing a message exchange service, and transmitting the image data when the setting of the destination is received on the first screen without the operation, and the server provides a second screen in accordance with the instruction. Effect of the Invention

[0007] According to the image processing device of the present invention, a mechanism can be provided that allows a user to select whether to perform the settings required for the series of processes for sending scanned documents on the operation panel of the digital multifunction device or on the screen of another device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a network configuration of a system according to the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of the image forming apparatus according to the present invention. [Diagram 3] FIG. 2 is a diagram illustrating a software configuration of the image forming apparatus according to the present invention. [Figure 4] FIG. 2 is a diagram illustrating a software configuration of the information processing device of the present invention. [Diagram 5] 5 is an example of a screen displayed on an operation unit of the image forming apparatus of the present invention. [Figure 6] 5 is an example of a screen displayed on an operation unit of the image forming apparatus of the present invention. [Figure 7] 5 is an example of a screen displayed on an operation unit of the image forming apparatus of the present invention. [Figure 8] 5 is an example of a screen displayed on an operation unit of the image forming apparatus of the present invention. [Figure 9] 1 is a diagram showing an example of a chat application screen executed on the information processing terminal of the present invention. [Figure 10] FIG. 4 is a diagram illustrating a processing flow of an application of the image processing device of the present invention. [Figure 11] FIG. 4 is a diagram illustrating a processing flow of an application of the image processing device of the present invention. [Figure 12] FIG. 2 is a diagram illustrating a processing sequence of the system of the present invention. [Figure 13] 5 is an example of a screen displayed on an operation unit of the image forming apparatus of the present invention. [Figure 14] FIG. 4 is a diagram illustrating a processing flow of an application of the image processing device of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the embodiments do not limit the present invention, and all of the configurations described in the embodiments are not necessarily essential to the means for solving the problems of the present invention.

[0010] <First embodiment> <System configuration> FIG. 1 shows an example of a system configuration according to this embodiment.

[0011] As shown in FIG. 1, the system of this embodiment is composed of, for example, external cloud storage servers 30 and 31, an information processing device 400, an information processing terminal 40, and an image forming device 200, all of which are connected to a network 10.

[0012] The network 10 is a local network and the Internet, and enables communication between various connected devices.

[0013] The external cloud storage servers 30 and 31 and the information processing device 400 are servers hosted on a cloud platform.

[0014] The external cloud storage servers 30 and 31 execute a Web service that provides external storage functions to clients with which they communicate. In the description of this embodiment, the name of the cloud storage service provided by the external cloud storage server 30 is "CS1," and the name of the cloud storage service provided by the external cloud storage server 31 is "CS2."

[0015] The information processing device 400 provides various Web services to clients with which it communicates, and as one example, serves as a client of the external cloud storage servers 30 and 31 to execute Web services in cooperation with the external cloud storage servers 30 and 31. It also executes a chat service. Hereinafter, the information processing device is referred to as a cloud server.

[0016] The image forming apparatus 200 is a digital multifunction machine having multiple functions such as a copy function, a scan function, a print function, a FAX function, an E-mail transmission function, etc. Alternatively, it may be a scanner having a single function.

[0017] The information processing terminal 40 is a personal computer (PC). The information processing terminal 40 checks a list of folders and files in the external cloud storage servers 30 and 31. In addition, the information processing terminal 40 executes a chat application that uses a chat service provided by the cloud server 400.

[0018] A chat service is a message exchange service suitable for exchanging messages between users over a network such as the Internet, without being concerned about format. Chat services are generally used to exchange simple messages with friends in closer real time than email. Chat services are also widely used as social networking sites and business tools. In addition to messages, chat services are also used to exchange files such as image data and video data.

[0019] A message sent from a host terminal connected to a chat server that provides a chat service is received and displayed by another host terminal connected to the chat server. Examples of the host terminal include a PC, a smartphone, and a multifunction printer.

[0020] The state in which the user's host terminal is connected to the chat server is called the online state, and the state in which it is not connected is called the offline state. Messages sent to the recipient user when the recipient user is offline are sent to the recipient user by a mail service that relies on a protocol such as SMTP instead of the chat service.

[0021] In addition to one-to-one message exchange between users, messages can also be exchanged between multiple users who participate in a group. In chat services, the group is also called a chat room, a talk room, a room, a channel, a group chat, etc.

[0022] <Hardware configuration of image forming device> FIG. 2 is a diagram illustrating an example of the hardware configuration of the image forming apparatus 200 according to the present embodiment.

[0023] The image forming apparatus 200 is a digital multifunction peripheral, and includes a controller unit 210, an operation unit 261, a printer 281, and a scanner 282. The controller unit 210 further includes a CPU 220, a RAM 230, a ROM 240, a HDD 250, an operation unit I / F 260, a network I / F 270, and a device I / F 280.

[0024] The CPU 220 is an execution medium of a control program built into the image forming apparatus 200, and controls the operation of devices connected to the controller unit via each I / F and memory of the storage medium. The RAM 230 stores programs and data such as an operating system, system software, and application software. The ROM 240 stores a system boot program, system programs, and application programs. In addition, information required for the image forming apparatus, such as fonts, may also be stored. The HDD 250 is a storage device (hard disk) with a larger capacity than the RAM 230, and stores an operating system, system software, application software, image data, setting data, print jobs, user information, and the like. The CPU 220 executes the programs stored in the ROM 240, and the programs stored in the HDD 250 are expanded in the RAM 230. The CPU 220 then executes the programs expanded in the RAM 230, and processes the data stored in the RAM 230, the ROM 240, and the HDD 250. In addition, some small multifunction peripherals are configured to store system software, application software, and the like in the ROM 240 without the HDD 250. Alternatively, instead of the HDD 250, a configuration using a storage device other than a hard disk, such as a solid state disk (SSD) or a flash memory, may be used.

[0025] The operation unit I / F 260 is an interface unit that controls input and output with an operation unit 261 having a touch panel, and outputs image data to be displayed on the operation unit 261 to the operation unit 261. In addition, the operation unit I / F 260 transmits input information input by a user operating the operation unit 261 to the CPU 220.

[0026] The network I / F 270 is connected to a network and communicates with external devices on the network.

[0027] The device I / F 280 connects the controller unit 210 to the printer 281 and scanner 282, which are image input / output devices, and inputs and outputs image data. An original image is read by controlling the scanner 282, and the read original image data is input via the device I / F 280 and stored in the RAM 230 or the HDD 250. The stored image data is subjected to image processing by an application program deployed in the RAM 230 as necessary. The image data is also output to the printer 281 via the device I / F 280, and the image data is printed on paper by controlling the printer 281.

[0028] As long as the effects of the present invention are achieved with a configuration not shown in Fig. 2, it goes without saying that the present invention is not limited to the configuration shown in Fig. 2. In the case of a multifunction peripheral with a FAX function, an I / F for a modem device not shown in Fig. 2 may be provided in the controller unit 210, and a modem may be used to connect to a public line to enable FAX transmission.

[0029] 1 are similar to the configuration of a general information processing server that realizes a cloud platform. Also, the hardware configuration of the information processing terminal 40 is similar to the configuration of a general PC.

[0030] <Software configuration of image forming device> FIG. 3 is a block diagram showing the software configuration of a program executed by the CPU 220 of the image forming apparatus 200 of this embodiment.

[0031] The operating system 360 provides various resource management services and frameworks optimized for controlling embedded systems for software running on the system. The various resource management services and frameworks provided by the operating system 360 include multitask management, which manages multiple execution contexts of processes by the CPU 220 to allow multiple processes to run in parallel. There is also inter-task communication, which realizes synchronization and data exchange between tasks. In addition, the operating system 360 provides memory management, interrupt management, various device drivers, and protocol stacks that implement processing of various protocols such as local interfaces, networks, and communications.

[0032] The controller platform 350 is composed of a user management module 351, a job / device control module 352, and a data management module 353. The user management module 351 provides an application with a mechanism for managing local users in the image forming apparatus and their authentication information using the RAM 230 or HDD 250. The login application can realize user login control for the image forming apparatus using the authentication information of the local users managed by the user management module 351. The job / device control module 352 executes image forming jobs such as scanning, printing, and copying while controlling the printer 281 and the scanner 282 according to instructions from the application. It also manages device states, errors, and the like of the printer 281 and the scanner 282.

[0033] The data management module 353 manages image data and various setting data required when executing an image formation job, and also manages job execution history, counter information, and various other data controlled by applications.

[0034] The system service 310 is a software module that is responsible for managing program updates for the controller platform 350 and the operating system, device information / network settings, and the like.

[0035] The application platform 340 is middleware that enables the use of the mechanisms of the operating system 360 and the controller platform 350. The application platform 340 can be used by various applications in the basic application library 320 and the extended application library 330, which will be described later.

[0036] The basic application library 320 indicates a group of applications that provide basic functions of the image forming apparatus and are stored in the ROM 240 or HDD 250 from the initial state when the image forming apparatus is purchased. The extended application library 330 indicates a group of applications that are individually installed and run to extend the functions realized by the image forming apparatus. Each application displays a screen on the operation unit 261 and realizes various functions according to user operations accepted by the operation unit 261.

[0037] 3 shows an example in which the basic application library 320 includes a copy 321 and an application management 322. The copy 321 is an application for executing a copy job of scanning an original and printing it on paper. The application management 322 is an application for managing the installation and uninstallation of extended applications in the extended application library 330.

[0038] FIG. 3 shows, as an example, a state in which extended application library 330 includes extended applications for user login authentication 331, cloud storage cooperation (CS1) 332, and cloud storage cooperation (CS2) 333 that are installed.

[0039] User login authentication 331 is an application that displays a screen for inputting user authentication information on operation unit 261 and realizes user login processing for the image forming apparatus using the user authentication information input from operation unit 261. That is, it is an application that provides a user authentication function. User login authentication 331 communicates with cloud server 400 via network I / F 10 and performs user authentication by comparing user authentication information managed on cloud server 400 with user authentication information input on the image forming apparatus. User login authentication 331 may also perform user authentication by comparing with user authentication information managed by user management 351.

[0040] Cloud storage cooperation (CS1) 332 is an application that executes functions in cooperation with the cloud storage service "CS1" provided by the external cloud storage server 30 while communicating with the cloud server 400. Cloud storage cooperation (CS1) 332 realizes a function of sending a document file consisting of document image data read by executing a scan job on the image forming device to the cloud storage provided by "CS1". Cloud storage cooperation (CS1) 332 also realizes a function of printing a document file on the cloud storage provided by "CS1" on the image forming device.

[0041] The cloud storage link (CS2) 333 links with the cloud storage service “CS2” provided by the external cloud storage server 31 while communicating with the cloud server 400. The cloud storage link (CS2) 333 is an application that executes the same functions as the cloud storage link (CS1) 332.

[0042] <Cloud server software configuration> FIG. 4 is a block diagram showing the software configuration of the cloud server 400 of this embodiment.

[0043] The infrastructure 430 is a foundation for the cloud server to provide various services, and is composed of servers, virtual machines, storage, networks, and operating systems.

[0044] The cloud platform 420 is a framework that provides basic functions to the cloud application 410 by using an infrastructure 430. The cloud platform 420 is composed of a Web service 421, a computing component 422, a storage component 423, and a database 424.

[0045] A cloud application 410 indicates a group of various applications that operate on a cloud platform 420. The cloud application 410 is composed of a user management 411, a cloud storage collaboration service (CS1) 412, a cloud storage collaboration service (CS2) 413, a chat service 414, and a tally / report 415.

[0046] The user management 411 is a Web application that uses a Web service 421 to provide a Web portal screen for centrally managing user information on the cloud server 400. This Web portal screen allows the user to be added to the management target, and the setting information to be changed and deleted. The user management 411 uses a database 424 to manage the target user information. The user management 411 is also a Web application that provides an API for receiving a user authentication instruction from the user login authentication 331 that operates on the image forming apparatus. The user management 411 also manages user authentication information required for linking with the external cloud storage servers 30 and 31 used by the cloud storage linking services 412 and 413 described later. The user management 411 also manages user information of the chat service 414 described later. As a result, the user management 411 can associate the login user on the image forming apparatus with the user authentication information of the external cloud storage servers 30 and 31 and the user information of the chat service.

[0047] Cloud storage linkage service (CS1) 412 is a Web application that uses Web service 421 to handle back-end processing of cloud storage linkage (CS1) 332 executed on the image forming apparatus. Similarly, cloud storage linkage service (CS2) 413 is a Web application that uses Web service 421 to handle back-end processing of cloud storage linkage (CS2) 333 executed on the image forming apparatus.

[0048] Cloud storage linkage services 412 and 413 receive scanned document image data via cloud storage linkages 332 and 333 running on the image forming apparatus, perform image processing on the image data, and create a document file. Then, cloud storage linkage services 412 and 413 transmit the document file to any folder in the associated external cloud storage servers 30 and 31. At this time, cloud storage linkage services 412 or 413 instruct chat service 414 to start setting operations by chat, as necessary. Then, after chat service 414 has confirmed settings for transmitting the scanned document, the document file is transmitted.

[0049] Furthermore, the cloud storage linking services 412 and 413 obtain information on folders and files in the linked external cloud storage servers 30 and 31, obtain any file therefrom, and perform image processing and file format conversion. The cloud storage linking services 412 and 413 enable the image forming device to obtain the document file or image data after image processing and file format conversion. The document file or image data is obtained from the cloud storage linking services 332 and 333 operating on the image forming device, and is printed by the image forming device.

[0050] The chat service 414 is a Web service that provides a chat function, and realizes a service for sending and receiving chat messages processed by a chat application running on the information processing terminal 40. The chat service 414 also operates as a chatbot that automatically sends chat messages in response to instructions from other applications or chat messages from users. The chat service 414 may operate on an external chat server (not shown).

[0051] The tally / report 415 is a Web application that provides an API for receiving job execution results sent from cloud storage links 332 and 333 executed on the image forming apparatus using a Web service 421. The tally / report 415 is also a Web application that uses computing 422 to tally up the received job execution results and provides a Web portal screen that displays the tally up results.

[0052] <Example of a screen displayed on the operation unit of an image forming device> The various screens shown in FIGS. 5 to 8 are operation screens that various applications of the image forming apparatus 200 display on the operation unit 261.

[0053] FIG. 5 is an example of a main menu screen 500. On the main menu screen 500, icons for executing various applications in the basic application library 320 and the extended application library 330 are arranged. The copy icon 511 is an icon for executing the copy 321. The scan and save icon 512, the device setting icon 513, the inbox icon 515, and the help icon 516 are also icons for executing the associated basic application (not shown in FIG. 3). For example, the scan and save icon 512 is for executing a basic application for scanning a document and saving the scanned image in the HDD 250. The device setting icon 513 is for executing a basic application for providing a setting screen for performing device information / network setting managed by the system service 310. The icon rearrangement is also performed for the icons displayed on the main menu screen. The inbox icon 515 is for executing a basic application for displaying a list of fax reception jobs and printing the contents or transferring them to another destination. The help icon 516 is for executing a basic application for displaying a manual or the like.

[0054] The application library icon 514 is an icon for executing the application management 322 .

[0055] The main menu screen 500 also includes a login user display area 501, a screen slide button 521, and a logout button 502. The login user display area 501 displays the name of the currently logged-in user. The screen slide button 521 accepts an operation to slide the main menu screen left or right to display a main menu screen on which other icons are arranged. The logout button 502 is a button for canceling the login state to the image forming apparatus.

[0056] 5A shows the initial state when the image forming apparatus is purchased. In the initial state, only icons of basic applications are displayed in the main menu. Also, in the initial state, no operational settings requiring user login authentication have been made, and no user is logged in, so nothing is displayed in the logged-in user display area 501, and the logout button 502 is not displayed either. Also, by pressing the application library icon 514 and executing application management 322, the user can install an extended application.

[0057] 5(B) shows the state after application management 322 is executed and extended applications user login authentication 331, cloud storage linkage (CS1) 332, and cloud storage linkage (CS2) 333 are installed. Cloud linkage CS1 icon 517 is an icon corresponding to cloud storage linkage (CS1) 332, and cloud linkage CS2 icon 518 is an icon corresponding to cloud storage linkage (CS2) 333. The icon corresponding to user login authentication 331, which is a login application, is not arranged in the main menu.

[0058] 5B shows a state in which a user managed by the user login authentication 331 and the user management 411 is logged in to the image forming apparatus. A login user display area 501 displays the user name of the login user (for example, “User AAA” in the figure).

[0059] Fig. 6(A) shows an example of a cloud storage authentication screen 600 that is displayed after the cloud linkage CS1 icon 517 or the cloud linkage CS2 icon 518 is pressed. The cloud storage authentication screen 600 includes an application / login user display area 601 and a logout button 602. The application / login user display area 601 displays the name of the application being executed and the user name of the logged-in user. For example, Fig. 6(A) shows that the cloud storage linkage (CS1) 332 is being executed and that the user name "User AAA" is logged in. The logout button 602 is a button for suspending the executing application and for canceling the logged-in state to the image forming apparatus.

[0060] Furthermore, the cloud storage authentication screen 600 is composed of an account input form 611, a password input form 612, an authentication information save checkbox 613, and an authentication button 614. When the authentication button 614 is pressed, the cloud storage linkage 332 or 333 executes authentication processing for the linked external cloud storage server 30 or 31 using the information entered in the account input form 611 and password input form 612. If authentication is successful, the cloud storage linkage 332 or 333 displays a job selection screen 6500 (for example, FIG. 6(B)). On the other hand, if authentication fails, the cloud storage linkage 332 or 333 displays a message indicating that authentication has failed and displays the cloud storage authentication screen 600 again.

[0061] When the authentication process to the external cloud storage server 30 or 31 is successful with the authentication information save checkbox 613 checked, the cloud storage cooperation 332 or 333 saves the authentication information. Specifically, the authentication information is saved in the user management 411 via the cloud storage cooperation service 412 or 413. After that, when the cloud cooperation CS1 icon 517 or the cloud cooperation CS2 icon 518 is pressed from the main menu, the cloud storage cooperation 332 or 333 executes the authentication process. Specifically, when the authentication information is saved in the user management 411, the cloud storage cooperation 332 or 333 executes the authentication process using the authentication information. When the authentication is successful, the cloud storage authentication screen 600 is not displayed, and the job selection screen 650 is displayed. This can save the user the trouble of repeatedly inputting the authentication information. On the other hand, when the authentication fails, the authentication information saved in the user management 411 is deleted.

[0062] FIG. 6B shows an example of a job selection screen 650 of the cloud storage cooperation 332 or 333. The job selection screen 650 includes an application / login user display area 701 and a logout button 652. The application / login user display area 651 is the same as the application / login user display area 601, and the logout button 652 is the same as the logout button 602. Furthermore, the job selection screen 650 is composed of a basic scan selection button 661, a basic print selection button 662, a custom button addition 663, a previous button 721, and a next button 722. The basic scan selection icon 661 is a button for executing a basic function of scanning in cooperation with the external cloud storage server 30 or 31. The basic print selection button 662 is a button for executing a basic function of printing in cooperation with the external cloud storage server 30 or 31. The custom button addition 663 is a button for registering a custom button with a predetermined setting performed in advance, and the custom buttons 664, 665, and 666 shown in FIG. 6B are examples thereof. Previous button 671 and next button 672 are buttons for moving between multiple job selection screens 650 when job selection screen 659 is made up of multiple screens due to the addition of many buttons by button addition 663. Note that the added custom buttons 664, 665, and 666 can also be used to change the order of placement on job selection screen 650 or to delete the buttons.

[0063] 7(A) shows an example of a scan execution screen 700 that is displayed when a scan function button (for example, basic scan selection button 661, custom buttons 664, 665 in FIG. 6(B)) arranged on job selection screen 650 is pressed. The scan execution screen 700 includes an application / login user display area 701 and a logout button 702, similar to the cloud storage authentication screen 600 in FIG. 6(A). Furthermore, the scan execution screen 700 is made up of a back button 711, an operation guide area 721, UI components 731-737 for making various settings when sending a scan, and a scan execution button 741.

[0064] The operation guide area 721 is an area for displaying a guide for user operations.

[0065] UI components 731 to 737 are for performing various settings when scanning and transmitting, and are classified into settings for performing scanning with the image forming device and settings for transmitting a document file. A color mode setting button 731, a resolution setting button 732, a single-sided / double-sided reading setting button 733, and a document reading size setting button 734 are examples of UI components that accept a setting operation for performing scanning. The cloud storage linkage 332 or 333 executes a scan of the set document based on this setting value. In contrast, a destination folder / file name setting form 736 and a check box 737 are examples of UI components (display items) that accept a setting operation for transmitting a document file on the screen. When the cloud storage linkage 332 or 333 accepts a press of the destination folder / file name setting form 736, it displays a destination folder / file name setting screen 750 shown in FIG. 7B. Furthermore, the cloud storage linkage 332 or 333 performs processing to transmit a document file with a set file name to a folder on the external cloud storage server 30 or 31 set in a destination folder / file name setting form 736. A checkbox 737 is a checkbox for switching whether the setting operation for transmitting the document file is performed on the scan execution screen 700 or via a chat service described later.

[0066] Moreover, by pressing a detailed settings button 735, a screen for making more detailed scan settings is displayed (not shown).

[0067] The scan execution button 741 is a button for executing a scan of the set document. When the scan execution button 741 is pressed, the cloud storage linkage 332 or 333 executes a scan job according to the setting values ​​of the UI components 731 to 735. Then, the read document image data is stored in the image forming device. Then, when the scan is completed, a next operation selection screen 850, which will be described later, is displayed.

[0068] A back button 711 is a button for returning to the job selection screen 650, and when returning to the job selection screen 650, the saved original image data is deleted.

[0069] 7B shows an example of a destination folder / file name setting screen 750 for allowing a user to set a destination folder and a file name of the external cloud storage server 30 or 31. The destination folder / file name setting screen 750 includes an application / login user display area 751 and a logout button 752, similar to the cloud storage authentication screen 600 of FIG. 6A. Furthermore, the destination folder / file name setting screen 750 is composed of 761, 762, 772 to 775, 781, and 782. These are a folder hierarchy display area 761, a URL specification button 762, a folder list display area 772, display page turn buttons 773 and 775, a display page number area 774, a file name input form 781, and a decision button 782, respectively.

[0070] The folder hierarchy display area 761 displays the folder hierarchy information of the linked external cloud storage server 30 or 31. The URL designation button 762 is a button for accepting an operation of designating a destination folder by a URL, and when this button is pressed, the cloud storage link 332 or 333 displays a software keyboard screen 800.

[0071] The cloud storage linkage 332 or 333 acquires information on the folder displayed in the folder hierarchy display area 761 from the external cloud storage server 30 or 31 of the linkage destination. Then, a list of folders existing under the folder is displayed in the folder list display area 772. In the folder list display area 772, a list of folders is displayed in a table format. When the display area of ​​a row displayed as a folder is pressed, it is considered as a move operation to the folder, and the folder hierarchy of the move destination is reflected in the folder hierarchy display area 761. At the same time, a list of folders existing in the move destination folder is reflected in the folder list display area 772. If there are many folders existing in the folder displayed in the folder hierarchy display area 761, the folder list is displayed as multiple pages in the folder list display area 772. Then, it is possible to switch the displayed page by using the display page turn buttons 773 and 775. The display page number area 774 is composed of the total number of pages displayed in the folder list display area 772 (denominator) and the page number being displayed (numerator). When the display area of ​​the “+Create new folder” line in the folder list display area 772 is pressed, the cloud storage link 332 or 333 displays a software keyboard screen 800, allowing the user to set the name of the newly created folder.

[0072] The file name input form 781 is for inputting the file name of the document file to be transmitted by the cloud storage linkage 332 or 333. When the file name input form 781 is pressed, a software keyboard screen 800 is displayed on the operation unit 261, and the user can set an arbitrary file name.

[0073] The OK button 782 is a button for confirming the destination folder and file name set on the destination folder / file name setting screen 750. When the OK button 782 is pressed, the cloud storage linkage 332 or 333 displays the scan execution screen 700. At the same time, the destination folder in the folder hierarchy display area 761 and the file name set in the file name input form 781 are reflected and displayed in the destination folder / file name setting form 736.

[0074] FIG. 8A shows an example of a software keyboard screen 800 for allowing a user to set an arbitrary character string. The software keyboard screen 800 includes an application / login user display area 801 and a logout button 802, similar to the cloud storage authentication screen 600 in FIG. 6A. Furthermore, the software keyboard screen 800 includes an input character string display area 811, a keyboard area 821, a cancel button 831, and an OK button 832. The keyboard area 821 is an area in which various keys for a user to input characters are arranged, and a character string input by pressing the corresponding key is displayed in the input character string display area 811. When the cloud storage linkage 332 or 333 accepts pressing of the cancel button 831, it clears the input character string and redisplays the screen before the transition. When the cloud storage linkage 332 or 333 accepts pressing of the OK button 832, it redisplays the screen before the transition and reflects the character string displayed in the input character string display area 811.

[0075] 8(B) shows an example of a next operation selection screen 850 displayed on operation unit 261 after scanning is completed. Similar to cloud storage authentication screen 600 in Fig. 6(A), next operation selection screen 850 includes an application / login user display area 851 and a logout button 852. Furthermore, next operation selection screen 850 is made up of a dialog 860, a start sending button 861, an add scanned original button 862, and a cancel button 863.

[0076] Dialog 860 is a dialog that prompts the user to perform the next operation.

[0077] The start transmission button 861 is a button for receiving an instruction to start transmitting a document file. When the start transmission button 861 is pressed, the cloud storage linkage 332 or 333 transmits data to the cloud storage linkage service 412 or 413. Specifically, the document image data saved by executing the scan, setting information for transmitting the document file, and login user information are transmitted. The setting information is, for example, the setting values ​​of the destination folder / file name setting form 736 and the check box 737. The login user information is, for example, "User AAA" in the next operation selection screen 850.

[0078] The add scan original button 862 is a button for receiving an instruction to add an original to be scanned subsequently. When the add scan original button 862 is pressed, the cloud storage link 332 or 333 displays the scan execution screen 700 again.

[0079] The cancel button 863 is a button for receiving an instruction to cancel the transmission of the scanned document. When this button is pressed, the cloud storage link 332 or 333 displays the job selection screen 650 and deletes the saved document image data.

[0080] <Example of chat application screen> 9 shows an example of a chat screen 900 of a chat application executed on the information processing terminal 40. The chat application is a client application for exchanging chat messages, which is executed by communicating with a Web service provided by the chat service 414.

[0081] The chat screen 900 is composed of a chat room selection area 910 and a chat area 920. The chat room selection area 910 is an area for selecting a chat room, and displays a list of the names of each chat room. One of the chat rooms listed in this area, a "Multifunction Printer Scan Send WF" chat room 911, is a chat room for performing setting operations for the cloud storage linkage 332 or 333 to send document files. The chat room is automatically generated by the chat service 414. The chat area 920 is an area for displaying chat messages exchanged in the chat room selected in the chat room selection area 910 and for performing operations for sending chat messages.

[0082] The chat message input form 941 is a form for a user to input a chat message. The send button 942 is a button for receiving an instruction for the chat application to send the message input in the chat message input form 941 to the chat service 414.

[0083] Chat messages 921 to 930 are chat messages received by the chat application from the chat service 414. Among these, chat messages 921, 923, 925, 927, 929, and 931 are examples of messages automatically generated by the chatbot of the chat service 411. Chat messages 922, 924, 926, 928, and 930 are examples of chat messages input and sent by the user in the chat message input form 941. In this embodiment, a series of chat messages are exchanged when the user sets a destination folder and a file name on the destination folder / file name setting screen 750 through the chat application.

[0084] The cloud storage linkage service 412 or 413 receives the document image data and the setting parameters for transmitting the document file, and issues an instruction to start a setting operation via chat to the chat service 414. The setting parameters are setting information transmitted from the cloud storage linkage 332 or 333 of the image forming apparatus 200. The chat service 414 identifies, via the user management 411, the chat application user associated with the logged-in user of the image forming apparatus that performed the scan, and performs subsequent sending and receiving processes of chat messages for that chat application user.

[0085] If the "Multifunction device scan transmission WF" chat room 911 does not exist, the chat service 414 creates a new chat room. If the "Multifunction device scan transmission WF" chat room 911 already exists, the chat service 414 performs processing for sending and receiving chat messages to and from this chat room.

[0086] First, the chat service 414 generates a chat message 921 which gives a message indicating the completion of scanning and a preview of the scanned document image, and prompts the user to input a destination folder. The chat message 922 is a chat message indicating the URL of the destination folder, which is sent by the user via the chat message input form 941. The chat service 414 checks whether the URL in the chat message 922 exists, and generates a chat message 923 indicating the folder path of the destination folder and for checking whether the specified content is correct. The chat message 924 is the answer sent by the user. When the chat service 414 determines that the destination folder has been determined by the previous chat message exchanges, it next generates a chat message 925 which prompts the user to set a file name. The chat message 925 is a chat message for allowing the user to select whether to use a file name automatically generated according to a preset file name generation rule, or to change to a different file name. The chat message 926 is a chat message sent by the user indicating that the file name will be changed to a different file name. In response to this, the chat service 414 generates a chat message 927 which prompts the user to specify a file name. Chat message 928 is a chat message indicating the file name to be changed, sent by the user. Chat service 414 generates chat message 929 to prompt the user to perform the next operation. Chat message 930 is a chat message indicating that the user is to instruct to start transmission. Chat service 414 instructs cloud storage linking services 412 and 413 to perform document file transmission processing according to the settings determined in the previous chat message exchanges (e.g., chat messages 922 and 928). Then, when the document file transmission processing of cloud storage linking services 412 and 413 is completed, chat service 414 generates chat message 931 indicating the transmission result, and the series of chat message exchanges ends.

[0087] <Flowchart of a program executed by the image forming apparatus> 10 is a flowchart showing a procedure for executing a scan in the cloud storage linkage 332 or 333. This process starts when the scan execution screen 700 is displayed while the user is logged in to the image forming apparatus 200.

[0088] First, in the first processing step S1001, the cloud storage linkage 332 or 333 accepts various setting operations via the UI components 731 to 737 and a scan start operation via the scan execution button 741. Upon accepting the scan start operation, the cloud storage linkage 332 or 333 executes a scan of the set document (S1002). Specifically, upon detecting the acceptance of the scan start operation, the cloud storage linkage 332 or 333 controls to execute a scan using the scanner 282.

[0089] When the scan execution is completed, the cloud storage cooperation 332 or 333 judges whether "Set later in chat" is disabled or enabled (S1103). At this time, if the check box 737 is not checked, it is judged that "Set later in chat" is disabled, and if it is checked, it is judged that "Set later in chat" is enabled. Alternatively, when a user operation on the check box 737 is detected on the scan execution screen 700, the cloud storage cooperation 332 or 333 sets a flag for setting later in chat to on and saves it in memory. In S1103, it is judged whether the flag is on. If the flag is on, it is judged that "Set later in chat" is enabled. Note that the flag is set to off by default in this embodiment. If "Set later in chat" is enabled, the cloud storage cooperation 332 or 333 adds information indicating that "Set later in chat" is enabled to the setting information (S1004).

[0090] Then, the cloud storage linkage 332 or 333 transmits the document image data read by the execution of the scan in S1002, the setting information, and the login user information to the cloud server 400 (S1005). The setting information is setting information for transmitting a document file, and is composed of the destination folder and file name set via the destination folder / file name setting form 736, and the setting information added in S1004. That is, when a user operation on the check box 737 for setting the destination on another device is accepted, an instruction based on the operation is transmitted to the cloud server 400. When a user operation on the check box 737 is not accepted and the setting of the destination is accepted in the form 736, the document image data and the setting information of the set destination are transmitted to the cloud server 400. The document image data may be transmitted directly to the set destination.

[0091] Furthermore, if a scan execution instruction (pressing button 741) is received without receiving a destination setting in form 736 and without receiving a user operation on check box 737, an error may be displayed. Alternatively, the display may be controlled so as not to accept a scan execution instruction. If a scan transmission instruction (button 861) is received by pressing instead of a scan execution instruction, an error may be displayed or the display may be controlled so as not to accept a scan transmission instruction.

[0092] <Flowchart of a program executed by an information processing device> FIG. 11 is a flowchart showing a procedure for transmitting a document file, which is started when cloud server 400 detects the transmission of document image data, setting information, and login user information to itself in the above-mentioned S1005.

[0093] First, in the first processing step S1101, the cloud storage cooperation service (CS1) 412 or the cloud storage cooperation service (CS2) 413 receives the document image data, the setting information, and the login user information transmitted from the image forming apparatus 200. At this time, the cloud storage cooperation service (CS1) 412 or the cloud storage cooperation service (CS2) 413 performs image processing on the received document image data and creates a document file.

[0094] Next, the cloud storage integration service (CS1) 412 or cloud storage integration service (CS2) 413 checks whether there is information indicating that "Set later via chat" is enabled from the received setting information. Then, it is determined whether "Set later via chat" is enabled (S1102). If "Set later via chat" is disabled, in step S1106, the cloud storage integration service (CS1) 412 or cloud storage integration service (CS2) 413 transmits the document file to the external cloud storage server 30 or 31. Specifically, the created document file is transmitted according to the received setting information. At this time, the aforementioned document file is transmitted to the destination folder included in the received setting information with the file name included in the received setting information.

[0095] On the other hand, if "Set later in chat" is enabled, the chat service 414 starts a chatbot and executes the following process steps S1103 to S1105. In process step S1103, the chat service 414 generates a chat message and transmits it to the relevant user. This relevant user is a chat application user who executes the chat function provided by the chat service 414 and is associated with the received login user information. In process step S1104, the chat service 414 receives a chat message from the relevant user, and in the next process step S1105, it is determined whether all the settings for sending a document have been confirmed. If all the settings have not yet been confirmed, the chat service 414 generates a new chat message in process step S1103 and repeats the following process steps. If all the settings have been confirmed, the chat service 414 transmits the created document file to the external cloud storage server 30 or 31 according to the settings confirmed in the chat message exchange in process steps S1103 to S1105 (S1106). The above-mentioned FIG. 9 shows an example of chat messages exchanged in processing steps S1103 to S1105.

[0096] <Image generation system control sequence> Fig. 12 is a sequence diagram showing the flow of processing among the information processing terminal 40, the image forming device 200, the information processing device 400, and the external cloud storage server 30 or 31 that configure the image forming system shown in Fig. 1. Fig. 12 shows the flow of a series of processing when a user performs an operation to send a scanned document while logged in to the image forming device 200.

[0097] First, in S1201, the image forming apparatus 200 accepts a pressing operation of the cloud linkage CS1 icon 517 or the cloud linkage CS2 icon 518 displayed on the main menu screen 500, and subsequently displays the job selection screen 650 (S1202). As described above, if authentication information for the corresponding external cloud storage server 30 or 31 is not stored in the user management 411, the cloud storage authentication screen 600 is displayed, and then the job selection screen 650 is displayed.

[0098] In S1203, the image forming apparatus 200 accepts pressing of the basic scan selection button 661 displayed on the job selection screen 650, and subsequently displays the scan execution screen 700 (S1204).

[0099] In S1205, the image forming apparatus 200 accepts a setting operation by the user via the UI components 731 to 737 displayed on the scan execution screen 700.

[0100] In S1206, the image forming apparatus 200 accepts pressing of the scan execution button 741 displayed on the scan execution screen 700, and then executes scanning (S1207) and stores the scanned document image data. When the image forming apparatus 200 has stored the scanned document image data for all pages, it displays the next operation selection screen 850 (S1208).

[0101] In S1209, when image forming apparatus 200 accepts pressing of transmission start button 861, it transmits the saved document image data, setting information for transmitting the document file, and login user information to information processing apparatus 400 (S1210). The setting information is, for example, information set via destination folder / file name setting form 736 and check box 737. Then, image forming apparatus 200 displays main menu screen 500 (S1211), and a series of processes in image forming apparatus 200 ends. Note that S1205 to S1210 correspond to the processes shown in the flowchart of FIG. 10.

[0102] In S1212, the information processing device 400 performs image processing on the received document image data to generate a document file. Next, in accordance with the received setting information, it is determined whether "Set later in chat" is disabled or enabled, and performs either the process of S1213 or the process of S1214 and subsequent steps.

[0103] S1213 is a process performed when “Set later in chat” is disabled, and the information processing device 400 transmits the document file created in S1212 to the external cloud storage server 30 or 31 according to the received setting information. The setting information is, for example, the destination folder and file name set in the destination folder / file name setting form 736.

[0104] S1214 is a process performed when "Set later in chat" is enabled, and the information processing device 400 starts a chatbot by the chat service 414. After that, the chat service 414 realizes the exchange of chat messages shown in FIG.

[0105] In S1215, the information processing device 400 generates a chat message (e.g., chat messages 921, 925, and 927) prompting input of a destination folder and a file name, and transmits the chat message to the information processing terminal 40 used by the chat application user associated with the received login user information. When a chat message (e.g., chat messages 922, 928) indicating the destination folder and the file name is input in S1216, the information processing terminal 40 transmits the chat message to the information processing device 400 (S1217).

[0106] Chat messages are exchanged between the user and the chatbot in S1215 to S1217. Then, in accordance with the settings determined in the chat message exchange, the information processing device 400 transmits the document file created in S1213 to the external cloud storage server 30 or 31 (S1218). Note that S1212 to S1215 and S1218 correspond to the process shown in the flowchart of FIG.

[0107] This allows the user to select, when executing scanned document transmission, whether to complete the operation only on the digital multifunction device, or to perform only the minimum necessary operations on the digital multifunction device and perform the remaining operations by means other than the digital multifunction device.

[0108] <Second embodiment> Here, only the parts that differ from the first embodiment will be described.

[0109] <Example of a screen displayed on the operation unit of an image forming device> Fig. 13(A) shows an example of a scan execution screen 1300 which is another embodiment of Fig. 7(A). Compared to the scan execution screen 700 of the implementation system 1, the scan execution screen 1300 has the check box 737 removed, but the other UI components and their functionality are similar.

[0110] 13(B) shows an example of a "Set Later via Chat" selection screen 1350 displayed on operation unit 261 after pressing start transmission button 861 on next operation selection screen 850. The "Set Later via Chat" selection screen 1350 includes an application / login user display area 1351 and a logout button 1352, similar to the cloud storage authentication screen 600 in FIG. 6(A). Furthermore, the "Set Later via Chat" selection screen 1350 is made up of a dialog 1360, a "Yes" button 1361, and a "No" button 1362.

[0111] Dialog 1360 is a dialog that prompts the user to select whether or not to set "set later in chat." "Yes" button 1361 is a button for accepting an operation from the user to enable "set later in chat." On the other hand, "No" button 1362 is a button for accepting an operation from the user to disable "set later in chat."

[0112] <Flowchart of a program executed by the image forming apparatus> Fig. 14 is a flowchart showing a procedure for executing a scan in the cloud storage linkage 332 or 333, which is another embodiment of the flowchart shown in Fig. 10. This process starts when the scan execution screen 1300 is displayed while the user is logged in to the image forming apparatus 200.

[0113] First, in the first processing step S1401, the cloud storage linkage 332 or 333 accepts various setting operations by the user via the UI components 1331 to 1336, and a scan start operation via the scan execution button 1341. At this time, the destination folder and file name may not be set via the destination folder / file name setting form 1336.

[0114] When a scan start operation is performed, the cloud storage link 332 or 333 executes a scan of the placed document (S1402).

[0115] When the scan execution is completed, the cloud storage linkage 332 or 333 determines whether all the settings necessary for transmitting the document file have been finalized (S1403). At this time, if the destination folder and file name have been set via the destination folder / file name setting form 1336, it is determined that all the settings necessary for transmitting the document file have been finalized, and processing step S1408 is executed. On the other hand, if the destination folder and file name have not been set via the destination folder / file name setting form 1336, it is determined that all the settings necessary for transmitting the document file have not been finalized, and processing step S1404 is executed.

[0116] In processing step S1404, the cloud storage linkage 332 or 333 displays the "Set later via chat" selection screen 1350, and determines whether or not to "Set later via chat" (S1405). At this time, if the cloud storage linkage 332 or 333 receives a press operation of the "Yes" button 1361, it determines that "Set later via chat" is enabled. On the other hand, if the cloud storage linkage 332 or 333 receives a press operation of the "No" button 1362, it determines that "Set later via chat" is disabled.

[0117] If "set later via chat" is enabled, the cloud storage linkage 332 or 333 adds information indicating that "set later via chat" is enabled to the setting information (S1407), and then executes processing step S1408. If "set later via chat" is disabled, the cloud storage linkage 332 or 333 displays a destination folder / file name setting screen 750. When a destination folder and file name are input on the destination folder / file name setting screen 750 and a pressing operation of the OK button 782 is accepted, processing step S1408 is then executed.

[0118] In processing step S1408, the cloud storage linkage 332 or 333 transmits the document image data read in the scan execution in S1402, the setting information, and the login user information to the cloud server 400. Note that the setting information is setting information for transmitting a document file, and is composed of the destination folder and file name set in processing step S1401 or processing step S1406, and the setting information added in processing step S1407.

[0119] This eliminates the need to explicitly specify whether to "set later in chat" if the settings for sending document files have already been made when the user performs a send operation. Also, if the user performs a send operation without making the settings for sending document files, the user can choose whether to complete the operation using only the digital multifunction device, or to perform the remaining operations using a means other than the digital multifunction device. In other words, the user can choose whether to complete the operation using only the digital multifunction device, or to perform only the minimum necessary operations on the digital multifunction device and then perform the remaining operations using a means other than the digital multifunction device.

[0120] Although an example of setting a destination folder and a file name has been described as the setting information for sending a document file whose setting is performed by a digital multifunction peripheral or a means other than the digital multifunction peripheral, other setting information may be included. For example, metadata of the document file to be sent may be included as the setting information for sending a document file. In this case, a UI component for setting the metadata of the document file is placed on the scan execution screen 700 or the scan execution screen 1300, or a separate setting screen is provided. The chatbot executed by the chat service 411 generates a chat message that prompts the user to set the metadata of the document file, and determines whether the setting of the metadata of the document file has been confirmed from the chat message input by the user. Furthermore, the setting information for sending a document file may be provided to the user by performing OCR (Optical Character Recognition) processing on the document image data read by the digital multifunction peripheral, and a setting operation based on the OCR result may be provided to the user. For example, the cloud storage linkages 332 and 333 automatically reflect the OCR result in the file name after scanning, and provide a setting operation for confirming and correcting the result by the digital multifunction peripheral or a means other than the digital multifunction peripheral.

[0121] Although the embodiment using a chat application has been described as an example of a means other than a digital multifunction device for performing a setting operation for sending a document file, it may be realized by other means. For example, the cloud storage cooperation services 412 and 413 may provide a Web portal screen for performing a setting operation for sending a document file.

[0122] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of each of the above-mentioned embodiments to a system or device via a network or a storage medium, and having one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC or FPGA) that realizes one or more functions. [Explanation of symbols]

[0123] 400 Information processing device 200 Image forming device 30 External Cloud Storage Servers 31 External Cloud Storage Servers 40 Information processing terminal

Claims

1. Equipped with a scanner, An image processing device having a function of transmitting image data obtained by scanning with the scanner, a display control means for displaying a first screen on which a user can specify a destination of image data obtained by scanning with the scanner; a receiving unit that receives an operation from a user to set a destination of the image data in a device other than the image processing device; a transmitting means for transmitting an instruction based on the operation to a server providing a message exchange service when the operation is accepted, and transmitting the image data when the setting of the destination is accepted on the first screen without the operation; having The server provides a second screen that complies with the instructions.

13. An image processing device comprising:

2. The image data is transmitted to the external storage based on a destination setting received by the other device or the image processing device.

2. The image processing device according to claim 1,

3. the image processing device has a user authentication function; When the transmission means receives the operation, the transmission means transmits information of a user who is logged in to the image processing device in addition to an instruction based on the operation; The server provides the second screen according to the instruction based on the information of the user.

2. The image processing device according to claim 1,

4. When an instruction to transmit the image data is received without receiving a destination setting from a user on the first screen, the receiving means displays a screen for receiving the operation from the user.

2. The image processing device according to claim 1,

5. The receiving means displays a display item for receiving the operation from the user on the first screen.

2. The image processing device according to claim 1,

6. when the transmission means receives the setting of the destination on the first screen without the operation, transmits information of the set destination and the image data to the server; The server transmits the image data based on the information of the destination.

2. The image processing device according to claim 1,

7. 2. The image processing apparatus according to claim 1, wherein the message exchange service is a chat service.

8. Equipped with a scanner, A method for controlling an image processing device having a function of transmitting image data obtained by scanning with the scanner, comprising: a display control step of displaying a first screen capable of receiving from a user a setting of a destination of image data obtained by scanning with the scanner; a receiving step of receiving, from a user, an operation for setting a destination of the image data in a device other than the image processing device; a transmission step of transmitting an instruction based on the operation to a server providing a message exchange service when the operation is accepted, and transmitting the image data when the setting of the destination is accepted on the first screen without the operation; having The server provides a second screen that complies with the instructions. A control method comprising:

9. Equipped with a scanner, an image processing device having a function of transmitting image data obtained by scanning with the scanner, a display control means for displaying a first screen on which a user can specify a destination of image data obtained by scanning with the scanner; a receiving unit that receives an operation from a user to set a destination of the image data in a device other than the image processing device; a transmission means for transmitting an instruction based on the operation to a server providing a message exchange service when the operation is accepted, and transmitting the image data when the setting of the destination is accepted on the first screen without the operation; A program for causing the device to function as a The server provides a second screen that complies with the instructions. A program characterized by:

Images