Application Program and Image Processing Apparatus

Abstract

To provide an application program capable of using a workflow definition file, and an image processing apparatus, configured to provide a technique for improving convenience in creating the workflow definition file.SOLUTION: In creating a WF file that defines a workflow including a process of storing an image file in a designated storage location, an image processing application 22 creates a list of accessible storage locations from among multiple storage location candidates, and displays the storage location candidates included in the created list, separately from storage location candidates not included in the created list, on a user IF 13. The image processing application 22 receives a selection of a storage location candidate, and designates the selected storage location candidate as a storage location to be used for the process of storing the image file.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The technical field disclosed in this specification relates to an application program executable by a computer of an information processing apparatus and an image processing apparatus.

Background Art

[0002] Conventionally, an application program or an image processing apparatus capable of creating a workflow definition file that defines a workflow showing a series of processes including image processing has been known. As a document disclosing techniques related to workflows, for example, there is Patent Document 1. Patent Document 1 discloses a multifunction device capable of executing a workflow, which has a configuration for registering parameter information used in each step of the workflow.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When creating a workflow definition file, the user selects processes or parameters to be included in the workflow from among a plurality of processes. Since the number of options increases as the image processing apparatus has higher functionality, the operation tends to become complicated and inconvenient for the user.

[0005] This specification discloses a technique for improving convenience when creating a workflow definition file in an application program and an image processing apparatus that can utilize the workflow definition file.

Means for Solving the Problems

[0006] An application program made for the purpose of solving this problem is an application program executable by a computer of an information processing apparatus, which causes the computer to execute a creation process for creating a workflow definition file. The workflow definition file is a file that defines a workflow indicating a series of processes including image processing. The workflow can include a saving process for saving an image file to a specified saving destination. Further, when the computer creates the workflow definition file that defines the workflow including the saving process in the creation process, the computer is caused to execute a list creation process for creating a list of accessible saving destinations from among a plurality of saving destination candidates, a display process for distinguishing, in the user interface of the information processing apparatus, the saving destination candidates included in the list created in the list creation process from the saving destination candidates not included in the list and displaying them, and a designation process for accepting a selection of a saving destination candidate and designating the selected saving destination candidate as the saving destination used in the saving process. This is the gist of the invention.

[0007] The application program disclosed in this specification designates the saving destination in the saving process by displaying and accepting a selection while distinguishing accessible saving destination candidates from other saving destination candidates from among a plurality of saving destination candidates when creating a workflow definition file that defines a workflow including a saving process. Thereby, the user can easily understand the accessible saving destination candidates and can more easily select a saving destination as compared with the case where all saving destination candidates are displayed without distinction.

[0008] An information processing apparatus, an image processing apparatus, in which the above application program is incorporated, a computer-readable storage medium storing the application program, and a control method for realizing the functions of the application program are also novel and useful.

Effect of the Invention

[0009] According to the technology disclosed in this specification, an application program and an image processing apparatus that can utilize a workflow definition file are provided, and a technology for improving convenience when creating the workflow definition file is realized.

Brief Description of Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0011] Hereinafter, a first embodiment will be described in detail with reference to the accompanying drawings. In this embodiment, a program executed on a personal computer (hereinafter referred to as "PC") will be described.

[0012] As shown in FIG. 1, the PC1 of this embodiment includes a controller 10 including a CPU 11 and a memory 12. The PC1 is an example of an information processing device, and the CPU 11 is an example of a computer. Further, the PC1 includes a user interface (hereinafter referred to as "user IF") 13 and a communication interface (hereinafter referred to as "communication IF") 14, and these are electrically connected to the controller 10. Note that the controller 10 in FIG. 1 is a general term for the hardware and software used for the control of the PC1, and does not necessarily represent a single piece of hardware actually existing in the PC1.

[0013] The CPU 11 executes various processes according to the program read from the memory 12 and based on the user's operations. Various programs and various data are stored in the memory 12. The memory 12 is also used as a work area when various processes are executed. The buffer included in the CPU 11 is also an example of a memory. Note that an example of the memory 12 is not limited to a ROM, a RAM, an HDD, etc. built in the PC1, and may be a storage medium that can be read from and written to by the CPU 11, for example, a recording medium such as a CD-ROM or a DVD-ROM.

[0014] The user IF 13 includes hardware for displaying a screen for notifying the user of information and hardware for receiving operations by the user. Note that the user IF 13 may be a combination of a display capable of displaying information and a mouse, a keyboard, etc. having an input reception function, or may be a touch panel having a display function and an input reception function.

[0015] The communication IF 14 includes hardware for communicating with an external device. The communication standard of the communication IF 14 is Ethernet (registered trademark), Wi-Fi (registered trademark), USB, etc. The PC1 may include a plurality of communication IFs 14 corresponding to a plurality of communication standards.

[0016] The PC1 of this embodiment is connected to a multi-functional peripheral (hereinafter referred to as "MFP") 3 via a communication IF14, as shown in FIG. 1 for example. The MFP 3 is a device having at least an image reading function. The MFP 3 is an example of a scanner.

[0017] Further, the PC1 may be connected via the communication IF14 to a local server 4, which is a server locally connected to the PC1, for example. Also, the PC1 may be connected to the Internet 50 via the communication IF14, and may utilize various cloud services 51, 52 via the Internet 50. Although shown in a simplified manner in FIG. 1, the PC1 utilizes the various cloud services 51, 52 by connecting to a cloud server managed by the respective cloud services 51, 52.

[0018] As shown in FIG. 1, an operating system (hereinafter referred to as "OS") 21 and an image processing application program (hereinafter referred to as "image processing app") 22 are stored in the memory 12 of the PC1. The image processing app 22 is an example of an application program. The OS 21 is, for example, Windows (registered trademark), macOS (registered trademark), Linux (registered trademark), iOS (registered trademark), Android (registered trademark).

[0019] The image processing app 22 is a program capable of executing various processes such as input, conversion, and output of image data by using a device capable of executing image processing such as the MFP 3. The image processing app 22 of this embodiment is a program corresponding to the MFP 3, and can execute various processes including image processing to be performed on the MFP 3 based on a user's instruction.

[0020] Examples of input - related processes executable by the image - processing application 22 include, for example, a scanning process for causing an MFP 3 or the like to perform scanning to acquire image data, and a download process for downloading image data via the Internet 50. Examples of conversion - related processes executable by the image - processing application 22 include, for example, a conversion process for converting the format of image data, and an OCR process for converting character images in image data into character data. Examples of output - related processes executable by the image - processing application 22 include, for example, a printing process for transmitting image data to an MFP 3 or the like to cause printing, an upload process for transmitting an image file to a cloud service 51 or the like via the Internet 50, and a local storage process for storing an image file in the memory 12 or a local server 4 or the like. The upload process and the local storage process are examples of storage processes.

[0021] Also, the image - processing application 22 of this embodiment can utilize a workflow. A workflow indicates a series of processes to be executed by the image - processing application 22 and is defined by a workflow definition file (hereinafter referred to as a "WF file"). The image - processing application 22 of this embodiment can receive instructions for creating, registering, and executing a WF file. A series of processes executed by the image - processing application 22 according to the workflow includes, for example, image processing to be executed on a device such as an MFP 3. In the image - processing application 22 of this embodiment, for example, as shown in FIG. 1, WF files 23 and 24 are registered.

[0022] In the WF file 23, for example, as shown in FIG. 2, a plurality of jobs are described in the order of execution to be executed by the image - processing application 22, and as information for each job, information such as settings used when the job is executed is included. In the example of the WF file 23 in FIG. 2, three jobs, <Job 1> 231, <Job 2> 232, and <Job 3> 233, are described in the order of execution.

[0023] The <Job 1> 231 of the WF file 23 is a scanning process that causes the MFP 3 to perform scanning to obtain scan data. The <Job 2> 232 is a conversion process that converts the scan data obtained in the <Job 1> 231 into the PDF format. The <Job 3> 233 is a local storage process that stores the file converted into the PDF format in the memory 12 of the PC 1 in the <Job 2> 232. Note that in this WF file 23, one process is described for each job, but a job may include a plurality of processes.

[0024] Subsequently, various operations related to the workflow in the PC 1 in which the image processing application 22 is incorporated will be described. Note that each processing step of the processing and the flowchart in the following description basically shows the processing of the CPU 11 according to the instructions described in a program such as the image processing application 22.

[0025] When the image processing application 22 is started, it displays an instruction reception screen for receiving a user's instruction on the user IF 13. On the instruction reception screen, for example, as shown in FIG. 3, a print instruction button for receiving an instruction to cause the MFP 3 to perform printing, a scan instruction button for receiving an instruction to cause the MFP 3 to perform scanning, and a WF creation button for receiving the creation and registration of a WF file are displayed. When there is a created WF file, a WF execution button for receiving an instruction to specify and execute the created WF file is displayed on the instruction reception screen.

[0026] The procedure of the WF execution process by the image processing application 22 will be described with reference to the flowchart of FIG. 4. The WF execution process is executed by the CPU 11 of the PC 1 when the image processing application 22 receives an instruction to specify and execute a created WF file.

[0027] The CPU 11 reads the WF file instructed to be executed (S101). Then, the CPU 11 executes each job described in the read WF file in order from the topmost job (S102). For example, if the WF file to be executed is the WF file 23 shown in FIG. 2, the CPU 11 first sends a scan instruction to the MFP 3 based on <Job 1> 231, which is the topmost job, and receives scan data from the MFP 3.

[0028] The CPU 11 determines whether the job executed in S102 is a save job that includes an upload process or a local save process (S103). If it is determined that it is not a save job (S103: NO), the CPU 11 determines whether the next job is described in the read WF file (S105). Since <Job 1> 231 is not a save job, the CPU 11 determines NO in S103 and reads the next job from the WF file 23.

[0029] If it is determined that there is a next job (S105: YES), the CPU 11 returns to S102 and executes the read next job. In the case of the WF file 23, the next job is the conversion process of <Job 2> 232. The CPU 11 converts the format of the scan data acquired in <Job 1> 231 to the PDF format in S102 and creates PDF data. Since <Job 2> 232 is also not a save job, the CPU 11 determines NO in S103 and reads the next job from the WF file 23.

[0030] In <Job 3> 233 of the WF file 23, a local save process for saving a file to the folder of the PC 1 is defined. The CPU 11 saves the PDF data created in <Job 2> 232 in S102 based on the description of <Job 3> 233. This <Job 3> 233 is a save job.

[0031] When it is determined that the executed job is a save job (S103: YES), the CPU 11 stores, in the save history information 25 (see FIG. 1) of the memory 12, information indicating the save destination where data was saved by the save job after the execution of the save job (S104). S104 is an example of storage processing. As the information indicating the save destination, for example, a folder path, a URL on the Internet, an IP address of an external device, or a combination thereof can be specified. Note that the CPU 11 may execute S104 when the execution of the save job is successful, and skip S104 when the execution fails, such as when the specified save destination cannot be accessed.

[0032] After S104, the CPU 11 proceeds to S105 and determines whether there is a next job. When it is determined that there is no next job (S105: NO), the CPU 11 ends the WF execution process.

[0033] Note that the image processing application 22 accepts the specification of the save destination of the scan data not only when executing the workflow but also when receiving an instruction to execute the scan process. For example, when the image processing application 22 receives an operation on the scan instruction button on the instruction reception screen shown in FIG. 3, it accepts the specification of the save destination of the scan data. After accepting the specification of the save destination of the scan data and receiving an instruction to execute the scan process, the image processing application 22, for example, sends a scan instruction to the MFP 3, acquires scan data from the MFP 3, and saves the acquired scan data to the specified save destination. Even when the image processing application 22 saves data in the scan process, it stores information indicating the save destination in the save history information 25.

[0034] Next, with reference to the flowchart of FIG. 5, the procedure of the WF creation process for creating a WF file on the PC 1 in which the image processing application 22 is incorporated will be described. This WF creation process is executed by the CPU 11 of the PC 1 when the image processing application 22 receives an instruction to create a workflow. In this embodiment, the process when an instruction to create a WF file defining a workflow including a series of processes of scanning and saving is received will be described.

[0035] When the image processing application 22 receives an instruction to create a workflow including scanning and saving, it determines whether the PC 1 is connected to the network (S201). S201 is an example of a determination process. If it is not connected to the network, the PC 1 cannot connect to the MFP 3 or the cloud service. As will be described later, the image processing application 22 of this embodiment determines whether access to the save destination specified by the user is possible when creating a WF file. If it is not connected to the network, since an access attempt cannot be made, the CPU 11 cannot make an appropriate determination as to whether access is possible.

[0036] If it is determined that the PC 1 is not connected to the network (S201: NO), the CPU 11 issues a notification prompting the user to connect to the network (S202), and ends the WF creation process. S202 is an example of a notification process. In this embodiment, when the PC 1 is not connected to the network, it prompts the user to connect to the network by warning them to that effect.

[0037] If it is determined that the PC 1 is connected to the network (S201: YES), the CPU 11 accepts the user's selection of either "Save to PC", which designates saving to a locally connected device including the PC 1 or the local server 4, or "Save to Cloud Service", which uploads to the cloud service, as the save destination. Then, the CPU 11 determines which of "Save to PC" and "Save to Cloud Service" has been selected (S203).

[0038] When it is determined that "Save to PC" is selected (S203: PC), the CPU 11 executes PC save destination determination processing (S204). On the other hand, when it is determined that "Save to cloud service" is selected (S203: cloud service), the CPU 11 executes cloud save destination determination processing (S205).

[0039] The procedure of the PC save destination determination processing will be described with reference to the flowchart of FIG. 6. In the PC save destination determination processing, the CPU 11 acquires the information of the folder designated as the save destination from the WF files that have been created by the image processing application 22 and include local save processing (S301), and extracts it as the save destination to be confirmed. The local save processing is the processing of saving to the PC 1 or the local server 4, and the save destination designated in the local save processing is one of the folders of the PC 1 or the local server 4.

[0040] Note that the save destination to be confirmed is the save destination that is one of the targets for confirming whether to add it to the save destination candidate list. The save destination candidate list is a list of candidates for the save destination to be registered in the WF file being created, and is a list for receiving the user's selection. The folder designated as the save destination in the created WF file is likely to be accessible and is likely to be a folder frequently used by the user. By including such a folder in the save destination to be confirmed, convenience is enhanced.

[0041] Also, the CPU 11 reads the save history information 25 from the memory 12 (S302), and adds the folder of the PC 1 or the local server 4 stored in the save history information 25 to the save destination to be confirmed. As described above, the save history information 25 stores information indicating the folder of the designated save destination when a scan is executed or when a workflow including a scan is executed. The save history information 25 may store only the save destination of the local save processing.

[0042] The folder stored as the storage destination in the scan execution history is likely to be accessible and is likely to be a frequently used folder by the user. Therefore, by including such a folder in the storage destinations to be checked, convenience is enhanced.

[0043] Furthermore, the CPU 11 acquires the storage destination information 31 stored in the MFP 3 connected to the PC 1 from the MFP 3 (S303), and adds each storage destination stored in the storage destination information 31 to the storage destinations to be checked. Note that the storage destination information 31 is information stored by the MFP 3 when, for example, the designation of the storage destination of scan data is received on the panel of the MFP 3. The MFP 3 of this embodiment can receive an instruction for push scan, for example, by operating the panel of the MFP 3. In the instruction for push scan, a folder of the PC 1 can be set as the storage destination of scan data. When the MFP 3 executes push scan, for example, the MFP 3 stores information indicating the folder designated as the storage destination of scan data in the storage destination information 31.

[0044] The folder set as the storage destination of scan data in the MFP 3, which is a device used by the user, is likely to be accessible and is likely to be a frequently used folder by the user. By including such a folder in the storage destinations to be checked, convenience is enhanced.

[0045] By S301 to S303, the CPU 11 can acquire one or more storage destinations to be checked. If there is no storage destination to be checked, the CPU 11 does not display candidates for the storage destination and ends the PC storage destination determination process. In this case, the image processing application 22 may, for example, request the user to input a storage destination in the same manner as in the conventional case.

[0046] The CPU 11 attempts to access one of the storage destinations extracted as the storage destination to be confirmed in S301 to S303 (S304), and determines whether it is currently accessible for each folder (S305). If it is determined that access is possible (S305: YES), the storage destination is a folder with access permission, and the CPU 11 adds the storage destination to the storage destination candidate list (S311). The storage destination candidate list is a list of accessible folders. S311 is an example of list creation processing. Note that the CPU 11 prepares an empty storage destination candidate list prior to S311.

[0047] If it is determined that access to the extracted storage destination is not possible (S305: NO), the CPU 11 determines whether the folder name of the storage destination is described in the correct format (S321). When storing the folder name in the storage history information 25, for example, when it is stored based on information from another application program, the folder name may be automatically changed to an incorrect format.

[0048] If it is determined that the format is not correct (S321: NO), the CPU 11 attempts to correct the folder name (S322), and attempts to access the folder with the corrected folder name. Then, the CPU 11 determines whether it can access the folder with the corrected folder name (S323).

[0049] There are several patterns for the automatic change of the folder name. Therefore, the image processing application 22 memorizes the change patterns and tries the trial of S322 by applying those patterns. For example, when there are two "￥" at the beginning of the folder path, one "￥" may be deleted and the description may include only one "￥". Also, for example, when "￥" and "_" are continuously included in the folder path, "￥" may be deleted. The CPU 11 performs processing such as adding "￥" in S322 using the possible change patterns. Note that when there are multiple possible change patterns, if the CPU 11 cannot access after modifying the folder name based on one change pattern, it may further try the modification and access with other change patterns.

[0050] When it is determined that access is possible by modifying the folder name (S323: YES), the CPU 11 adds the modified folder name to the save destination candidate list (S311).

[0051] On the other hand, when it is determined that the format of the folder name is correct (S321: YES), or when it is determined that access is not possible even if the modification of the folder name is tried (S323: NO), the CPU 11 tries to access the parent folder one level above the extracted save destination (S331). Then, the CPU 11 determines whether it can access the parent folder (S332). When it is determined that it can access the parent folder (S332: YES), the CPU 11 adds the accessible parent folder to the save destination candidate list (S311).

[0052] For example, when the folder used as the save destination is deleted, the CPU 11 cannot access that folder. However, there is a possibility that the parent folder, which is the upper folder of the deleted folder, remains and it may be possible to access that parent folder. If the upper folder is accessible, by including that upper folder in the list, it is possible to suppress the decrease in convenience without narrowing down the user's options.

[0053] After S311, or when it is determined that access to the parent folder is also impossible (S332: NO), the CPU 11 determines whether there are any other extracted storage destinations (S341). If it is determined that there are other storage destinations extracted as confirmation targets (S341: YES), the CPU 11 returns to S304 and attempts to access another folder that is the storage destination to be confirmed.

[0054] On the other hand, when the confirmation of all storage destinations extracted as confirmation targets in S301 to S303 is completed and it is determined that there are no other storage destinations (S341: NO), the CPU 11 causes the user IF 13 to display a storage destination selection screen that includes the list of storage destinations stored in the created storage destination candidate list as options (S351). S351 is an example of display processing. The storage destinations displayed as a list on the storage destination selection screen are all storage destinations that were accessible, that is, folders with access rights, and do not include storage destinations that were inaccessible. By not displaying inaccessible storage destinations as options, the possibility of creating a WF file in which an unexecutable WF is defined can be suppressed.

[0055] For example, as shown in FIG. 7, the storage destination selection screen 60 is a screen that displays a list 61 of accessible folders and accepts selections. On the storage destination selection screen 60, the CPU 11 further accepts the specification of the file name and file format to be saved. Note that the storage destination selection screen 60 may further include a "Select Folder" button 62 that accepts the specification of a folder not included in the list.

[0056] Then, the CPU 11 determines whether a selection instruction is received by the user's operation on the OK button 65 included in the storage destination selection screen 60 (S352). When the selection of necessary information is received on the storage destination selection screen 60, the CPU 11 becomes able to accept the operation on the OK button 65.

[0057] If it is determined that no selection instruction has been received (S352: NO), the CPU 11 determines whether an operation on the cancel button 66 included in the save destination selection screen 60 has been received (S353). If it is determined that no operation on the cancel button 66 has been received (S353: NO), the CPU 11 waits until an operation on the OK button 65 or the cancel button 66 is received.

[0058] If it is determined that a selection instruction has been received (S352: YES), the CPU 11 determines the save destination selected during the operation on the OK button 65 as the save destination to be described in the WF file (S354), ends the PC save destination determination process, and returns to the WF creation process. S354 is an example of the designation process.

[0059] On the other hand, if it is determined that an operation on the cancel button 66 has been received (S353: YES), the CPU 11 does not determine the save destination, ends the PC save destination determination process, and returns to the WF creation process.

[0060] Next, the procedure of the cloud save destination determination process (S205) executed when "Save to cloud service" is selected in S203 of the WF creation process shown in FIG. 5 will be described with reference to the flowchart of FIG. 8.

[0061] In the cloud save destination determination process, the CPU 11 extracts cloud services that can be supported by the image processing application 22 (S401). A plurality of cloud services are registered in advance in the image processing application 22, and among them, the cloud services for which signing in is possible are the supported services. On the other hand, for example, cloud services whose access is restricted by terminated cloud services or internal regulations are cloud services for which signing in is not possible and are not supported services.

[0062] The CPU 11 checks, one by one in order, whether each of the applicable cloud services can be accessed. First, the CPU 11 determines whether it has signed in to the cloud service to be checked (S403). Specifically, the CPU 11 determines whether information indicating that it has signed in to the cloud service, for example, an access token associated with the cloud service, is stored in the memory 12.

[0063] If it is determined that the sign-in has been completed (S403: YES), the CPU 11 determines whether the access token stored in the memory 12 is available (S404). For the determination in S404, the CPU 11, for example, attempts to access the cloud service using the access token. Alternatively, the CPU 11 may make the determination in S404 based on whether the stored access token is within the valid period.

[0064] If it is determined that the access token is not available (S404: NO), the CPU 11 determines whether a refresh token for updating the access token is available (S405). If it is determined that the refresh token is available (S405: YES), the CPU 11 attempts to update the access token using the refresh token (S406) and determines whether the update was successful (S407).

[0065] If it is determined that a valid access token for accessing the cloud service is stored (S404: YES), or if it is determined that the access token was successfully updated using the refresh token (S407: YES), the CPU 11 determines that access to the cloud service is possible and adds the cloud service to the signed-in list (S411). The signed-in list is an example of the first list.

[0066] The signed-in list is a list of candidate storage destinations to be registered in the WF file being created, and is a list of accessible cloud services for receiving user selections. S411 is an example of list creation processing. Note that the CPU 11 prepares an empty signed-in list prior to S411.

[0067] Even if a cloud service has no valid access token but has a refresh token and can re-acquire the access token using the refresh token, it becomes a signed-in cloud service.

[0068] On the other hand, if it is determined that the cloud service has not been signed in (S403: NO), or if it is determined that the refresh token cannot be used (S405: NO), or if it is determined that the update of the access token has failed (S407: NO), the CPU 11 adds that cloud service to the sign-in required list (S412). The sign-in required list is a list of cloud services that may become accessible by performing the sign-in procedure but are not currently accessible. The sign-in required list is an example of a second list. Note that the CPU 11 prepares an empty sign-in required list prior to S412.

[0069] After S411 or S412, the CPU 11 determines whether there are any other cloud services among the cloud services extracted in S401 that are not the confirmation target (S421). If it is determined that there are others (S421: YES), the CPU 11 returns to S403 and determines whether the next cloud service is accessible.

[0070] If it is determined that all the extracted cloud services have been added to the signed-in list or the sign-in required list (S421: NO), the CPU 11 causes the user IF 13 to display a service selection screen including the created signed-in list and sign-in required list as separate lists (S431). S431 is an example of display processing.

[0071] For example, as shown in FIG. 9, the service selection screen 70 is a screen that displays and accepts selections of "Signed-in Services" 71, which is a list of signed-in lists, and "Services Requiring Sign-in" 72, which is a list of lists requiring sign-in. "Signed-in Services" 71 is an example of a candidate storage destination included in the first list, and "Services Requiring Sign-in" 72 is an example of a candidate storage destination included in the second list. On the service selection screen 70, the CPU 11 further accepts the specification of the file name and file format to be saved.

[0072] On the service selection screen 70 of this embodiment, "Signed-in Services" 71 and "Services Requiring Sign-in" 72 are displayed separately. Even if it is an available cloud service, if it is a cloud service that has not been signed in, an operation for signing in is required. Therefore, by displaying it separately from the signed-in cloud services, the user can easily select an immediately available cloud service.

[0073] Note that on the service selection screen 70 shown in FIG. 9, the list of signed-in lists and the list of lists requiring sign-in are separated and displayed as separate selection fields, but the display form is not limited to this. For example, it may be displayed as one selection field with different font colors and sizes for the list of signed-in lists and the list of lists requiring sign-in.

[0074] In addition, the service selection screen 70 may further include a "Select Other Services" button 73 for accepting the specification of services not included in the list. When an operation on the "Select Other Services" button 73 is accepted, the CPU 11 displays a cloud service that is registered in the image processing application 22 but is restricted from access due to internal regulations or the like. The cloud service displayed by operating the "Select Other Services" button 73 is an example of a candidate storage destination that is not included in either the first list or the second list.

[0075] Then, the CPU 11 determines whether it has received a selection instruction by operating the OK button 75 included in the service selection screen 70 (S432). When receiving the selection of necessary information on the service selection screen 70, the CPU 11 becomes able to receive an operation on the OK button 75.

[0076] If it is determined that no selection instruction has been received (S432: NO), the CPU 11 determines whether it has received an operation on the cancel button 76 included in the service selection screen 70 (S433). If it is determined that no operation on the cancel button 76 has been received (S433: NO), the CPU 11 waits until it receives an operation on the OK button 75 or the cancel button 76.

[0077] If it is determined that a selection instruction has been received (S432: YES), the CPU 11 determines whether the selected service is a service that requires sign - in and is included in the required sign - in list (S441). If it is determined that a service included in the required sign - in list has been selected (S441: YES), the CPU 11 accesses the selected cloud service, displays a sign - in screen provided by the cloud service, and receives the input of sign - in information from the user (S442).

[0078] The CPU 11 determines whether the sign - in to the cloud service has been successful (S443). Note that if the sign - in is successful, the CPU 11 can obtain an access token provided by the cloud service.

[0079] If it is determined that the sign - in has not been successful (S443: NO), the CPU 11 determines whether it has received the cancellation of the sign - in by the user (S444). If it is determined that no cancellation has been received (S444: NO), the CPU 11 returns to S442 to receive the sign - in and waits until either the sign - in is successful or it is cancelled.

[0080] If it is determined that the sign-in was successful (S443: YES), or if it is determined that the selected service is a signed-in service included in the signed-in service list (S441: NO), the CPU 11 determines the storage destination for defining the signed-in service in the WF file (S445). S445 is an example of a designation process. When the sign-in is successful and an access token provided by the cloud service is acquired, the CPU 11 stores the acquired access token in the memory 12 in association with the cloud service name. After S445, the CPU 11 ends the cloud storage destination determination process and returns to the WF creation process.

[0081] On the other hand, if it is determined that an operation to the cancel button 76 included in the service selection screen 70 has been received (S353: YES), or if it is determined that the sign-in has been canceled on the sign-in reception screen (S444: YES), the CPU 11 does not determine the storage destination, ends the cloud storage destination determination process, and returns to the WF creation process.

[0082] Returning to the explanation of the WF creation process in FIG. 5, the CPU 11 determines whether the storage destination has been determined in either the PC storage destination determination process of S204 or the cloud storage destination determination process of S205 (S211). If it is determined that the storage destination has been determined by executing S354 in the PC storage destination determination process or S445 in the cloud storage destination determination process (S211: YES), the CPU 11 determines whether an instruction for scan settings has been received (S212). Note that the image processing application 22 sets, for example, default settings as the initial values of the scan settings at the start of the WF creation process. A user who wants to change the scan settings from the initial values gives an instruction for the scan settings.

[0083] If it is determined that an instruction for scan settings has been received (S212: YES), the CPU 11 receives various settings related to scanning, such as the document size, whether color is to be read, and the read resolution (S213). After S213, the CPU 11 returns to S212 and further determines whether an instruction for scan settings has been received.

[0084] When it is determined that no scan setting instruction has been received (S212: NO), the CPU 11 determines whether an instruction to register a WF file has been received (S221). When it is determined that an instruction to register a WF file has been received (S221: YES), the CPU 11 creates a WF file including the currently selected scan setting and the information on the storage destination determined in the PC storage destination determination process or the cloud storage destination determination process, and registers it in the memory 12 (S222). S222 is an example of a creation process.

[0085] The registered WF file becomes a workflow capable of receiving an execution instruction. As a result, on the instruction reception screen (see FIG. 3) displayed when the image processing application 22 is started, a WF execution button corresponding to the registered WF file is displayed. Note that the image processing application 22 may receive the designation of the name of the WF file at the time of registration, and the name of the WF file may be displayed on the WF execution button.

[0086] When it is determined that no instruction to register a WF file has been received (S221: NO), the CPU 11 determines whether an instruction to cancel the creation of a WF has been received (S223). When it is determined that no instruction to cancel the creation of a WF has been received (S223: NO), the CPU 11 waits until it receives any one of a scan setting instruction, a registration instruction, or a cancellation instruction.

[0087] After S222, or when it is determined that an instruction to cancel the creation of a WF has been received (S223: YES), or when the storage destination cannot be determined in the PC storage destination determination process or the cloud storage destination determination process and it is determined that the process has been canceled (S211: NO), the CPU 11 does not create a WF file and ends the WF creation process.

[0088] As described in detail above, when creating a WF file including upload processing and local storage processing, the image processing application 22 of the first embodiment displays candidates for accessible storage destinations separately from other candidates for storage destinations among a plurality of candidates for storage destinations. As a result, the user can easily identify candidates for accessible storage destinations and is more likely to select a storage destination compared to the case where all candidates for storage destinations are displayed without distinction. In addition, by making it easier to select candidates for accessible storage destinations, the possibility of creating a WF file in which an accessible storage destination is defined increases, and the possibility of creating a WF file in which an infeasible process is defined can be suppressed.

[0089] Furthermore, in this embodiment, since the storage destinations stored in the existing WF file, the storage history information 25, and the storage destination information 31 stored in the MFP 3 are acquired as candidates for storage destinations, and the accessible storage destinations are displayed separately from other candidates for storage destinations, storage destinations that are highly likely to be selected as storage destinations are displayed.

[0090] Furthermore, in this embodiment, a list of cloud services that can be signed in to is created and displayed separately from cloud services that cannot be signed in to, so it is easy to select a usable cloud service from among a plurality of cloud service candidates.

[0091] Next, the second embodiment will be described in detail with reference to the accompanying drawings. In this embodiment, a program executed by the MFP will be described. In this regard, it is different from the first embodiment executed by the PC 1.

[0092] As shown in FIG. 10, the MFP 100 of this embodiment includes a controller 110 that includes a CPU 111 and a memory 112. The MFP 100 is an example of an image processing apparatus. Further, the MFP 100 includes a user IF 113, a communication IF 114, a printing unit 115, and a scanner 116, and these are electrically connected to the controller 110. The MFP 100 can execute printing based on image data using the printing unit 115, and can also execute image reading for reading an image of a document using the scanner 116. The printing unit 115 and the scanner 116 are examples of an image processing unit.

[0093] The CPU 111 executes various processes according to a program read from the memory 112 and based on a user's operation. Various programs and various data are stored in the memory 112. The memory 112 is also used as a work area when various processes are executed.

[0094] The user IF 113 includes hardware for displaying a screen for notifying a user of information and hardware for receiving an operation by the user. The communication IF 114 includes hardware for communicating with an external device. The communication standard of the communication IF 114 is Ethernet (registered trademark), Wi-Fi (registered trademark), USB, etc. As shown in FIG. 10, the MFP 100 of this embodiment can be connected to a PC 101, a local server 104, and the Internet 50 via the communication IF 114. Further, the MFP 100 can use various cloud services 51, 52 via the Internet 50.

[0095] As shown in FIG. 10, an OS 121 and an image processing application 122 are stored in the memory 112 of the MFP 100. The image processing application 122 is a program capable of executing various processes such as input, conversion, and output of image data using the printing unit 115 and the scanner 116. Further, the image processing application 122 of this embodiment can use a workflow and receives an instruction for creating and executing a WF file.

[0096] Note that, for example, as shown in FIG. 10, WF files 123 and 124 created by the image processing application 122 are registered in the memory 112 of the MFP 100 of this embodiment. Similar to the WF files 23 and 24 in the aforementioned first embodiment, the WF files 123 and 124 are files that define a workflow indicating a series of processes including image processing such as printing and scanning.

[0097] The MFP 100 can receive execution instructions for the created WF files 123 and 124. When receiving the selection of a WF file and its execution instruction, the MFP 100 executes the same processing as the WF execution processing shown in FIG. 4. That is, the CPU 111 reads out the specified WF file and executes jobs in order according to the description therein. If the job to be executed is a save job, information indicating the specified save destination is stored in the save destination information 131 of the memory 112. Note that the save destination may be a folder of the PC 101 or the local server 104 connected to the MFP 100, or may be cloud services 51 and 52.

[0098] The image processing application 122 of the MFP 100 of this embodiment can receive an instruction to create a WF file via the user IF 113. When receiving an instruction to create a WF file including a process of saving scan data or the like, the image processing application 122 executes the same processing as the WF creation processing shown in FIG. 5.

[0099] When the CPU 111 receives an instruction to create a WF file including local save processing, it executes the same processing as the PC save destination determination processing shown in FIG. 6. Specifically, the CPU 111 displays a list of candidate save destinations accessible to the user IF 113 based on the save destination information described in the WF file created in the MFP 100, the save destination information 131 stored in the memory 112 of the MFP 100, and the save history information stored in the locally connected PC 101 or the like.

[0100] Also, when the CPU 111 receives an instruction to create a WF file including upload processing, it executes the same processing as the cloud storage destination determination processing shown in FIG. 8. Specifically, the CPU 111 attempts to access a cloud service that can be handled by the image processing application 122, and causes the user IF 113 to display a list of signed-in cloud services. If it is possible to display them simultaneously on the user IF 13, the CPU 111 may also display the list of services that require sign-in at the same time.

[0101] Even when executed by the CPU 111, the upload processing for uploading scan data to a cloud service 51 or the like and the local storage processing for storing scan data in a locally connected device such as the PC 101 or the local server 104 are examples of storage processing, and S222 of the WF creation processing is an example of creation processing. Also, S311 of the PC storage destination determination processing and S411 of the cloud storage destination determination processing are examples of list creation processing, S351 of the PC storage destination determination processing and S431 of the cloud storage destination determination processing are examples of display processing, and S352 of the PC storage destination determination processing and S432 of the cloud storage destination determination processing are examples of designation processing.

[0102] As described in detail above, the image processing application 122 of the second form displays candidates for accessible storage destinations separately from candidates for other storage destinations, as in the first form. As a result, the user can easily identify candidates for accessible storage destinations and can more easily select a storage destination as compared with the case where all storage destination candidates are displayed without distinction.

[0103] In particular, the user IF 113 of the MFP 100 often has less information that can be displayed compared to the user IF 13 of the PC 1. According to the second form, it is possible to reduce the number of options, such as displaying only candidates for accessible storage destinations, which effectively affects the convenience for the user.

[0104] Note that this embodiment is merely an example and does not limit the present invention in any way. Therefore, the technology disclosed in this specification can naturally be improved and modified in various ways without departing from the gist thereof. For example, instead of the PC1, it may be, for example, a tablet computer or a smartphone. Further, not limited to the MFP3, any device having a scanning function and a communication function such as a copier, a FAX device, a scanner, a digital camera, etc. may be used.

[0105] Also, the WF file is not limited to being stored in the memory 12, and any file that can be read by the image processing applications 22 and 122 may be used. For example, there may be a WF file stored in a device other than the PC1 and the MFP100 such as a local server 4 or a cloud server.

[0106] Further, for example, each of the various illustrated screens is merely an example, and the display forms such as the words included, the positions, shapes, numbers, etc. of the buttons are not limited to the illustrated examples. Also, in the embodiment, as buttons for selecting a storage destination other than the storage destinations displayed as options, an example of a screen including the "Select Folder" button 62 on the storage destination selection screen 60 (FIG. 7) and the "Select Other Service" button 73 on the service selection screen 70 (FIG. 9) is shown, but these buttons may not be included.

[0107] Also, in the embodiment, an example of the service selection screen 70 including both the list of signed-in services and the list of services requiring sign-in is shown, but it is not limited to simultaneously displaying both lists. For example, when there are no services included in the signed-in list, the list of services requiring sign-in may be displayed, or the list of signed-in services may be displayed first, and then the list of services requiring sign-in may be displayed when a predetermined input operation is received. In particular, in the second embodiment, since the amount of information that can be displayed on the user IF113 provided in the MFP100 is likely to be small, it is easier to apply if they are not displayed simultaneously.

[0108] In the embodiment, it is assumed that the storage destination selection screen 60 shown in FIG. 7 does not display a storage destination that is inaccessible even if it is a storage destination included in the created WF file, the storage history information 25, or the storage destination information 31. However, for example, it may be displayed separately from accessible storage destinations. For example, the list of accessible folders and the list of inaccessible folders may be separated and displayed in different columns.

[0109] In the embodiment, in the PC storage destination determination process, it is assumed that information on candidates for the storage destination is acquired from all of the created WF file, the storage history information stored in the PC1 or PC101, and the storage destination information stored in the MFP3 or MFP100. However, it is also possible to use only one or two of these. Specifically, at least one of S301 to S303 in the PC storage destination determination process may be executed. Also, S331 to S332 in the PC storage destination determination process may be omitted.

[0110] In the embodiment, it is assumed that when the storage destination of the required sign-in list is selected, sign-in is subsequently accepted. However, it is not necessary to accept it. For example, sign-in may be accepted when an instruction to execute a workflow is received. In that case, even if the CPU 11 determines YES in S444 of the cloud storage destination determination process in FIG. 8, it may proceed to S445 and determine the selected cloud service as the storage destination in S432.

[0111] In any flowchart disclosed in the embodiment, the plurality of processes in any plurality of steps can be arbitrarily changed in the execution order or executed in parallel within a range where no contradiction occurs in the processing content.

[0112] The processes disclosed in the embodiment may be executed by a single CPU, a plurality of CPUs, hardware such as an ASIC, or a combination thereof. Also, the processes disclosed in the embodiment can be realized in various forms such as a recording medium recording a program for executing the process, or a method.

Description of Reference Numerals

[0113] 1. 101 PC 3. 100 MFP 11. 111 CPU 13. 113 User IF 115 Printing Unit 116 Scanner

Claims

1. An application program executable by a computer of an information processing apparatus, causing the computer to execute a creation process for creating a workflow definition file, the workflow definition file being a file that defines a workflow indicating a series of processes including image processing, and the workflow being capable of including a saving process for saving an image file to a specified saving destination, and further causing the computer to when creating the workflow definition file that defines the workflow including the saving process in the creation process, execute a list creation process for creating a list of accessible saving destinations from among a plurality of saving destination candidates, execute a display process for distinguishing, in the user interface of the information processing apparatus, saving destination candidates included in the list created in the list creation process from saving destination candidates not included in the list and displaying the former, execute a designation process for accepting a selection of a saving destination candidate and designating the selected saving destination candidate as the saving destination to be used in the saving process, and causing the computer to do so,

2. In the application program according to Claim 1, in the display process, saving destination candidates included in the list created in the list creation process are displayed in the user interface, and saving destination candidates not included in the list created in the list creation process are not displayed in the user interface, and causing the computer to do so, In the application program according to Claim 1 or Claim 2, in the saving process, a folder can be designated as the saving destination, and in the list creation process, Include a folder with access rights among the candidates of the plurality of storage destinations in the list. An application program characterized by the above.

4. In the application program according to claim 3, In the list creation process, Read the created workflow definition file, and if the save process is included in the workflow defined in the read workflow definition file and a folder is specified as the storage destination, obtain the folder specified in the save process, and include the obtained folder in the candidates of the plurality of storage destinations. An application program characterized by the above.

5. In the application program according to claim 3 or claim 4, On the computer, After executing the save process with a folder as the storage destination, execute a storage process for storing an execution history including the storage destination folder, Further, in the list creation process, Read the execution history stored in the storage process, obtain the folders included in the execution history, and include the obtained folders in the candidates of the plurality of storage destinations. An application program characterized by the above.

6. In the application program according to any one of claims 3 to 5, In the list creation process, Obtain the storage destination information stored in the scanner connected to the information processing device from the scanner, include the folder indicated by the obtained storage destination information in the candidates of the plurality of storage destinations, and the scanner can set a folder as the storage destination of the read image and stores the storage destination information indicating the set storage destination. An application program characterized by the above.

7. In the application program according to any one of claims 3 to 6, in the list creation process, one or more candidate folders for the storage destination are acquired, it is determined whether each acquired folder is currently accessible, the folders determined to be accessible are included in the list, and even for a folder determined not to be accessible, if the upper-level folder of the folder is accessible, the upper-level folder is included in the list. An application program characterized by the above.

8. In the application program according to claim 1 or claim 2, the saving process is a process of saving an image file using a specified cloud service as the storage destination, and signing in is required to use the cloud service. in the list creation process, a cloud service for which signing in is possible is included in the list from among the plurality of candidate storage destinations. An application program characterized by the above.

9. In the application program according to claim 8, on the computer, in the list creation process, a first list and a second list are created as the list, a signed-in cloud service is included in the first list from among the plurality of candidate storage destinations, and a cloud service for which signing in is required is included in the second list. in the display process, the candidate storage destinations included in the first list, the candidate storage destinations included in the second list, and the candidate storage destinations not included in either the first list or the second list are distinguished and displayed on the user interface of the information processing apparatus. An application program characterized by the above.

10. In the application program according to any one of claims 1 to 9, when the computer creates the workflow definition file that defines the workflow including the saving process, before executing the list creation process, execute a determination process to determine whether it is connected to a network, when it is determined that it is connected to a network, execute the list creation process and the designation process, when it is not determined that it is connected to a network, do not execute the list creation process and the designation process, and execute a notification process to notify that it is not connected to a network. An application program characterized by the above.

11. An image processing unit, A user interface, An image processing apparatus comprising: the image processing apparatus executes a creation process for creating a workflow definition file, and the workflow definition file is a file that defines a workflow indicating a series of processes including image processing to be executed by the image processing unit, and the workflow can include a saving process for saving an image file to a specified saving destination. Further, the image processing apparatus in the creation process, when creating the workflow definition file that defines the workflow including the saving process, a list creation process for creating a list of accessible saving destinations from among a plurality of saving destination candidates, a display process for distinguishing, on the user interface, the saving destination candidates included in the list created in the list creation process from the saving destination candidates not included in the list among the plurality of saving destination candidates and displaying them, a designation process for accepting selection of a saving destination candidate and designating the selected saving destination candidate as the saving destination used in the saving process, Execute An image processing apparatus characterized by

Images