Terminal device, image processing device, and output system

Abstract

To provide a terminal device, etc. that have a user interface capable of improving a usability.SOLUTION: A terminal device includes: a control unit; and a device information obtaining unit that obtains device information containing identification information for identifying an image processing device. The control unit generates, on the basis of a user request, a user interface that accepts settings for at least an output scheme of a transmission job at the image processing device, and transmits setting information set through the user interface and the obtained identification information. The user interface displays a re-confirmation screen that prompts a user to re-confirm information on a transmission destination to which an input is accepted.SELECTED DRAWING: Figure 43

Description

[Technical Field]

[0001] The present disclosure relates to a terminal device and the like. [Background technology]

[0002] For example, multifunction devices that can operate in multiple modes, such as copy mode, scan mode, fax mode, and e-mail mode, often have an operation screen for selecting a mode and for inputting and selecting settings for the selected mode.

[0003] Recently, it has become common to use a touch panel display as the operation screen, which consists of a display for showing various information to the user and a touch panel placed on top of the display to detect the position pressed by the user's finger.By operating the touch panel while checking the various information displayed on the display, the user can intuitively and easily select modes and input / select setting values ​​for the selected mode.

[0004] Meanwhile, with the spread of the new coronavirus, there is an increasing need to avoid frequent contact with a large number of people in order to reduce the risk of infection.

[0005] For example, shared multifunction devices in the workplace and multipurpose multifunction devices installed in convenience stores and other locations are no exception when operating via their operation screens, and immediate measures are needed to avoid frequent contact.

[0006] As an example of avoiding direct contact with the operation screen of a multifunction device or the like, Patent Document 1 discloses a method for creating a document job without manually inputting information into a document processing device such as a multifunction device terminal. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-25809 Summary of the Invention [Problem to be solved by the invention]

[0008] As the technology for remotely operating image processing devices using terminal devices matures, it is natural that there is an increasing demand for improved usability. In particular, the user interface that connects users to devices such as terminal devices and multifunction peripherals must be more user-friendly and easy to see.

[0009] The present disclosure aims to provide a terminal device or the like equipped with a user interface that can improve usability. [Means for solving the problem]

[0010] In order to solve the above problem, the terminal device disclosed herein comprises a control unit and a device information acquisition unit that acquires device information including identification information for identifying the image processing device, and the control unit generates a user interface that accepts settings for at least the output method of a transmission job on the image processing device based on a user request, and transmits the setting information set via the user interface and the acquired identification information, and the user interface is characterized in that it displays a reconfirmation screen that prompts the user to reconfirm the information of the destination whose input has been accepted.

[0011] In addition, the image processing device according to the present disclosure includes a control unit, a display unit, and a job execution unit that executes a job with predetermined settings based on setting information related to job execution sent from a terminal device, and the control unit launches an application upon receiving a launch instruction, generates device information including device identification information based on the launched application, displays the generated device information on the display unit for the terminal device, controls the job execution unit to output the job with predetermined settings based on setting information related to job execution sent from the terminal device that reads the displayed device information, and displays a message screen on the display unit that displays the progress of the job.

[0012] An output system according to the present disclosure is a job output system including a terminal device, an image processing device, and a network service, wherein the terminal device includes a control unit and a device information acquisition unit that acquires device information including identification information for identifying the image processing device, and the control unit generates a user interface that accepts settings of an output method for a transmission job at least in the image processing device based on a user request, and transmits the setting information set via the user interface and the acquired identification information, and the user interface displays a reconfirmation screen that prompts the user to reconfirm the information of the transmission destination that has been input, and the network service includes a control unit and a storage unit that associates the setting information with the identification information and stores them as a job. and transmits a job corresponding to the identification information to the image processing device in response to a request from the image processing device, the image processing device comprising a control unit, a display unit, and a job execution unit that executes the job with predetermined settings based on setting information related to job execution transmitted from the terminal device, the control unit launches an application in response to a launch instruction, generates device information including the device identification information based on the launched application, displays the generated device information on the display unit for the terminal device, controls the job execution unit to output the job with predetermined settings based on setting information related to job execution transmitted from the terminal device that reads the displayed device information, and displays a message screen on the display unit that shows the progress of the job. [Effects of the Invention]

[0013] According to the present disclosure, it is possible to provide a terminal device or the like equipped with a user interface that can improve usability. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a diagram illustrating an outline of the overall configuration of an output system according to a first embodiment. [Figure 2]FIG. 2 is a diagram illustrating the functional configuration of the multifunction peripheral according to the first embodiment. [Figure 3] FIG. 10 is a diagram illustrating an example of the configuration of device information. [Figure 4] FIG. 10 is a diagram illustrating an end determination value management table. [Figure 5] FIG. 2 is a diagram illustrating the functional configuration of a terminal device according to the first embodiment. [Figure 6] 10 is a diagram illustrating an example of a configuration of a combination of setting information and identification information transmitted by a terminal device. FIG. [Figure 7] FIG. 2 is a diagram illustrating the functional configuration of a network device according to the first embodiment. [Figure 8] 10 is a diagram illustrating an example of a configuration of a combination of setting information and identification information as a job stored by a network service. FIG. [Figure 9] 10 is a flowchart illustrating an overall process according to the first embodiment. [Figure 10] 4 is a flowchart illustrating processing of the multifunction peripheral according to the first embodiment. [Figure 11] 6 is a flowchart illustrating processing of the terminal device according to the first embodiment. [Figure 12] 4 is a flowchart illustrating a process of a network service according to the first embodiment. [Figure 13] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 14] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 15] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 16] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 17] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 18] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 19] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 20] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 21]FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 22] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 23] FIG. 2 is a diagram illustrating an example of operation of the first embodiment. [Figure 24] FIG. 10 is a diagram illustrating an example of operation of the second embodiment. [Figure 25] FIG. 10 is a diagram illustrating an example of operation of the third embodiment. [Figure 26] FIG. 10 is a diagram illustrating a fourth embodiment. [Figure 27] FIG. 10 is a diagram illustrating a fourth embodiment. [Figure 28] FIG. 10 is a diagram illustrating the functional configuration of a multifunction peripheral according to a fourth embodiment. [Figure 29] FIG. 10 is a diagram illustrating the functional configuration of a network device according to a fourth embodiment. [Figure 30] 10 is a flowchart illustrating processing of a multifunction peripheral according to a fourth embodiment. [Figure 31] 10 is a flowchart illustrating a process of a network service according to the fourth embodiment. [Figure 32] FIG. 10 is a diagram illustrating an example of operation of the fourth embodiment. [Figure 33] FIG. 13 is a diagram illustrating an example of operation of the fifth embodiment. [Figure 34] 13 is a flowchart illustrating processing of a terminal device according to the sixth embodiment. [Figure 35] FIG. 13 is a diagram illustrating an example of operation of the sixth embodiment. [Figure 36] FIG. 13 is a diagram illustrating a seventh embodiment. [Figure 37] FIG. 13 is a diagram illustrating the functional configuration of a multifunction peripheral according to a seventh embodiment. [Figure 38] 13 is a flowchart illustrating processing of a multifunction peripheral according to a seventh embodiment. [Figure 39] FIG. 13 is a diagram illustrating an example of operation of the seventh embodiment. [Figure 40] FIG. 13 is a diagram illustrating an example of operation of the seventh embodiment. [Figure 41]13 is a flowchart illustrating processing of a multifunction peripheral according to an eighth embodiment. [Figure 42] FIG. 13 is a diagram illustrating an example of operation of the eighth embodiment. [Figure 43] FIG. 13 is a diagram illustrating an example of operation of the ninth embodiment. [Figure 44] FIG. 13 is a diagram illustrating an example of operation of the ninth embodiment. [Figure 45] FIG. 13 is a diagram illustrating an example of operation of the ninth embodiment. [Figure 46] FIG. 13 is a diagram illustrating an example of operation of the ninth embodiment. [Figure 47] FIG. 13 is a diagram illustrating an example of operation of the ninth embodiment. [Figure 48] FIG. 23 is a diagram illustrating an example of operation of the tenth embodiment. [Figure 49] FIG. 23 is a diagram illustrating an example of operation of the tenth embodiment. [Figure 50] FIG. 23 is a diagram illustrating an example of operation of the tenth embodiment. [Figure 51] FIG. 23 is a diagram illustrating an example of operation of the tenth embodiment. [Figure 52] FIG. 23 is a diagram illustrating an example of operation of the tenth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, a multifunction peripheral 10 capable of executing jobs in copy mode and scan mode will be described as an example of an image processing device. Note that the following embodiment is an example for explaining the present disclosure, and the technical scope of the description set forth in the claims is not limited to the following description.

[0016] [1 First Embodiment] The first embodiment is a form capable of preventing impersonation by other users by terminating the remote application after the termination determination time has elapsed.

[0017] [1.1 Overall structure] 1 is a diagram illustrating the overall configuration of an output system 100 according to the first embodiment. The output system 100 includes a multifunction peripheral 10, a terminal device 30, and a network service 50. Note that the output system 100 according to the first embodiment may also be provided with a separate external authentication server (not shown) that performs user authentication for the multifunction peripheral 10.

[0018] The multifunction device 10 is connected to a network service 50 via a network (NW) shown by a solid line in the figure so that it can communicate bidirectionally. The terminal device 30 is connected to the network service 50 via the network (NW) so that it can communicate. The terminal device 30 is also configured to be able to acquire device information (described later) from the multifunction device 10 (dotted line in the figure).

[0019] Here, a network refers to a mechanism, method, etc. in which at least two devices are connected and information can be transmitted from one device to another. The devices communicating via the network may be independent devices, as shown in the example of Figure 1, or may be internal blocks that make up a single device.

[0020] Furthermore, the communication may be wireless communication or wired communication, or may be a combination of wireless communication and wired communication. For example, wired communication may be performed in some sections and wireless communication in other sections. Also, wireless communication may be performed from one device to another device and wired communication may be performed from the other device to the other device.

[0021] [1.2 Functional Configuration] [1.2.1 About the Multifunction Device 10] The multifunction device 10 is an image processing device that can, for example, scan an original document and form an image on paper as a recording medium to output it as a printed matter. The multifunction device 10 is also an image processing device that can output electronic data in a predetermined format (for example, PDF (Portable Document Format)) based on the scanned data of the original document. Note that input to the multifunction device 10 is not limited to an original document, and can also be, for example, electronic data input from an external storage medium or an external device.

[0022] 2 is a functional configuration diagram of the multifunction device 10. The multifunction device 10 includes a control unit 11, a display unit 13, an operation input unit 15, an output unit 17 as a job execution unit, a communication unit 19, and a storage unit 21.

[0023] The control unit 11 controls the entire multifunction device 10. The control unit 11 is configured, for example, with one or more arithmetic units (CPUs (Central Processing Units) and the like). The control unit 11 realizes its functions by reading and executing various programs stored in the storage unit 21.

[0024] The display unit 13 displays various information to the user, etc. The display unit 13 can be configured, for example, with an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, etc. The display unit 13 displays device information including identification information, which will be described later.

[0025] The operation input unit 15 accepts information input by a user or the like. The operation input unit 15 can be configured with hard keys (for example, a numeric keypad), buttons, etc. The operation input unit 15 can be configured as a touch panel display that allows input via the display unit 13. In this case, the input method for the touch panel display can be, for example, a resistive film type, an infrared type, an electromagnetic induction type, a capacitance type, etc.

[0026] The output unit 17 includes an image forming unit 171 and an image reading unit 173. The image forming unit 171 forms and outputs an image based on image data (image data generated by scanning an original or image data input from an external device) on paper as a recording medium. The image forming unit 171 can be configured, for example, by a laser printer that uses an electrophotographic method. The image forming unit 171 forms an image using toner supplied from a toner cartridge (not shown) that corresponds to a toner color (for example, cyan, magenta, yellow, or black).

[0027] Image reading unit 173 generates and outputs image data by scanning and reading a document to be read (document image). Image reading unit 173 can be configured as a scanner device equipped with an image sensor such as a CCD (Charge Coupled Device) or a CIS (Contact Image Sensor). There are no limitations on the configuration of image reading unit 173, as long as it is configured to read a reflected light image from a document using an image sensor and output image data.

[0028] The communication unit 19 includes a wired / wireless interface or both for communicating with other devices via a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a telephone line, a fax line, etc.

[0029] The storage unit 21 stores various programs and various data necessary for the operation of the multifunction device 10. The storage unit 21 can be configured with a storage device such as a RAM (Random access memory), an HDD (Hard disk drive), an SSD (Solid state drive), or a ROM (Read only memory).

[0030] In the first embodiment, the storage unit 21 stores an output unit control program 211, a display processing program 213, and a remote application 215 as an application, and reserves a device setting value storage area 217 and an end determination value storage area 219.

[0031] The output unit control program 211 is a program that is read by the control unit 11 when controlling the output unit 17, such as the image forming unit 171 and the image reading unit 173. When the control unit 11 reads the output unit control program 211 and acquires a job, which will be described later, the control unit 11 controls the output unit 17 based on the setting information included in the job, and performs print output by the image forming unit 171 or image data output by the image reading unit 173.

[0032] The display processing program 213 is a program that is loaded by the control unit 11 when performing display processing on the display unit 13, such as a home screen or a job execution screen based on each mode. Furthermore, the control unit 11 that has loaded the display processing program 213 displays, on the display unit 13, encoded information including device information generated by the device information generation program 2151, in response to the start of the remote application 215.

[0033] The remote application 215 includes a device information generation program 2151, a setting information acquisition program 2153, and a termination determination program 2155. By executing these programs, the control unit 11 can provide device information, acquire setting information, and control the termination of the remote application 215.

[0034] The device information generation program 2151 is a program that the control unit 11 loads when generating device information including identification information of the multifunction device 10 in response to an instruction to launch the remote application 215. When the control unit 11 loads the device information generation program 2151, it transmits a request to the network service 50 to acquire connection information, such as a session key, for the network service 50. The control unit 11 generates device information based on the acquired connection information, connection-related items based on the identification information of the multifunction device 10, interface (I / F)-related items, and items related to the settings of the multifunction device 10 (multifunction device-related items) required for inputting setting information at the terminal device 30. The control unit 11 generates the generated device information as coded information coded with one or more of a two-dimensional code (quick response code: QR Code (registered trademark)), a one-dimensional code (barcode), symbols, and alphanumeric characters. The control unit 11 updates the device information regularly or irregularly. For example, the control unit 11 may update the device information when the driver program of the multifunction device 10 is updated to accommodate new functions that have been added, or when the installation location of the multifunction device 10 is changed.

[0035] An example of the configuration of device information according to the present disclosure will now be described with reference to FIG. 3. The device information illustrated in FIG. 3 is written in a specific format, including interface (I / F)-related items such as "name," "type," and "version," multifunction device-related items such as "color mode," "punch," "staple," and "OCR (Optical character recognition)," and connection-related items such as "device ID," "session key," and "country of installation." The terminal device 30 can acquire the device information by reading and decoding the encoded information that encodes the device information. The terminal device 30 can connect to the network service 50 based on the connection-related items (device ID, session key) of the acquired device information.

[0036] The session key here refers to information necessary for each device to communicate. For example, a session key is generated each time communication starts and discarded when communication ends. A validity period for the session key may also be set, and communication based on that session key may be terminated when the validity period expires.

[0037] Note that the device information items and their values ​​shown in Fig. 3 are merely examples, and the device information according to the present disclosure is not limited to that shown in Fig. 3. For example, if an authentication operation for the multifunction device 10 is required when issuing a job execution instruction on the terminal device 30, it is possible to include a PIN (Personal Identification Number), a one-time password generated by a token, or the like in the device information.

[0038] 2, the setting information acquisition program 2153 is a program that the control unit 11 reads when acquiring setting information set in the terminal device 30 as a job from the network service 50. The control unit 11 that reads the setting information acquisition program 2153 performs, for example, HTTPS (Hyper text transfer protocol secure) long polling to the network service 50 using the acquired connection information, and when setting information for the multifunction device 10 is sent from the terminal device 30, acquires the job as the setting information.

[0039] The termination determination program 2155 is a program that the control unit 11 reads in order to terminate the remote application 215 after a termination determination time has elapsed. The control unit 11 that has read the termination determination program 2155 determines, for example, whether or not a termination determination time (e.g., 120 seconds) has elapsed since receiving an instruction to start the remote application 215, and performs termination control to terminate the remote application 215 when the termination determination time has elapsed. Note that the termination determination program 2155 is not limited to being started when the remote application 215 is started, and can also be started, for example, when a request to acquire connection information is sent to the network service 50, when the connection information is acquired, or during login authentication. Furthermore, the timing to start counting the termination determination time can also be set to be when a request to acquire connection information is sent, when the connection information is acquired, or during login authentication.

[0040] The device setting value storage area 217 is a storage area that stores values ​​of interface items, multifunction device related items, connection related items, etc. for generating device information. The control unit 11 that reads out the device information generation program 2151 can generate device information by reading out values ​​of multifunction device related items (e.g., "color mode," "punch," "staple," "OCR," etc.) stored in the device setting value storage area 217.

[0041] The termination judgment value storage area 219 is a storage area for storing a termination judgment value management table that the control unit 11, which has read the termination judgment program 2155, refers to in order to perform termination judgment of the remote application 215.

[0042] An example of the configuration of the termination judgment value management table will now be described with reference to Fig. 4. The termination judgment value management table can include, as management items, an "application automatic termination" item that sets whether or not to (automatically) terminate the remote application 215, a "time until termination (seconds)" that sets the judgment time until the remote application 215 is terminated, and a "timing start timing" that sets the timing to start timing the judgment time. Fig. 4 shows an example in which the value of "application automatic termination" is set to "ON," the value of "time until termination (seconds)" is set to "120 (seconds)," and the value of "timing start timing" is set to "at (the remote application 215) startup." The values ​​for these management items can be set via a termination judgment value setting screen, which will be described later.

[0043] [1.2.2 Terminal Device 30] The terminal device 30 according to the present disclosure can be configured as a so-called mobile terminal device, such as a smartphone, tablet, mobile phone, notebook computer, etc. The terminal device 30 is configured as a device that has at least a function for generating a (graphical) user interface, a function for communication, and a function specific to a mobile terminal device.

[0044] 5 is a functional configuration diagram of the terminal device 30. The terminal device 30 includes a control unit 31, a display unit 33, an operation input unit 35, a device information acquisition unit 37, a communication unit 39, and a storage unit 41.

[0045] The control unit 31 controls the entire terminal device 30. The control unit 31 is configured by, for example, one or more arithmetic units (CPUs, etc.), and realizes its functions by reading and executing various programs stored in the storage unit 41.

[0046] The display unit 33 displays various information to the user, etc. The display unit 33 can be configured, for example, by an LCD, an organic EL display, or the like.

[0047] The operation input unit 35 accepts information input by a user or the like. The operation input unit 35 can be configured as a touch panel display that allows input via the display unit 33. In this case, the input method for the touch panel display can be, for example, a resistive film type, an infrared type, an electromagnetic induction type, a capacitance type, or the like.

[0048] The device information acquisition unit 37 acquires the coded information displayed on the display unit 13 of the multifunction device 10 and decodes it to acquire the device information. Examples of the device information acquisition unit 37 include an imaging device such as a camera, and a scanning device using laser light. Note that the device information acquisition unit 37 is not particularly limited as long as it is configured to be able to acquire the device information by reading the coded information of the multifunction device 10, and may acquire the device information using wireless communication (for example, Wifi (registered trademark), Bluetooth (registered trademark), or infrared). Furthermore, the device information acquisition unit 37 does not have to be directly included in the terminal device 30, and may be, for example, an external device equipped with an imaging function, a scanning function, or the like.

[0049] The communication unit 39 includes a wired / wireless interface or both for communicating with other devices via a LAN, a WAN, the Internet, a telephone line, or the like.

[0050] The storage unit 41 stores various programs and various data required for the operation of the terminal device 30. The storage unit 41 can be configured by a storage device such as a RAM, an HDD, an SSD, or a ROM.

[0051] In the first embodiment, the storage unit 41 stores a display processing program 411 and a job application 413, and reserves a device information storage area 415 and a setting value storage area 417.

[0052] The display processing program 411 is a program that is read by the control unit 31 when displaying on the display unit 33 the selection of a job mode to be executed by the multifunction device 10, a user interface for accepting input and selection of setting values, and the like.

[0053] The job application 413 includes a device information acquisition program 4131 and a setting information generation program 4133. The control unit 31 executes these programs to generate setting information to be executed by the multifunction device 10.

[0054] The device information acquisition program 4131 is a program that is read by the control unit 31 in response to a start instruction from the job application 413. After reading the device information acquisition program 4131, the control unit 31 controls the device information acquisition unit 37 to acquire coded information (for example, a QR code) including device information.

[0055] The setting information generation program 4133 is a program that the control unit 31 reads when generating setting information based on setting values ​​input and selected via a user interface displayed on the display unit 33 upon receiving an instruction to start the job application 413. The control unit 31 reads the setting information generation program 4133 and generates setting information from various setting values ​​input and selected via the user interface and stored in the setting value storage area 417. The control unit 31 then transmits the generated setting information to the network service 50 together with identification information (device ID) of the multifunction peripheral 10 extracted from the acquired device information.

[0056] 6 is a diagram showing an example of a combination of setting information and identification information (device ID) that the terminal device 30 transmits to the network service 50. Fig. 6 shows an example in which setting information including a group of "mode," "number of copies," "paper feed tray," "double-sided copy," "rotate back side 180 degrees," "color mode," "punch," and "staple" input and selected via a user interface is combined with "jv6Ou3QBGv8w6yNtGt" as identification information (device ID) of the multifunction device 10 and transmitted.

[0057] 5, the device information storage area 415 is a storage area that stores device information acquired from the multifunction device 10. The setting value storage area 417 is a storage area that stores setting values ​​that are input and selected by the user via the user interface.

[0058] [1.2.3 About Network Service 50] The network service 50 is a so-called cloud computing system that provides predetermined services such as processing resources, storage resources, and distribution resources via a web browser, for example. The services provided by the network service 50 use any of data communication protocols such as the Transmission Control Protocol, Internet Protocol, and other protocols, and can be accessed and used from the multifunction peripheral 10 or the terminal device 30 via a network (NW). The network service 50 includes one or more network devices as hardware.

[0059] 7 is a functional configuration diagram of the network service 50. The network service 50 includes a control unit 51, a display unit 53, an operation input unit 55, a communication unit 57, and a storage unit 59.

[0060] The control unit 51 controls the entire network service 50. The control unit 51 is configured by, for example, one or more arithmetic units (CPUs, etc.), and the control unit 51 realizes its functions by reading and executing various programs stored in the storage unit 59.

[0061] The display unit 53 displays various information to the user, etc. The display unit 53 can be configured with, for example, an LCD or an organic EL display.

[0062] The operation input unit 55 accepts information input by a user, etc. The operation input unit 55 can use input means such as a keyboard, a mouse, etc.

[0063] The communication unit 57 includes a wired / wireless interface or both for communicating with other devices via a LAN, a WAN, the Internet, a telephone line, or the like.

[0064] The storage unit 59 stores various programs and various data required for the operation of the network service 50. The storage unit 59 can be configured by a storage device such as a RAM, an HDD, an SSD, or a ROM.

[0065] In the first embodiment, the storage unit 59 stores a terminal authentication program 591 and a job transmission program 593, and reserves a job storage area 595.

[0066] The terminal device authentication program 591 is a program that is read by the control unit 51 when authenticating a connection with the terminal device 30. When the control unit 51 reads out the terminal device authentication program 591 and receives identification information and setting information from the terminal device 30, the control unit 51 authenticates the terminal device 30 based on a session key included in the setting information.

[0067] The job sending program 593 is a program that is read by the control unit 51 when sending a job to the multifunction device 10. When the control unit 51 reads the job sending program 593, it searches for a job ID attached to the identification information (device ID) of the multifunction device 10 in response to HTTPS long polling from the multifunction device 10. If setting information is associated with the job ID, it sends the setting information as a job to be executed by the multifunction device 10.

[0068] 8, the job storage area 595 is a storage area in which the control unit 51 associates the identification information and setting information of the multifunction device 10 transmitted from the terminal device 30, assigns a job ID to the information, and stores it as a job to be executed by the multifunction device 10. The control unit 51 manages information associating the identification information (device ID) with the setting information using the job ID. The job ID can also be assigned by the terminal device 30. In this case, the terminal device 30 associates the identification information and setting information of the multifunction device 10 with each other, assigns a job ID, and transmits the information to the network service 50. The control unit 51 stores the identification information and setting information of the multifunction device 10 assigned with the job ID in the job storage area 595.

[0069] [1.3 Processing flow] [1.3.1 Overall processing] Next, the overall processing according to the first embodiment will be described with reference to the flowchart in Fig. 9. The overall processing described in Fig. 9 is processing that starts when the user authentication function of the multifunction device 10 is enabled and the user logs in to the multifunction device 10, and then the remote application 215 is launched.

[0070] First, the user logs in to the multifunction device 10 via a login screen, which will be described later (step S10). That is, the multifunction device 10 executes a login process to display a screen for the user to input information required for login (e.g., user name, password, etc.). After the information required for login is input, the multifunction device 10 transitions to a login state if the user is an appropriate user (step S10).

[0071] After logging in to the multifunction peripheral 10, the user inputs an instruction to start the remote application 215 via, for example, a home screen, which will be described later.

[0072] Upon receiving a start instruction from the user, the control unit 11 starts the remote application 215 (step S12).

[0073] When the remote application 215 is started, the control unit 11 loads the termination determination program and starts timing the termination determination time (step S14). When the control unit 11 determines that the termination determination time has elapsed since the remote application 215 was started, it performs termination control of the remote application 215 (step S14 → step S16).

[0074] Then, the control unit 11 logs out the logged-in user (step S18).

[0075] On the other hand, if the control unit 11 determines that the termination determination time has not elapsed since the remote application 215 was started, the control unit 11 moves the process to step S20 (step S14 to step S20).

[0076] The control unit 11 transmits a request to acquire connection information for the network service 50, such as a session key, to the network service 50 (step S20).

[0077] Upon receiving the request to acquire the connection information, the network service 50 generates a session key necessary for communication and transmits the connection information, such as the session key, to the multifunction device 10. When the multifunction device 10 acquires the connection information from the network service 50 (step S22), it displays coded information (e.g., a QR code) including device information on the display unit 13 while maintaining the connection with the network service 50 by HTTPS long polling (step S24).

[0078] The user places a document on the multifunction device 10 and inputs an instruction to start the job application 413 to the terminal device 30. The terminal device 30 receives the instruction to start the job application 413 from the user (step S26). The terminal device 30 receives the instruction to start the job application and starts the job application (step S28). Specifically, the control unit 31 starts the job application 413 by reading the device information acquisition program 4131 and the setting information generation program 4133.

[0079] The user selects a job to be executed by the multifunction device 10 via the user interface displayed on the display unit 33, and inputs and selects setting values ​​for the selected job (step S30).

[0080] The terminal device 30 accepts the setting value for which the input instruction has been received, and stores the setting value in the setting value storage area 417 (step S32).

[0081] The user selects the start key, and the control unit 31 of the terminal device 30 receives an instruction to select the start key (step S34).

[0082] The control unit 31 of the terminal device 30 acquires the coded information (for example, a QR code) including the device information displayed on the display unit 13 of the multifunction device 10 (step S36).

[0083] The terminal device 30 generates setting information from the various setting values ​​stored in the setting value storage area 419 and transmits it to the network service 50 together with the identification information of the multifunction device 10 extracted from the device information included in the encoded information acquired in step S36 (step S38).

[0084] The network service 50 associates the identification information and setting information of the multifunction peripheral 10 sent from the terminal device 30, assigns a job ID to the information, and stores the job in the job storage area 595 (step S40).

[0085] The multifunction device 10 inquires of the network service 50 whether or not a job corresponding to the identification information of the multifunction device 10 exists (step S42).

[0086] If a job corresponding to the identification information of the multifunction device 10 exists, the network service 50 transmits the job to the multifunction device 10 (step S44).

[0087] The multifunction device 10 executes the received job (step S46), and then returns the process to step S14.

[0088] 9, it is preferable that communication is maintained while the remote application 215 is running and the multifunction peripheral 10 is connected. For example, it is preferable to maintain the connection by HTTPS long polling or to maintain communication at predetermined time intervals (for example, by maintaining communication between terminals by Ping, etc.). This allows the terminal device 30 to send input instructions to the multifunction peripheral 10 via the network service 50 at any time during remote operation.

[0089] In this embodiment, the termination determination time may be set by the terminal device 30. When the termination determination time has elapsed, the terminal device 30 automatically terminates communication with the network service 50. In this case, the connection between the multifunction peripheral 10 and the terminal device 30 is forcibly disconnected.

[0090] This allows the user to automatically terminate the remote application without touching, for example, an end button for the remote application displayed on the multifunction device 10. Therefore, the user can terminate the remote application without touching the multifunction device 10.

[0091] Here, it is preferable that the termination determination time be set, for example, between 30 and 240 seconds. For example, if the termination determination time is set to a short time such as 10 seconds, the remote application will terminate immediately after it is launched, resulting in poor usability for the user.

[0092] The above-mentioned processing flow will be explained below with reference to the flowcharts for each device.

[0093] [1.3.2 Processing of the multifunction device 10] The processing of the multifunction device 10 will be described using the flowchart in FIG. 10. When the control unit 11 of the multifunction device 10 receives a power-on instruction, a recovery instruction from sleep mode, or an auto-clear instruction, it executes device initialization processing (step S110 to step S120). Note that auto-clear is processing that is executed when the job itself is canceled or when the input / selection of a setting value is canceled. Generally, when a selection button (for example, an "auto-clear button") provided on the display screen is selected, the multifunction device 10 can execute the auto-clear processing.

[0094] Here, the device initialization process refers to, for example, when the input instruction is a power-on instruction input or an instruction input to recover from sleep mode, the process is temperature control of the fixing device to enable print output by the image forming unit 171, or when the input instruction is auto-clear, the process is to return the changed setting value to the initial value and make the multifunction device 10 usable in its initial state.

[0095] After the device initialization process is completed, the control unit 11 displays a login screen, and then the control unit 11 determines whether or not login authentication has been performed by the user via the login screen (step S130).

[0096] When the control unit 11 determines that the login authentication has been performed and succeeded, it displays the home screen (step S130; Yes→step S140).

[0097] On the other hand, when the control unit 11 determines that login authentication has not been performed (login authentication function is disabled) or that login authentication has been performed but failed, it determines whether an operation related to job execution has been detected (step S130; No -> step S150). Note that an operation related to job execution refers to a preparatory operation performed by a user for executing a job such as copying or scanning, such as placing a document on the document platen of the multifunction device 10. For example, when a document is placed on the document platen, the control unit 11 can determine that an operation related to job execution has been performed by detecting the document using an optical or mechanical detector.

[0098] If it is determined that an operation related to job execution has been input, the control unit 11 proceeds to step S170 (step S150; Yes -> step S170). On the other hand, if it is determined that an operation related to job execution has not been input, the control unit 11 may determine that an operation other than an operation related to job execution has been performed, or may simply end the process (step S150; No).

[0099] In step S140, after the home screen is displayed, the control unit 11 determines whether or not an instruction to start the remote application 215 has been input (step S140 → step S160). The control unit 11 can determine whether or not an instruction to start the remote application 215 has been input by detecting whether or not the user has selected the button to input an instruction to start the remote application 215 displayed on the home screen.

[0100] When the control unit 11 determines that an instruction to start the remote application 215 has been input, the control unit 11 starts the remote application 215 (step S160; Yes→step S170). When the control unit 11 determines that an instruction to start the remote application 215 has not been input, the control unit 11 continues to display the home screen (step S160; No→step S140).

[0101] The control unit 11 reads the termination determination program 2155 to determine whether the termination determination time has elapsed since the remote application 215 was launched (step S180). If the control unit 11 determines that the termination determination time has elapsed, it controls the termination of the remote application 215 (step S180; Yes → step S190). Note that the control of the termination of the remote application 215 includes releasing the loaded device information generation program 2151, setting information acquisition program 2153, and termination determination program 2155 from the working memory, as well as disconnecting from the network service 50 via HTTPS long polling. In this case, the control unit 11 may release the program after disconnecting from the network service 50, or conversely, may release the program after disconnecting from the network service 50.

[0102] If a logged-in user exists, the control unit 11 performs a logout process (step S200) and ends the process.

[0103] On the other hand, if it is determined that the termination determination time has not elapsed since the remote application 215 was launched, the control unit 11 sends a request to the network service 50 to obtain connection information such as a session key for the network service 50 (step S180; No → step S210).

[0104] Then, the control unit 11 determines whether or not connection information has been acquired from the network service 50 (step S220). If it is determined that connection information has been acquired, the control unit 11 generates device information and displays the generated device information on the display unit 13 as coded information encoded with one or more of a two-dimensional code (quick response (QR) code), a one-dimensional code (barcode), symbols, and alphanumeric characters (step S220; Yes → step S230). If it is determined that connection information has not been acquired, the control unit 11 waits until connection information is acquired (step S220; No). Note that if no setting information is acquired for a certain period of time and a logged-in user exists, the control unit 11 may automatically log out the user. This makes it possible to prevent unauthorized use by automatically logging out the user if there is a long period of inactivity, such as no operation, when user authentication is enabled.

[0105] The control unit 11 determines whether or not a job has been acquired from the network service 50 (step S240). If a job has been acquired from the network service 50, the control unit 11 executes the acquired job (step S240; Yes→step S250). On the other hand, if it is determined that a job has not been acquired, the control unit continues to display the encoded information (step S240; No→step S230).

[0106] In step S250, after the job is executed, the control unit 11 returns the process to step S180.

[0107] 10 illustrates a configuration in which the process for determining the termination determination time in step S180 is performed when the processes from step S210 to step S250 are completed. However, it is conceivable that the remote application 215 starts to launch and the termination determination time is reached while the processes from step S210 to step S250 are progressing. In this case, the control unit 11 may terminate the remote application (step S190) and perform the logout process (step S200) when the termination determination time is reached, or may terminate the remote application (step S190) and perform the logout process (step S200) after the processes from step S210 to step S250 are completed.

[0108] [1.3.3 Processing by the terminal device 30] Next, the processing of the terminal device 30 will be described with reference to the flowchart in Fig. 11. The control unit 31 of the terminal device 30 determines whether or not an instruction to start the job application 413 has been received from the user (step S300). The control unit 31 can determine whether or not an instruction to start the job application 413 has been received by detecting whether or not the user has selected the start instruction input button for the job application 413 displayed on the display unit 33 of the terminal device 30.

[0109] If it is determined that an instruction to start a job application has been received, the control unit 31 reads the display processing program 411 to display an application screen as a user interface on the display unit 33 (step S300; Yes→step S310).

[0110] Next, the control unit 31 determines whether or not the user has selected a copy job via the application screen (step S320). If it is determined that the user has selected a copy job, the control unit 31 displays a copy job execution screen on the display unit 33 (step S320; Yes → step S330). On the other hand, if it is determined that the user has not selected a copy job, the control unit 31 displays a scan job execution screen on the display unit 33 (step S320; No → step S340).

[0111] Control unit 31 receives input of setting values ​​via either the copy job execution screen displayed in step S330 or the scan job execution screen displayed in step S340 (step S350), and then stores the received setting values ​​in setting value storage area 417 (step S360).

[0112] The control unit 31 determines whether the "start button" has been selected by the user (step S370). If it is determined that the "start button" has been selected by the user, the control unit 31 controls the device information acquisition unit 37 to acquire coded information including device information from the multifunction device 10 (step S370; Yes -> step S380). In response to an input of an instruction to start the job application 413, the control unit 31 decodes the coded information displayed on the display unit 13 of the multifunction device 10 based on the loaded device information acquisition program 4131 to acquire the device information.

[0113] Next, in response to the input of an instruction to start the job application 413, the control unit 31 generates setting information from the various setting values ​​stored in the setting value storage area 417 based on the loaded setting information generation program 4133 (step S390). Then, the control unit 31 transmits the generated setting information to the network service 50 together with the identification information extracted from the device information of the multifunction device 10, and ends the process (step S400).

[0114] [1.3.4 Processing of Network Service 50] Next, the processing of the network service 50 will be described with reference to the flowchart of Fig. 12. The control unit 51 of the network service 50 determines whether or not a request for acquiring connection information for the network service 50, such as a session key, has been received from the multifunction device 10 (step S500).

[0115] If the control unit 51 determines that it has received a request to acquire connection information from the multifunction device 10, it transmits the connection information to the multifunction device 10 (step S500; Yes -> step S510). On the other hand, if it determines that it has not received a request to acquire connection information from the multifunction device 10, the control unit 51 waits until it receives an acquisition request (step S500; No).

[0116] Next, the control unit 51 determines whether or not the identification information and the setting information have been acquired from the terminal device 30 (step S520).

[0117] If the control unit 51 determines that it has acquired identification information and setting information from the terminal device 30, it associates the identification information with the setting information, assigns a job ID to the information, and stores it as a job in the job memory area 595 (step S520; Yes → step S530).

[0118] Next, the control unit 51 determines whether or not a job acquisition request has been received from the multifunction device 10 (step S540). If it is determined that a job acquisition request has been received from the multifunction device 10, the control unit 51 determines whether or not a job corresponding to the identification information of the multifunction device 10 that received the acquisition request has been stored (step S540; Yes→step S550). In this case, the control unit 51 searches for the job ID attached to the identification information (device ID) of the multifunction device 10. If setting information is associated with the job ID, the control unit 51 determines that a job corresponding to the identification information of the multifunction device 10 has been stored.

[0119] If the job corresponding to the identification information is stored, the control unit 51 reads the job transmission program 593, transmits the job to the multifunction device 10 (step S560), and ends the process.

[0120] In addition, in step S520, if the control unit 51 determines that it has acquired identification information and setting information from the terminal device 30, it can also be configured as a push type in which it sends a job corresponding to the identification information directly to the multifunction device 10 without waiting for a job acquisition request from the multifunction device 10.

[0121] [1.4 Example of operation] Next, an example of operation according to the first embodiment will be described. Fig. 13 is a diagram schematically showing the flow of operation according to the first embodiment as a timeline. Here, Fig. 13(a) is the timeline of the multifunction peripheral 10 when user authentication is enabled, and Fig. 13(b) is the timeline of the multifunction peripheral 10 when the user authentication function is disabled.

[0122] 13(a), when user authentication is enabled, after login authentication, the remote application 215 is started by the user inputting a start instruction. Remote job execution is possible only while the remote application 215 is running. Then, for example, when a termination determination time (e.g., 120 seconds) has elapsed since the remote application 215 was started, the control unit 11 terminates the remote application 215.

[0123] When the remote application 215 is terminated, the control unit 11 displays the home screen. When a preset automatic logout time has elapsed since the home screen was displayed, the control unit 11 logs out the user and displays a login screen for accepting login authentication.

[0124] If no operation is performed for a predetermined time after the login screen is displayed, the multifunction peripheral 10 transitions to a preheating or auto power shutoff mode (sleep mode) according to the preheating mode setting / auto power shutoff setting, for example.

[0125] 13(b) (when the user authentication function is disabled or the user authentication has failed), when a preparatory operation for executing a job such as copying or scanning, such as placing a document on the platen, is detected, the control unit 11 starts the remote application 215. Then, when a termination determination time (for example, 120 seconds) has elapsed since the remote application 215 was started, the control unit 11 terminates the remote application 215.

[0126] When the remote application 215 is terminated, the control unit 11 displays the home screen. If no operation is performed for a predetermined period of time after the home screen is displayed, the multifunction peripheral 10 transitions to a preheating mode or auto power shutoff mode (sleep mode). Then, when a preparation operation for executing a new job such as copying or scanning is detected, the control unit 11 starts the remote application 215.

[0127] 13(a) and 13(b), when the termination determination time has elapsed since the launch of the remote application 215, the control unit 11 terminates the remote application 215. Then, as shown in FIG. 13(a), when user authentication is enabled, when a preset automatic logout time has elapsed since the home screen was displayed, the control unit 11 logs out the user and displays a login screen for accepting login authentication. With this configuration, users other than the logged-in user cannot operate the multifunction peripheral 10, making it possible to prevent impersonation by other users.

[0128] 14 is a diagram illustrating an example of the configuration of a login screen displayed by the control unit 11. Note that this operation is an example of an operation corresponding to step S130 in FIG.

[0129] The login screen W10 includes a login user name input box Bx10, a login password input box Bx12, an authentication destination selection button B10, an OK button B12, and a cancel button B14.

[0130] The login user name input box Bx10 is an input box that accepts input of the login user name of a login user attempting to log in to the multifunction device 10.

[0131] The login password input box Bx12 is an input box that accepts input of a login password associated with the login user name of a login user attempting to log in to the multifunction peripheral 10.

[0132] The authentication destination selection button B10 is a button that accepts the selection of the authentication destination of the logged-in user. In the example shown in Fig. 14, a single machine (multifunction peripheral 10) is selected as the authentication destination of the logged-in user. When managing the logged-in user with another device such as a management server via a network (NW), it is possible to select the name of the other device or location information of the other device on the network (for example, IP address, etc.).

[0133] The OK button B12 is a button for accepting the login authentication operation by the login user. The cancel button B14 is a button for accepting the cancellation of the login authentication operation by the login user.

[0134] FIG. 15 is a diagram illustrating an example of the configuration of the home screen W20 displayed by the control unit 11. Note that this operation example corresponds to the processing of step S140 in FIG. 10. The home screen W20 is a basic screen that accepts, for example, the user's job selection and the selection of various function displays. The home screen W20 includes a job / function selection button B16, a display forward button B18, and a job status button B20.

[0135] The job / function selection buttons B16 accept the user's selection of a desired job, function display, etc. For example, when the user selects the "Simple Copy" button among the job / function selection buttons B16, the control unit 11 displays a job execution screen (not shown) for configuring the "Simple Copy" setting. In addition, the job / function selection buttons B16 in the first embodiment include a remote operation button B22 for transitioning the screen to the display screen W30 described in the next figure. When the user selects the remote operation button B22, the control unit 11 launches the remote application 215 and transitions the screen display to the display screen W30, thereby enabling the use of the output method according to the present disclosure. Note that the display configuration example of the job / function selection buttons B16 in FIG. 15 is merely illustrative, and job and function display buttons that are not displayed can be displayed by selecting the display forward button B18.

[0136] The job status button B20 accepts an input of a notification instruction regarding the progress status, reservation status, etc. of a job being executed by the multifunction device 10. When the job status button B20 is selected by the user, the control unit 11 displays the progress status, reservation status, etc. of the job.

[0137] Fig. 16 shows an example of the configuration of the display screen W30 displayed by the control unit 11. Note that this operation example corresponds to the processing of step S230 in Fig. 10, and the display screen W30 is displayed at the timing when the remote application 215 is started and connection information is acquired from the network service 50.

[0138] The display screen W30 has an operation procedure display area R10 and a close button B24. The operation procedure display area R10 is an area for explaining the operation procedure of the output method according to the first embodiment using illustrations or animations. In the example of Fig. 16, the operation procedure is explained in the following order: (1) document setting, (2) settings on the terminal device, and (3) job execution.

[0139] The operating procedure display area R10 includes an encoded information display area R11 that displays encoded information including device information of the multifunction peripheral 10. In the first embodiment, an example will be described in which a two-dimensional code (e.g., a Quick Response (QR) code, Data Matrix, or VeriCode) is used as the encoded information including the device information. A QR code (registered trademark) is a two-dimensional code for representing data in a graphical format. Note that, in addition to a QR code, information encoded with one or more of a barcode, a symbol, and alphanumeric characters can also be used as the device information.

[0140] The terminal device 30 can execute the job by reading the QR code using an imaging device such as a camera or a scanning device using laser light.

[0141] The close button B24 is a button that accepts selection when the user desires to execute a job via a normal home screen without using the output method according to the present disclosure. When the close button B24 is selected, the control unit 11 displays the home screen W20 on the display unit 13 and accepts input of a job execution instruction or the like via the home screen W20.

[0142] 17 shows an example of the configuration of an execution screen displayed on the display unit 13 while the multifunction device 10 receives setting information from the network service 50 and is executing a job based on the setting information. Note that this operation example corresponds to the processing of step S250 in FIG. 10. The execution screen W40 includes a message display area R12 indicating that a job is being executed, and an execution job display area R13 that displays the type of job being executed (the example in FIG. 17 is a copy job) using an illustration or animation.

[0143] Fig. 18 shows an example of the configuration of a completion screen displayed on the display unit 13 when the multifunction device 10 completes a job. This operation example corresponds to the processing from step S250 onwards in Fig. 10. The completion screen W50 includes a message display area R14 indicating that the job has been completed, and a completed job display area R15 that displays the completion of the job using an illustration or animation.

[0144] Fig. 19 shows an example of the configuration of an application screen that the control unit 31 of the terminal device 30 displays on the display unit 33 when a user issues an instruction to start the job application 413. This operation example corresponds to the processing from step S300 to step S310 in Fig. 11. The application screen W60 includes a menu display area R20 and a favorites list display area R22.

[0145] The menu display area R20 includes a copy job selection button B26 and a scan job selection button B28. The copy job selection button B26 accepts the user's selection of a copy job. When the copy job selection button B26 is selected, the control unit 31 can determine that a copy job has been selected by the user. When the copy job selection button B26 is selected, the control unit 31 displays a copy job execution screen on the display unit 33.

[0146] On the other hand, the scan job selection button B28 accepts the selection of a scan job by the user. When the scan job selection button B28 is selected, the control unit 31 can determine that a scan job has been selected by the user. When the scan job selection button B28 is selected, the control unit 31 displays a scan job execution screen on the display unit 33.

[0147] The favorites list display area R22 displays items that are frequently used by the user in list form. The favorites list can be displayed in ascending or descending order using the sort button B30.

[0148] Fig. 20 shows an example of the configuration of a copy job execution screen displayed on the display unit 33 when a copy job is selected by the user. This operation example corresponds to the processing of step S330, etc., in Fig. 11. The copy job execution screen W70a includes a setting value setting area R24 and a start button B32.

[0149] The setting value setting area R24 accepts input and selection of setting values ​​related to job execution. Setting values ​​can be input and selected for each setting item related to the copy job, such as the number of copies, paper tray, double-sided copying, rotate the back side 180 degrees, and color mode.

[0150] For example, the copy job execution screen W70b is an example of a number of copies setting screen that is displayed when the setting value for "number of copies" is selected by tapping, etc. The copy job execution screen W70b includes a modal M10 that accepts input of the setting value for the number of copies, and a setting value input button B34.

[0151] As shown in FIG. 20, when modal M10 is displayed, the control unit 31 grays out other setting values, restricting input of setting values. The user inputs the number of copies using the setting value input button B34. After inputting the desired number of copies, the user can confirm the setting value for the number of copies by selecting the "OK" button. Note that when the "OK" or "Cancel" button is selected, the screen returns to the copy job execution screen W70a.

[0152] Fig. 21 shows an example of the configuration of a scan job execution screen displayed on the display unit 33 when a scan job is selected by the user. This operation example corresponds to the processing of step S340, etc., in Fig. 11. The scan job execution screen W80a includes a setting value setting area R26 and a start button B32.

[0153] The setting value setting area R26 accepts input and selection of setting values ​​related to job execution. Setting values ​​can be input and selected for each setting value related to the scan job, such as "Enter address," "Send to yourself," "Read settings," "Image orientation," and "Color mode."

[0154] For example, the scan job execution screen W80b is an example of a self-destination setting screen that is displayed when the setting value "Send to self" is selected as the setting value by tapping, etc. The scan job execution screen W80b includes a modal M12 that accepts input of the setting value for "Send to self," and a setting value input button B36.

[0155] As shown in FIG. 21, when modal M12 is displayed, the control unit 31 grays out other setting values, restricting the input of setting values. The user uses the setting value input button B36 to input the destination of the transmission to themselves. After inputting the desired destination, the setting value for the destination can be confirmed by selecting the "OK" button. Note that when the "OK" or "Cancel" button is selected, the screen returns to the scan job execution screen W80a.

[0156] Fig. 22 shows an example of the configuration of an encoding information acquisition screen that is displayed by the control unit 31 when the start button B32 on the copy job execution screen W70a in Fig. 20 or the scan job execution screen W80a in Fig. 21 is selected and device information displayed on the multifunction device 10 is acquired. The encoding information acquisition screen W90a includes an encoding information acquisition area R28 and a status display area R30.

[0157] 22, when the encoded information to be acquired is encoded information such as a QR code, the encoded information acquisition area R28 can be configured as a guideline that guides the user so that the encoded information fits within the reading area of ​​the imaging device or scanning device. The user operates the terminal device 30 so that the encoded information such as a QR code fits within the encoded information acquisition area R28. When the encoded information is acquired, the control unit 31 transitions from the encoded information acquisition screen W90a to the encoded information acquisition screen W90b.

[0158] The status display area R30 is an area that displays the progress (status) of an operation or job to the user. For example, in the status display area R30 of the encoded information acquisition screen W90a, a QR code is placed in the encoded information acquisition area R28 and a message is displayed instructing the user to read the QR code.

[0159] When the encoded information such as a QR code is read, the status display area R32 of the encoded information acquisition screen W90b displays a message indicating that a job (setting information) is being sent to the multifunction device 10.

[0160] When the transmission of the job to the multifunction device 10 is completed, the control unit 31 transitions the display screen to the encoding information acquisition screen W90c. On the encoding information acquisition screen W90c, a message indicating that the transmission of the job has been completed is displayed in the status display area R34.

[0161] 23 is a diagram illustrating an example of the configuration of the termination determination value setting screen W100. The termination determination value setting screen W100 can be displayed, for example, via a system setting screen. Here, the system setting screen is a setting screen that accepts input settings for the multifunction device 10 (for example, operating conditions, environmental conditions, authenticated user registration, etc.), and is generally a setting screen that is managed by a user with administrative authority (administrative user).

[0162] The termination determination value setting screen W100 includes an application termination setting check box CB10, a termination time setting tab T10, a registration button B38, and a cancel button B40.

[0163] The application termination setting check box CB10 is a check box for setting whether or not to automatically terminate the remote application 215. When the application termination setting check box CB10 is checked, the automatic termination setting for the remote application 215 is enabled.

[0164] The end time setting tab T10 is a pull-down tab that accepts the setting of the determination time until the remote application 215 is terminated. The user can select the end determination time using the pull-down tab, or can directly input and set an arbitrary determination time.

[0165] The register button B38 accepts registration of input values ​​into the application termination setting check box CB10 and termination time setting tab T10. By selecting the register button B38, the input values ​​into the application termination setting check box CB10 and termination time setting tab T10 are registered in the termination judgment value management table. The cancel button B40 accepts cancellation of input into the application termination setting check box CB10 and termination time setting tab T10.

[0166] As described above, according to the first embodiment, it is possible to provide an image processing device or the like that can prevent impersonation by other users by terminating a remote application after the termination determination time has elapsed.

[0167] [2 Second Embodiment] The second embodiment is a configuration in which, in the first embodiment, when the remote application 215 is terminated, the termination determination time can be extended on the operation screen.

[0168] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations according to the second embodiment can be the same as those according to the first embodiment, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, terminal device processing, and network service processing can be the same as those according to the first embodiment, and therefore descriptions thereof will be omitted here.

[0169] [2.1 Processing of the multifunction device 10] The processing flow of the multifunction peripheral 10 according to the second embodiment can be substantially the same as the processing flow of the multifunction peripheral 10 according to the first embodiment described with reference to Fig. 10. The second embodiment differs from the first embodiment in that in step S180 in Fig. 10, a termination extension setting screen is displayed on the display unit 13 immediately before the determination time has elapsed.

[0170] [2.2 Example of operation] 24 is a diagram illustrating an example of the configuration of the termination extension setting screen W110. The termination extension setting screen W110 is displayed superimposed on the display screen W30 described in FIG. 16 immediately before the determination time elapses (for example, 30 seconds before the elapse).

[0171] The termination extension setting screen W110 includes a termination extension confirmation setting area R36, a Yes button B42, and a No button B43.

[0172] The end extension confirmation setting area R36 displays the remaining time until the judgment time has elapsed, for example, in countdown format, and can also be configured as a message display area that asks the user whether or not to extend the end time. Fig. 24 shows an example in which the remaining time until the judgment time has elapsed is 30 seconds, and the user is asked whether or not to extend the judgment time.

[0173] The Yes button B42 accepts input of an instruction to extend the judgment time by the user. When an instruction to extend the judgment time is given by selecting the Yes button B42, the control unit 11 extends the judgment time (in FIG. 24, the control unit 11 extends the judgment time by 30 seconds). The No button B43 accepts an instruction not to extend the judgment time. When an instruction not to extend the judgment time is given by selecting the No button B43, the control unit 11 performs termination control of the remote application 215 when the remaining time until the judgment time displayed in the termination extension confirmation setting area R36 reaches zero.

[0174] As described above, according to the second embodiment, in addition to the effects of the first embodiment, it is possible to extend the termination determination time of the remote application 215 on the operation screen, so that, for example, when a job to be executed has not been completed or when multiple jobs are in an incomplete state, it is possible to extend and maintain the running state of the remote application 215.

[0175] [3 Third embodiment] In the first embodiment, the termination judgment value setting screen W100 is displayed via, for example, a system setting screen, and the termination judgment value is set on the multifunction device 10. In the third embodiment, the termination judgment value can be set on the terminal device 30.

[0176] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations according to the third embodiment can be the same as those according to the first embodiment, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, processing by the multifunction peripheral, and processing by the network service can be the same as those according to the first embodiment, and therefore descriptions thereof will be omitted here.

[0177] [3.1 Processing of the terminal device 30] The processing flow of the terminal device 30 according to the third embodiment can be substantially the same as the processing flow of the terminal device 30 according to the first embodiment described with reference to Fig. 11. The third embodiment differs from the first embodiment in that an end determination value setting screen can be displayed on the display unit 33 in step S310 of Fig. 11.

[0178] [3.2 Example of operation] 25 is a diagram illustrating an example of the configuration of the termination judgment value setting screen W120 displayed by the terminal device 30. The termination judgment value setting screen W120 can be displayed by inputting a display instruction by selecting the application setting button B44 provided on the application screen W60 illustrated in FIG.

[0179] The end determination value setting screen W120 may have the same display content as the end determination value setting screen W100 shown in Fig. 23. The user can set the end determination value via the end determination value setting screen W120. The input value on the end determination value setting screen W120 may be stored in the setting value storage area 417, similar to the setting values ​​related to the job, and transmitted to the multifunction device 10 together with the setting information.

[0180] As described above, according to the third embodiment, in addition to the effects of the first embodiment, the termination judgment value can be set on the terminal device 30 without operating the operation screen of the multifunction device 10, thereby making it possible to further avoid contact with the multifunction device 10.

[0181] [4 Fourth embodiment] If the remote application is terminated and the user logs out of the multifunction device 10 immediately after the device information acquisition unit 37 of the terminal device 30 acquires the encoding information (device information) of the multifunction device 10, there is a risk that the next time another user who logs in to the multifunction device starts a remote application, the job registered in the network service by the logged-out user will be executed.

[0182] The fourth embodiment is a form that can prevent other users from executing jobs registered in a network service by deleting the jobs registered in the network service before or when a remote application is launched.

[0183] Before describing specific aspects of the fourth embodiment, a situation in which another user executes a job of a user who has previously logged in to the multifunction peripheral will be described.

[0184] FIG. 26 is a diagram showing a schematic timeline of the flow of operations performed when a user with a user name A logs in to a multifunction peripheral and remotely operates the multifunction peripheral.

[0185] When a user with user name A logs in to the multifunction peripheral and starts a remote application, the multifunction peripheral (remote application) requests the network service to acquire a session key as connection information.

[0186] The terminal device then generates setting information for executing the job and registers the job by transmitting the generated setting information to the network service. The multifunction peripheral then acquires the setting information from the network service and executes the job based on the acquired setting information.

[0187] After the job is executed, the multifunction device performs termination control of the remote application, logs out the user with user name A, and ends the series of processes.

[0188] As explained in Figure 26, the setting information for executing a job is registered as a job in the network service, and the multifunction device acquires the job from the network service, so that, in principle, the job does not remain in the network service.

[0189] However, as shown in the situation in Figure 27, after a job is registered in a network service, the remote application may be terminated before the multifunction device obtains the job from the network service, or poor network communication may occur, preventing the job from being obtained from the network service, and the registered job may remain in the network service.

[0190] In this situation, if user A logs out of the MFP and then another user, user B, logs in to the MFP and starts a remote application, the MFP will obtain the job for user A from the network service and execute that job. In other words, if the session key generated under user A is still valid, the next time the remote application is executed, that session key will be reused. This creates a problem in that any registered jobs remaining will be executed.

[0191] Because User A terminated the remote application without waiting for the job to finish, it is believed that the setting information remaining in the network service is for a job that User A does not need (no longer needs). However, it is possible that User A needed to quickly move away from the multifunction device, or that User A left the multifunction device thinking that the job was complete without realizing that a communication problem was occurring. In any case, the situation in which setting information related to a job executed by User A remained in the network service and that this setting information could be executed by another user, User B, poses the risk of personal information leakage or unauthorized use using the job output, and is not desirable for safely remotely operating the multifunction device.

[0192] In view of the above situation, we will describe a form in which it is possible to prevent other users from executing jobs registered in a network service by deleting the jobs registered in the network service before or when a remote application is launched.

[0193] [4.1 Overall Structure] The overall configuration according to the fourth embodiment can be the same as the overall configuration according to the first embodiment, and therefore a description thereof will be omitted here.

[0194] [4.2 Functional Configuration] The functional configuration of the terminal device can be the same as the functional configuration of the terminal device 30 according to the first embodiment, and therefore a description thereof will be omitted here.

[0195] [4.2.1 About the Multifunction Printer 70] 28 is a functional configuration diagram of the multifunction device 70. The functional configuration of the multifunction device 70 can be configured similarly to the multifunction device 10 according to the first embodiment. Therefore, the same functions as those of the multifunction device 10 are denoted by the same reference numerals, and the description thereof will be omitted.

[0196] The multifunction device 70 includes a storage unit 71 instead of the storage unit 21. The storage unit 71 stores an output unit control program 211, a display processing program 213, and a remote application 715 as an application, and reserves a device setting value storage area 217 and an end determination value storage area 219.

[0197] The remote application 715 includes a device information generation program 2151 , a setting information acquisition program 2153 , an end determination program 2155 , and a job deletion request program 7151 .

[0198] The job deletion request program 7151 is a program that the control unit 11 reads when it receives an instruction to start the remote application 715 and deletes a job stored in the network service 50. When the control unit 11 reads the job deletion request program 7151, it outputs a job deletion request to the network service 80. Note that when the application is started, the control unit 11 outputs a deletion request for a registered job even while the session key is still valid.

[0199] [4.2.2 About Network Service 80] 29 is a functional configuration diagram of the network service 80. The functional configuration of the network service 80 can be configured in the same manner as the network service 50 according to the first embodiment. Therefore, the same functions as those of the network service 50 are denoted by the same reference numerals, and the description thereof will be omitted.

[0200] The network service 80 includes a storage unit 89 instead of the storage unit 59. The storage unit 89 stores a terminal authentication program 591, a job transmission program 593, and a job deletion program 891, and reserves a job storage area 595.

[0201] The job deletion program 891 is a program that is read by the control unit 51 when a job deletion request is received from the multifunction device 70. When the control unit 51 reads the job deletion program 891, it deletes the job if it stores the job.

[0202] [4.3 Processing flow] [4.3.1 Overall processing] The overall processing according to the fourth embodiment can be the same as the processing flow explained in the flowchart of FIG. 9 in the first embodiment, and therefore will not be explained here.

[0203] [4.3.2 Processing of the multifunction device 70] Next, the processing of the multifunction device 70 will be described using the flowchart in Fig. 30. Note that the processing of the multifunction device 70 is substantially the same as the processing flow explained in Fig. 10 of the first embodiment, so the same steps are assigned the same step numbers and the explanation thereof will be omitted.

[0204] If it is determined in step S160 that an instruction to launch the remote application 715 has been input (step S160; Yes), or if it is determined in step S150 that an operation related to job execution has been input (step S150; Yes), the control unit 11 launches the remote application 715 (step S170).

[0205] Next, the control unit 11 reads the job deletion request program 7151 and outputs a job deletion request to the network service 80 (step S610). Note that the control unit 11 may read the job deletion request program 7151 and output a job deletion request to the network service 80 during the device initialization process in step S120 and the login authentication in step S130.

[0206] [4.3.3 Processing of Network Service 80] Next, the processing of the network service 80 will be described using the flowchart in Fig. 31. Note that the processing of the network service 80 is substantially the same as the processing flow described in Fig. 12 of the first embodiment, and therefore the same processing is assigned the same step number and the description thereof will be omitted.

[0207] First, the control unit 51 determines whether or not a job deletion request has been received from the multifunction device 70 (step S700). If the control unit 51 determines that a job deletion request has been received from the multifunction device 70, it reads the job deletion program 891, and deletes the job if it is stored in the job storage area 595 (step S700; Yes -> step S710). On the other hand, if the control unit 51 determines that a job deletion request has not been received from the multifunction device 70, it waits until a deletion request is received (step S700; No).

[0208] The processing from step S500 onwards is the same as the processing described in the flowchart of FIG.

[0209] [4.4 Example of operation] Next, an example of operation according to the fourth embodiment will be described. Fig. 32 is a diagram showing a schematic timeline of the flow of operation according to the fourth embodiment.

[0210] When a user with the user name A logs in to the multifunction peripheral and starts a remote application, the multifunction peripheral 70 (remote application) requests the network service 80 to acquire a session key as connection information.

[0211] When the multifunction device acquires the session key from the network service 80, it generates a QR code as encoded information including device information and displays it to the terminal device (job application). The terminal device acquires (reads) the QR code via a device information acquisition unit.

[0212] After a job is registered with the network service, the remote application is terminated before the multifunction device acquires the job from the network service. As a result, the job is not acquired from the network service and remains in the network service. In this state, user A logs out from the multifunction device 70.

[0213] After the user with the user name A logs out, the user with the user name B logs in to the multifunction peripheral 70 and inputs an instruction to start the remote application 715 .

[0214] Upon receiving the instruction to start the remote application 715, the control unit 11 outputs a request to the network service 80 to delete the job related to the execution of the job.

[0215] Upon receiving a request to delete a job, the network service 80 deletes the job if it stores the job.

[0216] Next, the multifunction device 70 requests the network service 80 to acquire a session key as connection information.

[0217] When the multifunction device 70 acquires the session key from the network service 80, it generates a QR code as encoded information including device information and displays it to the terminal device 30 (job application). The terminal device acquires (reads) the QR code via a device information acquisition unit.

[0218] Then, the terminal device 30 generates setting information related to the execution of the job and registers the job by transmitting the generated setting information to the network service 80. The multifunction device 70 acquires the job from the network and executes the acquired job.

[0219] After the job is executed, the multifunction device controls the termination of the remote application.

[0220] As described above, according to the fourth embodiment, by deleting a job registered in a network service before or when a remote application is launched, it is possible to prevent other users from executing a job registered in a network service.

[0221] [5 Fifth embodiment] The fifth embodiment is a form in which, when a job deletion request is made to a network service in the fourth embodiment, the user is queried as to whether or not the job can be deleted.

[0222] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations according to the fifth embodiment can be the same as those according to the fourth embodiment, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, terminal device processing, and network service processing can be the same as those according to the fourth embodiment, and therefore descriptions thereof will be omitted here.

[0223] [5.1 Processing of the multifunction device 70] The processing flow of the multifunction peripheral 70 according to the fifth embodiment can be substantially the same as the processing flow of the multifunction peripheral 70 according to the fourth embodiment described with reference to Fig. 30. The fifth embodiment differs from the fourth embodiment in that, before and after sending a job deletion request in step S610 of Fig. 30, a job deletion confirmation screen is displayed on the display unit 13 as an inquiry screen as to whether or not the job can be deleted.

[0224] [5.2 Example of operation] In FIG. 33, the job deletion confirmation screen W130 includes a job deletion confirmation area R38, a Yes button B46, and a No button B48.

[0225] The job deletion confirmation area R38 is an area that displays a message asking the user whether or not to delete a job stored in the network service 80. Fig. 33 shows an example of a message that indicates that a job with user name A remains in the network service 80 and asks whether or not to delete the job.

[0226] The Yes button B46 accepts input of a job deletion instruction from the user. When the Yes button B46 is selected to instruct the job to be deleted, the control unit 11 sends a job deletion request to the network service 80. The No button B48 accepts an instruction not to delete the job. When the No button B48 is selected to instruct the job not to be deleted, the control unit 11 does not send a job deletion request to the network service 80.

[0227] As described above, according to the fifth embodiment, in addition to the effects of the fourth embodiment, it is possible to prevent jobs from being unnecessarily deleted, for example, in cases where a user with a user name A who has once logged out of the multifunction device 70 logs in again and again.

[0228] [6 Sixth Embodiment] In the fifth embodiment, the job deletion confirmation screen W130 is displayed on the multifunction peripheral 70, and the deletion of the job is confirmed on the multifunction peripheral 70. In the sixth embodiment, the deletion of the job can be confirmed on the terminal device 30.

[0229] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations according to the sixth embodiment can be the same as those according to the fourth embodiment, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, multifunction peripheral processing, and network service processing can be the same as those according to the fourth embodiment, and therefore descriptions thereof will be omitted here.

[0230] [6.1 Processing of the terminal device 30] Fig. 34 is a flowchart illustrating the processing flow of the terminal device 30 according to the sixth embodiment. The processing flow of the terminal device 30 according to the sixth embodiment can also be substantially the same as the processing flow of the terminal device 30 described in Fig. 11 according to the first embodiment. Therefore, the same processes as those according to the flowchart in Fig. 11 are assigned the same step numbers, and their description will be omitted.

[0231] In step S400, the control unit 31 transmits the generated setting information to the network service 80 together with the identification information of the multifunction device 10, and then acquires presence / absence information indicating whether the network service 80 stores the job (step S800). Then, based on the acquired job presence / absence information, the control unit 31 displays a job deletion confirmation screen on the display unit 33, and when an instruction to delete the job is received, transmits a job deletion request to the network service 80 (step S810).

[0232] [6.2 Example of operation] 35 is a diagram illustrating an example of the configuration of a job deletion confirmation screen W140 displayed by the terminal device 30. The job deletion confirmation screen W140 can be displayed by inputting a display instruction by selecting the application setting button B44 provided on the application screen W60 illustrated in FIG.

[0233] The job deletion confirmation screen W140 can have the same display content as the job deletion confirmation screen W130 shown in FIG. 33. The user can set whether or not to delete a job via the job deletion confirmation screen W140. The user can input a command to delete a job by selecting the Delete button B50. If the user does not want to delete a job, they can execute the job by selecting the Execute button B52.

[0234] As described above, according to the sixth embodiment, in addition to the effects of the fourth embodiment, the confirmation of deletion of setting information can be performed on the terminal device 30 without operating the operation screen of the multifunction device 70, thereby making it possible to further avoid contact with the multifunction device 70.

[0235] [7 Seventh embodiment] When scanning multiple pages of documents using the document tray in a copy job or scan job, the user lifts the document pressing member, removes the scanned document, and places the next document on the document tray. Then, the user must return the document pressing member to its original position and then input a document scanning start command (for example, by pressing a scanning start button displayed on the operation screen).

[0236] In this case, every time reading of an original is completed, a message prompting the user to set the next original is displayed on the operation screen or the like (FIG. 36).

[0237] Scanning multiple documents using the document tray always requires operation on the document tray or display (operation screen), which is not in line with the concept of remotely operating a multifunction device to avoid frequent contact.

[0238] The seventh embodiment is an embodiment in which, in an operation of reading an original using a platen, the number of times reading can be performed on the platen is limited, thereby making it possible to avoid contact with the platen or operation screen as much as possible.

[0239] [7.1 Overall Structure] The overall configuration according to the seventh embodiment can be the same as the overall configuration according to the first embodiment, and therefore a description thereof will be omitted here.

[0240] [7.2 Functional Configuration] The functional configuration of the terminal device and the network service can be the same as that of the terminal device 30 and the network service 50 according to the first embodiment, and therefore a description thereof will be omitted here.

[0241] [7.2.1 About Multifunction Device 90] 37 is a functional configuration diagram of the multifunction device 90. The functional configuration of the multifunction device 90 can be configured in the same manner as the multifunction device 10 according to the first embodiment. Therefore, the same functions as those of the multifunction device 10 are denoted by the same reference numerals, and the description thereof will be omitted.

[0242] The multifunction device 90 includes a storage unit 91 instead of the storage unit 21. The storage unit 91 stores an output unit control program 211, a display processing program 213, a remote application 215, and a document placement determination program 911, and reserves a device setting value storage area 217 and an end determination value storage area 219.

[0243] The document placement determination program 911 is a program that the control unit 11 reads when determining whether or not a document has been placed (set) on a document table provided in the image reading unit 173. The control unit 11 can read the document placement determination program 911 when, for example, a document holder provided on the document table is opened.

[0244] [7.3 Processing flow] [7.3.1 Overall processing] The overall processing according to the seventh embodiment can be the same as the processing described in the flowchart of FIG. 9 in the first embodiment, and therefore a description thereof will be omitted here.

[0245] [7.3.2 Processing of the multifunction device 90] Next, the processing of the multifunction device 90 will be described with reference to the flowchart of Fig. 38. Fig. 38 is a flowchart for explaining the processing related to the reading of an original by the image reading unit 173 of the multifunction device 90.

[0246] First, the control unit 11 determines whether the remote application 215 is running (step S900). If it is determined that the remote application 215 is running, the control unit 11 determines whether an original has been set on the platen (step S900; Yes → step S910). The control unit 11 can determine whether an original has been set on the platen by detecting the original using, for example, an optical or mechanical detector. On the other hand, if it is determined that the remote application 215 is not running, the control unit 11 ends the process (step S900; No).

[0247] If it is determined that an original is set on the platen, the control unit 11 determines that the original is to be read from the platen (step S910; Yes → step S920). On the other hand, if it is determined that an original is not set on the platen, the control unit 11 ends the process (step S910; No).

[0248] Next, the control unit 11 displays a message on the display unit 13 to the effect that document reading will start (step S930).

[0249] When the user selects the start button and inputs a command to select the start button, the control unit 11 reads the document placed on the document platen once (one document sheet) and ends the process (step S940->step S950).

[0250] [7.4 Example of operation] 39 is a diagram illustrating an example of the configuration of a message screen W150 that the control unit 11 displays on the display unit 13 in step S930 of FIG. 38. The message screen W150 displays a message informing the user that scanning of the document set on the document platen will begin. After checking the displayed message, the user can start scanning of the document by selecting the start button displayed on the terminal device 30.

[0251] 40 is a diagram illustrating an example of the configuration of the document reading setting screen W160. The document reading setting screen W160 can be displayed via a system setting screen (not shown), for example.

[0252] The document reading setting screen W160 includes a multiple document reading setting check box CB12, a register button B38, and a cancel button B40.

[0253] The multiple document reading setting check box CB12 is a check box for setting whether or not to allow multiple document readings via the document platen (scanning multiple documents). When the multiple document reading setting check box CB12 is checked, the multiple document reading setting is enabled.

[0254] The register button B38 accepts the registration of the settings in the multiple document reading setting check box CB12. The cancel button B40 accepts the cancellation of the settings in the multiple document reading setting check box CB12.

[0255] As described above, according to the seventh embodiment, when reading a document using a document holder, the number of times reading can be performed on the document holder is limited to one (one document sheet), thereby making it possible to avoid contact with the document holder or operation screen as much as possible.

[0256] [8 Eighth embodiment] The eighth embodiment is a configuration in which, in the seventh embodiment, when the user desires to read a plurality of documents, the use of an automatic document reader is recommended.

[0257] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations according to the eighth embodiment can be the same as those according to the seventh embodiment, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, terminal device processing, and network service processing can be the same as those according to the seventh embodiment, and therefore descriptions thereof will be omitted here.

[0258] [8.1 Processing of Multifunction Device 90] Next, the processing of the multifunction device 90 will be described using the flowchart in Fig. 41. Note that the processing of the multifunction device 90 is substantially the same as the processing flow described in Fig. 38 of the seventh embodiment, so the same processes are assigned the same step numbers and their description will be omitted.

[0259] After displaying a message on display unit 13 indicating that document reading is about to begin, control unit 11 determines whether the document setting destination has been changed to an automatic document reader (ADF) (step S930->step S960). For example, control unit 11 can determine that the document setting destination has been changed to the automatic document reader when a document detection signal is no longer detected on the document platen and a document detection signal is detected in the automatic document reader.

[0260] If it is determined that the document has not been set to the automatic document reader, that is, if the detection signal of the document on the document table continues to be detected, the control unit 11 executes the processing of steps S940 and S950 (step S960; No → step S940, step S950).

[0261] On the other hand, if it is determined that the document setting destination has been changed to the automatic document reader, the control unit 11 determines that the document will be read by the automatic document reader (step S960; Yes→step S970).

[0262] When the user selects the start button and inputs an instruction to select the start button, the control unit 11 reads the document and ends the process (step S980 to step S990).

[0263] [8.2 Example of operation] FIG. 42 is a diagram illustrating an example of the configuration of a message screen W170 as a recommendation screen displayed by the control unit 11 on the display unit 13 in step S930 of FIG. 41. The message screen W170 displays a message recommending the use of an automatic document reader when there are multiple documents to be read. After checking the displayed message, the user changes the document loading destination to the automatic document reader. Then, the user can start document scanning by selecting the start button displayed on the terminal device 30.

[0264] As described above, according to the eighth embodiment, in addition to the effects of the seventh embodiment, when a user wishes to read multiple documents, the reading operation can be performed using an automatic document reading device, thereby making it possible to avoid contact with the document table or operation screen as much as possible.

[0265] [9 Ninth embodiment] As the technology for remotely controlling multifunction devices matures, it is only natural that there will be increasing demand for improved usability. In particular, the user interface that connects users with devices such as terminals and multifunction devices must be more user-friendly and easy to see.

[0266] The ninth embodiment is an embodiment that can further improve the usability of the user interface provided by the terminal device 30.

[0267] For example, the application screen W60 described in Fig. 19 etc. in the first embodiment was configured to include a copy job selection button B26 and a scan job selection button B28 that enable remote operation of a copy job or a scan job on the multifunction device 10. In the ninth embodiment, a configuration will be described in which a fax job selection button is further added to these job selection buttons.

[0268] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations of the ninth embodiment can be the same as the functional configurations of any of the first to eighth embodiments, so a description thereof will be omitted here. Also, the overall processing flow, processing of the multifunction peripheral, processing of the terminal device, and processing of the network service can be the same as the processing of any of the first to eighth embodiments, so a description thereof will be omitted here.

[0269] [9.1 Example of operation] 43 shows an example of the configuration of an application screen W180 that the control unit 31 displays on the display unit 33 when a user instructs the control unit 31 to start the job application 413. The application screen W180 includes a menu display area R40 and a favorites list display area R22.

[0270] The menu display area R40 includes a copy job selection button B26, a scan job selection button B28, and a fax job selection button B54. The copy job selection button B26 and the scan job selection button B28 have the same configuration as those described in Fig. 19, so their description will be omitted here. The favorites list display area R22 also has the same configuration as those described in Fig. 19, so their description will be omitted here.

[0271] The fax job selection button B54 accepts the selection of a fax job by the user. When the fax job selection button B54 is selected, the control unit 31 can determine that a fax job has been selected by the user. When the fax job selection button B54 is selected, the control unit 31 displays the fax job execution screen W190 on the display unit 33.

[0272] The fax job execution screen W190 includes a setting value setting area R42 and a start button B32. The setting value setting area R42 accepts input and selection of setting values ​​related to job execution. Setting values ​​can be input and selected for each setting item related to the fax job, such as "fax number," "scan settings," "image orientation," "density," and "image quality."

[0273] "Fax Number" accepts input of the fax number of the transmission destination. For example, when the user performs a screen operation such as a tap on "Fax Number" and the screen operation is detected, the control unit 31 displays setting value input buttons (numeric keypad) that allow direct input of the fax number. The user can directly input the fax number via the numeric keypad. In addition to direct input using the numeric keypad, the fax number can also be selected via the address book selection button B56. The address book is an address book managed by the terminal device 30, and collects information that associates contact information such as fax numbers, telephone numbers, email addresses, addresses, and workplaces with transmission destinations.

[0274] Furthermore, "reading settings" has setting values ​​such as "single-sided," "double-sided (portrait binding)," and "double-sided (horizontal binding)," and is a setting item that accepts the setting of the side of the document that is to be read. "Image orientation" has setting values ​​such as "face up" and "landscape," and is a setting item that accepts the setting of the image orientation of the document. "Density" has setting values ​​such as "automatic" and "manual (1 to 5 levels)," and is a setting item that accepts the setting of the document density. "Image quality" has setting values ​​such as "normal font," "small font," "small font (halftone)," "fine," "fine (halftone)," "high fine," and "high fine (halftone)," and is a setting item that accepts the setting of the document image quality.

[0275] After inputting and selecting these setting values ​​in the setting value setting area R42, the user can execute a fax job by selecting the start button B32.

[0276] Figure 44 is a diagram illustrating the procedure for directly inputting a fax number via the fax job execution screen W190. Note that in Figure 44, the procedure for inputting a fax number will be explained as transitioning in the order of state (a), state (b), state (c), and state (d) on the left side of the figure.

[0277] State (a) represents a state in which the user has used the setting value input button (numeric keypad) B58 to input the fax number "0987654321." When the input of the fax number is completed and, for example, "Complete" is selected on the setting value input button B58, the control unit 31 transitions the display state of the fax job execution screen W190 to state (b).

[0278] In state (b), when the user selects the start button B32, the control unit 31 transitions the display state of the fax job execution screen W190 to state (c). In state (c), the control unit 31 prompts the user to re-enter the fax number entered in state (a) (double-entry function), prompting the user to reconfirm that there are no errors in the input. Therefore, if the destination information is a fax number, the control unit 31 displays a re-entry area (e.g., an input area where all digits of the fax number can be entered) along with a message prompting the user to re-enter the fax number (e.g., "Please enter the fax number again.") in modal M10 as a reconfirmation screen. After the fax number is re-entered, when the user selects the OK button on modal M10, the control unit 31 compares the input content in state (a) with the input content in state (c). If the two input contents do not match, the control unit 31 displays a message on modal M10, such as "The numbers do not match. Please enter again." Then, the control unit 31 returns the display state of the fax job execution screen W190 to state (b), erases the input fax number, and prompts the user to input the fax number again.

[0279] In addition, when the cancel button on the modal M10 is selected in state (c), the control unit 31 returns the display state of the fax job execution screen W190 to state (b), but continues to display the entered fax number.

[0280] When the Enter button on modal M10 is selected and the input content in state (a) matches the input content in state (c), the control unit 31 transitions the display state of the fax job execution screen W190 to state (d). In state (d), the control unit 31 displays a message on modal M12 prompting confirmation of the fax number destination (for example, "Fax data will be sent to the following destination"), and when the Continue button on the same modal M12 is selected, the control unit 31 executes the fax job.

[0281] Figure 45 is a diagram illustrating the procedure for inputting a fax number via the fax job execution screen W190 when the address book selection button B56 is used to select destination information stored in the storage unit 41. Note that the same symbols are used for the same states as those illustrated in Figure 44. In Figure 45, the fax number input procedure will be described as transitioning in the order of state (e), state (b), state (c), and state (d) on the left side of the figure.

[0282] When the address book selection button B56 on the fax job execution screen W190 is selected, the control unit 31 displays the contact selection screen W200 (state (e)). The contact selection screen W200 includes a contact selection area R44. The contact selection area R44 is an area that displays the fax numbers of destinations registered in the address book managed by the terminal device 30 in the storage unit 41. The user can input a fax number by selecting the fax number of the destination displayed in the contact selection area R44.

[0283] When a fax number displayed in the contact selection area R44 is selected, the control unit 31 transitions the display state of the fax job execution screen W190 to state (b). When a fax number is selected from the address book, the control unit 31 does not, in principle, require the user to re-enter the fax number, as was required when the fax number was entered directly. However, if the control unit 31 detects that the selected fax number has been edited, the control unit 31 transitions the display state of the fax job execution screen W190 to state (c) in FIG. 44 and requires the user to re-enter the fax number.

[0284] Next, the control unit 31 transitions the display state of the fax job execution screen W190 to state (d). In state (d), the control unit 31 displays a message in modal M12 prompting confirmation of the fax number destination (for example, "Fax data will be sent to the following destination"), and executes the fax job in response to selection of the Continue button on the modal M12.

[0285] FIG. 46 is a diagram for explaining another form that can be applied instead of double-striking the fax number in the state (c) of the fax job execution screen W190 shown in FIG.

[0286] Form (1) is a form in which the user is prompted to input only a portion of the fax number, rather than re-entering all of the digits. In this case, modal M14 places a cursor at the location of the number to be input, allowing for numeric input, and for the numbers that are not to be input, the portion of the fax number entered in state (a) is displayed as is. Form (1) is a form in which the user is prompted to input only a portion of the fax number, thereby reducing the burden on the user in inputting the fax number. Note that in the example of form (1), the number to be input is represented as three digits, but the number of digits to be input is not limited to this.

[0287] In form (2), the fax number entered in state (a) is used as the search value, and the search results obtained by a search service that searches for destination information from the fax number are displayed in modal M16. In form (2), the destination information corresponding to the fax number entered in state (a) is displayed as the search result, which has the advantage that it is easier to get an idea of ​​the destination than if you were to enter the fax number directly.

[0288] In form (3), if the fax number entered in state (a) matches a fax number that was previously set as a transmission destination, the user is not prompted to re-enter the fax number. If the fax number entered in state (a) matches a fax number that was previously set as a transmission destination, the possibility of the user making an input error is considered low. In such a case, by not prompting the user to re-enter the fax number, the burden on the user in entering the fax number can be reduced.

[0289] In the fourth mode, verification is performed to determine whether the fax number entered in the fourth mode was entered by a human. As shown in the example of Figure 46, the security of a fax job can be improved by using puzzle authentication, hiragana authentication, picture authentication, or other image authentication methods.

[0290] Incidentally, the setting for requesting re-entry of the fax number, as explained in Fig. 44 etc., can be performed via the application setting modal. Here, the setting for re-entering the fax number will be explained using Fig. 47.

[0291] The application setting modal can be displayed, for example, by the user selecting an application setting button B44 provided on the application screen W180 shown in Fig. 47(a). In response to the selection of the application setting button B44, the control unit 31 displays the application setting modal M22a (Fig. 47(b)).

[0292] The application setting modal M22a as an application setting screen shown in FIG. 47(b) can expand and display configurable contents as shown in FIG. 47(c) by detecting, for example, a tap operation on the modal. The expanded application setting modal M22b displays a collection of application setting items such as "Set your own email address," "Confirm recipient before sending," and "Re-enter fax number." To disable the function related to re-entering the fax number, the user can disable the function by setting the setting value of "Re-enter fax number" to "OFF." On the other hand, to enable the function related to re-entering the fax number, the user can enable the function by setting the setting value of "Re-enter fax number" to "ON."

[0293] As illustrated in FIG. 47(b), regardless of the type of application, by displaying all configurable items in the application setting modal M22b, the user can efficiently configure the application, thereby improving usability.

[0294] 47(d), the application setting modal M22b can also be displayed via the job execution screen of each application. With this configuration, the user can easily access the application setting modal M22b regardless of whether the display unit 33 (operation screen) is displaying an application screen or a job execution screen.

[0295] As described above, the user interface provided by the terminal device is configured to enable fax jobs in addition to copy jobs and scan jobs, and is further configured to include a double-strike function for reconfirming the entered fax number, so that the ninth embodiment can provide a terminal device or the like that can further improve usability. Furthermore, regardless of the type of application, by displaying all items that can be changed in settings in an application setting modal, the user can efficiently configure the application.

[0296] [10 Tenth embodiment] The tenth embodiment is an embodiment that can further improve the usability of the user interface provided by the multifunction peripheral 10.

[0297] In the tenth embodiment, the multifunction peripheral 10 receives a job from the network service 50, and the progress of the job is added to the display contents of the execution screen W40 (FIG. 17) displayed on the display unit 13 while the job is being executed.

[0298] The overall configuration, multifunction peripheral, terminal device, and network service functional configurations of the tenth embodiment can be the same as the functional configurations of any of the first to ninth embodiments, and therefore descriptions thereof will be omitted here. Also, the overall processing flow, processing of the multifunction peripheral, processing of the terminal device, and processing of the network service can be the same as the processing of any of the first to ninth embodiments, and therefore descriptions thereof will be omitted here.

[0299] [10.1 Example of operation] 48 shows an example of the configuration of an execution screen displayed on the display unit 13 while the multifunction device 10 receives a job from the network service 50 and is executing the job. The execution screen W210 includes a message display area R46 indicating that a job is being executed, and an execution job display area R13 that displays the type of job being executed (the example in FIG. 48 is a copy job) using an illustration or animation.

[0300] 48 shows a message display area R46 on the execution screen W210, which displays the contents displayed on the execution screen W40, as well as a message such as "Please check the job status screen for job progress." For example, if the job is a fax job and, depending on the communication situation, it may take some time to complete, the user can check the job progress by operating the job status button on the home screen.

[0301] Fig. 49 shows an example of the configuration of a home screen W220 that includes a job status button B20. The home screen W220 can have substantially the same configuration as the home screen W20 shown in Fig. 15. The home screen W220 shown in Fig. 49 is an example that includes a display area R48 at the bottom of the screen for displaying consumable information such as device settings and toner consumption. The display layout of the home screen W20 shown in Fig. 15 and the home screen W220 shown in Fig. 49 can be changed via a system settings screen, etc.

[0302] 50 to 52 show examples of job status screens W230 to W250 displayed by the control unit 11 in response to selection of the job status button B20 on the home screen W220 of FIG. 49. FIG. 50 shows an example of the job status screen W230 for a copy job (print). FIG. 51 shows an example of the job status screen W240 for a scanner job. FIG. 52 shows an example of the job status screen W250 for a fax job. The job status screens shown in FIGS. 50 to 52 can all have the same configuration. Therefore, in the following description, the same components will be denoted by the same reference numerals, and the job status screen W230 for a copy job in FIG. 50 will be described as a representative example.

[0303] The job execution screen W230a and the execution screen W230b shown in FIG. 50 include an execution job display area R50 and a status display area R52.

[0304] The running job display area R50 is an area that displays information about the running job (job type, user name, number of copies set, status, start time, etc.). The running job display area R50 is provided with job type switching tabs that allow the display of information about the running job to be switched for each job type (copy (print) job, scanner job, fax job, or Internet fax). By operating the job type switching tab, the user can check the execution status of the job related to the desired job type.

[0305] The status display area R52 is an area that displays the execution status of a job. For example, the job execution screen W230a is an example of an execution screen for a job that is in the reserved / executing status. The same applies to the job execution screen W240a for a scanner job in FIG. 51 and the job execution screen W250a for a fax job in FIG. 52.

[0306] The job execution screen W230b is an example of an execution screen for a job in a completed state. The same applies to the job execution screen W240b for a scanner job in Fig. 51 and the job execution screen W250b for a fax job in Fig. 52.

[0307] As shown in the example of FIG. 50, the type of information displayed in the executed job display area R50 can be different between the job execution screen W230a and the job execution screen W230b. In the example of FIG. 50, the information displayed on the job execution screen W230a is information related to "Job," "User / Mode," "End / Set Copies," "Status," and "Start Time." On the other hand, the information displayed on the job execution screen W230b is information related to "Job," "Completion," "Set Time," "Number of Copies," and "Status." In this way, by changing the content of the information displayed in the executed job display area R50 depending on the job execution status, the user can accurately grasp the job execution status.

[0308] As described above, in the tenth embodiment, the progress of a job can be included in the display content of the execution screen that is displayed on the display unit while the multifunction peripheral is executing a job received from a network service. This configuration allows the user to easily grasp the execution status of the job, further improving usability.

[0309] The present invention is not limited to the above-described embodiments, and various modifications are possible. In other words, embodiments obtained by combining technical means that are appropriately modified within the scope of the gist of the present invention are also included in the technical scope of the present invention.

[0310] Furthermore, although the above-described embodiments are described separately for the sake of convenience, they may of course be combined and executed within the scope of technical feasibility.

[0311] In addition, the programs that run on each device in the embodiments are programs that control the CPU, etc. (programs that make a computer function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and then stored in various storage devices such as ROMs (Read Only Memories) and HDDs, and is read, modified, and written by the CPU as needed.

[0312] Here, the recording medium for storing the program may be any of semiconductor media (e.g., ROM, non-volatile memory card, etc.), optical recording media / magneto-optical recording media (e.g., DVD (Digital Versatile Disc), MO (Magneto Optical Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray Disc (registered trademark), etc.)), magnetic recording media (e.g., magnetic tape, flexible disk, etc.). Furthermore, not only are the functions of the above-described embodiments realized by executing the loaded program, but the functions of the present invention may also be realized by processing in cooperation with an operating system or other application programs, etc., based on instructions from the program.

[0313] Furthermore, when distributing the program on the market, the program can be stored on a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is of course included in the present invention. [Explanation of symbols]

[0314] 10 Multifunction device 11 Control section 13 Display section 15 Operation input section 17 Output section 171 Image forming unit 173 Image reading unit 19 Communications Department 21 Memory section 211 Output section control program 213 Display Processing Program 215 Remote Applications 2151 Device Information Generation Program 2153 Configuration Information Acquisition Program 2155 End Judgment Program 217 Device settings storage area 2179 Termination judgment value storage area 30 Terminal Equipment 31 Control Unit 33 Display section 35 Operation input section 37 Device information acquisition section 39 Communications Department 41 Storage section 411 Display Processing Program 413 Job Application 4131 Device Information Acquisition Program 4133 Configuration Information Generation Program 415 Device information storage area 417 Setting value storage area 50 Network Services 51 Control section 53 Display section 55 Operation input section 57 Communications Department 59 Memory section 591 Terminal Device Authentication Program 593 Job Submission Program 595 Job Storage 100 output system

Claims

1. a control unit, a device information acquisition unit that acquires device information including identification information for identifying the image processing device, and a storage unit; The control unit a user interface for receiving at least a setting of an output method for a transmission job in the image processing device based on a request from a user, and transmitting setting information set via the user interface and the acquired identification information; the user interface displays an input screen for receiving information about a destination; The terminal device is characterized in that, when the user interface receives direct input of a destination fax number via the input screen, it displays a reconfirmation screen prompting the user to reconfirm the fax number that has been received, and when the fax number is selected from the fax numbers stored in the memory unit, it restricts the display of the reconfirmation screen.

2. 2. The terminal device according to claim 1, wherein the reconfirmation screen includes a re-input area for requesting re-input of the destination information.

3. The terminal device described in Claim 2, characterized in that the re-input area is provided with an area for either re-inputting all digits of the fax number, inputting part of the fax number, displaying search results for destination information corresponding to the fax number, displaying the fax number that has previously been set as a destination, or displaying an image authentication screen.

4. The control unit 2. The terminal device according to claim 1, wherein the user interface displays an application setting screen for accepting re-input settings of the destination information.

5. 5. The terminal device according to claim 4, wherein the application setting screen displays setting items for applications other than the application related to a fax job.

6. a control unit, a display unit, and a job execution unit that executes a job with predetermined settings based on setting information related to job execution transmitted from the terminal device according to claim 1; The control unit After receiving the start instruction, the application is started. generating device information including device identification information based on the launched application, displaying the generated device information on the display unit of the terminal device, and controlling the job execution unit to output the job with predetermined settings based on setting information related to job execution transmitted from the terminal device that reads the displayed device information; 10. An image processing apparatus comprising: a display unit that displays a message screen that displays a progress status of a job;

7. A job output system including a terminal device, an image processing device, and a network service, The terminal device a control unit, a device information acquisition unit that acquires device information including identification information for identifying the image processing device, and a storage unit; The control unit a user interface for receiving at least a setting of an output method for a transmission job in the image processing device based on a request from a user, and transmitting setting information set via the user interface and the acquired identification information; the user interface displays an input screen for receiving information about a destination; When the user interface receives a direct input of a destination fax number via the input screen, it displays a reconfirmation screen prompting the user to reconfirm the received fax number, and when the fax number is selected from the fax numbers stored in the storage unit, it restricts the display of the reconfirmation screen; The network service is a control unit and a storage unit that associates the setting information with the identification information and stores the association information as a job; In response to a request from the image processing device, transmit a job corresponding to the identification information to the image processing device; The image processing device includes: a control unit, a display unit, and a job execution unit that executes a job with predetermined settings based on setting information related to job execution transmitted from the terminal device; The control unit After receiving the start instruction, the application is started. generating device information including device identification information based on the launched application, displaying the generated device information on the display unit of the terminal device, and controlling the job execution unit to output the job with predetermined settings based on setting information related to job execution transmitted from the terminal device that reads the displayed device information; An output system characterized in that a message screen displaying the progress of a job is displayed on the display unit.

Images