Image processing system, first terminal device, and second terminal device

Abstract

This improves the convenience of an image processing system that allows a terminal device to request image processing from an image processing device or a server device that provides image processing services. [Solution] An image processing system 1 according to one aspect of the present invention comprises a first terminal device 1, a second terminal device 2, and an image processing device. The first terminal device 1 comprises a first communication unit that connects to the second terminal device 2 by Wi-Fi Aware communication, and a first control unit that acquires identification information of the second terminal device 2 and the image processing device from the second terminal device 2 via the first communication unit and transmits an image processing instruction request to the second terminal device 2 based on that identification information. The second terminal device 2 transmits an image processing instruction via a third communication unit to the image processing device or a server device that provides image processing services on the device, based on the image processing instruction request received from the first terminal device 1 via a second communication unit that communicates with the first communication unit. The image processing device performs image processing based on the received image processing instruction.

Description

Technical Field

[0001] The present invention relates to an image processing system, a first terminal device, and a second terminal device.

Background Art

[0002] Patent Document 1 describes a cloud printing service in which a print job is transmitted from a client terminal to a cloud printing service, and an image forming apparatus acquires the print job stored in the cloud printing service.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique described in Patent Document 1, the client terminal needs to belong to the same network as the server device that provides the cloud printing service, and it is necessary to pre-register the user information of the client terminal and the information of the image forming apparatus in the server device. That is, this technique cannot respond to a print instruction from a first terminal device that is a terminal device that does not satisfy such conditions, and can only respond to a print instruction from a second terminal device that is a terminal device that satisfies such conditions.

[0005] Therefore, in order to print a file in the first terminal device using this technique, the user needs to operate the second terminal device to upload the file or print data to the second terminal device and operate the second terminal device to execute printing. Therefore, in order to upload data for such printing to the second terminal device and give a print instruction, the user of the first terminal device needs to move between the first terminal device and the second terminal device, and also needs to operate not only the first terminal device but also the second terminal device, resulting in a decrease in convenience.

[0006] Furthermore, in a system configuration that does not involve a server device, the terminal device that issues print commands must belong to the same network as the image forming apparatus or be directly connected to it, and the image forming apparatus's driver must be installed. Therefore, the same problem arises in such a system configuration as well.

[0007] Furthermore, the problems described above are not limited to printing; they also occur in other image processing operations such as scanning. For example, in scanning, in order to save the scanned data (the data after scanning) in the first terminal device, the user needs to operate the second terminal device to download the scanned data from the second terminal device. The scan command operation also needs to be performed from the second terminal device. Therefore, for such scanning operations, the user of the first terminal device needs to move between the first and second terminal devices, perform the scan command operation on the second terminal device, and perform the download operation on the second terminal device, which reduces convenience.

[0008] Therefore, in image processing systems where terminal devices request image processing from an image processing device or a server device that provides image processing services, there is a need for the development of technologies to improve convenience. [Means for solving the problem]

[0009] An image processing system according to one aspect of the present invention comprises a first terminal device, a second terminal device, and an image processing device, wherein the first terminal device comprises a first communication unit connected to the second terminal device by Wi-Fi Aware communication, and a first control unit that, via the first communication unit, acquires identification information of the second terminal device and identification information of the image processing device from the second terminal device and transmits an image processing instruction request to the second terminal device based on the identification information of the second terminal device and the identification information of the image processing device, wherein the second terminal device comprises a second communication unit connected to the first terminal device by Wi-Fi Aware communication, a third communication unit that communicates with the image processing device or a server device connected to the image processing device and providing image processing services on the image processing device, and a second control unit that, based on the image processing instruction request received from the first terminal device via the second communication unit, transmits an image processing instruction to the image processing device or the server device via the third communication unit, wherein the image processing device performs image processing based on the image processing instruction.

[0010] A first terminal device according to one aspect of the present invention includes a first communication unit that connects via Wi-Fi Aware communication to an image processing device or a second terminal device that is connected to the image processing device and can communicate with a server device that provides image processing services on the image processing device, and a first control unit that, via the first communication unit, acquires identification information of the second terminal device and identification information of the image processing device from the second terminal device, and transmits an image processing instruction request to the image processing device or the server device to the second terminal device based on the identification information of the second terminal device and the identification information of the image processing device.

[0011] A second terminal device according to one aspect of the present invention comprises a second communication unit connected to a first terminal device by Wi-Fi Aware communication, a third communication unit communicating with an image processing device or a server device connected to the image processing device and providing image processing services on the image processing device, and a second control unit, wherein the second control unit transmits identification information of the second terminal device and identification information of the image processing device to the first terminal device via the second communication unit, receives an image processing instruction request from the first terminal device to the image processing device or the server device based on the identification information of the second terminal device and the identification information of the image processing device, and transmits an image processing instruction to the image processing device or the server device via the third communication unit based on the image processing instruction request. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing an example configuration of an image forming system according to Embodiment 1. [Figure 2] Figure 1 is a flowchart illustrating an example of the printing process performed in the image forming system. [Figure 3] This figure shows an example of a user interface image presented to the first terminal device during the printing process shown in Figure 2. [Figure 4] This block diagram shows another example of the configuration of the image forming system according to Embodiment 1. [Figure 5] This is a flowchart illustrating an example of a scanning process performed in the scanning system according to Embodiment 2. [Figure 6] This figure shows an example of the device's hardware configuration. [Modes for carrying out the invention]

[0013] Embodiments of the present invention will be described below with reference to the drawings. Note that each drawing is merely an example illustrating embodiments of the present invention. Furthermore, not all components described in the embodiments of the present invention are necessarily essential components of the present invention.

[0014] (Embodiment 1) [Configuration Example of System] The image processing system according to this embodiment is a system that performs image formation processing on a medium, that is, printing processing, as an example of image processing, and can be referred to as an image forming system or a printing system. The print instruction request and the print instruction in the following description are examples of an image processing instruction request and an image processing request, respectively. Of course, the image forming system according to this embodiment can be configured to execute a plurality of types of image processing such as printing processing and scanning processing as image processing.

[0015] Hereinafter, the image forming system according to this embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing a configuration example of such an image forming system.

[0016] As shown in FIG. 1, the image forming system 100 according to this embodiment includes a first terminal device 1, a second terminal device 2, and an image forming device 3 as an example of an image processing device. The image forming device 3 is a device that forms an image on a medium, that is, a printing device.

[0017] The image forming system 100 is configured to request the second terminal device 2 to perform proxy printing to the image forming device 3 from the first terminal device 1 using Wi-Fi Aware communication.

[0018] Regardless of the printing method of the image forming device 3, various printing methods such as an inkjet printing method and a laser printing method can be applied, for example. The image forming device 3 can be a printer, a scanner, a facsimile device, or a multifunction device having a plurality of functions including at least an image forming function.

[0019] Although the detailed configuration of the image forming apparatus 3 will be omitted, it is sufficient that printing can be executed in response to a print instruction from the second terminal device 2. Therefore, the second terminal device 2 is connected to the image forming apparatus 3 via a network N1 such as an intranet constructed by a wired LAN or a wireless LAN. LAN is an abbreviation for Local Area Network. USB is an abbreviation for Universal Serial Bus. Alternatively, the second terminal device 2 may be connected to the image forming apparatus 3 via a cable such as USB (registered trademark; the same shall apply hereinafter) or short-range wireless communication such as Bluetooth (registered trademark). Also, a printer driver of the image forming apparatus 3 is installed in the second terminal device 2. The image forming apparatus 3 may transmit the result of printing, such as whether the printing has been completed or an error has occurred, to the second terminal device 2. In the case of an error, the image forming apparatus 3 may execute printing when the error is resolved, for example, by a response from the second terminal device 2 or by re-setting the medium.

[0020] Both the first terminal device 1 and the second terminal device 2 can be information processing devices such as a PC (Personal Computer), a smartphone, or a tablet-type terminal. Hereinafter, the configuration examples of the first terminal device 1 and the second terminal device 2 will be described in detail.

[0021] [Configuration Example of the First Terminal Device 1] As shown in FIG. 1, the first terminal device 1 can include a control unit 10, a first communication unit 11, an operation unit 14, a display unit 15, and a storage unit 16.

[0022] The control unit 10 can include a subscribe processing unit 10a and a transmission processing unit 10c, which will be described later, in order to request the second terminal device 2 to perform proxy printing via the first communication unit 11. Further, the control unit 10 may include a follow-up processing unit 10b, which will be described later.

[0023] The control unit 10 can be configured to include, for example, a processing unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), working memory, and a storage device for storing control programs and parameters. The control unit 10 can also be configured as a SoC (System on a Chip). As can be seen from these examples, the control unit 10 can be configured to store control programs in an executable state. However, the control unit 10 can also be configured to store control programs as a circuit configuration such as an FPGA (field-programmable gate array), or as a dedicated circuit.

[0024] The subscribe processing unit 10a, the follow-up processing unit 10b, and the transmission processing unit 10c can be implemented as the above program. The above program may include a program for the arithmetic processing unit to realize the functions of the subscribe processing unit 10a, the follow-up processing unit 10b, and the transmission processing unit 10c in cooperation with the first communication unit 11, the operation unit 14, the display unit 15, and the storage unit 16.

[0025] The storage unit 16, like the storage unit 26, is a storage device such as a hard disk drive, a solid-state drive, or other memory-based storage device. The storage unit 16 stores various setting information necessary for processing on the first terminal device 1, as well as files generated or acquired by the user. All or part of the files stored in the storage unit 16 can be used as files to be printed for proxy printing.

[0026] The display unit 15 is a component for displaying user interface images (UI images) for operating the first terminal device 1, and is composed of a display device such as a liquid crystal display or an organic electroluminescent display. The display unit 15 may also include a display and a drive circuit for driving the display.

[0027] The operation unit 14 is the part of the first terminal device 1 that receives input from the user, and can also be called the operation reception unit. The operation unit 14 can be implemented by one or more of the following: physical buttons, a touch panel mounted on the display unit 15, a pointing device, and a keyboard. In a configuration where the operation unit 14 includes a touch panel, the display unit 15 and the touch panel together can also be called the operation panel of the first terminal device 1.

[0028] The first communication unit 11 is the part that connects to the second terminal device 2 via Wi-Fi (registered trademark; hereinafter the same) Aware communication, more specifically the part that connects to the second communication unit 22, and can be configured with a communication interface capable of such Wi-Fi Aware communication. As will be described later, the first terminal device 1 transmits a print command request to the second terminal device 2 via the data communication path established by this Wi-Fi Aware communication.

[0029] Wi-Fi Aware communication is a type of NAN communication that can be achieved using the Wi-Fi Aware functionality defined by the Wi-Fi Alliance. Wi-Fi is the name of a wireless LAN (Local Area Network) that uses the IEEE (Institute of Electrical and Electronics Engineers) 802.11 standard and its derivative standards. NAN stands for Neighbor Awareness Networking. Hereafter, Wi-Fi Aware will be simply referred to as Aware.

[0030] Furthermore, the first communication unit 11 may be configured to enable wireless communication with external devices other than Aware communication, for purposes other than those related to proxy printing. Examples of such external devices include information processing devices such as PCs and smartphones, and server devices. The information processing device here may also include the second terminal device 2. In this case, the first communication unit 11 may be made to function as an Aware communication unit by control of the control unit 10. For example, the first communication unit 11 may be configured as an Aware-compatible Wi-Fi interface, and the control unit 10 may switch between normal Wi-Fi communication and Aware communication when the unit is functioning as an Aware communication unit. Of course, the first terminal device 1 may also include a communication interface for communicating with external devices via a wired connection.

[0031] The control unit 10 obtains identification information of the second terminal device 2 and identification information of the image forming apparatus 3 from the second terminal device 2 via the first communication unit 11. Here, the identification information of the device may refer to individual identification information such as the MAC (Media Access Control address) address or serial number of the device. The identification information of the device may also include one or more pieces of information such as the model name, performance, and installation location of the device.

[0032] The control unit 10 then transmits a print command request to the second terminal device 2 via the first communication unit 11 based on the identification information of the second terminal device 2 and the identification information of the image forming apparatus 3. The print command request may also be called a proxy print command or a proxy print request. The print command request may include the file to be printed, or the print data for that file, or a print job including the print data and print setting information. The control unit 10 and the control unit 20 of the second terminal device 2 may be referred to as the first control unit and the second control unit, respectively, to distinguish them from each other.

[0033] The detailed configuration of the control unit 10 will now be described. The transmission processing unit 10c of the control unit 10 performs the process of transmitting a print command request to the second terminal device 2 via the data communication path established by Aware communication in the first communication unit 11. For example, the transmission processing unit 10c establishes a data communication path with the second communication unit 22 in the first communication unit 11 and performs the process of transmitting a print command request to the second terminal device 2. For this type of communication, the first terminal device 1 is operated as a subscriber and the second terminal device 2 is operated as a publisher.

[0034] As preparation for sending a print command request, that is, as initial setup for Aware communication, for example, the Subscribe Processing Unit 10a broadcasts a Subscribe message via the First Communication Unit 11 requesting the disclosure of a service that accepts such print command requests. In this case, the Subscribe Processing Unit 10a and the First Communication Unit 11 operate in active mode. The above service is a service that sends a print command request from the First Terminal Device 1 to the Second Terminal Device 2 and causes the Second Terminal Device 2 to execute a print command to the Image Forming Apparatus 3, and since it is a service related to proxy printing, it can be hereinafter referred to as the proxy printing service.

[0035] As will be explained later, the second terminal device 2, which is the device that performs the proxy printing, receives this subscribe message transmitted by broadcast as a publisher and sends a publish message back to the sender of the subscribe message via unicast.

[0036] However, in order for the second terminal device 2 to respond to the subscribe message with a publish message, the subscribe processing unit 10a and the first communication unit 11 will form a cluster with the second terminal device 2 before sending the subscribe message. In other words, the subscribe processing unit 10a will join the same NAN cluster as the second terminal device 2 via the first communication unit 11 and broadcast a subscribe message requesting the publication of the proxy printing service. As a result, the second terminal device 2 will be able to receive the subscribe message.

[0037] The transmission processing unit 10c receives the publish message returned from the second terminal device 2 via the first communication unit 11. Thereby, the transmission processing unit 10c causes the first communication unit 11 to establish a data communication path with the second communication unit 22 of the second terminal device 2. This data communication path is the data communication path of Aware communication, that is, the data communication path of NAN communication.

[0038] Establishing a data communication path of NAN communication between the first terminal device 1 and the second terminal device 2, specifically between the first communication unit 11 and the second communication unit 22, means generating a bidirectional Aware network connection and establishing a data communication path between them. Hereinafter, the bidirectional Aware network connection is simply referred to as an Aware connection. In an Aware connection, IP (Internet Protocol) communication is performed.

[0039] In this way, the first terminal device 1 establishes a data communication path with the second terminal device 2. However, in the image forming system 100, there may be a plurality of terminal devices that can publish and become the second terminal device 2, and there may also be a plurality of image forming devices 3 that can perform printing from each terminal device. Therefore, in the first terminal device 1, it is advisable to specify the second terminal device 2 that is the target for establishing the data communication path, and at that time, it is also advisable to specify the image forming device 3 that will execute the printing. This specification can be implemented by additionally receiving the identification information of each device. The control unit 10 may include, for example, a follow-up processing unit 10b in order to additionally receive such identification information of the second terminal device 2 and the identification information of the image forming device 3.

[0040] The follow-up processing unit 10b transmits an additional information request for requesting the identification information of the second terminal device 2 and the identification information of the image forming device 3 that can instruct printing from the second terminal device 2 as additional information about the printing agency service published from the second terminal device 2 to the second terminal device 2 via the first communication unit 11. This additional information request can be executed via the first communication unit 11.

[0041] In response to this request for additional information, the second terminal device 2 sends back its own identification information and the identification information of the image forming apparatus 3 that it can instruct to print to the first terminal device 1. The follow-up processing unit 10b receives this returned identification information via the first communication unit 11.

[0042] If there is only one combination of received identification information, the subscribe processing unit 10a can consider that the combination has been designated to the user of the first terminal device 1. The subscribe processing unit 10a then establishes a data communication path with the second terminal device 2 indicated by that combination. Next, the transmission processing unit 10c transmits a print instruction request via the established data communication path, instructing the designated image forming apparatus 3 to print. Upon receiving this print instruction request, the second terminal device 2 issues a print instruction to the image forming apparatus 3, and the image forming apparatus 3 then performs the printing.

[0043] If there are multiple combinations of received identification information, the subscribe processing unit 10a displays a UI image on the display unit 15 to allow the user to select a combination and accepts the selection operation from the operation unit 14. The subscribe processing unit 10a establishes a data communication path with the second terminal device 2 indicated by the selected combination. Next, the transmission processing unit 10c sends a print instruction request to the second terminal device 2 via the data communication path thus established, instructing the image forming apparatus 3 indicated by the selected combination to print. Upon receiving this print instruction request, the second terminal device 2 issues a print instruction to the designated image forming apparatus 3, and the image forming apparatus 3 then performs the printing.

[0044] If the transmission processing unit 10c or the subscribe processing unit 10a receives a notification from the second terminal device 2 that printing is complete, it may cause the first communication unit 11 to disconnect the data communication path for Aware communication.

[0045] Furthermore, subscribing to a proxy printing service can mean searching for a proxy printing service as described above, or it can also mean using or joining a proxy printing service. It can also be detected that the second terminal device 2 within the same cluster has also been subscribed. Publishing a proxy printing service can mean making the proxy printing service publicly available.

[0046] [Example configuration of the second terminal device 2] As shown in Figure 1, the second terminal device 2 may include a control unit 20, a second communication unit 22, a third communication unit 23, an operation unit 24, a display unit 25, and a storage unit 26.

[0047] The control unit 20 may include a publish processing unit 20a and a receive processing unit 20c, described later, in order to process a request for proxy printing from the first terminal device 1 via the second communication unit 22. Furthermore, the control unit 20 may also include a follow-up processing unit 20b, described later.

[0048] The control unit 20, like the control unit 10, can be configured to include, for example, an arithmetic processing unit, a working memory, and a memory device for storing control programs and parameters. The control unit 20 can also be configured as an SoC. As can be seen from these examples, the control unit 20 can be configured to store control programs in an executable state. However, the control unit 20 can also be configured to store control programs as a circuit configuration, such as in an FPGA, or as a dedicated circuit.

[0049] The publish processing unit 20a, the follow-up processing unit 20b, and the receive processing unit 20c can be implemented as the above program. The above program may include a program for the arithmetic processing unit to realize the functions of the publish processing unit 20a, the follow-up processing unit 20b, and the receive processing unit 20c in cooperation with the second communication unit 22, the third communication unit 23, the operation unit 24, the display unit 25, and the storage unit 26.

[0050] The configurations of the second communication unit 22, the operation unit 24, the display unit 25, and the storage unit 26 are basically the same as those of the first communication unit 11, the operation unit 14, the display unit 15, and the storage unit 16 in the first terminal device 1, respectively, and their explanation will be omitted.

[0051] For example, the second communication unit 22 is the part that connects to the first terminal device 1 via Wi-Fi Aware communication, more specifically the part that connects to the first communication unit 11, and can be configured with a communication interface capable of such Wi-Fi Aware communication. As will be described later, the second terminal device 2 receives print command requests from the first terminal device 1 via the data communication path established by this Wi-Fi Aware communication.

[0052] Furthermore, the operation unit 24 is the part that receives operations from the user of the second terminal device 2. The display unit 25 is the part that displays UI images for operating the second terminal device 2. The storage unit 26 stores various setting information necessary for processing on the second terminal device 2, as well as files generated or acquired by the user. Note that the storage unit 26 may be part of the storage device within the control unit 20. In other words, the storage unit 26 can also be considered part of the control unit 20.

[0053] Furthermore, the second communication unit 22, like the first communication unit 11, should be configured to enable wireless communication with external devices other than Aware communication, for purposes other than those related to proxy printing. Examples of such external devices include the image forming apparatus 3, information processing devices such as PCs and smartphones, and server devices. The information processing device here may also include the first terminal device 1. In this case, the second communication unit 22 should be configured to function as an Aware communication unit through control by the control unit 20. For example, the second communication unit 22 can be configured as an Aware-compatible Wi-Fi interface, and the control unit 20 can switch between normal Wi-Fi communication and Aware communication when the unit is functioning as an Aware communication unit.

[0054] However, for the sake of distinction, this explanation assumes that the third communication unit 23 performs wireless communication with such external devices, including at least the image forming apparatus 3. Of course, the third communication unit 23 may also be equipped with a communication interface for communicating with such external devices by wire, instead of or in addition to wireless communication. In other words, the third communication unit 23 only needs to be a communication unit that communicates with the image forming apparatus 3.

[0055] The control unit 20 transmits the identification information of the second terminal device 2 and the identification information of the image forming apparatus 3 to the first terminal device 1 via the second communication unit 22. The control unit 20 then receives a print instruction request to the image forming apparatus 3 from the first terminal device 1 via the second communication unit 22, based on the identification information of the second terminal device 2 and the identification information of the image forming apparatus 3.

[0056] A detailed configuration example of the control unit 20 will be described. The receiving processing unit 20c of the control unit 20 receives a print command request from the first terminal device 1 via the data communication path established by Aware communication in the second communication unit 22.

[0057] As preparation for receiving a print command request, that is, as the initial setup for Aware communication, for example, the publish processing unit 20a receives a subscribe message requesting the publication of a proxy printing service, which is broadcast from the first terminal device 1, and publishes it. At this time, the second terminal device 2 operates as a publisher. The publish processing unit 20a receives this subscribe message via the second communication unit 22 and publishes it by unicasting a publish message back to the first terminal device 1, which was the source of the subscribe message.

[0058] However, as mentioned above, prior cluster formation is necessary for the second terminal device 2 to respond to a subscribe message by returning a publish message. That is, before the first terminal device 1 sends a subscribe message, the publish processing unit 20a and the second communication unit 22 form a cluster with the first terminal device 1, and more specifically with the first communication unit 11. In other words, the publish processing unit 20a joins the same NAN cluster as the second terminal device 2 via the second communication unit 22, receives a subscribe message requesting the publication of the proxy printing service, and returns a publish message. As a result, the first terminal device 1 can receive that publish message.

[0059] When a publish message is sent in response to a subscribe message transmitted from the first terminal device 1, the receiving processing unit 20c causes the second communication unit 22 to establish a data communication path with the second communication unit 22 of the second terminal device 2.

[0060] However, as described above with respect to the first terminal device 1, the second terminal device 2 transmits identification information of the second terminal device 2 and the image forming apparatus 3 to the first terminal device 1. The control unit 20 may include, for example, a follow-up processing unit 20b to transmit this identification information.

[0061] When the follow-up processing unit 20b receives an additional information request from the first terminal device 1 requesting additional information about the published proxy printing service, it sends the additional information back to the first terminal device 1 via the second communication unit 22. The additional information sent includes the identification information of the second terminal device 2 and the identification information of the image forming apparatus 3 that can be instructed to print from the second terminal device 2.

[0062] The first terminal device 1 receives these returned identification information via the first communication unit 11. The first terminal device 1 can similarly receive identification information from other second terminal devices 2. If there is only one combination of identification information received by the first terminal device 1, the subscribe processing unit 10a will establish a data communication path with the second terminal device 2 indicated by that combination. Next, the receiving processing unit 20c receives a print instruction request via the established data communication path, which causes the image forming apparatus 3 to issue a print instruction. Based on this print instruction request, the control unit 20 of the second terminal device 2 issues a print instruction to the image forming apparatus 3 via the third communication unit 23. The image forming apparatus 3 then performs printing based on that print instruction.

[0063] As described above, if there are multiple combinations of received identification information, the first terminal device 1 accepts a selection operation from the user and establishes a data communication path with the second terminal device 2 indicated by the selected combination. Next, the receiving processing unit 20c receives a print instruction request via the data communication path thus established, which instructs the image forming apparatus 3 indicated by the selected combination to print. Based on this print instruction request, the control unit 20 of the second terminal device 2 issues a print instruction to the designated image forming apparatus 3 via the third communication unit 23. The image forming apparatus 3 then performs printing based on that print instruction.

[0064] If the receiving processing unit 20c or the publishing processing unit 20a receives notification from the image forming apparatus 3 that printing is complete, it may cause the second communication unit 22 to disconnect the data communication path for Aware communication.

[0065] [First example of printing process] Using Figures 2 and 3, we will describe a first example of a printing process performed in the image forming system 100 with the configuration described above. Figure 2 is a flowchart illustrating this first example of a printing process. Figure 3 is a diagram showing an example of a UI image presented to the first terminal device 1 in the printing process of Figure 2. As described above, both the first terminal device 1 and the second terminal device 2 are configured to enable aware connections, that is, they have aware functionality.

[0066] First, in the first terminal device 1, the control unit 10 starts Aware when it receives a user operation from the operation unit 14 to enable the Aware function, or automatically when the power is turned on (step S10). The Aware that is started refers to, for example, a program that implements the Aware function in the first terminal device 1, and an API used to exchange information between that program and the first communication unit 11, which is the hardware for Aware. Note that API is an abbreviation for Application Programming Interface. Upon this start, the first terminal device 1 enters a standby state for Aware connection.

[0067] Furthermore, the second terminal device 2 activates Aware when the control unit 20 receives a user operation from the operation unit 24 to enable the Aware function, or automatically when the power is turned on (step S11). The activated Aware refers to, for example, a program that implements the Aware function in the second terminal device 2, and an API used to exchange information between that program and the second communication unit 22, which is the hardware for Aware. Upon activation, the second terminal device 2 enters a standby state for Aware connection.

[0068] After processing in steps S10 and S11, the first terminal device 1 and the second terminal device 2 form a NAN cluster (step S12). The order of steps S10 and S11 does not matter. For example, if the second terminal device 2 starts Aware first and forms a NAN cluster with other devices, and then the first terminal device 1 starts Aware, the first terminal device 1 will join that cluster. Conversely, if the first terminal device 1 starts Aware first and forms a NAN cluster with other devices, and then the second terminal device 2 starts Aware, the second terminal device 2 will join that cluster. In this way, ultimately, it is sufficient for the first terminal device 1 and the second terminal device 2 to be able to join the same NAN cluster.

[0069] Once a NAN cluster is formed and both the first terminal device 1 and the second terminal device 2 join the cluster, the first terminal device 1 operates as a subscriber, and the second terminal device 2, which is capable of issuing print instructions to the image forming apparatus 3, operates as a publisher.

[0070] Specifically, the Subscribe Processing Unit 10a of the First Terminal Device 1 performs a subscribe for service discovery by broadcasting a subscribe message requesting the disclosure of the proxy printing service (step S13). In other words, this subscribe signifies a search for the proxy printing service. In this way, the Subscribe Processing Unit 10a performs the search for the proxy printing service via the First Communication Unit 11.

[0071] In response to this subscribe message, the publish processing unit 20a of the second terminal device 2 within the same cluster publishes the proxy printing service by sending back a publish message (step S14). In this way, the publish processing unit 20a publishes the proxy printing service via the second communication unit 22.

[0072] The subscribe processing unit 10a will receive this publicly available proxy printing service via the first communication unit 11. Receiving the publicly available proxy printing service means receiving information about this proxy printing service. The first terminal device 1 can use the proxy printing service by utilizing the information thus received.

[0073] Next, the follow-up processing unit 10b of the first terminal device 1 makes an additional information request to the second terminal device 2 in the Further Service Discovery process (step S15). The Further Service Discovery process is an additional search process performed after the initial service discovery in NAN technology. In the Further Service Discovery process, it is preferable to make the additional information request using a Follow-up Frame. Alternatively, in the Further Service Discovery process, the additional information request may be made using the GAS (Generic Advertisement Service) communication protocol. For example, the control unit 10 may not have a follow-up processing unit 10b, and the transmission processing unit 10c may make the additional information request using the GAS communication protocol.

[0074] This additional information includes identification information for the second terminal device 2 and identification information for the image forming apparatus 3 that can receive print instructions from the second terminal device 2. Therefore, in response to the above-mentioned request for additional information, the follow-up processing unit 20b of the second terminal device 2 transmits the identification information for the second terminal device 2 and the identification information for the image forming apparatus 3 as additional information (step S16). In step S16, the follow-up processing unit 10b of the first terminal device 1 receives the additional information transmitted from the second terminal device 2.

[0075] The subscribe processing unit 10a receives additional information from the follow-up processing unit 10b, displays a UI image on the display unit 15 to allow the user to select a combination, and accepts the selection operation for the proxy printing service from the operation unit 14 (step S17). The selection operation here should be a selection operation from all proxy printing services indicated by the combination of identification information.

[0076] For example, the display unit 15 of the first terminal device 1 displays the UI image 30 shown in Figure 3. The UI image 30 includes buttons for making an Aware connection for each proxy printing service. Specifically, the UI image 30 includes a group of radio buttons 31, an OK button 32, and a Cancel button 33. The group of radio buttons 31 includes radio buttons for each proxy printing service in a list of combinations of identification information. In the example of the UI image 30, combinations such as image forming apparatus A (via second terminal device A) and image forming apparatus 3 and second terminal device 2 are shown.

[0077] The user can select the desired proxy printing service from the group of radio buttons 31, turn on the radio button, and then select the OK button 32 to select one of the proxy printing services indicated by the turned-on radio button. In this way, the user of the first terminal device 1 can select the second terminal device 2 and image forming apparatus 3 they wish to use based on the acquired additional information. For example, if the user wants to print from image forming apparatus A, this is not possible via the second terminal device B, so the user will select the combination of second terminal device A and image forming apparatus A. If the cancel button 33 is selected, the process can be terminated.

[0078] Thus, UI image 30 may include a list of combinations of image forming apparatus 3 and second terminal device 2. The list is not limited to the order exemplified; for example, it may be written separately for each second terminal device 2 or for each image forming apparatus 3. In addition, to distinguish the second terminal devices 2, the username of the second terminal device 2 may be obtained as additional information and displayed in the list. This allows the user of the first terminal device 1 to, for example, prioritize selecting a shared second terminal device 2. In addition, to distinguish the image forming apparatus 3, at least one of the model name and installation location of the image forming apparatus 3 may be obtained as additional information and displayed in the list. This allows the user of the first terminal device 1 to select printing on the desired image forming apparatus 3 even if they do not know, for example, the model name or installation location of the image forming apparatus 3 in advance.

[0079] Alternatively, the list may consist only of image forming apparatuses 3. In that case, for each image forming apparatus 3 selected by the user, the system should automatically determine which second terminal device 2 will send a print command to that image forming apparatus 3, according to predetermined rules, such as which second terminal device 2 was the first to receive identification information.

[0080] Furthermore, if there is only one image forming apparatus 3 among the combinations of identification information that the first terminal device 1 has received within the cluster, the following processing may be performed automatically instead of step S17. That is, the subscribe processing unit 10a may automatically select, for example, the second terminal device 2 that first received the identification information and its single image forming apparatus 3 from among the proxy printing services of the combinations published by the second terminal device 2. However, even in such a situation, the user may be asked to select a service as in step S17 for confirmation.

[0081] If the proxy printing service is selected in step S17, the subscribe processing unit 10a automatically sends a message to the publisher, the second terminal device 2, to that effect. Upon receiving this message, the second terminal device 2 automatically performs NAN pairing with the first terminal device 1 (step S18) and establishes an Aware connection (step S19) via the receiving processing unit 20c or the publishing processing unit 20a. Establishing an Aware connection means establishing a data communication path. Alternatively, if the proxy printing service is selected in step S17, the transmitting processing unit 10c or the subscribe processing unit 10a of the first terminal device 1 may take the lead in automatically performing NAN pairing with the second terminal device 2 to establish an Aware connection.

[0082] Step S18 provides an example of using NAN pairing to establish an Aware connection. However, it is sufficient for a data communication path to be established between the second terminal device 2 and the first terminal device 1, i.e., for a link to the proxy printing service to be established. Therefore, an Aware connection may be established by a method other than NAN pairing.

[0083] Some NAN pairing connection methods allow you to connect simply by selecting the target device. In other words, with NAN pairing, if enhanced security is not the goal, you can establish a data communication path and connect terminal device 1 and terminal device 2 without manually or automatically entering the SSID or password. SSID stands for Service Set Identifier.

[0084] However, to enhance security, it is advisable to establish a data communication path using NAN pairing in steps S18 and S19 as follows. For example, as a connection method in NAN pairing, a password such as a QR (Quick Response) code (registered trademark) or PIN code may be used. Alternatively, as a connection method in NAN pairing, passwords may be exchanged using other methods, such as exchanging passwords using NFC (Near Field Communication). In NAN pairing, the more complex the method of exchanging the key code, the higher the security. The password may be pre-set by the second terminal device 2 for the proxy printing service that it publishes. Alternatively, the password may be pre-set by the first terminal device 1 for the proxy printing service that it subscribes to. In either case, it becomes possible to establish an encrypted data communication path without user operation.

[0085] As in these examples, in steps S18 and S19, a data communication path may be established that uses password-encrypted communication. In other words, the data communication path to be established may be a password-encrypted communication path. This can enhance security.

[0086] Steps S15 and S16 show an example where identification information for both the second terminal device 2 and the image forming apparatus 3 is sent and received in the Further Service Discovery process. However, in this process, only the identification information for one of them may be sent and received. The user of the first terminal device 1 may request a proxy printing service by selecting only the second terminal device 2, or by selecting only the image forming apparatus 3. Therefore, the selection of the proxy printing service in step S17 is possible with only the identification information for one of them. Thus, the control unit 10 may, via the first communication unit 11, search for at least one of the identification information for the second terminal device 2 and the image forming apparatus 3 in the Further Service Discovery process, and receive the at least one of the identification information from the second terminal device 2.

[0087] If an Aware connection is established in step S19, that is, if a data communication path is established, the transmission processing unit 10c of the first terminal device 1 sends a print command request to the second terminal device 2 via that data communication path (step S20). In step S20, the receiving processing unit 20c of the second terminal device 2 receives the transmitted print command request.

[0088] The print instruction request sent and received in step S20 is a request to instruct the image forming apparatus 3 to print, as indicated by the combination selected by the first terminal device 1. This print instruction request can be made by the first terminal device 1 repeatedly sending and receiving information with the second terminal device 2.

[0089] For example, the initial print command request may include information about the file to be printed and a request for proxy printing of that file. In this case, for print settings, the second terminal device 2 may return a setting UI image of the printer driver for the image forming apparatus 3 to the first terminal device 1, allowing the second terminal device 1 to configure the print settings from that setting UI image, that is, to send the print setting information as part of the print command request. This allows the second terminal device 2 to use the printer driver to generate a print job that prints the previously sent file based on these print settings. Note that print settings can include various types of settings such as whether to print in color or monochrome, paper settings, number of copies, page specification, and collation settings.

[0090] Furthermore, the initial print command request may consist only of a request for the printer driver's UI image for the image forming apparatus 3 that is the target of the print command, i.e., the image forming apparatus 3 selected by the first terminal device 1. In this case, the second terminal device 2 can return the printer driver's UI image for the image forming apparatus 3 to the first terminal device 1, allowing it to configure the print settings and specify the file to be printed based on that UI image. With these print settings, the first terminal device 1 transmits the print setting information as part of the print command request. Also, with the specification of the file to be printed, the first terminal device 1 transmits the file to be printed as part of the print command request. As a result, the second terminal device 2 can use the printer driver to generate a print job that prints the file to be printed based on these print settings.

[0091] Thus, a print instruction request only needs to be a request that ultimately enables the second terminal device 2 to generate a print job containing print data and print setting information for the file to be printed.

[0092] Thus, the control unit 10 may transmit print setting information for the print subject to the print instruction request to the second terminal device 2 via the first communication unit 11 as part of the print instruction request. As described above, this transmission can be performed over an established data communication path. However, the print setting information may also be transmitted via this data communication path separately from the print instruction request. Even if the first terminal device 1 does not transmit such print setting information, printing based on the default setting information used for printing to the selected image forming apparatus 3 at the second terminal device 2 is still possible.

[0093] The control unit 20 of the second terminal device 2 issues a print instruction to the designated image forming apparatus 3 via the third communication unit 23, based on the print instruction request received from the first terminal device 1, and more specifically, using the print job generated based on this print instruction request (step S21).

[0094] Upon receiving this print instruction, the image forming apparatus 3 performs printing based on the instruction (step S22). When the image forming apparatus 3 completes printing, it notifies the second terminal device 2 of the completion of printing (step S23). Upon receiving this notification, the second terminal device 2 forwards the notification to the first terminal device 1 (step S24). This forwarded notification represents information indicating the result of printing in response to the print instruction request. Upon receiving this notification, the user of the first terminal device 1 should go to the location where the image forming apparatus 3 is installed to pick up the printed materials.

[0095] After step S24, the transmission processing unit 10c or the subscribe processing unit 10a automatically disconnects the data communication path with the second terminal device 2 (step S25) and terminates Aware (step S26). The second terminal device 2, upon receiving this notification, also terminates Aware (step S27). Alternatively, after step S24, the reception processing unit 20c or the publish processing unit 20a automatically disconnects the data communication path with the first terminal device 1 (step S25) and terminates Aware (step S27). In this case, the first terminal device 1, upon receiving this notification, should also terminate Aware (step S26). Thus, the processing in steps S26 and S27 can be performed immediately after the processing in step S25.

[0096] Thus, the control unit 20 may, via the second communication unit 22, transmit to the first terminal device 1 the result of the printing performed in the image forming apparatus 3 based on the print instruction, as a response to the print instruction request. The control unit 10 may then receive the print result via the first communication unit 11 as a response to the print instruction request, and after receiving it, disconnect the connection with the second terminal device 2, that is, terminate the service.

[0097] Furthermore, the Aware function allows users to subscribe to and publish to that service or other services, and to establish data communication paths with other terminals, even when a data communication path for a service has already been established. Therefore, the first terminal device 1 can send multiple print command requests to the same second terminal device 2, and can also send print command requests in parallel to multiple second terminal devices 2. The second terminal device 2 can receive multiple print command requests from the same first terminal device 1, and can also receive print command requests in parallel from multiple first terminal devices 1. Note that parallel processing here actually refers to time-sharing processing, for example.

[0098] Therefore, the control unit 10 may receive the print result as a response to the print command request via the first communication unit 11, and after receiving it, send another print command request to the second terminal device 2. In this case, after receiving the print result, the control unit 10 of the first terminal device 1 will maintain the connection with the second terminal device 2 and continue the proxy printing service. The maintenance may be continued for a predetermined period to save power, or it may be continued until the user of the first terminal device 1 or the second terminal device 2 terminates the Aware function. The above-mentioned other print command request becomes a print command request to the image forming apparatus 3 relating to the initial print command request, and basically, at least one of the files to be printed and the print settings can be different, but even if both are exactly the same, there is no problem in the sense of adding copies.

[0099] In addition, the first terminal device 1 may terminate the Aware function to conserve power if it does not receive a necessary response from the second terminal device 2 within a second predetermined period. Examples of necessary responses include the response in step S14 to step S13 and the response in step S16 to step S15.

[0100] Furthermore, since the above-mentioned parallel processing is possible, a third predetermined timeout process may be applied to the processing in step S27 to save power. For example, if no print instruction request is received from another first terminal device 1 for the third predetermined period from the selection of the service in step S17 or the establishment of the data communication path in step S19, the second terminal device 2 may terminate the Aware function. Alternatively, if such conditions are met, the publish processing unit 20a may simply stop publishing the service. Note that the third predetermined period may be the same as the first predetermined period or the second predetermined period, or it may be a different period from both.

[0101] [Second example of printing process] As the first example, we gave an example that assumes the subscribe processing unit 10a is operated in active mode, but the subscribe processing unit 10a may also be operated in passive mode. Such an example will be explained as the second example.

[0102] In the second example, the publish processing unit 20a broadcasts a publish message. This transmission is preferably performed at regular intervals, i.e., periodically. In the second example, the second terminal device 2 periodically publishes the proxy printing service, and the first terminal device 1 receives the proxy printing service that has been published in this periodic manner. In other words, in the second example, the first terminal device 1, which operates as a subscriber, passively receives the publish message broadcast by the second terminal device 2, which operates as a publisher. In the second example, the first terminal device 1 can omit sending a subscribe message requesting the publication of the proxy printing service.

[0103] [Third example of printing process] Furthermore, the printing process is not limited to the first and second examples; a third example may also be adopted as follows. In the third example, step S13 in Figure 2 of the first example is performed as follows: The first terminal device 1 first operates in passive mode to search and confirm whether the proxy printing service has been published, and only if it has not been published, it may execute the process described in step S13. In this way, the first terminal device 1 may send a subscribe message requesting the publication of the proxy printing service only if the proxy printing service has not been published.

[0104] [Effects of this embodiment] As described above, in the image forming system 100, a first terminal device 1, which is in an environment or setting where it cannot issue print instructions to the image forming apparatus 3, can establish an Aware connection with a second terminal device 2, which is capable of issuing print instructions to the image forming apparatus 3, and send a print instruction request to the second terminal device 2, requesting proxy printing. The second terminal device 2 then receives such a proxy printing request and can send a print instruction to the image forming apparatus 3, resulting in the image forming apparatus 3 being able to perform printing.

[0105] As a result, even if the first terminal device 1 is in an environment or setting where it cannot issue print commands to the image forming apparatus 3, the user can issue print commands from the second terminal device 2, which is capable of issuing print commands to the image forming apparatus 3, without having to upload the files to be printed to the second terminal device 2. Therefore, the user of the first terminal device 1 does not need to move between the first terminal device 1 and the second terminal device 2 or operate the second terminal device 2 in order to upload files and issue print commands. In other words, in this embodiment, even if the first terminal device 1 is in an environment or setting where it cannot issue print commands to the image forming apparatus 3, printing can be performed simply by operating the first terminal device 1, without having to move between the first terminal device 1 and the second terminal device 2 and operate the second terminal device 2. Thus, the image forming system 100 can improve the convenience of printing for the user of the first terminal device 1.

[0106] Furthermore, in this embodiment, when requesting printing from the first terminal device 1 to the image forming apparatus 3, there is no need for prior preparation on the first terminal device 1, such as installing the printer driver for the image forming apparatus 3 or setting it to the same network environment as the image forming apparatus 3. Setting it to the same network environment as the image forming apparatus 3 refers to setting the first terminal device 1 to belong to the same network as the image forming apparatus 3. Also, because no such prior preparation is required, the user of the first terminal device 1 does not need to know in advance which image forming apparatus 3 can be used to send a proxy printing instruction from the first terminal device 1. In addition, in this embodiment, the Aware function can discover a second terminal device 2 that can print using service discovery. Therefore, according to this embodiment, the user does not need to set up the first terminal device 1 again or go to the second terminal device 2 to check if printing is possible, and can also send a proxy printing instruction without being aware of the second terminal device 2 that will perform the proxy printing.

[0107] Furthermore, in this embodiment, the method of connecting the image forming apparatus 3 and the second terminal device 2 is not specified. Therefore, even if the image forming apparatus 3 does not have network functionality, printing can be performed as long as it is connected to the second terminal device 2 via a USB cable or the like.

[0108] Furthermore, in this embodiment, since the connection between the first terminal device 1 and the second terminal device 2 is an Aware connection, unlike a normal Wi-Fi connection, proxy printing can be requested without entering an SSID or password. In addition, in this embodiment, the user of the first terminal device 1 can also specify the second terminal device 2 to which the proxy printing will be requested, and the image forming apparatus 3 to perform the printing.

[0109] Furthermore, in the example configuration of the image forming system 100 shown in Figure 1, printing operations can be performed from the first terminal device 1, which is in an environment or setting where printing instructions to the image forming apparatus 3 cannot be sent, without introducing a cloud server device. Therefore, in this example configuration, the costs associated with introducing and operating a cloud server device can be reduced.

[0110] As described above, according to this embodiment, convenience can be improved in a system in which a terminal device requests printing from an image forming apparatus or a server device that provides printing services on an image forming apparatus.

[0111] [Other system configuration examples] Another configuration example of the image forming system according to this embodiment will be described with reference to Figure 4. Figure 4 is a block diagram showing another configuration example of the system. The other configuration example shown in Figure 4 (hereinafter referred to as Configuration Example A) will be described focusing on the differences from the configuration example described using Figures 1 to 3. However, various examples of the configuration examples and modifications described using Figures 1 to 3 can also be applied to Configuration Example A.

[0112] As shown in Figure 4, the image forming system 100A according to configuration example A includes a first terminal device 1, a second terminal device 2, and an image forming apparatus 3, in addition to a server device 4. The server device 4 is connected to the second terminal device 2 via a network N2 such as the Internet or an intranet. The server device 4 is connected to the image forming apparatus 3 via network N2. Alternatively, the server device 4 may be connected to the image forming apparatus 3 via a network different from network N2. In this case, the second terminal device 2 will not be connected to the image forming apparatus 3 via network N2, nor via the other network mentioned above.

[0113] Server device 4 is connected to both the second terminal device 2 and the image forming apparatus 3. Server device 4 provides printing services from the image forming apparatus 3 to the second terminal device 2. Server device 4 may be a cloud server device. Server device 4 also includes a printer driver for the image forming apparatus 3 to issue print commands to the image forming apparatus 3. Server device 4 is a server computer; a detailed description of its configuration is omitted, but it can include, for example, a processing unit, working memory, and a storage device for storing control programs and parameters. The printer driver can be included as part of this control program.

[0114] The second terminal device 2 will request printing from the image forming apparatus 3 to the server device 4, but the basic configuration of the first terminal device 1 and the second terminal device 2 is the same as the configuration example in Figure 1, so a detailed explanation will be omitted. Since the second terminal device 2 can issue print instructions to the server device 4 through such a request, it does not need to have a printer driver for the image forming apparatus 3 installed. In configuration example A, the third communication unit 23 is a communication unit that communicates with the server device 4, which is connected to the image forming apparatus 3 and provides printing services for the image forming apparatus 3.

[0115] In Configuration Example A, the control unit 10 also acquires identification information for the second terminal device 2 and identification information for the image forming apparatus 3 from the second terminal device 2 via the first communication unit 11. The identification information for the image forming apparatus 3 can be acquired by the second terminal device 2 accessing the server device 4. The control unit 20 of the second terminal device 2 then transmits the identification information for the second terminal device 2 and the identification information for the image forming apparatus 3 to the first terminal device 1 via the second communication unit 22. Based on the acquired identification information for the second terminal device 2 and the identification information for the image forming apparatus 3, the control unit 10 in Configuration Example A sends a print command request to the server device 4 via the first communication unit 11 to the second terminal device 2. The control unit 20 receives such a print command request to the server device 4 based on the identification information for the second terminal device 2 and the identification information for the image forming apparatus 3 via the second communication unit 22.

[0116] In configuration example A, the control unit 20 receives a print instruction request from the first terminal device 1 via the second communication unit 22 and transmits a print instruction to the server device 4 via the third communication unit 23. The server device 4 then transmits the print instruction to the image forming apparatus 3 via the network N2. The image forming apparatus 3 then performs printing based on the print instruction received from the server device 4. The printing result is transmitted from the image forming apparatus 3 to the server device 4, transferred from the server device 4 to the second terminal device 2, and finally transferred from the second terminal device 2 to the first terminal device 1.

[0117] As can be seen from the above explanation, the configuration example A described in Figure 4 can achieve the same effect as the examples described using Figures 1 to 3. Furthermore, configuration example A can also be applied to printing services via the server device 4, such as cloud printing services. Therefore, in configuration example A, the printer driver for the image forming apparatus 3 does not need to be installed on the second terminal device 2; it only needs to be installed on the server device 4.

[0118] Furthermore, in Configuration Example A, there is no need to install the printer driver for the image forming apparatus 3 on the first terminal device 1, nor is there any need to pre-register user information for the users of the first terminal device 1 on the server device 4. Also, in Configuration Example A, when requesting printing from the first terminal device 1 to the image forming apparatus 3, no prior preparation such as setting up the server device 4 or the same network environment as the image forming apparatus 3 is required.

[0119] (Embodiment 2) [System Configuration] The image processing system according to this embodiment is a system that performs scanning as an example of image processing, and can be referred to as a scanning system. In the following description, the scan instruction request and scan instruction are examples of image processing instruction requests and image processing requests, respectively. Of course, the scanning system according to this embodiment can be configured to perform multiple types of image processing, such as scanning and printing.

[0120] While examples of the configuration of the scanning system according to this embodiment are not shown, in the image forming system 100 shown in Figure 1, a configuration with a scanning device is possible, such as when the image forming apparatus 3 is a multifunction device, or a configuration in which a scanning device is provided instead of the image forming apparatus 3. Of course, if the scanning system according to this embodiment includes multiple scanning devices, some of the scanning devices may be mounted on other devices, such as devices mounted on the image forming apparatus 3, and the remaining scanning devices may be devices that only have a scanning function. For convenience, the following explanation will use an example in which the scanning device is mounted on the image forming apparatus 3.

[0121] [Example of scanning process] The scanning process performed in the scanning system according to this embodiment will be described below with reference to Figure 5. Figure 5 is a flowchart illustrating an example of such scanning process.

[0122] First, the same process as in steps S10 to S22 in Figure 2 is performed (steps S50 to S62). However, in this embodiment, the "proxy printing service" described in Figure 2 can be read as a "proxy scanning service," and so on, by replacing "printing" with "scanning."

[0123] To elaborate, the additional information sent and received in step S56 is the identification information of the image forming apparatus 3, which is the scanning device, and the identification information of the second terminal device 2. However, the identification information of the image forming apparatus 3 may also be the identification information that identifies the scanning device within the image forming apparatus 3. Furthermore, in step S57, for example, similar to the UI image 30, radio buttons may be included for each proxy scanning service in a list of similar combinations of identification information.

[0124] Furthermore, in step S50, the transmission processing unit 10c of the first terminal device 1 sends a scan instruction request to the second terminal device 2 via the data communication path established in step S49, and the second terminal device 2 receives it. The scan instruction request sent and received in step S50 is a request to perform a scan instruction to the image forming apparatus 3, which is indicated by the combination selected by the first terminal device 1. This scan instruction request can be made by the first terminal device 1 repeatedly sending and receiving information with the second terminal device 2.

[0125] For example, the initial scan instruction request may be only a request for a proxy scan. Alternatively, the initial scan instruction request may be a request for the scan setting UI image from the printer driver settings UI images for the image forming apparatus 3 that is the target of the scan instruction, i.e., the image forming apparatus 3 selected by the first terminal device 1.

[0126] In either case, the second terminal device 2 should return a setting UI image for the scan settings to the first terminal device 1, and allow the second terminal device 1 to perform the scan settings from that setting UI image, that is, send the scan setting information as part of the scan command request. This allows the second terminal device 2 to perform the scan settings using the printer driver. Note that the scan settings can include various types of settings, such as settings indicating whether it is a color scan or a monochrome scan, settings for scan resolution, settings for aggregated scans, and settings for the file format of the scanned data.

[0127] Based on this scan instruction request, the control unit 20 of the second terminal device 2 issues a scan instruction to the designated image forming apparatus 3 via the third communication unit 23 (step S61). The image forming apparatus 3 receives this scan instruction and executes the scan process (step S62).

[0128] This explanation assumes that the scan instruction request includes a scan start instruction. In this case, the scan process in step S62 can be automatically started based on the scan instruction received in step S61. In this case, it is advisable to place the document to be scanned at the scan position or in the automatic document feeder for scanning before selecting the service in step S57.

[0129] Alternatively, the scan instruction request may be a request for preparation for the scan process, rather than a request to start scanning. In this case, for example, the scan start button in the image forming apparatus 3 may be made to blink, and the system can wait for the user of the first terminal device 1 to press the scan start button when they arrive at the location where the image forming apparatus 3 is installed. In this case, the scan process in step S62 will start when the document to be scanned is placed in the scan position or on the automatic document feeder and the scan start button is pressed.

[0130] The image forming apparatus 3 transmits the scan data to the second terminal device 2 when the scan is completed, or sequentially (step S63). The second terminal device 2 then forwards the received scan data to the first terminal device 1 (step S64). When the scanning process in step S62 and the transmission of the scan data in step S63 are completed, the image forming apparatus 3 notifies the second terminal device 2 that the scan is complete (step S65). Upon receiving this notification, the second terminal device 2 forwards this notification to the first terminal device 1 (step S66). This forwarded notification represents information indicating the scan result in response to the scan instruction request. The user of the first terminal device 1 who receives this notification may, for example, check the scan data stored in the default folder in the storage unit 16.

[0131] After step S66, the data communication path may be disconnected (step S67) in the same manner as in step S25 in Figure 2, and Aware may be terminated (steps S68, S69) in the same manner as in steps S26 and S27 in Figure 2.

[0132] Furthermore, various modifications of the printing process described in Embodiment 1 can also be applied to the scanning process in this embodiment.

[0133] [Effects of this embodiment] According to this embodiment, a first terminal device 1, which is in an environment or setting where it cannot issue scan instructions to the image forming apparatus 3, can establish an Aware connection with a second terminal device 2, which is capable of issuing scan instructions to the image forming apparatus 3, and send a scan instruction request to the second terminal device 2, requesting a proxy scan. The second terminal device 2 then receives this proxy scan request and can send a scan instruction to the image forming apparatus 3, thereby enabling the image forming apparatus 3 to perform the scan process.

[0134] As a result, even if the first terminal device 1 is in an environment or setting where it cannot issue scan commands to the image forming apparatus 3, the user can acquire scan data by operating the second terminal device 2, which is capable of issuing scan commands to the image forming apparatus 3, without needing to download the scan data from the second terminal device 2. Therefore, for such scanning processing, the user of the first terminal device 1 does not need to move between the first terminal device 1 and the second terminal device 2, nor do they need to issue scan commands to the second terminal device 2, and no download operation is required on either device. In other words, in this embodiment, even if the first terminal device 1 is in an environment or setting where it cannot issue scan commands to the image forming apparatus 3, scanning processing can be performed without having to move back and forth between the first terminal device 1 and the second terminal device 2 and operate the second terminal device 2. Thus, in this embodiment, the convenience of scanning processing for the user of the first terminal device 1 can be improved.

[0135] Furthermore, in this embodiment, when requesting a scan from the first terminal device 1 to the image forming apparatus 3, there is no need for prior preparation on the first terminal device 1, such as installing the scan driver for the image forming apparatus 3 or configuring it to be in the same network environment as the image forming apparatus 3.

[0136] (Other variations) The present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. For example, the first terminal device, the second terminal device, and the image forming apparatus can all be any device capable of realizing the functions described. In addition, while printing and scanning have been given as examples of image processing, the invention is not limited to these. Examples of image processing other than printing and scanning include display processing, which forms an image on a display device, and projection processing, which projects images or videos onto a screen or wall using a projector. In any example, it is sufficient that an image processing device corresponding to the target image processing is connected to the second terminal device, and that an image processing instruction for executing the image processing can be transmitted from the second terminal device to the image processing device.

[0137] Furthermore, each device provided in the system according to the above-described embodiment may have a hardware configuration such as the following. Here, each device refers to, as in the examples in Figures 1 and 4, a first terminal device 1, a second terminal device 2, an image forming apparatus 3, and a server device 4. Figure 6 is a diagram showing an example of the hardware configuration of the devices.

[0138] The device 1000 shown in Figure 6 may include a processor 1001, a memory 1002, and an interface 1003. The interface 1003 may include interfaces to other devices as needed, such as a communication interface or an input / output device.

[0139] The processor 1001 may be, for example, a CPU, GPU, or MPU (Micro Processor Unit), also known as a microprocessor. The processor 1001 may include multiple processors. The memory 1002 is composed of, for example, a combination of volatile memory and non-volatile memory. The functions of each device are realized by the processor 1001 reading a program stored in the memory 1002 and executing it while exchanging necessary information via the interface 1003. For example, if device 1000 is the first terminal device 1, this program may include a program that causes the processor 1001 to perform the process of sending a print instruction request as described above. For example, if device 1000 is the second terminal device 2, this program may include a program that causes the processor 1001 to perform the process of receiving a print instruction request and sending a print instruction as described above.

[0140] Furthermore, the program described above includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments when loaded into a computer. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies. Examples, but not limited to, include CD-ROMs, digital versatile discs (DVDs), Blu-ray® discs, or other optical disc storage, magnetic cassettes, magnetic tapes, magnetic disk storage, or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrical, optical, acoustic, or other forms of propagating signals.

[0141] Although the present invention has been described above in accordance with the above embodiments, the present invention is not limited to the configuration of the above embodiments, and of course includes various modifications, alterations, and combinations that can be made by a person skilled in the art within the scope of the claims of the present patent application. [Explanation of Symbols]

[0142] 1...First terminal device, 2...Second terminal device, 3...Image forming apparatus, 4...Server device, 10...Control unit, 10a...Subscribe processing unit, 10b...Follow-up processing unit, 10c...Transmission processing unit, 11...First communication unit, 14...Operation unit, 15...Display unit, 16...Storage unit, 20...Control unit, 20a...Publish processing unit, 20b...Follow-up processing unit, 20c...Receive processing unit, 22...Second communication unit, 23...Third communication unit, 24...Operation unit, 25...Display unit, 26...Storage unit, 30...UI image, 31...Radio button group, 32...OK button, 33...Cancel button, 100...Image forming system, 100A...Image forming system, 1000...Device, 1001...Processor, 1002...Memory, 1003...Interface, N1,N2...Network.

Claims

1. The system comprises a first terminal device, a second terminal device, and an image processing device. The first terminal device is The first communication unit connects to the second terminal device via Wi-Fi Aware communication, A first control unit, via the first communication unit, obtains identification information of the second terminal device and identification information of the image processing device from the second terminal device, and transmits an image processing instruction request to the second terminal device based on the identification information of the second terminal device and the identification information of the image processing device, Equipped with, The second terminal device is A second communication unit that connects to the first terminal device via Wi-Fi Aware communication, A third communication unit that communicates with the image processing device or a server device connected to the image processing device and providing image processing services on the image processing device, A second control unit transmits an image processing instruction to the image processing device or the server device via the third communication unit based on the image processing instruction request received from the first terminal device via the second communication unit, Equipped with, The image processing device performs image processing based on the image processing instruction. Image processing system.

2. The first control unit performs a search for services related to proxy image processing via the first communication unit. The second control unit, via the second communication unit, performs the disclosure of services related to proxy image processing. The first control unit receives the publicly available service related to the proxy image processing via the first communication unit. The image processing system according to claim 1.

3. The first control unit, via the first communication unit, searches for at least one of the identification information of the second terminal device and the identification information of the image processing device in the Further Service Discovery process, and receives the at least one of the identification information from the second terminal device. The image processing system according to claim 1 or 2.

4. The first control unit transmits image processing setting information for the image processing subject to the image processing instruction request to the second terminal device via the first communication unit. The image processing system according to claim 1 or 2.

5. The second control unit transmits to the first terminal device, via the second communication unit, the result of the image processing performed by the image processing device based on the image processing instruction, as a response to the image processing instruction request. The first control unit receives the result of the image processing as a response to the image processing instruction request via the first communication unit, and disconnects the connection with the second terminal device after receiving the result. The image processing system according to claim 1 or 2.

6. The second control unit transmits to the first terminal device, via the second communication unit, the result of the image processing performed by the image processing device based on the image processing instruction, as a response to the image processing instruction request. The first control unit receives the result of the image processing as a response to the image processing instruction request via the first communication unit, and after receiving it, transmits another image processing instruction request to the second terminal device. The image processing system according to claim 1 or 2.

7. The aforementioned image processing is either printing or scanning. The image processing system according to claim 1 or 2.

8. A first communication unit is connected via Wi-Fi Aware communication to an image processing device or a second terminal device that can communicate with the image processing device or a server device connected to the image processing device and that provides image processing services on the image processing device, A first control unit, via the first communication unit, obtains identification information of the second terminal device and identification information of the image processing device from the second terminal device, and transmits an image processing instruction request to the image processing device or the server device to the second terminal device based on the identification information of the second terminal device and the identification information of the image processing device, A first terminal device equipped with [a specific feature].

9. The second terminal device is, The first terminal device and the second communication unit are connected via Wi-Fi Aware communication. A third communication unit that communicates with an image processing device or a server device connected to the image processing device and providing image processing services on the image processing device, The second control unit and Equipped with, The second control unit is, The second communication unit transmits the identification information of the second terminal device and the identification information of the image processing device to the first terminal device, and receives from the first terminal device an image processing instruction request to the image processing device or the server device based on the identification information of the second terminal device and the identification information of the image processing device. Based on the image processing instruction request, the image processing instruction is transmitted to the image processing device or the server device via the third communication unit. Second terminal device.

Images