Systems, mobile devices, image processing devices, programs, and storage media

Abstract

To provide a data processing system that, when an image forming apparatus receives a job from a mobile terminal and executes a job after receiving an instruction to execute processing on an operation panel of the image forming apparatus, performs user operation in both the mobile terminal and the image forming apparatus.SOLUTION: In a data processing system, when an image forming apparatus receives a job from a mobile terminal (S901), an image processing apparatus displays authentication information on an operation panel (S910), and the mobile terminal receives input of the authentication information and transmits the authentication information to the image processing apparatus to cause the image forming apparatus to execute the job (S913).SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present invention relates to A system that allows users to give instructions for jobs to be performed on an image forming machine from a mobile device. .

Background Art

[0002] In recent years, with the popularization of high-performance mobile terminals called smartphones, the number of image forming apparatuses that cooperate with such mobile terminals has also increased. For example, a print instruction can be issued from a mobile terminal to an image forming apparatus using wireless communication. A mobile terminal accepts an operation from a user, creates a print job based on the selected print data and various set print setting information (for example, information on color settings and the number of print copies), and transmits the print job to an MFP, thereby causing the MFP to execute print processing. At this time, network communication between the mobile terminal and the image forming apparatus is established in accordance with communication protocols such as TCP / IP, NFC, and Bluetooth (registered trademark), for example, and can be implemented by known techniques. In addition, Patent Document 1 discloses a method for improving operability when giving instructions such as copy processing and scan data transmission processing from a mobile terminal to an image forming apparatus. When a terminal can instruct an image forming apparatus to perform scan data transmission processing, problems occur due to, for example, an erroneous operation by a user. For example, if user B located away from the image forming apparatus mistakenly instructs transmission of scan data from a terminal for a sheet placed on the document platen of the image forming apparatus by user A who is in front of the image forming apparatus, the scan data can be obtained illegally. Therefore, Patent Document 2 discloses a method in which after a scan data transmission instruction is issued on a terminal, scan data is transmitted when a predetermined operation is accepted on an operation panel of the image forming apparatus. According to this method, a user can transmit scan data after performing confirmation work on the image processing apparatus, and erroneous operations and the like can be prevented.

Prior Art Literature

Patent Literature

[0003]

Patent Document 1

[0004] However, as in Patent Document 2, when scan data is transmitted when a predetermined operation is received on the operation panel of an image forming apparatus, the user must first instruct the execution of the process on their terminal and then operate the operation panel of the image forming apparatus. In other words, the user must operate on two devices, which reduces user convenience. It would be preferable if the operation could be completed on the user's terminal.

[0005] In light of the above, Akira is a fraudulent job Execute Suppress, User experience of decline Mechanism to suppress The purpose is to provide. [Means for solving the problem]

[0006] A system including a mobile terminal and an image processing device, The aforementioned mobile device is With a wireless LAN communication connection established between the image processing device and the mobile terminal, the image processing device is instructed to execute a job to transmit the scanned and generated image. After receiving an instruction operation to instruct the mobile terminal, An acquisition means for acquiring information about the display content displayed on the display means of the image processing apparatus, An execution request based on the aforementioned instruction operation, which requests the image processing device to execute a job to transmit the scanned and generated image, Transmission information based on the information acquired by the aforementioned acquisition means and Control to send Send It has signal control means, The aforementioned image processing device is A display control means that controls the display content indicating authentication information to be displayed on the display means, before Record An execution means that executes a job corresponding to the execution request when the transmission information transmitted by the control means satisfies predetermined conditions, comprising the predetermined condition is not satisfied when the transmission information does not include information indicating the authentication information . [Advantageous Effects of Invention]

[0007] Invalid job execution Suppress, user operability of decrease Suppress . [Brief Description of Drawings]

[0008] [Figure 1] Diagram showing configuration of data processing system [Figure 2] Block diagram showing hardware configuration of data processing apparatus [Figure 3] Block diagram showing hardware configuration of image forming apparatus [Figure 4] Block diagram showing software configuration of data processing apparatus [Figure 5] Block diagram showing software configuration of image forming apparatus [Figure 6] Flowchart of connection processing by the data processing apparatus in Embodiment 1 [Figure 7] Flowchart of job execution processing by the data processing apparatus in Embodiment 1 [Figure 8] Diagram showing an example of a screen displayed on the data processing apparatus [Figure 9] Flowchart of job execution processing by the image forming apparatus in Embodiment 1 [Figure 10] Diagram showing an example of a screen displayed on the image forming apparatus [Figure 11] Flowchart of job execution processing by the image forming apparatus in Embodiment 2 [Figure 12] Flowchart of job execution processing by the image forming apparatus in Embodiment 3 [Figure 13] Flowchart of job execution processing by the image forming apparatus in Embodiment 4 Description of Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments for carrying out the present invention will be exemplarily described in detail with reference to the drawings. However, the components described in the present embodiment are merely illustrative, and are not intended to limit the scope of the present invention solely to these components.

[0010] (Example 1) FIG. 1 is a configuration diagram of an information processing system according to the present example. A data processing system 100 is configured by a data processing apparatus 101, a wireless LAN (Local Area Network) terminal 102, an image forming apparatus 104, and a cloud server 105, and these apparatuses are connected via a network 103.

[0011] The data processing apparatus 101 is, for example, a mobile terminal such as a smartphone or a tablet, and may operate an operating system for small terminals, or a program that controls calling and data communication. Alternatively, the data processing apparatus 101 may be a personal computer that does not include voice control, position detection control, mobile phone data communication, or the like. Further, the data processing apparatus 101 is connected to the network 103 via the wireless LAN terminal 102.

[0012] The wireless terminal 102 is a wireless LAN master device having a general network router function, and provides wireless LAN within a home, an office, or the like.

[0013] The image forming apparatus 104 is a digital multifunction machine having various job execution functions such as a printer function, a copy function, a scanner function, and a facsimile transmission function. By operating the data processing apparatus 101, a user can instruct the image forming apparatus 104 to execute a job and implement various functions of the image forming apparatus 104.

[0014] The cloud server 105 manages the data used by the data processing device 101 and the image forming apparatus 104, and performs various function extension processing via the network 103. In this embodiment, the image forming apparatus 104 and the cloud server 105 are connected to the network 103 via wired connections, but they may also be connected wirelessly using the wireless LAN terminal 102, similar to the data processing device 101.

[0015] Furthermore, the data processing device 101 and the image forming apparatus 104 are capable of short-range wireless communication via wireless signals such as NFC (Near Field Communication) and BLE (Bluetooth Low Energy). The image forming apparatus 104 has connection information (such as an IP address and MAC address) for establishing a wireless LAN connection with the image forming apparatus 104 in the NFC communication unit or BLE communication unit described later, and the data processing device 101 acquires this connection information via short-range wireless communication. Based on the acquired connection information, the data processing device 101 and the image forming apparatus 104 then begin wireless LAN communication. In other words, by switching from connection information exchanged between the devices via short-range wireless communication such as NFC or BLE to wireless LAN communication such as Wi-Fi (called a handover), wireless LAN communication between the data processing device 101 and the image forming apparatus 104 is established.

[0016] Figure 2 is a block diagram showing the hardware configuration of the data processing device 101 according to this embodiment.

[0017] The data processing device 101 has a controller unit 201. The controller unit 201 controls various communication units such as the NFC communication unit 210, the BLE communication unit 211, and the wireless LAN communication unit 212, as well as various UI units such as the microphone / speaker 213, the display 214, and the touch panel 215.

[0018] The controller unit 201 consists of a CPU 202, ROM 203, RAM 204, network I / F 205, audio control unit 206, display control unit 207, input control unit 208, and storage device 209, which are connected by a system bus 216.

[0019] The CPU 202 controls the entire system of the data processing unit 101. The ROM 203 stores the operating system of the data processing unit 101 and applications that control calls and data communication, and the CPU 202 executes various programs. The RAM 204 is memory for the CPU 202 to execute various programs and is a work memory area where applications execute programs.

[0020] The storage device 209 is a non-volatile storage device that records various operating mode settings and operation logs that need to be retained even after the data processing device 101 is restarted. In particular, in this embodiment, the storage device 209 stores setting information used when issuing execution instructions to the image forming apparatus 104, as well as setting information obtained from the image forming apparatus 104.

[0021] The network interface 205 is connected to the NFC communication unit 210, the BLE communication unit 211, and the wireless LAN communication unit 212, and performs various wireless communication controls with the image forming apparatus 104 and the cloud server 105.

[0022] The audio control unit 206 controls the input and output of audio data via the microphone / speaker 213. The display control unit 207 controls the output of image data to be displayed on the display 214. The input control unit 208 controls the input of information instructed by the user via buttons or the touch panel 215. Various applications executed by the data processing device 101 are provided to the user using these components: the audio control unit 206, the display control unit 207, and the input control unit 208.

[0023] Figure 3 is a block diagram showing the hardware configuration of the image forming apparatus 104 according to this embodiment.

[0024] The image forming apparatus 104 has a controller unit 301, which controls various communication units such as the NFC communication unit 310, BLE communication unit 311, and wireless LAN communication unit 312, as well as the display / operation unit 307, scanner 313, and printer 314. When a user uses the copy function, the controller unit 301 controls the scanner 313 to acquire image data of the original document and controls the printer 314 to print the image onto paper and output it. When a user uses the scan function, the controller unit 301 controls the scanner 313 to acquire image data of the original document, converts it into code data, and transmits it via the network 103 to the data processing unit 101, cloud server 105, etc. When a user uses the print function, the controller unit 301 receives image data (code data) via the data processing unit 101, cloud server 105, and network 103. The controller unit 301 then converts the received print data into image data and transmits it to the printer 314. The printer 314 prints the image onto paper and outputs it based on the received image data. Furthermore, the image forming apparatus 104 also has a fax receiving function that receives data from ISDN, etc., and prints it, and a fax transmission function that sends scanned data to ISDN, etc. The tasks required to execute each of these functions are called jobs, and the image forming apparatus 104 executes predetermined processing according to the jobs corresponding to each function.

[0025] The controller unit 301 consists of a CPU 302, RAM 303, ROM 304, HDD 305, display / operation interface 306, network interface 308, and device interface 309, which are connected by a system bus 312.

[0026] The CPU 302 controls the entire system of the image forming apparatus 104. The RAM 303 is the system work memory for the operation of the CPU 302, and also serves as image memory for temporarily storing image data and setting data. The RAM 303 also stores programs and data such as the operating system, system software, and application software. It also stores scanned image data read by the scanner 312 and print image data received from the data processing device 101 via the network 103. The ROM 304 stores the system boot program and other similar data. The hard disk drive (HDD) 305 stores the operating system, system software, application software, image data, and setting data.

[0027] The display / operation interface 306 is an interface unit with the display / operation unit 307, and outputs information to be displayed on the display / operation unit 307. It also receives information input by the user from the display / operation unit 307.

[0028] The display / operation unit 307 displays information to the user and accepts user input. This includes, for example, an operation panel such as a touch panel display or a hardware keyboard.

[0029] The network interface 308 is connected to the NFC communication unit 310, the BLE communication unit 311, and the wireless LAN communication unit 312, and performs various wireless communication controls with the data processing unit 101 and the cloud server 105. The wireless LAN communication unit 312 forms a wireless LAN with the data processing unit 101 via the network 103. The NFC communication unit and the BLE communication unit 311 also perform short-range wireless communication with the data processing unit 101 via wireless signals. The image forming apparatus 104 sends and receives job setting information and image data with the data processing unit 101 via the network interface 308, and executes jobs received from the data processing unit 101. Hereafter, the setting information assigned to a job will be referred to as job setting information. For example, for a print job, the setting information assigned to the print job, such as number of copies: 1, color setting: monochrome, and size: A4, will be referred to as job setting information.

[0030] The device interface 309 connects the scanner 313 and printer 314, which perform image data reading and printing, to the controller unit 301, and handles the input and output of image data.

[0031] Figure 4 is a block diagram showing the software configuration of the data processing device 101 according to this embodiment.

[0032] Application 401 is software executed by the CPU 202 of the data processing unit 101 and is stored in RAM 203, storage device 209, etc.

[0033] The user interface (UI) control unit 402 receives settings (job setting information) entered by the user via the touch panel 215 and transmits them to the job setting management unit 406 via the input control unit 208. The UI control unit 402 also receives responses from the job setting management unit 406 and the job control unit 407 and outputs the information to the display unit, i.e., the display 214, via the display control unit 207. Furthermore, the UI control unit 402 receives authentication information entered by the user via the touch panel 215 and transmits the received authentication information to the authentication setting management unit 403 via the input control unit 208.

[0034] The authentication settings management unit 403 transmits authentication information, such as user information, received from the UI control unit 402 to the network control unit 405. This authentication information is used in the authentication process in the image processing device 104, which will be described later, via the network 103. Alternatively, the authentication information, such as user information, may be stored in the authentication settings management unit 403.

[0035] The device connection unit 404 establishes short-range wireless communication between the data processing unit 101 and the image forming apparatus 104 using NFC or BLE, or wireless LAN communication via the network 103. For example, in the case of NFC, the user brings the NFC communication unit 210 of the data processing unit 101 and the NFC communication unit 310 of the image forming apparatus 104 close together to start short-range wireless communication. In the case of BLE, the user brings the BLE communication unit 211 of the data processing unit 101 and the BLE communication unit 311 of the image forming apparatus 104 closer together. When the radio wave strength of the BLE beacon received from the image forming apparatus 104 exceeds a certain value, the device connection unit 404 starts bidirectional short-range wireless communication. In this way, by the user performing an operation (called a touch operation) of bringing the NFC or BLE communication units of the data processing unit 101 and the image forming apparatus 104 close together, the device connection unit 404 obtains connection information (such as an IP address) necessary for wireless LAN communication from the image forming apparatus 104. The data processing unit 101 then uses the obtained connection information to start a wireless LAN connection with the image forming apparatus 104. Alternatively, even without short-range wireless communication, the image forming apparatus 104 and the data processing apparatus 101 may establish wireless LAN communication by having the data processing apparatus 101 read a QR code (registered trademark) indicating connection information displayed on the image forming apparatus 104.

[0036] The network control unit 405 transmits jobs (including job setting information, execution command instructions, image data, etc.) and user authentication information to the image forming apparatus 104 via the network 103. Furthermore, the network control unit 405 receives job setting information stored in the image forming apparatus 104 via the network 103.

[0037] The job setting management unit 406 stores job setting information entered by the user via the UI control unit 402, and job setting information received from the image forming apparatus 104 and the cloud server 105 via the network control unit 405, in the RAM 204 and storage device 209. At this time, the job setting management unit 406 manages this job setting information as "favorites," which are settings that the user frequently uses. In addition, the job setting management unit 406 manages job setting information that was pre-stored in the RAM 204 and storage device 209 during the installation of the application 401 as "presets."

[0038] The job control unit 407 generates job execution instruction information from the "favorites" and "presets" of job settings registered in the job setting management unit 406, and transmits the job execution instruction to the image forming apparatus 104 via the network 103. The job control unit 407 also acquires the job execution status and the operating status of the scanner 313 and printer 314 devices from the image forming apparatus 104 via the network 103 and transmits it to the UI control unit 402.

[0039] Figure 5 is a block diagram showing the software configuration of the image forming apparatus 104 according to this embodiment.

[0040] Application 501 is software executed by the CPU 302 of the image forming apparatus 104 and is stored in RAM 303, HDD 305, etc.

[0041] The user interface (UI) control unit 502 receives job setting information entered by the user via the display / operation unit 307 and transmits it to the job setting management unit 506. The UI control unit 502 also receives responses from the job setting management unit 506 and the job control unit 507 and outputs the information to the display / operation unit 307.

[0042] The authentication control unit 503 identifies the user, performs user authentication processing based on the authentication information received from the data processing device 101, and returns the result.

[0043] The device connection unit 504 performs short-range wireless communication between the data processing device 101 and the image forming apparatus 104, and establishes wireless LAN communication via the network 103.

[0044] The network control unit 505 receives jobs (job setting information, job execution instruction commands, image data) and user authentication information from the data processing device 101 via the network 103. Furthermore, the network control unit 505 transmits the job setting information stored in the image forming apparatus 104 to the data processing device 101 via the network 104.

[0045] The job setting management unit 506 stores job setting information entered by the user via the UI control unit 502, and job setting information received from the data processing unit 101 and cloud server 105 via the network control unit 505, in the RAM 303 and HDD 305. At this time, the job setting management unit 506 manages this job setting information as "favorites," which are settings frequently used by the user. In addition, the job setting management unit 406 manages the job setting information stored in the RAM 303 and HDD 305 during the installation of the application 501 as "presets." Furthermore, it manages the job setting information included in jobs executed by the image processing unit 104 as "history."

[0046] The job control unit 507 controls the scanning processing unit 511, the copying processing unit 512, the printing processing unit 513, and the fax processing unit 514 in response to the received job, and executes various jobs. At this time, the job control unit 507 executes jobs based on the job setting information set by the user on the display / operation unit 307 and the "favorites" and "preset" job setting information registered in the job setting management unit 506. Furthermore, the job control unit 507 receives job execution requests from the data processing unit 101 via the network 103 and executes various jobs according to the job setting information of the received job. The job control unit 507 also transmits the job execution status and the operating status of the scanner 313 and printer 314 devices to the data processing unit 101 via the network 103.

[0047] Figure 6 is a flowchart illustrating the connection process of the data processing device 101 to the image forming apparatus 104 in this embodiment. The flowchart in Figure 6 is realized when the CPU 202 of the data processing device 101 reads the programs for implementing each control module stored in the ROM 203 or storage device 209 into the RAM 204 and executes them.

[0048] In step S601, the UI control unit 402 detects a user instruction to search for an image forming apparatus.

[0049] In step S602, the device connection unit 404 searches for an image forming apparatus 104 supported by the application 401 on the network 103 via the wireless LAN terminal 102 using Wi-Fi (registered trademark), etc.

[0050] In step S603, if the image forming apparatus is not detected as a result of the search in step S602, the device connection unit 404 terminates the process. If the image forming apparatus is detected, it acquires the apparatus information (S604). Alternatively, it is also possible to acquire connection information such as the IP address by performing short-range wireless communication with the NFC or BLE equipped on the image forming apparatus 104, and then search for the image forming apparatus 104 using the acquired connection information to acquire the apparatus information. Here, the apparatus information is, for example, identification information such as the MAC address and apparatus name of the image forming apparatus, but it may also include capability information such as color information and supported format information.

[0051] In step S605, the device connection unit 404 starts connecting to the image forming apparatus 104 based on the acquired device information and terminates the process.

[0052] The data processing device 101, which has started to connect with the image forming apparatus 104, can use application 401 to instruct the image forming apparatus to perform jobs such as copying, printing, and sending scanned images. For example, the data processing device 101 accepts scan settings and destination settings for scanned images from the user on the touch panel 215, generates a job, and sends the job to the image forming apparatus. The image forming apparatus performs the scan based on the received job and sends the generated image data to the set destination. In other words, the user can remotely instruct the image forming apparatus to scan and send. However, when a user located far from the image forming apparatus instructs the apparatus to scan and send, there is a risk of accidentally scanning and sending a document that someone else has set in the image forming apparatus due to a misoperation. Furthermore, a malicious user could wait for the moment when someone else sets a document in the image forming apparatus and remotely instruct the data processing device to scan and send, thereby illegally obtaining and sending images of other people's documents. Therefore, in this embodiment, even when the data processing device 101 can instruct the image forming apparatus to execute a job, a method to prevent user errors and illegal job execution will be described. Specifically, when a job is sent from the data processing unit to the image forming machine, the image forming machine displays an authentication code on its display, and the user enters the displayed authentication code on their mobile device and sends the code to the image forming machine. If the received code is correct, the image forming machine executes the job. This ensures that the user has to verify by entering the authentication code before the job is executed. Furthermore, it guarantees that the user operating the data processing unit is in front of the image forming machine, preventing unauthorized execution of job instructions.

[0053] The job execution process performed by the data processing device 101 in this embodiment will be explained using Figures 7 and 8. Figure 7 is a flowchart illustrating the job execution process, which is realized when the CPU 202 of the data processing device 101 reads the programs for implementing each control module stored in the ROM 203 or storage device 209 into the RAM 204 and executes them. Figure 8 is an example of a screen displayed by the application 401 of the data processing device 101.

[0054] The function list screen 801 in Figure 8(a) is the menu screen for application 401. For example, this screen is displayed when application 401 is launched. If communication with the image forming apparatus has been established through the flowchart in Figure 6, the name of the apparatus to which the job will be sent is displayed, as shown in the apparatus name 808. Also displayed are a copy button 805 for instructing the image forming apparatus to make a copy, a print button 806 for instructing it to print, and a "Scan and Send" button 807 for instructing it to scan and send. Pressing any of these buttons displays the job settings screen. In addition, the function list screen 801 displays the favorites button 804 and preset buttons (803, 804) that the user has registered as favorites by setting desired job settings. Pressing these buttons displays the job settings screen with the desired settings reflected. As an example, the following flowchart will be explained using the case where the user selects the "Send to Myself" button 802, which instructs the scanned and generated image data to be sent to the user's own address.

[0055] In step S701, the UI control unit 402 receives a selection operation from the user using the "Send to Me" button 802 and displays the job setting screen (Figure 8(b)).

[0056] In step S702, the UI control unit 402 accepts job setting changes from the user on the email sending screen 811 in Figure 8(b). On the email sending screen 811 in Figure 8(b), the title field 812 displays the screen title and has a button to cancel the setting and return to the previous screen. The email address setting area 813 is an area for entering the recipient's email address using the soft keyboard. Pressing the address book launch button 814 launches the address book of the data processing device 101. When the user selects an email address in the address book, the selected email address is displayed in the email address setting area 813. Multiple email addresses can be set. Pressing the open button 815 switches to a screen display where CC, BCC, subject, body, and file name can be set, and input for each item becomes possible. The scan setting area 816 has buttons for setting scan settings when the image forming apparatus 104 scans, such as color settings and resolution, and settings can be changed by pressing each button.

[0057] In step S703, the UI control unit 402 determines whether it has received a job execution instruction from the user. If the job execution button 817 shown in Figure 8(b) is pressed, it determines that the job execution instruction has been received and proceeds to S704. If it has not received the instruction, it returns to S702.

[0058] In step S704, the device connection unit 404 retrieves user information, such as usernames and passwords, stored in the RAM 204 or storage device 209, and transmits it to the image forming apparatus 104. In other words, it requests remote authentication from the image forming apparatus 104. The image forming apparatus 104 to which the remote authentication request is made is the image forming apparatus that was connected in the connection process shown in Figure 6. Remote authentication is an authentication process to authorize the start of communication between the data processing device 101 and the image forming apparatus 104, and is different from local authentication, which will be described later.

[0059] In step S705, the device connection unit 404 determines whether remote authentication was successful. This determination is based on the response from the image forming apparatus 104 to the authentication request in S704. If remote authentication is unsuccessful, the UI control unit 402 displays an error screen on the display 214 (S706) and terminates the process. If remote authentication is successful, the job control unit 407 acquires operation control information (S707). Operation control information is information that ensures the image forming apparatus 104 only accepts instructions from the data processing device 101. When the image forming apparatus 104 receives a job containing operation control information from the data processing device 101, it is information that prevents it from executing any jobs other than the received job.

[0060] In step S708, the job control unit 407 generates a job based on the job setting information, user information, password, operation control information, etc., set in step S702, and sends the job to the connected image forming apparatus 104 to request job execution.

[0061] In step S709, if the job execution request in step S708 is unsuccessful, the job control unit 407 displays an error screen on the display 214 (S706) via the UI control unit 402 and terminates processing. For example, if the image forming apparatus 104 that received the job attempts local authentication using the user information contained in the job and fails to authenticate, resulting in an inability to log in, it is determined that the job execution request is unsuccessful. If the job execution request is successful, the process proceeds to step S710.

[0062] In step S710, the job control unit 407 determines whether it has received an instruction from the image forming apparatus 104 to display a screen prompting the placement of the original document, based on the fact that the job was sent in S708. If the instruction has been received, the process proceeds to S711; otherwise, it proceeds to S713.

[0063] In S711, the UI control unit 402 displays a screen prompting the user to place the document on the display 214. The screen prompting the user to place the document is, for example, like the one shown in Figure 8(c), and has a message prompting the user to place the document in the message area 821, as well as a cancel button 822 and a set complete button 823. Pressing the cancel button 822 cancels the job execution request. Pressing the set complete button 823 allows the user to proceed to the next process. In S712, the UI control unit 402 determines whether the set complete button 823 was pressed on the screen prompting the user to place the document. If it is determined that the button was pressed, the process proceeds to S710. Otherwise, i.e., if the cancel button 822 was pressed, the process terminates.

[0064] In step S713, the job control unit 407 determines whether it has received a request for an authentication code for the job sent in S708 from the image forming apparatus 104. If the request has been received, the process proceeds to S714; otherwise, the process terminates.

[0065] At S714, the UI control unit 402 displays an authentication code input screen and accepts the user's input of an authentication code. The authentication code input screen is, for example, as shown in Figure 8(d), and has an input field in the message area 831 where the authentication code can be entered, as well as a cancel button 832 and an OK button 833. In this embodiment, the authentication code is entered from the display / operation unit 307 of the image forming apparatus 104 into the input field in the message area 831, and the authentication code is sent by pressing the OK button 833. Pressing the cancel button 832 cancels the job execution request. Alternatively, instead of an authentication code, the image forming apparatus 104 may display a QR code, and the data processing device 101 may read the QR code with its camera 216 and send the acquired authentication code. If the image forming apparatus 104 displays a QR code, the data processing device 101 may be configured to automatically activate the camera.

[0066] In S715, the device connection unit 404 transmits the authentication code received in S714 to the image forming apparatus 104. Here, the device connection unit 404 may send the authentication code when the OK button 833 is pressed on the screen shown in Figure 8(d), or it may automatically send the authentication code after receiving a predetermined number of codes. If a QR code is read, the information extracted from the acquired QR code is transmitted.

[0067] In step S716, the job control unit 407 determines whether authentication was successful based on the authentication code sent in S715. Specifically, the determination is made based on the response from the image forming apparatus 104 to the transmission of the authentication code in S715. If authentication is successful, the process ends; otherwise, the process proceeds to S706 to display an error screen, or returns to S714. Through the processing of the above flowchart, the data processing device 101 cannot allow the image forming apparatus 104 to execute a job unless it inputs the authentication code displayed on the display / operation unit 307 of the image forming apparatus 104 and sends it to the image forming apparatus 104. Therefore, it is possible to prevent job execution due to user error or the execution of unauthorized jobs.

[0068] The job execution process of the image forming apparatus 104 in this embodiment will be explained using Figures 9 and 10. Figure 9 is a flowchart illustrating the job execution process, which is realized when the CPU 302 of the image forming apparatus 104 reads the programs for implementing each control module stored in the ROM 304 or HDD 305 into the RAM 303 and executes them. The following flow is assumed to begin when the image forming apparatus 104 receives the job sent in S708 of Figure 7. Figure 10 is an example of a screen displayed by the system software 501 of the image forming apparatus 104.

[0069] In step S901, the network control unit 505 receives a job sent from the data processing unit 101 via the network 103 and accepts a request to execute the job. The job received here is, for example, the job sent in step S708.

[0070] In step S902, the authentication control unit 503 extracts the operation control information contained in the received job and stores it in the RAM 303. At this time, although not shown in the diagram, if another job execution request has already been received and operation control information is available, the system may not accept the job execution request, notify the data processing unit 101 of the error information, and terminate the process.

[0071] In step S903, the authentication control unit 503 performs local authentication using the user information included in the job. If local authentication is successful, the user corresponding to the user information included in the job can log in to the image forming apparatus 104. This login is a local login to occupy the operation panel of the image forming apparatus 104.

[0072] In step S904, the authentication control unit 503 determines whether local authentication was successful. If local authentication is successful, the login process is performed and the process proceeds to step S907. If local authentication is unsuccessful, the operation control information stored in step S902 is discarded (S905), error information is sent to the data processing device 101 via the network control unit 505 (S906), and the process ends.

[0073] In S907, the job control unit 506 determines whether the job received in S901 is a "scan and send" job. If it is determined to be a "scan and send" job, the process proceeds to S908; otherwise, it proceeds to S912.

[0074] In step S908, the job control unit 506 determines whether a document to be scanned is placed on the scanner 313. If the placement of the document to be scanned cannot be detected, the UI control unit 502 displays a screen prompting the user to place the document on the display / operation unit 307, and the network control unit 505 sends instructions for the screen prompting the user to place the document to the data processing unit 101 (S909). The screen prompting the user to place the document is, for example, as shown in 1001 of Figure 10(a), and includes a message prompting the user to place the document, a cancel button 1002, and a set complete button 1003. Pressing the cancel button 1002 cancels the job execution request. The set complete button 1003 is used to notify the image forming apparatus 104 that the document has been placed, in cases where the image forming apparatus 104 does not automatically detect the document even after the user has placed the document. Pressing the set complete button 1003 allows the user to proceed to the next process. Here, an example is shown in which the screen prompting the user to place the document is displayed on both the display / operation unit 307 and the data processing unit 101 of the image forming apparatus, but it may be displayed on only one of them.

[0075] If S908 detects the placement of a scanner document, S910 causes the job control unit 506 to generate an authentication code, and the UI control unit 502 displays a screen on the display / operation unit 307 showing information corresponding to the generated authentication code. The screen displaying information corresponding to the authentication code is, for example, as shown at 1011 in Figure 10(b), and includes a message displaying the authentication code and a cancel button 1012. Pressing the cancel button 1012 cancels the execution of the job. In the example in Figure 10(b), the authentication code is displayed as a number, but it can also be displayed as text, or the information corresponding to the authentication code can be displayed in QR code format. In other words, the generated authentication code can be encrypted to generate a QR code, which can then be displayed.

[0076] In step S911, the job control unit 506 determines whether or not it has received an authentication code from the data processing device 101 via the network 103. If an authentication code has been received, it proceeds to S912; otherwise, it repeats the process in S911. In S912, the job control unit 506 determines whether or not the authentication code received in S911 is correct. Specifically, it determines that the authentication code is correct if the authentication code received from the data processing device 101 matches the authentication code displayed on the display / operation unit 307. At this time, if the authentication code displayed on the display / operation unit 307 is received from a device other than the data processing device 101 that sent the job, it is treated as an error.

[0077] If the authentication code in S912 is correct, proceed to step S913; otherwise, notify the data processing unit 101 of the error and proceed to S914. At this point, it may be possible to return to S911 or proceed to S905.

[0078] In step S913, the job control unit 506 executes the job based on the job configuration information obtained in step S901. In this embodiment, the job configuration information includes scan settings for performing a scan and the recipient to whom the scanned image will be sent via email. Based on this information, the scan is performed and the image is sent via email to the specified recipient. Once the job execution is complete, information indicating completion may be notified to the data processing device 101. In this embodiment, the function of sending an email has been described, but this is just one example, and it may also be performed using functions such as copying or faxing.

[0079] In step S913, the authentication control unit 503 discards the operation control information saved in step S902 and terminates the process.

[0080] The above flowchart ensures that the image forming apparatus executes the scan and send job only when it receives correct authentication information from the data processing device, thus preventing incorrect or fraudulent job execution due to user error. While the flowchart above shows an example where an authentication code is requested from the data processing device when executing a "scan and send" job, the request for an authentication code is not limited to "scan and send" jobs; it can also be for other jobs such as print or copy jobs. For jobs other than "scan and send," the system proceeds to No at S907 and does not request the input of an authentication code. This is because print and copy jobs do not have the potential for fraudulent transmission of documents.

[0081] As described above, according to this embodiment, when the data processing device 101 sends a job execution instruction to the image forming apparatus 104 to request job execution, an authentication code is displayed on the image forming apparatus 104, and the data processing device 101 inputs and transmits the authentication code to execute the job. At this time, the job is executed only if the authentication code transmitted by the data processing device 101 satisfies predetermined conditions. This prevents incorrect or unauthorized execution of user jobs, and since the operation is completed solely by the data processing device, user usability is improved. Even for users who are reluctant to operate equipment shared by multiple users, such as an image forming apparatus, processing can be executed solely by operating the user's data processing device, improving usability.

[0082] (Example 2) In Example 1, when a data processing device requests job execution from the image forming apparatus, the image forming apparatus automatically performs local authentication using user information included in the job, displays an authentication code, and then executes the job after receiving the authentication code from the data processing device. This method requires displaying the authentication code each time a job is executed. Therefore, Example 2 shows an example where the user is not prompted to enter an authentication code if they are already logged into the image forming apparatus before the user sends the job from the data processing device. The basic configuration of Example 2 is the same as in Example 1, so only the differences are shown.

[0083] Figure 11 is a flowchart illustrating the job execution process performed by the image forming apparatus 104 in Example 2. Since the basic process is the same as in Figure 9, only the differences are shown.

[0084] In step S1101, the authentication control unit 503 determines whether a user is logged into the image forming apparatus 104. If the user is not logged in, the process proceeds to step 903; if the user is logged in, the process proceeds to step S1102.

[0085] In step S1102, the authentication control unit 503 determines whether the user information extracted from the job is the same as the currently logged-in user. If it is determined that they are the same user, the process proceeds to step S907. If it is not determined that they are the same user, the process proceeds to step S905. If the process proceeds to S907, the image forming apparatus 104 executes the job in S913 without displaying an authentication code on the screen. In other words, if the user who submitted the job and the already logged-in user are the same, the user is not asked to enter a code to execute the job. If the user who instructed the execution of the job at the terminal is the same as the user already logged into the image forming apparatus, the image forming apparatus does not ask for an authentication code to execute the job, so the user does not need to perform any unnecessary code input operations.

[0086] (Example 3) This embodiment shows an example where, when a job is received from the data processing device, the authentication code is not displayed if the display of the image forming apparatus is being remotely controlled by another device. If the authentication code is displayed when the operation panel of the image forming apparatus is being remotely controlled, there is a risk that the authentication code may be illegally obtained. Therefore, Embodiment 3 describes a method for switching the processing to display or not display the authentication code depending on whether or not the operation panel of the image forming apparatus is being remotely controlled. The basic configuration is the same as in Embodiment 1, so only the differences are shown.

[0087] Figure 12 shows a flowchart illustrating the processing in this embodiment. The basic structure of the flowchart in Figure 12 is the same as that of the flowchart in Figure 9, so only the differences are shown.

[0088] If the job control unit 506 determines in S907 that the received job is a "scan and send" job, instead of proceeding to S908, in S1202 the network control unit 505 determines whether the display / operation unit 307 of the image forming apparatus 104 is being remotely controlled by another device. Remote control means, for example, that the operation panel of the image forming apparatus 104 is being remotely controlled from an external device using VNC (Virtual Network Computing) with the RFB protocol. If it is not being remotely controlled, the process proceeds to S908; if it is being remotely controlled, the process proceeds to S905 and S906 to notify the data processing device 101 of the error.

[0089] Here, after S907, the network control unit 505 determines whether the display / operation unit 307 of the image forming apparatus 104 is being remotely controlled by another device, but this is not limited to this configuration. For example, as shown in Figure 12, after S902, in S1201, the network control unit 505 determines whether the display / operation unit 307 of the image forming apparatus 104 is being remotely controlled by another device. If it is being remotely controlled, the process proceeds to S905; otherwise, it proceeds to S903. Figure 12 shows an example where the network control unit 505 has two steps to determine whether the display / operation unit 307 of the image forming apparatus 104 is being remotely controlled by another device, but only one of these steps is also acceptable.

[0090] Through the above process, if the control panel of the image processing device is being remotely controlled, even if the image processing device receives a scan and transmission job from the data processing device, the image processing device will not display an authentication code on the control panel and will not execute the job, thus ensuring security.

[0091] (Example 4) In Example 1, when a job execution request was sent from the data processing device 101 to the image forming apparatus 104, the image forming apparatus automatically performed a login process using user information included in the job, and then determined whether the document had been placed and displayed an authentication code. This method had the problem that, after the login process, the user was prompted to place the document and enter the authentication code, resulting in a long time for the user to log in to the image forming apparatus 104 and occupy the control panel. Therefore, in this example, we will describe a method in which the image forming apparatus 104 determines whether the document has been placed and displays an authentication code after receiving a job, and then performs the login process. The basic configuration of Example 4 is the same as in Example 1, so only the differences are shown.

[0092] Figure 13 is a flowchart illustrating the job execution process performed by the image forming apparatus 104 in Example 4. Since the basic process is the same as in Figure 9, only the differences are shown.

[0093] In step S1301, the authentication control unit 503 obtains user information included in the received job and verifies whether the obtained user information matches and is correct to the information in the user information managed by the image forming apparatus 104.

[0094] In step S1302, if the user information matches the user information managed by the image forming apparatus 104, the process proceeds to step S907; otherwise, the authentication information is invalid, and the process proceeds to step S905.

[0095] In step S1303, the authentication control unit 503 performs local authentication using the user information obtained in step S1301 and executes the user's local login process. Here, it is determined in S912 whether the authentication code received from the data processing device 101 is correct, and the local login process is performed only if it is correct. Since the user information check is performed in step S1301, local authentication will not fail in this step.

[0096] As described above, when a job execution request is sent from the data processing device to the image forming device, the image forming device checks whether the original document has been placed and verifies the authentication code before executing the login process. This minimizes the time that the operation panel of the image forming device 104 is occupied by the login process. Furthermore, since S1301 checks whether the user information is correct before checking whether the original document has been placed and verifying the authentication code, it prevents users who are not qualified to execute the job from entering the authentication code in the first place.

[0097] Here, as a variation of Example 1, we show a configuration that determines whether the document has been installed and displays an authentication code before performing the login process. This configuration can also be applied to Examples 2 and 3.

[0098] (Other examples) The present invention can also be realized by performing the following process: supplying software (programs) that realize the functions of the embodiments described above to a system or device via a network or various storage media, and having the computer (or CPU, MPU, etc.) of that system or device read and execute the program. In this case, the computer program and the storage medium storing the computer program constitute the present invention.

Claims

1. A system including a mobile terminal and an image processing device, The aforementioned mobile device is With a wireless LAN communication connection established between the image processing device and the mobile terminal, after the mobile terminal receives an instruction operation to instruct the image processing device to execute a job to transmit scanned and generated images, an acquisition means acquires information regarding the display content displayed on the display means of the image processing device. The system includes an execution request based on the aforementioned instruction operation, which requests the image processing device to execute a job to transmit the scanned and generated image, and a transmission control means that controls the transmission of transmission information based on the information acquired by the acquisition means. The aforementioned image processing device is A display control means that controls the display content indicating authentication information to be displayed on the display means, When the transmission information transmitted by the control of the transmission control means satisfies predetermined conditions, an execution means executes a job corresponding to the execution request, It has, The aforementioned predetermined conditions are not met if the transmitted information does not contain information indicating the authentication information. A system characterized by the following features.

2. The system according to claim 1, characterized in that, when a document to be scanned is placed in the image processing device and a job corresponding to the execution request is executed based on the transmission information transmitted by the control of the transmission control means, the job corresponding to the execution request is executed even if there is no user operation on the image processing device after the mobile terminal has transmitted the execution request.

3. The system according to claim 1 or 2, characterized in that the mobile terminal has display processing means for controlling the display of the mobile terminal to show a specific screen including a first operation item for receiving the instruction operation.

4. The system according to claim 3, further characterized in that the specific screen displays an address display area showing the email address set as the destination to which the scanned image is to be sent.

5. The aforementioned specific screen also displays a second operation item, which is different from the first operation item. When the second operation item is operated, the address book is displayed, and the email address selected in the displayed address book is displayed in the address display area. The system according to feature 4.

6. The system according to any one of claims 3 to 5, further characterized in that the specific screen displays a setting area for accepting operations to set at least one item related to the scanning and transmission process, such as color settings, resolution, and file format.

7. The system according to any one of claims 3 to 6, further characterized in that the display processing means processes to display an error screen on the display when the transmitted information does not satisfy the predetermined conditions.

8. The system according to any one of claims 1 to 7, characterized in that the display control means controls the display content to be displayed after receiving the execution request transmitted by the transmission control means.

9. The system according to any one of claims 1 to 8, characterized in that the displayed content is a representation of the authentication information in the form of at least one of a number and characters.

10. The system according to claim 9, characterized in that the acquisition means acquires information regarding the display content based on an input operation from the user of at least one of a number and a character.

11. The system according to any one of claims 1 to 8, characterized in that the displayed content is a QR code (registered trademark).

12. The mobile terminal further includes control means for controlling the activation of the mobile terminal's camera in order to read the QR code displayed on the display means. The system according to claim 11, characterized in that the acquisition means acquires information extracted by the mobile terminal as information relating to the display content by reading the QR code with the camera which is activated by the control means.

13. The system according to any one of claims 1 to 12, characterized in that the display control means displays an error screen when the image processing device receives the execution request and no document is placed in the scanner of the image processing device.

14. The system according to any one of claims 1 to 13, characterized in that when the image processing device receives the execution request, if no document is placed in the scanner of the image processing device, an error screen is displayed on the display of the mobile terminal.

15. The system according to any one of claims 1 to 14, characterized in that the display control means does not perform control to display the display content when the image processing device receives the execution request and no document is placed in the scanner of the image processing device.

16. The system according to any one of claims 1 to 15, characterized in that the display control means does not perform control to display the display content when the image processing device receives the execution request and the user of the mobile terminal is logged into the image processing device.

17. The system according to any one of claims 1 to 16, characterized in that the image processing device does not execute the job corresponding to the execution request if the display means of the image processing device is being remotely controlled when the image processing device receives the execution request.

18. The system according to any one of claims 1 to 17, wherein the image processing device is used to establish a wireless LAN communication connection with the image processing device, and is capable of displaying a specific QR code from which connection information of the image processing device can be extracted, and the displayed content is not the specific QR code.

19. A mobile terminal capable of instructing an image processing device to send scanned and generated images, With a wireless LAN communication connection established between the image processing device and the mobile terminal, after the mobile terminal receives an instruction operation to instruct the image processing device to execute a job to transmit scanned and generated images, an acquisition means acquires information regarding the display content displayed on the display means of the image processing device. The system includes an execution request based on the aforementioned instruction operation, which requests the image processing device to execute a job to transmit the scanned and generated image, and a transmission control means that controls the transmission of transmission information based on the information acquired by the acquisition means. The display content indicating authentication information is displayed on the display means. When the transmission information transmitted by the control of the transmission control means satisfies predetermined conditions, the job corresponding to the execution request is executed in the image processing device. The aforementioned predetermined conditions are not met if the transmitted information does not contain information indicating the authentication information. A mobile device characterized by the following features.

20. An image processing device capable of executing a job that transmits images generated by scanning based on an execution request from a mobile device, A display control means that controls the display content indicating authentication information to be displayed on the display means of the image processing device, An execution means that executes a job corresponding to the execution request when the transmission information sent from the mobile terminal satisfies predetermined conditions, It has, With a wireless LAN communication connection established between the image processing device and the mobile terminal, after the mobile terminal receives an instruction operation to instruct the image processing device to execute a job to transmit scanned and generated images, information regarding the display content displayed on the display means of the image processing device is acquired by the mobile terminal. An execution request based on the aforementioned instruction operation, which requests the image processing device to execute a job to transmit the scanned and generated image, and the transmission information based on the acquired information are transmitted from the mobile terminal. The aforementioned predetermined conditions are not met if the transmitted information does not contain information indicating the authentication information. An image processing apparatus characterized by the following:

21. A program for causing the computer of a mobile terminal to function as each of the means of a mobile terminal included in the system described in any one of claims 1 to 18.

22. A program for causing the computer of an image processing device to function as each of the means of the image processing device included in the system described in any one of claims 1 to 18.

23. A computer-readable storage medium on which the program described in claim 21 or 22 is stored.

Images