Information processing device, method for controlling the information processing device, and program

Abstract

This invention provides an information processing device, a control method for the information processing device, and a program that enable improved security in information processing devices. [Solution] In a communication system in which a communication device, an MFP, and a job management server communicate via a network, the MFP, which is an information processing device, includes an imaging control unit that controls the acquisition of images of the surrounding area, and a login management unit that detects face information from images acquired according to the control of the imaging control unit, and controls the login of the information processing device as a registered user if it satisfies a first condition that the detected face information matches the face information of a registered user that has been registered in advance, and a second condition that it is presumed that the registered user whose face information matches will use the information processing device.

Description

Technical Field

[0006] ,

[0004] , , , , ,

[0005] , , , , ,

[0003] , , , , , ,

[0001] The present disclosure relates to an information processing apparatus, a control method for the information processing apparatus, and a program.

Background Art

[0002] In recent years, when logging in to an image forming apparatus, which is a type of information processing apparatus, a technique of using face authentication for logging in has been proposed (Patent Document 1). In Patent Document 1, a technique of logging in to an image forming apparatus using face authentication without performing a screen operation is disclosed by utilizing the fact that face authentication is an authentication method that can be executed even without contact.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] [Figure 1] This is a diagram showing an example of a communication system configuration. [Figure 2] This is a block diagram showing an example of the hardware configuration of a communication device. [Figure 3] This is a block diagram showing an example of the software configuration of a communication device. [Figure 4] This is a block diagram showing an example of an MFP hardware configuration. [Figure 5] This is a diagram showing an example of an MFP software configuration. [Figure 6] This flowchart shows an example of a process performed in a communication device. [Figure 7] This figure shows an example of the settings screen for a job submission application. [Figure 8] This figure shows an example of a job management table. [Figure 9] This flowchart shows an example of the processes performed in MFP. [Figure 10] This figure shows an example of a user management table. [Figure 11] This flowchart shows an example of the processes performed in MFP. [Figure 12] This figure shows an example of a scan screen. [Figure 13] This figure shows an example of an address book table. [Figure 14] This figure shows an example of a favorites settings management table. [Modes for carrying out the invention]

[0008] Preferred embodiments of this disclosure will be described in detail below with reference to the attached drawings. Note that the following embodiments are not limiting to the scope of this disclosure, and not all combinations of features described in the following embodiments are essential to the solutions of this disclosure. The same reference numerals are used for identical components.

[0009] <<First Embodiment>> <Overview> This embodiment describes an example of improving security in an information processing device. In information processing devices, login is performed using facial recognition. As mentioned above, there is also a technology that uses facial recognition for login in an image forming apparatus, which is a type of information processing device. Facial recognition is a method that identifies an individual based on feature quantities extracted from the position and size of the eyes, nose, and mouth on the face, and uses this for authentication.

[0010] If a technology is used that allows users to log in to an image-forming device using facial recognition without screen operation, even a user who simply passes by the device may unintentionally log in. In that case, there is a risk that the image-forming device could be misused by a malicious third party.

[0011] Therefore, in this embodiment, we will explain an example in which users who are determined to be highly likely to use an image forming apparatus are selected as targets for automatic facial recognition login, thereby preventing unintended logins and reducing security risks.

[0012] <Structure> FIG. 1 is a diagram showing an example of the configuration of the communication system in the present embodiment. The communication system includes a communication device 110, a MFP (Multi-Function Printer) 120, and a job management server 130. The communication device 110, the MFP 120, and the job management server 130 communicate with each other via a network 100. In the example of FIG. 1, the communication device 110, the MFP 120, and the job management server 130 connected to the network 100 are each assumed to be one unit, but they may be multiple units. The communication device 110 is configured to be able to install applications. The MFP 120 can communicate with the job management server 130 to transmit and receive jobs and execute processes such as printing and scanning. The job management server 130 manages jobs input from the communication device 110 to the MFP 120. In the present embodiment, the job is treated as a print instruction, but the job may be a scan instruction, a copy instruction, or a FAX instruction.

[0013] FIG. 2 is a block diagram showing an example of the hardware configuration of the communication device 110. The communication device 110 in the present embodiment assumes an information processing device such as a PC, a smartphone, or a tablet, but other devices may be used as long as they can communicate with the network 100. The communication device 110 includes a CPU 201, a ROM 202, a RAM 203, an HDD 204, an input unit 205, a display unit 206, and a communication unit 207.

[0014] The CPU 201 reads out the control program stored in the ROM 202 and executes various processes for controlling the operation of the communication device 110. The ROM 202 stores the control program. The RAM 203 is used as the main memory of the CPU 201 and a temporary storage area such as a work area. The HDD 204 stores an operating system, system software, applications, and various data such as photos and electronic documents. The HDD 204 can use any storage device as long as it can store data. For example, as the HDD 204, other storage devices such as an SSD (Solid State Drive), an SD memory card, or an eMMC (embedded Multi Media Card) may be used.

[0015] The input unit 205 receives an input to the communication device 110. In the present embodiment, the communication device 110 includes the input unit 205, but the input unit 205 may be provided in a terminal external to the communication device 110. The display unit 206 displays various screens. In the present embodiment, the input unit 205 and the display unit 206 are described as separate configurations, but the input unit 205 and the display unit 206 may be integrally configured, such as a touch panel capable of detecting a user's touch operation. The communication unit 207 executes communication using the network 100. The configuration shown in FIG. 2 is merely an example, and it may not have a part of the configuration shown in FIG. 2, or may have a configuration other than the configuration shown in FIG. 2.

[0016] FIG. 3 is a block diagram showing an example of the software configuration of the communication device 110. FIG. 3 is a functional block diagram of software realized by the CPU 201 reading out the control program stored in the ROM 202 or the HDD 204. The communication device 110 has a job submission application 301. The job submission application 301 can create a job executable on the MFP 120 and transmit it to the job management unit 504 or the job management server 130 of the MFP 120 described later. In the communication device 110, various other applications are also available, but the description thereof is omitted.

[0017] Figure 4 is a block diagram showing an example of the hardware configuration of the MFP120. In this embodiment, the MFP120 is a multifunction device having a printer 421 and a scanner 422, but it may also be a device having either the printer 421 or the scanner 422. Furthermore, in this embodiment, the MFP120 is used as an example of an information processing device for explanation, but the information processing device in this embodiment does not necessarily have to be an image processing device like the MFP120. Any device to which a camera 423 can be connected will suffice.

[0018] The MFP120 includes a control unit 410, an operating unit 420, a printer 421, and a scanner 422. The control unit 410 includes a CPU 411, ROM 412, RAM 413, HDD 414, operating unit I / F 415, printer I / F 416, scanner I / F 417, USB I / F 418, and network I / F 419.

[0019] The control unit 410, including the CPU 411, controls the operation of the entire device. The CPU 411 reads control programs stored in the ROM 412 or HDD 414 and executes various control processes. The RAM 413 is used as the main memory for the CPU 411 and as a temporary storage area such as the work area. The HDD 414 stores various programs and data.

[0020] The operation unit interface 415 connects the operation unit 420 and the control unit 410. The operation unit 420 displays screen information output from the control unit 410 and accepts user input. In Figure 4, the operation unit 420 has a liquid crystal display unit with touch panel functionality, making the operation unit 420 an integrated unit like a touch panel capable of detecting user touch operations; however, the operation unit 420 and the display unit may be configured separately. The printer interface 416 connects the printer 421 and the control unit 410. The scanner interface 417 connects the scanner 422 and the control unit 410.

[0021] The USBI / F418 connects the camera 423, which is connected externally to the MFP120, to the control unit 410. The camera 423 is a webcam, network camera, or smartphone camera, and captures images and videos (hereinafter collectively referred to as "peripheral images") of the area around the MFP120. In this embodiment, the explanation assumes that a USB device conforming to the UVC (USB Video Class) standard is used as the camera 423. UVC is a camera driver provided by the OS and has an interface for using a webcam via system calls. In the example shown in Figure 4, the MFP120 and camera 423 are shown as separate devices, but the camera 423 may be built into the MFP120. The networkI / F419 connects the control unit 410 to the network 100.

[0022] Figure 5 is a block diagram showing an example of the software configuration of the MFP120. The CPU 411 reads the program stored in the MFP120's HDD 414 into the RAM 413 and executes it, so that the CPU 411 functions as the various parts shown in Figure 5 and performs the processing described later. The MFP120 has a login management unit 501, a screen display unit 502, an imaging control unit 503, and a job management unit 504.

[0023] The login management unit 501 performs the processing of user authentication in the MFP120. The authentication methods of the login management unit 501 include entering an ID and password, IC card authentication, and facial recognition using the camera 423. The screen display unit 502 performs the processing of displaying various screens on the operation unit 420. The screen display unit 502 also displays buttons for calling up applications (hereinafter referred to as app buttons) on the menu screen. App buttons are buttons for calling up various functions such as applications installed on the MFP120. The imaging control unit 503 controls the acquisition of images of the MFP120's surroundings using the camera 423. The imaging control unit 503 uses the UVC interface for imaging using the camera 423. The job management unit 504 performs the processing of receiving jobs submitted from the communication device 110, as well as processing of referencing jobs held by the job management server 130.

[0024] Figure 6 is a flowchart showing an example of processing performed in the communication device 110 in this embodiment. The processing shown in Figure 6 is realized by the CPU 201 of the communication device 110 functioning as the job submission application 301 shown in Figure 3, as described above. That is, the flowchart in Figure 6 is realized by the CPU 201 reading a program stored in the ROM 202 or HDD 204, etc., into the RAM 203 and executing it. Note that some or all of the functions of the steps in Figure 6 may be realized by hardware such as an ASIC or electronic circuit. The symbol "S" in the description of each process means that it is a step in the flowchart (the same applies to flowcharts in this specification hereafter).

[0025] Figure 7 shows an example of the settings screen 700 for the job submission application 301. The following explanation will use Figures 6 and 7. The flowchart in Figure 6 shows an example of the process from when the job submission application 301 in the communication device 110 submits a job to the job management unit 504 of the MFP 120 or the job management server 130. The flowchart in Figure 6 is initiated when the user starts the settings screen 700 for the job submission application 301 shown in Figure 7.

[0026] The job submission application 301 can configure the jobs to be submitted to the MFP 120. In this embodiment, a print job is used as an example, but the type of job that the job submission application 301 submits to the MFP 120 may be a job other than printing, such as copying or scanning.

[0027] As shown in Figure 7, the settings that can be submitted by the job submission application 301 include color settings 701, paper size settings 702, single-sided / double-sided settings 703, and magnification 704. Note that these settings are just examples, and other settings may exist. The automatic facial recognition login setting 705 is an item that enables or disables automatic facial recognition login on the MFP120. In the example in Figure 7, if the checkbox for automatic facial recognition login setting 705 is checked, the automatic facial recognition login setting is enabled. When the automatic facial recognition login setting is enabled, the user can automatically log in to the MFP120 using facial recognition. In other words, if the user submits a job using the job submission application 301 from a location away from the MFP120, and then moves closer to the MFP120, the MFP120 will perform the automatic facial recognition login process. Details of automatic facial recognition login will be described later.

[0028] The job registration button 706 is used to submit a job created by the job submission application 301 to the job management unit 504 of the MFP120 or the job management server 130. The job created by the job submission application 301 is created based on the setting items 701 to 704 and the automatic facial recognition login setting 705. When the user presses the job registration button 706, the job submission application 301 submits the job to the destination. Note that the explanation of how to select the destination is omitted as it is not the main focus of this embodiment.

[0029] The process will be explained using the flowchart in Figure 6. In S601, the job submission application 301 accepts the job settings made by the user using the settings screen 700. When the job submission application 301 receives confirmation that the job registration button 706 has been pressed on the settings screen 700, it accepts the settings configured in the settings item.

[0030] Next, in S602, the job submission application 301 determines whether the automatic facial recognition login setting 705 is enabled or disabled. If it determines that the automatic facial recognition login setting 705 is enabled, the job submission application 301 proceeds to S603; otherwise, it proceeds to S604.

[0031] In S603, the job submission application 301 enables the automatic facial recognition login setting for jobs. Next, in S604, the job submission application 301 submits the job to the job management unit 504 of the MFP120 or the job management server 130. Then, the job submission application 301 completes the process shown in the flowchart in Figure 6. Thus, in the process shown in the flowchart in Figure 6, if the automatic facial recognition login setting is enabled, a job with automatic facial recognition login enabled is submitted. On the other hand, if the automatic facial recognition login setting is not enabled, a job with automatic facial recognition login disabled is submitted. The submitted jobs are managed in the job management table 800 stored in the MFP120 or the job management server 130.

[0032] Figure 8 shows an example of a job management table 800 stored in the MFP120 or job management server 130. The job ID 801 is a unique value used to identify a job within the job management table 800. The username 802 is the name of the user who submitted the job. The job type 803 is the type of job that was submitted. The automatic facial recognition login setting 804 is a value indicating whether automatic facial recognition login is enabled, as set in the automatic facial recognition login setting 705 in S603. That is, a job for which the automatic facial recognition login setting 804 is enabled is a job that has been set to enable login using facial recognition. The job setting 805 is the value set in setting items 701 to 704, which were accepted in S601 along with the automatic facial recognition login setting 705. The print data 806 is the data to be printed. The submission date and time 807 is the date and time the job was submitted in S604. Jobs managed in job management table 800 are deleted from job management table 800 once their execution is complete.

[0033] Figure 9 is a flowchart illustrating an example of the processing performed in the MFP120 in this embodiment. The processing shown in Figure 9 is realized by the CPU 411 of the MFP120 functioning as the various functional units shown in Figure 5, as described above. Specifically, the flowchart in Figure 9 is realized by the CPU 411 reading a program stored in the ROM 412 or HDD 414, etc., into the RAM 413 and executing it. Note that some or all of the functions in the steps in Figure 9 may be implemented by hardware such as an ASIC or electronic circuit.

[0034] Figure 9 is a flowchart illustrating an example of the process by which the login management unit 501 performs automatic facial recognition login in the MFP120. The flowchart in Figure 9 is initiated when the login management unit 501 determines that the MFP120 is not logged in. For example, this could occur when a user logs out of the MFP120. Alternatively, it could occur when the MFP120 is powered on and starts up or returns from standby. The process in the flowchart in Figure 9 is repeated whenever the MFP120 is determined to be not logged in. If a login to the MFP120 occurs using a method other than automatic facial recognition login, the MFP120 is no longer not logged in, and the process in the flowchart in Figure 9 terminates at that point.

[0035] In S901, the login management unit 501 checks if camera 423 is connected to USBI / F418. If it is not connected, the login management unit 501 returns to S901; if it is connected, the login management unit 501 proceeds to S902.

[0036] In S902, the login management unit 501 determines whether a job with facial recognition automatic login settings has been submitted. That is, the login management unit 501 determines whether there is a job in the job management table 800 in which the automatic facial recognition login setting 804 is enabled. As mentioned above, the job management table 800 can exist in either the MFP 120 or the job management server 130, and if there is a job in either of which in which the automatic facial recognition login setting 804 is enabled, the result in S902 is YES. If the login management unit 501 determines that there is a job in which the automatic facial recognition login setting 804 is enabled, it proceeds to S903, and if it determines that there is no such job, it returns to S901.

[0037] In S903, the login management unit 501 controls the imaging control unit 503 to capture peripheral images. The imaging control unit 503 captures peripheral images by using the UVC interface with the camera 423. As mentioned above, the process in the flowchart of Figure 9 is repeated until login is performed, so the capture of peripheral images in S903 is also repeated until login is performed. In other words, imaging by the camera 423 is repeated at regular or irregular intervals. Also, as explained in the trigger for starting the process in the flowchart of Figure 9, the process in Figure 9 is triggered when the MFP120 is not logged in. For this reason, the imaging control unit 503 captures peripheral images without accepting user input to the operation unit 420 of the MFP120.

[0038] In S904, the login management unit 501 determines whether a face exists in the image captured in S903. If the login management unit 501 determines that a face exists, it proceeds to S905; otherwise, it returns to S901. Note that the method for detecting faces in images is publicly known, so an explanation is omitted.

[0039] In S905, the login management unit 501 extracts facial features from the faces present in the image captured in S903. If multiple faces are present in the image, facial features are extracted from the face with the largest area in the image. The extraction of facial features utilizes the position and size of the eyes, nose, and mouth. The method for extracting facial features is also a well-known technique, so a detailed explanation is omitted.

[0040] Next, in S906, the login management unit 501 queries the user management table with the facial features extracted in S905.

[0041] Figure 10 shows an example of the user management table 1000. The user management table 1000 is a table stored on the HDD414 of the MFP120, etc. User ID 1001 is a unique value in the user management table 1000. Username 1002 is a name that represents the logged-in user, and is the username required when logging in to the login management unit 501. Username 1002 can be set for each logged-in user. Password 1003 is the password used to log in to the login management unit 501. Password 1003 can be set for each logged-in user. Face feature quantity 1004 is the face feature quantity of the logged-in user that has been registered in the login management unit 501 in advance.

[0042] In S907, the login management unit 501 determines whether it was able to identify a user corresponding to the captured face, based on the results of the query with the user management table 1000 in S906. That is, the login management unit 501 compares the face features extracted in S905 with the face features included in the user management table 1000 to determine if a corresponding face feature exists. If a corresponding feature exists, the login management unit 501 identifies the user with that corresponding face feature in the user management table 1000 as the user corresponding to the captured face. If the login management unit 501 determines that a user has been identified, it proceeds to S908; otherwise, it returns to S901.

[0043] In S908, the login management unit 501 determines whether the user identified in S907 has submitted a job. For example, the login management unit 501 identifies the username 1002 of the user identified in S907. Then, the login management unit 501 checks the job management table to see if there is a username 802 that matches the identified username 1002. If there is a username 802 that matches username 1002, the login management unit 501 determines that the user identified in S907 has submitted a job. If the login management unit 501 determines that the user has submitted a job, it proceeds to S909; if it determines that the user has not submitted a job, it returns to S901. If the user identified in S907 has submitted a job, it is presumed that that user is likely to use the MFP120.

[0044] In S909, the login management unit 501 determines whether the automatic facial recognition login setting 804 is enabled for the job that was determined to have been submitted in S908. If it determines that the automatic facial recognition login setting 804 is enabled, the login management unit 501 proceeds to S910; otherwise, it returns to S901.

[0045] In S910, the login management unit 501 refers to the job management table 800 and confirms the submission date and time 807 of the job that was determined to have been submitted in S908. The login management unit 501 then determines whether the time elapsed since the job was submitted is below a threshold. The threshold can be any value, but for example, it can be set to 30 minutes. If the login management unit 501 determines that the time elapsed since the job was submitted is below the threshold, it proceeds to S911; otherwise, it returns to S901. If a certain amount of time (corresponding to the threshold) has already elapsed since the job was submitted, it is possible that the user submitted the job but no longer needs to execute it, or that they have forgotten to submit the job. In other words, it is considered unlikely that the user will consciously log in to the MFP120. Therefore, to prevent such users from logging in unintentionally, if a certain amount of time has elapsed since the job was submitted, the processing of the flowchart in Figure 9 is repeated. Alternatively, processing in which S910 is skipped and the process proceeds to S911 after S909 may be adopted. In other words, it is not necessary to perform a determination using the job submission date and time.

[0046] In S911, the login management unit 501 logs in to the MFP120 as the user identified in S907. The MFP120 may also automatically execute the identified user's jobs in the job management table 800 after logging in. That is, further job execution may occur in S911. Then, the login management unit 501 completes the process shown in the flowchart in Figure 9.

[0047] As described above, this embodiment makes it possible to improve security in an information processing device. For example, an image forming apparatus, which is an information processing device, determines that only users who are likely to use the image forming apparatus are subject to automatic facial recognition login. That is, login control is performed not only when the first condition that the facial features detected from the captured image match those of the registered user, but also when the second condition that the registered user is presumed to use the image forming apparatus is met. This prevents users from unintentionally logging into the image forming apparatus using automatic facial recognition, thereby reducing security risks.

[0048] <<Second Embodiment>> In the first embodiment, as described in the processing of S909, an example was described in which automatic facial recognition login is performed in the MFP120 based on the fact that the automatic facial recognition login setting is enabled for a job that has already been submitted. However, it is also conceivable that a job that a user intends to perform, such as a scan, does not require any prior operations such as job submission and can be completed by operating the MFP120. In this embodiment, an example is described in which automatic facial recognition login is performed while reducing security risks even in a form in which no job is submitted in advance.

[0049] Since the various configurations in this embodiment, such as the system configuration, hardware configuration, and software configuration, can be the same as those described in the first embodiment, their descriptions will be omitted, and the differences will be explained in detail.

[0050] Figure 11 is a flowchart illustrating an example of the process performed in the MFP120. Specifically, Figure 11 is a flowchart illustrating an example of the process in the MFP120 from the login management unit 501 to the implementation of automatic facial recognition login. The flowchart shown in Figure 11 is initiated when the login management unit 501 determines that the MFP120 is not logged in. The process shown in the flowchart in Figure 11 is repeated whenever the MFP120 is determined to be not logged in. Similar to the flowchart in Figure 9, the process in the flowchart shown in Figure 11 is implemented by the CPU 411 reading a program stored in the ROM 412 or HDD 414, etc., into the RAM 413 and executing it.

[0051] The flowchart in Figure 11 partially mirrors the flowchart in Figure 9. Specifically, steps S1101 and S1103 to S1107 are the same as steps S901 and S903 to S907 in Figure 9, respectively. Note that the step corresponding to S902 in Figure 9 is not included in Figure 11; after determining YES in S1101, the process proceeds to S1103. Before explaining the processes from S1108 onwards, we will explain the favorites settings and address book using the scan screen.

[0052] Figure 12 shows an example of the scan screen 1200. Note that the scan screen 1200 is the screen displayed on the operation panel 420 of the MFP120 after the user has logged into the MFP120. In other words, it is not displayed on the operation panel 420 when the automatic facial recognition login process shown in Figure 11 is being performed. Here, a specific example of the scan screen 1200 is used to explain the favorites settings and address book used during the automatic facial recognition login process.

[0053] On the scan screen 1200, the address book 1201 is a function that allows the user to select the recipients to whom the scan results are sent, and it can be registered and configured for each user. In other words, the scan screen 1200 in Figure 12 displays the address book 1201 that has been set up and registered for the first user when the first user logs into the MFP 120. Therefore, when a second user, who is different from the first user, logs into the MFP 120, the address book that has been set up and registered for the second user will be displayed.

[0054] Figure 13 shows an example of an address book table 1300. The address book table 1300 is stored, for example, on the HDD 414 of the MFP 120. Users registered in the address book 1201 are managed in the address book table 1300 shown in Figure 13. An address book table 1300 is also assumed to be prepared for each user, but the MFP 120 may have one address book table 1300 for the entire system.

[0055] Address ID 1301 is a unique number in address book table 1300. Username 1302 is the username displayed in address book 1201. Destination 1303 is the destination for each user's scan results.

[0056] In the scan screen 1200 of Figure 12, the selected destination 1202 is the target to which the scanned results will be sent. In this example, the settings are configured to send the scanned results to destination 1303, which corresponds to the user with the username "Jiro". The color setting 1203, scan resolution setting 1204, scan size setting 1205, and scan surface setting 1206 are settings used during scanning. Note that the settings related to scanning are not limited to the example shown in Figure 12, and the scan screen 1200 may have other setting items not shown.

[0057] The Advanced Settings 1207 button transitions to a screen (not shown) where settings other than Settings 1203-1206 can be configured. The Favorite Settings Registration button 1208 saves the selected destination 1202, settings 1203-1206, and Advanced Settings 1207 to the Favorite Settings Table 1400.

[0058] Figure 14 shows an example of the Favorite Settings Table 1400. Favorite ID 1401 is a unique number for the Favorite Settings Table 1400. Color setting 1402 stores the value set in color setting 1203. Resolution setting 1403 stores the value set in scan resolution setting 1204. Scan size setting 1404 stores the value set in scan size setting 1205. Single-sided / double-sided setting 1405 stores the value set in scan surface setting 1206. Destination setting 1406 stores the value of destination 1303 corresponding to the user of the selected destination 1202. Favorite settings stored in the Favorite Settings Table 1400 can be referenced and recalled based on the press of the Favorite Settings List button 1209 on the scan screen 1200. The Favorite Settings Table 1400 is assumed to be a single management table stored in the MFP 120.

[0059] Here, users who have their favorite settings in the favorite settings table 1400 are presumed to be users who regularly use the scanning function of the MFP120. Similarly, users registered in the address book table are also presumed to be users who regularly use the scanning function of the MFP120. Thus, in this embodiment, users who are presumed to be highly likely to use functions on the MFP120 that do not require prior job submission are targeted for the automatic facial recognition login process. The process of the flowchart in Figure 11 will be explained below.

[0060] In S1108, the login management unit 501 determines whether the user identified in S1107 is registered as a favorite in the favorite settings table 1400. If the identified user is registered as a favorite, it can be inferred that the user regularly operates the MFP120 and uses the scan function. If the login management unit 501 determines that the user is registered as a favorite, it proceeds to S1110; otherwise, it proceeds to S1109.

[0061] In S1109, the login management unit 501 checks the address book table 1300. The login management unit 501 then determines whether the user identified in S1107 is registered as a user in the address book. If the identified user is registered as a user in the address book, it can be inferred that the user regularly operates the MFP 120 and uses the scanning function. If the login management unit 501 determines that the user is registered as a user in the address book, it proceeds to S1110; otherwise, it returns to S1101.

[0062] In S1110, the login management unit 501 logs in to the MFP120 as the user identified in S1107. Then, the login management unit 501 completes the process shown in the flowchart in Figure 11.

[0063] As explained above, according to this embodiment, security risks can be reduced even when a user attempts to execute a function in the image forming apparatus that does not require prior job submission. In other words, by targeting users who are likely to use the image forming apparatus on a daily basis with automatic facial recognition login, security risks caused by users logging in unintentionally can be reduced.

[0064] <<Other Embodiments>> A combination of the first and second embodiments described above may also be used. Specifically, in Figure 9, if the result is determined to be No in S908, S909, and S910, the processes S1108 and S1109 shown in Figure 11 may be added. This allows the image forming apparatus to perform processing that corresponds to both cases in which jobs are submitted in advance and cases in which jobs are not submitted in advance.

[0065] Furthermore, in the second embodiment, an example was described in which it is determined whether a user is registered as a favorite or in the address book when identifying a user who is likely to use the image forming apparatus on a daily basis, but the example is not limited to this. Users who are likely to use the image forming apparatus on a daily basis may be identified by referring to other parameters that can identify users who frequently use the image forming apparatus.

[0066] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0067] The disclosure of this embodiment includes configurations represented by the following examples of information processing devices, control methods for information processing devices, and programs.

[0068] <Configuration 1> An information processing device, The information processing device includes an imaging control means for controlling the imaging of images of the surrounding area, A detection means for detecting face information from an image captured in accordance with the control of the aforementioned imaging control means, A control means that controls the login of the information processing device as the registered user if the first condition that the detected facial information matches the facial information of a registered user that has been registered in advance and the second condition that the registered user whose facial information matches is presumed to be using the information processing device are met, An information processing device characterized by having the following features.

[0069] <Configuration 2> The information processing apparatus according to configuration 1, characterized in that the imaging control means repeatedly captures the image while no one is logged into the information processing apparatus.

[0070] <Structure 3> The information processing apparatus according to configuration 1 or 2, characterized in that the imaging control means performs imaging of the image without accepting an operation related to logging into the operation unit of the information processing apparatus.

[0071] <Structure 4> The information processing apparatus according to any one of configurations 1 to 3, characterized in that the imaging control means captures an image when a job submitted to the information processing apparatus includes a job which has been set to enable login by facial recognition.

[0072] <Composition 5> The information processing apparatus according to any one of configurations 1 to 4, characterized in that the control means determines that the second condition is not met if a registered user whose facial information matches has not submitted a job to the information processing apparatus.

[0073] <Composition 6> The information processing device according to any one of configurations 1 to 5, characterized in that the control means determines that the second condition is met when a registered user whose facial information matches has submitted a job to the information processing device, and the job submitted to the information processing device includes a job for which a setting to enable login using facial recognition has been granted.

[0074] <Composition 7> The information processing apparatus according to configuration 6, characterized in that the control means executes the job submitted by the registered user to the information processing apparatus after the login, without accepting any operation from the operation unit.

[0075] <Structure 8> The information processing apparatus according to any one of configurations 1 to 7, characterized in that the control means does not perform control to log in to the information processing apparatus as a registered user if the first and second conditions are met but a third condition different from the first and second conditions is not met.

[0076] <Composition 9> The third condition is that the time elapsed since a registered user whose facial information matches submitted a job to the information processing device is less than or equal to a threshold value, as described in configuration 8.

[0077] <Composition 10> The information processing device according to any one of configurations 1 to 9, characterized in that the control means determines that the second condition is met if a registered user whose facial information matches is registered as a favorite.

[0078] <Composition 11> The information processing apparatus according to any one of configurations 1 to 10, characterized in that the control means determines that the second condition is met if a registered user whose facial information matches is registered as a recipient of the job results.

[0079] <Composition 12> The information processing apparatus according to any one of configurations 1 to 11, characterized in that the information processing apparatus is an image forming apparatus having the functions of printing, copying, scanning, or faxing.

[0080] <Composition 13> A method for controlling an information processing device, The steps include controlling the imaging of an image of the area surrounding the information processing device, The steps include detecting face information from an image captured according to the control described above, The steps include: if the first condition that the detected facial information matches the facial information of a registered user that has been pre-registered, and the second condition that the registered user whose facial information matches is presumed to be using the information processing device, then controlling the user to log in to the information processing device as the registered user; A control method for an information processing device, characterized by having the following features.

[0081] <Composition 14> A program for causing a computer to function as one of the means of the information processing device described in any one of the configurations 1 to 12.

Claims

1. An information processing device, The information processing device includes an imaging control means for controlling the imaging of images of the surrounding area, A detection means for detecting face information from an image captured in accordance with the control of the aforementioned imaging control means, A control means that controls the information processing device to log in as the registered user if the first condition that the detected face information matches the face information of a registered user that has been registered in advance and the second condition that the registered user whose face information matches is presumed to be using the information processing device are met, An information processing device characterized by having the following features.

2. The information processing apparatus according to claim 1, characterized in that the imaging control means repeatedly captures the image while no one is logged into the information processing apparatus.

3. The information processing apparatus according to claim 1, characterized in that the imaging control means performs imaging of the image without accepting an operation related to logging into the operation unit of the information processing apparatus.

4. The information processing apparatus according to claim 1, wherein the imaging control means captures an image when a job submitted to the information processing apparatus includes a job that has been set to enable login by facial recognition.

5. The information processing apparatus according to claim 1, characterized in that the control means determines that the second condition is not met if a registered user whose facial information matches has not submitted a job to the information processing apparatus.

6. The information processing apparatus according to claim 1, characterized in that the control means determines that the second condition is met when a registered user whose facial information matches submits a job to the information processing apparatus, and the job submitted to the information processing apparatus includes a job for which a setting to enable login using facial recognition has been added.

7. The information processing apparatus according to claim 6, characterized in that the control means executes the job submitted by the registered user to the information processing apparatus after the login without accepting any operation from the operation unit.

8. The information processing apparatus according to claim 1, characterized in that the control means does not perform control to log in to the information processing apparatus as a registered user if the first and second conditions are met but a third condition different from the first and second conditions is not met.

9. The third condition is that the time elapsed since a registered user whose facial information matches submitted a job to the information processing device is less than or equal to a threshold value, as described in claim 8.

10. The information processing apparatus according to claim 1, characterized in that the control means determines that the second condition is met if the registered user whose facial information matches is registered as a favorite.

11. The information processing apparatus according to claim 1, characterized in that the control means determines that the second condition is met if a registered user whose facial information matches is registered as a recipient of the job results.

12. The information processing apparatus according to claim 1, characterized in that the information processing apparatus is an image forming apparatus having the functions of printing, copying, scanning, or faxing.

13. A method for controlling an information processing device, The steps include controlling the imaging of an image of the area surrounding the information processing device, The steps include detecting face information from an image captured according to the control described above, The steps include: if the first condition that the detected facial information matches the facial information of a registered user that has been pre-registered, and the second condition that the registered user whose facial information matches is presumed to be using the information processing device, then controlling the information processing device to log in as the registered user; A control method for an information processing device, characterized by having the following features.

14. A program for causing a computer to function as one of the means of an information processing apparatus according to any one of claims 1 to 12.

Images