Processing system, server system, printing device, program, and processing method

Abstract

To provide an electronic apparatus that allows a user to appropriately log out from the apparatus based on his / her own intention.SOLUTION: A processing system includes an acquisition unit that acquires information based on a picked-up image of a user, and a processing unit that performs log-in processing and log-out processing with respect to an electronic apparatus. The processing unit determines, in the log-out processing (S30), if a gesture of instructing log-out from the electronic apparatus has been performed by the user based on the picked-up image of the user (S40). When determining that the gesture of instructing the log-out has been performed, the processing unit performs the log-out processing of receiving the log-out (S42).SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a processing system, a server system, a printing device, a program, a processing method, and the like. [Background technology]

[0002] Conventionally, there is known a processing system that allows a user to log in to an electronic device when the user is authenticated by face authentication. Patent Document 1 discloses a method for automatically logging out of an electronic device after a certain period of time has elapsed since the user could no longer be authenticated. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-28719 A Summary of the Invention [Problem to be solved by the invention]

[0004] If an electronic device were to uniformly log out users based on the fact that it was unable to authenticate them for a certain period of time, the electronic device would also log out users when they temporarily left the device while using it, which would be against the users' will and would reduce convenience. The method described in Patent Document 1 does not take such circumstances into consideration. [Means for solving the problem]

[0005] One aspect of the present disclosure relates to a processing system that includes an acquisition unit that acquires information based on an captured image of a user, and a processing unit that performs login and logout processing for an electronic device, and the processing unit performs the logout processing when it determines, based on the captured image of the user, that the user has made a gesture to instruct the user to log out of the electronic device.

[0006] Another aspect of the present disclosure relates to a server system including the above-described processing system and a communication unit that communicates with an electronic device.

[0007] Moreover, one aspect of the present disclosure relates to a printing device including the above-described processing system and a printing unit.

[0008] Furthermore, one aspect of the present disclosure relates to a program that causes a computer to function as an acquisition unit that acquires information based on a captured image of a user, and a processing unit that performs login and logout processing for an electronic device, and the processing unit is related to a program that performs the logout processing when it is determined that the user has made a gesture to instruct the user to log out of the electronic device based on the information based on the captured image of the user.

[0009] Furthermore, one aspect of the present disclosure relates to a processing method for performing a login process for an electronic device, acquiring information based on a captured image of a user, and performing a logout process for the electronic device if it is determined that the user has made a gesture to instruct logging out of the electronic device based on the information based on the captured image of the user. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a processing system. [Diagram 2] FIG. 2 is a diagram for explaining a processing flow of the processing system. [Diagram 3] 11 is a flowchart illustrating a login process. [Figure 4] 11 is a flowchart illustrating a logout process. [Diagram 5] FIG. 2 is a block diagram showing a more detailed configuration example of the processing system. [Figure 6] FIG. 4 is a diagram for explaining a more detailed processing flow of the processing system. [Figure 7] 10 is a flowchart illustrating a login process according to another embodiment. [Figure 8] 11 is a flowchart illustrating a first login process. [Figure 9] 11 is a flowchart illustrating a second login process. [Figure 10] 10 is a flowchart illustrating a logout process according to another embodiment. [Figure 11] 11 is a flowchart illustrating a first logout process. [Figure 12] 11 is a flowchart illustrating a second logout process. [Figure 13] 11A and 11B are diagrams illustrating examples of screens to which the method of the present embodiment is applied. [Figure 14] FIG. [Figure 15] FIG. 11 is a block diagram illustrating a modified example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The present embodiment will be described below. Note that the present embodiment described below does not unduly limit the contents of the present disclosure described in the claims. Furthermore, not all of the configurations described in the present embodiment are necessarily essential components of the present disclosure.

[0012] FIG. 1 is a block diagram for explaining a processing system 10 of the present embodiment. The processing system 10 of the present embodiment includes an acquisition unit 110 and a processing unit 120. The acquisition unit 110 is a communication interface that acquires information based on a captured image of a user. It does not matter whether the communication here is wired communication or wireless communication. The information based on the captured image of a user includes, for example, authentication result information of face authentication based on a captured image of a user, but may be the captured image itself or other information. The authentication result information of face authentication based on a captured image of a user is specifically information on the result of authenticating a captured face image of a user by face authentication processing. In addition, although not shown in the figure, the processing system 10 may include a predetermined electronic device, and the predetermined electronic device may further include a display unit. The predetermined electronic device is, for example, a printing device, but may be other devices.

[0013] The printing device here includes a multifunction device, which refers to a printer that includes functions other than a printer function, such as a copy function, a fax function, or a scanner function, but may also include other functions.

[0014] The processing unit 120 controls each unit in the processing system 10, such as the acquisition unit 110, and performs login and logout processing of the electronic device described above, and executes a job. In this case, the job is, for example, a print job sent to and stored in the printing device in the case of a printing device for the electronic device described above, but may also be a command or instruction given to another electronic device. In the following description, the job can be appropriately read as a print job. Specifically, the processing unit 120 is a processor or controller. The processing unit 120 is, for example, a main CPU (Central Processing Unit), but may also include multiple CPUs such as sub-CPUs. In this case, the main CPU controls each unit of the processing system 10 and performs overall control. The sub-CPU is, for example, a CPU that performs communication control of the communication unit 130 described later in FIG. 5. In addition, in the case where the processing system 10 includes the printing device described above, the processing system 10 may further include a CPU that controls the printing device. In addition, the processing unit 120 of this embodiment can be configured by the following hardware. The hardware can include at least one of a circuit that processes digital signals and a circuit that processes analog signals. The hardware may be configured, for example, by one or more circuit devices or one or more circuit elements mounted on a circuit board. The circuit device may be, for example, an integrated circuit device. The circuit element may be, for example, an active element such as a transistor, or a passive element such as a resistor or a capacitor.

[0015] The face recognition process is a process for determining the authenticity of a person to be authenticated by comparing the feature amount of a face image registered in advance with the feature amount of the face image of the person to be authenticated at the time of authentication. There are various types of processes for face recognition process, for example, a process for detecting face parts of a captured face image of a user and a registered face image, detecting each face feature point based on the detected face parts, and further calculating the similarity of the face parts based on the detected face feature points. If the calculated similarity exceeds a predetermined threshold, it is determined that the user of the captured face image and the person of the registered face image are the same person.

[0016] Detection of the face can be achieved, for example, by using a method of distinguishing between faces and non-faces using a support vector machine for each of the captured face image of the user and the registered face image, but it may also be achieved by using a method of distinguishing between faces and non-faces using a deep neural network or a general learning vector quantization method.

[0017] The detection of facial feature points can be realized, for example, by extracting feature points such as the eyes, nose, and mouth from the face, calculating the positional relationship of the feature points and predetermined characteristics in the vicinity of the feature points as feature amounts, and forming the feature amount vector, or by other methods. Note that the predetermined characteristics may be color shading, distribution, etc.

[0018] The similarity of the facial parts can be calculated, for example, by a method of calculating the chi-squared distance or Euclidean distance between the calculated feature vectors for each of the captured user's facial image and the registered facial image, but it may also be calculated by other methods.

[0019] The face recognition process can be realized by predetermined hardware such as the imaging device 20 and the first server 30 described later in FIG. 5, and the details will be described later. In this case, the information based on the captured image acquired by the acquisition unit 110 is authentication result information of face recognition based on the captured image of the user. The processing unit 120 may be predetermined hardware that executes a program for face recognition process. In this case, the information based on the captured image acquired by the acquisition unit 110 is the captured image data itself transmitted from the hardware having an imaging function.

[0020] Next, the flow of login and logout processing of the processing system 10 of the present embodiment will be described. The processing system 10 performs processing to transmit a login command to a specific electronic device in response to receiving a specific login request. The subject that transmits the specific login request may be the specific electronic device, but may be another device that is associated with the specific electronic device. Similarly, the processing system 10 performs processing to transmit a logout command to a specific electronic device in response to receiving a specific logout request. The specific login request and the specific logout request are composed of authentication information input by a contact-type input means such as a button. The processing system 10 can also accept information based on a captured image as a login request and transmit a login command to a specific electronic device, and can also perform processing such as a login process (step S10) based on face authentication, which will be described later in FIG. 3. Similarly, the processing system 10 can accept information based on a captured image as a logout request and transmit a logout command to a specific electronic device, and can also perform processing such as a logout process (step S30) which will be described later in FIG. 4.

[0021] 4, the logout process (step S30) can be combined with at least one of the predetermined login request and the login process (step S10) described above. That is, the processing system 10 can perform the logout process (step S30) after transmitting a login command to a predetermined electronic device by a predetermined login request of the contact type, thereby achieving the process flow shown in FIG. 2.

[0022] FIG. 2 is a diagram for explaining the flow of processing when the above-mentioned login processing (step S10) and logout processing (step S30) are combined. In FIG. 2, the downward direction indicates the progression of time, but does not indicate a specific length of time. The acquisition unit 110 receives information based on a captured image corresponding to the login processing (step S10) at a predetermined timing. Then, the processing unit 120 performs the login processing (step S10). After that, the acquisition unit 110 receives information based on a captured image corresponding to the logout processing (step S30) at a timing after the predetermined timing. Then, the processing unit 120 performs the logout processing (step S30).

[0023] The details of the process in FIG. 2 will be described with reference to FIG. 3 and FIG. 4. FIG. 3 is a flowchart for explaining a processing example of the login process (step S10). The processing unit 120 performs a process of determining whether or not the user is a registered user by face authentication, and when it is determined that the user is a registered user (YES in step S20), it performs a process of accepting the login (step S22). For example, the first server 30 described later in FIG. 5 performs a face authentication process, and the acquisition unit 110 acquires information that the captured person is the same person as the registered user, and the processing unit 120 performs a process of transmitting a command to log in to the printing device or the like based on the information. Also, for example, the processing unit 120 may perform a face authentication process, determine that the captured person is the same person as the registered user, and transmit a command to log in to the printing device or the like.

[0024] Thereafter, the processing unit 120 performs a process of transmitting screen information according to the job status (step S24), and ends the flow. The job status is, for example, the number of jobs, but is not limited to this, and may be the job status, etc. For example, when the job status is the number of jobs, the user may appropriately decide whether or not to include a job that has become an error during transmission in the number of jobs. In addition, a predetermined printing status may be taken into consideration in the job status. The predetermined printing status is, for example, the status of the remaining amount of ink contained in the printing device. For example, as will be described later with reference to FIG. 13, etc., the processing unit 120 performs a process of transmitting a command to the printing device to display different types of screen information according to the number of print jobs related to the user based on face authentication.

[0025] On the other hand, if the processing unit 120 cannot determine that the user is a registered user (NO in step S20), it performs a process of rejecting the login (step S26) and ends the flow. The process of rejecting the login (step S26) is, for example, a process of discarding the captured image data, but is not limited to this, and a process of notifying an error may be added.

[0026] Thus, the processing system 10 of this embodiment includes an acquisition unit 110 that acquires authentication result information of face authentication based on a captured image of a user, and a processing unit 120 that performs processing for a print job. When the processing unit 120 determines based on the authentication result information that the user has successfully logged in through face authentication (YES in step S20), it performs processing (step S24) to display a screen in a different display mode on the display unit of the printing device according to the status of the print job corresponding to the user.

[0027] In this way, the processing system 10 of the present embodiment includes the acquisition unit 110 and the processing unit 120, and therefore can process the authentication result of the face authentication based on the captured image. In addition, the processing unit 120 can display appropriate screen information on the display unit of the printing device according to the job status. This can improve the convenience of the printing device. For example, when a user logs in to the printing device with only one print job stored, it is obvious that the one stored print job will be printed, so it is convenient for the user to execute printing of the print job upon acceptance of the login. On the other hand, when a user logs in to the printing device with multiple print jobs stored, the user may not intend to print all the stored print jobs. Or, the user may intend to delete a print job sent by mistake by operating the printing device. In such a case, it is not appropriate to uniformly print all print jobs upon acceptance of the login. In addition, even if the printing device has one print job stored, it is not appropriate to execute printing in a situation where the ink remaining in the printing device is insufficient. In this respect, by applying the method of the present embodiment, it is possible to display appropriate screen information according to the job status.

[0028] The method of the present embodiment may be realized by a program. That is, the program of the present embodiment causes a computer to function as an acquisition unit 110 that acquires authentication result information of face authentication based on a captured image of a user, and a processing unit 120 that performs processing for a print job. Furthermore, when the processing unit 120 determines based on the authentication result information that login of a user through face authentication has been successful, it performs processing to display a screen in a different display mode on the display unit of the printing device according to the status of the print job corresponding to the user. This allows the same effect as above to be obtained.

[0029] FIG. 4 is a flowchart for explaining a processing example of the logout process (step S30). The processing unit 120 performs a process (step S40) for determining whether or not the information based on the captured image is a gesture indicating an instruction to log out. Specifically, the processing system 10 stores, for example, information regarding the gesture indicating an instruction to log out in a memory (not shown) in advance. Then, the user performs a predetermined gesture using the hardware used for face authentication. Then, the processing unit 120 determines whether or not the similarity between the captured image based on the user's gesture and the stored information regarding the gesture exceeds a predetermined threshold value through the above-mentioned process. If the processing unit 120 can determine that the gesture indicates an instruction to log out (YES in step S40), it performs a process for accepting the logout (step S42) and ends the flow. Specifically, if the similarity exceeds a predetermined threshold value, the processing unit 120 performs a process for transmitting a command to log out to the printing device. On the other hand, if the processing unit 120 cannot determine that the information based on the captured image is a gesture indicating an instruction to log out (NO in step S40), it performs a process for rejecting the logout (step S46) and ends the flow. The process of refusing the logout (step S46) is, for example, a process of discarding captured image data related to the gesture, but a process of notifying an error may be added.

[0030] Here, a gesture is, for example, a movement such as shaking a hand back and forth or bending and straightening fingers, but is not limited thereto, and may be a predetermined facial expression, a movement of the neck or shoulders, or a predetermined pose. A predetermined facial expression is, for example, making a surprised expression with the eyes and mouth open, closing one eye, or blinking a predetermined number of times. A predetermined pose is, for example, making the same shape as a letter of the alphabet with fingers for a certain period of time.

[0031] In this manner, the processing system 10 of the present embodiment includes an acquisition unit 110 that acquires information based on a captured image of the user, and a processing unit 120 that performs login processing and logout processing (step S30) for the electronic device. When the processing unit 120 determines that a gesture has been made by the user to instruct the user to log out of the electronic device based on the captured image of the user, the processing unit 120 performs logout processing (step S30). In this manner, the processing system 10 of the present embodiment includes the acquisition unit 110 and the processing unit 120, and therefore can perform processing to transmit a login or logout instruction to a specific electronic device based on information based on the captured image. Furthermore, when the processing unit 120 determines that a gesture has been made, it performs logout processing, so that the user can non-contactly log out of the electronic device based on his or her own intention when he or she wishes to end use of the electronic device. Conventionally, an electronic device logs out when a certain time has elapsed since the user left the image capture range, so that unintentional logout may occur when the user leaves the image capture range during use of the specific electronic device, which causes a problem in convenience. In this regard, by applying the method of the present embodiment, the user can intentionally log out when he or she wishes to end use of the specific electronic device. Such a processing system has not existed until now.

[0032] The method of the present embodiment may be realized by a program. That is, the program of the present embodiment causes a computer to function as an acquisition unit 110 that acquires information based on a captured image of a user, and a processing unit 120 that performs login and logout processing for the electronic device. Furthermore, when the processing unit 120 determines that a gesture instructing the user to log out of the electronic device has been made based on information based on a captured image of the user, the processing unit 120 performs logout processing. This provides the same effect as above.

[0033] The technique of the present embodiment may be realized by a processing method. That is, the processing method of the present embodiment performs a login process for the electronic device, acquires information based on a captured image of the user, and performs a logout process for the electronic device when it is determined that the user has made a gesture to instruct logging out of the electronic device based on the information based on the captured image of the user. This can provide the same effect as above.

[0034] As shown in FIG. 2, the processing unit 120 can also perform a log-out process (step S30) using information based on a captured image corresponding to a log-in process (step S10) after performing a login process (step S10) using information based on a captured image corresponding to the login process (step S10). That is, when the processing unit 120 determines that a gesture instructing log-out has been performed after a user has logged in using face authentication processing based on a captured image, the processing unit 120 performs a log-out process. In this way, a user who has logged in using face authentication without contact can log out using a gesture without contact, and can log in and out of a specific electronic device without contact. In particular, in a situation where there are multiple types of authentication means, a user who has logged in using face authentication may have the intention of logging in without contact. In this regard, by applying the method of this embodiment, log-out can also be performed without contact, improving convenience.

[0035] The processing system 10 of the present embodiment is not limited to the above-mentioned configuration, and various modifications such as adding other components are possible. FIG. 5 is a block diagram for explaining a more detailed configuration example of the processing system 10 of the present embodiment. The processing system 10 of FIG. 5 includes an imaging device 20, a first server 30, a second server 100, an electronic device 200, and a terminal device 300. The second server 100 includes the above-mentioned acquisition unit 110 and processing unit 120, and further includes a communication unit 130. The electronic device 200 includes a display unit 240. The communication unit 130 is an interface that communicates with the electronic device 200 and the terminal device 300, but may be the same interface as the above-mentioned acquisition unit 110. The electronic device 200 is, for example, a printing device, but may be another device. If the electronic device 200 is a printing device, it further includes a printing unit (not shown).

[0036] The functions of the acquisition unit 110 and the processing unit 120 in Fig. 5 correspond to some of the functions of the acquisition unit 110 and the processing unit 120 in Fig. 1. Therefore, the second server 100 can be considered as a server system in which the processing system 10 in Fig. 1 is further equipped with a communication unit 130. In other words, the server system of this embodiment includes the above-mentioned processing system 10 and the communication unit 130 that communicates with the electronic device 200. In this way, it is possible to build a server system that acquires information based on a captured image and performs login processing and logout processing for the electronic device 200.

[0037] The imaging device 20 is located, for example, at a predetermined location near the electronic device 200, captures an image of a user who wants to operate the electronic device 200, and transmits the captured image information to a first server 30, which will be described later. Note that the imaging device 20 and the electronic device 200 do not need to be directly connected for communication. Since the captured image information includes the identification information of the imaging device 20 itself, the user can know which imaging device 20 corresponds to which electronic device 200 by associating the identification information of the imaging device 20 with the identification information of the electronic device 200. The imaging device 20 can be realized, for example, by a near-infrared camera, but may be another camera. Also, the imaging device 20 may be configured with multiple cameras.

[0038] In the case of FIG. 5, the first server 30 performs face authentication based on the captured image information described above, and transmits information based on the captured image to the second server 100. The information based on the captured image is authentication result information of the face authentication. The first server 30 includes a memory (not shown). The memory stores, for example, a face authentication program and image information related to the faces of registered users used for face authentication, but can also store image information related to the gestures described above. The first server 30 can realize face authentication processing by including hardware such as a processor or a controller in addition to the memory described above.

[0039] The second server 100 receives information based on the captured image from the first server 30, and judges whether to accept login or logout for the electronic device 200 corresponding to the imaging device 20. The second server 100 also receives predetermined job data from the terminal device 300 and stores it in a memory (not shown). For example, the predetermined job data is print job data when the electronic device 200 is a printing device. Note that the predetermined job data transmitted by the terminal device 300 includes user identification information. Therefore, when a user logs in to the electronic device 200, job information related to the logged-in user is displayed on the display unit 240.

[0040] The display unit 240 can be realized by, for example, a liquid crystal display, but may also be realized by an organic EL display, a dot matrix LED, or the like. The display unit 240 may be integrated with an operation unit (not shown) as a hardware unit using a touch panel, or may notify the user of the electronic device 200 together with a notification unit (not shown). In this embodiment, the display unit 240 is a touch panel.

[0041] FIG. 6 is a diagram for explaining the flow of processing of the entire processing system 10 in FIG. 5. Here, it is assumed that the electronic device 200 is a printing device. The terminal device 300 transmits a print job to the second server 100, and the second server 100 performs a print job storage process. Thereafter, the second server 100 receives one of a first login request or a second login request. The first login request is authentication information transmitted from the first server 30 based on captured image information transmitted from the imaging device 20. The second login request is authentication information that is not based on captured image information, and is, for example, authentication information transmitted by a user by inputting an operation on a predetermined operation unit or authentication information resulting from the use of a predetermined electronic medium. The predetermined operation unit is, for example, a button (not shown), but may be a touch panel of the display unit 240.

[0042] After receiving the first login request or the second login request, the processing unit 120 performs login processing (step S100) for the printing device. Although both the first login request and the second login request are illustrated in FIG. 6, in reality, one of them is sent to the second server 100. The same applies to the first logout request and the second logout request described later. After that, when the processing unit 120 receives a print data request (step S200) based on the job information related to the user displayed on the display unit 240 from the printing device, it transmits the print data (step S210). As a result, the printing device executes printing based on the received print data, and the user can obtain the desired printed matter. Depending on the status of the job, print data may be transmitted to the printing device even if there is no print data request (step S200), and details will be described later with reference to FIG. 8.

[0043] Thereafter, the second server 100 receives either the first logout request or the second logout request. The first logout request is authentication information transmitted from the first server 30 based on the gesture image information transmitted from the imaging device 20. The second logout request is authentication information that is not based on captured image information, similar to the second login request. After receiving the first logout request or the second logout request, the processing unit 120 performs a logout process (step S300) for the printing device.

[0044] Next, the specific contents of each process in FIG. 6 will be described with reference to FIGS. 7, 8, 9, 10, 11, and 12. Here, a process example in which the screen display after login by face authentication is changed according to the number of print jobs, which is an example of the state of the print jobs, will be described. That is, the processing unit 120 performs a process in which a screen in a different display mode is displayed on the display unit 240 according to the number of print jobs. In this way, the electronic device 200 can display appropriate screen information on the display unit 240 according to the number of print jobs.

[0045] 7 is a flowchart illustrating the login process (step S100). The processing unit 120 performs a process of determining whether the login request is a first login request or a second login request, and if the login request is a first login request (YES in step S110), the processing unit 120 performs the first login process (step S120) and ends the flow. On the other hand, if the login request is a second login request (NO in step S110), the processing unit 120 performs the second login process (step S220) and ends the flow.

[0046] FIG. 8 is a flow chart for explaining the first login process (step S120). The processing unit 120 performs user authentication (step S122). If there is a problem with the user authentication, the process does not proceed to the following steps, but here it is assumed that there is no problem with the user authentication and the process proceeds. The same applies to the explanations of FIGS. 9, 13, and 14 described below. Thereafter, the processing unit 120 performs a process for determining whether or not the number of print jobs for the user stored in the printing device is zero, and if the number of print jobs is zero (YES in step S130), performs a process for sending an instruction to the printing device to display the display unit 240 in the first display mode (step S132), and then performs the processes from step S160 onwards. On the other hand, when the number of print jobs is not zero (NO in step S130), the processing unit 120 performs a process of determining whether the number of print jobs is 1 or not, and when the number of print jobs is 1 (YES in step S140), the processing unit 120 performs a process of transmitting print job data to the printing device (step S142), a process of transmitting an instruction to display the display unit 240 in the second display mode to the printing device (step S144), and then performs the processes in and after step S160. Note that step S142 is a process corresponding to step S210 described above in FIG. 6, and the printing device that receives the print job data transmitted in step S142 executes printing based on the print job data. In this way, even if step S200 described above in FIG. 6 is not performed, the print job data may be transmitted to the printing device. Also, when the number of print jobs is 2 or more (NO in step S140), the processing unit 120 performs a process of transmitting an instruction to display the display unit 240 in the third display mode to the printing device (step S150), and then performs the processes in and after step S160.

[0047] In this way, in the first login process (step S120), the processing unit 120 of this embodiment divides the number of jobs into three patterns, and performs processing to display a screen of a different display mode on the display unit 240 according to each pattern. That is, when the number of print jobs for the user when the login is successful is zero, the processing unit 120 displays a screen of the first display mode. And when the number of print jobs for the user when the login is successful is one, the processing unit 120 displays a screen of the second display mode. And when the number of print jobs for the user when the login is successful is two or more, the processing unit 120 displays a screen of the third display mode. In this way, it is possible to display an appropriate guide according to the number of print jobs.

[0048] Specifically, the processing unit 120 of the second server 100 as a server system generates display screen data according to the first to third display modes. After that, the processing unit 120 performs a process of transmitting the display screen data to the electronic device 200 as a printing device via the communication unit 130 at a predetermined timing. The same applies to steps S232 and S250 in FIG. 9. That is, the server system of this embodiment includes the above-mentioned processing system 10 and the communication unit 130 that communicates with the electronic device 200 as a printing device, and the processing unit 120 instructs the display unit 240 of the electronic device 200 as a printing device to display screens of different display modes according to the status of the print job via the communication unit 130. In this way, a server system can be constructed that generates an appropriate guidance display and causes the printing device to display the screen of the guidance display. Specific screen examples of the first to third display modes will be described later with reference to FIG. 13.

[0049] Thereafter, the processing unit 120 performs a process (step S160) of invalidating the second logout process (step S330) described later in Fig. 12. That is, when the first login process (step S120) based on a captured image is performed as the login process, the processing unit 120 invalidates the second logout process (step S330). In this manner, it is possible to prevent a user who has selected to use the electronic device 200 based on a login using a non-contact method from logging out using a contact method.

[0050] Specifically, the processing unit 120 performs a process of generating image data that does not reflect the logout button icon 540 described later with reference to FIG. 13 and the like in the first to third display modes described above. That is, the processing unit 120 performs, as the login process, a first login process (step S120) based on a captured image and a second login process (step S220) based on information other than the captured image. Then, when the first login process (step S120) is performed, the processing unit 120 disables a display on the display unit 240 of the electronic device 200 instructing the second logout process (step S330) corresponding to the second login process (step S220). In this way, the user can confirm that he or she has logged in using the contactless method.

[0051] Thereafter, the processing unit 120 performs a process of superimposing and displaying the guidance display (step S162). Specifically, as described later in FIG. 13, the processing unit 120 performs a process of generating image data in which the logout method guide icon 530 is reflected in the first to third display modes described above. Note that step S162 is a process that is performed when login is performed using face authentication, and therefore the display of the logout method guide icon 530 described later in FIG. 13 means that face authentication has been successful. In other words, when face authentication is successful, the processing unit 120 of this embodiment performs a display process of notifying the display unit 240 of the printing device that face authentication has been successful. In this way, the user can confirm that login using face authentication has been successful.

[0052] FIG. 9 is a flowchart for explaining the second login process (step S220). The processing unit 120 performs user authentication (step S222) in the same manner as in step S122 described above. Thereafter, the processing unit 120 performs a process for determining whether the number of print jobs stored in the printing device for the user is zero, and if the number of print jobs is zero (YES in step S230), performs a process for displaying in the first display mode (step S232), and then performs a process of step S260. On the other hand, if the number of print jobs is not zero (NO in step S230), the processing unit 120 performs a process for sending an instruction to the printing device to display the display unit 240 in the third display mode (step S250), and then performs a process of step S260.

[0053] Thereafter, the processing unit 120 performs a process (step S260) for enabling a second logout process (step S330) which will be described later with reference to Fig. 12. Specifically, as will be described later with reference to Fig. 14 etc., a process for sending an instruction to the printing device to display a logout button icon 540 on the display unit 240 is performed.

[0054] As seen from FIG. 8 and FIG. 9, when the first login process (step S120) is executed, the user can only log out by the first logout process (step S320). In addition, since the second login process (step S220) does not have a process corresponding to step S162 in FIG. 8, the logout method guide icon 530 described later in FIG. 13 is not displayed. Therefore, the user cannot recognize the logout method by gesture, and is naturally prompted to log out by the second logout process (step S330). In this way, when the first login process (step S120) based on a captured image is executed as the login process, the processing unit 120 of this embodiment executes the first logout process (step S320) based on a captured image related to the gesture as the logout process. In addition, when the second login process (step S220) based on information other than the captured image is executed, the processing unit 120 executes the second logout process (step S330) based on information other than the captured image as the logout process. In this way, the method for logging in and out of the electronic device 200 can be adapted to either the contactless method or the contact method.

[0055] 10 is a flowchart illustrating the logout process (step S300). The processing unit 120 performs a process of determining whether the logout request is a first logout request based on gesture image information, and if the logout request is the first logout request (YES in step S310), the processing unit 120 performs the first logout process (step S320) and ends the flow. On the other hand, if the logout request is not the first logout request, that is, if it is a second logout request (NO in step S310), the processing unit 120 performs the second logout process (step S330) and ends the flow.

[0056] FIG. 11 is a flowchart for explaining the first logout process (step S320). The processing unit 120 performs a process for determining whether the gesture image information satisfies the first logout condition (step S322). The gesture image information here includes information based on a gesture image that is a captured image. The first logout condition is, for example, that the similarity between a gesture image based on a gesture made by a user and a registered gesture image exceeds a predetermined threshold. In addition, for example, when the information based on the gesture image is a character or a number, the first logout condition may be that the character or number based on the captured gesture image matches the registered character or number. When the processing unit 120 determines that the gesture image information satisfies the first logout condition (YES in step S322), it performs a process for accepting the logout (step S324) and ends the flow. For example, the processing unit 120 performs a process for generating screen display data before the above-mentioned login process (step S100) is performed and a process for transmitting the screen display data to the printing device.

[0057] On the other hand, when the processing unit 120 determines that the gesture image information does not satisfy the first logout condition (NO in step S322), it performs a process of refusing the logout (step S326) and ends the flow. Specifically, the processing unit 120 notifies that the similarity between the gesture image based on the gesture performed by the user and the registered gesture image does not exceed a predetermined threshold, but is not limited to this. For example, the processing unit 120 may notify that the letters or numbers based on the gesture performed by the user do not match the registered letters or numbers.

[0058] Note that a process for re-enabling the second logout process (step S330) described above may be added, since a logout refusal may be caused by a malfunction of the processing system 10 or the like.

[0059] FIG. 12 is a flowchart for explaining the second logout process (step S330). The processing unit 120 performs a process for determining whether or not the information on the electronic medium or the user's operation satisfies the second logout condition. That is, the second logout process (step S330) is a logout by the electronic medium or a logout by the user's operation on the display unit 240. In this way, it is possible to log out by a method other than the information based on the captured image. The second logout condition is, for example, that the information based on the ID card used for logout matches the information registered as the logged-in user. When the processing unit 120 determines that the information on the electronic medium or the user's operation satisfies the second logout condition (YES in step S332), it performs a process for accepting the logout (step S334). Specifically, it is the same as the above-mentioned step S324.

[0060] On the other hand, if the processing unit 120 determines that the information on the electronic medium or the user's operation does not satisfy the second logout condition (NO in step S332), it performs processing to reject the logout (step S336) and ends the flow. For example, if logout is performed using an ID card held by a user other than the user who logged in, it performs processing to send a command to the printing device to display that fact on the display unit 240. Note that it is not normally expected that logout will be rejected by selecting a logout button icon 540, which will be described later.

[0061] Fig. 13 is an example of a screen to which the method of this embodiment is applied. When the electronic device 200 is started by turning on the power, the display unit 240 displays a user authentication icon 500. Then, when the user selects login by face authentication, that is, when a first login request is made, the processing unit 120 performs the first login process (step S100) described above in Fig. 8. Therefore, a display image in any one of the first display mode, the second display mode, and the third display mode described above is displayed on the display unit 240 according to the number of jobs.

[0062] In addition, in any of the first to third display modes, the user display icon 501 is displayed on the display unit 240. This allows the user to confirm that user authentication (step S122) has been performed. In any of the first to third display modes, the logout button icon 540 described later in FIG. 14 is not displayed on the display unit 240 as shown in A1, A2, and A3. This is because the process of step S160 described above in FIG. 8 is executed in any of the first to third display modes. In addition to completely erasing the logout button icon 540, the processing unit 120 may make the icon semi-transparent or otherwise different from the state of the logout button icon 540 shown in FIG. 14, or may display the logout button icon 540 without accepting touch panel operations.

[0063] If the number of print jobs is zero (YES in step S130), display unit 240 displays a list of print button icon 502, fax button icon 504, copy button icon 506, and scanner button icon 508 as a first display mode. In other words, the first display mode is a mode that shows a list of the functions of the printing device. In this way, processing unit 120 performs processing to display a function list screen of the printing device for a user who has successfully logged in and has zero print jobs. In this way, the user can arbitrarily select the content that he or she wishes to execute on the printing device.

[0064] If the number of print jobs is one (YES in step S140), display unit 240 displays print in progress icon 510 as the second display mode. In other words, the second display mode is a mode indicating that printing is being executed. In this way, for a user who has successfully logged in, if the number of print jobs is one, processing unit 120 executes processing to cause the printing device to execute printing and display a print execution screen. In this way, the user can cause the printing device to execute the accumulated print job in response to the login.

[0065] If the number of print jobs is two or more (NO in step S140), display unit 240 displays print waiting icons 520, 522 as a third display mode. In other words, the third display mode is a mode that shows a list of print jobs that have not yet been printed. In this way, processing unit 120 performs processing to display a list screen of multiple print jobs for a user who has successfully logged in, when the number of print jobs is two or more. In this way, the user can take appropriate action for two or more print jobs.

[0066] In addition, for any of the first to third display modes, the logout method guide icon 530 is displayed on the display unit 240. This is because, for any of the first to third display modes, the process of step S162 described above with reference to FIG. 8 is executed.

[0067] The logout method guide icon 530 is a display that informs the user to log out by a gesture when logging in by face authentication, i.e., the first login process (step S120). That is, the processing unit 120 performs, as the login process, a first login process (step S120) based on a captured image and a second login process (step S220) based on information other than the captured image. Then, when the first login process (step S120) is performed, the processing unit 120 displays a guidance display on the display unit 240 of the electronic device 200 that informs the user to perform a first logout process (step S320) by a gesture corresponding to the first login process (step S120). In this way, the user can recognize that he or she must log out by a gesture.

[0068] FIG. 14 is an example of a screen when the processing unit 120 performs the second login process (step S220). In FIG. 14, when the number of print jobs is 1, the display is performed in the third display mode (NO in step S230) and the print waiting icon 520 is displayed on the display unit 240, which is different from the first login process (step S120). In addition, since the second logout process is enabled (step S260), the logout button icon 540 is displayed on the display unit 240 regardless of the number of print jobs. In addition, since the process of step S162 in FIG. 8 is not performed, the logout method guide icon 530 is not displayed on the display unit 240 regardless of the number of print jobs, as shown in B1, B2, and B3. The user can log out of the electronic device 200 by selecting the logout button icon 540 by operating the touch panel. In other words, the logout button icon 540 is a contact-type logout means. Although not shown in the figure, in addition to the logout button icon 540, an ID card or the like may be used to log out.

[0069] The method of this embodiment is not limited to the above, and various modifications are possible. FIG. 15 is a block diagram for explaining a modification of this embodiment. In the processing system 10 of FIG. 15, the electronic device 400 also plays the role of the second server 100 of FIG. 5, which is different from FIG. 5. That is, the electronic device 400 includes an acquisition unit 410, a processing unit 420, a communication unit 430, and a display unit 440. The acquisition unit 410 corresponds to the acquisition unit 110 of FIG. 1, the processing unit 420 corresponds to the processing unit 120 of FIG. 1, the communication unit 430 corresponds to the communication unit 130 of FIG. 5, and the display unit 440 corresponds to the display unit 240 of FIG. 5. The electronic device 400 may be, for example, a printing device, and in this case, further includes a printing unit (not shown). Therefore, the electronic device 400 can be considered as a printing device that further includes a printing unit in addition to the processing system 10 of FIG. 1. In this way, a printing device that acquires information based on a captured image and performs its own login process and logout process can be configured. It is also possible to provide a printing device that performs login processing based on face authentication and displays appropriate guidance.

[0070] As described above, the processing system of the present embodiment includes an acquisition unit that acquires information based on a captured image of a user, and a processing unit that performs login and logout processing for the electronic device. In addition, when the processing unit determines that a gesture instructing the user to log out of the electronic device has been made based on the captured image of the user, the processing unit performs the logout processing.

[0071] In this way, when the user wants to finish using the electronic device, the user can contactlessly log out of the electronic device based on his or her own will, thereby improving the convenience of the electronic device.

[0072] Furthermore, the processing unit may perform logout processing when it determines that a gesture instructing logout has been made after a user has logged in through face authentication processing based on a captured image.

[0073] In this way, a user who logs in based on contactless face authentication can log out based on a contactless gesture, and can therefore log in and out of an electronic device in a contactless manner.

[0074] In addition, when a first login process based on an captured image is performed as a login process, the processing unit may perform a first logout process based on an captured image related to a gesture as a logout process, and when a second login process based on information other than the captured image is performed, the processing unit may perform a second logout process based on information other than the captured image as a logout process.

[0075] In this way, the method for logging in and out of the electronic device can be adapted to either a contactless method or a contact method.

[0076] Furthermore, when the first login process based on the captured image is performed as the login process, the processing unit may invalidate the second logout process.

[0077] In this way, a user who has selected to use an electronic device based on a contactless login can be prevented from logging out using a contact method.

[0078] In addition, the processing unit may perform, as the login process, a first login process based on a captured image and a second login process based on information other than the captured image, and when the first login process is performed, may disable a display on the display unit of the electronic device instructing a second logout process corresponding to the second login process.

[0079] In this way, the user can confirm that they have logged in contactlessly.

[0080] The second logout process may be a logout via an electronic medium, or a logout via a user's operation on the display unit.

[0081] In this way, it is possible to log out using a method other than information based on a captured image.

[0082] In addition, the processing unit may perform, as the login process, a first login process based on the captured image and a second login process based on information other than the captured image, and when the first login process is performed, a guidance display may be displayed on the display unit of the electronic device to instruct the user to perform a first logout process using a gesture corresponding to the first login process.

[0083] This allows the user to know that they must log out using a gesture.

[0084] Moreover, the server system of the present embodiment includes the above-mentioned processing system and a communication unit that communicates with the electronic device.

[0085] In this way, a server system can be constructed that acquires information based on captured images and performs login and logout processes for electronic devices.

[0086] The printing apparatus of the present embodiment includes the above-mentioned processing system and a printing unit.

[0087] In this way, a printing device can be configured that acquires information based on captured images and performs login and logout processes for electronic devices.

[0088] The program of the present embodiment relates to a program that causes a computer to function as an acquisition unit that acquires information based on a captured image of a user and a processing unit that performs login and logout processing for the electronic device. Furthermore, the processing unit performs logout processing when it determines that the user has made a gesture to instruct logging out of the electronic device based on the information based on the captured image of the user.

[0089] In addition, the processing method of this embodiment performs login processing for the electronic device, acquires information based on an image captured by the user, and, if it is determined based on the information based on the image captured by the user that the user has made a gesture to instruct the user to log out of the electronic device, performs logout processing for the electronic device.

[0090] Although the present embodiment has been described in detail as above, it will be easily understood by those skilled in the art that many modifications are possible without substantially departing from the novel matters and effects of the present disclosure. Therefore, all such modifications are intended to be included in the scope of the present disclosure. For example, a term described at least once in the specification or drawings together with a different term having a broader meaning or synonymy can be replaced with that different term anywhere in the specification or drawings. In addition, all combinations of the present embodiment and modifications are also included in the scope of the present disclosure. In addition, the configurations and operations of the processing system, server system, printing device, program, processing method, etc. are not limited to those described in the present embodiment, and various modifications are possible. [Explanation of symbols]

[0091] Reference Signs List 10... processing system, 20... imaging device, 30... first server, 100... second server, 110,410... acquisition unit, 120,420... processing unit, 130,430... communication unit, 200,400... electronic device, 240,440... display unit, 300... terminal device, 500... user authentication icon, 501... user display icon, 502... print button icon, 504... FAX button icon, 510... printing in progress icon, 520,522... printing waiting icon, 530... logout method guide icon, 540... logout button icon

Claims

1. an acquisition unit that acquires information based on a captured image of a user; A processing unit that performs login and logout processing for the electronic device; Including, The processing unit includes: The user logs out of the electronic device based on the captured image of the user. When it is determined that a gesture instructing the user to log out has been made, the logout process is performed. When a first login process based on the captured image is performed as the login process, As the logout process, a first logout process based on the captured image relating to the gesture is performed. Processing is performed. When a second login process based on information other than the captured image is performed, the logout process a second logout process based on information other than the captured image as a process for detecting the captured image; When the first login process based on the captured image is performed as the login process, and disabling the second logout process.

2. 2. The processing system of claim 1, The processing unit includes: After the user logs in through face authentication processing based on the captured image, When it is determined that the gesture instructing logout has been performed, the logout process A processing system comprising:

3. 3. The processing system according to claim 1, The processing unit includes: The login process includes a first login process based on the captured image and a second login process based on the captured image. A second login process based on the external information is performed. When the first login process is performed, the display unit of the electronic device displays the second login process. A processing system characterized in that a display instructing a second logout process corresponding to the process is invalidated. Tem.

4. 4. The processing system according to claim 1, The second logout process is the logout by electronic media or the logout by the user. The processing system according to claim 1, wherein the logout is performed by an operation on a display unit.

5. 3. The processing system according to claim 1, The processing unit includes: The login process includes a first login process based on the captured image and a second login process based on the captured image. A second login process based on the external information is performed. When the first login process is performed, a message indicating the first login process is displayed on the display unit of the electronic device. The user is prompted to perform a first logout process by the gesture corresponding to the first logout process. A processing system that displays guidance within a processing area.

6. A processing system according to any one of claims 1 to 5; A communication unit that communicates with the electronic device; A server system comprising:

7. A processing system according to any one of claims 1 to 5; A printing department; A printing device comprising:

8. an acquisition unit that acquires information based on a captured image of a user; A processing unit that performs login and logout processing for the electronic device, Make your computer work The processing unit includes: The user logs out of the electronic device based on the captured image of the user. When it is determined that a gesture instructing to log out has been made, the logout process is performed. When a first login process based on the captured image is performed as the login process, As the logout process, a first logout process based on the captured image relating to the gesture is performed. Processing is performed. When a second login process based on information other than the captured image is performed, the logout process a second logout process based on information other than the captured image as a process for detecting the captured image; When the first login process based on the captured image is performed as the login process, and a program for invalidating the second logout process.

9. A login process for an electronic device; Acquiring information based on a captured image of a user, and The user makes a gesture to log out of the electronic device. If it is determined that the user has logged out of the electronic device, When a first login process based on the captured image is performed as the login process, As the logout process, a first logout process based on the captured image relating to the gesture is performed. Processing and When a second login process based on information other than the captured image is performed, the logout process a second logout process based on information other than the captured image; When the first login process based on the captured image is performed, The processing method comprises disabling the second logout process.

Images