Processing system, server system, printing device, recording medium, and processing method

Abstract

The present invention provides an electronic device that allows a user to log out of the device at their own discretion. The processing system (10) includes: an acquisition unit (110) that acquires information based on a user's captured image; and a processing unit (120) that performs login processing and logout processing (step S30) for the electronic device. The processing unit (120) performs the following processing: if it is determined based on the user's captured image that the user has made a gesture indicating that the electronic device should log out, then it performs logout processing (step S30).

Description

Technical Field

[0001] This invention relates to a processing system, a server system, a printing apparatus, a program, and a processing method. Background Technology

[0002] A processing system that allows a user to log in to an electronic device when the user has been authenticated via facial recognition has been known for some time. Patent Document 1 discloses a method that automatically logs the electronic device out of the device after a certain period of time has elapsed since the user failed to authenticate.

[0003] If a uniform logout is implemented based on the inability of an electronic device to authenticate within a certain period, the device will log out even if the user temporarily leaves during use, thus contradicting the user's intention and reducing convenience. The method described in Patent Document 1 does not consider this situation.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2019-28719 Summary of the Invention

[0005] One aspect of this disclosure relates to a processing system comprising: an acquisition unit that acquires information based on a user's captured image; and a processing unit that performs login processing and logout processing for an electronic device, wherein the processing unit performs the logout processing if it is determined, based on the user's captured image, that the user has made a gesture instructing the electronic device to log out.

[0006] Furthermore, one aspect of this disclosure relates to a server system comprising: the processing system described above; and a communication unit that implements communication with an electronic device.

[0007] Furthermore, one aspect of this disclosure relates to a printing apparatus comprising: the processing system described above; and a printing unit.

[0008] Furthermore, one aspect of this disclosure relates to a recording medium storing a program that enables a computer to function as a component comprising: an acquisition unit that acquires information based on a user's captured image; and a processing unit that performs login processing and logout processing for an electronic device, wherein the processing unit performs the logout processing if it determines, based on the information obtained from the user's captured image, that the user has made a gesture instructing the electronic device to log out.

[0009] Furthermore, one aspect of this disclosure relates to a processing method that performs the following steps: performing login processing for an electronic device; obtaining information based on a user's captured image; and, if it is determined from the information obtained based on the user's captured image that the user has made a gesture indicating that the electronic device should log out, performing logout processing for the electronic device. Attached Figure Description

[0010] Figure 1 A block diagram illustrating an example of the structure of a processing system.

[0011] Figure 2 A diagram illustrating the processing flow of the processing system.

[0012] Figure 3 This is a flowchart illustrating the login process.

[0013] Figure 4 This is a flowchart illustrating the logout process.

[0014] Figure 5 A block diagram illustrating a more detailed structural example of the processing system.

[0015] Figure 6 A diagram illustrating the more detailed processing flow of the processing system.

[0016] Figure 7 This is a flowchart illustrating the login process in another embodiment.

[0017] Figure 8 This is a flowchart illustrating the first login process.

[0018] Figure 9 This is a flowchart illustrating the second login process.

[0019] Figure 10 This is a flowchart illustrating the logout process in another embodiment.

[0020] Figure 11 This is a flowchart illustrating the first logout process.

[0021] Figure 12 This is a flowchart illustrating the second logout process.

[0022] Figure 13 This is a diagram illustrating a screen example of a method applied according to this embodiment.

[0023] Figure 14 This is a diagram used to illustrate an example of a screen.

[0024] Figure 15This is a block diagram illustrating a variation of this embodiment. Detailed Implementation

[0025] The following describes this embodiment. Furthermore, the embodiment described below is not intended to unduly limit the content of this disclosure as described in the technical solution. Additionally, not all structures described in this embodiment are necessarily essential structural elements of this disclosure.

[0026] Figure 1 This is a block diagram illustrating the processing system 10 of this embodiment. The processing system 10 of this embodiment includes an acquisition unit 110 and a processing unit 120. The acquisition unit 110 is a communication interface for acquiring information obtained based on a user's captured image. This communication can be either wired or wireless. While the information obtained based on the user's captured image may include, for example, authentication result information from facial authentication performed based on the user's captured image, it could also be the captured image itself, or other information. Specifically, the authentication result information from facial authentication performed based on the user's captured image is information obtained by authenticating the captured user's facial image through facial authentication processing. Furthermore, although not shown in the diagram, the processing system 10 may also include a predetermined electronic device, which may further include a display unit. While the predetermined electronic device may be, for example, a printing device, it could also be other devices.

[0027] Additionally, the printing equipment mentioned here includes multifunction printers. A multifunction printer is a printer that includes functions other than a printer function. Although these functions other than a printer function may be copier, fax, or scanner functions, they can also be other functions.

[0028] The processing unit 120 implements control over various parts of the processing system 10, including the acquisition unit 110, the login and logout processes for the aforementioned electronic devices, and the task execution process. While the task here may be, for example, a printing task sent to and stored by a printing apparatus for the aforementioned electronic device, it could also be a command or instruction executed on other electronic devices. In the following description, the task can be appropriately referred to as a printing task. Specifically, the processing unit 120 is a processor or controller. While the processing unit 120 may be, for example, a main CPU (Central Processing Unit), it may also include multiple CPUs such as auxiliary CPUs. In this case, the main CPU implements control over various parts of the processing system 10 and overall control. The auxiliary CPUs, for example, implement... Figure 5The communication unit 130 described later includes a CPU for communication control. Furthermore, if the processing system 10 includes the printing apparatus described above, it may further include a CPU for controlling the printing apparatus. In addition, the processing unit 120 of this embodiment can be configured with the following hardware. The hardware can include at least one of circuitry for processing digital signals and circuitry for processing analog signals. The hardware can be configured, for example, by one or more circuit devices or one or more circuit elements mounted on a circuit board. Furthermore, the circuit device is, for example, an integrated circuit device. Furthermore, the circuit element is, for example, an active element such as a transistor, or a passive element such as a resistor or capacitor.

[0029] Furthermore, facial authentication processing refers to the process of judging the legitimacy of the person being authenticated by comparing the feature values ​​of a pre-registered facial image with the feature values ​​of the facial image of the person being authenticated. While various methods are listed in facial authentication processing, one example is the following: Facial portion detection is performed on both the captured user's facial image and the registered facial image; then, facial feature points are detected based on the detected facial portions; and further, facial similarity is calculated based on the detected facial feature points. If the calculated similarity exceeds a predetermined threshold, it is determined that the user in the captured facial image and the person in the registered facial image are the same person.

[0030] Facial detection can be achieved, for example, by using support vector machines to distinguish between the face and other areas of the face for the captured user's facial image and the registered facial image, respectively. Alternatively, it can be achieved by using deep neural networks or general learning vector quantization techniques to distinguish between the face and other areas of the face.

[0031] Facial feature point detection can be achieved by extracting feature points such as eyes, nose, and mouth from the face, calculating the positional relationships of these feature points and predetermined characteristics of their vicinity as feature quantities, and then setting these as feature vectors. However, other methods can also be used. Furthermore, predetermined characteristics refer to aspects such as color intensity and distribution.

[0032] The similarity of facial features can be calculated by methods such as calculating the chi-square distance or Euclidean distance between the feature vectors of the captured user's facial image and the registered facial image, but it can also be achieved by other methods.

[0033] In addition, facial authentication processing can, for example, utilize... Figure 5The imaging device 20 and the first server 30, as described later, are predetermined hardware components, the details of which will be described later. In this case, the information obtained based on the image captured by the acquisition unit 110 is the authentication result information of facial authentication performed based on the user's image. Furthermore, the processing unit 120 may also be predetermined hardware that performs the facial authentication processing procedure. In this case, the information obtained based on the image captured by the acquisition unit 110 is the image data itself sent from the hardware with the imaging function.

[0034] Next, the login and logout processes of the processing system 10 in this embodiment will be described. The processing system 10 performs the process of sending a login instruction to a predetermined electronic device when a predetermined login request is received. Although the subject sending the predetermined login request can be the predetermined electronic device, it can also be any other device as long as it has established a correspondence with the predetermined electronic device. Similarly, the processing system 10 performs the process of sending a logout instruction to a predetermined electronic device when a predetermined logout request is received. The predetermined login request and the predetermined logout request are, for example, composed of authentication information input via a contact input unit such as a button. Furthermore, the processing system 10 can also accept information obtained based on captured images as a login request and send a login instruction to the predetermined electronic device; for example, it can also perform the process based on information obtained using... Figure 3 The process is similar to the facial recognition login process (step S10) described later. Similarly, the processing system 10 can also accept information obtained based on the captured image as a logout request and send a logout instruction to a predetermined electronic device. For example, it can also perform actions such as... Figure 4 The process described later in the text is similar to the logout process (step S30).

[0035] In addition, in utilizing Figure 4 The logout process (step S30) described later can be combined with at least one of the predetermined login request or login process (step S10) described above. That is, the processing system 10 can also perform the logout process (step S30) after sending a login instruction to a predetermined electronic device based on a predetermined login request constituted by a contact method, thereby setting it as... Figure 2 The processing flow is as shown.

[0036] Figure 2 This diagram illustrates the process flow when the login process (step S10) and logout process (step S30) described above are combined. Figure 2In the text, the downward direction indicates the direction of time progression, but does not represent the specific length of time. The acquisition unit 110 receives information based on the captured image corresponding to the registration process (step S10) at a predetermined time. Then, the processing unit 120 performs the registration process (step S10). Thereafter, the acquisition unit 110 receives information based on the captured image corresponding to the exit registration process (step S30) at a time later than the predetermined time. Then, the processing unit 120 performs the exit registration process (step S30).

[0037] use Figure 3 , Figure 4 Come to Figure 2 The details of the processing will be explained. Figure 3 This is a flowchart illustrating a processing example of login processing (step S10). The processing unit 120 performs a process to determine whether the user is a registered user via facial authentication, and if it can determine that the user is a registered user ("Yes" in step S20), it performs a login acceptance process (step S22). For example, the following process is performed: using... Figure 5 In the first server 30 described later, facial authentication processing is performed. The acquisition unit 110 acquires information indicating that the person being photographed is the same person as the registered user. Based on this information, the processing unit 120 sends a login instruction to the printing device or the like described above. Alternatively, for example, the processing unit 120 may perform facial authentication processing, determine that the person being photographed is the same person as the registered user, and then send a login instruction to the printing device or the like.

[0038] Afterwards, the processing unit 120 performs the processing of sending screen information corresponding to the task status (step S24) and ends the process. The task status may refer to the number of tasks, but is not limited to this; it may also refer to the current state of the tasks. For example, if the task status is the number of tasks, whether to include tasks that encounter errors during transmission in the task count is up to the user to decide appropriately. Furthermore, predetermined printing conditions may be taken into account in the task status. Predetermined printing conditions may refer to, for example, the remaining amount of ink in the printing apparatus. For example, although... Figure 13 As will be described later, the processing unit 120 performs the processing of sending instructions to the printing device to display different types of screen information based on the number of printing tasks related to the user based on facial authentication.

[0039] On the other hand, if the processing unit 120 fails to determine that the user is already registered (no in step S20), it implements a login denial process (step S26) and terminates the process. The login denial process (step S26) may refer to, for example, the process of discarding the captured image data, but it is not limited to this; it may also include an error notification process.

[0040] Thus, the processing system 10 of this embodiment includes an acquisition unit 110 and a processing unit 120. The acquisition unit 110 acquires authentication result information of facial authentication performed based on a user's captured image, and the processing unit 120 performs processing related to the printing task. When the processing unit 120 determines, based on the authentication result information, that the user's login confirmed by facial authentication has been successful (Yes in step S20), it performs processing to display a screen on the display unit of the printing apparatus in a manner that differs depending on the status of the printing task corresponding to the user (step S24).

[0041] Thus, the processing system 10 of this embodiment, including the acquisition unit 110 and the processing unit 120, can process the authentication results of facial authentication performed based on captured images. Furthermore, the processing unit 120 can display appropriate screen information on the display unit of the printing apparatus according to the task status. This improves the convenience of the printing apparatus. For example, if a user registers the printing apparatus with only one stored print job, it is obviously more convenient for the user to perform printing along with the registration. On the other hand, if a user registers the printing apparatus with multiple stored print jobs, there is a possibility that the user does not intend to print all the stored print jobs. Or, there is a possibility that the user intends to delete a mistakenly sent print job through the operation of the printing apparatus. In such cases, it is inappropriate to uniformly print all print jobs along with the registration process. Furthermore, even if the printing apparatus has only one stored print job, it is also inappropriate to perform printing when the ink level in the printing apparatus is insufficient. In this respect, by applying the method of this embodiment, it is possible to display appropriate screen information according to the situation of the task.

[0042] Furthermore, the method described in this embodiment can also be implemented through a program. That is, the program in this embodiment functions as an acquisition unit 110 and a processing unit 120, wherein the acquisition unit 110 acquires authentication result information based on facial authentication performed on a captured image of the user, and the processing unit 120 performs processing related to the printing task. Furthermore, when the processing unit 120 determines, based on the authentication result information, that the user's login via facial authentication has been successful, it performs processing to display a screen on the display unit of the printing apparatus in a manner that differs depending on the status of the printing task corresponding to the user. Thus, the same effects as described above can be obtained.

[0043] Figure 4 This is a flowchart illustrating an example of the logout process (step S30). The processing unit 120 performs a process (step S40) to determine whether the information obtained based on the captured image is a gesture indicating a logout instruction. Specifically, the processing system 10, for example, pre-stores information related to the gesture indicating a logout instruction in a memory (not shown). Then, the user makes a predetermined gesture using the hardware used in facial authentication. Furthermore, the processing unit 120, through the aforementioned process, determines whether the similarity between the captured image obtained based on the user's gesture and the stored gesture-related information exceeds a predetermined threshold. If the processing unit 120 can determine that it is a gesture indicating a logout instruction ("yes" in step S40), it performs a logout acceptance process (step S42) and ends the process. Specifically, if the similarity exceeds the predetermined threshold, the processing unit 120 performs a process of sending an instruction indicating a logout instruction to the printing device (as described above). On the other hand, if the processing unit 120 fails to determine that the information obtained based on the captured image is a gesture indicating an exit from login (no in step S40), it implements the process of refusing to exit from login (step S46) and terminates the process. The process of refusing to exit from login (step S46) may, for example, refer to the process of discarding the captured image data related to the gesture, but error reporting may also be implemented as an additional step.

[0044] Here, gestures can refer to actions such as shaking the hand left, right, back, or forward, or bending and stretching the fingers, but are not limited to these. They can also refer to predetermined facial expressions, head or shoulder movements, or predetermined postures. Predetermined facial expressions include, for example, making a surprised expression with open eyes or mouth, closing one eye, or blinking a predetermined number of times. Predetermined postures include, for example, making a shape with the fingers that resembles the alphabet or other written characters for a certain period of time.

[0045] Thus, the processing system 10 of this embodiment includes an acquisition unit 110 and a processing unit 120. The acquisition unit 110 acquires information based on images captured by the user, and the processing unit 120 performs login and logout processing for the electronic device (step S30). When the processing unit 120 determines, based on the user's captured image, that the user has made a gesture indicating that they wish to log out of the electronic device, it performs logout processing (step S30). Therefore, since the processing system 10 of this embodiment includes an acquisition unit 110 and a processing unit 120, it is possible to perform processing that sends login or logout instructions to a predetermined electronic device based on information obtained from captured images. Furthermore, since the processing unit 120 performs logout processing when it determines that a gesture has been made, the user can log out of the electronic device without contact when they wish to end use of the device. Previously, electronic devices would log out after a certain period of time has passed since the user left the shooting range, sometimes resulting in unintended logouts when the user leaves the shooting range during intended use of the electronic device, causing inconvenience issues. In this respect, by applying the method of this embodiment, users can perform the intended logout when they wish to end their use of the electronic device. Such a processing system does not exist to date.

[0046] Furthermore, the method described in this embodiment can also be implemented through a program. That is, the program in this embodiment functions as an acquisition unit 110 and a processing unit 120, wherein the acquisition unit 110 acquires information based on images captured by the user, and the processing unit 120 performs login and logout processing for the electronic device. Furthermore, if the processing unit 120 determines, based on information obtained from images captured by the user, that the user has made a gesture indicating that they wish to log out of the electronic device, it performs the logout processing. Thus, the same effects as described above can be achieved.

[0047] Furthermore, the method described in this embodiment can also be implemented through a processing method. That is, the processing method of this embodiment performs login processing for the electronic device and logout processing for the electronic device when information obtained based on a user's photographed image is acquired and a gesture indicating that the user has indicated a logout of the electronic device is determined based on the information obtained based on the user's photographed image. Thus, the same effects as described above can be obtained.

[0048] In addition, like Figure 2In this way, after performing the login process (step S10) determined by the information obtained from the captured image corresponding to the login process (step S10), the processing unit 120 can also perform the logout login process (step S30) determined by the information obtained from the captured image corresponding to the logout login process (step S30). That is, the processing unit 120 performs the logout login process when it determines that a user has performed login through facial authentication processing based on the captured image and has made a gesture indicating logout. By adopting this method, since users who have performed login through contactless facial authentication can perform logout through contactless gestures, login and logout to a predetermined electronic device can be performed in a contactless manner. Especially when there are multiple types of authentication methods, there may be cases where users who have performed login through facial authentication intend to log in in a contactless manner. In this regard, by applying the method of this embodiment, convenience is improved because login can be performed in a contactless manner.

[0049] Furthermore, the processing system 10 of this embodiment is not limited to the structure described above, and can be modified in various ways, such as by adding other structural elements. Figure 5 This is a block diagram illustrating a more detailed structural example of the processing system 10 of this embodiment. Figure 5 The processing system 10 includes a shooting device 20, a first server 30, a second server 100, an electronic device 200, and a terminal device 300. The second server 100 includes the acquisition unit 110 and processing unit 120 described above, and also includes a communication unit 130. The electronic device 200 includes a display unit 240. The communication unit 130 is an interface for communication connection with the electronic device 200 and the terminal device 300, but it may also be the same interface as the acquisition unit 110 described above. The electronic device 200 is, for example, a printing device, but it may also be other devices. Additionally, if the electronic device 200 is a printing device, it also includes a printing unit (not shown).

[0050] Figure 5 The functions of the acquisition unit 110 and the processing unit 120 are respectively related to Figure 1 This corresponds to a part of the functions of the acquisition unit 110 and the processing unit 120. Therefore, the second server 100 can also be considered as... Figure 1 The processing system 10 further includes a server system with a communication unit 130. In other words, the server system of this embodiment includes the processing system 10 described above and the communication unit 130 that performs communication with the electronic device 200. By employing this method, a server system can be constructed that acquires information based on captured images and performs login and logout processing for the electronic device 200.

[0051] The imaging device 20 is located at a predetermined location near the electronic device 200. It captures images of the user who wants to operate the electronic device 200 and sends the captured image information to the first server 30, described later. Furthermore, the imaging device 20 and the electronic device 200 do not need to have a direct communication connection. This is because, since the captured image information contains the imaging device 20's own identification information, the user can associate the identification information of the imaging device 20 with the identification information of the electronic device 200, thereby knowing which imaging device 20 corresponds to which electronic device 200. Although the imaging device 20 can be implemented, for example, by a near-infrared camera, it can also be other types of cameras. Furthermore, the imaging device 20 can also be composed of multiple cameras.

[0052] exist Figure 5 In this case, the first server 30 performs facial authentication based on the captured image information described above, and sends the information obtained based on the captured image to the second server 100. The information obtained based on the captured image is the authentication result information of the facial authentication. The first server 30 includes a memory (not shown). Although the memory may store, for example, the facial authentication program and the image information related to the registered user's face used in facial authentication, the gesture-related image information described above can also be stored in advance. The first server 30 can implement facial authentication processing by including hardware such as a processor or controller in addition to the memory described above.

[0053] The second server 100 receives information based on captured images from the first server 30 and determines whether to accept or log out of the electronic device 200 corresponding to the capturing device 20. Furthermore, the second server 100 receives predetermined task data from the terminal device 300 and stores this task data in a memory (not shown). The predetermined task data, for example, refers to printing task data if the electronic device 200 is a printing device. Additionally, the predetermined task data sent by the terminal device 300 includes user identification information. Therefore, when logging into the electronic device 200, information about tasks related to the logged-in user is displayed on the display unit 240.

[0054] The display unit 240 can be implemented, for example, by a liquid crystal display (LCD), but it can also be implemented by an organic EL display or a dot matrix LED. Furthermore, the display unit 240 can be integrated with an operation unit (not shown) via a touch panel, or it can be used together with a notification unit (not shown) to provide notifications related to the electronic device 200 to the user. In this embodiment, the display unit 240 is a touch panel.

[0055] Figure 6 To Figure 5 The diagram illustrates the overall processing flow of the processing system 10. Here, the electronic device 200 is assumed to be a printing apparatus. The terminal device 300 sends a printing task to the second server 100, and the second server 100 performs printing task storage processing. Subsequently, the second server 100 receives either a first login request or a second login request. The first login request is authentication information sent from the first server 30 based on image information captured by the imaging device 20. The second login request is authentication information not based on image information; it may be, for example, authentication information sent by the user through input to a predetermined operation unit, or authentication information obtained using a predetermined electronic medium. The predetermined operation unit may refer to a button (not shown), but could also be the touch panel of the display unit 240.

[0056] After receiving the first registration request or the second registration request, the processing unit 120 performs registration processing on the printing device (step S100). Additionally, although in Figure 6 The diagram illustrates both the first login request and the second login request, but in reality, only one of them is sent to the second server 100. The same applies to the first and second logout requests described later. Subsequently, when the processing unit 120 receives a print data request from the printing device based on user-related task information displayed on the display unit 240 (step S200), it performs print data transmission (step S210). Thus, the printing device performs printing based on the received print data, allowing the user to obtain the desired printed material. Furthermore, depending on the task status, there are cases where print data is sent to the printing device even without a print data request (step S200); details will be provided later. Figure 8 This will be described later.

[0057] Subsequently, the second server 100 receives either a first logout request or a second logout request. The first logout request refers to authentication information sent from the first server 30 based on gesture image information sent from the capturing device 20. Similarly, the second logout request is authentication information not based on captured image information. After receiving either the first or second logout request, the processing unit 120 performs logout processing on the printing device (step S300).

[0058] Next, use Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 , Figure 12 Come to Figure 6The specific details of each process will be explained. Here, we will describe an example where the display of the login screen implemented by facial authentication differs depending on the number of printing jobs, which is an example of the printing job status. That is, the processing unit 120 performs processing to cause the display unit 240 to display a screen in a manner that differs depending on the number of printing jobs. By employing this method, the electronic device 200 can cause the display unit 240 to display appropriate screen information according to the number of printing jobs.

[0059] Figure 7 This is a flowchart explaining the login process (step S100). The processing unit 120 performs a process to determine whether the login request is a first login request or a second login request. If the login request is a first login request ("Yes" in step S110), the first login process is performed (step S120), and the process ends. On the other hand, if the login request is a second login request ("No" in step S110), the processing unit 120 performs a second login process (step S220), and the process ends.

[0060] Figure 8 This is a flowchart illustrating the first login process (step S120). Processing unit 120 performs user authentication (step S122). If a problem exists in user authentication, subsequent processing is not advanced; however, this is assumed that no problem exists in user authentication and processing proceeds. (For details described below...) Figure 9 , Figure 13 , Figure 14 The same applies to the description. Thereafter, the processing unit 120 performs a process to determine whether the number of the user's print jobs stored in the printing apparatus is zero. If the number of print jobs is zero (yes in step S130), it performs a process to send an instruction to the printing apparatus to display the product on the display unit 24 in a first display mode (step S132). Afterward, it performs the processing from step S160 onward. On the other hand, if the number of print jobs is not zero (no in step S130), the processing unit 120 performs a process to determine whether the number of print jobs is one. If the number of print jobs is one (yes in step S140), it performs a process to send the print job data to the printing apparatus (step S142), and performs a process to send an instruction to display the product on the display unit 240 in a second display mode to the printing apparatus (step S144). Afterward, it performs the processing from step S160 onward. Furthermore, step S142 is equivalent to... Figure 6The processing described in step S210 above involves the printing apparatus receiving the printing task data sent in step S142 and performing printing based on that data. Thus, even without implementing [the necessary technology / methods]... Figure 6 In step S200 described above, printing task data may also be sent to the printing apparatus. Furthermore, if the number of printing tasks is 2 or more ("No" in step S140), the processing unit 120 performs a process of sending an instruction to the printing apparatus to display the display unit 240 in a third display mode (step S150), and then performs the processing after step S160.

[0061] Thus, in the first registration process (step S120) of this embodiment, the processing unit 120 performs the following processing: it divides the number of tasks into three modes and displays a screen on the display unit 240 with a different display method depending on each mode. Specifically, when the number of printing tasks related to the user who has successfully registered is one piece, the processing unit 120 displays a screen in the first display mode. Furthermore, when the number of printing tasks related to the user who has successfully registered is one piece, the processing unit 120 displays a screen in the second display mode. And, when the number of printing tasks related to the user who has successfully registered is two or more pieces, the processing unit 120 displays a screen in the third display mode. By employing this method, appropriate guidance display can be performed according to the number of printing tasks.

[0062] Specifically, the processing unit 120 of the second server 100, which is part of the server system, generates display screen data implemented in the first display mode to the third display mode. Thereafter, the processing unit 120 performs the process of transmitting the display screen data to the electronic device 200, which is a printing apparatus, via the communication unit 130 at a predetermined time. Figure 9 The same applies to steps S232 and S250. That is, the server system of this embodiment includes the processing system 10 described above and a communication unit 130 that communicates with the electronic device 200, which is a printing apparatus. The processing unit 120, via the communication unit 130, instructs the display unit 240 of the electronic device 200, which displays screens with different display modes depending on the printing task. By employing this method, a server system that generates appropriate guidance displays and displays such guidance displays on the printing apparatus can be constructed. Furthermore, specific screen examples for the first to third display modes will be provided using… Figure 13 This will be described later.

[0063] Subsequently, the processing department 120 implemented its use. Figure 12The process of invalidating the second logout process (step S330) will be described later (step S160). In other words, if the processing unit 120 performs the first logout process (step S120) based on the captured image as a login process, it will invalidate the second logout process (step S330). By employing this method, users who have selected to use the electronic device 200 based on contactless login will not be required to log out via contact.

[0064] Specifically, the implementation of generation will not utilize Figure 14 The logout button icon 540, described later, reflects the image data processing in the first to third display modes mentioned above. That is, the processing unit 120 performs a first login process based on the captured image (step S120) and a second login process based on information other than the captured image (step S220). Furthermore, when the first login process (step S120) is performed, the processing unit 120 disables the display of the second logout process (step S330) corresponding to the second login process (step S220) on the display unit 240 of the electronic device 200. By employing this method, the user can confirm whether they have logged in using a contactless method.

[0065] Subsequently, the processing unit 120 performs the process of overlaying the guide display (step S162). Specifically, although using Figure 13 As described later, the processing unit 120 performs the process of generating image data that reflects the logout login method guide icon 530 in the first to third display modes described above. Furthermore, since step S162 is a process performed when login is achieved through facial authentication, it is beneficial to display... Figure 13 The appearance of the login exit guide icon 530, described later, indicates that facial authentication has been successful. In other words, in this embodiment, the processing unit 120 displays a notification on the display unit 240 of the printing device that facial authentication has been successful when it has. By employing this method, the user can confirm that login via facial authentication has been successfully completed.

[0066] Figure 9This is a flowchart illustrating the second login process (step S220). Processing unit 120 performs user authentication (step S222) in the same manner as step S122 described above. Then, processing unit 120 determines whether the number of print jobs stored in the printing apparatus for the user is zero. If the number of print jobs is zero (yes in step S230), processing is performed to display the print job in a first display mode (step S232), and then processing is performed in step S260. On the other hand, if the number of print jobs is not zero (no in step S230), processing unit 120 sends an instruction to the printing apparatus to display the print job in a third display mode on display unit 240 (step S250), and then processing is performed in step S260.

[0067] Subsequently, the processing department 120 implemented its use. Figure 12 The second logout process (step S330), described later, is then validated (step S260). Specifically, although it utilizes... Figure 14 As will be described later, the implementation involves sending an instruction to the printing device to indicate the meaning of displaying the logout button icon 540 on the display unit 240.

[0068] according to Figure 8 and Figure 9 When the first login process (step S120) is executed, the user can only log out via the first logout process (step S320). Furthermore, since there is no equivalent in the second login process (step S220)... Figure 8 The processing in step S162 will therefore not cause any damage to the exploit. Figure 13 In the case where the logout method guide icon 530 is displayed as described later, the user cannot understand the gesture-based logout method, thus prompting them to naturally log out using the second logout process (step S330). Therefore, in this embodiment, when the processing unit 120 performs a first login process based on a captured image (step S120) as login processing, it performs a first logout process based on a gesture-related captured image (step S320) as logout processing. Furthermore, when the processing unit 120 performs a second login process based on information other than the captured image (step S220), it performs a second logout process based on information other than the captured image (step S330) as logout processing. By employing this method, the login and logout methods to the electronic device 200 can be matched with either a contactless or contact method.

[0069] Figure 10This is a flowchart explaining the logout process (step S300). The processing unit 120 performs a process to determine whether the logout request is a first logout request based on gesture image information. If the logout request is a first logout request ("Yes" in step S310), the processing unit 120 performs the first logout process (step S320) and ends the process. On the other hand, if the logout request is not a first logout request, i.e., a second logout request ("No" in step S310), the processing unit 120 performs the second logout process (step S330) and ends the process.

[0070] Figure 11 This is a flowchart illustrating the first logout process (step S320). The processing unit 120 performs a process to determine whether the gesture image information meets the first logout condition (step S322). The gesture image information here includes information obtained based on a gesture image captured as a photograph. The first logout condition, for example, is that the similarity between the gesture image obtained based on the user's gesture and a registered gesture image exceeds a predetermined threshold. Furthermore, if the information obtained based on the gesture image is text or numbers, the first logout condition may also be that the text or numbers obtained based on the photographed gesture image are identical to the registered text or numbers. If the processing unit 120 determines that the gesture image information meets the first logout condition ("Yes" in step S322), it performs a logout acceptance process (step S324) and ends the process. For example, the processing unit 120 performs a process to generate screen display data prior to the aforementioned login process (step S100) and a process to send the screen display data to the printing device.

[0071] On the other hand, if the processing unit 120 determines that the gesture image information does not meet the first logout condition (no in step S322), it implements the process of refusing to log out (step S326) and ends the process. Specifically, the processing unit 120 reports cases where the similarity between the gesture image obtained based on the user's gesture and the registered gesture image does not exceed a predetermined threshold, but it is not limited to this. For example, the processing unit 120 may also report cases where the text or numbers obtained based on the user's gesture are inconsistent with the registered text or numbers.

[0072] Alternatively, a process can be added to make the second logout process (step S330) described above effective again. This is because the logout rejection may also be caused by malfunctions in the processing system 10, etc.

[0073] Figure 12This is a flowchart explaining the second logout process (step S330). The processing unit 120 performs a process to determine whether the information obtained from the electronic medium or the user's operation meets the second logout conditions. That is, the second logout process (step S330) is a logout performed by the electronic medium or a logout based on the user's operation to the display unit 240. By adopting this method, it is possible to log out using methods other than information obtained based on captured images. The second logout condition is, for example, the case where the information obtained based on the ID card used in the logout is consistent with the information registered as a logged-in user. If the processing unit 120 determines that the information obtained from the electronic medium or the user's operation meets the second logout conditions ("Yes" in step S332), it performs a logout acceptance process (step S334). Specifically, it is the same as step S324 described above.

[0074] On the other hand, if the processing unit 120 determines that the information obtained from the electronic medium or the user's operation does not meet the second logout condition ("No" in step S332), it performs a logout rejection process (step S336) and ends the process. For example, if a logout is performed using an ID card belonging to a user different from the already logged-in user, a process is implemented to send an instruction indicating the meaning of this situation to the printing device, which will be displayed on the display unit 240. Furthermore, it is generally not considered that the logout button icon 540, described later, will be selected to reject the logout.

[0075] Figure 13 Here is a screen example demonstrating the application of the method described in this embodiment. When the electronic device 200 is powered on, the display unit 240 displays the user authentication icon 500. Furthermore, if the user selects login via facial authentication, i.e., a first login request is made, the processing unit 120 performs a process utilizing... Figure 8 The first login process described above (step S100) is then performed. Therefore, depending on the number of tasks, a display image implemented by any one of the first display mode, second display mode, and third display mode described above is displayed on the display unit 240.

[0076] Furthermore, for any of the first to third display modes, a user display icon 501 is displayed on the display unit 240. This allows the user to confirm that user authentication (step S122) has been performed. Additionally, for any of the first to third display modes, as shown in A1, A2, and A3, the display is not shown on the display unit 240. Figure 14The logout button icon 540, described later, is used because it also performs exploitation for any of the first to third display modes. Figure 8 This is due to the processing in step S160 described above. In addition to completely removing the logout button icon 540, the processing unit 120 can also make it semi-transparent, etc. Figure 14 The logout button icon 540 shown can be displayed in a different way than other methods. Alternatively, the logout button icon 540 can be displayed but touch panel operations can be disabled.

[0077] When the number of print jobs is zero ("Yes" in step S130), the display unit 240 displays a list of the print button icon 502, fax button icon 504, copy button icon 506, and scan button icon 508 as a first display mode. In other words, the first display mode is a list of the functions of the printing apparatus. Thus, for a successfully logged-in user, when the number of print jobs is parts, the processing unit 120 performs the process of displaying a list of the functions of the printing apparatus. By employing this method, the user can freely select the content they wish to perform on the printing apparatus.

[0078] When the number of print jobs is 1 ("Yes" in step S140), the display unit 240 displays the printing execution icon 510 as a second display mode. That is, the second display mode indicates that printing is being executed. Thus, for a successfully logged-in user, when the number of print jobs is one, the processing unit 120 executes the printing process and displays a printing execution screen. By employing this method, the user can have the printing device execute stored print jobs upon login.

[0079] When the number of print jobs is two or more ("No" in step S140), the display unit 240 displays the print waiting icons 520 and 522 as a third display mode. That is, the third display mode is a list of print jobs that have not yet been printed. Thus, for users who have successfully logged in, the processing unit 120 performs the process of displaying a list of multiple print jobs when the number of print jobs is two or more. By adopting this method, users can take appropriate measures for two or more print jobs.

[0080] Furthermore, for any of the first to third display modes, a logout guide icon 530 is displayed on the display unit 240. This is because the operation is performed for any of the first to third display modes. Figure 8This is due to the processing in step S162 described above.

[0081] The logout method guide icon 530 is a display indicating to the user, in the case of logging in via facial recognition (i.e., the first login process, step S120), that logout can be performed using a gesture. In other words, the processing unit 120 performs the first login process based on the captured image (step S120) and the second login process based on information other than the captured image (step S220). Furthermore, when the first login process (step S120) is performed, the processing unit 120 displays a guide on the display unit 240 of the electronic device 200 to the user to perform the first logout process (step S320) using a gesture, corresponding to the first login process (step S120). By employing this method, the user can understand that logout must be performed using a gesture.

[0082] Figure 14 An example screen showing the situation where the processing unit 120 has performed the second login process (step S220). Figure 14 In this case, the display implemented by the third display method ("No" in step S230) is different from the first login process (step S120) in that the number of printing jobs is 1, and in that the printing wait icon 520 is displayed on the display unit 240. Furthermore, since the second logout login process is enabled (step S260), the logout login button icon 540 is displayed on the display unit 240 regardless of the number of printing jobs. Furthermore, since the second logout login process is not implemented... Figure 8 The processing in step S162 differs from steps B1, B2, and B3 in that the logout method guide icon 530 is not displayed on the display unit 240 regardless of the number of printing jobs. The user can log out of the electronic device 200 by selecting the logout button icon 540 using the touch panel. In other words, the logout button icon 540 is a contact-based logout unit. Furthermore, although the illustration is omitted, in addition to the logout button icon 540, a logout method using an ID card or similar device can also be employed.

[0083] Furthermore, the methods described in this embodiment are not limited to the above content and can be implemented in various variations. Figure 15 This is a block diagram illustrating a variation of this embodiment. Figure 15 In the processing system 10, the electronic device 400 also has Figure 5 Regarding the role of the second server 100, and Figure 5There are some differences. That is, the electronic device 400 includes an acquisition unit 410, a processing unit 420, a communication unit 430, and a display unit 440. The acquisition unit 410 corresponds to... Figure 1 The acquisition unit 110 and the processing unit 420 correspond to Figure 1 The processing unit 120 and the communication unit 430 correspond to Figure 5 The communication unit 130 and the display unit 440 correspond to Figure 5 The display unit 240. Furthermore, the electronic device 400 may also be a printing apparatus, in which case it further includes a printing unit (not shown). Therefore, the electronic device 400 can also be considered as... Figure 1 The processing system 10 further includes a printing apparatus with a printing unit. By employing this method, a printing apparatus can be configured to perform its own login and logout processes by acquiring information based on captured images. Furthermore, a printing apparatus capable of implementing facial recognition-based login processing and providing appropriate guidance displays can be provided.

[0084] As described above, the processing system of this embodiment includes: an acquisition unit that acquires information based on images captured by a user; and a processing unit that performs login processing and logout processing for the electronic device. Furthermore, if the processing unit determines, based on the user's captured image, that the user has made a gesture instructing the electronic device to log out, it performs logout processing.

[0085] By adopting this method, users can log out of their electronic devices without contact when they wish to stop using them. This improves the convenience of electronic devices.

[0086] Alternatively, the processing unit may perform the following process: after a user has logged in through facial authentication based on a captured image, if it determines that a gesture indicating logout has been made, it performs logout processing.

[0087] By adopting this method, users who have logged in through contactless facial authentication can log out through contactless gestures, thus enabling contactless login and logout of electronic devices.

[0088] Alternatively, the processing unit may be configured to perform the following processing: when a first login process based on a captured image is performed as a login process, a first logout login process based on a captured image related to a gesture is performed as a logout login process; and when a second login process based on information other than a captured image is performed, a second logout login process based on information other than a captured image is performed as a logout login process.

[0089] By adopting this method, it is possible to match the login and logout methods for electronic devices with either contactless or contactless methods.

[0090] Alternatively, the processing unit may perform the following process: if a first login process based on a captured image is performed as a login process, the second logout process is invalidated.

[0091] By adopting this method, users who have chosen to use electronic devices based on contactless login will not have to log out based on contact.

[0092] Alternatively, the processing unit may perform the following processing: as a login process, it performs a first login process based on the captured image and a second login process based on information other than the captured image; and when the first login process is performed, it invalidates the display of the second logout process corresponding to the second login process on the display unit of the electronic device.

[0093] This approach allows users to confirm that they have logged in without contact.

[0094] In addition, the second logout process can also be a logout implemented by electronic media or a logout implemented by the user through an operation on the display unit.

[0095] By adopting this method, it becomes possible to log out using methods other than information obtained based on captured images.

[0096] Alternatively, the processing unit may perform the following processing: a first login process based on the captured image and a second login process based on information other than the captured image. If the first login process is performed, a guidance display is displayed on the display unit of the electronic device to guide the user to perform a first logout process implemented by gestures corresponding to the first login process.

[0097] By adopting this method, users can understand when they must log out using a gesture.

[0098] Furthermore, the server system of this embodiment includes: the processing system described above; and a communication unit that implements communication with electronic devices.

[0099] By adopting this method, it is possible to construct a server system that acquires information based on captured images and performs login and logout processing for electronic devices.

[0100] Furthermore, the printing apparatus of this embodiment includes: the processing system described above; and a printing unit.

[0101] By employing this method, it is possible to construct a printing apparatus that acquires information based on captured images and performs login and logout processing for electronic devices.

[0102] Furthermore, the program of this embodiment relates to a program that enables the computer to function as the following components: an acquisition unit that acquires information based on images captured by the user; and a processing unit that performs login processing and logout processing for the electronic device. The processing unit performs the following processing: if it determines, based on the information obtained from the user's captured images, that the user has made a gesture instructing the electronic device to log out, it performs logout processing.

[0103] Furthermore, the processing method of this embodiment performs the following processing: performing login processing for the electronic device; obtaining information based on a user's captured image; and, if it is determined from the information obtained based on the user's captured image that the user has made a gesture indicating that the electronic device should log out, performing logout processing for the electronic device.

[0104] Furthermore, although this embodiment has been described in detail above, it will be readily understood by those skilled in the art that numerous modifications can be implemented without substantially departing from the novel aspects and effects of this disclosure. Therefore, all such modifications are included within the scope of this disclosure. For example, a term described at least once in the specification or drawings along with a more general or synonymous term can be replaced anywhere in the specification or drawings with that different term. Moreover, all combinations of this embodiment and its modifications are also included within the scope of this disclosure. Furthermore, the structure and operation of processing systems, server systems, printing apparatuses, programs, and processing methods are not limited to those described in this embodiment, and various modifications are possible.

[0105] Symbol Explanation

[0106] 10…Processing system; 20…Shooting device; 30…First server; 100…Second server; 110, 410…Acquisition unit; 120, 420…Processing unit; 130, 430…Communication unit; 200, 400…Electronic device; 240, 440…Display unit; 300…Terminal device; 500…User authentication icon; 501…User display icon; 502…Printing button icon; 504…FAX button icon; 510…Printing in progress icon; 520, 522…Printing waiting icon; 530…Logout guide icon; 540…Logout button icon.

Claims

1. A processing system, characterized in that, include: The acquisition unit acquires information based on images captured by the user; The processing unit handles the login and logout processes for electronic devices. The processing unit performs the following processing, namely, If, based on the user's captured image, it is determined that the user has made a gesture instructing the electronic device to log out, the logout process is executed. If a first login process based on the captured image is performed as the login process, then a first logout process based on the captured image related to the gesture is performed as the logout process. If a second login process based on information other than the captured image is implemented, a second logout process based on information other than the captured image is implemented as the logout process.

2. The processing system as described in claim 1, characterized in that, The processing unit performs the following processing, namely, After the user has logged in through facial authentication processing based on the captured image, the logout process is performed if it is determined that the gesture indicating logout has been made.

3. The processing system as described in claim 1, characterized in that, The processing unit performs the following processing, namely, If the first login process based on the captured image is performed as the login process, the second logout process is invalidated.

4. The processing system as described in any one of claims 1 to 3, characterized in that, The second logout process is either a logout implemented by an electronic medium or a logout implemented by the user through an operation on the display unit.

5. A processing system, characterized in that, include: The acquisition unit acquires information based on images captured by the user; The processing unit handles the login and logout processes for electronic devices. The processing unit performs the following processing, namely, If, based on the user's captured image, it is determined that the user has made a gesture instructing the electronic device to log out, the logout process is executed. The login process includes a first login process based on the captured image and a second login process based on information other than the captured image. If the first login process is performed, the display indicating the second logout process corresponding to the second login process will be set to invalid.

6. The processing system as described in claim 5, characterized in that, The second logout process is either a logout implemented by an electronic medium or a logout implemented by the user through an operation on the display unit.

7. A processing system, characterized in that, include: The acquisition unit acquires information based on images captured by the user; The processing unit handles the login and logout processes for electronic devices. The processing unit performs the following processing, namely, If, based on the user's captured image, it is determined that the user has made a gesture instructing the electronic device to log out, the logout process is executed. The login process includes a first login process based on the captured image and a second login process based on information other than the captured image. If the first login process is performed, a guidance display is implemented on the display of the electronic device to guide the user to perform a first logout process corresponding to the first login process by the gesture.

8. A server system, characterized in that, include: The processing system according to any one of claims 1 to 7; The communications unit implements communication with the electronic device.

9. A printing apparatus, characterized in that, include: The processing system according to any one of claims 1 to 7; Printing department.

10. A recording medium, characterized in that, The computer contains programs that enable it to function as a component, wherein the component is: The acquisition unit acquires information based on images captured by the user; The processing unit handles the login and logout processes for electronic devices. The processing unit performs the following processing, namely, If, based on information obtained from the user's captured image, it is determined that the user has made a gesture instructing the electronic device to log out, the logout process is executed. If a first login process based on the captured image is performed as the login process, then a first logout process based on the captured image related to the gesture is performed as the logout process. If a second login process based on information other than the captured image is implemented, a second logout process based on information other than the captured image is implemented as the logout process.

11. A processing method, characterized in that, The following processing will be implemented: Implement login processing for electronic devices; Information obtained based on images captured by the user is acquired, and if it is determined based on the information obtained based on the images captured by the user that the user has made a gesture instructing the electronic device to log out, the user is logged out of the electronic device. If a first login process based on the captured image is performed as the login process, then a first logout process based on the captured image related to the gesture is performed as the logout process. If a second login process based on information other than the captured image is implemented, a second logout process based on information other than the captured image is implemented as the logout process.

Images