Information Processing Apparatus, Information Processing System, Information Processing Method, and Program

Abstract

An information processing device (10) includes an authentication control unit (13) for controlling biometric authentication based on a photographed image of a first user, a position estimating unit (14) that, in a case of successful biometric authentication, estimates a position of the first user in an object space, on the basis of position information of a first user terminal that the first user uses, and an output control unit (16) that outputs output information in which the position of the first user, and external appearance information including at least one of the photographed image of the first user and data relating to external appearance that is generated on the basis of the photographed image, are associated.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing system, an information processing method, and a non-transitory computer-readable medium, and particularly relates to an information processing apparatus, an information processing system, an information processing method, and a non-transitory computer-readable medium that output a user's location.

Background Art

[0002] In recent years, technologies for grasping the locations of employees have been proposed. For example, Patent Document 1 discloses a position estimation system that estimates the position of a moving body from the state of carrying a sensor terminal by the moving body and the position of the sensor terminal.

[0003] Also, for example, in Patent Document 2, a communication support system is disclosed that detects the respective locations of a plurality of employees based on information of a wireless AP to which the user's mobile terminal is connected, and provides data of a screen that displays the locations together with thumbnail images of the employees to terminals of other users.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the method described in Patent Document 1 above, even if the position of the target person is known, when there are a plurality of people on the same floor, there is a problem that it is difficult to actually find the target person.

[0006] Also, in the method described in Patent Document 2 above, even if the location of an employee is known, if the appearance of the user on that day is unknown, there is a problem that it takes time to actually find the employee. In particular, if the clothing or hairstyle changes, it becomes even more difficult to find the employee.

[0007] An object of the present disclosure is to provide an information processing apparatus, an information processing system, an information processing method, and a non-transitory computer-readable medium that suitably assist in finding a user in a space in view of the above-described problems.

Means for Solving the Problems

[0008] An information processing apparatus according to an aspect of the present disclosure includes: authentication control means for controlling biometric authentication based on a captured image of a first user; position estimation means for estimating the position of the first user in a target space based on the position information of a first user terminal used by the first user when the biometric authentication is successful; output control means for outputting output information in which the position of the first user and appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image are associated with each other and is provided with.

[0009] An information processing system according to an aspect of the present disclosure includes: a biometric authentication device that performs biometric authentication based on a captured image of a first user; an information processing device and is provided with, wherein the information processing device authentication control means for obtaining the result of the biometric authentication from the biometric authentication device; position estimation means for estimating the position of the first user in a target space based on the position information of a first user terminal used by the first user when the biometric authentication is successful; Output control means for outputting output information associating at least one of the position of the first user, the captured image of the first user, and data related to the appearance generated based on the captured image with appearance information It has.

[0010] An information processing method according to an aspect of the present disclosure Controls biometric authentication based on a captured image of a first user, When the biometric authentication is successful, based on the position information of the first user terminal used by the first user, estimate the position of the first user in the target space, Output output information associating the position of the first user with appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image.

[0011] A non-transitory computer-readable medium according to an aspect of the present disclosure A procedure for controlling biometric authentication based on a captured image of a first user, When the biometric authentication is successful, a procedure for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user, A procedure for outputting output information associating the position of the first user with appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image A program for causing a computer to execute is stored.

Advantages of the Invention

[0012] According to the present disclosure, it is possible to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that preferably assist in finding a user in a space.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and redundant descriptions are omitted as necessary for clarity of explanation.

[0015] <Problems of the Embodiment> Here, the problems of this embodiment will be described again. An increasing number of companies are adopting an office style where employees do not have individual desks, so-called free address. In such a free-address office, since employees can perform their work anywhere within the office, it is difficult to grasp the location of each employee. Therefore, communication between employees may not be smoothly carried out.

[0016] Therefore, in recent years, technologies for grasping the location of employees have been proposed. For example, there is a method in which an employee carries a tag that emits a beacon, and the location of the receiver that receives the beacon is grasped as the location of the employee. Also, for example, when an employee holds an employee ID card embedded with an IC chip in front of a reader, there is a method of grasping the installation location of the reader as the location of the employee.

[0017] However, in the method using the above-mentioned tags, there is a possibility of impersonation by someone carrying the employee's tag, and it is necessary to install a beacon receiver. Also, in the method using the above-mentioned employee ID card, there is still a possibility of impersonation by someone using the employee's ID card. Also, when the installation location of the reader is regarded as the location of the employee, since it is usually considered that the employee conducts work at a location away from the reader, the error in the location is large.

[0018] Here, the method described in Patent Document 1 above has been proposed. Patent Document 1 describes that the portable state may be detected when the personal authentication is successful. However, as described above, there is a problem that it is difficult to find the target person in reality.

[0019] Also, the method described in Patent Document 2 above has been proposed, but even if the location of the employee is known, if the appearance of the user on that day is not known, there is a problem that it takes time to find the employee in reality. In particular, if the clothing or hairstyle changes, it becomes even more difficult to find the employee.

[0020] Furthermore, the above problems are the same not only for free-address offices but also for other spaces where multiple people stay and can move inside. This embodiment is made to solve such problems.

[0021] <Embodiment 1> First, Embodiment 1 of the present disclosure will be described. FIG. 1 is a block diagram showing the configuration of an information processing apparatus 10 according to Embodiment 1. The information processing apparatus 10 is a computer device that assists other users (sometimes referred to as second users) in finding a target user (sometimes referred to as a first user) within a target space. The information processing apparatus 10 is connected to a network (not shown). The network may be wired or wireless. A first user terminal (not shown) used by the first user and a display device (not shown) are connected to the network. The information processing apparatus 10 includes an authentication control unit 13, a position estimation unit 14, and an output control unit 16.

[0022] The authentication control unit 13 is also referred to as authentication control means. The authentication control unit 13 controls biometric authentication based on a captured image of the first user. The biometric authentication is iris authentication, face authentication, palmprint authentication, or other biometric authentication that authenticates based on a captured image of the user. Thereby, the authentication control unit 13 identifies the user.

[0023] The position estimation unit 14 is also referred to as position estimation means. When the biometric authentication is successful, the position estimation unit 14 estimates the position information of the first user terminal within the target space. The target space is a space where multiple people can stay and each person can move inside. The target space is a predetermined space. Then, the position estimation unit 14 estimates the position of the first user within the target space based on the position information of the first user terminal.

[0024] The output control unit 16 is also referred to as output control means. The output control unit 16 outputs output information in which the position of the first user terminal and the appearance information of the first user are associated with each other to another device such as a display device or a second user terminal used by the second user. The appearance information of the first user is information indicating or suggesting the characteristics or wearing status of the items worn by the first user. The items worn may be clothing, hairstyles, ornaments, masks, glasses, or the like. The appearance information of the first user includes at least one of a captured image generated by photographing the first user and data related to the appearance generated based on the captured image. The data related to the appearance, also called appearance data, is, for example, data indicating the characteristics or wearing status of the items worn. As an example, the appearance data is text data or an illustration image indicating the characteristics or wearing status.

[0025] Figure 2 is a flowchart showing the flow of the information processing method according to Embodiment 1. First, the authentication control unit 13 of the information processing apparatus 10 controls biometric authentication based on a captured image of the first user (S10). Controlling biometric authentication based on a captured image may mean performing biometric authentication based on the captured image or feature information extracted from the captured image. Also, controlling biometric authentication based on a captured image may mean transmitting the captured image or feature information extracted from the captured image to a biometric authentication device (not shown) and obtaining an authentication result from the biometric authentication device.

[0026] Next, the authentication control unit 13 determines whether or not the biometric authentication has been successful (S11). Success in biometric authentication may indicate that the degree of coincidence between the feature information extracted from the captured image of the first user and the feature information of the pre-registered user is equal to or greater than a predetermined value.

[0027] When biometric authentication is successful (Yes at S11), the position estimation unit 14 estimates the position of the first user terminal in the target space (S12). For example, the position estimation unit 14 may acquire the position of the access point (AP) used by the first user terminal or the GPS (Global Positioning System) information of the first user terminal, and estimate the position of the AP or the GPS information as the position of the first user terminal. Further, the position estimation unit 14 may estimate the position of the first user terminal based on the position of the AP used by the first user terminal and the received radio wave intensity from the first user terminal.

[0028] Next, the position estimation unit 14 estimates the position of the first user in the target space based on the position information of the first user terminal in the target space (S13). For example, the position estimation unit 14 may estimate the position information of the first user terminal in the target space as the position of the first user in the target space. Also, for example, the position estimation unit 14 may estimate the range within a predetermined distance from the position information of the first user terminal in the target space as the position of the first user.

[0029] Next, the output control unit 16 outputs output information in which the position information of the first user is associated with appearance information such as a photographed image of the first user to another device (S14).

[0030] On the other hand, when biometric authentication fails (No at S11), the information processing apparatus 10 ends the process. That is, the output control unit 16 does not output the position information of the user who failed in biometric authentication to another device as the position information of the first user.

[0031] As described above, according to the first embodiment, since the information processing apparatus 10 uses the position information of the first user who has succeeded in biometric authentication, it is possible to prevent impersonation of the first user by others. Further, the information processing apparatus 10 outputs appearance information such as a photographed image of the first user in association with the position information of the first user. Therefore, the second user who receives the provision of the output information can grasp the characteristics of the appearance of the first user on that day together with the position of the first user. Thereby, the information processing apparatus 10 can suitably assist the second user in finding the first user in the actual target space.

[0032] <Embodiment 2> Next, Embodiment 2 of the present disclosure will be described. FIG. 3 is a block diagram showing the overall configuration of the information processing system 1000 according to Embodiment 2. The information processing system 1000 is a computer system that assists a second user in finding a first user within the target space TS. In the present Embodiment 2, as an example, the target space TS is the site of the target company. As an example, the site of the target company includes one or more floors. However, it is not limited to this, and the target space TS may be a shared office where a plurality of companies gather or the site of a school. Also, in the present Embodiment 2, as an example, biometric authentication is face authentication.

[0033] The information processing system 1000 includes a face authentication device 100, an information processing device (hereinafter referred to as a server) 200, a plurality of user terminals 300-1, 300-2, 300-3, a plurality of APs 400-1, 400-2, and a display device 500. The face authentication device 100, the server 200, the APs 400, and the display device 500 are connected to each other via a network N. The network N is a wired or wireless communication line. The network N is, for example, an intranet, and may be at least one of a LAN (Local Area Network), a WAN (Wide Area Network), and the Internet, or a combination thereof. Note that the number of user terminals and the number of APs are not limited to this.

[0034] The user terminal 300 is an information terminal such as a personal computer, a smartphone, or a tablet terminal used by the user. The user terminal 300 sends a user registration request to the server 200. Thereby, the face feature information of the user is registered and a user ID is issued. Also, the user terminal 300 sends user information to the server 200 and causes the server 200 to register the user information. Also, when the user terminal 300 is started up or released from the sleep state, it requests face authentication. For example, the user terminal 300 captures at least the user's face from the front, and requests face authentication by transmitting the captured image or the face feature information extracted from the captured image to the face authentication device 100 via the server 200. Note that the user terminal 300 may directly transmit the captured image or the face feature information to the face authentication device 100.

[0035] Note that when the user terminal 300 is located within the target space TS, the user terminal 300 connects to any one of the APs 400 via a wireless LAN, and connects to the network N via the AP 400. For example, the user terminal 300 connects to the nearest AP 400 via a wireless LAN, and connects to the network N via the nearest AP 400. In FIG. 3, the user terminals 300-1 and 300-2 are connected to the AP 400-1 and are connected to the network N via the AP 400-1. The user terminal 300-3 is connected to the AP 400-2 and is connected to the network N via the AP 400-2.

[0036] The APs 400-1 and 400-2 are wireless access points. The APs 400-1 and 400-2 are respectively installed in a predetermined area of the target space TS. For example, the APs 400-1 and 400-2 may be installed on each floor within the site of the target company. Also, for example, the APs 400-1 and 400-2 may be installed in different areas on the same floor within the site of the target company.

[0037] The face authentication device 100 is a computer device that stores face feature information of a plurality of persons. Also, the face authentication device 100 has a face authentication function of collating the face image or the face feature information included in the request with the face feature information of each user in response to a face authentication request received from the outside. In the second embodiment, the face authentication device 100 registers the face feature information of the user at the time of user registration. Then, the face authentication device 100 acquires the captured image of the user from the user terminal 300 via the server 200, and executes face authentication using the face area in the captured image. Then, the face authentication device 100 returns the collation result (face authentication result) to the server 200.

[0038] Server 200 is an example of the information processing apparatus 10 described above. When the server 200 receives a user registration request including a registration image from the user terminal 300, it sends a face registration request to the face authentication device 100. Then, the server 200 registers user information in association with the user ID issued by the face authentication device 100. When the server 200 receives a captured image for face authentication or face feature information from the user terminal 300 via the AP 400, it sends a face authentication request to the face authentication device 100. The server 200 identifies the user based on the face authentication result, and estimates the position of the user terminal 300 and the position of the user based on the position of the AP 400 to which the user terminal 300 is connected. Then, the server 200 sends output information associating the appearance information including the captured image of the user for face authentication with the position of the user to the display device 500.

[0039] The display device 500 is a device including a display unit such as a digital signage or a tablet terminal. The display device 500 is installed within the target space TS or at a remote location. As an example, the display device 500 is installed at the floor entrance within the premises of the target company. The display device 500 displays the position of each user included in the output information received from the server 200 in association with the captured image of that user for face authentication.

[0040] FIG. 4 is a block diagram showing the configuration of the face authentication device 100 according to Embodiment 2. The face authentication device 100 includes a face information database (face information DB) 110, a face detection unit 120, a feature point extraction unit 130, a registration unit 140, and an authentication unit 150. The face information DB 110 stores the user ID 111 and the face feature information 112 of the user ID in association with each other. The face feature information 112 is a set of feature points extracted from a face image and is an example of face information. Note that the face authentication device 100 may delete the face feature information 112 in the face feature DB 110 according to the request of the registered user of the face feature information 112. Alternatively, the face authentication device 100 may delete the face feature information 112 after a certain period has elapsed since the registration of the face feature information 112.

[0041] The face detection unit 120 detects the face region included in the registration image for registering face information and supplies it to the feature point extraction unit 130. The feature point extraction unit 130 extracts feature points from the face region detected by the face detection unit 120 and supplies face feature information to the registration unit 140. Also, the feature point extraction unit 130 extracts the feature points included in the captured image received from the server 200 and supplies face feature information to the authentication unit 150.

[0042] When registering face feature information, the registration unit 140 newly issues a user ID 111. The registration unit 140 associates the issued user ID 111 with the face feature information 112 extracted from the registration image and registers it in the face information DB 110. The authentication unit 150 performs face authentication using the face feature information 112. Specifically, the authentication unit 150 collates the face feature information extracted from the captured image with the face feature information 112 in the face information DB 110. The authentication unit 150 returns to the server 200 whether there is a match in the face feature information. Whether there is a match in the face feature information corresponds to the success or failure of the authentication. Note that the case where the face feature information matches (match exists) means that the degree of match is equal to or greater than a predetermined value.

[0043] FIG. 5 is a flowchart showing the flow of the face information registration process according to Embodiment 2. First, the face authentication device 100 acquires the registration image of the user U included in the face registration request (S21). For example, the face authentication device 100 receives the face registration request from the server 200 that has received the user registration request from the user terminal 300 via the network N. Note that the face authentication device 100 is not limited to this, and may directly receive the face registration request from the user terminal 300. Next, the face detection unit 120 detects the face region included in the registration image (S22). Next, the feature point extraction unit 130 extracts feature points from the face region detected in step S22 and supplies face feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues a user ID 111, associates the user ID 111 with the face feature information 112, and registers it in the face information DB 110 (S24). Note that the face authentication device 100 may receive the face feature information 112 from the source of the face registration request, associate it with the user ID 111, and register it in the face information DB 110.

[0044] FIG. 6 is a flowchart showing the flow of face authentication processing according to Embodiment 2. First, the feature point extraction unit 130 acquires face feature information for authentication (S31). For example, the face authentication device 100 receives a face authentication request from the server 200 via the network N, and extracts face feature information from the captured image included in the face authentication request as in steps S21 to S23. Alternatively, the face authentication device 100 may receive face feature information from the server 200. Next, the authentication unit 150 collates the acquired face feature information with the face feature information 112 in the face information DB 110 (S32). When the face feature information matches, that is, when the degree of match of the face feature information is equal to or greater than a predetermined value (Yes in S33), the authentication unit 150 identifies the user ID 111 of the user whose face feature information matches (S34). Then, the authentication unit 150 returns to the server 200 as a face authentication result that the face authentication has succeeded and the identified user ID 111 (S35). When there is no matching face feature information (No in S33), the authentication unit 150 returns to the server 200 as a face authentication result that the face authentication has failed (S36).

[0045] FIG. 7 is a block diagram showing the configuration of the user terminal 300 according to Embodiment 2. The user terminal 300 includes a camera 310, a storage unit 320, a communication unit 330, a display unit 340, an input unit 350, and a control unit 360. The camera 310 is a photographing device that performs photographing according to the control of the control unit 360. The storage unit 320 is a storage device in which programs for realizing each function of the user terminal 300 are stored. The communication unit 330 is a communication interface with the network N. The display unit 340 is a display device. The input unit 350 is an input device that receives input from the user. The display unit 340 and the input unit 350 may be integrally configured like a touch panel. The control unit 360 controls the hardware of the user terminal 300.

[0046] FIG. 8 is a block diagram showing the configuration of the server 200 according to Embodiment 2. The server 200 includes a storage unit 210, a memory 220, a communication unit 230, and a control unit 240. The storage unit 210 is a storage device such as a hard disk or a flash memory. The storage unit 210 stores a program 211, a user database (DB) 212, and an access point database (APDB) 213. The program 211 is a computer program in which the processing of the information processing method according to the present Embodiment 2 is implemented.

[0047] The user DB 212 stores information about users. Specifically, the user DB 212 stores user information 2122, location information 2123, and appearance information 2124 in association with a user ID 2121. The user ID 2121 is a user ID issued by the face authentication device 100 at the time of face information registration. The user information 2122 may include, for example, a user name, an employee number, a mobile phone number, an email address, attribute information, or schedule-related information of the user. The attribute information may include at least one of gender, job title, and department name. The schedule-related information may be the schedule itself or information for accessing a scheduler operating on the user terminal 300 or in the cloud. The location information 2123 is the location information of the user estimated by a location estimation unit 244 described later. The appearance information 2124 is a captured image for face authentication, but may also include appearance data.

[0048] The APDB 213 stores information about the AP 400. Specifically, the APDB 213 stores an APID 2131 for identifying the AP 400 and location information 2132 where the AP 400 is installed in association with each other.

[0049] The memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during the operation of the control unit 240. The communication unit 230 is a communication interface with the network N.

[0050] The control unit 240 is a processor that controls each component of the server 200, that is, a control device. The control unit 240 causes the memory unit 210 to read the program 211 into the memory 220 and executes the program 211. Thereby, the control unit 240 realizes the functions of the registration unit 241, the image acquisition unit 242, the authentication control unit 243, the position estimation unit 244, the generation unit 245, and the output control unit 246.

[0051] The registration unit 241 is also called a registration means. When the registration unit 241 receives a user registration request including a registration image from the user terminal 300, it sends a face registration request to the face authentication device 100. And when the face authentication device 100 registers the face information and issues a user ID, the registration unit 241 registers that user ID in the user DB 212. Also, the registration unit 241 registers the user information of the user using the user terminal 300 in the user DB 212 in association with the user ID of that user. Since the user ID is associated with the face information in the face authentication device 100, the registration unit 241 registers the user information for each user in association with the face information of that user via the user ID.

[0052] The image acquisition unit 242 is also called an image acquisition means. The image acquisition unit 242 receives a captured image for face authentication from the user terminal 300 via the AP 400 and supplies it to the authentication control unit 243.

[0053] The authentication control unit 243 is an example of the authentication control unit 13 described above. The authentication control unit 243 controls face authentication for the face region of the user U included in the captured image and identifies the user. That is, the authentication control unit 243 causes the face authentication device 100 to perform face authentication on the captured image acquired from the user terminal 300. For example, the authentication control unit 243 transmits a face authentication request including the acquired captured image to the face authentication device 100 via the network N. Note that the authentication control unit 243 may extract the face region of the user U from the captured image and include the extracted image in the face authentication request. Further, the authentication control unit 243 may extract face feature information from the face region and include the face feature information in the face authentication request. Then, the authentication control unit 243 receives the face authentication result from the face authentication device 100. Thereby, the authentication control unit 243 identifies the user ID of the user.

[0054] The position estimation unit 244 is an example of the position estimation unit 14 described above. First, the position estimation unit 244 estimates the position of the user terminal 300. Examples of the method for estimating the position of the user terminal 300 include the following (1) to (3). (1) When receiving the captured image, the position estimation unit 244 identifies the AP 400 through which the image was transmitted, and identifies the position information of the AP 400 in the APDB 213. Then, the position estimation unit 244 estimates the position information of the AP 400 as the position information of the user identified by the authentication control unit 243. (2) When the position estimation unit 244 has acquired the radio wave intensity of the user terminal 300 connected to each of the APs 400 from the APs 400, the position estimation unit 244 calculates the distance between the AP 400 and the user terminal 300 based on the radio wave intensity. Then, the position estimation unit 244 estimates the position of the user terminal 300 based on the position information of the AP 400 and the distance between the AP 400 and the user terminal 300. (3) When the position estimation unit 244 has acquired GPS information from the user terminal 300, the position estimation unit 244 estimates the GPS information as the position information of the user terminal 300.

[0055] Next, the position estimation unit 244 estimates the user's position based on the position of the user terminal 300. For example, the position estimation unit 244 may estimate the position of the user terminal 300 as the user's position.

[0056] In addition, when there are a plurality of user terminals 300 used by the user, the position estimation unit 244 may estimate the position of the user terminal 300 that has performed face authentication most recently, or the position of the active user terminal 300 as the user's position. The fact that there are a plurality of user terminals 300 used by the user may mean that there are a plurality of user terminals 300 for which the user has performed face authentication within a predetermined period. Also in this case, the position estimation unit 244 may determine which user terminal 300's position is to be regarded as the user's position based on the type of the user terminal 300. For example, when the same user has received face authentication from both a PC and a smartphone within a predetermined period, the position estimation unit 244 may use the position of the PC as the user's position. Also, when there is a user terminal 300 outside the target space TS, the position estimation unit 244 may use the position of the smartphone as the user's position, and when all user terminals 300 are within the target space TS, the position estimation unit 244 may also use the position of the PC as the user's position.

[0057] The generation unit 245 is also called a generation means. The generation unit 245 generates appearance information including a captured image for user face authentication, and stores it in the user DB 212 in association with the user ID 2121. The appearance information may be the captured image for face authentication itself. Also, the generation unit 245 generates output information in which at least the appearance information of the user stored in the user DB 212 and the position information of the user are associated. For example, the output information is a map showing the target space TS. As an example, the generation unit 245 generates, as output information, a map representing the target space TS, in which the appearance information of the user is superimposed on the position corresponding to the position information of the user. By superimposing the appearance information on the map, it becomes easier for a second user who views the map to find the target user (first user) in the real space.

[0058] The output control unit 246 is an example of the output control unit 16 described above. The output control unit 246 transmits output information to the display device 500 and causes the display unit of the display device 500 to display the output information.

[0059] FIG. 9 is a sequence diagram showing the flow of user registration processing according to Embodiment 2. First, the user terminal 300 captures an image of the user (S500), and transmits a user registration request including the registration image generated by the capture to the server 200 (S501). Then, the registration unit 241 of the server 200 includes the registration image included in the received user registration request in a face registration request and transmits it to the face authentication device 100 (S502). Then, the face authentication device 100 registers the face information (face feature information) of the user U based on the registration image included in the received face registration request (S503). Then, the face authentication device 100 notifies the server 200 of the issued user ID (S504). Also, the user terminal 300 receives an input of user information from the user and transmits the user information to the server 200 (S505). The user information transmitted here includes, for example, a user name, attribute information, and schedule-related information. The registration unit 241 of the server 200 registers the notified user ID and user information in the user DB 212 in association with each other (S506).

[0060] FIG. 10 is a sequence diagram showing the flow of the position output process according to Embodiment 2. First, the user terminal 300 photographs the user (S510), and transmits the photographed image to the server 200 via the connected AP 400 (S511). Thereby, the image acquisition unit 242 of the server 200 acquires the photographed image of the user. Next, the authentication control unit 243 of the server 200 transmits a face authentication request for the face area of the user U in the photographed image to the face authentication device 100 (S512). Then, the face authentication device 100 performs face authentication on the face area of the user U in the photographed image included in the received face authentication request (S513). Here, it is assumed that there is a user ID for which face authentication has been successful. The face authentication device 100 transmits the face authentication result including the fact that face authentication has been successful and the user ID to the server 200 (S514). Based on the user ID included in the face authentication result, the authentication control unit 243 of the server 200 identifies the user. The authentication control unit 243 transmits the face authentication result to the user terminal 300 via the AP 400 (S515). Thereby, the user terminal 300 starts up or transitions from the sleep state to the normal state.

[0061] Next, the position estimation unit 244 of the server 200 refers to the APDB 213, identifies the position information of the AP 400 associated with the APID of the AP 400, and estimates the position of the user terminal 300 based on the position information of the AP 400 (S516). Then, the position estimation unit 244 estimates the position of the user based on the position of the user terminal 300 (S517). Then, the position estimation unit 244 stores the position information of the user in the user DB 212 in association with the user ID in the user DB 212.

[0062] Next, the generation unit 245 of the server 200 generates a map in which appearance information including the photographed image for face authentication of the user and the position information of the user are associated (S518). Then, the output control unit 246 of the server 200 transmits the map to the display device 500 via the AP 400 (S519), and causes the map to be displayed on the display unit of the display device 500 (S520).

[0063] FIG. 11 is a diagram showing an example of a display image 900 of the display device 500 according to Embodiment 2. For example, assume that the target space TS includes area A, area B, and area C, and an AP 400 is installed in each area. At the position of area A in the display image 900 shown in FIG. 11, icons I_1 and I_2 of captured images for face authentication of the user using the user terminal 300 connected to the AP 400 installed in area A are superimposed. Also, at the position of area B in the display image 900, an icon I_3 of a captured image for face authentication of the user using the user terminal 300 connected to the AP 400 installed in area B is superimposed. Further, in the display image 900, the position where the display device 500 is installed is shown as the current position. Note that in FIG. 11, one icon of a captured image for face authentication is displayed for each user, but a plurality of icons may be displayed for each user. The plurality of icons may include a plurality of captured images for face authentication, may include captured images of the user's clothes, shoes, hairstyle, or back view on that day, or may include illustrated images expressing the characteristics of the user's appearance on that day.

[0064] As described above, according to Embodiment 2, since the server 200 uses the position information of the user who has successfully passed the face authentication, it is possible to prevent impersonation of the user by others. Also, in the example of FIG. 11, the server 200 causes the display device 500 to display the captured image of the user in association with the position information. Therefore, other users who view the output information can grasp the characteristics of the appearance of the target user on that day together with the position of the target user. Thereby, the server 200 can suitably assist other users in finding the target user within the target space.

[0065] Also, since the captured image for face authentication uses the camera 310 of the user terminal 300, there is no need to newly install a camera for face authentication. Also, when performing face authentication when the PC is started or woken up from sleep, the face of the user sitting in front of the PC can be captured from the front using the camera attached to the PC. When capturing the user from the front with the camera 310 in this way, a high-quality captured image suitable for face authentication can be obtained.

[0066] In addition, since the server 200 estimates the user's position based on the position of the AP 400 or estimates the user's position using the GPS information of the user terminal 300, it is not necessary to install and introduce new devices such as dedicated transmitters and receivers.

[0067] Note that the second embodiment can also be modified as follows.

[0068] For example, the appearance information included in the output information may be appearance data generated from the captured image for face authentication instead of the captured image for face authentication. At this time, the output information may include a registered image of a user registered in advance. The registered image may be a registered image at the time of face authentication, a thumbnail image appropriately set by the user, or a face image on an employee ID.

[0069] FIG. 12 is a diagram showing an example of a display image 900 of the display device 500 according to the second embodiment. Icons R_1 and R_2 of the registered images of users using the user terminal 300 connected to the AP 400 installed in area A are superimposed on the position of area A of the display image 900 shown in FIG. 12. Further, appearance data O_1 and O_2 generated from the captured images for face authentication of the users associated with the icons R_1 and R_2 are included in the position of area A of the display image 900. As an example, the appearance data O_1 indicates that the user is wearing "red clothes", and the appearance data O_2 indicates that the user is wearing "glasses". Similarly for area B, an icon R_3 of a user using the user terminal 300 connected to the AP 400 installed in area B and appearance data O_3 are superimposed.

[0070] For example, the output information may be information that further associates the position information and appearance information of the first user with the user information. That is, the generation unit 245 may generate output information including the position information and appearance information of the first user and the user information. Further, the output information may be information that further associates the position information and appearance information of the first user with the schedule-related information. That is, the generation unit 245 may generate output information that associates the position information and appearance information of the first user with the schedule information of the user. The schedule information of the user may be extracted by the generation unit 245 from the schedule-related information of the user information 2122, or may be obtained by accessing the scheduler based on the schedule-related information.

[0071] FIG. 13 is a diagram showing an example of a display image 900 of the display device 500 according to Embodiment 2. Icons I_1 and I_2 of a captured image for face authentication of a user using the user terminal 300 connected to the AP 400 installed in the area A are superimposed on the position of the area A of the display image 900 shown in FIG. 13. The display image 900 includes user information U of the user located in the area A. For example, the user corresponding to the icon I_1 belongs to the "First Technology Department" and his name is "Den Taro". The user information U may also include input information input by a user operation. In this case, the user can input input information regarding today's appearance, and the user terminal 300 that has received the input transmits the input information to the server 200 and may register it in the user DB 212 as the user information of the user. For example, the user information U shown in FIG. 13 includes information "wearing red clothes" as input information of the user corresponding to the icon I_1. The user can also input other input information, and the user terminal 300 that has received the input transmits the input information to the server 200 and may register it. For example, the user information U shown in FIG. 13 includes information "sitting next to a round chair" as input information of the user corresponding to the icon I_3. The input information registered in the user DB 212 as user information can be given an expiration date such as one hour or one day, and may be deleted after the expiration date has passed.

[0072] Further, when a viewer of the display device 500 selects the icon I_1 of the captured image for face authentication, other information about the user may be displayed. The other information about the user may be user information or schedule information. Further, the other information about the user may be another captured image for face authentication of the user, a captured image of the user's clothes, shoes, hairstyle, or back view on that day, or an illustrated image representing the characteristics of the appearance on that day. When the display device 500 includes a touch panel, selecting may be tapping.

[0073] Also, when the display device 500 is installed at a specific location, the display device 500 may display the location of a user associated with the specific location. For example, when the display device 500 is installed in a room of a certain department, the display device 500 may display the locations of the members of that department.

[0074] FIG. 14 is a diagram showing an example of the display image 900 of the display device 500 according to Embodiment 2. The display image 900 in FIG. 14 shows a map indicating the room of the first technical department and the locations of the members belonging to the first technical department.

[0075] For the members in the room, the display device 500 displays the icons I_1 to I_3 of the captured images for face authentication of the members in association with the positions in the map corresponding to the locations. Also, for the members not in the room, the display device 500 displays information about which area they are in, together with the icons I_4 to I_8 of the captured images for face authentication of the members.

[0076] Further, for members determined by the output control unit 246 of the server 200 to be located outside the target space TS, the position of such members may be output, for example, as "remote", distinguishable from the target space TS. Further, the position estimation unit 244 of the server 200 may determine whether the position of a member is outside the target space TS from the GPS information of the user terminal 300, or may determine by tracking the network through which it passes. Further, the position estimation unit 244 may also determine whether the position of a member is outside the target space TS from the schedule information of the user. In this case, for members outside the target space TS, the display device 500 displays their location as "remote" as shown in FIG. 14. Thereby, even members not in the target space TS can be easily grasped.

[0077] Further, the display device 500 may display details such as how many of the affiliated members are present in the room, how many are in other areas, and how many are remote.

[0078] Further, also in FIG. 14, when a viewer of the display device 500 selects an icon, other information regarding the user corresponding to the icon may be displayed. At this time, the display device 500 may display the same type of information regardless of whether the selected user is inside or outside the target space TS. However, not limited to this, the display device 500 may vary the type of information to be displayed depending on whether the selected user is inside or outside the target space TS. For example, when a user inside the target space TS is selected, the display device 500 may display detailed information regarding appearance and an extension number, while when a user outside the target space TS is selected, the display device 500 may display a mobile phone number.

[0079] <Embodiment 3> Next, Embodiment 3 of the present disclosure will be described. Embodiment 3 is characterized in that the server 200 has a search function. For example, the server 200 outputs output information including the location information of the user using the user name or user ID as a key. As an example, when the output control unit 246 receives a search request regarding the location of the first user from the second user terminal 300-2 used by the second user, the output control unit 246 outputs output information including the appearance information of the first user together with the location information to the second user terminal 300-2.

[0080] Also, for example, the server 200 outputs output information of the users in the area using the area as a key. As an example, when the second user terminal 300-2 receives a search request regarding a person located in a predetermined area in the target space TS, the generation unit 245 refers to the user DB 212, identifies the users whose location information is within the predetermined area, and generates output information of the identified users. Then, the output control unit 246 outputs the output information of the identified users to the second user terminal 300-2.

[0081] Also, for example, the server 200 outputs output information of the users having the attribute using the user attribute as a key. As an example, when the generation unit 245 receives a search request regarding the location of the users belonging to a predetermined department from the second user terminal 300-2, the generation unit 245 refers to the user DB 212 and identifies the users belonging to the predetermined department in the target space TS. Then, the generation unit 245 generates output information of the identified users. Then, the generation unit 245 outputs the output information of the identified users to the second user terminal 300-2.

[0082] FIG. 15 is a sequence diagram showing the flow of the position output process according to Embodiment 3. FIG. 15 shows the sequence when the second user searches for the location of the first user using the user name of the first user as a key.

[0083] First, the same processing as S510 to S517 in FIG. 10 is executed. Next, the second user terminal 300-2 used by the second user sends a search request including the user name of the first user to the server 200 (S531). In this figure, the second user terminal 300-2 sends a search request to the server 200 via the AP 400, but it is not necessary to use the AP 400.

[0084] The generation unit 245 of the server 200 that has received the search request refers to the user DB 212 and searches for the location information and appearance information of the user (first user) corresponding to the specified user name using the specified user name as a key (S532). Then, the generation unit 245 generates a map in which the location information and appearance information of the first user are associated (S533). Then, the output control unit 246 of the server 200 transmits the map to the display device 500 via the AP 400 (S534), and causes the map to be displayed on the display unit of the display device 500 (S535).

[0085] Thus, according to Embodiment 3, the server 200 can output, in a manner that is easy for the second user to find, where the target user is, who is in a specific area, or where users with specific attributes are, in response to the search by the second user.

[0086] Any process of the present disclosure can be realized by causing a processor to execute a computer program. In the above example, the program includes a group of instructions (or software code) for causing a computer to perform one or more functions described in the embodiment when the program is loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage, or other magnetic storage devices. The program may be transmitted on a transient computer-readable medium or communication medium. By way of example and not limitation, the transient computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0087] The above computer is composed of a computer system including a personal computer, a word processor, and the like. However, it is not limited to this, and the computer can also be composed of a server of a LAN (Local Area Network), a host for computer (personal computer) communication, a computer system connected to the Internet, and the like. Further, it is also possible to distribute functions to each device on the network and configure a computer throughout the network.

[0088] Note that the present disclosure is not limited to the above-described embodiments, and can be appropriately modified without departing from the gist. For example, in Embodiments 2 to 3, face authentication is performed when the user terminal 300 is started or released from the sleep state. However, the timing of face authentication is not limited to this. For example, face authentication may be performed at a predetermined time interval, or may be performed a predetermined number of times within a predetermined period. Further, for example, face authentication may be performed when there is some input operation. When face authentication is performed multiple times a day, impersonation can be more effectively prevented. Also, when face authentication is performed multiple times a day, the generation unit 245 may update the appearance information for each face authentication, or may set the appearance information to the appearance information based on the captured image at any timing (for example, the beginning of that day) of that day. Further, the generation unit 245 may update the appearance information when a predetermined time has elapsed since the most recent face authentication. When updating the appearance information, it is effective in making it easier to find the user even when the clothing or hairstyle changes midway or the mask is removed. Further, the generation unit 245 may set which timing of the appearance information is used for the output information by a selection operation of the user.

[0089] Also, in the above-described embodiment, the face authentication device 100 has the face authentication function. However, instead of or in addition to the face authentication device 100, the server 200 may have the face authentication function.

[0090] Some or all of the above-described embodiments can also be described as follows in the appended claims, but are not limited thereto. (Appended Claim 1) Authentication control means for controlling biometric authentication based on a captured image of a first user, When the biometric authentication is successful, position estimation means for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user; Output control means for outputting output information in which the position of the first user and appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image are associated; An information processing apparatus comprising: (Appendix 2) The biometric authentication is face authentication. The information processing apparatus according to Appendix 1. (Appendix 3) The position estimation means estimates the position information of the first user terminal based on the position information of the access point to which the first user terminal is connected. The information processing apparatus according to Appendix 1 or 2. (Appendix 4) The output information further associates the position and appearance information of the first user with user information related to the first user. The information processing apparatus according to any one of Appendices 1 to 3. (Appendix 5) A map representing the target space, further comprising generation means for generating, as the output information, a map in which the appearance information of the first user is superimposed on a position corresponding to the position of the first user. The information processing apparatus according to any one of Appendices 1 to 4. (Appendix 6) The output control means causes a display device installed in the target space to display the output information. The information processing apparatus according to any one of Appendices 1 to 5. (Appendix 7) When the output control unit receives a search request regarding the position of the first user from a second user terminal used by a second user, the output control unit outputs the output information of the first user to the second user terminal. The information processing apparatus according to any one of Appendices 1 to 5. (Appendix 8) When the output control means determines that the position of the first user is outside the target space, the output control means outputs the position of the first user separately from the target space. The information processing apparatus according to any one of Appendices 1 to 7. (Appendix 9) A biometric authentication device that performs biometric authentication based on a captured image of a first user, An information processing device and The information processing device includes authentication control means for obtaining the result of the biometric authentication from the biometric authentication device, position estimation means for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user when the biometric authentication is successful, output control means for outputting output information in which the position of the first user is associated with appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image and An information processing system. (Appendix 10) further includes a display device, and the output control means outputs the output information to the display device. The information processing system according to Appendix 9. (Appendix 11) controls biometric authentication based on a captured image of a first user, when the biometric authentication is successful, estimates the position of the first user in the target space based on the position information of the first user terminal used by the first user, and outputs output information in which the position of the first user is associated with appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image. An information processing method. (Appendix 12) A procedure for controlling biometric authentication based on a captured image of a first user, When the biometric authentication is successful, a procedure for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user; A procedure for outputting output information in which the position of the first user and appearance information including at least one of the captured image of the first user and data related to the appearance generated based on the captured image are associated; A non-transitory computer-readable medium storing a program for causing a computer to execute.

Explanation of Signs

[0091] 10,200 Information processing apparatus (server) 13,243 Authentication control unit 14,244 Position estimation unit 16,246 Output control unit 100 Face authentication device 110 Face information DB 111 User ID 112 Face feature information 120 Face detection unit 130 Feature point extraction unit 140 Registration unit 150 Authentication unit 210 Storage unit 211 Program 212 User DB 2121 User ID 2122 User information 2123 Position information 213 APDB 2131 APID 2132 Position information 220 Memory 230 Communication unit 240 Control unit 241 Registration unit 242 Image acquisition unit 245 Generation unit 300 User terminal 310 Camera 320 Storage unit 330 Communication unit 340 Display unit 350 Input Unit 360 Control Unit 400 Access Point (AP) 500 Display Device 900 Display Image 1000 Information Processing System TS Target Space I Captured Image R Registered Image U User Information O Appearance Data

Claims

1. Authentication control means for controlling biometric authentication based on a captured image of a first user; When the biometric authentication is successful, position estimation means for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user; Output control means for outputting output information in which the position of the first user, the captured image of the first user, and input information regarding the appearance or position of the first user input by the first user are associated; An information processing apparatus comprising the above.

2. The biometric authentication is face authentication The information processing apparatus according to claim 1.

3. The position estimation means estimates the position information of the first user terminal based on the position information of the access point to which the first user terminal is connected. The information processing apparatus according to claim 1 or 2.

4. The output information further associates the position and appearance information of the first user with user information related to the first user. The information processing apparatus according to any one of claims 1 to 3.

5. A generation means for generating, as the output information, a map representing the target space, in which the appearance information of the first user is superimposed on a position corresponding to the position of the first user. The information processing apparatus according to any one of claims 1 to 4.

6. The output control means causes a display device installed in the target space to display the output information. The information processing apparatus according to any one of claims 1 to 5.

7. A biometric authentication device for performing biometric authentication based on a captured image of a first user; An information processing apparatus; Comprising; The information processing apparatus includes: Authentication control means for obtaining the result of the biometric authentication from the biometric authentication device; When the biometric authentication is successful, position estimation means for estimating the position of the first user in the target space based on the position information of the first user terminal used by the first user; Output control means for outputting output information in which the position of the first user, the captured image of the first user, and input information regarding the appearance or position of the first user input by the first user are associated; An information processing system comprising the above.

8. Further comprising a display device, The output control means outputs the output information to the display device. The information processing system according to claim 7.

9. A computer controls biometric authentication based on a captured image of a first user. ​ When the biometric authentication is successful, based on the location information of the first user terminal used by the first user, estimate the position of the first user in the target space. Output output information associating the position of the first user, the captured image of the first user, and input information regarding the appearance or position of the first user input by the first user. Information processing method.

10. A procedure for controlling biometric authentication based on a captured image of a first user, When the biometric authentication is successful, a procedure for estimating the position of the first user in the target space based on the location information of the first user terminal used by the first user, A procedure for outputting output information associating the position of the first user, the captured image of the first user, and input information regarding the appearance or position of the first user input by the first user A program for causing a computer to execute.

Images