Notification device and notification method

Abstract

To provide a notification system capable of properly notifying a face recognition result to persons passing through a particular place even when any gate is not set at a specific place where many people pass at the same time.SOLUTION: The notification system includes: a generation unit that generates image data of an image of a face recognition result that represents a face recognition result of a person passing a passage control area which is obtained based on image data of a camera for picking up the passage control area, and which is projected at the feet of the person passing through the passage control area; and a transmission unit that transmits the image data to a projector.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a notification device and a notification method.

Background Art

[0002] A face recognition device is used, for example, for entry and exit management in an office or the like. For example, the face recognition device receives image data from a camera that photographs the periphery of a gate provided at an entrance or exit of an office or the like. The face recognition device compares the face image of a person included in the received image data with a registered face image and controls the opening and closing of the gate.

[0003] It is conceivable to use such a face recognition device at an entrance or exit (passage management area) such as a concert hall where more people pass through simultaneously than at an entrance or exit of an office or the like.

[0004] Note that Patent Document 1 discloses a biometric verification device that can efficiently monitor the results of biometric authentication processing and can perform manual control instructions to each device.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, when a gate is provided in a passage management area where many people pass through simultaneously and face recognition processing is performed by a face recognition device, the passage management area may become congested. Therefore, there is a need for a notification device that appropriately notifies people passing through the passage management area of the face recognition result even if no gate is provided in the passage management area.

[0007] Non-limiting embodiments of the present disclosure contribute to providing a notification device and a notification method that appropriately notify a person passing through a passage management area of a face authentication result without providing a gate in the passage management area where many people pass through simultaneously.

Means for Solving the Problem

[0008] A notification device according to an embodiment of the present disclosure represents a face authentication result of a person passing through the passage management area obtained based on image data of a camera that photographs the passage management area, and includes a generation unit that generates image data of a face authentication result image projected onto the feet of the person passing through the passage management area, and a transmission unit that transmits the image data to a projector.

[0009] A notification method according to an embodiment of the present disclosure represents a face authentication result of a person passing through the passage management area obtained based on image data of a camera that photographs the passage management area, generates image data of a face authentication result image projected onto the feet of the person passing through the passage management area, and transmits the image data to a projector.

[0010] These general or specific aspects may be implemented in a system, apparatus, method, integrated circuit, computer program, or recording medium, or may be implemented in any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

Advantages of the Invention

[0011] According to an embodiment of the present disclosure, it is possible to appropriately notify a person passing through the passage management area of the face authentication result without providing a gate in the passage management area where many people pass through simultaneously.

[0012] Further advantages and effects in an embodiment of the present disclosure will be clarified from the specification and drawings. Such advantages and / or effects are provided by some embodiments and the features described in the specification and drawings respectively, but it is not necessarily required that all are provided to obtain one or more of the same features.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art.

[0015] Note that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0016] FIG. 1 is a diagram showing a configuration example of a face recognition system according to an embodiment of the present disclosure. As shown in FIG. 1, the face recognition system includes a face recognition device 1, a camera 2, and a projector 3.

[0017] In FIG. 1, a network 4 is shown in addition to the face recognition system. The network 4 is a network such as a LAN (Local Area Network) or the Internet, for example.

[0018] Also, FIG. 1 shows people 5a to 5e passing through the passage management area A1. The passage management area A1 is, for example, the entrance of a facility such as a concert hall, and is an area where the passage of people is managed (restricted) by a face recognition system. Hereinafter, when not distinguishing people 5a to 5e, they may simply be referred to as person 5.

[0019] The face recognition device 1 receives image data from the camera 2 via the network 4. The face recognition device 1 performs face recognition processing on person 5 based on the face image of person 5 included in the received image data. The face recognition device 1 generates image data indicating the face recognition result of person 5, and transmits the generated image data to the projector 3 via the network 4. Note that the face recognition device 1 may be an information processing device such as a personal computer or a server, for example.

[0020] The camera 2 photographs the passage management area A1. The camera 2 transmits the image data of the photographed image to the face recognition device 1 via the network 4. For the camera 2, for example, a compound eye camera capable of measuring the distance (position) of person 5 by the face recognition device 1 may be used.

[0021] The projector 3 receives, via the network 4, image data indicating the face recognition result of person 5 from the face recognition device 1. The projector 3 projects face recognition result images 6a to 6e indicating the face recognition result onto the feet of person 5 (the floor of the passage management area A1) based on the image data received from the face recognition device 1.

[0022] The "OK" face authentication result image 6a projected at the feet of person 5a shown in Fig. 1 indicates that the face authentication device 1 has determined that person 5a is legitimate. The "OK" face authentication result image 6b projected at the feet of person 5b indicates that the face authentication device 1 has determined that person 5b is legitimate. The "OK" face authentication result image 6c projected at the feet of person 5c indicates that the face authentication device 1 has determined that person 5c is legitimate. The "OK" face authentication result image 6e projected at the feet of person 5e indicates that the face authentication device 1 has determined that person 5e is legitimate.

[0023] On the other hand, the "NG" face authentication result image 6d projected at the feet of person 5d in Fig. 1 indicates that the face authentication device 1 has determined that person 5d is illegitimate.

[0024] Note that "legitimate" may, for example, mean that permission is granted to pass through the passage management area A1. Also, "legitimate" may, for example, mean that the face image of person 5 passing through the passage management area A1 matches the face image registered in the face authentication device 1.

[0025] "Illegitimate" may, for example, mean that permission is not granted to pass through the passage management area A1. Also, "illegitimate" may, for example, mean that the face image of person 5 passing through the passage management area A1 does not match the face image registered in the face authentication device 1.

[0026] Note that the determination of whether or not passage through the passage management area A1 is permitted does not necessarily match the determination of whether or not the face image of person 5 matches the registered face image. For example, there may be cases where the face image of person 5 passing through matches the registered face image, but passage is not permitted, such as when monitoring a person who requires attention. Therefore, the operator of the face authentication system may arbitrarily set the criteria for determining legitimate / illegitimate based on any determination result.

[0027] Hereinafter, when not distinguishing between the face authentication result images 6a to 6e, they may simply be referred to as the face authentication result image 6.

[0028] The face authentication result image 6 is not limited to the example of FIG. 1. Legitimate and illegitimate may be represented by characters other than OK and NG. Also, legitimate and illegitimate may be represented (or distinguished) by color. For example, legitimate may be represented by a green face authentication result image 6, and illegitimate may be represented by a red face authentication result image 6. Also, legitimate and illegitimate may be represented by differences in the shape of images such as "○" and "×", or may be presented as a moving image. Also, legitimate and illegitimate may be represented by any combination of characters, colors, shapes, and moving images.

[0029] FIG. 2 is a diagram showing a configuration example of another face authentication system. In FIG. 2, the same components as those in FIG. 1 are denoted by the same reference numerals. The face authentication system shown in FIG. 2 has a display 7 instead of the projector 3 described in FIG. 1.

[0030] The face authentication device 1 in FIG. 2 displays the face authentication result for each individual person 5 on the display 7. For example, the face authentication device 1 displays the face authentication result for the person 5 in correspondence with the positional relationship of the person 5 when viewing the passage management area A1 from above on the display 7.

[0031] For example, the face authentication result image 8a of "NG" displayed on the display 7 in FIG. 2 indicates the face authentication result of the person 5a. The face authentication result image 8b of "OK" displayed on the display 7 indicates the face authentication result of the person 5b. The face authentication result image 8c of "OK" displayed on the display 7 indicates the face authentication result of the person 5c. The face authentication result image 8d of "OK" displayed on the display 7 indicates the face authentication result of the person 5d. The face authentication result image 8e of "OK" displayed on the display 7 indicates the face authentication result of the person 5e.

[0032] Hereinafter, when not distinguishing between the face authentication result images 8a to 8e, they may be simply described as the face authentication result image 8.

[0033] In the face recognition system shown in FIG. 2, since the face recognition result is displayed on the display 7 corresponding to the positional relationship of person 5 in the passage management area A1, it is not intuitive which person 5's face recognition result it is. Therefore, even when person 5 looks at the face recognition result displayed on the display 7, it is difficult to grasp which one is their own face recognition result. Also, an administrator who manages the passage through the passage management area A1, such as a security guard, also has difficulty grasping the face recognition result of person 5.

[0034] In contrast, in the face recognition system shown in FIG. 1, the individual face recognition results of person 5 are projected at the feet of each of person 5. For this reason, person 5 can easily grasp the face recognition result.

[0035] Also, an administrator who manages the passage through the passage management area A1 can also easily grasp the face recognition result of person 5. For example, the administrator can easily recognize person 5d who is determined to be improper and prevent person 5d from passing through the passage management area A1.

[0036] FIG. 3 is a diagram showing a block configuration example of the face recognition device 1. As shown in FIG. 3, the face recognition device 1 includes a control unit 11, a storage unit 12, a communication unit 13, an input unit 14, and an output unit 15.

[0037] The control unit 11 controls the entire face recognition device 1. The control unit 11 may be configured by a processor such as a CPU (Central Processing Unit), for example.

[0038] The control unit 11 includes a position calculation unit 11a, a face recognition unit 11b, and an image data generation unit 11c. The control unit 11 may execute, for example, a program stored in the storage unit 12 to realize the functions of the position calculation unit 11a, the face recognition unit 11b, and the image data generation unit 11c.

[0039] The position calculation unit 11a calculates the position of person 5 in the passage management area A1 included in the image data based on the image data of the camera 2.

[0040] The face authentication unit 11b performs face authentication of person 5 based on the image data of camera 2. For example, the face authentication device 1 compares the face image data of person 5 included in the image data of camera 2 with the face image data previously stored in the storage unit 12 to determine whether person 5 is a legitimate person.

[0041] Specifically, the face authentication unit 11b calculates the degree of match between the face image data of person 5 included in the image data of camera 2 and the face image data previously stored in the storage unit 12. When the calculated degree of match is equal to or greater than the threshold value, the face authentication unit 11b determines that person 5 is legitimate. When the calculated degree of match is less than the threshold value, the face authentication unit 11b determines that person 5 is improper.

[0042] The image data generation unit 11c generates image data for projecting the face authentication result onto the floor at the feet of person 5 (the floor of the passage management area A1) based on the position of person 5 calculated by the position calculation unit 11a and the face authentication result of the face authentication unit 11b.

[0043] For example, the image data generation unit 11c calculates the projection position of the face authentication result to be projected at the feet of person 5 in the projector 3 based on the position of person 5 in the passage management area A1 calculated by the position calculation unit 11a. Also, the image data generation unit 11c determines the face authentication result image 6 to be projected at the feet of person 5 based on the face authentication result of the face authentication unit 11b. For example, the face authentication device 1 determines the face authentication result image 6 including the character OK or the face authentication result image 6 including the character NG shown in FIG. 1 based on the face authentication result of the face authentication unit 11b. Then, the image data generation unit 11c generates image data for projecting the determined face authentication result image 6 at the calculated projection position.

[0044] When one projector 3 is responsible for the entire passage management area A1, the face authentication result image 6 is arranged only at the coordinates corresponding to the feet of person 5 in the image data, and the other parts are represented as black images. When multiple projectors 3 cooperate to be responsible for the passage management area A1, images corresponding to the responsible areas of each projector 3 are generated.

[0045] The storage unit 12 stores a program for the operation of the control unit 11. The storage unit 12 also stores data for the control unit 11 to perform calculation processing and data for controlling each unit. For example, the storage unit 12 stores the face image data of the people 5 whose entry and exit to facilities such as concert halls are permitted.

[0046] The communication unit 13 is connected to the network 4. The communication unit 13 communicates with the camera 2 via the network 4. The communication unit 13 communicates with the projector 3 via the network 4.

[0047] The communication unit 13 includes an image data receiving unit 13a and an image data transmitting unit 13b. The image data receiving unit 13a receives image data from the camera 2. The image data transmitting unit 13b transmits the image data generated by the image data generating unit 11c to the projector 3.

[0048] The input unit 14 is connected to an input device such as a keyboard or a touch panel. The input unit 14 outputs the signal received from the input device to the control unit 11.

[0049] The output unit 15 is connected to a display device such as a display or a touch panel. The output unit 15 outputs the signal received from the control unit 11 to the display device.

[0050] Figure 4 is a flowchart showing an operation example of the face authentication device 1. The face authentication device 1 repeatedly executes the processing of the flowchart shown in Figure 4.

[0051] The face authentication device 1 receives image data from the camera 2 (S1). The received image data includes an image of the passage management area A1.

[0052] The face authentication device 1 detects face image data from the received image data (S2). That is, the face authentication device 1 detects the face image of the people 5 passing through the passage management area A1.

[0053] The face authentication device 1 repeats the processes of S4 to S7 for the number n of detected face images (S3a, S3b).

[0054] The face authentication device 1 extracts one face image from the n detected face images, and calculates the three-dimensional position of the face in the extracted face image in the passage management area A1 (S4).

[0055] The face authentication device 1 performs face authentication processing on the face image extracted in S4 (S5).

[0056] The face authentication device 1 calculates the projection position of the face authentication result image 6 projected at the feet of person 5 based on the three-dimensional position calculated in S4 for the face image extracted in S4. Also, the face authentication device 1 determines the face authentication result image 6 projected at the feet of person 5 based on the face authentication result of S5. Then, the face authentication device 1 generates image data for projecting the determined face authentication result image 6 at the calculated projection position (S6).

[0057] The face authentication device 1 transmits the image data generated in S6 to the projector 3 (S7).

[0058] Note that the projector 3 projects an image based on the image data transmitted in S7. As a result, a face authentication result image 6 indicating the face authentication result of person 5 is projected at the feet of person 5 as shown in FIG. 1.

[0059] As described above, the image data receiving unit 13a of the face authentication device 1 receives image data from the camera 2 that captures the passage management area A1. The face authentication unit 11b performs a face authentication process on the person 5 passing through the passage management area A1 based on the image data received by the image data receiving unit 13a. The image data generation unit 11c generates image data of the face authentication result image 6 that is projected onto the feet of the person passing through the passage management area A1 and represents the face authentication result of the face authentication process. The image data transmission unit 13b transmits the recorded image data generated by the image data generation unit 11c to the projector 3. That is, the face authentication device 1 projects the face authentication result image 6 that represents the face authentication result of the face authentication process onto the feet of the person passing through the passage management area A1 using the projector 3.

[0060] Thereby, the face authentication device 1 can appropriately notify the person 5 passing through the passage management area A1 of the face authentication result without providing a gate in the passage management area A1 where many people pass through at the same time. In addition, the face authentication device 1 can appropriately notify the administrator who manages the passage through the passage management area A1 of the face authentication result.

[0061] (Modification Example 1) As the density of the people 5 passing through the passage management area A1 increases (as the passage management area A1 becomes congested), it becomes difficult for the people 5 passing through the passage management area A1 or the administrator who manages the passage through the passage management area A1 to recognize the face authentication result image 6. Therefore, when the number of people 5 passing through the passage management area A1 exceeds a threshold value, the face authentication device 1 stops projecting the face authentication result image 6 indicating that the face authentication result is valid and projects only the face authentication result image 6 indicating invalidity.

[0062] FIG. 5 is a diagram showing a projection example of the face authentication result image 6 according to Modification Example 1. In FIG. 5, the same components as those in FIG. 1 are denoted by the same reference numerals.

[0063] FIG. 5 shows an example where the number of people 5 passing through the passage management area A1 exceeds the threshold value. The threshold value may be, for example, 8. Persons 5a and 5b shown in FIG. 5 are persons determined to be improper by the face authentication device 1. Persons other than persons 5a and 5b are persons determined to be proper by the face authentication device 1.

[0064] As described above, when the number of people 5 passing through the passage management area A1 exceeds the threshold value, the face authentication device 1 projects only the face authentication result image 6 indicating that the face authentication result is improper. Therefore, the face authentication device 1 projects face authentication result images 6a and 6b indicating that the face authentication result is improper only at the feet of persons 5a and 5b determined to be improper in the face authentication process, and does not project a face authentication result image at the feet of persons determined to be proper in the face authentication process.

[0065] Note that when the number of people 5 passing through the passage management area A1 is equal to or less than the threshold value, the face authentication device 1 also projects the face authentication result image 6 indicating that the face authentication result is proper. Therefore, when the number of people 5 passing through the passage management area A1 is equal to or less than the threshold value, as shown in FIG. 1, the face recognition result image is projected at the feet of all people 5 passing through the passage management area A1.

[0066] FIG. 6 is a flowchart showing an operation example of the face authentication device 1 according to Modification Example 1. In FIG. 6, the same processing steps as those in FIG. 4 are denoted by the same reference numerals. Hereinafter, processing different from the processing in FIG. 4 will be described.

[0067] After performing the face image detection process in S2, the face authentication device 1 determines whether the number of face images detected in S2 exceeds the threshold value (S11). That is, the face authentication device 1 determines whether the number of people 5 passing through the passage management area A1 exceeds the threshold value.

[0068] If the face authentication device 1 determines in S11 that the number of face images detected in S2 does not exceed the threshold value (``No'' in S11), the process proceeds to S3a. The processes of S3a, S3b, S4 to S7 shown in FIG. 6 are the same as those of S3a, S3b, S4 to S7 described in FIG. 4, and the description thereof will be omitted.

[0069] When the face recognition device 1 determines in S11 that the number of face images detected in S2 exceeds the threshold value (\"Yes\" in S11), for the number m of face images detected in S2, the processes of S13 to S16 are repeated (S12a, S12b).

[0070] The face recognition device 1 extracts one face image from the m detected face images, and calculates the three-dimensional position of the face of the extracted face image in the passage management area A1 (S13).

[0071] The face recognition device 1 performs face recognition processing on the face image extracted in S13 (S14).

[0072] When the face recognition device 1 determines in the face recognition processing of S14 that the person 5 in the face image extracted in S13 is inappropriate, based on the three-dimensional position calculated in S13, it calculates the projection position of the face recognition result image 6 projected at the feet of the person 5 determined to be inappropriate. Then, the face recognition device 1 generates image data for projecting the face recognition result image 6 indicating that the face recognition result is inappropriate at the calculated projection position (S15).

[0073] The face recognition device 1 transmits the image data generated in S15 to the projector 3 (S16).

[0074] Note that the projector 3 projects an image based on the image data transmitted in S16 onto the floor of the passage management area A1. As a result, as shown in FIG. 5, the face recognition result image 6 indicating that the face recognition result is inappropriate is projected at the feet of the person 5 determined to have an inappropriate face recognition result, and the face recognition result image 6 is not projected at the feet of the person 5 determined to have a proper face recognition result. Thereby, since the number of images to be projected can be suppressed, the possibility of securing a place to project an image increases even when the density of the passage management area A1 increases.

[0075] Also, in this modification example, although the face authentication result image 6 is not projected at the feet of person 5 who is determined to have a valid face authentication result, conversely, it may be configured not to project the face authentication result image 6 at the feet of person 5 who is determined to have an invalid result. Which of the valid or invalid images is not projected can be arbitrarily set according to the bias of the determination result or the importance. For example, in an environment such as the entrance of an office where most people 5 are permitted to pass through, or in an environment where person 5 determined to be invalid should be particularly vigilant, it is beneficial to control so as not to project the face authentication result image 6 indicating validity. Also, in an environment where most people are rejected from passing through, such as a room where valuables are stored or a path to a VIP room, it is beneficial to control so as not to project the face authentication result image 6 indicating invalidity.

[0076] Note that in this modification example, it is controlled not to project the face authentication result image 6 at the feet of person 5 who is determined to be valid on the condition that the density of the passage management area A1 increases. However, regardless of the density of the passage management area A1, the projection of either the valid or invalid face authentication result image 6 may be omitted. Thereby, the number of people on whom the image is projected can be reduced, so that it is possible to prevent excessive notification to person 5.

[0077] As described above, the face authentication device 1 determines whether to generate the image data of the face authentication result image 6 of person 5 determined to be valid in the face authentication process based on the congestion level of person 5 passing through the passage management area A1. When the passage management area A1 is congested, the face authentication device 1 does not generate the image data of the face authentication result image of person 5 determined to be valid, generates the image data of the face authentication result image of person 5 determined to be invalid, and projects only the face authentication result image 6 indicating that the face authentication result is invalid at the feet.

[0078] Thereby, person 5 passing through the passage management area A1 can easily recognize the face authentication result even when the passage management area A1 is congested. Also, the administrator who manages the passage of the passage management area A1 can easily recognize the face authentication result even when the passage management area A1 is congested.

[0079] In addition, when the passage management area A1 is congested, the face authentication device 1 projects a face authentication result image indicating impropriety instead of a face authentication result image indicating propriety. Thereby, an administrator who manages passage through the passage management area A1 can easily prevent the passage of improper persons.

[0080] (Modification Example 2) The face authentication device 1 may include, in the face authentication result image 6 of the person 5 determined to be proper, an image indicating the route (destination) after passing through the passage management area A1.

[0081] For example, the face authentication device 1 may include, in the face authentication result image 6 of the person 5 determined to be proper, character images such as "Turn right ahead" or "Turn left ahead". Also, the face authentication device 1 may include, in the face authentication result image 6 of the person 5 determined to be proper, an image of a right turn arrow or an image of a left turn arrow. Further, the face authentication device 1 may include, in the face authentication result image 6 of the person 5 determined to be proper, a character image such as "Please go to the conference room on the second floor".

[0082] As described above, when including, in the face authentication result image 6 of the person 5 determined to be proper, an image indicating the route after passing through the passage management area A1, in the storage unit 12, image data indicating the route after passing through the passage management area A1 is stored in association with the face image data stored (registered) in advance. When the face authentication device 1 determines that the person 5 is proper in the face authentication process, the face authentication device 1 acquires the image data indicating the route after passing through the passage management area A1 stored corresponding to the face image data of that person 5. Then, the face authentication device 1 generates the image data of the face authentication result image 6 including the image of the acquired image data, and transmits it to the projector 3.

[0083] Thereby, the person 5 determined to be proper can easily move to an appropriate place after passing through the passage management area A1. For example, in the case of a concert venue, the person 5 can easily move to the reserved seat.

[0084] In addition, the face authentication device 1 may include, in the face authentication result image 6 of the person 5 determined to be improper, an image indicating the reason for the impropriety.

[0085] In addition, the face recognition device 1 may include, for the face recognition result of the person 5 determined to be improper, an image indicating the route after passing through the passage management area A1 with respect to the image 6. In this case, it may include images indicating different routes for the person 5 determined to be legitimate and the person 5 determined to be improper. For example, in the case of a concert venue, it is conceivable to guide the person 5 determined to be legitimate to the reserved seat and the person 5 determined to be improper to a window or a security room where there is a staff member.

[0086] For example, when the face of the person 5 is blocked by the previous person and the face image cannot be acquired and the face recognition process cannot be executed, the face recognition device 1 may include a character image such as "Please move away because your face is blocked by the previous person" in the face recognition result image 6.

[0087] In addition, when the face recognition process cannot be executed because the person 5 is wearing sunglasses, the face recognition device 1 may include a character image such as "Please remove your sunglasses" in the face recognition result image 6.

[0088] As a result, even if a person 5 who is originally legitimate is determined to be improper, they can take appropriate measures to be determined to be legitimate and pass through the passage management area A1.

[0089] (Modification Example 3) In addition to the projector 3, the face recognition device 1 may display the face recognition result on a display installed in a location different from the passage management area A1, such as a security room. For example, the face recognition device 1 may display the face recognition result on the display together with the image captured by the camera 2. For example, the face recognition result image may be displayed at the feet of the person 5 shown in the image captured by the camera 2.

[0090] As described above, when the face recognition result image is displayed on the display, the face recognition result image 6 projected by the projector 3 and the face recognition result image displayed on the display may be different. That is, the face recognition result image 6 notified to the person 5 and the face recognition result image notified to the security guard may be different.

[0091] For example, the face recognition device 1 may include an OK character image in the face recognition result image 6 notified to person 5, and may include an image of information such as the name and destination of person 5 in the face recognition result image notified to (displayed on the display of) the security guard.

[0092] Also, the face recognition result image notified to the security guard may reflect the correct face recognition result, and a different face recognition result image may be projected onto the face recognition result image 6 notified to person 5. For example, in a theme park or the like, if there is a risk that the OK / NG character image may spoil the surrounding atmosphere, an image of a character that notifies that face recognition has been performed but does not notify the result may be projected at the feet of person 5, and only the security guard may be notified of the face recognition result.

[0093] Also, the face recognition result image notified to the security guard may reflect the correct face recognition result, and the face recognition result image 6 notified to person 5 may reflect an incorrect face recognition result. For example, since the image projected by the projector 3 can be confirmed by the person himself and the surrounding people, if person 5 is a person who requires attention, there is a risk of causing escape or confusion. Therefore, even if it is actually determined to be inappropriate, by projecting an image indicating that it is legitimate, it is possible to monitor the person who requires attention while suppressing escape and confusion.

[0094] Also, the face recognition device 1 may include, for example, an NG character image in the face recognition result image 6 notified to person 5 determined to be inappropriate, and may include an image of information indicating that person 5 is a person who requires attention in the face image recognition result image notified to (displayed on the display of) the security guard.

[0095] Also, the device for notifying the security guard is not limited to a display installed in a location different from the passage management area A1. It may be a terminal such as a smartphone owned by the security guard, or a head-mounted display worn by the security guard. That is, any device may be used as long as it is difficult for a person passing through the passage management area A1 to peek at it.

[0096] (Modification Example 4) The face recognition device 1 may change the display form of the face recognition result image 6 projected by the projector 3 based on the positional relationship of the people passing through the passage management area A1. For example, the face recognition device 1 may change the size and position of the face recognition result image 6 so that the face recognition result image 6 of a certain person 5 does not overlap with the face recognition result image 6 of the adjacent person 5.

[0097] In addition, the face recognition device 1 may change the size and position of the face recognition result image 6 for people 5 with high density (crowded) and people 5 with low density (scattered). For example, the face recognition device 1 may make the size of the face recognition result image 6 of people 5 with high density smaller than the size of the face recognition result image 6 of people 5 with low density.

[0098] In this way, the face recognition device 1 changes the display form of the face recognition result image 6 according to the positional relationship of the people 5 passing through the passage management area A1 and the density of the people 5. Thereby, the people 5 passing through the passage management area A1 and the administrator who manages the passage of the passage management area A1 can easily recognize the face recognition results of the people 5.

[0099] (Modification Example 5) Calibration may be performed between the camera 2 and the projector 3. For example, calibration may be performed between the coordinates in the image of the camera 2 (coordinates in the passage management area A1) and the projection coordinates of the projector.

[0100] (Modification Example 6) The face recognition device 1 may notify the face recognition result to the group with one face recognition result image 6 instead of notifying the face recognition result image 6 to each individual in the group where the face recognition results are the same.

[0101] FIG. 7 is a diagram showing a projection example of the face recognition result image 6 according to Modification Example 6. In FIG. 7, the same components as those in FIG. 1 are denoted by the same reference numerals.

[0102] When the face authentication results of a plurality of persons 5 (group) located within a region of a predetermined size are the same, the face authentication device 1 may notify the group of the face authentication result image 6 all at once. That is, when the persons 5 passing through the passage management area A1 in a group (collectively), if the face authentication results are the same, the face authentication device 1 may notify the face authentication result image 6 all at once.

[0103] For example, in FIG. 7, assume that persons 5a to 5c are located within a region of a predetermined size. That is, assume that persons 5a to 5c are a group. Assume that the face authentication device 1 determines that the face authentication results for the group of persons 5a to 5c are valid. In this case, the face authentication device 1 generates image data of a face authentication result image 6a that notifies the group of persons 5a to 5c all at once that the face authentication results are valid. As a result, a single common face authentication result image 6a is projected at the feet of persons 5a to 5c.

[0104] Similarly, for a group determined to have inappropriate face authentication results, a face authentication result image 6a that notifies all at once that the face authentication results are inappropriate may be generated.

[0105] As described above, the face authentication device 1 generates image data so that one face authentication result image 6a is projected at the feet of the group of persons 5a to 5c having the same face authentication results.

[0106] As a result, a group or the like moving through the passage management area A1 can easily recognize the face authentication results. Also, an administrator who manages passage through the passage management area A1 can easily recognize the face authentication results of a group or the like moving through the passage management area A1.

[0107] Note that various known methods other than those described above may be applied to determine whether it is a group. For example, when the movement trajectories of persons 5a to 5c are substantially the same, it may be determined that they are a group or the like.

[0108] Also, when there are a small number of people 5 (for example, less than half of the total number of people in the group) who are considered not to belong to the group (such as when their moving directions are clearly different), a face authentication result image 6a that ignores the face authentication results for these small number of people 5 and notifies the face authentication results collectively may be generated. This eliminates the need to separate the face authentication result image 6a for the small number of people 5, enabling efficient notification. Even when adopting this configuration, if either legitimacy or illegitimacy has important significance, a face authentication result image 6a that shows a result different from the group only at the feet of the small number of people 5 may be projected.

[0109] (Modification Example 7) The face authentication device 1 may determine the projection position of the face authentication result image 6 using the background difference method.

[0110] For example, when there is no person 5 in the passage management area A1, the face authentication device 1 stores the image data (hereinafter referred to as background image data) in the storage unit 12. The face authentication device 1 compares the image data including person 5 captured by the camera 2 with the background image data stored in the storage unit 12, and identifies the floor area where there is no person 5 in the image data including person 5 captured by the camera 2. The face authentication device 1 calculates the projection position for projecting the face authentication result image 6 in the identified floor area where there is no person 5.

[0111] Thereby, the face authentication device 1 can suppress the face authentication result image 6 from being hidden by person 5.

[0112] (Modification Example 8) The face authentication device 1 may acquire the line-of-sight information of person 5 from the face image detected by the face image detection process. The face authentication device 1 may calculate (adjust) the projection position of the face authentication result image 6 based on the acquired line-of-sight information. For example, when the line of sight of person 5 is directed slightly ahead of the feet of person 5, the face authentication device 1 may change the projection position of the face authentication result image 6 to a position slightly ahead of the feet of person 5.

[0113] In this way, the face recognition device 1 generates image data in which the projection position of the face recognition result image 6 is adjusted based on the line of sight of the person 5. As a result, the person 5 can easily visually recognize the face recognition result image 6.

[0114] In addition, when the line of sight of the person 5 is blocked by the body of the previous person 5 or the like, the face recognition device 1 may adjust the body of the previous person 5 as the projection position of the face recognition result image 6.

[0115] (Modification Example 9) A plurality of projectors 3 may be installed at different locations so as to have the same or overlapping projection ranges. For example, two projectors 3 may be installed with the passage management area A1 therebetween. The face recognition device 1 may project the face recognition result image 6 at the feet of the person 5 using the plurality of projectors 3.

[0116] For example, the face recognition device 1 projects the face recognition result image 6 at the feet of the person 5 using a first projector 3 and a second projector 3 installed at different locations. Even if a certain face recognition result image 6 projected by the first projector 3 is blocked by another person 5, the face recognition result image 6 can be projected at the feet of a certain person 5 by the second projector 3 that projects the face recognition result image 6 from another direction.

[0117] In this way, when a plurality of projectors 3 are installed, the area where the face recognition result image 6 cannot be projected can be reduced.

[0118] (Other Modification Examples) In the above embodiment, the face recognition process was performed inside the face recognition device 1. However, the face recognition process may be performed by an external server or the like. In this case, the face recognition device 1 sends the image data received from the camera 2 or the data obtained by performing processing such as cutting out the face portion of the person 5 from the image data to a server that performs the face recognition process, and acquires the result of the face recognition from the server. The processing after acquiring the face recognition result is the same as that in the above embodiment.

[0119] In the above-described embodiment, the face recognition device 1 calculates the position of person 5 in the passage management area A1 based on the image data of camera 2. However, other methods may be used to identify the position of person 5. For example, the position of person 5 may be estimated by associating the position of the head of person 5 detected by another camera or sensor installed on the ceiling or the like with the position of the face included in the image data of camera 2. Further, a terminal or the like having a positioning function may be provided to person 5, and the position of each person 5 may be identified based on a signal from the terminal. That is, in the above-described embodiment, various techniques known as techniques for estimating the position of a person can be applied to the method of identifying the position of person 5.

[0120] In the above-described embodiment, the face recognition unit 11b executes the face recognition process. However, the face recognition process may be executed by, for example, an external server. The face recognition device 1 may acquire the face recognition result of the face recognition process from the external server. The face recognition device 1 may be referred to as a notification device.

[0121] In the above-described embodiment, the notation “... unit” used for each component may be replaced with other notations such as “... circuitry”, “... assembly”, “... device”, “... unit”, or “... module”.

[0122] As described above, the embodiments have been described with reference to the drawings, but the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive of various modification examples or correction examples within the scope described in the claims. Such modification examples or correction examples are also understood to belong to the technical scope of the present disclosure. Further, within the scope not departing from the gist of the present disclosure, the components in the embodiments may be arbitrarily combined. Also, the modification examples in the embodiments may be arbitrarily combined.

[0123] The present disclosure can be implemented in software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiments is realized, partially or entirely, as an LSI which is an integrated circuit, and each process described in the above embodiments may be controlled, partially or entirely, by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip so as to include part or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may also be referred to as an IC, a system LSI, a super LSI, or an ultra LSI.

[0124] The method of integration is not limited to LSI, and it may be realized by an application specific circuit, a general-purpose processor, or a dedicated processor. Further, after manufacturing the LSI, an FPGA (Field Programmable Gate Array) that can be programmed, or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.

[0125] Furthermore, if an integrated circuit technology that replaces the LSI appears due to the progress of semiconductor technology or other derived technologies, naturally, the technology may be used to integrate the functional blocks. The application of biotechnology and the like are possible.

Industrial Applicability

[0126] The present disclosure is useful for a face authentication system that performs face authentication at a place where many people pass through simultaneously.

Explanation of Signs

[0127] 1 Face authentication device 2 Camera 3 Projector 5 Person 6 Face authentication result image 11 Control unit 11a Position calculation unit 11b Face authentication unit 11c Image data generation unit 12 Memory unit 13 Communication unit 13a Image data reception unit 13b Image data transmission unit 14 Input unit 15 Output unit A1 Passage management area

Claims

1. A generation unit that represents a face authentication result of a person passing through the passage management area, obtained based on image data of a camera that photographs the passage management area, and generates image data of a face authentication result image projected onto the feet of the person passing through the passage management area; A transmission unit that transmits the image data to a projector; comprising The generation unit determines whether to generate the image data of a person determined to be valid in the face authentication process based on the number of people passing through the passage management area. Notification device.

2. When the number of people passing through the passage management area exceeds a threshold value, the generation unit determines not to generate the image data of a person determined to be valid in the face authentication process. The notification device according to claim 1.

3. The generation unit generates the image data including an image indicating a route after passing through the passage management area in the face authentication result image. The notification device according to claim 1 or 2.

4. The generation unit generates the image data including an image indicating a reason for invalidity of a person for whom face authentication is determined to be invalid in the face authentication result image. The notification device according to any one of claims 1 to 3.

5. The generation unit changes the size or display position of the face authentication result image based on the positional relationship of the people passing through the passage management area. The notification device according to any one of claims 1 to 4.

6. For the same group of face authentication results, the generation unit generates the image data in which one face authentication result image is projected onto the feet of the group. The notification device according to any one of claims 1 to 5.

7. The generation unit generates the image data in which the projection position of the face authentication result image is adjusted based on the line of sight of the people passing through the passage management area. The notification device according to any one of claims 1 to 6.

8. Represents a face authentication result of a person passing through the passage management area, obtained based on image data of a camera that photographs the passage management area, generates image data of a face authentication result image projected onto the feet of the person passing through the passage management area, transmits the image data to a projector, and determines whether to generate the image data of a person determined to be valid in the face authentication process based on the number of people passing through the passage management area. Notification method.

Images