Imaging control device, system, method and program

Abstract

The present invention provides an imaging control device for providing a captured image guaranteeing that all group members show therein. An imaging control device (100) is provided with: a storage unit (110) that stores, as a group, identification information of a plurality of persons: an acquisition unit (120) that acquires a captured image obtained by capturing an image of the plurality of persons by a predetermined imaging device; a region specification unit (130) that specifies a plurality of face regions from the captured image; a personal authentication control unit (140) that causes an authentication device (200) that stores a set of facial feature information of the plurality of persons to perform face authentication using the set of facial feature information on each of the specified face regions; and an output unit (150) that, when the facial feature information of each of the persons belonging to the group succeeds in face authentication with any of the plurality of face regions, outputs the captured image as an output image.

Description

[Technical Field]

[0001] The present invention relates to a photography control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored, and more particularly to a photography control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored for performing group face recognition. [Background technology]

[0002] Patent Document 1 discloses a technique for taking commemorative photographs using facial recognition technology. The facial recognition system described in Patent Document 1 compares a facial image contained in an in-area image taken at an entertainment facility with a registered image registered at the accommodation facility. The facial recognition system described in Patent Document 1 enables guests to obtain an in-area image in which they themselves appear.

[0003] Patent Documents 2 and 3 disclose techniques for detecting facial images from a captured image and performing mosaic processing on facial images other than those of a specific person. Patent Document 4 discloses a technique for recognizing the gestures of a subject in a captured image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-126414 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-062560 [Patent Document 3] Japanese Patent Application Laid-Open No. 2011-182028 [Patent Document 4] Japanese Patent Application Laid-Open No. 2015-043141 Summary of the Invention [Problem to be solved by the invention]

[0005] The system described in Patent Document 1 outputs a captured image that includes a registered person as an output image. However, if users are in a group, some of the group members may not appear in the output image. Therefore, there is a problem that it is difficult to take a group photo using the related system.

[0006] The present disclosure has been made to solve such problems, and aims to provide a shooting control device, system, method, and program for providing a captured image that guarantees that all members of a group are included in the image. [Means for solving the problem]

[0007] The photography control device according to the present disclosure includes a storage means for storing identification information of a plurality of persons as a group, an acquisition means for acquiring a photographed image of a plurality of persons photographed by a specified photography device, an area identification means for identifying a plurality of facial areas from the photographed image, a personal authentication control means for causing an authentication device that stores a set of facial feature information of the plurality of persons to perform face authentication for each of the identified facial areas using the set of facial feature information, and an output means for outputting the photographed image as an output image when each of the facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial areas.

[0008] The photography control device according to the present disclosure includes a storage means for storing a collection of facial feature information of a plurality of persons as a group, an acquisition means for acquiring a photographed image of a plurality of persons photographed by a specified photography device, an area identification means for identifying a plurality of facial areas from the photographed image, a personal authentication control means for performing face authentication for each of the identified facial areas using the collection of facial feature information, and an output means for outputting the photographed image as an output image when each of the facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial areas.

[0009] The photography control system according to the present disclosure comprises a photography control device having a storage means for storing identification information of a plurality of persons as a group, an authentication device having a storage means for storing facial feature information of the plurality of persons and an authentication means for performing face authentication using the set of facial feature information, and a specified photography device, wherein the photography control device acquires a photographed image of a plurality of persons taken by the specified photography device, identifies a plurality of facial areas from the photographed image, performs face authentication for each of the identified facial areas using the set of facial feature information, and outputs the photographed image as an output image if each of the facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial areas.

[0010] The photography control method according to the present disclosure involves a computer that stores identification information of multiple people as a group, acquires a photographed image of multiple people taken with a specified photography device, identifies multiple facial areas from the photographed image, causes an authentication device that stores a collection of facial feature information of the multiple people to perform facial authentication for each of the identified facial areas using the collection of facial feature information, and outputs the photographed image as an output image if each of the facial feature information of each person belonging to the group is successfully authenticated with one of the multiple facial areas.

[0011] The photography control method disclosed herein involves a computer that stores a collection of facial feature information of multiple people as a group, acquires a photographed image of multiple people taken with a specified photography device, identifies multiple facial areas from the photographed image, performs facial recognition for each identified facial area using the collection of facial feature information, and outputs the photographed image as an output image if each of the facial feature information of each person belonging to the group is successfully recognized as having one of the multiple facial areas.

[0012] The non-transitory computer-readable medium according to the present disclosure has recorded thereon a program that causes a computer that stores identification information of a plurality of persons as a group to acquire a photographed image of the plurality of persons taken with a specified photographing device, identify a plurality of facial areas from the photographed image, cause an authentication device that stores a set of facial feature information of the plurality of persons to perform facial authentication for each of the identified facial areas using the set of facial feature information, and output the photographed image as an output image if each of the facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial areas.

[0013] The non-transitory computer-readable medium according to the present disclosure has recorded thereon a program that causes a computer that stores a collection of facial feature information of a plurality of persons as a group to execute the following processes: acquiring a photographed image of a plurality of persons taken with a specified photographing device; identifying a plurality of facial areas from the photographed image; performing facial recognition for each of the identified facial areas using the collection of facial feature information; and outputting the photographed image as an output image if each of the facial feature information of each person belonging to the group is successfully recognized as having one of the plurality of facial areas. [Effects of the Invention]

[0014] The present disclosure can provide a photography control device, system, method, and program for providing a photographed image that guarantees that all members of a group are included in the image. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a block diagram showing the configuration of an imaging control device according to a first embodiment. [Figure 2] 4 is a flowchart showing the flow of an imaging control method according to the first embodiment. [Figure 3] FIG. 10 is a block diagram showing the configuration of an imaging control device according to a second embodiment. [Figure 4] FIG. 11 is a block diagram showing the configuration of an imaging control system according to a third embodiment. [Figure 5] FIG. 10 is a block diagram showing the configuration of an authentication device according to a third embodiment. [Figure 6] FIG. 11 is a block diagram showing the configuration of a face authentication terminal according to a third embodiment. [Figure 7] FIG. 11 is a block diagram showing the configuration of a user terminal according to the third embodiment. [Figure 8] 11 is a flowchart showing the flow of face information registration processing according to the third embodiment. [Figure 9] 11 is a flowchart showing the flow of face authentication processing according to the third embodiment. [Figure 10] 11 is a flowchart showing the flow of group authentication processing according to the third embodiment. [Figure 11] FIG. 10 is a diagram illustrating a captured image according to the third embodiment. [Figure 12] FIG. 10 is a block diagram showing the configuration of an imaging control system according to a fourth embodiment. [Figure 13] 10 is a flowchart showing the flow of group authentication processing according to the fourth embodiment. [Figure 14] FIG. 10 is a diagram illustrating an output image according to the fourth embodiment. [Figure 15] FIG. 11 is a block diagram showing the configuration of a photography control system according to a fifth embodiment. [Figure 16] FIG. 11 is a block diagram showing the configuration of a face authentication terminal according to a fifth embodiment. [Figure 17] FIG. 11 is a block diagram showing the configuration of a user terminal according to the fifth embodiment. [Figure 18] FIG. 13 is a block diagram showing the configuration of an imaging control system according to a sixth embodiment. [Figure 19] FIG. 13 is a diagram illustrating a captured image according to the sixth embodiment. [Figure 20] 13 is a flowchart showing the flow of group registration processing according to the sixth embodiment. [Figure 21] FIG. 20 is a conceptual diagram showing a state after face information registration processing according to the sixth embodiment has been performed. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0017] <Embodiment 1> 1 is a block diagram showing the configuration of an imaging control device 100 according to the first embodiment. The imaging control device 100 includes a storage unit 110, an acquisition unit 120, an area identification unit 130, a personal authentication control unit 140, and an output unit 150. The imaging control device 100 is connected to a network 500 (not shown). The network 500 may be wired or wireless. An authentication device 200 (not shown) is connected to the network 500.

[0018] The storage unit 110 stores identification information of multiple people as a group. The identification information is information for identifying multiple users. The identification information is, for example, a user ID, an email address, etc. The acquisition unit 120 acquires images of multiple people taken by a predetermined imaging device. For example, the predetermined imaging device is a public camera installed in a public area.

[0019] The region identification unit 130 identifies a plurality of face regions from the captured image. The personal authentication control unit 140 causes the authentication device 200 to perform face authentication using a set of facial feature information for each of the identified face regions. Here, it is assumed that the authentication device 200 stores a set of facial feature information for a plurality of people.

[0020] When the facial feature information of each person belonging to the group is successfully authenticated with any of the plurality of facial regions, the output unit 150 outputs the captured image as an output image. For example, the output unit 150 may output the output image to a user terminal owned by a person belonging to the group.

[0021] 2 is a flowchart showing the flow of the photography control method according to Embodiment 1. It is assumed that the storage unit 110 of the photography control device 100 stores identification information of a plurality of people as a group.

[0022] First, the acquisition unit 120 acquires a photographed image of multiple people taken by a predetermined photographing device (step S101). The photographed image may include people outside the group. All members of the group must appear in the photographed image, but people within the group may be located at different locations. Next, the region identification unit 130 identifies multiple face regions from the photographed image (step S102).

[0023] Next, the personal authentication control unit 140 causes the authentication device 200, which stores a set of facial feature information of multiple people, to perform face authentication for each identified face area using the set of facial feature information (step S103). Finally, the output unit 150 outputs the captured image as an output image when the facial feature information of each person belonging to the group is successfully authenticated with one of the multiple face areas (step S104).

[0024] As described above, it has not been possible to guarantee that all members of a group appear in a photographed image up until now. In contrast, in this embodiment, it is possible to provide a photographed image that guarantees that all members of a group appear in the photographed image.

[0025] The photography control device 100 includes a processor, memory, and storage device (not shown). The storage device stores a computer program that implements the processing of the photography control method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of the acquisition unit 120, area identification unit 130, personal authentication control unit 140, and output unit 150.

[0026] Alternatively, the acquisition unit 120, the area identification unit 130, the personal authentication control unit 140, and the output unit 150 may each be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. Furthermore, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), etc. may be used as the processor.

[0027] Furthermore, when some or all of the components of the imaging control device 100 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in which they are connected via a communication network. Furthermore, the functions of the imaging control device 100 may be provided in a SaaS (Software as a Service) format.

[0028] <Embodiment 2> The present embodiment 2 is a modification of the above-described embodiment 1. The imaging control device 100 according to embodiment 1 performs personal authentication using an external authentication device 200. On the other hand, the imaging control device 100 according to embodiment 2 performs personal authentication within the device.

[0029] 3 is a block diagram showing the configuration of the photography control device 100 according to the present embodiment 2. The photography control device 100 includes a storage unit 110, an acquisition unit 120, an area identification unit 130, a personal authentication control unit 140, and an output unit 150. The functions of the acquisition unit 120, the area identification unit 130, and the output unit 150 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0030] The storage unit 110 according to the second embodiment stores a set of facial feature information of a plurality of persons as a group. The personal authentication control unit 140 according to the second embodiment performs face authentication for each face area identified by the area identification unit 130 using the set of facial feature information stored in the storage unit 110.

[0031] The flow of the photography control method according to the second embodiment is the same as that shown in Fig. 2. However, in step S103, the personal authentication control unit 140 performs face authentication using a set of facial feature information stored in the storage unit 110 for each face area identified in step S102.

[0032] In this way, the second embodiment can also achieve the same effects as the first embodiment described above.

[0033] <Embodiment 3> The present embodiment 3 is a specific example of the above-described embodiment 1. Fig. 4 is a block diagram showing the configuration of an imaging control system 600a according to the present embodiment 3. The imaging control system 600a includes an imaging control device 100a, an authentication device 200, an imaging device 700, a face authentication terminal 300, and a user terminal 400. The imaging control device 100a, the authentication device 200, the imaging device 700, the face authentication terminal 300, and the user terminal 400 are each connected via a network 500.

[0034] In the third embodiment, it is assumed that facial feature information of a plurality of users is registered in advance in the authentication device 200. It is assumed that each member of a predetermined group, which will be described later, is included in the plurality of users. The photography control device 100a according to the third embodiment outputs a photographed image when all members of the predetermined group take a photograph.

[0035] The photography control device 100a includes a group DB 110a, a registration unit 170, an acquisition unit 120, an area identification unit 130, a personal authentication control unit 140, a group authentication unit 160, and an output unit 150. The photography control device 100a registers a plurality of users as a group in the group DB 110a. The photography control device 100a controls group authentication, which will be described later. Each function of the photography control device 100a will be described later.

[0036] The authentication device 200 has a facial feature DB 210. The facial feature DB 210 stores a user ID and facial feature information of the user in association with each other. The facial feature DB 210 is also referred to as a storage unit. In addition, in response to a facial authentication request received from the outside, the authentication device 200 compares the facial image or facial feature information included in the request with the facial feature information of each user and returns the comparison result to the request source. The photographing device 700 is installed at point X. The photographing device 700 takes a photographed image and transmits it to the photographing control device 100a via the network 500. Point X is, for example, a scramble intersection.

[0037] The face authentication terminal 300 captures a registration image used for face authentication of users UA1, UA2, and UA3. The face authentication terminal 300 transmits the registration image to the authentication device 200 and requests face information registration. The face authentication terminal 300 may also transmit facial feature information extracted from the registration image to the authentication terminal and request face information registration. The face authentication terminal 300 may be installed at point X, or may be installed at a location different from point X. The face authentication terminal 300 may be a digital signage.

[0038] The user terminal 400 is a terminal owned by at least one of the users UA1, UA2, and UA3. The user terminal 400 is, for example, a mobile phone, a smartphone, a tablet, or a PC (Personal Computer) equipped with or connected to a camera. The user terminal 400 transmits a registration image used for face authentication of the users UA1, UA2, and UA3 to the authentication device 200 and requests face information registration. The user terminal 400 may also transmit facial feature information extracted from the registration image to the authentication device 200 and request face information registration. The user terminal 400 may receive an output image from the photography control device 100a. The photography control system 600a may include only one of the face authentication terminal 300 and the user terminal 400 as a display device that receives and displays the output image. The photography control system 600a may use one of the photography device 700, the face authentication terminal 300, or the user terminal 400 as a predetermined photography device for capturing a photographed image. The photographing device 700 may transmit a registration image to the authentication device 200 and make a facial information registration request. Here, the photographing device 700 may transmit facial feature information extracted from the registration image to the authentication device 200 and make a facial information registration request.

[0039] That is, the face authentication terminal 300 and the user terminal 400 are devices that register facial feature information extracted from a user's facial image in the face information DB 210 before performing group authentication, which will be described later. Here, as a method for registering facial feature information, for example, either method a or b shown below can be used. a. A method in which the faces of multiple people are photographed simultaneously, multiple facial areas are detected from one image, and each piece of extracted facial feature information is registered in the face information DB 210. b. A method in which the faces of group members are photographed in turn, and facial feature information extracted from each image is registered in the face information DB 210. Note that, as will be described later, facial feature information is registered in the face information DB 210 in association with a user ID. The photography control device 100a associates multiple user IDs with a group ID and registers them as a single group in the group DB 110a.

[0040] Next, a detailed description will be given of the functions of authentication device 200. Fig. 5 is a block diagram showing the configuration of authentication device 200. Authentication device 200 includes face information DB 210, face detection unit 220, feature point extraction unit 230, registration unit 240, and authentication unit 250.

[0041] The face detection unit 220 detects a face area included in a registration image for registering face information and outputs the detected face area to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face area detected by the face detection unit 220 and outputs face feature information to the registration unit 240. Here, the face feature information is a collection of the extracted feature points. The feature point extraction unit 230 also extracts feature points included in a face image received from the photography control device 100a and outputs the face feature information to the authentication unit 250.

[0042] The registration unit 240 issues a new user ID when registering facial feature information. The registration unit 240 associates the issued user ID with the facial feature information extracted from the registered image and registers the associated user ID in the facial information DB 210. The authentication unit 250 compares the facial feature information extracted from the facial image with the facial feature information in the facial information DB 210. The authentication unit 250 returns a response indicating whether or not the facial feature information matches to the imaging control device 100a. Whether or not the facial feature information matches corresponds to whether or not authentication was successful.

[0043] FIG. 8 is a flowchart showing the flow of face information registration processing by the authentication device 200. First, the authentication device 200 acquires a registration image included in a face information registration request (step S201). For example, the authentication device 200 receives a face information registration request from the face authentication terminal 300 or the user terminal 400 via the network 500. Next, the face detection unit 220 detects a face area included in the registration image (step S202). Next, the feature point extraction unit 230 extracts feature points from the face area detected in step S202 and outputs face feature information to the registration unit 240 (step S203). Finally, the registration unit 240 issues a user ID and associates the user ID with the face feature information to register it in the face information DB 210 (step S204). Note that the authentication device 200 may receive face feature information from a face authentication terminal or the like and register it in the face information DB 210 in association with the user ID.

[0044] FIG. 9 is a flowchart showing the flow of face authentication processing by the authentication device 200. First, the feature point extraction unit 230 acquires facial feature information from a facial image received from the photography control device 100a (step S301). For example, the authentication device 200 receives a facial image from the photography control device 100a and extracts facial feature information as in steps S201 to S203. Alternatively, the authentication device 200 may receive facial feature information from the photography control device 100a. Next, the authentication unit 250 compares the acquired facial feature information with the facial information DB 210 (step S302). If the facial feature information matches (Yes in step S303), the authentication unit 250 identifies the user ID of the user whose facial feature information matches (step S304) and returns a message to the photography control device 100a indicating that face authentication was successful and the identified user ID (step S305). If there is no matching facial feature information (No in step S303), the authentication unit 250 returns a message to the imaging control device 100a indicating that face authentication has failed (step S306).

[0045] Next, the face authentication terminal 300 will be described in detail. The face authentication terminal 300 has a hardware configuration including an imaging device such as a camera, a display device, and a computer. FIG. 6 is a block diagram showing the configuration of the face authentication terminal 300. The face authentication terminal 300 has the above-mentioned camera 310, a memory unit 320, a communication unit 330, a display unit 340, and a control unit 350. The memory unit 320 is a storage device that stores programs for realizing each function of the face authentication terminal 300. The communication unit 330 is a communication interface with the network 500. The display unit 340 is the above-mentioned display device. The control unit 350 controls the hardware of the face authentication terminal 300. The control unit 350 has an imaging unit 351 and a registration unit 352.

[0046] The photographing unit 351 controls the camera 310 to photograph a registration image of the user. The registration image is an image that includes at least an image of the user's face. The registration unit 352 transmits a face information registration request including the registration image to the authentication device 200 via the network 500. Note that the face authentication terminal 300 may be capable of displaying an output image on the screen of the display unit 340.

[0047] Next, the user terminal 400 will be described. The user terminal 400 is a mobile phone terminal or a PC carried by a user. FIG. 7 is a block diagram showing the configuration of the user terminal 400. Like the face authentication terminal 300, the user terminal 400 includes a camera 410, a storage unit 420, a communication unit 430, and a display unit 440. The user terminal 400 also includes a control unit 450 that controls the above-mentioned hardware. Like the control unit 350 of the face authentication terminal 300, the control unit 450 includes an imaging unit 451 and a registration unit 452. The user terminal 400 may be capable of displaying an output image on the screen of the display unit 440.

[0048] The face authentication terminal 300 and the user terminal 400 have the function of issuing a face information registration request and a group registration request. The flow of the face information registration process and the group registration process will be explained below. Note that although the case where the user terminal 400 is used will be explained, similar processes may also be performed by the face authentication terminal 300.

[0049] First, the facial information registration process will be described. First, the photographing unit 451 controls the camera 410 to photograph a registration image of the user. Next, the registration unit 452 transmits a facial information registration request including the registration image to the authentication device 200 via the network 500. Finally, the registration unit 452 receives the authentication result from the authentication device 200. Note that the registration unit 452 may transmit the facial information registration request including facial feature information extracted from the registration image to the authentication device 200.

[0050] Next, an example of group registration processing will be described. First, the user terminal 400 individually performs the face information registration processing described above in response to an operation by each user belonging to the group. Next, the user terminal 400 transmits a group registration request to the imaging control device 100a in response to an operation by any user in the group, and registers definitions of the members belonging to the group.

[0051] Next, returning to Fig. 4, the functions of the photography control device 100a will be described. The photography control device 100a is an information processing device that performs group registration and group authentication, and is, for example, a server device realized by a computer. As shown in Fig. 5, the photography control device 100a includes a group DB 110a, a registration unit 170, an acquisition unit 120, an area identification unit 130, a personal authentication control unit 140, a group authentication unit 160, and an output unit 150.

[0052] The group DB 110a is a database for managing members belonging to a group. Members of a group are also called users. For example, the group DB 110a associates one group ID, one or more user IDs, and an authentication record for each record of group information. The authentication record is information indicating that group authentication was successful, and may be a flag, or may include the date, time, and location of successful group authentication.

[0053] The registration unit 170 receives a group registration request from the face authentication terminal 300 or the user terminal 400 via the network 500. The registration unit 170 issues a group ID corresponding to the multiple user IDs included in the received group registration request. The registration unit 170 generates group information in which each user ID is associated with the issued group ID, and registers the group information in the group DB 110a.

[0054] Furthermore, if a group registration request includes a group ID and one or more user IDs, the registration unit 170 may search the group DB 110a for the group ID included in the received group registration request. In such a case, the registration unit 170 updates the group information by further associating the user ID included in the received group registration request with the searched group ID. Note that the group registration process is not limited to this.

[0055] The acquisition unit 120 acquires a captured image from the photographing device 700. It is assumed that the captured image includes facial regions of multiple people. The region identification unit 130 identifies multiple facial regions from the captured image. For example, the region identification unit 130 analyzes the captured image to recognize multiple facial regions. When multiple facial regions are identified, the personal authentication control unit 140 causes the authentication device 200 to perform face authentication using a set of facial feature information for each identified facial region.

[0056] The group authentication unit 160 refers to the group DB 110a and performs group authentication. That is, the group authentication unit 160 determines whether the facial feature information of each person belonging to the group has been successfully authenticated with any of the multiple facial areas. If the group authentication is successful, the group authentication unit 160 registers the fact that the group authentication was successful in the group DB 110a.

[0057] Furthermore, if the facial regions for which face authentication with the facial feature information of each person belonging to the group has succeeded are within a predetermined range, the group authentication unit 160 may register in the group DB 110a that the group authentication has been successful in association with the group. In other words, the group authentication unit 160 may not authenticate the people as a group unless they are relatively close to each other. For example, if the people belonging to the group are unintentionally captured in the same frame, it may be considered inappropriate for a group image. Therefore, such cases can be excluded, improving the accuracy of group authentication.

[0058] If group authentication is successful, the output unit 150 outputs the captured image as an output image. If face authentication of part of the facial feature information of each person belonging to the group does not succeed with any of the multiple face regions, the output unit 150 outputs information indicating that the person corresponding to the part of facial feature information is not included in the captured image. In other words, if face authentication of some of the group members is not successful, the output unit 150 outputs information indicating that some users are not included.

[0059] The group authentication unit 160 may process the captured image so as to highlight users who have succeeded or failed in face authentication. In this case, the output unit 150 outputs the processed image as the output image. This allows group members to easily recognize which users' face authentication has failed. Furthermore, when the group has a large number of members, group members can easily identify absent members.

[0060] 10 is a flowchart showing the flow of group authentication processing. An example will be described in which the user IDs of users UA1, UA2, and UA3 are associated and registered as group A in the group DB 110a.

[0061] First, the acquisition unit 120 of the photography control device 100a acquires a photographed image from the photography device 700 (step S401). Next, the region identification unit 130 identifies multiple face regions from the photographed image (step S402). Next, the personal authentication control unit 140 causes the authentication device 200 to perform face authentication for each identified face region and receives the results of the face authentication (steps S403 to S406).

[0062] After performing face authentication on all of the multiple face regions identified in step S402, the group authentication unit 160 determines whether face authentication has been successful for all users in the group (step S407). For example, if the IDs of users UA1, UA2, and UA3 are received as the results of face authentication, the group authentication unit 160 determines that face authentication has been successful for all users in the group. For example, if the IDs of users UA1 and UA2 are received as the results of face authentication but the ID of user UA3 is not received, the group authentication unit 160 determines that group authentication has failed.

[0063] If all members of the group have passed the facial authentication (Yes in step S407), the group authentication unit 160 records that the group authentication has passed (step S408). For example, the group authentication unit 160 updates the group DB 110a by adding a record of the successful group authentication to the authentication record associated with group A. Furthermore, if all members of the group have passed the facial authentication, the output unit 150 outputs the captured image (step S409).

[0064] If not all members of the group have succeeded in face authentication (No in step S407), the group authentication unit 160 determines whether some members of the group have failed face authentication (step S410). A case in which some members of the group have failed face authentication occurs, for example, when the personal authentication control unit 140 receives the user IDs of users UA1 and UA2 as authentication results from the authentication device 200, but has not received the user ID of user UA3. If some members of the group have failed face authentication (Yes in step S410), the output unit 150 outputs a message indicating that some users are not included (step S411). The output destination of step S411 may be, for example, output to the logged-in user terminal 400 using the user ID of user UA1 or UA2 whose face authentication has succeeded, or output to the display unit 340 of the face authentication terminal 300, which is independent of the user.

[0065] Furthermore, the group authentication unit 160 may identify a user whose face authentication failed based on the difference between the user IDs of all the group members and the user ID of the user whose face authentication was successful. Then, the output unit 150 may output to the user terminal 400 of the identified user that face authentication of the user has failed. Furthermore, the output unit 150 may notify the user of the reason for the group authentication failure. The reason for the group authentication failure may be, for example, that the user is far away from the group members, or that face authentication of the user has failed, etc. Here, the group authentication unit 160 may notify the user of guidance for re-shooting, encouraging the user to get closer to the group members or to face the camera.

[0066] If all the members of the group fail the face authentication (No in step S410), the output unit 150 outputs a message indicating that the face authentication has failed (step S412). Note that the output destination of step S412 may be the display unit 340 of the face authentication terminal 300, which does not depend on the user.

[0067] FIG. 11 is an example of a captured image captured by the image capture device 700. Users UA1, UA2, and UA3 are members of a group. The image capture control device 100a identifies facial areas 11A1, 11A2, and 11A3 and causes the authentication device 200 to perform face authentication. The authentication device 200 transmits the user IDs of users UA1, UA2, and UA3. The image capture control device 100a determines that group authentication is successful and outputs the captured image. According to this embodiment, users can take a group photo that includes all members of the group.

[0068] <Embodiment 4> An image captured by the image capturing device 700 according to the third embodiment may contain multiple groups of people. In such cases, it is desirable to protect the privacy of each group. The image capturing control device 100b according to the fourth embodiment protects the privacy of each group and classifies people captured in the captured image into multiple groups.

[0069] 12 is a block diagram showing the configuration of an imaging control system 600b according to the fourth embodiment. The imaging control device 100b, authentication device 200, imaging device 700, face authentication terminal 300, and user terminal 400 are connected via a network 500, similarly to the third embodiment. Note that the authentication device 200, imaging device 700, face authentication terminal 300, and user terminal 400 are similar to those in the third embodiment, and therefore description thereof will be omitted.

[0070] The imaging control device 100b includes a group DB 110a, a registration unit 170, an acquisition unit 120, an area identification unit 130, a personal authentication control unit 140, a group authentication unit 160, an output unit 150, a classification unit 180, and a generation unit 190. The functions of the registration unit 170, the acquisition unit 120, the area identification unit 130, the personal authentication control unit 140, and the output unit 150 are the same as those in the third embodiment, and therefore description thereof will be omitted.

[0071] It is assumed that two pieces of group information are registered in the group DB 110a. For example, it is assumed that users UA1, UA2, and UA3 are registered in group ID: A, and users UB1 and UB2 are registered in group ID: B.

[0072] There are multiple users UA1, UA2, UA3, UB1, UB2, UC, UD, and UE at point X. Users UA1, UA2, and UA3 are members of group A. Users UB1 and UB2 are members of group B. Users UC, UD, and UE are people who do not belong to either group A or B.

[0073] The classification unit 180 of the photography control device 100b classifies each facial area that has been successfully authenticated into one of the groups to which the corresponding facial feature information belongs. For example, if the facial authentication of users UA1, UA2, UA3, UB1, and UB2 has been successful, the facial areas are classified into group A and group B.

[0074] For groups for which all of the facial feature information belonging to the group has been successfully authenticated, the group authentication unit 160 associates the group with the fact that the group authentication has been successful and registers the result in the group DB 110a. For example, if group authentication of groups A and B is successful, the group authentication unit 160 registers the fact that the group authentication has been successful in the authentication record of each group.

[0075] The generation unit 190 generates processed images for each group by processing the captured image so that the recognizability of face areas that do not belong to a specific group among the multiple face areas is reduced. For example, in the processed image for group A, mosaic processing is applied to the face areas of users UB1, UB2, UC, UD, and UE other than group A. In such a case, in the processed image for group B, mosaic processing is applied to the face areas of users UA1, UA2, UA3, UC, UD, and UE other than group B.

[0076] Fig. 14 is a diagram illustrating an example of a processed image generated by the generation unit 190. Fig. 14 is a processed image for group A. Facial areas 11B1 and 11B2 of users UB1 and UB2 who belong to group B have been subjected to mosaic processing to reduce the degree of recognition. Facial areas 11C, 11D, and 11E of users UC, UD, and UE who do not belong to any group have been subjected to mosaic processing to reduce the degree of recognition. On the other hand, facial areas 11A1, 11A2, and 11A3 of users UA1, UA2, and UA3 who belong to group A have not been subjected to mosaic processing.

[0077] Similarly, in the processed image for group B, face areas 11A1, 11A2, and 11A3 of users UA1, UA2, and UA3 who belong to group A are subjected to mosaic processing to reduce the degree of recognition.Face areas 11C, 11D, and 11E of users UC, UD, and UE who do not belong to any group are subjected to mosaic processing to reduce the degree of recognition.On the other hand, in the processed image for group B, face areas 11B1 and 11B2 of users UB1 and UB2 who belong to group B are not subjected to mosaic processing.

[0078] The output unit 150 outputs, as an output image, an edited image corresponding to each group to the user terminal 400 corresponding to the user who belongs to each group. For example, an edited image for group A is output to the user terminal 400 owned by user UA2 who belongs to group A. It is assumed that user UA2 has already logged in to the user terminal 400 using a user ID. Similarly, the output unit 150 outputs an edited image for group B to the user terminal 400 owned by user UB2 who belongs to group B.

[0079] 13 is a flowchart showing the flow of group authentication processing. Steps S401 to S406 are the same as those in FIG. 10, and therefore their explanations are omitted. In step S507, the classification unit 180 classifies each face area for which face authentication has been successful into a group. Next, the photography control device 100b determines whether face authentication has been successful for all people in the group (step S508).

[0080] For a group in which face authentication of all members has been successful, the photography control device 100b generates the processed image described above (step S509), records that the group authentication has been successful (step S510), and outputs the processed image (step S511). Note that, as described above, the generation of the processed image is performed for each group.

[0081] If face authentication has failed for at least some of the group members, the photographing control device 100b determines whether face authentication has failed for some of the group members or for all of the group members (step S512). If face authentication has failed for some of the group members, the photographing control device 100b outputs a message to that effect (step S513). Here, the photographing control device 100b may identify the person whose face authentication has failed, and notify the user terminal 400 of the identified person of guidance for re-photographing. If face authentication has failed for all of the group members, the photographing control device 100b outputs a message to the effect that face authentication has failed (step S514).

[0082] As a result, in the output image of users belonging to group A, the facial areas of users other than group A are blurred. Therefore, it is possible to protect the privacy of users in group B and users who do not belong to any group. <Embodiment 5> An imaging control system 600c according to the fifth embodiment records that all members of a group have passed through a checkpoint in a point rally or the like. Fig. 15 is a block diagram showing the configuration of the imaging control system 600c. The imaging control system 600c includes an imaging control device 100c, an authentication device 200, a face authentication terminal 300, and a user terminal 400, which are connected via a network 500. The face authentication terminal 300 is installed at point X, which is a checkpoint in the point rally.

[0083] In the fifth embodiment, the face authentication terminal 300 captures an image. Either the face authentication terminal 300 or the user terminal 400 displays an output image. Therefore, the user terminal 400 does not need to exist in the fifth embodiment. The functions of the authentication device 200 are the same as those in the other embodiments, and therefore a description thereof will be omitted.

[0084] 16 is a block diagram showing the functions of the face authentication terminal 300. The following describes the differences from embodiment 3. The camera 310 is used not only to capture registration images, but also to capture images at checkpoints.

[0085] The control unit 350 has a group image request unit 353. The group image request unit 353 transmits the captured image to the photography control device 100c to perform group authentication. If all members of the group are captured in the captured image, the face authentication terminal 300 acquires the captured image from the photography control device 100c and displays the captured image on the display unit 340. The face authentication terminal 300 is, for example, a digital signage, but is not limited to this.

[0086] Next, a description will be given of the processing performed by the face authentication terminal 300. The face information registration processing and group registration processing are the same as those in the third embodiment, and therefore descriptions thereof will be omitted. Below, a description will be given of the group authentication processing.

[0087] The group image request unit 353 transmits a group authentication request including the image captured by the camera 310 to the imaging control device 100c via the network 500, and receives the result of the group authentication. The group image request unit 353 receives the captured image and displays it on the display unit 340. If facial authentication of some of the group members is not successful, the group image request unit 353 receives a message that some users are not included and displays this on the display unit 340. If facial authentication of all of the group members is unsuccessful, the group image request unit 353 receives a message that facial authentication has failed and displays this on the display unit 340.

[0088] The user terminal 400 is a mobile terminal or the like carried by a user. Fig. 17 is a block diagram showing the configuration of the user terminal 400. The user terminal 400 has the same functions as the face authentication terminal 300. The processes performed by the face authentication terminal 300 in the above-mentioned face information registration process, group registration process, and group authentication process may be performed by the user terminal 400.

[0089] Next, returning to FIG. 15, the imaging control device 100c will be described. Only the differences from the third embodiment will be described below. The group DB 110a is a database that manages members belonging to a group and authentication records for the group. For example, the group DB associates one group ID, one or more user IDs, and authentication records for each record of group information. The authentication record is information indicating that group authentication was successful, and may be a flag, or may include information such as the date, time, and location of successful group authentication.

[0090] The acquisition unit 120 receives a group authentication request from the face authentication terminal 300 or the user terminal 400 via the network 500. In other words, the acquisition unit 120 acquires an image captured by a camera of the face authentication terminal or the like from the face authentication terminal or the like.

[0091] The flow of group authentication processing in the photography control device 100c is the same as that in Fig. 10. However, in step S401, the photography control device 100c acquires a group authentication request including a photographed image. The photography control system 600c according to this embodiment can accurately record that all members of a group have passed a checkpoint in a stamp rally or the like.

[0092] <Embodiment 6> According to the first to fifth embodiments, before group registration, all members of the group need to register their registration images for face authentication in advance. However, it is cumbersome for all members of the group to register their registration images in advance. The photography control system 600d according to the sixth embodiment performs group registration by user gestures.

[0093] 18 is a block diagram showing an imaging control system 600d according to the sixth embodiment. Compared to the third embodiment, an identification unit 105 is added to the imaging control device 100d. In addition, it is assumed that only the user ID of user UA1 is registered in the group DB 110a, and the user IDs of users UA2 and UA3 are not registered. In addition, it is assumed that the user ID and facial feature information of user UA1 are registered in the face information DB 210 of the authentication device 200, and the user IDs and facial feature information of other users are not registered.

[0094] The acquisition unit 120 acquires a captured image for group registration. The acquisition unit 120 may acquire the captured image for group registration from the face authentication terminal 300 or the user terminal 400, or may acquire the captured image for group registration from the photographing device 700. The following describes a case where the captured image includes multiple people. The region identification unit 130 identifies multiple face regions from the registration image. The personal authentication control unit 140 causes the authentication device 200 to perform face authentication on the identified face regions.

[0095] If the identification unit 105 succeeds in face authentication of user UA1, it identifies users UA2 and UA3 who are making gestures similar to those of user UA1 in the captured image. Gestures include, for example, a peace sign or a pose with one's hand raised. The identification unit 105 extracts posture features of multiple people appearing in the registered image. The identification unit 105 may also extract movement features of the movements of multiple people appearing in the captured image. The identification unit 105 identifies people whose extracted features are similar to those of user UA1. The identification unit 105 may also identify the type of gesture from the features of user UA1 and identify people making the same gesture.

[0096] FIG. 19 is an example of a captured image for group registration captured by the image capturing device 700 according to the sixth embodiment. The registration image shows users UA1, UA2, UA3, UB, and UC as multiple people. The user ID of user UA1 is assumed to be registered in the group DB 110a. Users UA2 and UA3 are performing the same gesture as user UA1. User UB is performing a different gesture from user UA1. User UC is not performing a specific gesture. In such a case, the identification unit 105 identifies users UA2 and UA3.

[0097] The registration unit 170 registers the facial feature information generated based on the identified facial regions of users UA2 and UA3 in the authentication device 200, and registers the user IDs of users UA2 and UA3 in the group DB 110a in association with the user ID of user UA1. At this time, the registration unit 170 issues a group ID. This makes it easy to register registration images for facial authentication of group members.

[0098] The registration unit 170 may register in the authentication device 200 only people who perform gestures similar to those of the user UA1 and whose distance from the user UA1 is equal to or less than a predetermined value. This is to prevent people who accidentally perform the same gesture from being registered as a group.

[0099] 20 is a flowchart illustrating the flow of group registration processing according to this embodiment. The photography control device 100d first acquires a captured image for group registration (step S601). Next, the photography control device 100d requests the authentication device 200 to perform face authentication for a face region identified from the captured image for group registration (step S602). Next, the photography control device 100d receives the result of face authentication (step S603) and determines whether the face authentication was successful (step S604).

[0100] If the facial authentication fails (No in step S604), the photographing control device 100d outputs a message indicating that the facial authentication failed (step S605). If the facial authentication succeeds (Yes in step S604), the photographing control device 100d identifies the gesture g1 of the user UA1 whose facial authentication succeeded (step S606). Next, the photographing control device 100d identifies users UA2 and UA3 who are performing gestures similar to the gesture g1 from the photographed image (step S607). Finally, the photographing control device 100d requests the authentication device 200 to register the facial information of users UA2 and UA3 (step S608). Furthermore, the photographing control device 100d associates the user ID of user UA1 with the user IDs of users UA2 and UA3 and registers them (step S609). The photographing control device 100d may transmit the result of the group registration to the user terminal 400.

[0101] 21 is a conceptual diagram showing the state of the imaging control system 600d after the user IDs of users UA2 and UA3 have been registered. New facial information for users UA2 and UA3 has been registered in the facial information DB 210 of the authentication device 200. New user IDs for users UA2 and UA3 have been registered in the group DB 110a of the imaging control device 100d, and users UA1, UA2, and UA3 have been registered as a group. According to this embodiment, a user can register a group without registering facial information for all members of the group in advance.

[0102] Although the above-described embodiment has been described as a hardware configuration, the present disclosure is not limited to this. Any processing in the present disclosure can also be realized by causing a CPU to execute a computer program.

[0103] In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, DVDs (Digital Versatile Discs), and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can be supplied to a computer via wired communication paths such as electrical wires and optical fibers, or via wireless communication paths.

[0104] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0105] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) a storage means for storing identification information of a plurality of persons as a group; an acquisition means for acquiring photographed images of a plurality of people taken by a predetermined photographing device; an area specifying means for specifying a plurality of face areas from the photographed image; a personal authentication control means for causing an authentication device that stores a set of facial feature information of the plurality of persons to perform face authentication for each of the identified face regions using the set of facial feature information; an output means for outputting the captured image as an output image when facial feature information of each person belonging to the group is successfully authenticated with any of the plurality of facial regions; An imaging control device comprising: (Appendix 2) The photographing control device described in Appendix 1 further includes a group authentication means that, when facial feature information of each person belonging to the group is successfully authenticated with one of the multiple facial areas, registers in the storage means that group authentication has been successful, corresponding to the group. (Appendix 3) The group authentication means A photography control device as described in Appendix 2, wherein if the facial feature information of each person belonging to the group and the facial areas for which the facial authentication has been successful are within a predetermined distance, the fact that the group authentication has been successful is associated with the group and registered in the storage means. (Appendix 4) The output means The photographing control device according to claim 2 or 3, wherein, if a portion of the facial feature information of each person belonging to the group does not successfully match any of the plurality of facial areas in face recognition, the photographing control device outputs a message indicating that the person corresponding to the portion of facial feature information is not included in the photographed image. (Appendix 5) the storage means stores two or more of the groups; The imaging control device includes: a classification means for classifying each face region that has been successfully authenticated into one of the groups to which the corresponding facial feature information belongs; Furthermore, The group authentication means The photographing control device according to any one of appendices 2 to 4, wherein for a group in which all of the facial feature information belonging thereto has been successfully authenticated, the fact that the group authentication has been successful is associated and registered in the storage means. (Appendix 6) the storage means stores two or more of the groups; The imaging control device includes: a classification means for classifying each face region that has been successfully authenticated into one of the groups to which the corresponding facial feature information belongs; a generation means for generating, for each group, a processed image by processing the photographed image so that a degree of recognition of a face region that does not belong to a specific group among the plurality of face regions is reduced; Furthermore, The photographing control device according to any one of appendices 1 to 4, wherein the output means outputs the processed image corresponding to the group to a terminal corresponding to a person belonging to each group as the output image. (Appendix 7) the acquiring means acquires, by the photographing device, a second photographed image in which a first person included in the plurality of people and a second person not included in the plurality of people are photographed; the region specifying means specifies a plurality of face regions from the second captured image; the personal authentication control means causes the authentication device to perform face authentication using the set of facial feature information for each of the identified face areas; The imaging control device includes: an identification means for identifying the second person making a gesture similar to the gesture of the first person in the second captured image when the face authentication of the first person is successful; a registration means for registering second facial feature information generated based on the face area of ​​the identified second person in the second captured image in the authentication device, and for registering the second identification information of the second person in the storage means in association with the first identification information of the first person; Further equipped 7. An imaging control device according to any one of appendices 1 to 6. (Appendix 8) a storage means for storing a set of facial feature information of a plurality of persons as a group; an acquisition means for acquiring photographed images of a plurality of people taken by a predetermined photographing device; an area specifying means for specifying a plurality of face areas from the photographed image; a personal authentication control means for performing face authentication using the set of facial feature information for each of the identified face regions; an output means for outputting the captured image as an output image when facial feature information of each person belonging to the group is successfully authenticated with any of the plurality of facial regions; An imaging control device comprising: (Appendix 9) The photographing control device described in Appendix 8 further includes a group authentication unit that, when facial feature information of each person belonging to the group is successfully authenticated with one of the multiple facial areas, registers in the storage means that group authentication has been successful in association with the group. (Appendix 10) an imaging control device including a storage means for storing identification information of a plurality of persons as a group; an authentication device including: a storage means for storing facial feature information of the plurality of persons; and an authentication means for performing face authentication using the set of facial feature information; A predetermined photographing device; Equipped with The imaging control device includes: Acquire photographic images of multiple people taken by the predetermined photographing device; Identifying a plurality of face regions from the captured image; performing face authentication using the set of facial feature information for each of the identified face regions; outputting the captured image as an output image when facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial regions; Filming control system. (Appendix 11) The imaging control device includes: A photography control system as described in Appendix 10, wherein, when the facial feature information of each person belonging to the group is successfully authenticated with one of the multiple facial areas, the fact that group authentication has been successful is registered in the storage means in association with the group. (Appendix 12) A computer that stores identification information of a plurality of people as a group, Acquire photographic images of multiple people taken by a predetermined photographing device; Identifying a plurality of face regions from the captured image; causing an authentication device that stores a set of facial feature information of the plurality of persons to perform face authentication using the set of facial feature information for each of the specified face regions; outputting the captured image as an output image when facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial regions; Shooting control method. (Appendix 13) A computer that stores a set of facial feature information of a plurality of persons as a group, Acquire photographic images of multiple people taken by a predetermined photographing device; Identifying a plurality of face regions from the captured image; performing face authentication using the set of facial feature information for each of the identified face regions; outputting the captured image as an output image when facial feature information of each person belonging to the group is successfully authenticated with one of the plurality of facial regions; Shooting control method. (Appendix 14) A computer that stores identification information of multiple people as a group, A process of acquiring photographed images of multiple people taken by a predetermined photographing device; A process of identifying a plurality of face regions from the captured image; a process of causing an authentication device that stores a set of facial feature information of the plurality of persons to perform face authentication for each of the identified face regions using the set of facial feature information; A non-transitory computer-readable medium storing an image capture control program that executes a process of outputting the captured image as an output image if each of the facial feature information of each person belonging to the group is successfully facially authenticated with one of the multiple facial areas. (Appendix 15) A computer that stores a set of facial feature information of a plurality of people as a group, A process of acquiring photographed images of multiple people taken by a predetermined photographing device; A process of identifying a plurality of face regions from the captured image; a process of performing face authentication for each of the identified face regions using the set of facial feature information; A non-transitory computer-readable medium storing an image capture control program that executes a process of outputting the captured image as an output image if each of the facial feature information of each person belonging to the group is successfully facially authenticated with one of the multiple facial areas.

[0106] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0107] 100, 100a, 100b, 100c, 100d Imaging control device 110 Storage section 110a Group DB 120 Acquisition Department 130 Area identification part 140 Personal authentication control unit 150 Output section 160 Group Authentication Department 170 Registration Department 180 Classification Department 190 Generation part 105 Specific part 200 Authentication Device 210 Face Information DB 220 Face detection unit 230 Feature Point Extraction Unit 240 Registration Department 250 Authentication Department 300 facial recognition terminals 310 Camera 320 Storage section 330 Communications Department 340 Display section 350 control section 351 Photography Department 352 Registration Department 353 Group Image Request Section 400 User Terminals 410 Camera 420 Storage section 430 Communications Department 440 Display section 450 control section 451 Photography Department 452 Registration Department 453 Group Image Request 500 Network 600, 600a, 600b, 600c, 600d Filming Control System 700 Imaging Device

Claims

1. an acquisition means for acquiring photographed images of a plurality of people taken by a predetermined photographing device; an authentication means for causing an authentication device that stores face information of a plurality of people as a group to perform face authentication using the face information of the plurality of people in the captured image; an output means for outputting the captured image when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, and otherwise outputting information different from the captured image; Equipped with The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; a group authentication unit that, when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, registers in a storage unit that group authentication has been successful in association with the group; The group authentication means If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control device.

2. the storage means stores two or more of the groups; The imaging control device includes: a classification means for classifying each face area that has been successfully authenticated into one of the groups to which the corresponding face information belongs; Furthermore, The group authentication means 2. The imaging control device according to claim 1, wherein for a group in which all of the face information belonging to the group has been successfully authenticated, a record indicating that the group authentication has been successful is registered in the storage means.

3. The storage means stores two or more of the groups, The imaging control device includes: a classification means for classifying each face area that has been successfully authenticated into one of the groups to which the corresponding face information belongs; a generation means for generating, for each group, a processed image by processing the photographed image so that the recognizability of face regions that do not belong to a specific group among the plurality of face regions is reduced; Furthermore, The photographing control device according to claim 1 , wherein the output unit outputs the processed image corresponding to the group to a terminal corresponding to a person belonging to each group as an output image.

4. the acquiring means acquires, by the imaging device, a second captured image in which a first person included in the plurality of people and a second person not included in the plurality of people are captured; the region specifying means specifies a plurality of face regions from the second captured image; the authentication means causes the authentication device to perform face authentication using the set of face information for each of the identified face areas; The imaging control device includes: an identification means for identifying the second person making a gesture similar to a gesture of the first person in the second captured image when the face authentication of the first person is successful; a registration means for registering second face information generated based on the face area of ​​the specified second person in the second captured image in the authentication device, and for registering the second identification information of the second person in the storage means in association with the first identification information of the first person; Further equipped The imaging control device according to any one of claims 1 to 3.

5. an acquisition means for acquiring photographed images of a plurality of people taken by a predetermined photographing device; an authentication means for performing face authentication using face information of a plurality of people in the photographed image, the face information of the plurality of people being stored in advance as a group; an output means for outputting the captured image when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, and otherwise outputting information different from the captured image; Equipped with The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; a group authentication unit that, when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, registers in a storage unit that group authentication has been successful in association with the group; The group authentication means If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control device.

6. An imaging control device; an authentication device; A predetermined photographing device; Equipped with The imaging control device includes: an acquisition means for acquiring photographed images of a plurality of people taken by the predetermined photographing device; an authentication means for causing the authentication device, which stores face information of a plurality of people as a group, to perform face authentication using the face information of the plurality of people in the captured image; an output means for outputting the captured image when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, and otherwise outputting information different from the captured image; Equipped with The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; The imaging control device includes: a group authentication unit that, when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, registers in a storage unit that group authentication has been successful in association with the group; The group authentication means If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Filming control system.

7. The computer Acquiring photographed images of multiple people using a predetermined photographing device; causing an authentication device that stores face information of a plurality of people as a group to perform face authentication using the face information of the plurality of people in the captured image; outputting the captured image when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, and otherwise outputting information different from the captured image; Including, The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; The method further includes the step of registering, in a storage means, a fact that group authentication has been successful in association with the group when face information of each person belonging to the group has been successfully authenticated with face information of any of the plurality of people, The registration is If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control method.

8. The computer Acquiring photographed images of multiple people using a predetermined photographing device; performing face authentication using face information of a plurality of people in the photographed image, the face information of the plurality of people being stored in advance as a group; outputting the captured image when face information of each person belonging to the group is successfully authenticated with any of the face information of the plurality of people, and otherwise outputting information different from the captured image; Including, The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; The method further includes the step of registering, in a storage means, a fact that group authentication has been successful in association with the group when face information of each person belonging to the group has been successfully authenticated with face information of any of the plurality of people, The registration is If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control method.

9. On the computer, A process of acquiring photographed images of multiple people taken by a predetermined photographing device; a process of causing an authentication device that stores face information of a plurality of people as a group to perform face authentication using the face information of the plurality of people in the captured image; outputting the captured image when the facial information of each person belonging to the group has been successfully authenticated with any of the facial information of the plurality of people, and otherwise outputting information different from the captured image; The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; and causing the computer to further execute a process of registering in a storage device, when face authentication of each of the face information of each person belonging to the group with any of the face information of the plurality of people is successful, the fact that group authentication has been successful being associated with the group; The registration process includes: If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control program.

10. On the computer, A process of acquiring photographed images of multiple people taken by a predetermined photographing device; A process of performing face authentication using face information of a plurality of people in the captured image, the face information of the plurality of people being stored in advance as a group; outputting the captured image when the facial information of each person belonging to the group has been successfully authenticated with any of the facial information of the plurality of people, and otherwise outputting information different from the captured image; The information different from the photographed image is information indicating that, when a part of the face information of each person belonging to the group does not successfully undergo face authentication with any of the face information of the plurality of people, the person corresponding to the part of the face information is not included in the captured image; and causing the computer to further execute a process of registering in a storage device, when face authentication of each of the face information of each person belonging to the group with any of the face information of the plurality of people is successful, the fact that group authentication has been successful being associated with the group; The registration process includes: If the facial regions where the facial authentication has succeeded with respect to the facial information of each person belonging to the group are within a predetermined distance, the fact that the group authentication has succeeded is registered in the storage means in association with the group. Shooting control program.

Images