Judgment system, judgment method, and program

Abstract

To suppress reduction in security while improving convenience in registering an authentication image.SOLUTION: A determination system 1 includes an acquisition unit 31, a registration determination unit 32, and a registration unit 34. The acquisition unit 31 acquires an image to be used as an authentication image of an intercom system 2. The registration determination unit 32 determines whether to register the image acquired by the acquisition unit 31 as an authentication image. The registration unit 34 registers the image determined to be registered as an authentication image by the registration determination unit 32, as an authentication image. When the image has been acquired by the acquisition unit 31 through a trunk line L1 of the intercom system 2, the registration determination unit 32 determines to register the image as an authentication image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure generally relates to a determination system, a determination method, and a program, and more particularly, the present disclosure relates to a determination system, a determination method, and a program for acquiring an image. [Background technology]

[0002] Patent Document 1 describes an intercom system that includes a common entrance slave unit, a dwelling master unit, and a face authentication server. The face authentication server described in Patent Document 1 performs face authentication by comparing an image captured by a camera of the common entrance slave unit with a face image registered in the face authentication server. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-140617 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, the face images registered in the face recognition server are images that have been registered in advance by, for example, an administrator, etc. Therefore, when a resident of an apartment complex wants to register a new face image in the face recognition server, for example, when there is a change in the family structure of the resident, the resident needs to request the administrator to register the face image. Also, if the residents, etc. are allowed to register face images, security may be reduced.

[0005] The present disclosure has been made in consideration of the above-mentioned reasons, and aims to provide a judgment system, judgment method, and program that improve convenience when registering an authentication image while suppressing a decrease in security. [Means for solving the problem]

[0006] A determination system according to an aspect of the present disclosure includes an acquisition unit, a registration determination unit, and a registration unit. An image quality determination unit; The acquisition unit acquires an image to be used as an authentication image for an intercom system. The registration determination unit determines whether or not to register the image acquired by the acquisition unit as the authentication image. The registration unit registers the image determined by the registration determination unit to be registered as the authentication image as the authentication image. The image quality determining unit determines whether the image satisfies a predetermined image quality standard as the authentication image. The registration determination unit is The image quality determination unit determines that the image satisfies the predetermined image quality standard, When the image is acquired by the acquisition unit via the main line of the intercom system, it is determined that the image is to be registered as the authentication image. The registration judgment unit determines whether or not to register the image as the authentication image by determining whether or not the image that has been judged by the image quality judgment unit to satisfy the specified image quality standard has passed through the trunk line.

[0008] A determination method according to one aspect of the present disclosure includes an acquisition step, Registration A determination step and a registration step, an image quality judgment step; In the acquiring step, an image to be used as an authentication image for the intercom system is acquired. Registration In the determination step, it is determined whether or not the image acquired in the acquisition step is to be registered as the authentication image. Registration The image that is determined to be registered as the authentication image in the determination step is registered as the authentication image. In the image quality determination step, it is determined whether or not the image satisfies a predetermined image quality standard for the authentication image. The above Registration In the decision step, In the image quality determination step, it is determined that the image satisfies the predetermined image quality standard; When the image is acquired through a trunk line of the intercom system in the acquiring step, the image is registered as the authentication image. In the registration determination step, it is determined whether the image that is determined to satisfy the predetermined image quality standard in the image quality determination step has passed through the trunk line, thereby determining whether or not to register the image as the authentication image.

[0010] A program according to one embodiment of the present disclosure is a program for causing one or more processors to execute the determination method. Effect of the Invention

[0011] According to the determination system, the determination method, and the program according to the above aspects of the present disclosure, it is possible to improve the convenience when registering an authentication image while suppressing a decrease in security. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram showing an overall configuration of a determination system according to an embodiment. [Diagram 2] FIG. 2 is a sequence diagram showing the operation of the determination system. [Diagram 3] FIG. 3 is a flowchart showing the operation of the determination device. [Figure 4] FIG. 4 is a flowchart showing the operation of the determination device according to the modified example. [Diagram 5] FIG. 5 is a schematic diagram showing an overall configuration of a determination system according to a first modified example. [Figure 6] FIG. 6 is a block diagram showing a main part of the above-mentioned determination system. [Figure 7] FIG. 7 is a schematic diagram showing the selection screen of the above embodiment. [Figure 8] FIG. 8 is a block diagram showing a main part of a determination system according to the second modified example. [Figure 9] FIG. 9 is a block diagram showing a main part of a determination system according to the third modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the drawings. In the embodiments described below, common elements are given the same reference numerals, and duplicated descriptions of the common elements will be omitted. The following embodiment is merely one of various embodiments of the present disclosure. Various modifications of the embodiment can be made depending on the design, etc., as long as the object of the present disclosure can be achieved. Each figure described in this disclosure is a schematic diagram, and the ratio of the size and thickness of each component in each figure does not necessarily reflect the actual dimensional ratio.

[0014] (1) Overview First, an overview of a determination system 1 according to this embodiment will be described with reference to FIG.

[0015] 1, the determination system 1 is a system that cooperates with an intercom system 2 installed in a facility 20 such as an apartment building. The determination system 1 includes an acquisition unit 31, a registration determination unit 32, and a registration unit .

[0016] The acquisition unit 31 acquires an image to be used as an authentication image for the intercom system 2. In this disclosure, "image" refers to image data and may include still images and moving images. In this embodiment, it is assumed that the image acquired by the acquisition unit 31 is a still image. The acquisition unit 31 in this embodiment is configured to be able to acquire images from the intercom master unit 26 installed in each dwelling unit 22 of the facility 20 via the trunk line L1 of the intercom system 2.

[0017] The registration determination unit 32 performs a registration determination to determine whether or not to register the image acquired by the acquisition unit 31 as an authentication image. More specifically, when the image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the image acquired by the acquisition unit 31 is to be registered as an authentication image.

[0018] The registration unit 34 registers the image determined by the registration determination unit 32 to be registered as an authentication image in the database 5 as the authentication image. In the present disclosure, "registering an image as an authentication image" may include registering the image itself, registering an image after image processing, and registering features of a person (face) included in the image. "Image processing" may include a process of deleting the background from an image including a person and a background, a process of changing the size of a person included in the image, a process of changing the brightness of the image, and a process of extracting a face of a person included in the image. In this embodiment, the registration unit 34 registers the image itself acquired by the acquisition unit 31 in the database 5 as an authentication image. In this embodiment, a person appearing in the authentication image registered in the database 5 is treated as a person permitted to enter the inside of the facility 20 (inside the door 23 described later).

[0019] According to the determination system 1 of this embodiment, when a resident of the facility 20 has changed in family composition, for example, the resident can register a new image as an authentication image by transmitting the new image to the acquisition unit 31 via the trunk line L1 of the intercom system 2. Therefore, the resident of the facility 20 does not need to request the manager of the facility 20 to register the new image as an authentication image. In other words, the determination system 1 of this embodiment has the advantage of improving the convenience of the intercom system 2.

[0020] Furthermore, the registration determination unit 32 of the determination system 1 determines to register the image acquired by the acquisition unit 31 via the trunk line L1 of the intercom system 2 as an authentication image. Since the image acquired by the acquisition unit 31 via the trunk line L1 of the intercom system 2 of the facility 20 is registered in the database as an authentication image, there is an advantage that a decrease in security can be suppressed.

[0021] (2) Details Hereinafter, the determination system 1 according to this embodiment will be described in detail with reference to FIGS.

[0022] (2.1) Intercom system configuration First, the configuration of the intercom system 2 will be described with reference to FIG.

[0023] As described above, the intercom system 2 is provided in the facility 20. Here, the "facility" in the present disclosure includes residential facilities used for residential purposes, as well as non-residential facilities such as stores (tenants), offices, welfare facilities, educational facilities, hospitals, and factories. Non-residential facilities also include restaurants, amusement parks, hotels, inns, kindergartens, nurseries, and community centers. That is, the facility 20 may be a residential facility such as an apartment building, or a non-residential facility such as an office building. Furthermore, the facility 20 also includes a facility in a form in which residential facilities and non-residential facilities are mixed, for example, where the lower floors are stores and the upper floors are dwelling units. As shown in FIG. 1, in this embodiment, it is assumed that the facility 20 is an apartment building (such as an apartment) including a plurality of dwelling units 22. In the following description, each of the plurality of dwelling units 22 may be referred to as a "dwelling unit 22."

[0024] 1, the intercom system 2 includes a door 23, a control device 24, a lobby intercom 25, an intercom master unit 26, and an intercom handset 27. The door 23, the control device 24, and the lobby intercom 25 are installed in the lobby 21. The intercom master unit 26 and the intercom handset 27 are installed in each dwelling unit 22.

[0025] The door 23 of the lobby 21 leads to the inside of the facility 20. The door 23 is communicably connected to the lobby intercom 25 and can be controlled by the lobby intercom 25. In the present disclosure, "communicative" means that information can be exchanged directly or indirectly via a network or a repeater by an appropriate communication method such as wired communication or wireless communication. In the intercom system 2 of this embodiment, the lobby intercom 25 can control the opening / closing or locking / unlocking of the door 23 of the lobby 21. In other words, if the door 23 is an automatic door, the lobby intercom 25 can control the door 23 to open the door 23, which is closed by default.

[0026] The control device 24 is communicatively connected to the lobby intercom 25, the intercom master units 26 in each dwelling unit 22, and a later-described judgment device 3 of the judgment system 1. The control device 24 relays communication between the lobby intercom 25, the intercom master units 26 in each dwelling unit 22, and the judgment device 3.

[0027] The lobby intercom 25 is installed in the lobby 21, and is a terminal provided outside the door 23. The lobby intercom 25 is communicatively connected to the door 23 and the control device 24. The lobby intercom 25 of this embodiment is communicatively connected to a database 5 in which an authentication image is registered, for example, via an external network NT1.

[0028] The lobby interphone 25 has an imaging unit 251. The imaging unit 251 includes an image sensor such as a Complementary Metal Oxide Semiconductor (CMOS) image sensor or a Charge-Coupled Device (CCD) image sensor.

[0029] The imaging unit 251 captures an image of a visitor who is about to open the door 23, and generates an image. More specifically, the imaging unit 251 of this embodiment captures an image of a visitor who performs a predetermined operation on the lobby intercom 25, and generates an image. In this disclosure, the "visitor" includes not only customers, delivery persons, and construction workers of the facility 20, but also people who approach the door 23 leading to the inside of the facility 20. In other words, visitors include residents of the facility 20, managers and workers of the facility 20, and the like. The lobby intercom 25 may be configured to automatically capture an image of a visitor who enters the lobby 21 from outside the facility 20 with the imaging unit 251.

[0030] In this embodiment, when the lobby intercom 25 captures an image of a visitor with the imaging unit 251, it performs face authentication using a face image contained in the generated image to determine whether or not the visitor is a person permitted to enter the facility 20. In face authentication, the lobby intercom 25 first executes face detection processing to detect the face of a person in the image and extracts a face image that is an image of the face of a person. Then, when a face image is extracted from the image, the lobby intercom 25 compares (matches) the extracted face image with a plurality of authentication images (template data) registered in advance in the database 5.

[0031] The lobby intercom 25 allows the visitor to enter the facility 20 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. In other words, the lobby intercom 25 opens (unlocks) the door 23 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. On the other hand, the lobby intercom 25 does not allow the visitor to enter the facility 20 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. In other words, the lobby intercom 25 does not open (unlock) the door 23 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value.

[0032] The intercom master unit 26 (information terminal) is installed in the indoor space of each dwelling unit 22. The intercom master unit 26 is communicably connected to the intercom slave unit 27. The intercom master unit 26 is communicably connected to the control device 24 via the trunk line L1 of the intercom system 2. The intercom master unit 26 of this embodiment is communicably connected to a server 4, which will be described later, via a network NT1. The intercom master unit 26 of this embodiment is further configured to be communicable with an information terminal (other information terminal), such as a smartphone 6, carried by a resident of the dwelling unit 22, via a route different from the trunk line L1, such as wireless communication. The information terminal carried by the resident with which the intercom master unit 26 can communicate may be an information terminal such as a personal computer, a tablet, or a digital camera.

[0033] In this embodiment, it is assumed that the intercom master unit 26 is an information terminal that is installed in advance in the indoor space of the dwelling unit 22. However, the intercom master unit 26 may also be an information terminal such as a personal computer, smartphone, or tablet that is possessed by a resident of the dwelling unit 22, as long as it is capable of communicating with the control device 24 via the trunk line L1 of the intercom system 2.

[0034] When the intercom master unit 26 of this embodiment receives an image to be used as an authentication image for the intercom system 2 from the smartphone 6, it transmits the image to the server 4. The server 4 performs image quality judgment on the image transmitted by the intercom master unit 26, which will be described later.

[0035] The intercom master unit 26 receives result information on the result of the image quality judgment from the server 4 and checks the information. If the result information indicates that the image meets a predetermined image quality standard, the intercom master unit 26 transmits the image to the judgment device 3 via the trunk line L1. Here, the intercom master unit 26 of this embodiment transmits source information indicating that the image will be transmitted via the trunk line L1 in association with the image to be transmitted. The "source information" may include, for example, information indicating that the source of the image is the intercom master unit 26.

[0036] On the other hand, if the result information indicates that the image does not meet the predetermined image quality standard, intercom master unit 26 does not transmit the image that was the subject of image quality judgment to judgment device 3. If the result information indicates that the image does not meet the predetermined image quality standard, intercom master unit 26 outputs information regarding the result of the image quality judgment to smartphone 6. Having received the information indicating that the image does not meet the predetermined image quality standard, smartphone 6 is notified that the image does not meet the predetermined image quality standard. The notification from smartphone 6 lets the resident know that the image has been determined to not meet the predetermined image quality standard.

[0037] The intercom handset 27 is communicably connected to the intercom master 26, and is, for example, a front door handset installed outside the front door of each dwelling unit 22. In other words, the intercom master 26 and the intercom handset 27 are configured to be able to communicate (including make calls) with each other. Furthermore, in this embodiment, the intercom handset 27 has an imaging unit 271, and an image of a visitor captured by the imaging unit 271 of the intercom handset 27 can be displayed on the intercom master 26.

[0038] As described above, the lobby intercom 25 and the intercom master unit 26 are communicatively connected to the control device 24. Therefore, the lobby intercom 25 and the intercom master unit 26 are capable of communication (including phone calls) via the control device 24. Furthermore, the lobby intercom 25 and the intercom master unit 26 of this embodiment are configured to be capable of communication with the judgment device 3 of the judgment system 1 via the control device 24.

[0039] (2.2) Structure of the judgment system Next, the configuration of the determination system 1 of the present embodiment will be described with reference to FIG.

[0040] 1, the determination system 1 includes a determination device 3 and a server 4. The determination device 3 and the server 4 are configured to be able to communicate with each other via a network NT1.

[0041] (2.2.1) Server configuration Next, the configuration of the server 4 will be described with reference to FIG.

[0042] The server 4 in this embodiment is installed, for example, outside the facility 20. Note that the server 4 may also be installed, for example, inside the facility 20. The server 4 is configured to be able to communicate with the intercom master unit 26 and the smartphones 6 carried by the residents of the dwelling units 22, etc., via the network NT1. The server 4 is configured, for example, to request a person attempting to access the server 4 to transmit registration information and a password, etc., so that only the residents of the facility 20 can transmit images to the server 4.

[0043] The server 4 mainly comprises a computer system having one or more processors and one or more memories. In the server 4, the one or more processors execute a program recorded in the memory, thereby realizing the functions of an image quality determination unit 41 and an output unit 42 in the server 4. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0044] The image quality judgment unit 41 performs image quality judgment to judge whether or not an image to be used as an authentication image for the intercom system 2 satisfies a predetermined image quality standard for an authentication image. More specifically, the image quality judgment unit 41 in this embodiment judges whether or not an image to be used as an authentication image for the intercom system 2 received from the intercom master unit 26 satisfies a predetermined image quality standard for an authentication image. The "predetermined image quality standard" in this disclosure is a standard for whether or not an image to be used as an authentication image for the intercom system 2 is suitable as an authentication image. For example, the "predetermined image quality standard" may include standards such as whether the resolution (number of pixels) and image size are within a predetermined range, whether the image includes a person's face, whether there is only one person in the image, and whether the image is not blurred.

[0045] The image quality determination unit 41 of this embodiment determines whether or not an image satisfies a predetermined image quality standard before the acquisition unit 31 of the determination device 3 acquires an image to be used as an authentication image for the intercom system 2. Therefore, for example, there is an advantage in that the processing load of the determination device 3 can be reduced by preventing the acquisition unit 31 of the determination device 3 from acquiring an image that is not suitable as an authentication image.

[0046] After the image quality judgment unit 41 judges the image quality of an image to be used as an authentication image for the intercom system 2, the output unit 42 outputs information related to the judgment result of the image quality judgment unit 41. The output unit 42 of this embodiment associates result information indicating the result of the image quality judgment with the image that was the subject of the image quality judgment, and transmits (outputs) the image and the result information to the intercom master unit 26. By the output unit 42 outputting the information indicating the result of the image quality judgment, for example, the intercom master unit 26 can notify the resident of the result of the image quality judgment via a display unit or speaker of the intercom master unit 26. The result of the image quality judgment may also be notified via a display unit or speaker of an information terminal owned by the resident, such as a smartphone 6.

[0047] (2.2.2) Configuration of the decision-making device Next, the configuration of the determination device 3 will be described with reference to FIG.

[0048] The determination device 3 of this embodiment is installed in the lobby 21 of the facility 20. Note that the determination device 3 may be installed in, for example, a management room in the facility 20, or may be installed outside the facility 20.

[0049] The determination device 3 mainly comprises a computer system having one or more processors and one or more memories. In the determination device 3, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the acquisition unit 31, the registration determination unit 32, the output unit 33, and the registration unit 34 in the determination device 3. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0050] As described above, the acquisition unit 31 acquires an image to be used as an authentication image for the intercom system 2. The acquisition unit 31 of this embodiment is configured to be able to acquire an image from the intercom master unit 26 included in the intercom system 2 via the control device 24 and the main line L1. More specifically, the acquisition unit 31 of this embodiment is configured to be able to acquire an image from an information terminal such as the smartphone 6 via the control device 24, the main line L1, and the intercom master unit 26. For example, by using the imaging unit of the smartphone 6, there is an advantage that a resident can easily prepare an image to be used as an authentication image.

[0051] As described above, an image that is determined by the image quality determination unit 41 of the server 4 to satisfy the predetermined image quality standard is transmitted from the intercom master unit 26 to the determination device 3 (acquisition unit 31). On the other hand, an image that is determined by the image quality determination unit 41 of the server 4 not to satisfy the predetermined image quality standard is not transmitted from the intercom master unit 26 to the acquisition unit 31. That is, the acquisition unit 31 of this embodiment acquires an image that is determined by the image quality determination unit 41 to satisfy the predetermined image quality standard, and does not acquire an image that is determined by the image quality determination unit 41 not to satisfy the predetermined image quality standard. By not having the acquisition unit 31 acquire an image that does not satisfy the predetermined image quality standard, it is possible to reduce the number of times that the registration determination unit 32 makes a registration determination for an image that does not satisfy the predetermined image quality standard, which has the advantage of reducing the processing load on the registration determination unit 32.

[0052] As described above, the registration determination unit 32 determines whether or not to register the image acquired by the acquisition unit 31 as an authentication image. When the image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines to register the image acquired by the acquisition unit 31 as an authentication image. More specifically, when the image acquired by the acquisition unit 31 is associated with the above-mentioned transmission source information, the registration determination unit 32 in this embodiment determines that the image is an image acquired via the main line L1.

[0053] Furthermore, when the image quality judgment unit 41 of the server 4 judges that an image satisfies a predetermined image quality standard and the image is acquired by the acquisition unit 31 via the trunk line L1, the registration judgment unit 32 judges that the image acquired by the acquisition unit 31 should be registered as an authentication image. Since an image judged by the image quality judgment unit 41 to satisfy the predetermined image quality standard for an authentication image can be registered as an authentication image, there is an advantage that the accuracy of authentication is improved. Note that in this embodiment, since the image acquired by the acquisition unit 31 is an image judged by the image quality judgment unit 41 to satisfy the predetermined image quality standard, the registration judgment unit 32 does not need to check the result of the image quality judgment for that image.

[0054] Moreover, the registration determination unit 32 determines whether or not an image acquired by the acquisition unit 31 and determined by the image quality determination unit 41 of the server 4 to satisfy a predetermined image quality standard has passed through the trunk line L1, thereby determining whether or not to register the image as an authentication image. The registration determination unit 32 of this embodiment determines whether or not an image determined by the image quality determination unit 41 to satisfy a predetermined image quality standard should be registered as an authentication image, and therefore has the advantage of reducing unnecessary determinations on images that do not satisfy the predetermined image quality standard. In other words, there is the advantage of reducing the processing load on the registration determination unit 32.

[0055] After the registration determination unit 32 makes a registration determination, the output unit 33 outputs information relating to the determination result of the registration determination unit 32. The output unit 33 of this embodiment transmits (outputs) information relating to the determination result of the registration determination by the registration determination unit 32 to the intercom master unit 26 that transmitted the image that was the subject of the registration determination, via the trunk line L1. The output unit 33 may also transmit (output) information relating to the determination result of the registration determination, via the network NT1 or the like, to the smartphone 6 carried by the resident of the dwelling unit 22 in which the intercom master unit 26 that transmitted the image that was the subject of the registration determination is installed.

[0056] By outputting information indicating the result of the registration determination from output unit 33, for example, intercom master unit 26 can notify the result of the registration determination to the resident via a display unit or speaker, etc., of intercom master unit 26. In addition, the notification of the result of the registration determination may be made via a display unit or speaker, etc., of an information terminal, such as smartphone 6, that the resident has.

[0057] As described above, the registration unit 34 registers, as an authentication image, an image that is determined by the registration determination unit 32 to be registered as an authentication image in the database 5. In this embodiment, the registration unit 34 registers an image acquired by the acquisition unit 31 from the intercom master unit 26 included in the intercom system 2, and therefore a decrease in security can be suppressed.

[0058] (3) Operation of the discrimination system Hereinafter, the operation of the determination system 1 according to this embodiment will be described with reference to FIGS.

[0059] 2 is a sequence diagram showing the operation of the determination system 1. In this embodiment, a case will be described assuming that an image captured by a resident using an imaging unit of the smartphone 6 is an image to be used as an authentication image for the intercom system 2.

[0060] First, the resident performs a predetermined operation on the smartphone 6, and prepares an image to be used as an authentication image for the intercom system 2 using the imaging unit of the smartphone 6. That is, the imaging unit of the smartphone 6 captures an image of the resident or the like, and generates an image to be used as an authentication image for the intercom system 2 (S1). Here, the smartphone 6 may be installed with dedicated application software for generating an image to be used as an authentication image for the intercom system 2. The dedicated application software may be software that instructs the resident on how to take a photograph, etc., via the display unit or speaker of the smartphone 6. By executing (starting) the dedicated application software on the smartphone 6, there is an advantage that the resident can easily prepare an image suitable for the authentication image.

[0061] The smartphone 6 transmits the generated image to the intercom master unit 26, for example, by wireless communication with the intercom master unit 26 (S2). After receiving the image from the resident's smartphone 6, the intercom master unit 26 transmits the received image to the server 4 (S3).

[0062] The server 4 judges the image quality of the received image (S4). After judging the image quality, the server 4 associates information indicating the result of the image quality judgment with the image, and transmits the image and the result information to the intercom master unit 26 (S5).

[0063] The intercom master unit 26 checks the result information associated with the image. If the result information indicates that the image meets a predetermined image quality standard, the intercom master unit 26 transmits the image to the determination device 3 via the trunk line L1 (S6). If the result information indicates that the image does not meet the predetermined image quality standard, the intercom master unit 26 outputs the result information to the smartphone 6 without transmitting the image to the determination device 3. Then, the smartphone 6 that has received the result information is notified that the image does not meet the predetermined image quality standard.

[0064] After receiving the image from the intercom master unit 26, the determination device 3 performs a registration determination for the image (S7). Specifically, the determination device 3 checks whether the image has been determined by the server 4 to satisfy a predetermined image quality standard, and whether the image has been acquired via the trunk line L1 of the intercom system 2.

[0065] If the server 4 determines that the image meets a predetermined image quality standard and the image has been acquired via the trunk line L1, the determination device 3 transmits the image to the database 5 (S8). Then, the authentication image is registered in the database 5 (S9).

[0066] The determination device 3 transmits result information of the registration determination to the intercom master unit 26 (S10). The intercom master unit 26 transmits the result information received from the determination device 3 to the smartphone 6 (S11). Note that the intercom master unit 26 may notify the resident of the result of the registration determination via a display unit or speaker of the intercom master unit 26 without transmitting the result information to the smartphone 6. Upon receiving the result information from the intercom master unit 26, the smartphone 6 notifies the resident of the result of the registration determination (S12).

[0067] It should be noted that the sequence diagram shown in FIG. 2 is merely an example, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

[0068] Next, the operation of the determination device 3 of this embodiment will be described with reference to Fig. 3. Fig. 3 is a flow chart showing the operation of the determination device 3, which corresponds to the processes of steps S7, S8, and S10 in Fig. 2.

[0069] First, the determination device 3 checks whether the acquisition unit 31 has acquired an image (S21). If the acquisition unit 31 has not acquired an image (S21: No), the determination device 3 repeats the process of step S21 until the acquisition unit 31 acquires an image. On the other hand, if the acquisition unit 31 has acquired an image (S21: Yes), the registration determination unit 32 checks whether the image has been acquired by the acquisition unit 31 via the trunk line L1 of the intercom system 2 (S22). The registration determination unit 32 of this embodiment checks whether the image acquired by the acquisition unit 31 is associated with transmission source information, thereby determining whether the image has been acquired by the acquisition unit 31 via the trunk line L1.

[0070] If the image is associated with transmission source information, i.e., if the image has been acquired by the acquisition unit 31 via the trunk line L1 (S22: Yes), the registration determination unit 32 determines to register the image as an authentication image for the intercom system 2 (S23). The registration unit 34 transmits the image determined by the registration determination unit 32 to be registered as an authentication image to the database 5 (S24). Then, the image determined by the registration determination unit 32 to be registered as an authentication image is registered in the database 5. The output unit 33 transmits the determination result of the registration determination unit 32, i.e., the determination result that the image is to be registered as an authentication image, to the intercom master unit 26 (S25). Then, the determination device 3 ends the process.

[0071] On the other hand, if the image is not associated with transmission source information, i.e., if the image has not been acquired by the acquisition unit 31 via the trunk line L1 (S22: No), the registration determination unit 32 determines not to register the image as an authentication image for the intercom system 2 (S26). The output unit 33 transmits the determination result of the registration determination unit 32, i.e., the determination result that the image will not be registered as an authentication image, to the intercom master unit 26 (S27). Then, the determination device 3 ends the process.

[0072] It should be noted that the flowchart shown in FIG. 3 is merely an example, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

[0073] (4) Variations The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved.

[0074] Furthermore, functions equivalent to the judgment system 1 according to the above embodiment may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium having a program recorded thereon. The judgment method according to one embodiment has an acquisition step, a judgment step, and a registration step. In the acquisition step, an image to be used as an authentication image for the intercom system 2 is acquired. In the judgment step, it is judged whether or not the image acquired in the acquisition step should be registered as an authentication image. In the registration step, the image judged in the judgment step to be registered as an authentication image is registered as an authentication image. In the judgment step, if an image is acquired in the acquisition step via the main line L1 of the intercom system 2, the image is registered as an authentication image. The program according to one embodiment is a program for causing one or more processors to execute the above judgment method.

[0075] The judgment system 1 in the present disclosure includes, for example, a computer system. The computer system is mainly composed of a processor and a memory as hardware. The processor executes a program recorded in the memory of the computer system to realize the function of the judgment system 1 in the present disclosure. The program may be pre-recorded in the memory of the computer system, may be provided through an electric communication line, or may be provided by being recorded in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed among multiple chips. The chips may be integrated in one device or distributed among multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Thus, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0076] The judgment system 1 may include at least an acquisition unit 31, a registration judgment unit 32, and a registration unit .

[0077] It is not essential for the determination system 1 that at least a part of the functions of the determination device 3 be concentrated in one housing, and at least a part of the functions of the determination device 3 may be distributed across multiple housings. For example, at least a part of the functions of the determination device 3 may be provided in the lobby intercom 25 or the server 4.

[0078] It is not essential for the determination system 1 that at least a part of the functions of the server 4 be concentrated in one housing, and at least a part of the functions of the server 4 may be distributed across multiple housings. For example, at least a part of the functions of the server 4 may be provided in the lobby intercom 25 or the determination device 3.

[0079] Visitor authentication is not limited to being performed by lobby intercom 25, but may be performed by another authentication device such as a server installed outside facility 20. Moreover, the image capturing unit 251 of lobby intercom 25 is not limited to being used to capture an image of a visitor. For example, an image capturing unit provided in lobby 21 separate from lobby intercom 25 may capture an image of a visitor.

[0080] In the above embodiment, the network NT1 is an external network of the facility 20, but the network NT1 may be an internal network of the facility 20, such as a local area network (LAN). In this case, the server 4 and the database 5 are provided inside the facility 20. One of the server 4 and the database 5 may be connected to a network external to the facility 20, and the other of the server 4 and the database 5 may be connected to a network internal to the facility 20.

[0081] The acquisition unit 31 may be configured to be able to acquire an image to be used as an authentication image from the intercom slave unit 27 connected to the intercom master unit 26 via the intercom master unit 26 and the trunk line L1. For example, by using the imaging unit 271 of the intercom slave unit 27, there is an advantage that a resident can easily prepare an image to be used as an authentication image.

[0082] The server 4 may receive an image to be used as an authentication image for the intercom system 2 from the smartphone 6, not via the intercom master unit 26. The image quality determination unit 41 of the server 4 determines whether the image to be used as an authentication image received from the smartphone 6 satisfies a predetermined image quality standard for an authentication image. The output unit 42 of the server 4 associates information indicating the result of the image quality determination with the image that was the subject of the image quality determination, and transmits (outputs) the image and the result information to the smartphone 6. Then, if the information indicating that the image satisfies the predetermined image quality standard for an authentication image is associated with the image, the smartphone 6 transmits the image to the determination device 3 via the intercom master unit 26 and the trunk line L1.

[0083] When the control device 24 of the intercom system 2 receives an image from the intercom master unit 26 via the trunk line L1 and transmits the image to the determination device 3, the control device 24 may transmit information indicating that the image was received via the trunk line L1 in association with the image to the determination device 3. The registration determination unit 32 of the determination device 3 may determine whether or not to register the image as an authentication image depending on the presence or absence of information indicating that the image was received via the trunk line L1.

[0084] Furthermore, intercom master unit 26 may be capable of reading images stored in a portable recording medium such as memory card 7. Intercom master unit 26 may then transmit the image stored in memory card 7 to determination device 3 via trunk line L1 as an image to be used as an authentication image for intercom system 2.

[0085] The lobby intercom 25 (imaging unit 251) may capture an image to be used as a temporary authentication image for temporarily permitting entry of a delivery person or the like entering the facility 20. The lobby intercom 25 associates information indicating that the image is to be used as a temporary authentication image with the image to be used as a temporary authentication image, and transmits the image and the information to the determination device 3. The determination device 3 registers the image captured by the lobby intercom 25 as a temporary authentication image in the database 5. FIG. 4 is a flowchart showing the operation of the determination device 3 when registering a temporary authentication image. Note that the processes from step S21 to S27 are the same as those in FIG. 3, and therefore description thereof will be omitted. When the acquisition unit 31 acquires an image (S21: Yes), the registration determination unit 32 checks whether the image is for temporary registration based on the presence or absence of information indicating that the image is to be used as a temporary authentication image (S28). If the image is associated with information indicating that the image is to be used as a temporary authentication image (S28: Yes), the registration determination unit 32 determines to register the image as a temporary authentication image (S29). The registration unit 34 transmits the image determined by the registration determination unit 32 to be registered as a temporary authentication image to the database 5 (S30). Then, the image determined by the registration determination unit 32 to be registered as a temporary authentication image is registered in the database 5. In the process of step S28, if the image is not associated with information indicating that the image is to be used as a temporary authentication image (S28: No), the process proceeds to step S22. Note that the flowchart shown in FIG. 4 is merely an example, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

[0086] (5) First Modification Next, a first modified example of the above embodiment will be described with reference to FIGS.

[0087] 5 and 6, in the determination system 1 according to the first modification, the lobby intercom 25 has at least a part of the functions of the determination system 1. Moreover, the determination system 1 according to the first modification stores (registers) the authentication image not in the database 5 (see FIG. 1) but in a storage unit 256 (to be described later).

[0088] First, the details of the lobby intercom 25 according to the first modification will be described. As shown in Fig. 6, the lobby intercom 25 according to the first modification includes an imaging unit 251, a communication unit 252, a call unit 253, a display unit 254, an operation unit 255, a storage unit 256, and a control unit 257.

[0089] The communication unit 252 has an interface capable of communicating with the door 23 (or electric lock), an interface capable of communicating with the control device 24, an interface capable of communicating with the server 4, and an interface capable of communicating with the lobby camera 28 (see FIG. 5). The communication unit 252 is capable of communicating with the intercom master unit 26 via the control device 24 and the trunk line L1, etc.

[0090] The communication unit 252 of the first modified example transmits a plurality of images to the intercom master unit 26, including a live image G1 (see FIG. 7) of a visitor captured by the imaging unit 251, and a playback image G3 (see FIG. 7) of the visitor captured by the imaging unit 251 while the imaging unit 251 is operating the operation unit 255. The live image G1 and the playback image G3 are moving images including a plurality of frames (still images). Both the live image G1 and the playback image G3 are images of the visitor captured by the imaging unit 251. The playback image G3 is an image taken earlier than the live image G1. The playback image G3 may be a still image.

[0091] Furthermore, the communication unit 252 of the first modified example transmits a lobby image G2 (see FIG. 7) captured by the lobby camera 28 of the lobby 21 to the intercom master unit 26, together with the live image G1 and the playback image G3. The lobby camera 28 is installed in the lobby 21, and is disposed in a position where it can capture an image of visitors who visit the lobby 21. The lobby image G2 of the first modified example is a video captured by the lobby camera 28 at the same time as the live image G1.

[0092] The communication unit 253 includes a speaker and a microphone. The communication unit 253 of the first modified example is configured to be able to communicate with the intercom master unit 26.

[0093] The display unit 254 is, for example, a liquid crystal display. For example, the display unit 254 is configured to display an image captured by the imaging unit 251 and a message for the visitor. The message is, for example, a message for encouraging the visitor to speak. If the lobby interphone 25 is equipped with a touch panel display, the touch panel display may serve as both the display unit 254 and the operation unit 255.

[0094] The operation unit 255 is configured to receive operations from a visitor. The operation unit 255 is, for example, an input interface having a plurality of push button switches, a touch panel, and the like.

[0095] When a visitor performs a predetermined operation on the operation unit 255, the lobby intercom 25 transmits a call signal for calling the intercom master unit 26 to the intercom master unit 26. Furthermore, the lobby intercom 25 transmits an image (live image G1) captured by the imaging unit 251 to the intercom master unit 26. As a result, the image of the visitor captured by the imaging unit 251 of the lobby intercom 25 can be displayed on the intercom master unit 26.

[0096] As described above, the lobby intercom 25 of the first modified example transmits to the intercom master unit 26 an image (playback image G3) captured by the imaging unit 251 of the visitor while the visitor is operating the operation unit 255, and a lobby image G2 captured by the lobby camera 28, together with a live image G1.

[0097] The storage unit 256 is configured with a device selected from a hard disk drive (HDD), a solid state drive (SSD), a read only memory (ROM), a random access memory (RAM), an electrically erasable programmable read only memory (EEPROM), etc. The storage unit 256 stores, for example, an authentication image.

[0098] The control unit 257 mainly comprises a computer system having one or more processors and one or more memories. In the control unit 257, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the control unit 257. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0099] The control unit 257 includes an acquisition unit 31, a registration determination unit 32, an output unit 33, and a registration unit .

[0100] The acquisition unit 31 of the first modified example acquires from the intercom master unit 26 one image selected by the intercom master unit 26 from among the live image G1, the playback image G3, and the lobby image G2, as an image to be used as an authentication image.

[0101] Next, the intercom master unit 26 according to the first modified example will be described in detail.

[0102] As shown in FIG. 6, intercom master unit 26 according to the first modified example includes a communication unit 261, a conversation unit 262, a display unit 263, an operation unit 264, a storage unit 265, and a control unit 266.

[0103] The communication unit 261 has an interface capable of communicating with the control device 24, an interface capable of communicating with the intercom handset 27, and an interface capable of communicating with an information terminal (other information terminal) such as a smartphone, tablet, or personal computer owned by a resident of the dwelling unit 22. The communication unit 261 is capable of communicating with the lobby intercom 25 via the trunk line L1 and the control device 24, etc.

[0104] The communication unit 262 includes a speaker and a microphone. The communication unit 262 of the first modified example is configured to be able to communicate with the lobby intercom 25 and the intercom handset 27.

[0105] The display unit 263 is, for example, a liquid crystal display. For example, the display unit 263 is configured to display a live image G1 captured by the imaging unit 251 of the lobby intercom 25. The intercom master unit 26 of the present embodiment is equipped with a touch panel display, and the touch panel display serves as both the display unit 263 and at least a part of the operation unit 264.

[0106] The operation unit 264 is configured to receive operations from the resident. The operation unit 264 is, for example, an input interface having a plurality of push button switches, a touch panel, and the like.

[0107] The storage unit 265 is configured with a device selected from a HDD, an SSD, a ROM, a RAM, an EEPROM, etc. The storage unit 265 of the first modified example stores at least a part of the live image G1, the lobby image G2, and the playback image G3 received from the lobby intercom 25.

[0108] The control unit 266 mainly comprises a computer system having one or more processors and one or more memories. In the control unit 266, the one or more processors execute a program recorded in the memory, thereby realizing the function of the control unit 266. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be recorded on a non-transitory recording medium such as a memory card and provided. The control unit 266 has a selection unit 267.

[0109] The selection unit 267 selects one image from among the live image G1, the lobby image G2, and the playback image G3 (plural images) received from the lobby intercom 25 (communication unit 252) based on a predetermined condition.

[0110] 7, when a resident performs a predetermined operation on the operation unit 264, a selection screen D1 is displayed on the display unit 263. The selection screen D1 is a screen for allowing the resident to select one image to be used as an authentication image from among a live image G1, a lobby image G2, and a playback image G3.

[0111] The selection screen D1 includes a first region R1, a second region R2, and a third region R3. The first region R1 is an region where a live image G1 is displayed. The first region R1 is located to the left of the second region R2 and the third region R3. The second region R2 is an region where a lobby image G2 is displayed. The second region R2 is located to the right of the first region R1 and above the third region R3. The third region R3 is an region where a playback image G3 is displayed. The third region R3 is located to the right of the first region R1 and below the second region R2.

[0112] A resident can select one image to be used as an authentication image from among the live image G1, the lobby image G2, and the playback image G3 by performing a predetermined operation on the selection screen D1. As described above, the live image G1, the lobby image G2, and the playback image G3 are moving images including a plurality of frames (still images), so that the resident can select one frame from the plurality of frames as an image to be used as an authentication image.

[0113] When the selection unit 267 accepts an operation by a resident to select an image to be used as an authentication image, the selection unit 267 transmits the selected image to the lobby intercom 25 via the communication unit 261 or the like.

[0114] According to the judgment system 1 of the first modified example, one image from among multiple images taken of the same visitor can be selected as the image to be used as the authentication image, and an image suitable as an authentication image can be obtained.

[0115] In the first modified example, the selection unit 267 selects an image selected by a resident as the first image. However, the selection unit 267 may perform quality judgment on each of the live image G1, the lobby image G2, and the playback image G3, and select the image most suitable as the authentication image (the image with the highest score) as the first image. For example, the quality judgment is performed by judging the suitability of the image for authentication based on the orientation, size, image quality, etc. of the face image included in the multiple images, and indicating the suitability of the image for authentication by a score.

[0116] The selection unit 267 may select an image that includes the largest face image among the multiple images as the first image. The selection unit 267 may select a predetermined image among the live image G1, the lobby image G2, and the playback image G3 as the first image.

[0117] The same function as that of the determination system 1 according to the first modified example may be embodied as a determination method, a (computer) program, or a non-transitory recording medium on which a program is recorded.

[0118] The various configurations described in the first modified example can be adopted in appropriate combination with the various configurations (including the modified examples) described in the above embodiment.

[0119] (6) Second Modification Next, a second modification of the above embodiment will be described with reference to FIGS.

[0120] 5 and 8, in the determination system 1 according to the second modification, the lobby intercom 25 has at least a part of the functions of the determination system 1. Also, in the determination system 1 according to the second modification, the authentication image is stored (registered) in the memory unit 256, not in the database 5 (see FIG. 1).

[0121] As shown in FIG. 8, the control unit 257 of the lobby intercom 25 according to the second modified example further includes an extraction unit 35 and an update unit 36 ​​in addition to the acquisition unit 31, the registration determination unit 32, the output unit 33, and the registration unit .

[0122] The extraction unit 35 extracts a facial image from an image (live image G1 or playback image G3) of the visitor captured by the imaging unit 251. The extraction unit 35 may also extract a facial image from an image (lobby image G2) of the visitor captured by the lobby camera 28. In other words, the extraction unit 35 may extract a plurality of facial images from a plurality of images.

[0123] The extraction unit 35 extracts face images by performing image processing (pattern recognition processing) on ​​multiple images, for example. In the present disclosure, "pattern recognition processing" refers to image processing that recognizes what a subject is contained in an image based on the shape of the image of the subject. Examples of this type of pattern recognition processing include pattern matching processing and processing that recognizes a subject appearing in an image using a trained model created by machine learning.

[0124] When the extraction unit 35 extracts, for example, a plurality of face images from a plurality of images, the communication unit 252 transmits the plurality of face images extracted by the extraction unit 35 together with the plurality of images to the intercom master unit 26.

[0125] Intercom master unit 26 of the second modified example transmits a face image corresponding to one image selected by selection unit 267 to lobby intercom 25 as an image to be used as an authentication image.

[0126] In other words, the acquisition unit 31 in the second modified example acquires, from the intercom master unit 26, the face image selected by the intercom master unit 26 as an image to be used as an authentication image.

[0127] The registration determination unit 32 of the second modified example determines whether or not to register the facial image acquired by the acquisition unit 31 as an authentication image. The registration determination unit 32 of the second modified example determines whether or not to register the facial image acquired by the acquisition unit 31 as an authentication image. More specifically, when the facial image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the facial image is to be registered as an authentication image.

[0128] On the other hand, when the face image is not acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines not to register the face image as an authentication image.

[0129] The registration unit 34 of the second modified example registers (stores) the face image that has been determined by the registration determination unit 32 to be registered as an authentication image in the storage unit 256 as an authentication image.

[0130] The facial image extracted by the extraction unit 35 has a smaller data size than the image (such as the live image G1) from which it is extracted. Therefore, the communication load when the lobby intercom 25 communicates with the intercom master unit 26 can be reduced.

[0131] The update unit 36 ​​in the second modified example performs an update process to update the authentication image (face image) registered by the registration unit 34. For example, in the update process, the update unit 36 ​​compares (matches) the face image acquired by the acquisition unit 31 with a plurality of authentication images (template data) stored in the storage unit 256. Here, the update unit 36 ​​determines whether or not there is a face image among the plurality of face images (authentication images) registered by the registration unit 34 whose similarity with the face image acquired by the acquisition unit 31 is equal to or greater than a threshold value.

[0132] Then, when there is a face image among the multiple face images registered by the registration unit 34, the face image having a similarity to the face image acquired by the acquisition unit 31 that is equal to or greater than a threshold, the update unit 36 ​​replaces the face image acquired by the acquisition unit 31 with the face image having a similarity that is equal to or greater than the threshold, and updates the authentication image.

[0133] On the other hand, the update unit 36 ​​does not update the authentication image if there is no face image whose similarity to the face image acquired by the acquisition unit 31 is equal to or greater than the threshold value among the multiple face images registered by the registration unit 34. When the update unit 36 ​​does not update the authentication image, the registration unit 34 of the second modified example registers the face image acquired by the acquisition unit 31 as the authentication image. Note that the registration unit 34 does not register the face image updated by the update unit 36 ​​as the authentication image.

[0134] The update unit 36 ​​performs the above-mentioned update process when the registration determination unit 32 determines that the face image acquired by the acquisition unit 31 is to be registered as an authentication image. On the other hand, when the registration determination unit 32 determines that the face image acquired by the acquisition unit 31 is not to be registered as an authentication image, the update unit 36 ​​does not perform the above-mentioned update process.

[0135] According to the determination system 1 of the second modified example, it is possible to update the face image registered in the storage unit 256 as the authentication image.

[0136] The same function as that of the determination system 1 according to the second modified example may be embodied as a determination method, a (computer) program, or a non-transitory recording medium on which a program is recorded.

[0137] The various configurations described in the second modified example can be adopted in appropriate combination with the various configurations (including the modified examples) described in the above embodiment.

[0138] (7) Third Modification Next, a third modification of the above embodiment will be described with reference to FIGS.

[0139] 5 and 9, in the determination system 1 according to the third modified example, the lobby intercom 25 has at least a part of the functions of the determination system 1. Also, in the determination system 1 according to the third modified example, the authentication image is stored (registered) in the memory unit 256, not in the database 5 (see FIG. 1).

[0140] As shown in FIG. 9, the control unit 266 of the intercom master unit 26 according to the second modified example further includes an extraction unit 35 in addition to a selection unit 267.

[0141] The extraction unit 35 extracts a facial image from an image received from the lobby intercom 25 (communication unit 252). That is, the intercom master unit 26 of the third modified example extracts a facial image from an image received from the lobby intercom 25 (communication unit 252).

[0142] Intercom master unit 26 of the third modified example transmits a face image corresponding to one image selected by selection unit 267 to lobby intercom 25 as an image to be used as an authentication image.

[0143] The acquisition unit 31 of the lobby intercom 25 of the third modified example acquires, from the intercom master unit 26, the face image selected by the intercom master unit 26 as an image to be used as an authentication image.

[0144] The facial image extracted by the extraction unit 35 has a smaller data size than the image (such as the live image G1) from which it is extracted. This reduces the communication load imposed when the acquisition unit 31 of the lobby intercom 25 acquires an image to be used as an authentication image from the intercom master unit 26.

[0145] The same function as that of the determination system 1 according to the third modified example may be embodied as a determination method, a (computer) program, or a non-transitory recording medium on which a program is recorded.

[0146] The various configurations described in the third modified example can be adopted in appropriate combination with the various configurations (including the modified examples) described in the above embodiment.

[0147] (8) Fourth Modification Next, a fourth modification of the above embodiment will be described with reference to FIGS.

[0148] 5 and 8, in the judgment system 1 according to the fourth modified example, the lobby intercom 25 has at least a part of the functions of the judgment system 1. Also, the judgment system 1 according to the fourth modified example stores (registers) the authentication image in the memory unit 256, not in the database 5 (see FIG. 1).

[0149] As shown in FIG. 8, the lobby intercom 25 according to the fourth modified example includes a communication unit 252, an acquisition unit 31, a registration determination unit 32, a registration unit , an extraction unit 35, and an update unit .

[0150] The communication unit 252 transmits a plurality of images including a live image G1 and a playback image G3 captured by the imaging unit 251 of the visitor to the intercom master unit 26.

[0151] The extraction unit 35 extracts facial features from images (live image G1, playback image G3) of the visitor captured by the imaging unit 251. More specifically, the extraction unit 35 extracts facial features from each of a plurality of frames (still images) included in the images of the visitor captured by the imaging unit 251. The extraction unit 35 of the fourth modified example is configured to be capable of extracting facial features from each of a plurality of frames included in the lobby image G2 captured by the lobby camera 28.

[0152] More specifically, the extraction unit 35 of the fourth modified example extracts one facial feature amount from each of a plurality of frames. That is, the extraction unit 35 of the fourth modified example extracts one facial feature amount from one frame.

[0153] According to the judgment system 1 of the fourth variant, even if a single frame contains multiple facial images, a single feature extracted from a single frame can be used as an authentication image of any one of the people captured in the single frame.

[0154] Furthermore, in the case where one frame includes multiple face images, for example, the extraction unit 35 may be configured to extract the feature amount of the largest face among the multiple face images included in one frame. Furthermore, the extraction unit 35 may perform a quality judgment on each of the multiple face images included in one frame, and extract the feature amount of the face image that is most suitable as an authentication image (has the highest score). For example, the quality judgment judges the suitability of the image for authentication based on the orientation, size, image quality, etc. of the face image, and indicates the suitability of the image for authentication with a score.

[0155] As shown in Table 1 below, the extraction unit 35 of the fourth modified example associates the extracted feature amount, the identification information of the live image G1 or playback image G3 from which the feature amount was extracted, and the frame number of the live image G1 or playback image G3 from which the feature amount was extracted, and temporarily stores them, for example, in the storage unit 256. The frame numbers are numbers assigned in chronological order to each of the multiple frames (still images) included in the live image G1 or playback image G3. After storing the feature amount, the identification information, and the frame number in association with each other, the extraction unit 35 of the fourth modified example deletes the original image (live image G1 or playback image G3) from which the feature amount was extracted.

[0156] [Table 1]

[0157] Intercom master unit 26 according to the fourth modified example transmits specific information corresponding to one image (one frame) selected by selection unit 267 to lobby intercom 25. In the present disclosure, the "specific information" is information including at least one of identification information and a frame number.

[0158] The acquisition unit 31 acquires, from the intercom master unit 26 included in the intercom system 2, identification information for identifying at least one frame out of the plurality of frames.

[0159] The registration determination unit 32 determines whether or not to register a feature amount corresponding to a frame specified by the specific information acquired by the acquisition unit 31 as an authentication image for the intercom system 2. More specifically, when the specific information is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the feature amount corresponding to the frame specified by the specific information is to be registered as an authentication image.

[0160] On the other hand, when the specific information is not acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration judgment unit 32 determines not to register the features corresponding to the frame identified by the specific information as an authentication image.

[0161] The registration unit 34 registers, as an authentication image, the feature amount determined to be registered as an authentication image by the registration determination unit 32. The registration unit 34 of the fourth modified example stores (registers) the feature amount (authentication image) in the storage unit 256.

[0162] According to the determination system 1 of the fourth modified example, the image capturing unit 251 does not store an image of a visitor, but registers feature amounts, thereby improving the confidentiality of data.

[0163] The update unit 36 ​​of the fourth modified example performs an update process to update the authentication image (feature amount) registered by the registration unit 34. For example, in the update process, the update unit 36 ​​compares (matches) the feature amount corresponding to the frame specified by the identification information with a plurality of authentication images (template data) stored in the storage unit 256. Here, the update unit 36 ​​determines whether or not there is a feature amount among the plurality of feature amounts (authentication image) registered by the registration unit 34 whose similarity with the feature amount corresponding to the frame specified by the identification information is equal to or greater than a threshold value.

[0164] Then, the update unit 36 ​​updates the features when there is a feature whose similarity to the feature corresponding to the frame specified by the identification information is equal to or greater than a threshold value among the multiple feature values ​​registered by the registration unit 34. More specifically, the update unit 36 ​​updates the authentication image by replacing the feature corresponding to the frame specified by the identification information with the feature whose similarity is equal to or greater than a threshold value.

[0165] On the other hand, the update unit 36 ​​does not update the authentication image if there is no feature whose similarity to the feature corresponding to the frame specified by the identification information is equal to or greater than the threshold value among the multiple feature amounts registered by the registration unit 34. When the update unit 36 ​​does not update the authentication image, the registration unit 34 of the fourth modified example registers the feature corresponding to the frame specified by the identification information as the authentication image. Note that the registration unit 34 does not register the face image updated by the update unit 36 ​​as the authentication image.

[0166] The update unit 36 ​​performs the above-mentioned update process when the specific information is acquired by the acquisition unit 31 via the trunk line L1 of the intercom system 2. On the other hand, when the specific information is acquired by the acquisition unit 31 without passing through the trunk line L1 of the intercom system 2, the update unit 36 ​​does not perform the above-mentioned update process.

[0167] According to the determination system 1 of the fourth modified example, it is possible to update the feature amount registered in the storage unit 256 as the authentication image.

[0168] In the fourth modified example, the registration unit 34 stores the features as the authentication image in the memory unit 256, but the registration unit 34 may store the features in another storage device (storage medium) such as the database 5 (see FIG. 1).

[0169] The function equivalent to the judgment system 1 according to the fourth modified example may be embodied as a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded. The judgment method according to one embodiment includes an extraction step, an acquisition step, a registration judgment step, and a registration step. In the extraction step, facial features are extracted from each of a plurality of still images included in an image captured by the imaging unit 251 of a visitor. In the acquisition step, specific information for identifying at least one of the plurality of still images is acquired from an information terminal included in the intercom system 2. In the registration judgment step, it is determined whether or not a feature corresponding to the still image identified by the specific information acquired in the acquisition step is to be registered as an authentication image of the intercom system 2. In the registration step, the feature determined to be registered as an authentication image in the registration judgment step is registered as an authentication image. In the registration judgment step, when the specific information is acquired through the main line L1 of the intercom system 2 in the acquisition step, it is determined that a feature corresponding to the still image identified by the specific information is to be registered as an authentication image. The program according to one embodiment is a program for causing one or more processors to execute the above judgment method.

[0170] The various configurations described in the fourth modified example can be adopted in appropriate combination with the various configurations (including the modified examples) described in the above embodiment.

[0171] (summary) As described above, the judgment system (1) according to the first aspect includes an acquisition unit (31), a registration judgment unit (32), and a registration unit (34). The acquisition unit (31) acquires an image to be used as an authentication image for the intercom system (2). The registration judgment unit (32) judges whether or not to register the image acquired by the acquisition unit (31) as an authentication image. The registration unit (34) registers the image judged by the registration judgment unit (32) to be registered as an authentication image as an authentication image. When the image is acquired by the acquisition unit (31) via the main line (L1) of the intercom system (2), the registration judgment unit (32) judges to register the image as an authentication image.

[0172] According to this embodiment, the residents of the housing complex (facility 20) can register their own authentication images by using the determination system (1), improving convenience. Also, by determining that the image acquired via the main line (L1) for the intercom of the complex should be registered as an authentication image, a decrease in security can be suppressed.

[0173] In the judgment system (1) according to the second aspect, in the first aspect, the acquisition unit (31) is configured to be able to acquire the above image from an information terminal (intercom master unit 26) included in the intercom system (2) via the main line (L1).

[0174] According to this embodiment, since the image is acquired from an information terminal included in the intercom system (2), such as the intercom master unit (26), a decrease in security can be suppressed.

[0175] In the determination system (1) according to the third aspect, in the second aspect, the information terminal (intercom master unit 26) is configured to be able to communicate with another information terminal (smartphone 6) via a route different from the trunk line (L1). The acquisition unit (31) is configured to be able to acquire the image from the other information terminal via the information terminal and the trunk line (L1).

[0176] According to this embodiment, the resident or the like can easily prepare an image for face recognition by using another information terminal such as a smartphone (6).

[0177] In the judgment system (1) according to the fourth aspect, in the second or third aspect, the acquisition unit (31) is configured to be able to acquire the above image from the intercom handset (27) connected to the information terminal (intercom master unit 26) via the information terminal and the trunk line (L1).

[0178] According to this embodiment, for example, by using a camera provided in the intercom slave unit (27), a resident or the like can easily prepare an image for face recognition.

[0179] The judgment system (1) according to the fifth aspect is in any one of the first to fourth aspects, and further includes an image quality judgment unit (41). The image quality judgment unit (41) judges whether the image satisfies a predetermined image quality standard as an authentication image. The registration judgment unit (32) judges to register the image as an authentication image when the image quality judgment unit (41) judges that the image satisfies the predetermined image quality standard and the image has been acquired by the acquisition unit (31) via the trunk line (L1).

[0180] According to this aspect, the image that satisfies a predetermined image quality standard for an authentication image can be registered as the authentication image.

[0181] In the judgment system (1) according to the sixth aspect, in the fifth aspect, the registration judgment unit (32) judges whether or not the image judged by the image quality judgment unit (41) to satisfy a predetermined image quality standard has passed through a trunk line (L1), thereby judging whether or not to register the image as an authentication image.

[0182] According to this aspect, for example, it is possible to reduce the number of times that the registration determination unit (32) makes a determination on the image that does not satisfy a predetermined image quality standard, and it is possible to reduce the processing load on the registration determination unit (32).

[0183] In the judgment system (1) according to the seventh aspect, in the fifth aspect, the image quality judgment unit (41) judges whether or not the image satisfies a predetermined image quality standard before the acquisition unit (31) acquires the image. The acquisition unit (31) acquires the image that is judged by the image quality judgment unit (41) to satisfy the predetermined image quality standard, and does not acquire the image that is judged by the image quality judgment unit (41) not to satisfy the predetermined image quality standard.

[0184] According to this aspect, the acquisition unit (31) does not acquire the images that do not satisfy the predetermined image quality standards, so that the registration judgment unit (32) can reduce judgments made on the images that do not satisfy the predetermined image quality standards, thereby reducing the processing burden on the registration judgment unit (32).

[0185] The judgment system (1) according to an eighth aspect is in any one of the fifth to seventh aspects, and further includes an output unit (33). The output unit (33) outputs information related to the judgment result of the image quality judgment unit (41).

[0186] According to this embodiment, the result of the judgment regarding the image quality of the image can be notified to the resident or the like via a display unit or the like of an information terminal (intercom master unit 26) or the like included in the intercom system (2).

[0187] The determination system (1) according to a ninth aspect is in any one of the first to eighth aspects, and further includes an output unit (42). The output unit (42) outputs information related to the determination result of the registration determination unit (32).

[0188] According to this aspect, it is possible to notify the resident or the like of the result of the determination regarding the registration of the authentication image via, for example, a display unit or the like.

[0189] The judgment system (1) according to the tenth aspect is in any one of the second to fourth aspects and further includes a communication unit (252). The communication unit (252) transmits a plurality of images (live image G1; playback image G3) of a visitor captured by the imaging unit (251) to an information terminal (intercom master unit 26). The information terminal selects one image from the plurality of images received from the communication unit (252). The acquisition unit (31) acquires the one image from the information terminal as an image to be used as an authentication image.

[0190] According to this embodiment, one image from among multiple images (live image G1; playback image G3) taken of the same visitor can be selected as the image to be used as the authentication image, and an image suitable as an authentication image can be obtained.

[0191] The judgment system (1) according to the eleventh aspect is in any one of the second to fourth aspects and further includes an extraction unit (35) and a communication unit (252). The extraction unit (35) extracts a facial image from an image (live image G1; playback image G3) of a visitor captured by the imaging unit (251). The communication unit (252) transmits the facial image extracted by the extraction unit (35) to an information terminal (intercom master unit 26). The acquisition unit (31) acquires the facial image selected by the information terminal from the information terminal as an image to be used as an authentication image.

[0192] According to this embodiment, it is possible to reduce the communication load when the determination system (1) communicates with the information terminal (intercom master unit 26).

[0193] The judgment system (1) according to the twelfth aspect, in any one of the second to fourth aspects, further includes a communication unit (252). The communication unit (252) transmits images (live images G1; playback images G3) of a visitor captured by the imaging unit (251) to an information terminal (intercom master unit 26). The information terminal extracts a facial image from the images received from the communication unit (252). The acquisition unit (31) acquires the facial image from the information terminal as an image to be used as an authentication image.

[0194] According to this aspect, it is possible to reduce the communication load imposed when the acquisition unit (31) acquires an image to be used as an authentication image.

[0195] The judgment system (1) according to the thirteenth aspect includes an extraction unit (35), an acquisition unit (31), a registration judgment unit (32), and a registration unit (34). The extraction unit (35) extracts facial features from each of a plurality of still images included in an image (live image G1; playback image G3) of a visitor captured by an imaging unit (251). The acquisition unit (31) acquires specific information for identifying at least one still image among the plurality of still images from an information terminal (intercom master unit 26) included in the intercom system (2). The registration judgment unit (32) judges whether or not to register the feature corresponding to the still image identified by the specific information acquired by the acquisition unit (31) as an authentication image of the intercom system (2). The registration unit (34) registers the feature determined by the registration judgment unit (32) to be registered as an authentication image as an authentication image. When the specific information is acquired by the acquisition unit (31) via the main line (L1) of the intercom system (2), the registration judgment unit (32) judges that the feature quantity corresponding to the still image identified by the specific information should be registered as an authentication image.

[0196] According to this aspect, since the image capturing unit (251) does not store an image of a visitor, but registers a feature amount, it is possible to improve the confidentiality of data.

[0197] The determination system (1) according to a fourteenth aspect is the thirteenth aspect, further including an update unit (36). The update unit (36) updates the feature amounts registered by the registration unit (34). When there is a feature amount, among the multiple feature amounts registered by the registration unit (34), whose similarity to a feature amount corresponding to a still image identified by the identification information is equal to or greater than a threshold value, the update unit (36) replaces the identified feature amount with the feature amount whose similarity is equal to or greater than the threshold value.

[0198] According to this aspect, the feature amount registered as the authentication image can be updated.

[0199] In a determination system (1) according to a fifteenth aspect, in the thirteenth aspect, an extraction section (35) extracts a feature amount of one face from each of a plurality of still images.

[0200] According to this aspect, even if a single frame contains images of multiple people, the features extracted from the single frame can be used as an authentication image of any of the people captured in the single frame.

[0201] The configurations other than those of the first aspect are not essential to the determination system (1) and may be omitted as appropriate.

[0202] The judgment method according to the sixteenth aspect includes an acquisition step, a judgment step, and a registration step. In the acquisition step, an image to be used as an authentication image for the intercom system (2) is acquired. In the judgment step, it is judged whether or not the image acquired in the acquisition step should be registered as an authentication image. In the registration step, the image judged in the judgment step to be registered as an authentication image is registered as the authentication image. In the judgment step, if the image is acquired in the acquisition step via the main line (L1) of the intercom system (2), the image is registered as an authentication image.

[0203] According to this embodiment, the residents of the housing complex (facility 20) can register their own authentication images. Also, by deciding to register the image acquired via the main line (L1) for the intercom of the complex as an authentication image, it is possible to prevent a decrease in security.

[0204] The determination method according to the seventeenth aspect includes an extraction step, an acquisition step, a registration determination step, and a registration step. In the extraction step, facial features are extracted from each of a plurality of still images included in an image captured by the imaging unit (251) of a visitor. In the acquisition step, specific information for identifying at least one of the plurality of still images is acquired from an information terminal included in the intercom system (2). In the registration determination step, it is determined whether or not a feature corresponding to the still image identified by the specific information acquired in the acquisition step is to be registered as an authentication image for the intercom system (2). In the registration step, the feature determined to be registered as an authentication image in the registration determination step is registered as an authentication image. In the registration determination step, when the specific information is acquired via the main line (L1) of the intercom system (2) in the acquisition step, it is determined that a feature corresponding to the still image identified by the specific information is to be registered as an authentication image.

[0205] According to this aspect, since the image capturing unit (251) does not store an image of a visitor, but registers a feature amount, it is possible to improve the confidentiality of data.

[0206] A program according to an eighteenth aspect is a program for causing one or more processors to execute the determination method according to the sixteenth or seventeenth aspect.

[0207] According to this embodiment, the residents of the housing complex (facility 20) can register their own authentication images. Also, by deciding to register the image acquired via the main line (L1) for the intercom of the complex as an authentication image, it is possible to prevent a decrease in security. [Explanation of symbols]

[0208] 1. Judgment System 2. Intercom System 251 Imaging unit 252 Communications Department 26 Intercom base station (information terminal) 27 Intercom handset 31 Acquisition Department 32 Registration Judgment Department 33 Output section 34 Registration Department 35 Extraction part 36 Update section 41 Image quality judgement unit 42 Output section 6 Smartphones (other information terminals) L1 trunk line

Claims

1. an acquisition unit that acquires an image to be used as an authentication image for the intercom system; a registration determination unit that determines whether or not to register the image acquired by the acquisition unit as the authentication image; a registration unit that registers the image determined by the registration determination unit to be registered as the authentication image as the authentication image; an image quality determination unit that determines whether the image satisfies a predetermined image quality standard for the authentication image; Equipped with The registration determination unit is when the image quality determination unit determines that the image satisfies the predetermined image quality standard and the image is acquired by the acquisition unit via the trunk line of the intercom system, determine that the image is to be registered as the authentication image; determining whether the image, which is determined by the image quality determination unit to satisfy the predetermined image quality standard, has passed through the trunk line, thereby determining whether to register the image as the authentication image; Judgment system.

2. the acquiring unit is configured to acquire the image from an information terminal included in the intercom system via the trunk line, The determination system according to claim 1 .

3. the information terminal is configured to be able to communicate with other information terminals via a route different from the trunk line; the acquisition unit is configured to be able to acquire the image from the other information terminal via the information terminal and the trunk line, The determination system according to claim 2 .

4. The acquisition unit is configured to acquire the image from an intercom slave connected to the information terminal via the information terminal and the trunk line. The determination system according to claim 2 .

5. Further comprising an output unit that outputs information regarding a result of the judgment by the image quality judgment unit. The determination system according to claim 1 .

6. Further comprising an output unit that outputs information regarding a judgment result of the registration judgment unit. The determination system according to claim 1 .

7. Further comprising a communication unit that transmits a plurality of images of the visitor captured by the imaging unit to the information terminal, the information terminal selects one image from the plurality of images received from the communication unit; The acquisition unit acquires the one image as the authentication image from the information terminal. The determination system according to claim 2 .

8. An extraction unit that extracts a face image from an image of a visitor captured by an imaging unit; a communication unit that transmits the facial image extracted by the extraction unit to the information terminal; Further comprising: The acquisition unit acquires the face image selected by the information terminal from the information terminal as the authentication image. The determination system according to claim 2 .

9. Further comprising a communication unit that transmits an image of the visitor captured by the imaging unit to the information terminal, The information terminal extracts a face image from the image received from the communication unit, The acquisition unit acquires the face image as the authentication image from the information terminal. The determination system according to claim 2 .

10. An acquisition step of acquiring an image to be used as an authentication image for an intercom system; a registration determination step of determining whether or not to register the image acquired in the acquisition step as the authentication image; a registration step of registering the image determined to be registered as the authentication image in the registration determination step as the authentication image; an image quality determination step for determining whether the image satisfies a predetermined image quality standard for the authentication image; having In the registration determination step, When it is determined in the image quality determination step that the image satisfies the predetermined image quality standard, and when the image is acquired through a trunk line of an intercom system in the acquisition step, it is determined that the image is to be registered as the authentication image; determining whether the image, which is determined in the image quality determination step to satisfy the predetermined image quality standard, has passed through the trunk line, thereby determining whether or not to register the image as the authentication image; Judgment method.

11. A program for causing one or more processors to execute the judgment method described in claim 10.

Images