Intercom system, information processing method and program

Abstract

To provide an intercom system, an information processing method, and a program that can present information to residents that can be used to confirm the identity of visitors.SOLUTION: An intercom system 80 includes an image acquisition unit 22a that acquires a facial image of a visitor to an apartment building 100, an extraction unit 22b that extracts first facial information from the acquired facial image, and an output unit 22c that identifies the reliability associated with second facial information corresponding to the first facial information by referring to reliability information in which a reliability is associated with each of a plurality of pieces of second facial information for inquiry, and outputs visitor information for displaying the identified reliability and the acquired facial image to an intercom base unit 30 installed in the apartment building 100.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an intercom system, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses an intercom system used in an apartment house.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Visitors who attempt to visit residents of an apartment house can be various people. When a resident confirms the identity of a visitor, it is common to make a voice call while looking at the face image of the visitor displayed on the master unit of the intercom. However, incidents such as robberies by thieves posing as deliverymen have also occurred.

[0005] Therefore, an object of the present invention is to provide an intercom system, an information processing method, and a program that can present information used as a basis for judgment when a resident confirms the identity of a visitor.

Means for Solving the Problems

[0006] In order to achieve the above object, one form of the intercom system according to the present invention includes an image acquisition unit that acquires a face image of a visitor to an apartment building, an extraction unit that extracts first face information from the acquired face image, and by referring to reliability information in which reliability is associated with each of a plurality of pieces of second face information for inquiry, the reliability associated with the second face information corresponding to the first face information is specified, and an output unit that outputs visitor information for displaying the specified reliability and the acquired face image to a master intercom provided in the apartment building.

[0007] Also, in order to achieve the above object, one form of the information processing method according to the present invention is an information processing method executed by an intercom system provided in an apartment building, the method including an image acquisition step of acquiring a face image of a visitor to the apartment building, an extraction step of extracting first face information from the acquired face image, and by referring to reliability information in which reliability is associated with each of a plurality of pieces of second face information for inquiry, specifying the reliability associated with the second face information corresponding to the first face information, and an output step of outputting visitor information for displaying the specified reliability and the acquired face image to a master intercom provided in the apartment building.

[0008] Note that the present invention can be realized not only as the above information processing method but also as a program for causing a computer to execute the information processing method. Furthermore, it can also be realized as a computer-readable recording medium storing the program.

Effect of the Invention

[0009] According to the present invention, it is realized to present information that serves as a basis for judgment when a resident confirms the identity of a visitor.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the intercom system according to the present invention will be described in detail with reference to the drawings. Note that each of the embodiments described below shows a preferred specific example of the present invention. The numerical values, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, the components not described in the independent claims are described as optional components constituting a preferred form.

[0012] Note that each figure is a schematic diagram and is not necessarily drawn precisely. Also, in each figure, the same reference numerals are given to substantially the same configurations, and duplicate explanations may be omitted or simplified.

[0013] (Embodiment) [Configuration] First, the configuration of a communication system including an intercom system according to the embodiment will be described. FIG. 1 is a block diagram showing the functional configuration of the communication system according to the embodiment.

[0014] As shown in FIG. 1, the communication system 10 includes a reliability information server 70 and an intercom system 80. The communication system 10 is a system capable of presenting the reliability of a visitor to a resident using the intercom system 80. The reliability represents, in numerical terms, the degree to which a resident trusts a visitor. That is, a visitor with a high reliability is considered by the resident to be a person with a clear identity who can be dealt with with confidence, and a visitor with a low reliability is considered by the resident to be a person who may cause harm to the resident.

[0015] The apartment building 100 is a structure to which the intercom system 80 is applied inside. Specifically, the apartment building 100 is an apartment, a dormitory, a company housing, or the like.

[0016] Hereinafter, the configuration of the systems or devices included in the communication system 10 will be described.

[0017] The intercom system 80 includes a lobby intercom 20, an intercom master unit 30, a control device 40, a gateway device 50, and an auto-lock door 60. The intercom master unit 30 is provided in each of one or more exclusive parts of the apartment building 100. The lobby intercom 20, the control device 40, the gateway device 50, and the auto-lock door 60 are provided in the common part of the apartment building 100.

[0018] The lobby intercom 20 is a device provided outside (outdoor side) of the automatic locking door 60 at the entrance of the apartment building 100. The lobby intercom 20 controls, for example, the automatic locking door 60. The lobby intercom 20 has a user interface composed of a numeric keypad, a calling button, etc. A visitor to the apartment building 100 can communicate with a resident and request unlocking of the automatic locking door 60 by entering the room number of the destination through the numeric keypad. The lobby intercom 20 communicates with the main intercom unit 30 via the control device 40. Specifically, the lobby intercom 20 includes a communication unit 21, an information processing unit 22, an operation reception unit 23, an imaging unit 24, and a storage unit 25.

[0019] The communication unit 21 is a communication circuit (communication module) for the lobby intercom 20 to communicate with the main intercom unit 30 via the control device 40. Also, the communication unit 21 can communicate with the reliability information server 70 via the control device 40, the gateway device 50, and the public network 90. The communication performed by the communication unit 21 is, for example, wired communication, but may also be wireless communication. The communication standard of the communication performed by the communication unit 21 is not particularly limited.

[0020] The information processing unit 22 performs various information processes such as information processing related to the reliability information to be transmitted to the main intercom unit 30 and information processing related to the communication of the lobby intercom 20. The information processing unit 22 is realized by, for example, a microcomputer, but may also be realized by a processor or a dedicated circuit. The information processing unit 22 includes, as functional components, an image acquisition unit 22a, an extraction unit 22b, and an output unit 22c. The functions of the image acquisition unit 22a, the extraction unit 22b, and the output unit 22c are realized by a microcomputer or a processor constituting the information processing unit 22 executing a computer program stored in the storage unit 25.

[0021] The image acquisition unit 22a acquires the face image of the visitor captured by the imaging unit 24.

[0022] The extraction unit 22b extracts face information from the face image of the visitor acquired by the image acquisition unit 22a. The face information is, for example, feature amounts such as the positions of feature points such as eyes, nose, and mouth, the position of the face area, and the size of the face area. The face information includes information necessary for identifying an individual.

[0023] The output unit 22c determines and outputs the reliability of the visitor from the face information extracted by the extraction unit 22b.

[0024] The operation reception unit 23 receives various operations of the visitor. The operation reception unit 23 is realized, for example, by a touch panel, but may also be realized by a hardware button.

[0025] The imaging unit 24 images the face image of the visitor. The imaging unit 24 is realized, for example, by a camera.

[0026] The storage unit 25 is a storage device that stores the face information of visitors who have visited the apartment house 100 in the past, the reliability associated with each face information, and computer programs executed by the information processing unit 22, etc. The storage unit 25 is realized, for example, by a semiconductor memory.

[0027] The intercom master unit 30 is an intercom terminal fixedly installed in the exclusive part of the apartment house 100. The intercom master unit 30 performs information processing for the resident of the exclusive part to communicate with the visitor via the lobby intercom 20 or the intercom slave unit 35. The intercom master unit 30 includes a communication unit 31, an information processing unit 32, an operation reception unit 33, and a display unit 34.

[0028] The communication unit 31 is a communication circuit (communication module) for the intercom master unit 30 to communicate with the lobby intercom 20 via the control device 40. Further, the communication unit 31 can communicate with the reliability information server 70 via the control device 40, the gateway device 50, and the public network 90. The communication performed by the communication unit 31c is, for example, wired communication, but may also be wireless communication. The communication standard of the communication performed by the communication unit 31 is not particularly limited.

[0029] The information processing unit 32 performs various information processes such as processes related to the communication of the intercom master unit 30. The information processing unit 32 is realized by, for example, a microcomputer, but may also be realized by a processor or a dedicated circuit.

[0030] The operation reception unit 33 receives various operations of the resident. The operation reception unit 33 is realized by, for example, a touch panel, but may also be realized by a hardware button.

[0031] The display unit 34 displays various images. The display unit 34 is realized by a display panel such as a liquid crystal panel or an organic EL panel.

[0032] The intercom slave unit 35 is provided outside the entrance and exit of the exclusive area. The intercom slave unit 35 includes an imaging unit 35a, and the imaging unit 35a captures a face image of a visitor and is realized by, for example, a camera.

[0033] The control device 40 is a device provided in the apartment house 100 that controls the communication between two devices among a plurality of intercom master units 30 and the lobby intercom 20. The control device 40 includes a communication unit 41. The communication unit 41 is a communication circuit (communication module) for the control device 40 to communicate with the lobby intercom 20, a plurality of intercom master units 30, and the gateway device 50. Further, the communication unit 41 can communicate with the reliability information server 70 via the gateway device 50 and the public network 90. The communication performed by the communication unit 41 is, for example, wired communication, but may also be wireless communication. The communication standard of the communication performed by the communication unit 41 is not particularly limited. Also, it may be provided with an information processing unit 42 and a storage unit 43 having a functional configuration similar to that of the information processing unit 22 and the storage unit 25 of the lobby intercom 20.

[0034] The gateway device 50 is a communication device for a device provided in the apartment house 100 such as the master intercom 30 to communicate with a reliability information server 70 etc. through the public network 90. The gateway device 50 includes a communication unit 51. The communication unit 51 is a communication circuit (communication module) for the gateway device 50 to communicate with the reliability information server 70 via the public network 90. Also, the communication unit 51 can communicate with the lobby intercom 20 and a plurality of master intercoms 30 via the control device 40. The communication performed by the communication unit 51 is, for example, wired communication, but may also be wireless communication. The communication standard of the communication performed by the communication unit 51 is not particularly limited.

[0035] The gateway device 50 may include an information processing unit 52 and a storage unit 53 having a functional configuration similar to that of the information processing unit 22 and the storage unit 25 of the lobby intercom 20 or the information processing unit 42 and the storage unit 43 of the control device 40. Note that the gateway device 50 may be built into the control device 40.

[0036] The auto-lock door 60 is an automatic door provided at the entrance of the apartment house 100. The auto-lock door 60 automatically closes and locks after a certain period of time has elapsed since it was unlocked and opened.

[0037] The reliability information server 70 is, for example, one or more server devices located outside the apartment house 100. The reliability information server 70 is a server that holds reliability information. The reliability information server 70 can communicate with the intercom system 80 via a public network 90 such as the Internet (in other words, a public line). The reliability information server 70 can transmit reliability information to the lobby intercom 20 when a visitor comes to the apartment house 100. The reliability information server 70 includes a communication unit 71 that communicates with the gateway device 50 via the public network 90, an information processing unit 72 that identifies and outputs reliability information, and a storage unit 73 in which the reliability information is stored.

[0038] Note that the reliability information server 70 is mainly used when sharing reliability information in a plurality of apartment houses 100 located remotely. When sharing reliability information in one apartment house 100, the communication system 10 may not include the reliability information server 70.

[0039] [Operation Example 1] Visitors who intend to visit the residents of the apartment house 100 can be various people. When a resident confirms the identity of a visitor, it is common to make a voice call while looking at the face image of the visitor displayed on the display unit 34 of the master intercom 30. However, incidents such as robberies by criminals posing as deliverymen have also occurred.

[0040] In contrast, the communication system 10 can present the face image and reliability information of a visitor who intends to visit a resident in a proprietary unit to the resident in the proprietary unit. That is, the resident can obtain information that serves as a basis for judgment when confirming the identity of the visitor. Hereinafter, Operation Example 1 of such a communication system 10 will be described. FIG. 2 is a sequence diagram of Operation Example 1 of the communication system 10. Note that the following Operation Example 1 is an operation when a visitor who intends to visit a certain proprietary unit in the apartment house 100 is located at the lobby intercom 20 provided at the common entrance of the apartment house 100.

[0041] First, the imaging unit 24 of the lobby intercom 20 captures a face image of the visitor (S11 in FIG. 2). This may be automatically executed when the visitor performs an operation for calling (such as an operation for specifying the room number of the proprietary unit) on the lobby intercom 20.

[0042] Next, the image acquisition unit 22a of the information processing unit 22 acquires the face image of the visitor captured by the imaging unit 24 (S12 in FIG. 2). The extraction unit 22b extracts the first face information from the face image acquired by the image acquisition unit 22a (S13 in FIG. 2). Although the first face information includes information necessary to identify an individual, if the amount of first face information necessary to identify an individual cannot be extracted, the operations of S11 to S13 may be repeated until the amount of first face information necessary to identify an individual is acquired. At this time, the lobby intercom 20 may present an instruction to the visitor to capture an image suitable for the extraction of the first face information using an image and voice.

[0043] When the first face information is extracted, the output unit 22c identifies the reliability of the visitor (S14 in FIG. 2). Specifically, the output unit 22c identifies the reliability of the visitor based on the extracted first face information and the reliability information stored in the storage unit 25. The reliability information is information in which a reliability is associated with each of a plurality of second face information for inquiry. FIG. 3 is a diagram showing an example of the reliability information. The output unit 22c identifies the second face information corresponding to the first face information from among the plurality of second face information for inquiry. Here, the second face information corresponding to the first face information may be the second face information that matches the first face information or the second face information having the highest similarity to the first face information, as long as the first face information and the identified second face information are face information of the same person. The output unit 22c identifies the reliability associated with the identified second face information as the reliability of the visitor.

[0044] In FIG. 3, the reliability is stored as the number of times the lock has been unlocked and the number of times the lock has not been unlocked. The output unit 22c calculates the reliability from, for example, the ratio of the number of times the lock has been unlocked to the number of times the lock has not been unlocked, and identifies the reliability. The reliability may be calculated from the difference between the number of times the lock has been unlocked and the number of times the lock has not been unlocked. Also, the reliability may be calculated based on the unlocking results (the number of times the lock has been unlocked and the number of times the lock has not been unlocked) in the entire period so far, or may be calculated based on the unlocking results in a recent predetermined period (that is, only a part of the entire period). Further, the reliability may be calculated while emphasizing the unlocking results in a recent predetermined period while using the unlocking results in the entire period so far. The method for calculating the reliability by the output unit 22c is not particularly limited.

[0045] When the reliability of the visitor is identified, the output unit 22c uses the communication unit 21 to transmit visitor information including the face image and reliability of the visitor to the master intercom 30 of the visitor's destination (S15 in FIG. 2). The visitor information transmitted by the communication unit 21 is received by the master intercom 30 via a control device 40 (not shown in FIG. 2). When the communication unit 31 of the master intercom 30 receives the visitor information, the information processing unit 32 displays the visitor information on the display unit 34 (S16 in FIG. 2). FIG. 4 is a diagram showing an example of a display screen of the visitor information. As shown in FIG. 4, a meter representing the reliability of the visitor is displayed on the display screen together with the face image of the visitor. In the example of FIG. 4, the meter representing the reliability is displayed on the left side of the display screen. The reliability of the visitor may be displayed numerically, and the display mode of the reliability is not particularly limited.

[0046] When the visitor information is displayed, the information processing unit 32 receives the resident's operation using the operation reception unit 33. First, the information processing unit 32 receives the resident's response operation (S17 in FIG. 2). The response operation is received, for example, when the resident presses the "Call" button of the operation reception unit 33. By performing the response operation, the resident can talk to the visitor and can determine whether to unlock by asking questions, etc. Next, the information processing unit 32 receives the resident's unlocking operation (S18 in FIG. 2). The unlocking operation is received, for example, when the resident presses the "Unlock" button of the operation reception unit 33.

[0047] When the unlocking operation is received, the information processing unit 32 uses the communication unit 31 to send an unlocking command to the lobby intercom 20 (S19 in FIG. 2). The unlocking command sent by the communication unit 31 is received by the lobby intercom 20 via a control device 40 (not shown in FIG. 2). When the communication unit 21 of the lobby intercom 20 receives the unlocking command, the information processing unit 22 uses the communication unit 21 to unlock the auto-lock door 60.

[0048] Finally, the information processing unit 22 updates the reliability information stored in the storage unit 25 (S20 in FIG. 2). When the resident performs the response operation and the unlocking operation and the auto-lock door 60 is unlocked, a correction is executed to increase the reliability of the visitor by adding 1 to the number of unlocks associated with the second face information of the visitor in the reliability information of FIG. 3.

[0049] Here, in S17 and S18, when a response operation is performed but the unlocking operation is not performed and an end operation is performed, a correction for reducing the reliability of the visitor is executed by adding 1 to the number of times of non-unlocking associated with the second face information of the visitor in the reliability information of FIG. 3. The end operation is an operation for ending a call and is received, for example, when the resident presses the "End" button of the operation reception unit 33. For example, this may correspond to a case where an undesirable visitor tries to visit the resident. Further, when neither a response operation nor an unlocking operation is performed, the information processing unit 22 does not execute a correction for the specified reliability. For example, this may correspond to a case where the resident is absent.

[0050] As described above, according to the operation example 1, the resident can obtain information that serves as a basis for judgment when confirming the identity of the visitor.

[0051] Note that the operation example 1 is an operation when a visitor who tries to visit a certain proprietary unit in the apartment house 100 is located at the lobby interphone 20 provided at the common entrance of the apartment house 100. However, the same operation is also performed when a visitor who tries to visit another proprietary unit in the apartment house 100 is located at the lobby interphone 20 provided at the common entrance of the apartment house 100.

[0052] [Operation Example 2] In the operation example 1, the operation when the reliability information includes the second face information of the visitor due to reasons such as the visitor having visited the apartment house 100 in the past was described. In the operation example 2, the operation when the reliability information does not include the second face information of the visitor will be described. FIG. 5 is a sequence diagram showing the operation of the operation example 2 of the communication system 10 according to the embodiment. Note that the following operation example 2 is an operation when a visitor who tries to visit a certain proprietary unit in the apartment house 100 is located at the lobby interphone 20 provided at the common entrance of the apartment house 100.

[0053] First, the imaging unit 24 of the lobby intercom 20 captures a face image of the visitor (S31 in FIG. 5). This may be automatically executed when the visitor performs an operation for calling the lobby intercom 20 (such as an operation of specifying the room number of the exclusive area).

[0054] Next, the image acquisition unit 22a of the information processing unit 22 acquires the face image of the visitor captured by the imaging unit 24 (S32 in FIG. 5). The extraction unit 22b extracts first face information from the face image acquired by the image acquisition unit 22a (S33 in FIG. 5). Although the first face information includes information necessary to identify an individual, if an amount of first face information necessary to identify an individual cannot be extracted, the operations of S31 to S33 may be repeated until an amount of first face information necessary to identify an individual is acquired. At this time, the lobby intercom 20 may present an instruction for capturing an image suitable for the extraction of the first face information to the visitor using an image and voice.

[0055] When the first face information is extracted, the output unit 22c attempts to specify the reliability of the visitor. Specifically, the output unit 22c attempts to specify the reliability of the visitor based on the extracted first face information and the reliability information stored in the storage unit 25. The output unit 22c attempts to specify the second face information corresponding to the first face information from among a plurality of second face information for query. Here, when the second face information corresponding to the first face information is not included in the reliability information and cannot be specified, the output unit 22c registers the first face information extracted in step S33 as new second face information in the reliability information (S34 in FIG. 5).

[0056] When it is determined that the reliability cannot be specified, the output unit 22c uses the communication unit 21 to transmit the face image of the visitor to the master intercom 30 of the visitor's destination (S35 in FIG. 5). The face image transmitted by the communication unit 21 is received by the master intercom 30 via a control device 40 (not shown in FIG. 5). When the communication unit 31 of the master intercom 30 receives the visitor information, the information processing unit 32 displays the face image on the display unit 34 (S36 in FIG. 5). At this time, the information processing unit 32 may display, together with the face image, the fact that the reliability could not be specified, that is, the fact that the visitor is visiting the apartment house 100 for the first time.

[0057] When the face image is displayed, the information processing unit 32 receives the operation of the resident using the operation reception unit 33. First, the information processing unit 32 receives the response operation of the resident (S37 in FIG. 5). The response operation is received, for example, when the resident presses the "Call" button of the operation reception unit 33. By performing the response operation, the resident can talk to the visitor and can determine whether to unlock by asking requirements or the like. Next, the information processing unit 32 receives the unlocking operation of the resident (S38 in FIG. 5). The unlocking operation is received, for example, when the resident presses the "Unlock" button of the operation reception unit 33.

[0058] When the unlocking operation is received, the information processing unit 32 uses the communication unit 31 to transmit an unlocking command to the lobby intercom 20 (S39 in FIG. 5). The unlocking command transmitted by the communication unit 31 is received by the lobby intercom 20 via a control device 40 (not shown in FIG. 5). When the communication unit 21 of the lobby intercom 20 receives the unlocking command, the information processing unit 22 unlocks the auto-lock door 60 using the communication unit 21.

[0059] Finally, the information processing unit 22 updates the reliability information stored in the storage unit 25 (S40 in FIG. 5). When a response operation and an unlocking operation are performed by the resident and the auto-lock door 60 is unlocked, for the reliability information in FIG. 3, the initial reliability of the visitor is set by adding 1 to the number of times of unlocking associated with the second face information of the visitor registered in S34.

[0060] Here, in S37 and S38, when a response operation is performed but an unlocking operation is not performed and an end operation is performed, for the reliability information in FIG. 3, the initial reliability of the visitor is set by adding 1 to the number of times of not unlocking associated with the second face information of the visitor registered in S34. The end operation is an operation for ending a call and is received, for example, when the resident presses the "end" button of the operation reception unit 33. For example, this may correspond to a case where an undesirable visitor tries to visit the resident. Also, when neither a response operation nor an unlocking operation is performed, the information processing unit 22 does not execute correction for the specified reliability. For example, this may correspond to a case where the resident is absent.

[0061] Thus, according to Operation Example 2, the communication system 10 can register the first face information of a person who visits the apartment building 100 for the first time as new second face information in the reliability information.

[0062] Note that Operation Example 2 is an operation when a visitor who tries to visit a certain proprietary part in the apartment building 100 is located at the lobby intercom 20 provided at the common entrance of the apartment building 100. However, the same operation is also performed when a visitor who tries to visit another proprietary part in the apartment building 100 is located at the lobby intercom 20 provided at the common entrance of the apartment building 100. Therefore, the reliability information stored in the storage unit 25 of the lobby intercom 20 includes the second face information of visitors who have tried to visit any of the proprietary parts in the apartment building 100 so far.

[0063] [Operation Example 3] In Operation Examples 1 and 2, the operation when only one lobby intercom 20 is provided in the apartment house 100 was described. However, a plurality of lobby intercoms 20 may be provided in the apartment house 100. For example, it is assumed that the apartment house 100 is provided with a plurality of common entrances, and a lobby intercom 20 is provided at each of the plurality of common entrances.

[0064] Therefore, in Operation Example 3, the operation when a plurality of lobby intercoms 20 are provided in the apartment house 100 will be described. FIG. 6 is a sequence diagram showing the operation of Operation Example 3 of the communication system 10 according to the embodiment.

[0065] Here, it is assumed that two lobby intercoms 20 are provided, and they are referred to as lobby intercom 20A and lobby intercom 20B. Note that A and B are merely notations for distinction, and do not indicate differences in functional configurations or superiority, and A and B can be read appropriately replaced.

[0066] First, a visitor uses the lobby intercom 20A. The lobby intercom 20A operates according to Operation Example 1 or 2, and the information processing unit 22A of the lobby intercom 20A updates the reliability information stored in the storage unit 25A (S51 in FIG. 6).

[0067] When the reliability information is updated, the information processing unit 22A of the lobby intercom 20A transmits the reliability information to the lobby intercom 20B using the communication unit 21A (S52 in FIG. 6). The reliability information transmitted by the communication unit 21A is received by the lobby intercom 20B via the control device 40 (not shown in FIG. 6) (S53 in FIG. 6). The information processing unit 22B of the lobby intercom 20B updates the reliability information stored in the storage unit 25B based on the received reliability information (S54 in FIG. 6). Specifically, the information processing unit 22B reflects the update content of the received reliability information (the update content of the reliability information in step S53) in the reliability information stored in the storage unit 25B.

[0068] In this way, even when the apartment building 100 is equipped with a plurality of lobby intercoms 20, the communication system 10 can present the reliability of the visitor to the resident whether the visitor who used a certain common entrance in the past uses another common entrance or not.

[0069] The transmission and reception of the reliability information may be executed every time the reliability information is updated, or may be executed at predetermined intervals. For example, it may be executed at 5:00 every morning.

[0070] Also, the reliability information may be stored only in the storage unit 25A of the lobby intercom 20A, and other lobby intercoms 20B etc. may identify the reliability by communicating with the lobby intercom 20A and accessing the storage unit 25A. Further, the reliability information may be stored in the storage unit of an external device different from any of the plurality of lobby intercoms 20, and the plurality of lobby intercoms 20 may each communicate with the external device and identify the reliability by accessing the reliability information stored in the external device. The external device is, for example, the control device 40.

[0071] [Operation Example 4] In Operation Examples 1 to 3, the operation of the communication system 10 within one apartment building 100 was described. Here, in the communication system 10, the reliability information server 70 provided outside the intercom system 80 can share the reliability information among a plurality of intercom systems 80 provided in different apartment buildings 100. In Operation Example 4, the operation when the reliability information is shared among a plurality of intercom systems 80 provided in different apartment buildings 100 will be described. FIG. 7 is a sequence diagram showing the operation of Operation Example 4 of the communication system 10 according to the embodiment. In the following, the processing executed by the lobby intercom 20 and the reliability information server 70 provided in a certain apartment building 100 when a visitor visits the apartment building 100 will be described.

[0072] First, the imaging unit 24 of the lobby intercom 20 captures a face image of the visitor (S61 in FIG. 7). This may be automatically executed when the visitor performs an operation for calling the lobby intercom 20 (such as an operation of specifying the room number of the exclusive area).

[0073] Next, the image acquisition unit 22a of the information processing unit 22 acquires the face image of the visitor captured by the imaging unit 24 (S62 in FIG. 7). The extraction unit 22b extracts first face information from the face image acquired by the image acquisition unit 22a (S63 in FIG. 7). The first face information includes information necessary to identify an individual. However, if an amount of first face information necessary to identify an individual cannot be extracted, the operations of S61 to S63 may be repeated until an amount of first face information necessary to identify an individual is acquired. At this time, the lobby intercom 20 may present an instruction for the visitor to capture an image suitable for the extraction of the first face information using an image and voice.

[0074] When the first face information is extracted, the output unit 22c transmits the first face information of the visitor to the reliability information server 70 using the communication unit 21 (S64 in FIG. 7). The first face information transmitted by the communication unit 21 is received by the reliability information server 70 via a control device 40 (not shown in FIG. 7), a gateway device 50 (not shown in FIG. 7), and a public network 90 (not shown in FIG. 7).

[0075] When the first face information is received, the information processing unit 72 of the reliability information server 70 identifies the reliability of the visitor (S65 in FIG. 7). Specifically, the information processing unit 72 identifies the reliability of the visitor based on the received first face information and the reliability information stored in the storage unit 73. The information processing unit 72 identifies the second face information corresponding to the first face information from among a plurality of second face information for query. Here, the second face information corresponding to the first face information may be second face information that matches the first face information or second face information having the highest similarity to the first face information, as long as the first face information and the identified second face information are face information of the same person. The information processing unit 72 identifies the reliability associated with the identified second face information as the reliability of the visitor.

[0076] When the reliability of the visitor is specified, the information processing unit 72 uses the communication unit 71 to transmit the specified reliability of the visitor to the lobby intercom 20 (S66 in FIG. 7). The reliability transmitted by the communication unit 71 is received by the lobby intercom 20 via the public network 90, the gateway device 50, and the control device 40.

[0077] When the reliability of the visitor is received, the information processing unit 22 uses the communication unit 21 to transmit visitor information including the face image and reliability of the visitor to the intercom master unit 30 at the visitor's destination (S67 in FIG. 7). The visitor information transmitted by the communication unit 21 is received by the intercom master unit 30 via the control device 40. When the communication unit 31 of the intercom master unit 30 receives the visitor information, the information processing unit 32 displays the visitor information on the display unit 34 (S68 in FIG. 7). FIG. 4 is a diagram showing an example of the display screen of the visitor information. As shown in FIG. 4, a meter representing the reliability of the visitor is displayed on the display screen together with the face image of the visitor.

[0078] When the visitor information is displayed, the information processing unit 32 receives the operation of the resident using the operation reception unit 33. First, the information processing unit 32 receives the response operation of the resident (S69 in FIG. 7). The response operation is received, for example, when the resident presses the "Call" button of the operation reception unit 33. By performing the response operation, the resident can talk to the visitor and can make a judgment on whether to unlock by asking requirements or the like. Next, the information processing unit 32 receives the unlocking operation of the resident (S70 in FIG. 7). The unlocking operation is received, for example, when the resident presses the "Unlock" button of the operation reception unit 33.

[0079] When the unlocking operation is received, the information processing unit 32 uses the communication unit 31 to send an unlocking command to the lobby intercom 20 (S71 in FIG. 7). The unlocking command transmitted by the communication unit 31 is received by the lobby intercom 20 via the control device 40. When the communication unit 21 of the lobby intercom 20 receives the unlocking command, the information processing unit 22 uses the communication unit 21 to unlock the auto-lock door 60 (S72 in FIG. 7).

[0080] Finally, the information processing unit 22 uses the communication unit 21 to send unlocking determination information indicating whether the unlocking command has been executed to the reliability information server 70 (S73 in FIG. 7). The unlocking determination information transmitted by the communication unit 21 is received by the reliability information server 70 via the control device 40, the gateway device 50, and the public network 90. The information processing unit 72 updates the reliability information stored in the storage unit 73 based on the received unlocking determination information (S74 in FIG. 7).

[0081] In this way, the communication system 10 can identify the reliability of the visitor using the reliability information stored in the reliability information server 70. FIG. 7 shows the processes executed by the lobby intercom 20 provided in the apartment building 100 and the reliability information server 70 when a visitor visits the apartment building 100. Here, the processes executed by the lobby intercom 20 provided in the apartment building 100 and the reliability information server 70 when a visitor visits another apartment building 100 are the same. That is, the reliability information stored in the reliability information server 70 is shared among a plurality of intercom systems 80 (a plurality of lobby intercoms 20) provided in different apartment buildings 100.

[0082] Thereby, for a visitor who visits the apartment building 100 for the first time, if the visitor has visited another apartment building 100, the resident can confirm the reliability of the visitor.

[0083] In addition, the reliability information stored in the reliability information server 70 may include not only that of visitors who have visited the apartment building 100 in the past but also that of dangerous persons such as wanted criminals and violent offenders.

[0084] [Modification Example] In the above embodiment, it has been described that the process of specifying the reliability of the visitor and the process of updating the reliability of the visitor are performed by the lobby intercom 20. However, these processes may be performed by the control device 40 or the gateway device 50 instead of the lobby intercom 20.

[0085] Also, the process of specifying the reliability of the visitor and the process of updating the reliability of the visitor may be performed by the master intercom 30. In this case, the master intercom 30 can perform the process of specifying the reliability of the visitor and the process of updating the reliability of the visitor not only when an operation for calling is performed on the lobby intercom 20 but also when an operation for calling is performed on the slave intercom 35. In the description of FIG. 2 and the description of the following modification examples, the lobby intercom 20 and the imaging unit 24 may be appropriately read as the slave intercom 35 and the imaging unit 35a.

[0086] [Effects, etc.] Hereinafter, the invention derived from the disclosure of this specification will be exemplified, and the effects and the like obtained from the exemplified invention will be described.

[0087] Invention 1 is an intercom system 80 including an image acquisition unit 22a that acquires a face image of a visitor to the apartment house 100, an extraction unit 22b that extracts first face information from the acquired face image, and an output unit 22c that outputs visitor information for displaying the reliability associated with the second face information corresponding to the first face information by referring to reliability information in which reliability is associated with each of a plurality of second face information for inquiry, and the acquired face image.

[0088] According to such an intercom system 80, since the reliability and the face image can be displayed on the master intercom together, it is possible to present information that serves as a basis for judgment when a resident confirms the identity of a visitor.

[0089] In Invention 2, after the output unit 22c outputs the visitor information, if the visitor is permitted to enter the apartment house 100, the reliability associated with the second face information corresponding to the first face information is increased, and if the visitor's entry into the apartment house 100 is rejected, the reliability associated with the second face information corresponding to the first face information is decreased. This is the intercom system 80 of Invention 1.

[0090] According to such an intercom system 80, the reliability information of the visitor can be updated without the resident performing a specific operation for evaluating the visitor. Specific operations for the resident to evaluate the visitor include, for example, an operation of registering a face image of a visitor who can be trusted in advance, an operation of inputting the attribute information and reliability of the visitor after the response, and the like.

[0091] In Invention 3, when the face information corresponding to the first face information does not exist in the second face information, the output unit 22c adds the first face information as new second face information to the reliability information. This is the intercom system 80 of Invention 1 or 2.

[0092] According to such an intercom system 80, the reliability of a visitor who visits the apartment house 100 for the first time can be registered.

[0093] In Invention 4, the intercom master unit 30 includes a display unit 34 and displays the received visitor information on the display unit 34. This is the intercom system 80 of any one of Inventions 1 to 3.

[0094] According to such an intercom system 80, the resident can visually confirm the reliability of the visitor together with the face image of the visitor.

[0095] In Invention 5, the apartment house 100 includes a plurality of shared entrances, cameras are respectively provided at the plurality of shared entrances, and the plurality of second face information for inquiry includes face information extracted from face images of visitors photographed by the plurality of cameras corresponding to the plurality of shared entrances. This is the intercom system 80 of any one of Inventions 1 to 4.

[0096] According to such an intercom system 80, in an apartment house 100 provided with a plurality of common entrances, even when a visitor who has used a certain common entrance uses another common entrance, the reliability of the visitor can be presented to the resident.

[0097] Invention 6 is the intercom system 80 according to any one of Inventions 1 to 5, wherein the plurality of second face information for inquiry includes the face information of a visitor who has tried to visit any one of the plurality of exclusive parts in the apartment house 100 in the past.

[0098] According to such an intercom system 80, in an apartment house 100 provided with a plurality of exclusive parts, even when a visitor who has visited a certain exclusive part visits another exclusive part, the reliability of the visitor can be presented to the resident.

[0099] Invention 7 is the intercom system 80 according to any one of Inventions 1 to 6, further including an external communication unit that communicates with a reliability information server 70 provided outside the system, wherein the second face information and the reliability information are stored in the reliability information server 70, and the second face information and the reliability information include the face information and the reliability information of a visitor who has tried to visit a house different from the apartment house 100 in the past.

[0100] According to such an intercom system 80, by sharing reliability information among a plurality of housing facilities, even when a visitor who has visited a certain house visits another house, the reliability of the visitor can be presented to the resident.

[0101] Invention 8 is the intercom system 80 according to any one of Inventions 1 to 7, wherein a camera is provided at the common entrance of the apartment house 100, and the image acquisition unit acquires a face image of the visitor captured by the camera.

[0102] According to such an intercom system 80, the visitor information of the visitor who has visited the common entrance can be presented to the resident.

[0103] Invention 9 is an intercom system 80 according to any one of Inventions 1 to 8, in which a camera is provided at the entrance of the exclusive part of the apartment house 100, and the image acquisition unit acquires a face image of a visitor photographed by the camera.

[0104] According to such an intercom system 80, visitor information of a visitor who has visited the exclusive part can be presented to the resident.

[0105] Invention 10 is an intercom system 80 according to any one of Inventions 1 to 9, in which the image acquisition unit 22a, the extraction unit 22b, and the output unit 22c are provided by the lobby intercom 20 provided in the apartment house 100.

[0106] According to such an intercom system 80, the lobby intercom 20 can identify the reliability of the visitor.

[0107] Invention 11 is an intercom system 80 according to any one of Inventions 1 to 9, in which the image acquisition unit, the extraction unit, and the output unit are provided by a control device 40 provided in the apartment house 100, and the control device 40 controls communication between the intercom master unit 30 and the lobby intercom 20 provided in the apartment house 100.

[0108] According to such an intercom system 80, the control device 40 can identify the reliability of the visitor.

[0109] Invention 12 is an intercom system 80 according to any one of Inventions 1 to 9, in which the image acquisition unit, the extraction unit, and the output unit are provided by a gateway device 50 provided in the apartment house 100, and the gateway device 50 is used for the intercom system 80 to connect to the public network 90.

[0110] According to such an intercom system 80, the gateway device 50 can identify the reliability of the visitor.

[0111] The invention 13 is an information processing method executed by an intercom system 80 provided in an apartment house 100, the method including an image acquisition step of acquiring a face image of a visitor to the apartment house 100, an extraction step of extracting first face information from the acquired face image, and an output step of referring to reliability information in which reliability is associated with each of a plurality of pieces of second face information for inquiry, identifying the reliability associated with the second face information corresponding to the first face information, and outputting, to an intercom master unit 30 provided in the apartment house 100, visitor information for displaying the identified reliability and the acquired face image.

[0112] According to such an information processing method, it is possible to present information that serves as a basis for judgment when a resident confirms the identity of a visitor.

[0113] The invention 14 is a program for causing a computer to execute the information processing method of the invention 13.

[0114] According to such a program, a computer can use the intercom system 80 to present information that serves as a basis for judgment when a resident confirms the identity of a visitor.

[0115] As described above, the intercom system, information processing method, and program according to the present invention have been described based on embodiments. However, the present invention is not limited to the embodiments. As long as the gist of the present invention is not deviated from, various modifications conceived by those skilled in the art applied to the embodiments, and other forms constructed by combining some components in the embodiments are also included in the scope of the present invention.

[0116] Also, in the above embodiments, the communication system and the intercom system are realized by one or a plurality of server devices. Thus, the "system" in this specification may be configured by a single device or may be configured by a plurality of devices. When the system is configured by a plurality of devices, the components (particularly, functional components) included in the system may be distributed among the plurality of devices in any manner.

[0117] In addition, the communication method between devices in the above-described embodiment is not particularly limited. Also, in the communication between devices, a relay device (such as a broadband router) not shown may be interposed.

[0118] In the above-described embodiment, the processing executed by a specific processing unit may be executed by another processing unit. Also, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel.

[0119] In the above-described embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0120] Also, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may constitute one circuit as a whole, or may be separate circuits respectively. Also, these circuits may be general-purpose circuits or dedicated circuits respectively.

[0121] Also, the general or specific aspects of the present invention may be realized by a system, a device, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM. Also, the present invention may be realized by any combination of a system, a device, a method, an integrated circuit, a computer program, and a recording medium.

[0122] For example, the present invention may be realized as a method executed by a computer system such as an intercom system for presenting reliability, or may be realized as a program for causing a computer system to execute the method. Also, the present invention may be realized as a computer-readable non-transitory recording medium on which such a program is recorded.

[0123] In addition, forms obtained by applying various modifications that can be conceived by those skilled in the art to each embodiment, or forms realized by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present invention are also included in the present invention.

Explanation of Reference Numerals

[0124] 20 Lobby Intercom 22a Image Acquisition Unit 22b Extraction Unit 22c Output Unit 24 Imaging Unit 30 Intercom Master Unit 34 Display Unit 35a Imaging Unit 40 Control Device 50 Gateway Device 51 Communication Unit (External Communication Unit) 70 Reliability Information Server 80 Intercom System 90 Public Network 100 Apartment Building

Claims

1. An image acquisition unit that acquires a face image of a visitor to an apartment building, An extraction unit that extracts first face information from the acquired face image, By referring to reliability information in which reliability is associated with each of a plurality of second face information for query, the reliability associated with the second face information corresponding to the first face information is specified, and the specified reliability and the acquired face image are output to the master intercom provided in the apartment building for displaying visitor information for display. An output unit, An intercom system.

2. After the output unit outputs the visitor information, When the visitor is permitted to enter the apartment building, the reliability associated with the second face information corresponding to the first face information is increased, When the visitor's entry into the apartment building is rejected, the reliability associated with the second face information corresponding to the first face information is decreased, The intercom system according to claim 1.

3. When there is no face information corresponding to the first face information among the second face information, the output unit adds the first face information as new second face information to the reliability information, The intercom system according to claim 1 or 2.

4. The master intercom includes a display unit, and the received visitor information is displayed on the display unit, The intercom system according to claim 1 or 2.

5. The apartment building includes a plurality of shared entrances, Each of the plurality of shared entrances is provided with a camera, The plurality of second face information for query includes face information extracted from face images of visitors photographed by the plurality of cameras corresponding to the plurality of shared entrances, The intercom system according to claim 1 or 2.

6. The plurality of second face information for query includes face information of visitors who have tried to visit any of a plurality of private parts in the apartment building in the past, The intercom system according to claim 1 or 2.

7. Further includes an external communication unit that communicates with a reliability information server provided outside the system, The second face information and the reliability information are stored in the reliability information server, The second face information and the reliability information include face information and reliability information of visitors who have tried to visit other houses different from the apartment building in the past, The intercom system according to claim 1 or 2.

8. An imaging unit is provided at the shared entrance of the apartment building, The image acquisition unit acquires the face image of the visitor photographed by the imaging unit. The intercom system according to claim 1 or 2.

9. An imaging unit is provided at the entrance of the exclusive part of the apartment building. The image acquisition unit acquires the face image of the visitor photographed by the imaging unit. The intercom system according to claim 1 or 2.

10. The image acquisition unit, the extraction unit, and the output unit are provided by a lobby intercom provided in the apartment building. The intercom system according to claim 1 or 2.

11. The image acquisition unit, the extraction unit, and the output unit are provided by a control device provided in the apartment building. The control device controls communication between the intercom master unit and a lobby intercom provided in the apartment building. The intercom system according to claim 1 or 2.

12. The image acquisition unit, the extraction unit, and the output unit are provided by a gateway device provided in the apartment building. The gateway device is used for the intercom system to connect to a public network. The intercom system according to claim 1 or 2.

13. An information processing method executed by an intercom system provided in an apartment building, an image acquisition step of acquiring a face image of a visitor to the apartment building, an extraction step of extracting first face information from the acquired face image, by referring to reliability information in which reliability is associated with each of a plurality of pieces of second face information for query, specifying the reliability associated with the second face information corresponding to the first face information, and outputting visitor information for displaying the specified reliability and the acquired face image to an intercom master unit provided in the apartment building. Information processing method.

14. A program for causing a computer to execute the information processing method according to claim 13.

Images