Intercom base unit and intercom system

Abstract

To provide an intercom base unit and an intercom system that can appropriately perform the necessary suspicious person identification.SOLUTION: In an intercom system, a control unit 21 of an intercom master unit 2 includes a person detection unit 21a that detects people included in a detected image captured by a camera 34 of an intercom slave unit 3, a face detection unit 21b that detects facial information related to the faces of people included in the detected image, and a person determination unit 21c that stores the facial information and the number of times each piece of facial information is detected in a memory unit 22, determines whether any of the facial information stored in the memory unit matches the facial information of the person included in the detected image, and determines whether the person is a suspicious person on the basis of the number of times each facial image is detected within a detection period.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an intercom master unit and an intercom system. [Background technology]

[0002] 2. Description of the Related Art There is known an intercom system that enhances security by using a camera that starts capturing an image of a person visiting a house when the person presses a call button on an intercom slave unit.

[0003] The intercom system described in Patent Document 1 acquires the characteristics of a person captured by a camera, determines whether the person is suspicious based on the acquired characteristics, and if it determines that the person is suspicious, issues an alarm. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-272819 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the intercom system described in Patent Document 1, all people captured by the camera are judged to be suspicious, which means that even family members, acquaintances, etc. who would not normally be considered suspicious may be judged to be suspicious, which could result in unnecessary suspicious person judgments.

[0006] Non-limiting examples of the present disclosure contribute to providing an intercom master unit and an intercom system that can appropriately perform the necessary suspicious person determination. [Means for solving the problem]

[0007] An intercom master unit according to one embodiment of the present disclosure includes a person detection unit that detects a person included in a detection image captured by a camera possessed by an intercom slave unit, a face detection unit that detects facial information regarding the face of the person included in the detection image, and a person determination unit that stores the facial information and the number of times each piece of facial information is detected in a memory unit, determines whether any of the facial information stored in the memory unit matches the facial information of the person included in the detection image, and determines whether the person is a suspicious person based on the number of times each face image is detected within a detection period.

[0008] An intercom system according to one embodiment of the present disclosure is an intercom system comprising an intercom master unit and an intercom slave unit, wherein the intercom master unit comprises a person detection unit that detects a person included in a detection image captured by a camera possessed by the intercom slave unit, a face detection unit that detects facial information relating to the face of the person included in the detection image, and a person determination unit that stores the facial information and the number of times each piece of facial information is detected in a memory unit, determines whether any of the facial information stored in the memory unit matches the facial information of the person included in the detection image, and determines whether the person is a suspicious person based on the number of times each facial image is detected within a detection period.

[0009] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. [Effects of the Invention]

[0010] According to an embodiment of the present disclosure, it is possible to provide an intercom master unit and an intercom system that can appropriately perform the necessary suspicious person determination.

[0011] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and / or benefits may be provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of them may be provided to obtain one or more identical features. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an intercom system according to an embodiment; [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of a parent device and a child device according to an embodiment; [Figure 3] FIG. 10 is a diagram showing a first example of suspicious person determination according to an embodiment; [Figure 4] FIG. 10 is a diagram showing a second example of suspicious person determination according to an embodiment. [Figure 5] FIG. 10 is a diagram showing a third example of suspicious person determination according to an embodiment. [Figure 6] FIG. 1 is a diagram showing an example of a whitelist according to an embodiment; [Figure 7] FIG. 1 is a diagram showing an example of a blacklist according to an embodiment; [Figure 8] 10 is a flowchart showing an example of the operation of the master unit in determining a suspicious person according to an embodiment. [Figure 9] 1 is a flowchart showing an example of creating a whitelist and a blacklist according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or redundant explanation of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0014] The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] <System configuration> The configuration of an intercom system 1 will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an intercom system 1 according to an embodiment. The intercom system 1 has a base unit 2 and a handset 3.

[0016] Base unit 2 is installed inside (inside) house A in a living room, kitchen, etc. Handset 3 is installed outside house A near the entrance.

[0017] The base unit 2 communicates with the slave unit 3 by wire or wirelessly. For example, as shown in Fig. 1, the base unit 2 may be configured to be communicably connected to the slave unit 3 via a signal line L1.

[0018] A visitor (person P) to house A operates handset 3 installed outside the house to call a resident (user U) inside the house. The visitor uses handset 3, and the resident uses base unit 2, and the visitor talks to the resident.

[0019] For example, when person P, a visitor, presses the call button 35 of the slave unit 3, the camera 34 starts capturing an image of person P. The master unit 2 displays the image of person P captured by the camera 34. The resident checks the image of person P displayed on the master unit 2. The captured image data is also saved in the master unit 2.

[0020] Furthermore, the person P captured by the camera 34 is not limited to a visitor to the house A. The person P may also be a suspicious person attempting to burgle the house A, a wandering elderly person, a missing person, a wanted person, or any other person who is the subject of a search or investigation.

[0021] The data captured by the camera 34 is stored in the base unit 2. The base unit 2 refers to the stored data and determines whether or not the person P is a suspicious person. If the base unit 2 determines that the person P is a suspicious person, the base unit 2 notifies the resident that a suspicious person has been detected.

[0022] <Block configuration> The block configuration of the base unit 2 and the slave unit 3 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the block configuration of the base unit 2 and the slave unit 3 according to the embodiment.

[0023] Block configuration of base unit 2 The block configuration of the base unit 2 will be described with reference to Fig. 2. As shown in Fig. 2, the base unit 2 has a control unit 21, a storage unit 22, a handset communication I / F unit 23, an audio signal control unit 24, a microphone 24a, a speaker 24b, an audio signal bus 25, a display unit 26, a short-range wireless control unit 27, a wireless LAN communication I / F unit 27a, a wireless LAN communication unit 27b, and a wired LAN communication I / F unit 28.

[0024] The control unit 21 controls the overall operation of the base unit 2. The control unit 21 may be configured, for example, by a CPU (Central Processing Unit).

[0025] The control unit 21 includes a person detection unit 21a, a face detection unit 21b, and a person determination unit 21c.

[0026] The person detection unit 21a detects a person captured by the camera 34 of the slave unit 3. A detected image (video frame) including the detected person is stored in the storage unit 22. For example, in response to a person (such as a visitor to the house) pressing the call button 35, the camera 34 starts capturing an image of the person. The detected image acquired by the camera 34 is stored, for example, in the ROM 22a constituting the storage unit 22.

[0027] The person detection unit 21a may also be configured to use a human presence sensor. For example, the person detection unit 21a detects a person by sensing heat emitted by a human body in a predetermined detection area. The person detection unit 21a may also be configured to use a motion detection sensor. For example, the person detection unit 21a detects a person by sensing that something has moved in a predetermined detection area. The person detection unit 21a may also be configured to use a voice recognition sensor. For example, the person detection unit 21a detects a person by recognizing a specific keyword or phrase.

[0028] The face detection unit 21b detects and acquires face information related to the facial features of people included in the detected image. The face information is stored in the ROM 22a that constitutes the storage unit 22. For example, the face detection unit 21b uses an existing face recognition technology to detect the faces of people included in the detected image and acquire the face information of the people. The acquired face information is stored in association with the date and time of acquisition for each piece of face information.

[0029] The person determination unit 21c performs image authentication processing to compare a person included in a detected image stored in the storage unit 22 with a person captured by the camera 34 and determine whether they are the same person. For example, the person determination unit 21c determines whether they are the same person based on whether the facial information of the person captured by the camera 34 is similar to the facial information of the person stored in the storage unit 22. Note that the determination of whether they are the same person may be performed based on various information other than facial information, such as clothing color information, depending on the required accuracy of determination.

[0030] The person determination unit 21c stores face information and the number of times each face information is detected in the memory unit 22, determines whether any of the face information stored in the memory unit 22 matches the face information of a person included in the detected image, and determines whether the person is a suspicious person based on the number of times each face image is detected within the detection period.

[0031] The storage unit 22 includes a ROM 22a and a RAM 22b.

[0032] The ROM 22a is a read-only memory, and stores, for example, programs and firmware necessary for the operation of the control unit 21. The data stored in the ROM 22a is generally not erased even when the power to the parent device 2 is turned off, and therefore the ROM 22a stores data that is not normally changed. The ROM 22a may also be configured as a flash ROM, and the data stored in the ROM 22a may be rewritable.

[0033] The RAM 22b is a readable and writable memory, and stores, for example, temporary data necessary for the operation of the control unit 21, information currently being processed, etc. The data stored in the RAM 22a is generally lost when the power to the base unit 2 is turned off. The RAM 22a stores data for calculation processes executed by the control unit 21 and other temporary data for controlling various hardware components.

[0034] The handset communication I / F unit 23 is an interface that communicatively connects the base unit 2 and the handset 3. The base unit 2 communicatively connected to the handset 3 via the handset communication I / F unit 23 becomes capable of making and receiving calls with the handset 3.

[0035] The audio signal control unit 24 is electrically connected to the control unit 21, the microphone 24a, and the speaker 24b. The audio input to the microphone 24a is converted into analog audio data by the audio signal control unit 24. The speaker 24b outputs sound based on the analog audio data output from the audio signal control unit 24.

[0036] The audio signal bus 25 functions as a path for sending audio signals to the control unit 21. The control unit 21 processes the audio signals input via the audio signal bus 25. For example, the control unit 21 uses the audio signals to perform voice recognition, provide an intercom function, and store call data in the memory unit 22.

[0037] Display unit 26 displays an image based on the digital image data output from control unit 21. Display unit 26 may be a touch panel type liquid crystal display device. Display unit 26 is a user interface for displaying the status of intercom system 1 and accepting operations of base unit 2. For example, a resident can operate base unit 2 while checking the image of the visitor displayed on display unit 26 to start a call with the visitor.

[0038] The short-range wireless control unit 27 controls the wireless LAN communication I / F unit 27a. The short-range wireless control unit 27 controls wireless communication between the base unit 2 and devices with wireless communication functions that are located in a short distance from the base unit 2. For example, the short-range wireless control unit 27 controls wireless communication between an app on a smartphone in a room and the base unit 2. At that time, the base unit 2 may notify the smartphone of information about a visitor who has come to visit.

[0039] Furthermore, when the base unit 2 and the handset 3 are connected via wireless communication, the short-distance wireless control unit 27 may be configured to control the wireless communication between the base unit 2 and the handset 3.

[0040] The wireless LAN communication I / F unit 27a is an interface that connects the base unit 2 and a device having a wireless communication function so that they can communicate with each other.

[0041] The wireless LAN communication unit 27b performs wireless communication in accordance with a communication standard such as Wi-Fi (registered trademark).

[0042] The wired LAN communication I / F unit 28 is an interface that communicatively connects the master unit 2 with a device having a wired communication function. For example, the master unit 2 can be communicatively connected to a device outside the house A via the Internet 100.

[0043] Block configuration of handset 3 The block configuration of the handset 3 will be described with reference to Fig. 2. As shown in Fig. 2, the handset 3 has a control unit 31, a storage unit 32, a base unit communication I / F unit 33, a camera 34, a call button 35, a microphone 36, and a speaker 37.

[0044] The control unit 31 controls the overall operation of the slave unit 3. For example, the control unit 31 controls the transmission of a detected image captured by the camera 34 to the master unit 2.

[0045] The storage unit 32 includes a ROM 32a and a RAM 32b.

[0046] The ROM 32a is a read-only memory, and stores, for example, programs and firmware required for the operation of the control unit 31. The data stored in the ROM 32a is generally not erased even when the power to the slave unit 3 is turned off, and therefore the ROM 32a stores data that is not normally changed. The ROM 32a may also be configured as a flash ROM, and the data stored in the ROM 32a may be rewritable.

[0047] The RAM 32b is a readable and writable memory, and stores, for example, temporary data necessary for the operation of the control unit 31, information currently being processed, etc. The data stored in the RAM 32a is generally lost when the power to the slave unit 3 is turned off. The RAM 32a stores data for the calculation process executed by the control unit 31 and other temporary data for controlling various hardware components.

[0048] The base unit communication I / F unit 33 is an interface that communicatively connects the handset 3 and the base unit 2. The handset 3 communicatively connected to the base unit 2 via the base unit communication I / F unit 33 becomes capable of making and receiving calls with the base unit 2.

[0049] Camera 34 captures an image of the vicinity of the entrance of house A. As described above, camera 34 may be configured with a human sensor, and when a person is detected in a predetermined detection area, camera 34 starts capturing an image of the person.

[0050] Call button 35 is pressed, for example, by a visitor outside the home. Based on the operation of this call button 35, control unit 31 controls camera 34 to capture an image of the outside of the home. The image captured by camera 34 is displayed, for example, on display unit 26 of base unit 2.

[0051] Furthermore, when a visitor presses the call button 35, the control unit 31 controls the microphone 36 and the speaker 37. The voice input to the microphone 36 is output from the speaker 24b of the base unit 2. The speaker 37 outputs the voice input to the microphone 24a of the base unit 2.

[0052] <Suspicious person determination> In the embodiment, when the number of times that face information of a person included in the detected image captured by the camera 34 is detected is equal to or exceeds a predetermined number of times within a detection period set by the resident, the base unit 2 determines that the person is a suspicious person. First to third examples of suspicious person determination are shown below.

[0053] First example of suspicious person detection A first example of determining a suspicious person will be described with reference to Fig. 3. Fig. 3 is a diagram showing a first example of determining a suspicious person according to an embodiment.

[0054] In this example, the resident sets a one-week detection period starting on November 10, 2023. If the same person visits House A three times during the detection period, the control unit 21 (person determination unit 21c) of the base unit 2 determines that the person is a suspicious person.

[0055] At 11:00 on November 10, 2023, person P1 visits house A. Assume that person P1 is a person who is not acquainted with the residents. When person P1 presses call button 35, or when person PI enters a predetermined detection area of ​​house A, camera 34 starts capturing images. The image captured by camera 34 is displayed on display unit 26 of base unit 2.

[0056] The person detection unit 21a detects person P1 included in the video frame F11 (detected image) captured by the camera 34. The face detection unit 21b detects the face of person P1 detected by the person detection unit 21a and acquires face information related to the facial features of person P1. The face information of person P1 acquired by the face detection unit 21b is linked to the number of times of detection and the date and time of acquisition, and is stored in ROM 22a constituting the storage unit 22.

[0057] The person determination unit 21c determines whether or not the person P1 is a suspicious person based on the number of times the face information of the person P1 has been detected. Since the person P1 was detected this time only once within the one-week detection period set by the resident, the person determination unit 21c determines that the person P1 is not a suspicious person. The base unit 2 stores the number of times the face information of the person P1 has been detected.

[0058] At 11:30 on November 11, 2023, person P1 visits house A. In this example, this is the second visit. Based on the number of times that the facial information of person P1 contained in video frame F12 is detected, person determination unit 21c determines whether person P1 is a suspicious person. Since the facial information of person P1 detected this time has been detected twice during the detection period, person determination unit 21c determines that person P1 is not a suspicious person. Base unit 2 stores the number of times that the facial information of person P1 has been detected.

[0059] At 3:00 p.m. on November 15, 2023, person P1 visits house A. In this example, this is the third visit. Based on the number of times that the facial information of person P1 contained in video frame F13 has been detected, person determination unit 21c determines whether person P1 is a suspicious person. Since the number of times that the facial information of person P1 detected this time has been detected is three during the detection period, person determination unit 21c determines that person P1 is a suspicious person. Base unit 2 issues an alarm. Base unit 2 also erases the number of times that person P1 has been detected and the facial information stored in memory unit 22.

[0060] An alarm may be issued, for example, by the parent unit 2 displaying and notifying on the display 26 of the parent unit 2 that a suspicious person has been detected, by the parent unit 2 sounding an alarm from the speaker 37 of the child unit 3, or by the parent unit 2 notifying the police station, security company, and communication terminals owned by the residents of house A that a suspicious person has been detected.

[0061] Second example of suspicious person detection A second example of determining a suspicious person will be described with reference to Fig. 4. Fig. 4 is a diagram showing a second example of determining a suspicious person according to an embodiment.

[0062] In this example, the resident sets a one-week first detection period on November 10, 2023. The resident resets the first detection period setting on November 17, 2023, and sets a one-week second detection period. If the same person visits house A three times during the first or second detection period, the control unit 21 (person determination unit 21c) of the base unit 2 determines that the person is a suspicious person.

[0063] Person P2 visits house A at 11:00 on November 10, 2023. In this example, this is the first visit. Based on the number of times the facial information of person P2 contained in video frame F21 has been detected, person determination unit 21c determines whether person P2 is a suspicious person. Since the number of times the facial information of person P2 detected this time has been detected is one in the first detection period, person determination unit 21c determines that person P2 is not a suspicious person. Base unit 2 stores the number of times the facial information of person P2 has been detected.

[0064] Person P2 visits house A at 11:30 on November 11, 2023. In this example, this is the second visit. Based on the number of times that the facial information of person P2 contained in video frame F22 has been detected, person determination unit 21c determines whether person P2 is a suspicious person. Since the number of times that the facial information of person P2 detected this time has been detected is two during the first detection period, person determination unit 21c determines that person P2 is not a suspicious person. Base unit 2 stores the number of times that the facial information of person P2 has been detected.

[0065] After this, the resident resets the alert (first detection period) setting to November 17, 2023, and sets a second detection period of one week. Base unit 2 resets the number of times the face information of person P2 has been detected.

[0066] After the resident sets the second detection period, person P2 visits house A at 3:00 p.m. on November 18, 2023. In this example, this is his third visit. Based on the number of times that the facial information of person P2 included in video frame F23 is detected, person determination unit 21c determines whether person P2 is a suspicious person.

[0067] This is person P2's third visit, but the number of visits during the second detection period is one. Therefore, person determination unit 21c determines that person P2 is not a suspicious person. Base unit 2 stores the number of times that face information of person P2 has been detected.

[0068] Person P2 visits house A at 11:30 on November 19, 2023. In this example, this is the fourth visit. Based on the number of times that the facial information of person P2 contained in video frame F24 has been detected, person determination unit 21c determines whether person P2 is a suspicious person. Since the number of times that the facial information of person P2 detected this time has been detected is two in the second detection period, person determination unit 21c determines that person P2 is not a suspicious person. Base unit 2 stores the number of times that the facial information of person P2 has been detected.

[0069] At 3:00 p.m. on November 22, 2023, person P2 visits house A. In this example, this is the fifth visit. Based on the number of times that the facial information of person P2 contained in video frame F25 has been detected, person determination unit 21c determines whether person P2 is a suspicious person. Since the number of times that the facial information of person P2 detected this time has been detected is three times during the second detection period, person determination unit 21c determines that person P2 is a suspicious person. Base unit 2 issues an alarm. Base unit 2 also erases the number of times that person P2 has been detected and the facial information stored in memory unit 22.

[0070] Third example of suspicious person detection A third example of determining a suspicious person will be described with reference to Fig. 5. Fig. 5 is a diagram showing a third example of determining a suspicious person according to an embodiment.

[0071] In this example, the resident sets a one-week detection period on November 10, 2023. If the same person visits House A three times within the one-week detection period, the control unit 21 (person determination unit 21c) of the base unit 2 determines that the person is a suspicious person.

[0072] Person P2 visits house A at 11:00 on November 10, 2023. In this example, this is the first visit. Based on the number of times the facial information of person P3 contained in video frame F31 has been detected, person determination unit 21c determines whether person P3 is a suspicious person. Since the facial information of person P3 detected this time has been detected once during the detection period, person determination unit 21c determines that person P3 is not a suspicious person. Base unit 2 stores the number of times the facial information of person P3 has been detected.

[0073] Person P3 visits house A at 11:30 on November 11, 2023. In this example, this is the third visit. Based on the number of times the facial information of person P3 contained in video frame F32 has been detected, person determination unit 21c determines whether person P3 is a suspicious person. Since the facial information of person P3 detected this time has been detected twice during the detection period, person determination unit 21c determines that person P3 is not a suspicious person. Base unit 2 stores the number of times the facial information of person P3 has been detected.

[0074] Person P3 visits house A at 3:00 p.m. on November 11, 2023. In this example, this is the third visit. Based on the number of times the facial information of person P3 contained in video frame F33 has been detected, person determination unit 21c determines whether person P3 is a suspicious person. Since the number of times the facial information of person P3 detected this time has been detected is three times during the detection period, person determination unit 21c determines that person P3 is a suspicious person. Base unit 2 issues an alarm. Base unit 2 also erases the number of times the facial information of person P3 has been detected and the facial information stored in memory unit 22.

[0075] Person P3 visits house A at 11:30 on November 12, 2023. In this example, this is the fourth visit. Based on the number of times that the facial information of person P3 contained in video frame F34 has been detected, the person determination unit 21c determines whether person P3 is a suspicious person. The number of times that the facial information of person P3 detected this time has been detected is four during the detection period. However, person P3 was determined to be a suspicious person during his third visit, and the number of times that person P3 was detected and his facial information have been erased. For this reason, this is person P3's first visit. Therefore, the person determination unit 21c determines that person P3 is not a suspicious person. The base unit 2 stores the number of times that the facial information of person P3 has been detected.

[0076] Person P3 visits house A at 3:00 p.m. on November 12, 2023. In this example, this is the fifth visit. Based on the number of times that the facial information of person P3 contained in video frame F35 has been detected, person determination unit 21c determines whether person P3 is a suspicious person. Since the facial information of person P3 detected this time has been detected twice during the detection period, person determination unit 21c determines that person P3 is not a suspicious person. Base unit 2 stores the number of times that the facial information of person P3 has been detected.

[0077] Person P3 visits house A on November 15, 2023. In this example, this is the sixth visit. Based on the number of times that the facial information of person P3 contained in video frame F36 has been detected, person determination unit 21c determines whether person P3 is a suspicious person. Since the number of times that the facial information of person P3 detected this time has been detected is three times during the detection period, person determination unit 21c determines that person P3 is a suspicious person. Base unit 2 issues an alarm. Base unit 2 also erases the number of times that person P3 has been detected and the facial information stored in memory unit 22.

[0078] For example, if the persons P1, P2, and P3 determined to be suspicious as described above are attempting to burgle house A, the suspicious person may check what time house A is unoccupied. If there is no one in house A when the suspicious person attempts to burgle, the suspicious person can freely search house A without being found by anyone, ensuring time for the suspicious person to escape safely.

[0079] In this way, the base unit 2 determines that a person who repeatedly visits the residence A during the hours when the residence A is empty is a suspicious person, and issues an alarm, thereby preventing burglary.

[0080] <Whitelist> The whitelist will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the whitelist according to the embodiment.

[0081] The whitelist is a list created by a resident (user U). If a person P registered on the whitelist is included in the detected image, the control unit 21 (person determination unit 21c) of the parent device 2 excludes the person P from the list of people to be determined as suspicious persons.

[0082] The resident operates the base unit 2 to display the recording list screen on the display unit 26. The recording list displays a list of recording data captured by the camera 34. Each recording data contains a record of a visitor to the house A.

[0083] For example, the resident selects data number 1 (8:00 a.m., November 10, 2023) from the list of recorded data and plays back the video of the recorded data. The resident checks person P who appears in the played back video. If the resident determines that person P is a family member or acquaintance, or someone the resident knows, and is not a target for determining whether or not they are suspicious, the resident operates base unit 2 to mark person P and register them on the whitelist.

[0084] The whitelist also includes facial information of the registered person P. If facial information newly detected by the face detection unit 21b matches facial information of any person registered on the whitelist, the person determination unit 21c determines that the person is not a suspicious person regardless of the number of times the person has been detected. Furthermore, the person determination unit 21c may be configured not to determine that a person registered on the whitelist is a suspicious person.

[0085] A marked person P may be configured not to be removed from the whitelist. To remove a person P from the whitelist, a resident must first unmark the person P and then remove the person P from the whitelist.

[0086] To mark a person, the resident touches the display unit 26 with a finger when the person appears in the video being played. To remove the marking, the resident touches the display unit 26 with a finger when the marked person appears in the video being played.

[0087] <Blacklist> The blacklist will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the blacklist according to the embodiment.

[0088] The blacklist is a list created by a resident. If a person P registered on the blacklist is included in the detected image, the control unit 21 (person determination unit 21c) of the base unit 2 determines that the person P is a suspicious person.

[0089] The resident operates the base unit 2 to display the recording list screen on the display unit 26. The recording list displays a list of recording data captured by the camera 34. Each recording data contains a record of a visitor to the house A.

[0090] The resident selects data number 1 (8:00 a.m., November 10, 2023) from the list of recorded data and plays back the video of the recorded data. The resident checks person P who appears in the played back video. If person P is a person the resident does not know, a person who has been determined to be suspicious in the past, or a person who user U suspects to be suspicious, and the resident determines that person P is a person to be determined to be suspicious or not, the resident operates base unit 2 to mark person P, and person P is registered on the blacklist.

[0091] The blacklist also includes facial information of the registered person P. If facial information newly detected by the face detection unit 21b matches the facial information of any person registered on the blacklist, the person determination unit 21c determines that the person is a suspicious person, regardless of the number of times the person has been detected.

[0092] A marked person P may be configured not to be removed from the blacklist. To remove a person P from the whitelist, a resident must first unmark the person P and then remove the person P from the blacklist.

[0093] <Suspicious person detection operation> The suspicious person determination operation will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the operation of the base unit 2 in determining a suspicious person according to the embodiment. This flow starts when the person detection unit 21a of the base unit 2 detects a person P.

[0094] The master unit 2 acquires facial information of the person P included in the detected image (S1). The master unit 2 determines whether the acquired facial information of the person P is registered in a blacklist (S2).

[0095] If the parent unit 2 determines that the facial information of person P is registered on the blacklist (YES in S2), the parent unit 2 determines that person P is a suspicious person, issues an alarm (S3), and this flow ends.

[0096] If the parent device 2 determines that the facial information of person P is not registered on the blacklist (NO in S2), the parent device 2 determines whether the acquired facial information of person P is registered on the whitelist (S4).

[0097] If the parent device 2 determines that the facial information of person P is registered on the whitelist (YES in S4), the parent device 2 determines that person P is not a suspicious person, and this flow ends. Also, the parent device 2 may be configured not to perform a suspicious person determination on person P (to exclude person P from the suspicious person determination).

[0098] If the parent unit 2 determines that the facial information of person P is not registered on the whitelist (NO in S4), the parent unit 2 determines whether the acquired facial information of person P is stored in the memory unit 22 of the parent unit 2 (S5).

[0099] If the parent unit 2 determines that the facial information of person P is not stored in the memory unit 22 (NO in S5), the parent unit 2 stores the facial information of person P in the memory unit 22 (S6), and the parent unit 2 stores the number of times that the facial information of person P has been detected in the memory unit 22 (S12), and this flow ends.

[0100] If the base unit 2 determines that the face information of person P is not stored in the storage unit 22 (YES in S5), the base unit 2 determines whether or not it is within the detection period (S7).

[0101] If the parent device 2 determines that it is not the detection period (NO in S7), it resets the number of detections (S8), and the parent device 2 stores the number of times that the face information of person P has been detected in the memory unit 22 (S12), and this flow ends.

[0102] If the parent unit 2 determines that it is the detection period (YES in S7), the parent unit 2 determines whether the number of times that the facial information of person P has been detected is equal to or greater than a predetermined number (S9). If the parent unit 2 determines that the number of times that the facial information of person P has been detected is not equal to or greater than the predetermined number (NO in S9), the parent unit 2 stores the number of times that the facial information of person P has been detected in the storage unit 22 (S12), and this flow ends.

[0103] If the parent unit 2 determines that the number of times that the facial information of person P1 has been detected is greater than or equal to a predetermined number (YES in S9), the parent unit 2 determines that person P is a suspicious person, issues an alarm (S10), resets the number of detections stored in the memory unit 22, and erases the facial information of person P (S11), and this flow ends.

[0104] <Creating blacklists and whitelists> The creation of a whitelist and a blacklist will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the creation of a whitelist and a blacklist according to an embodiment. This flow starts when a resident (user U) selects recorded data to be played back from the list of recorded data displayed on the display unit 26 and playback of the selected recorded data begins.

[0105] The resident determines whether or not the face of person P shown in the reproduced video can be recognized (S21). If the resident determines that the face of person P shown in the reproduced video cannot be recognized (NO in S21), this flow ends.

[0106] If the resident determines that he or she can recognize the face of person P appearing in the reproduced video (YES in S21), the resident determines whether or not person P appearing in the reproduced video is someone the resident knows (S22).

[0107] If the resident determines that person P in the playback video is someone the resident knows (YES in S22), the resident decides whether or not to mark person P as a family member or acquaintance (S23). If the resident determines not to mark person P as a family member or acquaintance (NO in S23), this flow ends.

[0108] If the resident decides to mark person P as a family member or acquaintance (YES in S23), the resident marks person P (S24) and registers person P on the whitelist (S25), and this flow ends.

[0109] If the resident determines that the person P in the playback video is not someone the resident knows (NO in S22), the resident decides whether or not to mark the person P as a suspicious person (S26). If the resident determines not to mark the person P as a suspicious person (NO in S26), this flow ends.

[0110] If the resident decides to mark person P as a suspicious person (YES in S26), the resident marks person P (S27) and registers person P on a blacklist (S28), and this flow ends.

[0111] With this configuration, residents can view the playback video and decide which people they can trust (register on the whitelist) or should be wary of (register on the blacklist), and register that information in the system. This narrows down the people who are subject to suspicious person detection, allowing base unit 2 to perform suspicious person detection more accurately and quickly.

[0112] <Summary of the embodiment> As described above, the intercom master unit of this embodiment comprises a person detection unit that detects people included in a detection image captured by a camera possessed by the intercom slave unit, a face detection unit that detects facial information related to the faces of people included in the detection image, and a person determination unit that stores the facial information and the number of times each piece of facial information is detected in a memory unit, determines whether any of the facial information stored in the memory unit matches the facial information of the person included in the detection image, and determines whether the person is a suspicious person based on the number of times each face image is detected within a detection period.

[0113] With this configuration, if the base unit 2 determines that the person P is a suspicious person, the base unit 2 issues an alarm, thereby preventing fraudulent acts before they occur.

[0114] The base unit 2 has a function that allows it to reset the detection period, which enables the base unit 2 to perform continuous monitoring and determine whether or not a suspicious person is present depending on the situation.

[0115] Base unit 2 can quickly identify suspicious individuals who repeatedly visit residence A and issue notifications and alarms to prevent crimes such as burglary.

[0116] The present embodiment is not limited to the intercom system 1, but can also be applied to, for example, a security system having a surveillance camera or a security camera. A security system to which the present embodiment is applied can be used as a suspicious person determination device that determines suspicious persons.

[0117] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims. It is understood that such modifications or alterations also fall within the technical scope of the present disclosure. Furthermore, the components in the embodiments may be combined in any manner without departing from the spirit of the present disclosure.

[0118] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuitry," "... assembly," "... device," "... unit," or "... module."

[0119] The present disclosure can be realized by software, hardware, or software linked to hardware. Each functional block used in the description of the above embodiments may be partially or entirely realized as an LSI, which is an integrated circuit, and each process described in the above embodiments may be partially or entirely controlled by a single LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of a single chip that includes some or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may be called an IC, system LSI, super LSI, or ultra LSI.

[0120] The integrated circuit method is not limited to LSI, but may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, a field programmable gate array (FPGA) that can be programmed after LSI manufacturing, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells within the LSI, may be used. The present disclosure may be realized as digital processing or analog processing.

[0121] Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology or other derivative technologies, it is natural that such technology may be used to integrate functional blocks. The application of biotechnology, etc. is also a possibility. [Industrial Applicability]

[0122] The present disclosure is useful as an intercom master unit and an intercom system. [Explanation of symbols]

[0123] 1. Intercom System 2 Base unit 3 Handsets 21 Control section 21a Person detection unit 21b Face detection unit 21c Person recognition section 22 Memory section 34 Camera 35 Call button

Claims

1. a person detection unit that detects a person included in a detected image captured by a camera included in the intercom slave; a face detection unit that detects face information relating to a face of a person included in the detected image; An intercom base unit having a person determination unit that stores the face information and the number of times each piece of face information is detected in a memory unit, determines whether any of the face information stored in the memory unit matches the face information of a person included in the detected image, and determines whether the person is a suspicious person based on the number of times each face image is detected within a detection period.

2. the person determination unit determines that a person whose number of detections within the detection period is equal to or greater than a predetermined number is a suspicious person; The intercom master unit according to claim 1.

3. If the face information is acquired outside the detection period, resetting the number of detections; The intercom master unit according to claim 1.

4. When face information newly detected by the face detection unit matches face information of any person registered on a blacklist, the person determination unit determines the person to be a suspicious person regardless of the number of times of detection. The intercom master unit according to claim 1.

5. When face information newly detected by the face detection unit matches face information of any person registered in a whitelist, the person determination unit excludes the person from being determined as a suspicious person regardless of the number of times the person has been detected. The intercom master unit according to claim 1.

6. An intercom system including an intercom master unit and an intercom slave unit, The intercom master unit is a person detection unit that detects a person included in a detected image captured by a camera included in the intercom slave; a face detection unit that detects face information relating to a face of a person included in the detected image; a person determination unit that stores the face information and the number of times each piece of face information is detected in a storage unit, determines whether any of the face information stored in the storage unit matches face information of a person included in the detected image, and determines whether the person is a suspicious person based on the number of times each face image is detected within a detection period; Intercom system.

Images