Notification system, notification method, and program

Abstract

To produce contents that enhance the degree of attention to notification information and are suitable for a target person to which the notification information is provided.SOLUTION: A notification system comprises: a processing unit 170; an action detection unit 172; and a notification output unit 176. The processing unit 170 determines an attribute of a person who moves in a shared area of a facility on the basis of a captured image of persons who move in the shared area. The action detection unit 172 detects an action of the person who moves in the shared area on the basis of the captured image. The notification output unit 176 provides notification information corresponding to at least one of a determination result of the processing unit 170 and a detection result of the action detection unit 172.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure generally relates to a notification system, a notification method, and a program, and more particularly to a notification system, a notification method, and a program for notifying visitors to a facility.

Background Art

[0002] Patent Document 1 describes a regional information providing system that inputs regional information provided from a regional information provider, which is a source of regional information in the vicinity of an apartment building, into a server device and displays the regional information in the vicinity of the apartment building on a display unit installed in a common area of the apartment building.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a regional information providing system as described in Patent Document 1, when the same information (notification information) is repeatedly displayed on the display unit, there is a problem that the attention level to the notification information decreases.

[0005] In view of the above problems, the present disclosure aims to provide a notification system, a notification method, and a program that can increase the attention level to notification information and further make the content of the notification information suitable for the target person to whom the notification information is to be notified.

Means for Solving the Problems

[0006] A notification system according to one aspect of the present disclosure includes a processing unit that determines an attribute of a person based on a captured image of a person moving in a shared area of a facility, an action detection unit that detects an action of the person based on the captured image, and a notification output unit that notifies the person of notification information according to at least one of a determination result of the processing unit and a detection result of the action detection unit.

[0007] A notification method according to one aspect of the present disclosure includes a processing step of determining an attribute of a person based on a captured image of a person moving in a shared area of a facility, an action detection step of detecting an action of the person based on the captured image, and a notification output step of notifying the person of notification information according to at least one of a determination result in the processing step and a detection result in the action detection step.

[0008] A program according to one aspect of the present disclosure is a program for causing one or more processors to execute the notification method.

Advantages of the Invention

[0009] According to the present disclosure, the attention level to the notification information can be increased, and further, the content can be made suitable for the target person to whom the notification information is notified.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

[0011] The notification system 100 according to an embodiment of the present disclosure will be described in detail with reference to the drawings. Note that the embodiments and modifications described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modifications. Even outside of these embodiments and modifications, various changes can be made according to the design and the like as long as the technical idea of the present disclosure is not deviated from. Also, the following embodiments (including modifications) may be realized in appropriate combinations.

[0012] (1) Overview The notification system 100 according to the present embodiment is a notification system applied to the shared area AR0 of the facility F1.

[0013] As shown in FIGS. 1 and 2, the notification system 100 includes a processing unit 170, a motion detection unit 172, and a notification output unit 176.

[0014] The processing unit 170 determines the attributes of a person moving within the shared area AR0 based on a captured image of a person moving within the shared area AR0 of the facility F1.

[0015] The motion detection unit 172 detects the motion of a person moving within the shared area AR0 based on the captured image.

[0016] The notification output unit 176 notifies a person moving within the shared unit AR0 of notification information corresponding to at least one of the determination result of the processing unit 170 and the detection result of the motion detection unit 172.

[0017] According to the above configuration, in order to change the notification information notified to a person moving within the shared unit AR0 according to at least one of the determination result of the processing unit 170 and the detection result of the motion detection unit 172, it is possible to notify more useful notification information to the person moving within the shared unit AR0, and the degree of attention to the notification information can be increased. Further, thereby, the content can be made suitable for the person (target person) to whom the notification information is to be notified.

[0018] (2) Details Hereinafter, the details of the notification system 100 will be described with reference to the drawings.

[0019] (2.1) Overall configuration In this embodiment, it is assumed that the facility F1 is an apartment house (hereinafter referred to as apartment house F10). However, the facility F1 to which the notification system 100 is applied may be a detached house in addition to the apartment house F10. Alternatively, the facility F1 may be a non-residential facility such as an office, a store, a school, or a nursing facility.

[0020] The notification system 100 notifies a person moving within the shared unit AR0, which is, for example, the 1st floor of the apartment house F10, of information (notification information).

[0021] Here, as shown in FIGS. 6 to 9, the shared unit AR0 includes a first area AR1 and a second area AR2 existing inside the apartment house F10 rather than the first area AR1. In other words, the second area AR2 exists in a place where it is easier to access the dwelling units of the apartment house F10 than the first area AR1.

[0022] The first area AR1 is, for example, an area where the lobby intercom 9 for authenticating a person visiting the apartment house F10 is installed.

[0023] The second area AR2 is an area where, for example, an elevator, stairs, etc. for going from the 1st floor of the apartment house F10 to the floor where the dwelling units of the apartment house F10 are provided are installed.

[0024] The first area AR1 and the second area AR2 are separated by a gate GT1. Here, the gate GT1 is an automatic door provided between the first area AR1 and the second area AR2. The gate GT1 is configured to be unlocked by an unlocking signal from the lobby intercom 9 and to open automatically. The gate GT1 includes a transparent member such as a glass plate, for example, and is configured such that the first area AR1 can be visually recognized from the second area AR2 even when the gate GT1 is closed.

[0025] As shown in FIG. 1, the notification system 100 includes a first control device 1, a second control device 2, an imaging device 3, a first display device 4, a second display device 5, an audio output device 6, a plurality of (two in FIG. 1) dwelling unit terminals 7, a plurality of (two in FIG. 1) door phones 8, and a lobby intercom 9.

[0026] The first control device 1 and the second control device 2 communicate with the lobby intercom 9 provided in the first area AR1.

[0027] Each of the plurality of dwelling unit terminals 7 is installed in each dwelling unit of the apartment house F10. Each dwelling unit terminal 7 is configured to communicate (for example, make a call and receive an image signal, etc.) with the lobby intercom 9 via the second control device 2.

[0028] Each of the plurality of door phones 8 is installed, for example, at the outer entrance of each dwelling unit of the apartment house F10. The plurality of door phones 8 correspond one-to-one with the plurality of dwelling unit terminals 7. Each door phone 8 is configured to communicate (for example, make a call and transmit an image signal, etc.) with the corresponding dwelling unit terminal 7.

[0029] The imaging device 3, the first display device 4, the second display device 5, and the audio output device 6 will be described later.

[0030] (2.2) Lobby Intercom As shown in FIG. 1, the lobby intercom 9 includes a first communication unit 91, a second communication unit 92, an imaging unit 93, a storage unit 94, an operation unit 95, a display unit 96, a call unit 97, and a control unit 98. The lobby intercom 9 also has a housing that houses or holds the above-described components.

[0031] The imaging unit 93 has an imaging element and is a camera for imaging a subject. Here, it is assumed that the subject of the imaging unit 93 is a person (visitor C0) who has visited the apartment house F10 as shown in FIG. 3. The imaging area (field of view) of the imaging unit 93 is set in front of the lobby intercom 9 so that at least the face of the visitor C0 can be imaged when the visitor C0 is authenticated by the lobby intercom 9. That is, the imaging unit 93 images an image (first captured image) Im1 of the face of the visitor C0. In the present embodiment, the imaging unit 93 is a camera that captures a moving image. Further, in the present embodiment, the imaging unit 93 is a camera that captures a color image. Note that the imaging unit 93 may be a camera that captures a still image. Also, the imaging unit 93 may be a camera that captures a monochrome image. Further, the imaging unit 93 is not limited to a camera that captures a visible light image, and may be a near-infrared camera, a stereo camera, a Depth camera, or the like.

[0032] The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 93 forms an image of light from the subject on the imaging surface (light receiving surface) of the imaging element by an optical system such as a lens, and converts the light from the subject into an electrical signal by the imaging element. Then, the imaging unit 93 outputs the output signal of the imaging element to the control unit 98 as an image signal.

[0033] The first communication unit 91 is a communication module configured to be communicable with the first control device 1.

[0034] The second communication unit 92 is a communication module configured to be communicable with the second control device 2.

[0035] The storage unit 94 is composed of a device selected from a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), or the like.

[0036] The storage unit 94 stores in advance images of the faces of a plurality of persons (candidate permit holders) whose entry from the first area AR1 to the second area AR2 is permitted. Note that the storage unit 94 may store feature amounts of the faces of the plurality of candidate permit holders. Further, images of the faces of the plurality of candidate permit holders and the like may be stored in an external storage device (such as a server or a cloud server) communicable with the lobby interphone 9.

[0037] The operation unit 95 is configured to receive operations by a visitor C0 to the apartment house F10. The operation unit 95 is, for example, an input interface having a plurality of push-button switches and a touch panel or the like.

[0038] The display unit 96 is, for example, a liquid crystal display. The display unit 96 is configured to display, for example, a first captured image Im1 captured by the imaging unit 93. When the lobby interphone 9 is provided with a touch panel display, the touch panel display may also serve as the display unit 96 and the operation unit 95.

[0039] The call unit 97 includes a speaker and a microphone and is configured to be able to make a call with the household terminal 7.

[0040] The control unit 98 is configured by, for example, a computer system mainly composed of a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) and a memory. Then, by the processor executing the program stored in the memory, the computer system functions as the control unit 98. The program executed by the processor is recorded in advance in the memory of the computer system here, but it may be provided by being recorded on a recording medium such as a memory card, or may be provided through a telecommunication line such as the Internet.

[0041] As shown in FIG. 1, the control unit 98 includes an acquisition unit 981, a face detection unit 982, an authentication unit 983, a gate control unit 984, and an output unit 985. Note that the acquisition unit 981, the face detection unit 982, the authentication unit 983, the gate control unit 984, and the output unit 985 only indicate functions realized by the control unit 98, and do not necessarily indicate a physical configuration.

[0042] The acquisition unit 981 acquires a first captured image Im1, which is a face image of the visitor C0 captured by the imaging unit 93.

[0043] Based on the first captured image Im1, the face detection unit 982 extracts data on the feature amounts of the face of the visitor C0.

[0044] The authentication unit 983 determines the attribute of the visitor C0. More specifically, based on the first captured image Im1, the authentication unit 983 determines whether the visitor C0 is a permitted person whose entry from the first area AR1 to the second area AR2 is permitted or a non-permitted person whose entry from the first area AR1 to the second area AR2 is not permitted. That is, the authentication unit 983 determines the attribute of the visitor C0 based on the first captured image Im1 and authenticates the visitor C0.

[0045] The authentication unit 983 determines that the visitor C0 is an authorized person when there is one candidate authorized person among the multiple candidate authorized persons whose entry from the first area AR1 to the second area AR2 is permitted and who matches the visitor C0. Specifically, the authentication unit 983 determines that the visitor C0 is an authorized person when there is an image of one candidate authorized person among the images of the multiple candidate authorized persons whose degree of match with the data of the facial features of the visitor C0 extracted from the first captured image Im1 is equal to or greater than a predetermined threshold. The images of the multiple candidate authorized persons are stored in advance in the storage unit 94, for example. The predetermined threshold is set to a value such that, for example, the false accept rate of the authentication unit 983 is 0.01% or less and the false reject rate is 0.15% or less.

[0046] Also, when there is no candidate authorized person among the multiple candidate authorized persons who matches the visitor C0, the authentication unit 983 determines that the visitor C0 is an unauthorized person. Specifically, the authentication unit 983 determines that the visitor C0 is an unauthorized person when there is no image of a candidate authorized person among the images of the multiple candidate authorized persons whose degree of match with the data of the facial features of the visitor C0 is equal to or greater than a predetermined threshold.

[0047] When the authentication unit 983 authenticates the visitor C0 (determines that the visitor C0 is an authorized person), it generates information on the authentication result (authentication information). The authentication information includes authentication information indicating that the visitor C0 has been authenticated and data on the facial features of the visitor C0 extracted from the first captured image Im1 by the face detection unit 982.

[0048] The output unit 985 outputs the authentication information to the first control device 1 via the first communication unit 91.

[0049] When the authentication unit 983 authenticates the visitor C0, the gate control unit 984 opens the gate GT1. Also, when the authentication unit 983 does not authenticate the visitor C0, the gate control unit 984 does not open the gate GT1 and outputs a sound (voice) indicating that the authentication has failed from, for example, a speaker included in the communication unit 97.

[0050] Furthermore, as described above, the lobby intercom 9 is configured to communicate with each of the plurality of household terminals 7. Accordingly, the lobby intercom 9 is configured to be able to call the resident of the household desired by the visitor C0 when the operation unit 95 is operated by the visitor C0.

[0051] Specifically, when the operation unit 95 of the lobby intercom 9 receives a call operation, the lobby intercom 9 transmits a control signal related to the call to the household terminal 7 installed in the household to be called. When the household terminal 7 receives the control signal and the household terminal 7 receives a predetermined operation (such as pressing a call button provided in the household terminal 7) from the resident, communication becomes possible between the household terminal 7 and the lobby intercom 9. Accordingly, a call becomes possible between the resident of the household who is the operator of the household terminal 7 and the visitor C0 who is the operator of the lobby intercom 9.

[0052] Also, when the household terminal 7 receives the control signal and the household terminal 7 receives a predetermined operation (such as pressing an unlocking button provided in the household terminal 7) from the resident, the household terminal 7 transmits an unlocking signal to the lobby intercom 9 via a second control device 2 described later.

[0053] When the second communication unit 92 of the lobby intercom 9 receives the unlocking signal, the authentication unit 983 authenticates the visitor C0 and outputs authentication information including the authentication information indicating that the visitor C0 has been authenticated and the first captured image Im1 of the visitor C0 authenticated by the authentication unit 983 to the first control device 1 via the first communication unit 91.

[0054] Also, when the second communication unit 92 receives the unlocking signal, the gate control unit 984 opens the gate GT1. That is, the visitor C0 authenticated by the lobby intercom 9 (authentication unit 983) includes a person permitted by the resident of the apartment house F10 to enter the second area AR2.

[0055] (2.3) First control device As shown in FIG. 2, the first control device 1 includes a first communication unit 11, a second communication unit 12, a third communication unit 13, a fourth communication unit 14, a fifth communication unit 15, a storage unit 16, and a control unit 17.

[0056] The first communication unit 11 is a communication module configured to be communicable with the lobby intercom 9.

[0057] The second communication unit 12 is a communication module configured to be communicable with the imaging device 3.

[0058] Here, the imaging device 3 has an imaging element and is a camera for imaging a subject. As shown in FIGS. 6 to 9, the imaging device 3 is installed, for example, on the ceiling of the second area AR2.

[0059] As shown in FIG. 4, the imaging device 3 images a person moving within the shared area AR0. More specifically, the imaging device 3 images an image (second captured image) Im2 of a person (entrant E0) entering from the first area AR1 to the second area AR2. Note that the "entrant E0" referred to in the present disclosure includes a person who has entered the second area AR2 and a person who is moving toward the second area AR2 in the first area AR1.

[0060] The imaging area of the imaging device 3 is set so that at least the face of the entrant E0 can be imaged when the entrant E0 enters from the first area AR1 to the second area AR2. In the present embodiment, the imaging device 3 is a camera that captures a moving image. Further, in the present embodiment, the imaging device 3 is a camera that captures a color image. Note that the imaging device 3 may be a camera that captures a still image. Also, the imaging device 3 may be a camera that captures a monochrome image. Further, the imaging device 3 is not limited to a camera that captures a visible light image, and may be a near-infrared camera, a stereo camera, a Depth camera, or the like.

[0061] The third communication unit 13 is a communication module configured to be communicable with the first display device 4. Here, the first display device 4 is a display device having a display unit 41, and as an example, it is a digital signage as shown in FIGS. 6 to 9. The first display device 4 is installed, for example, on the floor surface 10 of the second area AR2. The first display device 4 displays the image output from the control unit 17 on the display unit 41. Note that the first display device 4 only needs to be a device capable of displaying the image output from the control unit 17, and is not limited to digital signage. Also, the first display device 4 may be a projector or the like capable of projecting the image output from the control unit 17 onto a screen or the like.

[0062] The fourth communication unit 14 is a communication module configured to be communicable with the second display device 5. Here, the second display device 5 is, as an example, a projector. The second display device 5 is installed, for example, on the ceiling of the second area AR2. The second display device 5 projects and displays the image output from the control unit 17 on the floor surface 10 of the shared area AR0 (for example, the second area AR2). Note that the second display device 5 is not limited to a projector, and may be a spotlight or the like. In this case, the second display device 5 irradiates the floor surface 10 with light based on the control signal output from the second output unit 178. Also, in this case, the light irradiated from the second display device 5, which is a spotlight or the like, may be transmitted through a film sheet printed with a fixed pattern, and the fixed pattern may be projected onto the floor surface 10.

[0063] The fifth communication unit 15 is a communication module configured to be communicable with the audio output device 6. Here, the audio output device 6 is a device that outputs audio, and as an example, it is a speaker. The audio output device 6 is installed, for example, on the ceiling of the second area AR2. The audio output device 6 outputs audio based on the audio data output from the control unit 17.

[0064] The control unit 17 is configured by, for example, a computer system mainly composed of a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) and a memory. Then, when the processor executes a program stored in the memory, the computer system functions as the control unit 17. The program executed by the processor is recorded in advance in the memory of the computer system here, but it may be provided by being recorded on a recording medium such as a memory card, or may be provided through a telecommunication line such as the Internet.

[0065] As shown in FIG. 2, the control unit 17 includes a processing unit 170, a face detection unit 171, a motion detection unit 172, a first acquisition unit 174, a second acquisition unit 175, and a notification output unit 176. The processing unit 170 includes an authentication unit 173. The notification output unit 176 includes a first output unit 177, a second output unit 178, and a third output unit 179. Note that the authentication unit 173, the face detection unit 171, the motion detection unit 172, the first acquisition unit 174, the second acquisition unit 175, the first output unit 177, the second output unit 178, and the third output unit 179 only indicate functions realized by the control unit 17, and do not necessarily indicate a physical configuration.

[0066] The first acquisition unit 174 acquires the authentication information output from the lobby intercom 9.

[0067] The second acquisition unit 175 acquires the second captured image Im2 (see FIG. 4) captured by the imaging device 3.

[0068] Based on the second captured image Im2, the face detection unit 171 performs face detection of the entrant E0. Specifically, the face detection unit 171 extracts the feature amount of the face of the entrant E0 based on the second captured image Im2.

[0069] The motion detection unit 172 detects the motion of the entrant E0 based on the second captured image Im2. Here, the motion of the entrant E0 detected by the motion detection unit 172 includes the movement of the entrant E0 on the floor surface 10. That is, the motion detection unit 172 detects the current position of the entrant E0 on the floor surface 10. In addition, the motion of the entrant E0 detected by the motion detection unit 172 includes the change in the orientation of the body of the entrant E0. Furthermore, the motion of the entrant E0 detected by the motion detection unit 172 includes the change in the orientation of the face of the entrant E0.

[0070] In addition, the motion detection unit 172 detects the moving direction and moving speed of the entrant E0. The motion detection unit 172 calculates the change in the position of the entrant E0 on the floor surface 10 from the temporal changes in the moving direction and moving speed of the entrant E0, and detects the movement path of the entrant E0.

[0071] The motion detection unit 172 stores the movement path of the entrant E0 in the storage unit 16 as part of the action information of the entrant E0. In other words, the action information of the entrant E0 includes the movement path of the entrant E0 obtained based on the second captured image Im2.

[0072] The authentication unit 173 determines the attributes of the entrant E0. More specifically, the authentication unit 173 determines, based on the second captured image Im2, whether the entrant E0 is a permitted person whose entry from the first area AR1 to the second area AR2 is permitted, or a non-permitted person whose entry from the first area AR1 to the second area AR2 is not permitted. That is, the authentication unit 173 performs attribute determination of the entrant E0 based on the second captured image Im2 and authenticates the entrant E0.

[0073] The authentication unit 173 determines that the entrant E0 is an authorized person when there is one candidate authorized person among the plurality of candidate authorized persons whose entry from the first area AR1 to the second area AR2 is permitted and who matches the entrant E0. Specifically, the authentication unit 173 determines that the entrant E0 is an authorized person when there is an image of one candidate authorized person among the images of the plurality of candidate authorized persons whose degree of match with the data of the facial features of the entrant E0 extracted from the second captured image Im2 is equal to or greater than a predetermined threshold. The images of the plurality of candidate authorized persons are stored in advance in the storage unit 16, for example. Note that the predetermined threshold is set to a value such that, for example, the false accept rate of the authentication unit 173 is 0.01% or less and the false reject rate is 0.15% or less.

[0074] Further, the authentication unit 173 determines that the entrant E0 is an unauthorized person when there is no candidate authorized person among the plurality of candidate authorized persons whose entry from the first area AR1 to the second area AR2 is permitted and who matches the entrant E0. Specifically, the authentication unit 173 determines that the entrant E0 is an unauthorized person when there is no image of a candidate authorized person among the images of the plurality of candidate authorized persons whose degree of match with the data of the facial features of the entrant E0 is equal to or greater than a predetermined threshold.

[0075] The notification output unit 176 notifies the entrant E0 of notification information corresponding to the determination result of the authentication unit 173.

[0076] Specifically, the first output unit 177 notifies the entrant E0 of the notification information by causing the display unit 41 of the first display device 4 to display a first notification image G1 including the notification information corresponding to the determination result of the authentication unit 173.

[0077] The second output unit 178 notifies the entrant E0 of the notification information by causing the second display device 5 to display a second notification image G2 including the notification information corresponding to the determination result by the authentication unit 173 on the floor surface 10.

[0078] The third output unit 179 causes the voice output device 6 to output a notification voice including notification information corresponding to the determination result by the authentication unit 173, thereby notifying the entering person E0 of the notification information.

[0079] The operation of the notification output unit 176 will be described in detail in “(3) Operation”.

[0080] The storage unit 16 is composed of a device selected from a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), etc. The storage unit 16 stores various data acquired by the first acquisition unit 174 and the second acquisition unit 175. Further, the storage unit 16 stores various data (such as image data and voice data) output by the first output unit 177, the second output unit 178, and the third output unit 179.

[0081] (2.4) Second control device As shown in FIG. 1, the second control device 2 includes a communication unit 21 and a control unit 22.

[0082] The communication unit 21 is a communication module configured to be able to communicate with the lobby intercom 9 and each household terminal 7. The communication unit 21 is configured to relay communication between each household terminal 7 and the lobby intercom 9.

[0083] The control unit 22 is configured by, for example, a computer system mainly composed of a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) and a memory. Then, by the processor executing the program stored in the memory, the computer system functions as the control unit 22. The program executed by the processor is recorded in advance in the memory of the computer system here, but may be provided by being recorded on a recording medium such as a memory card, or may be provided through a telecommunication line such as the Internet.

[0084] The control unit 22 is configured to control the communication unit 21. Specifically, the control unit 22 controls the communication unit 21 to transmit a communication signal transmitted from the lobby intercom 9 to each of the plurality of household terminals 7, and to transmit a communication signal transmitted from each of the household terminals 7 to the lobby intercom 9.

[0085] (2.5) Household Terminal The household terminal 7 has, for example, a microcomputer having a processor and a memory. Then, by the processor executing a program stored in the memory, the microcomputer realizes the functions of the household terminal 7. The program executed by the processor is recorded in advance in the memory of the microcomputer here, but may be recorded and provided on a non-transitory recording medium such as a memory card, or may be provided through a telecommunication line such as the Internet.

[0086] The household terminal 7 is configured to be communicable with the lobby intercom 9 via the second control device 2. When the household terminal 7 receives a control signal (call signal) for calling a resident from the lobby intercom 9 and receives a predetermined operation by an operator of the household terminal 7 (for example, a resident of a household in the apartment house F10), a communicable state is established between the household terminal 7 and the lobby intercom 9 via the second control device 2. Thereby, the operator of the household terminal 7 and the operator of the lobby intercom 9 can make a call. Further, when the household terminal 7 receives a call signal from the lobby intercom 9 or is in a communicable state with the lobby intercom 9 and receives a predetermined operation by an operator of the household terminal 7, an unlocking signal is transmitted to the lobby intercom 9. When the lobby intercom 9 receives the unlocking signal, it opens the gate GT1.

[0087] Furthermore, when the household terminal 7 receives a control signal (call signal) for calling a resident from the door phone 8 and accepts a predetermined operation while receiving the control signal, a communicable state is established between the household terminal 7 and the door phone 8. As a result, the operator of the household terminal 7 and the operator of the door phone 8 can make a call.

[0088] (3) Operation The operation example of the notification system 100 will be described below with reference to FIG. 5 which is a sequence diagram. Note that the sequence shown in FIG. 5 is an example and can be changed as appropriate.

[0089] First, as shown in FIG. 6, assume a scene where two visitors C0 (the first visitor C1 and the second visitor C2) are present in the first area AR1 of the apartment building F10. Here, the first visitor C1 is, for example, a resident of a household in the apartment building F10 who has returned from outside. The first visitor C1 stands in front of the lobby interphone 9 and tries to receive authentication by the lobby interphone 9 in order to enter from the first area AR1 to the second area AR2. Also, the second visitor C2 waits at a position away from the lobby interphone 9 and is a suspicious person who intends to enter from the first area AR1 to the second area AR2 (so-called piggybacking) with the first visitor C1 without receiving authentication by the lobby interphone 9.

[0090] When the imaging unit 93 of the lobby interphone 9 detects the first visitor C1, for example, by a human sensor (not shown) provided in the lobby interphone 9, the imaging unit 93 captures a first captured image Im1 of the first visitor C1. When the imaging unit 93 captures the first captured image Im1, the acquisition unit 981 acquires the first captured image Im1 (step S1).

[0091] The authentication unit 983 performs a first authentication process of the first visitor C1 based on the first captured image Im1 of the first visitor C1 (step S2).

[0092] As described above, when there is an image of one candidate permittee among the images of a plurality of candidate permittees pre-registered in the storage unit 94, whose degree of coincidence with the data of the facial features of the visitor C0 extracted from the first captured image Im1 is equal to or greater than a predetermined threshold value, the authentication unit 983 determines that the visitor C0 is a permittee. The images of the plurality of candidate permittees pre-registered in the storage unit 94 include images of residents of the housing units in the apartment building F10, relatives of the residents of the apartment building F10, acquaintances of the residents of the apartment building F10, and merchants such as delivery companies.

[0093] In this operation example, since the first visitor C1 is a resident of a housing unit in the apartment building F10, the authentication unit 983 determines that the first visitor C1 is a permittee.

[0094] When the authentication unit 983 determines (authenticates) that the first visitor C1 is a permittee, the output unit 985 outputs first authentication information including authentication information indicating that the first visitor C1 has been authenticated and data of the facial features of the first visitor C1 to the first control device 1 (step S3). The first authentication information output from the output unit 985 is acquired by the first acquisition unit 174 of the first control device 1 (step S4).

[0095] Also, when the authentication unit 983 authenticates the first visitor C1, the gate control unit 984 opens the gate GT1.

[0096] When the gate GT1 is opened, as shown in FIG. 7, the first visitor C1 and the second visitor C2 start to enter from the first area AR1 to the second area AR2. Here, "start to enter from the first area AR1 to the second area AR2" means starting to move in the direction of the second area AR2 in the first area AR1. Hereinafter, the first visitor C1 is referred to as the first entrant E1 (E0), and the second visitor C2 is referred to as the second entrant E2 (E0).

[0097] Here, for example, the imaging device 3 installed on the ceiling of the second area AR2 constantly images the imaging area at a predetermined imaging interval.

[0098] The second acquisition unit 175 acquires the second captured image Im2 from the imaging device 3 at a predetermined time interval. Note that the predetermined time interval at which the second acquisition unit 175 acquires the second captured image Im2 is set to a time equal to or longer than the imaging interval at which the imaging device 3 captures the second captured image Im2.

[0099] The motion detection unit 172 of the first control device 1 identifies the first entrant E1 and the second entrant E2 based on the second captured image Im2. The motion detection unit 172 detects the movements of the identified first entrant E1 and second entrant E2 by tracking the respective positions of the first entrant E1 and the second entrant E2. That is, the motion detection unit 172 detects the movement of the first entrant E1 and the second entrant E2 entering from the first area AR1 to the second area AR2.

[0100] In addition, the face detection unit 171 of the first control device 1 performs face detection of the first entrant E1 and the second entrant E2 based on the second captured image Im2. More specifically, the face detection unit 171 performs face detection of the first entrant E1 and the second entrant E2 identified by the motion detection unit 172 based on the second captured image Im2.

[0101] Note that the frequency at which the face detection unit 171 performs face detection on the first entrant E1 and the second entrant E2 is set lower than the frequency at which the motion detection unit 172 detects the movements of the first entrant E1 and the second entrant E2. By detecting the movements of the first entrant E1 and the second entrant E2 by the motion detection unit 172 at a higher frequency than the face detection of the first entrant E1 and the second entrant E2, the movements of the first entrant E1 and the second entrant E2 can be tracked more reliably. Specifically, due to the relationship between the face orientation and the moving speed, even if the face detection of the first entrant E1 and the second entrant E2, which have been face-detected once, fails, the movements of the first entrant E1 and the second entrant E2 can be detected at a high frequency, so that the first entrant E1 and the second entrant E2 can be reliably tracked. Also, even when the face detection of the first entrant E1 and the second entrant E2 has not been performed yet, by detecting the movements of the first entrant E1 and the second entrant E2 at a high frequency, when the face detection of the first entrant E1 and the second entrant E2 is performed later, it becomes easier to associate the first entrant E1 and the second entrant E2 with the respective face feature amounts.

[0102] Based on the second captured image Im2, the face detection unit 171 extracts the face feature amounts of the first entrant E1 and the second entrant E2, respectively. Note that the second captured image Im2 from which the face detection unit 171 extracts the face feature amounts of the first entrant E1 and the second entrant E2 is the second captured image Im2 captured immediately after the first acquisition unit 174 acquires the first authentication information and acquired by the second acquisition unit 175 (step S5). That is, it is assumed that the second captured image Im2 acquired by the second acquisition unit 175 immediately after the first acquisition unit 174 acquires the first authentication information is the second captured image Im2 at the stage when the first entrant E1 and the second entrant E2 are present in the first area AR1.

[0103] Based on the first authentication information received from the lobby intercom 9 and the face detection result by the face detection unit 171, the authentication unit 173 included in the first control device 1 performs a second authentication process for determining whether the first entrant E1 and the second entrant E2 are permitted persons or non-permitted persons (step S6).

[0104] Here, as described above, the first authentication information includes data on the facial feature amounts of the first visitor C1. Therefore, the authentication unit 173 provisionally determines that the first entrant E1 is an authorized person on the assumption that the degree of coincidence between the facial feature amounts of the first entrant E1 and the first visitor C1 is equal to or greater than a predetermined threshold value.

[0105] Also, the authentication unit 173 provisionally determines that the second entrant E2 is an unauthorized person on the assumption that the degree of coincidence between the facial feature amounts of the second entrant E2 and the first visitor C1 is less than a predetermined threshold value.

[0106] When the second authentication process is completed by the authentication unit 173, the authentication unit 173 generates second authentication information including the authentication result of the second authentication process.

[0107] Next, the authentication unit 173 performs a third authentication process for the first entrant E1 and the second entrant E2 based on the second captured image Im2 (step S7).

[0108] In the third authentication process, when there is an image of one candidate authorized person among the images of a plurality of candidate authorized persons pre-stored in the storage unit 16, the degree of coincidence of which with the data on the facial feature amounts of the entrant E0 (the first entrant E1 and the second entrant E2) extracted from the second captured image Im2 is equal to or greater than a predetermined threshold value, the authentication unit 173 determines that the entrant E0 is an authorized person. Note that the images of the plurality of candidate authorized persons pre-registered in the storage unit 16 include images of residents of the dwelling units in the apartment house F10, relatives of the residents of the apartment house F10, acquaintances of the residents of the apartment house F10, and merchants such as delivery companies.

[0109] In the present embodiment, since the first entrant E1 is a resident of a dwelling unit in the apartment house F10, the authentication unit 173 determines that the first entrant E1 is an authorized person.

[0110] Also, in the third authentication process, when there is no image of one candidate authorized person among the images of a plurality of candidate authorized persons pre-stored in the storage unit 16, the degree of coincidence of which with the data on the facial feature amounts of the entrant E0 is equal to or greater than a predetermined threshold value, the authentication unit 173 determines that the entrant E0 is an unauthorized person.

[0111] In this embodiment, the second entrant E2 is a suspicious person, and among the images of a plurality of candidate permit holders, there is no image of a single candidate permit holder whose degree of match with the data of the facial features of the second entrant E2 is equal to or greater than a predetermined threshold value. Therefore, the authentication unit 173 determines that the second entrant E2 is an unauthorized person.

[0112] When the third authentication process is completed, the authentication unit 173 generates third authentication information including the authentication result of the third authentication process.

[0113] Based on the second authentication information and the third authentication information, the authentication unit 173 performs a fourth authentication process to finally determine whether the entrant E0 is a permit holder or an unauthorized person (step S8).

[0114] In the fourth authentication process, if the entrant E0 is determined to be a permit holder in the second authentication process and is determined to be a permit holder in the third authentication process, the authentication unit 173 finally determines that the entrant E0 is a permit holder. Also, if the entrant E0 is determined to be an unauthorized person in the second authentication process and is determined to be an unauthorized person in the third authentication process, the authentication unit 173 finally determines that the entrant E0 is an unauthorized person.

[0115] In this embodiment, since the first entrant E1 is determined to be a permit holder in the second authentication process and the third authentication process, in the fourth authentication process, the authentication unit 173 finally determines that the first entrant E1 is a permit holder. Also, since the second entrant E2 is determined to be an unauthorized person in the second authentication process and the third authentication process, in the fourth authentication process, the authentication unit 173 finally determines that the second entrant E2 is an unauthorized person.

[0116] In addition, for example, when the authenticator 173 determines that the entrant E0 is a permitted person in the second authentication process but a non-permitted person in the third authentication process, it determines that the entrant E0 is not a person whose image is registered in the storage unit 16 in advance, but is a person permitted by the resident of the apartment house F10 to enter the second area AR2. In this case, the authenticator 173 determines that the entrant E0 is a permitted person. In this case, the entrant E0 is, for example, a person (guest) permitted by the resident of the apartment house F10 to enter the second area AR2. Note that the data of the feature amount of the face of the guest output to the first control device 1 in the first authentication process may be temporarily registered in the storage unit 16 of the first control device 1. In this case, the guest is determined to be a permitted person in the third authentication process.

[0117] Further, when the authenticator 173 determines that the entrant E0 is a non-permitted person in the second authentication process but a permitted person in the third authentication process, it determines that the entrant E0 is a person whose image is registered in the storage unit 16 in advance. In this case, the authenticator 173 determines that the entrant E0 is a permitted person. In this case, the entrant E0 is a resident whose image is registered in the storage unit 16 in advance, but is, for example, a child who did not appear in the first captured image Im1 captured by the imaging unit 93 of the lobby intercom 9 for some reason such as being short.

[0118] The notification output unit 176 notifies the entrant E0 of notification information corresponding to the determination result of the authenticator 173 in the fourth authentication process (step S9).

[0119] An example of the operation of the notification output unit 176 (the first output unit 177, the second output unit 178, and the third output unit 179) will be described below.

[0120] The first output unit 177 causes the display unit 41 of the first display device 4 to display a first notification image G1 including first notification information, which is notification information corresponding to the determination result of the authenticator 173.

[0121] Here, the first notification information is information that prompts the second entrant E2, who is an unauthorized person, to stop entering from the first area AR1 to the second area AR2. That is, the first notification image G1 is an image that prompts the second entrant E2, who is an unauthorized person, to stop entering from the first area AR1 to the second area AR2. When the first entrant E1, who is an authorized person, views the first notification image G1, the first entrant E1 can recognize the presence of an unauthorized person.

[0122] As shown in FIG. 10, the first notification image G1 includes a display image Im21 of the second entrant E2. The display image Im21 is, for example, a still image obtained by cutting out an area in which at least the head H1 of the second entrant E2 appears from the second captured image Im2 at the stage when the second entrant E2 is present in the first area AR1. In other words, the first output unit 177 cuts out the display image Im21 in which at least the head H1 of the second entrant E2 appears from the second captured image Im2 and causes the display unit 41 to display it. The "head" mentioned here refers to the part of a person's body above the neck.

[0123] Further, the first notification image G1 includes a notification image G11 including an icon (for example, an icon of a security camera) and a character string ("Security camera in operation") that notifies that the imaging device 3 is operating, and a notification image G12 including a character string ("Trespassing") that notifies that the second entrant E2 is an unauthorized person. Note that the character string that notifies that the second entrant E2 is an unauthorized person is not limited to "Trespassing", and may be "Not registered", "Please refrain from bringing companions in", or the like.

[0124] When the motion detection unit 172 detects that the second entrant E2 has entered the second area AR2, the first output unit 177 causes the display unit 41 to display the first notification image G1.

[0125] Thereby, the first output unit 177 can notify the second entrant E2 of the first notification information.

[0126] In addition, when only the first entrant E1 who is the permit holder exists in the second area AR2, the first output unit 177 may cause the display unit 41 to display a notification image including notification information for notifying the permit holder of area information (for example, information regarding an event held near the apartment house F10, etc.).

[0127] The second output unit 178 causes the second display device 5 to display a second notification image G2 (G21) including second notification information, which is notification information corresponding to the determination result of the authentication unit 173, on the floor surface 10. More specifically, as shown in FIG. 8, the second output unit 178 causes the second display device 5 to display the second notification image G21 in a display area A1 including the area where the first entrant E1 exists on the floor surface 10.

[0128] Here, the second notification information is information for notifying the first entrant E1 that authentication has been performed on the lobby intercom 9. That is, the second notification image G21 is an image for notifying the first entrant E1, who is the permit holder, that authentication has been performed on the lobby intercom 9.

[0129] As an example, the second notification image G21 includes a marker M1 and a character string image T1 including a character string (for example, "Authenticated") for notifying the first entrant E1 that authentication has been performed on the lobby intercom 9.

[0130] The marker M1 is, for example, circular such that the first entrant E1 is located inside when viewed from above. Also, the marker M1 is, for example, green, which generally has a positive meaning. Note that the marker M1 is not limited to a circular shape and may be a polygon or the like. Also, the marker M1 is not limited to green and may be blue or the like.

[0131] When the motion detection unit 172 detects that the first entrant E1 has entered the second area AR2, the second output unit 178 causes the second display device 5 to display the second notification image G21 in the display area A1.

[0132] Here, the second output unit 178 changes the display area A1 following the movement of the first entrant E1 detected by the movement detection unit 172. For example, as shown in FIGS. 8 and 9, when the first entrant E1 moves on the floor surface 10, the second output unit 178 moves the display area A1 following the movement of the first entrant E1. That is, the second output unit 178 moves the display area A1 based on the current position of the first entrant E1 on the floor surface 10. Note that the current position of the first entrant E1 on the floor surface 10 is calculated by coordinate-converting two-dimensional coordinate data centered on the installation position of the imaging device 3 calculated from the second captured image Im2 into two-dimensional coordinate data centered on the installation position of the second display device 5.

[0133] The second output unit 178 causes the second display device 5 to display a second notification image G2 (G22) including the first notification information on the floor surface 10. More specifically, as shown in FIG. 8, the second output unit 178 causes the second display device 5 to display the second notification image G22 in a display area A2 including the area where the second entrant E2 exists on the floor surface 10.

[0134] Here, as described above, the first notification information is information that prompts the non-permitted second entrant E2 to stop entering from the first area AR1 to the second area AR2. That is, the second notification image G22 is an image for prompting the non-permitted second entrant E2 to stop entering from the first area AR1 to the second area AR2.

[0135] As an example, the second notification image G22 includes a marker M2 and a character string image T2 including a character string (for example, "Not authenticated") that prompts the second entrant E2 to stop entering from the first area AR1 to the second area AR2. Note that the character string that prompts the second entrant E2 to stop entering from the first area AR1 to the second area AR2 is not limited to "Not authenticated", and may be a character string (for example, "Illegal entry!") that more strongly prompts the second entrant E2 to stop entering from the first area AR1 to the second area AR2.

[0136] Marker M2 is, for example, circular in shape such that when viewed from above, the second entrant E2 is located inside. Also, marker M2 is, for example, red which generally has a negative meaning. Note that marker M2 is not limited to a circular shape and may be a polygon or the like. Also, marker M2 is not limited to red and may be yellow or the like.

[0137] When the motion detection unit 172 detects that the second entrant E2 has entered the second area AR2, the second output unit 178 causes the second notification image G22 to be displayed in the display area A2 on the second display device 5.

[0138] Here, the second output unit 178 changes the display area A2 following the motion of the second entrant E2 detected by the motion detection unit 172. For example, as shown in FIGS. 8 and 9, when the second entrant E2 moves on the floor surface 10, the second output unit 178 moves the display area A2 following the movement of the second entrant E2. That is, the second output unit 178 moves the display area A2 based on the current position of the second entrant E2 on the floor surface 10.

[0139] The third output unit 179 causes the audio output device 6 to output a notification voice including the first notification information.

[0140] Here, as described above, the first notification information is information that prompts the second entrant E2, who is an unauthorized person, to stop entering from the first area AR1 to the second area AR2. That is, the notification voice is a voice for prompting the second entrant E2, who is an unauthorized person, to stop entering from the first area AR1 to the second area AR2.

[0141] As an example, the notification voice is a voice such as "This is an illegal entry". Note that the notification voice is not limited to "This is an illegal entry!" and may be something that more indirectly prompts the second entrant E2 to stop entering from the first area AR1 to the second area AR2 (for example, "You are not authenticated").

[0142] When the motion detection unit 172 detects that the second entrant E2 has entered the second area AR2, the third output unit 179 causes the voice output device 6 to output a notification voice. That is, the third output unit 179 notifies the first notification information to the second entrant E2 in a state where the second entrant E2 is present in the second area AR2.

[0143] Note that the third output unit 179 may cause the voice output device 6 to output a notification voice before the second entrant E2 enters the second area AR2. That is, the third output unit 179 may notify the first notification information to the second entrant E2 in a state where the second entrant E2 is present in the first area AR1.

[0144] Also, when only the first entrant E1, who is the authorized person, is present in the second area AR2, the third output unit 179 may cause the voice output device 6 to output a notification voice including notification information such as a greeting to the authorized person (for example, "Hello", "Welcome").

[0145] (4) Modification The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved. Also, functions similar to those of the notification system 100 according to the above embodiment may be embodied by a control method of the notification system 100, a computer program, or a non-transitory recording medium on which the computer program is recorded.

[0146] A notification method according to one aspect includes a processing step of determining the attribute of a person moving in the shared area AR0 of the facility F1 based on an imaging image (second imaging image) Im2 of the person moving in the shared area AR0, a motion detection step of detecting the motion of the person moving in the shared area AR0 based on the second imaging image Im2, and a notification output step of notifying the person moving in the shared area AR0 of notification information according to at least one of the determination result in the processing step and the detection result in the motion detection step.

[0147] A program according to one aspect is a program for causing one or more processors to execute the above control method.

[0148] The following are examples of modifications to the embodiments. In the following, the above-described embodiment may also be referred to as the "basic example". The above basic example and the modification examples described below can be applied in appropriate combinations.

[0149] (4.1) Modification Example 1 In the basic example, when there is one candidate permittee that matches the entrant E0 among the plurality of candidate permittees whose entry from the first area AR1 to the second area AR2 is permitted, the authentication unit 173 determines that the entrant E0 is a permittee.

[0150] In this modification example, the plurality of candidate permittees whose entry from the first area AR1 to the second area AR2 is permitted are associated one-to-one with a plurality of types representing the attributes of the permittees. The plurality of types representing the attributes of the permittees are, for example, "resident" representing a resident of the apartment house F10, "relative" representing a relative of the resident, "acquaintance" representing an acquaintance of the resident, "registered merchant" representing a merchant pre-registered by the resident, and the like.

[0151] In this modification example, the notification output unit 176 notifies the first entrant E1 of notification information corresponding to the type corresponding to the one candidate permittee that matches the entrant E0 (the first entrant E1 in the embodiment) who is a permittee. As an example, the second output unit 178 included in the notification output unit 176 notifies the first entrant E1 of the notification information by displaying a second notification image G2 including the notification information corresponding to the type corresponding to the one candidate permittee that matches the first entrant E1 on the floor surface 10. Note that the notification information may be notified to the first entrant E1 by the first output unit 177 displaying a first notification image G1 including the notification information corresponding to the type corresponding to the one candidate permittee that matches the first entrant E1 on the display unit 41. Further, the third output unit 179 may output a notification voice including the notification information corresponding to the type corresponding to the one candidate permittee that matches the first entrant E1 to the voice output device 6.

[0152] When the first entrant E1 is a resident, that is, when the type corresponding to one candidate permittee who matches the first entrant E1 is "resident", as shown in FIG. 11, the second output unit 178 causes the second display device 5 to display a second notification image G21a including third notification information, which is notification information, in the display area A1. Here, the third notification information is information including a greeting to the returning resident. As an example, the second notification image G21a includes a marker M1 and a character string image T1a including a character string (for example, "Welcome home") that is a greeting to the returning resident.

[0153] Also, when a delivery addressed to the first entrant E1, who is a resident, has arrived at the delivery box provided in the common area AR0, as shown in FIG. 12, the second output unit 178 causes the second display device 5 to display a second notification image G21b including fourth notification information, which is notification information, in the display area A1. Here, the fourth notification information is information for notifying the resident that a delivery has arrived. As an example, the second notification image G21b includes a marker M1, a marker M1b indicating the position of the delivery box, and a character string image T1b including a character string (for example, "A delivery has arrived") for notifying the resident that a delivery has arrived.

[0154] Also, when an event (for example, a fireworks display) is held in the vicinity of the apartment building F10, as shown in FIG. 13, the second output unit 178 causes the second display device 5 to display a second notification image G21c including fifth notification information, which is notification information, in the display area A1. Here, the fifth notification information is information for notifying the resident that a fireworks display is being held in the vicinity of the apartment building F10. As an example, the second notification image G21c includes a marker M1 and a character string image T1c including a character string (for example, "There will be a fireworks display on August 5 (Sat)") for notifying the resident that a fireworks display is being held in the vicinity of the apartment building F10.

[0155] Also, the second output unit 178 causes the second display device 5 to display a related image G3 related to the fifth notification information on the floor surface 10. The related image G3 is, for example, an illustration of fireworks indicating a fireworks display.

[0156] When the first entrant E1 is a relative of the resident, that is, when the type corresponding to the single candidate permittee that matches the first entrant E1 is "relative", as shown in FIG. 14, the second output unit 178 causes the second display device 5 to display a second notification image G21d including sixth notification information, which is the notification information, in the display area A1. Here, the sixth notification information is information including a greeting to the relative of the resident. As an example, the second notification image G21d includes a marker M1d and a character string image T1d including a character string (for example, "Hello") that is a greeting to the relative of the resident.

[0157] The marker M1d is, for example, an arrow for guiding the first entrant E1. Further, the marker M1d is, for example, green, which generally has a positive meaning.

[0158] When the first entrant E1 is an acquaintance (for example, a friend) of the resident, that is, when the type corresponding to the single candidate permittee that matches the first entrant E1 is "acquaintance", as shown in FIG. 15, the second output unit 178 causes the second display device 5 to display a second notification image G21e including seventh notification information, which is the notification information, in the display area A1. Here, the seventh notification information is information for guiding the acquaintance of the resident to the dwelling unit where the resident lives. As an example, the second notification image G21e includes a marker M1 and a character string image T1e including a character string (for example, "Welcome! Please come to the 3rd floor") for guiding the acquaintance of the resident to the dwelling unit where the resident lives.

[0159] When the first entrant E1 is a merchant pre-registered by the resident, that is, when the type corresponding to one candidate permittee that matches the first entrant E1 is "registered merchant", as shown in FIG. 16, the second output unit 178 causes the second display device 5 to display a second notification image G21f including the eighth notification information, which is the notification information, in the display area A1. Here, the eighth notification information is information for notifying that the merchant has been authenticated by the lobby intercom 9 and for notifying the floor where entry is permitted. As an example, the second notification image G21f includes a marker M1f and a character string image T1f including a character string (for example, "Entry permitted (1 - 3F)") for notifying that the merchant has been authenticated by the lobby intercom 9 and for notifying the floor where entry is permitted. The marker M1f is, for example, a star-shaped polygon.

[0160] Also, when the type corresponding to one candidate permittee that matches the first entrant E1 is "relative", "acquaintance", or "registered merchant", as shown in FIG. 17, the second output unit 178 may cause the second display device 5 to display a second notification image G21g including the ninth notification information, which is the notification information, in the display area A1. Here, the ninth notification information is information for guiding the permittee to the elevator. As an example, the second notification image G21g includes a marker M1, a marker M1g indicating the position of the elevator, and a character string image T1g including a character string (for example, "The elevator is this way") for guiding the permittee to the elevator.

[0161] (4.2) Modification Example 2 In the basic example, when there is no candidate permittee that matches the entrant E0 among the plurality of candidate permittees whose entry from the first area AR1 to the second area AR2 is permitted, the authentication unit 173 determines that the entrant E0 is a non-permitted person.

[0162] Furthermore, in this modified example, when there is one candidate unauthorized person that matches the unauthorized entrant E0 among at least one candidate unauthorized person whose entry from the first area AR1 to the second area AR2 is not permitted, the authentication unit 173 determines that the entrant E0 is a specific unauthorized person. Specifically, when there is an image of one candidate unauthorized person among the images of at least one candidate unauthorized person, and the degree of match with the data of the facial features of the entrant E0 extracted from the second captured image Im2 is equal to or greater than a predetermined threshold value, the authentication unit 173 determines that the entrant E0 is a specific unauthorized person. The images of at least one candidate unauthorized person are, for example, stored in advance in the storage unit 16.

[0163] At least one candidate unauthorized person is associated one-to-one with at least one type representing the attributes of the unauthorized person. At least one type representing the attributes of the unauthorized person includes, for example, "registered suspicious person" representing a person registered in the suspicious person information of the region. Note that at least one type representing the attributes of the unauthorized person may include "person under manhunt" representing a person being wanted, "person with a criminal record" representing a person with a criminal record, and the like.

[0164] In this modified example, the notification output unit 176 notifies the second entrant E2 of notification information corresponding to the type corresponding to one candidate unauthorized person that matches the entrant E0 who is a specific unauthorized person (for example, the second entrant E2 in the embodiment).

[0165] As an example, the second output unit 178 included in the notification output unit 176 notifies the second entrant E2 of the notification information by displaying a second notification image G2 including the notification information corresponding to the type corresponding to one candidate unauthorized person that matches the second entrant E2 on the floor surface 10. Note that the first output unit 177 may notify the second entrant E2 of the notification information by displaying a first notification image G1 including the notification information corresponding to the type corresponding to one candidate unauthorized person that matches the second entrant E2 on the display unit 41. Further, the third output unit 179 may output a notification voice including the notification information corresponding to the type corresponding to one candidate unauthorized person that matches the second entrant E2 to the voice output device 6.

[0166] When the second entrant E2 is a person registered in the regional suspicious person information, that is, when the type corresponding to one candidate permittee who matches the second entrant E2 is "registered suspicious person", as shown in FIG. 18, the second output unit 178 causes the second display device 5 to display a second notification image G22a including seventh notification information, which is notification information, in the display area A2. Here, the seventh notification information is information that strongly urges the registered suspicious person to stop entering from the first area AR1 to the second area AR2. As an example, the second notification image G22a includes a marker M2 and a character string image T2a including a character string (for example, "If you enter further, you will be reported!") that strongly urges the registered suspicious person to stop entering from the first area AR1 to the second area AR2.

[0167] (4.3) Variant 3 In this variant, as shown in FIG. 19, the processing unit 170 further includes a state determination unit 180 that determines which of the first state, the second state, and the third state the state in the shared part AR0 is based on the determination result of the authentication unit 173.

[0168] The first state is a state in which a permittee exists in the shared part AR0 and no non-permittee exists. The second state is a state in which a non-permittee exists in the shared part AR0 and no permittee exists. The third state is a state in which a permittee and a non-permittee exist in the shared part AR0.

[0169] The notification output unit 176 notifies the entrant E0 of notification information corresponding to the determination result of the state determination unit 180.

[0170] When the state determination unit 180 determines that it is the first state, the notification output unit 176 notifies the entrant E0, who is a permittee, of notification information notifying that the entrant is authenticated by the lobby intercom 9.

[0171] In addition, when the state determination unit 180 determines that the state in the shared part AR0 is the second state or the third state, the notification output unit 176 notifies the entrant E0 of notification information that urges the non-permittee to stop entering from the first area AR1 to the second area AR2.

[0172] Below, the operation examples of the notification output unit 176 when the state in the shared part AR0 is in the second state or the third state will be described respectively.

[0173] First, as an example of the second state, as shown in FIG. 20, assume a state where only the intruder E0 (second intruder E2), who is an unauthorized person, exists in the second area AR2 of the shared part AR0. Such a state can occur, for example, when a resident of the apartment building F10 goes out from the second area AR2 to the first area AR1 and the second intruder E2 enters from the first area AR1 into the second area AR2.

[0174] In such a second state, the second output unit 178 of the notification output unit 176 causes the second display device 5 to display a second notification image G22 including notification information (first notification information) prompting the suspension of entry from the first area AR1 to the second area AR2 in the display area A2.

[0175] As an example, the second notification image G22 includes a marker M2 and a character string image T2 including a character string (for example, "Illegal entry!") prompting the suspension of entry from the first area AR1 to the second area AR2.

[0176] Next, as an example of the third state, as shown in FIG. 21, assume a state where the entrant E0 (first entrant E1), who is an authorized person, and the entrant E0 (second entrant E2), who is an unauthorized person, exist in the second area AR2.

[0177] In such a third state, the second output unit 178 causes the second display device 5 to display a second notification image G21 including the second notification information in the display area A1.

[0178] As an example, the second notification image G21 includes a marker M1 and a character string image T1 including a character string (for example, "Authenticated") notifying that the first entrant E1 has been authenticated on the lobby intercom 9.

[0179] Also, in the third state, the second output unit 178 causes the second display device 5 to display a second notification image G22b including the eighth notification information in the display area A2. Here, the eighth notification information is notification information that more indirectly (euphemistically) prompts the cancellation of entry from the first area AR1 to the second area AR2 as compared with the first notification information. That is, the notification information (the eighth notification information) when the state in the second area AR2 is the third state is more indirect in prompting the non-permitted person to cancel the entry from the first area AR1 to the second area AR2 as compared with the notification information (the first notification information) when the state in the second area AR2 is the second state.

[0180] As an example, the second notification image G22b includes a marker M2 and a character string image T2b including a character string (e.g., "Not authenticated") that more indirectly prompts the cancellation of entry from the first area AR1 to the second area AR2 as compared with the character string ("Trespassing!") included in the character string image T2. Thereby, the degree of warning to the non-permitted person can be weakened, and the occurrence of unforeseen situations such as the non-permitted person impulsively causing harm to the permitted person can be suppressed.

[0181] Also, when the state determination unit 180 determines that the state in the second area AR2 of the shared area AR0 is the third state, the second output unit 178 causes the second display device 5 to display a warning image G4 for allowing the permitted person (the first entrant E1) to recognize the presence of the non-permitted person (the second entrant E2) in at least a part of the display area A3.

[0182] The display area A3 is an area different from the display areas A1 and A2 where the second notification image G21 and the second notification image G22b are respectively displayed on the floor surface 10. As an example, as shown in FIGS. 21 and 22, the display area A3 includes the display areas A1 and A2 and is an area wider than each of the display areas A1 and A2. Note that the display area A3 may be an area that does not include the display areas A1 and A2.

[0183] As an example, the attention - attracting image G4 includes a marker M3 that causes attention to be directed in a specific direction, as shown in FIG. 21. The marker M3 is displayed at a position that enters the field of view of the first entrant E1 in the display area A3. Thus, even when the second entrant E2 has not entered the field of view of the first entrant E1, the first entrant E1 can recognize the presence of the second entrant E2, who is an unauthorized person, by visually recognizing the marker M3.

[0184] Also, as an example, the attention - attracting image G4 is a single - color image displayed in an area of the display area A3 other than the markers M1, M2, the character string image T1, and the character string image T2b, as shown in FIG. 22. The single - color image is a color (for example, orange) different from the colors of each of the markers M1 and M2 (for example, green and red). Note that the attention - attracting image G4, which is a single - color image, may be the same color as either one of the colors of the markers M1 and M2.

[0185] (4.4) Variant 4 In the basic example, the first notification image G1 included a still image Im21 obtained by cutting out an area in which at least the head of the second entrant E2 appears from the second captured image Im2 at the stage when the second entrant E2 is present in the first area AR1. However, the display image Im21 may be updated at a predetermined interval. In other words, the first output unit 177 may update the display image Im21 to be displayed on the display unit 41 at a predetermined interval. That is, the display image Im21 may be a moving image.

[0186] Also in this case, the display image Im21 may be a real - time moving image or a playback moving image that repeats a moving image captured over a certain period.

[0187] Note that the size of the area cut out from the second captured image Im2 may change depending on the position of the second entrant E2 and the like. However, regardless of the size of the area cut out from the second captured image Im2, the first output unit 177 causes the display image Im21 to be displayed on the display unit 41 so that the display image Im21 has a constant size.

[0188] (4.5) Variant Example 5 When a plurality of people (for example, entrant E0) are captured in the second captured image Im2, the first output unit 177 may cut out a plurality of display images Im21 corresponding to each of the plurality of people from the second captured image Im2 and display them on the display unit 41.

[0189] As an example, when the first entrant E1 who is a permitted person and the second entrant E2 who is a non-permitted person are captured in the second captured image Im2, as shown in FIG. 23, a first notification image G1 including two display images Im21 (Im211, Im212) is displayed on the display unit 41. The display images Im211 and Im212 are display images Im21 corresponding to the first entrant E1 and the second entrant E2, respectively. In this case, the display images Im211 and Im212 are cut out in different shapes. For example, the display image Im211 is cut out in a circular shape, and the display image Im212 is cut out in a rectangular shape. Thereby, a person who visually recognizes the first notification image G1 can distinguish between a permitted person and a non-permitted person. Also, in this case, a notification image G120 ("recording for 24 hours") notifying that the second entrant E2 is a non-permitted person is displayed in an area below the display image Im212 corresponding to the non-permitted second entrant E2. Thereby, a person who visually recognizes the first notification image G1 can recognize that the person shown in the display image Im212 is a non-permitted person.

[0190] Also, as an example, when a plurality (for example, four) of second entrants E2 (E21 to E24) who are non-permitted persons are captured in the second captured image Im2, as shown in FIG. 24, a first notification image G1 including four display images Im21 (Im213 to Im216) is displayed on the display unit 41. The display images Im213 to Im216 are display images Im21 corresponding to each of the second entrants E21 to E24. In this case, the display images Im213 to Im216 are cut out in the same shape, for example, and are resized to the same size and then displayed.

[0191] (4.6) Variant Example 6 As shown in FIG. 25, the second output unit 178 may change the display area A1 following the change in the body orientation of the first entrant E1 detected by the motion detection unit 172. More specifically, when the first entrant E1 rotates the body, the second output unit 178 rotates the display area A1 by the same amount (rotation angle) as the body rotation of the first entrant E1. As a result, the character string image T1 displayed in the display area A1 is displayed such that the upward direction of the characters included in the character string image T1 coincides with the front direction of the body of the first entrant E1. Therefore, even when the first entrant E1 changes the body orientation, it becomes easier to recognize the characters included in the character string image T1.

[0192] Similarly, the second output unit 178 may change the display area A2 following the change in the body orientation of the second entrant E2 detected by the motion detection unit 172.

[0193] Also, as shown in FIG. 26, the second output unit 178 may change the display area A1 following the change in the face orientation of the first entrant E1 detected by the motion detection unit 172. More specifically, when the first entrant E1 rotates the face, the second output unit 178 rotates the display area A1 by the same amount (rotation angle) as the face rotation of the first entrant E1. As a result, the character string image T1 displayed in the display area A1 is displayed such that the upward direction of the characters included in the character string image T1 coincides with the front direction of the face of the first entrant E1. Therefore, even when the first entrant E1 changes the face orientation, it becomes easier to recognize the characters included in the character string image T1.

[0194] Similarly, the second output unit 178 may change the display area A2 following the change in the face orientation of the second entrant E2 detected by the motion detection unit 172.

[0195] (4.7) Modification Example 7 In the basic example, the notification output unit 176 notifies the entrant E0 of the notification information according to the determination result in the face authentication process (the second authentication process and the third authentication process in the basic example) by the authentication unit 173. However, the notification output unit 176 may notify the entrant E0 of the notification information according to the detection result of the motion detection unit 172.

[0196] This will be described in detail below.

[0197] The authentication unit 173 according to this modification example determines whether the entrant E0 is a permitted person or a non-permitted person based on the behavior information regarding the behavior of the entrant E0 obtained from the detection result of the motion detection unit 172. As described above, the behavior information regarding the behavior of the entrant E0 is information including the movement path of the entrant E0 calculated by the motion detection unit 172.

[0198] Specifically, when the entrant E0 does not pass through the predetermined range AR3 (see FIGS. 6 to 9) around the lobby intercom 9, the authentication unit 173 determines that the entrant E0 is a non-permitted person because the possibility that the entrant E0 is undergoing authentication by the lobby intercom 9 is low.

[0199] As an example, assume the same situation as shown in the above basic example.

[0200] As shown in FIG. 7, the authentication unit 173 determines that the first entrant E1 is a permitted person who has undergone authentication by the lobby intercom 9 because the movement path Tr1 of the first entrant E1 passes through the predetermined range AR3 around the lobby intercom 9 that authenticates visitors to the apartment building F10.

[0201] Also, since the movement path Tr2 of the second entrant E2 does not pass through the predetermined range AR3, the authentication unit 173 determines that the second entrant E2 is a non-permitted person.

[0202] The notification output unit 176 notifies the first entrant E1 and the second entrant E2 of notification information corresponding to the determination result of the authentication unit 173 based on the behavior information regarding the behaviors of the first entrant E1 and the second entrant E2 obtained from the detection result of the motion detection unit 172. That is, the notification output unit 176 notifies the first entrant E1 and the second entrant E2 of notification information according to the detection result of the motion detection unit 172.

[0203] Note that the notification output unit 176 may notify the first entrant E1 and the second entrant E2 of notification information according to both the determination result in the face authentication process (the second authentication process and the third authentication process in the basic example) by the authentication unit 173 and the detection result of the motion detection unit 172.

[0204] (4.8) Other Modification Examples The notification system 100 in the present disclosure includes, for example, a control unit 17 or the like of the first control device 1 and includes a computer system. The computer system mainly includes a processor and a memory as hardware. By the processor executing a program recorded in the memory of the computer system, the function as the control unit 17 in the present disclosure is realized. The program may be recorded in advance in the memory of the computer system, may be provided through a telecommunication line, or may be recorded and provided in a non-temporary recording medium such as a memory card, an optical disk, or a hard disk drive readable by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). Here, the integrated circuit such as the IC or LSI has different names depending on the degree of integration, and includes an integrated circuit called a system LSI, a VLSI (Very Large Scale Integration), or a ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) that is programmed after the manufacture of the LSI, or a logic device capable of reconfiguring the bonding relationship inside the LSI or reconfiguring the circuit section inside the LSI can also be adopted as the processor. The one or more electronic circuits may be integrated on one chip, or may be provided distributed on a plurality of chips. The plurality of chips may be integrated in one device, or may be provided distributed in a plurality of devices. The computer system here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0205] Also, it is not an essential configuration for the first control device 1 that a plurality of functions in the first control device 1 are integrated in one housing, and the components of the first control device 1 may be provided dispersedly in a plurality of housings. Furthermore, at least some functions of the first control device 1, such as the control unit 17, may be realized by, for example, a cloud (cloud computing) or the like.

[0206] Also, the functions of the first control device 1 and the functions of the second control device 2 may be integrated in one housing.

[0207] (5) Summary As described above, the notification system (100) according to the first aspect includes a processing unit (170), a motion detection unit (172), and a notification output unit (176). The processing unit (170) determines the attributes of a person moving within the shared area (AR0) of the facility (F1) based on the captured image (lm2) of the person moving within the shared area (AR0). The motion detection unit (172) detects the motion of a person moving within the shared area (AR0) based on the captured image (lm2). The notification output unit (176) notifies a person moving within the shared area (AR0) of notification information corresponding to at least one of the determination result of the processing unit (170) and the detection result of the motion detection unit (172).

[0208] According to this aspect, since the notification information is changed according to at least one of the determination result of the processing unit (170) and the detection result of the motion detection unit (172), the degree of attention to the notification information can be increased, and furthermore, the content can be made suitable for the person (target person) to whom the notification information is to be notified.

[0209] In the notification system (100) according to the second aspect, in the first aspect, the shared area (AR0) includes a first area (AR1) and a second area (AR2) existing inside the facility (F1) rather than the first area (AR1). The notification output unit (176) notifies a person of the notification information in any of the state where the person moving within the shared area (AR0) exists in the first area (AR1) and the state where the person exists in the second area (AR2).

[0210] According to this aspect, the notification target of the notification information can be selected from the people present in the first area (AR1) and the people present in the second area (AR2). Further, the content of the notification information can be changed according to whether the person moving within the shared area (AR0) is present in either the first area (AR1) or the second area (AR2).

[0211] In the notification system (100) according to the third aspect, in the first or second aspect, the shared area (AR0) includes a first area (AR1) and a second area (AR2) existing inside the facility (F1) rather than the first area (AR1). The processing unit (170) has an authentication unit (173) that determines, based on the captured image (lm2), whether the person moving within the shared area (AR0) is a permitted person whose entry from the first area (AR1) to the second area (AR2) is permitted or a non-permitted person whose entry from the first area (AR1) to the second area (AR2) is not permitted. The notification output unit (176) notifies the person moving within the shared area (AR0) of notification information according to the determination result of the authentication unit (173).

[0212] According to this aspect, it is possible to notify the person moving within the shared area (AR0) of appropriate notification information according to whether the person moving within the shared area (AR0) is a permitted person or a non-permitted person.

[0213] In the notification system (100) according to the fourth aspect, in the third aspect, the authentication unit (173) determines that the person moving within the shared area (AR0) is a permitted person when there is one candidate permitted person who matches the person moving within the shared area (AR0) among the plurality of candidate permitted persons whose entry from the first area (AR1) to the second area (AR2) is permitted. The plurality of candidate permitted persons are associated one-to-one with a plurality of types representing the attributes of the permitted persons. The notification output unit (176) notifies the person moving within the shared area (AR0) of notification information according to the type corresponding to one candidate permitted person who matches the person moving within the shared area (AR0).

[0214] According to this aspect, appropriate notification information corresponding to the type of the permittee can be notified to the permittee.

[0215] In the notification system (100) according to the fifth aspect, in the third or fourth aspect, the processing unit (170) further includes a state determination unit (180) that determines, based on the determination result of the authentication unit (173), which of the first state, the second state, and the third state the state in the shared unit (AR0) is. The first state is a state in which a permittee exists in the shared unit (AR0) and no non-permittee exists. The second state is a state in which a non-permittee exists in the shared unit (AR0) and no permittee exists. The third state is a state in which a permittee and a non-permittee exist in the shared unit (AR0). The notification output unit (176) notifies a person moving within the shared unit (AR0) of notification information corresponding to the determination result of the state determination unit (180).

[0216] According to this aspect, appropriate notification information corresponding to the determination result of the state determination unit (180) can be notified to a person moving within the shared unit (AR0). Also, when the state in the shared unit (AR0) changes, appropriate notification information corresponding to the change in the state can be notified to a person moving within the shared unit (AR0).

[0217] In the notification system (100) according to the sixth aspect, in the fifth aspect, when the state determination unit (180) determines that the state in the shared unit (AR0) is the second state or the third state, the notification output unit (176) notifies a person moving within the shared unit (AR0) of notification information prompting a non-permittee to stop entering from the first area (AR1) to the second area (AR2). The notification information when the state in the shared unit (AR0) is the third state prompts a non-permittee to stop entering from the first area (AR1) to the second area (AR2) more indirectly than the notification information when the state in the shared unit (AR0) is the second state.

[0218] According to this aspect, when the state in the shared area (AR0) is the third state in which both authorized and unauthorized persons are present in the shared area (AR0), by more indirectly prompting the unauthorized person to stop entering from the first area (AR1) to the second area (AR2), the possibility that the unauthorized person will revolt and harm the authorized person can be reduced.

[0219] The notification system (100) according to the seventh aspect further includes a display device (5) that displays an image on the floor surface (10) of the shared area (AR0) in any of the first to sixth aspects. The notification output unit (176) notifies the person moving within the shared area (AR0) of the notification information by causing the display device (5) to display a notification image (G2) including the notification information on the floor surface (10).

[0220] According to this aspect, the notification information can be surely notified to the person moving within the shared area (AR0).

[0221] In the notification system (100) according to the eighth aspect, in the seventh aspect, the notification output unit (176) causes the display device (5) to display the notification image (G2) in a display area (A1, A2) including the area where the person moving within the shared area (AR0) is present on the floor surface (10).

[0222] According to this aspect, the notification information can be more surely notified to the person moving within the shared area (AR0).

[0223] In the notification system (100) according to the ninth aspect, in the eighth aspect, the notification output unit (176) changes the display area (A1, A2) following the movement of the person moving within the shared area (AR0).

[0224] According to this aspect, the notification information can be more surely notified to the person moving within the shared area (AR0).

[0225] In the notification system (100) according to the tenth aspect, in the ninth aspect, the movement of the person moving within the shared area (AR0) includes movement on the floor surface (10).

[0226] According to this aspect, it is possible to more surely notify a person moving within the shared area (AR0) of the notification information.

[0227] In the notification system (100) according to the eleventh aspect, in the ninth or tenth aspect, the movement of a person moving within the shared area (AR0) includes a change in body orientation.

[0228] According to this aspect, since the notification information is displayed directly facing the body orientation of the moving person, it is possible to more surely notify a person moving within the shared area (AR0) of the notification information.

[0229] In the notification system (100) according to the twelfth aspect, in any one of the ninth to eleventh aspects, the movement of a person moving within the shared area (AR0) includes a change in face orientation.

[0230] According to this aspect, since the notification information is displayed directly facing the face orientation of the moving person, it is possible to more surely notify a person moving within the shared area (AR0) of the notification information.

[0231] The notification system (100) according to the thirteenth aspect further includes a display device (4) having a display unit (41) in any one of the first to twelfth aspects. The notification output unit (176) cuts out a display image (Im21) in which at least the head (H1) of a person moving within the shared area (AR0) is captured from the captured image (lm2) and displays it on the display unit (41).

[0232] According to this aspect, it becomes easier to recognize the object captured in the display image (Im21).

[0233] In the notification system (100) according to the fourteenth aspect, in the thirteenth aspect, the notification output unit (176) displays the display image (Im21) on the display unit (41) so that the display image (Im21) has a certain size.

[0234] According to this aspect, since the display image (Im21) is displayed in the same size regardless of the distance or position of the moving person, it becomes easier to recognize the object shown in the display image (Im21).

[0235] In the notification system (100) according to the 15th aspect, in the 13th or 14th aspect, the notification output unit (176) updates the display image (Im21) to be displayed on the display unit (41) at a predetermined interval.

[0236] According to this aspect, it becomes easier to recognize the object shown in the display image (Im21).

[0237] In the notification system (100) according to the 16th aspect, in any of the 13th to 15th aspects, when a plurality of people are shown in the captured image (lm2), the notification output unit (176) cuts out a plurality of display images (Im21) corresponding to each of the plurality of people from the captured image (lm2) and displays them on the display unit (41).

[0238] According to this aspect, a plurality of people can be visually recognized simultaneously.

[0239] The notification system (100) according to the 17th aspect further includes a display device (5) that displays an image on the floor surface (10) of the shared part (AR0) in any of the 5th to 16th aspects. The notification output unit (176) notifies the person moving within the shared part (AR0) of the notification information by causing the display device (5) to display a first image (G2) including the notification information on the floor surface (10). When the state determination unit (180) determines that the state within the shared part (AR0) is the third state, the notification output unit (176) causes the display device (5) to display a second image (G4) for allowing the authorized person to recognize the presence of the unauthorized person in at least a part of a second display area (A3) that is different from the first display areas (A1, A2) where the first image (G2) is displayed on the floor surface (10).

[0240] According to this aspect, even when there is no unauthorized person within the sight of the permittee, by visually recognizing the second image (G4), the permittee can recognize that there is an unauthorized person in the shared area (AR0).

[0241] In the notification system (100) according to the 18th aspect, in any of the 3rd to 17th aspects, when there is no candidate permittee who matches the person moving within the shared area (AR0) among the plurality of candidate permittees whose entry from the first area (AR1) to the second area (AR2) is permitted, the authentication unit (173) determines that the person moving within the shared area (AR0) is an unauthorized person. When there is a candidate unauthorized person who matches a person who is an unauthorized person among at least one candidate unauthorized person whose entry from the first area (AR1) to the second area (AR2) is not permitted, the authentication unit (173) determines that the person who is an unauthorized person is a specific unauthorized person. At least one candidate unauthorized person is associated one-to-one with at least one type representing the attribute of the unauthorized person. The notification output unit (176) notifies the person who is a specific unauthorized person of notification information corresponding to the type corresponding to one candidate unauthorized person who matches the person who is a specific unauthorized person.

[0242] According to this aspect, for example, appropriate notification information can be notified to a person who requires particular caution, such as a person registered in the suspicious person information of the area.

[0243] The notification system (100) according to the 19th aspect further includes an audio output device (6) that outputs audio in any of the 1st to 18th aspects. The notification output unit (176) notifies the person moving within the shared area (AR0) of the notification information by causing the audio output device (6) to output a notification audio including the notification information.

[0244] According to this aspect, the notification information can be more reliably notified to the person moving within the shared area (AR0).

[0245] The notification system (100) according to the 20th aspect is, in any of the 1st to 19th aspects, the motion detection unit (172) detects the moving direction and moving speed of a person moving within the shared area (AR0).

[0246] According to this aspect, the motion detection unit (172) can detect the moving path of a person moving within the shared area (AR0). As a result, a person moving within the shared area (AR0) can be tracked more reliably. Also, the notification information can be displayed more accurately according to the position where a person moving within the shared area (AR0) exists. Furthermore, these effects can improve the possibility that a person moving within the shared area (AR0) recognizes the notification information.

[0247] The notification method according to the 21st aspect includes a processing step of determining the attributes of a person moving within the shared area (AR0) of a facility (F1) based on an imaging image (lm2) of the person moving within the shared area (AR0), a motion detection step of detecting the motion of the person moving within the shared area (AR0) based on the imaging image (lm2), and a notification output step of notifying the person moving within the shared area (AR0) of notification information according to at least one of the determination result in the processing step and the detection result in the motion detection step.

[0248] According to this aspect, since the notification information is changed according to at least one of the determination result in the processing step and the detection result in the motion detection step, the degree of attention to the notification information can be increased, and furthermore, the content can be made suitable for the person (target person) to whom the notification information is to be notified.

[0249] The program according to the 22nd aspect is a program for causing one or more processors to execute the notification method according to the 21st aspect.

[0250] According to this aspect, since the notification information is changed according to at least one of the determination result in the processing step and the detection result in the motion detection step, the degree of attention to the notification information can be increased, and furthermore, the content can be made suitable for the person (target person) to whom the notification information is to be notified.

Description of Reference Numerals

[0251] 4 First display device 5 Second display device 6 Audio output device 10 Bed surface 41 Display unit 100 Notification system 170 Processing unit 172 Motion detection unit 173 Authentication unit 176 Notification output unit 180 State determination unit A1, A2 Display area (first display area) A3 Second display area AR0 Shared part AR1 First area AR2 Second area F1 Facility G2 Notification image (first image) G4 Second image H1 Head Im2 Captured image Im21 Display image

Claims

1. A processing unit that determines the attributes of the person based on the captured image of the person moving within the shared area of the facility, An action detection unit that detects the actions of the person based on the captured image, A notification output unit that notifies the person of notification information according to at least one of the determination result of the processing unit and the detection result of the action detection unit, A notification system.

2. The shared area includes a first area and a second area existing inside the facility rather than the first area, The notification output unit notifies the person of the notification information in either a state where the person is present in the first area or a state where the person is present in the second area. The notification system according to claim 1.

3. The shared area includes a first area and a second area existing inside the facility rather than the first area, The processing unit has an authentication unit that determines, based on the captured image, whether the person is a permitted person whose entry from the first area to the second area is permitted or a non-permitted person whose entry from the first area to the second area is not permitted, The notification output unit notifies the person of the notification information according to the determination result of the authentication unit. The notification system according to claim 1 or 2.

4. The authentication unit determines that the person is a permitted person when there is one candidate permitted person that matches the person among a plurality of candidate permitted persons whose entry from the first area to the second area is permitted, The plurality of candidate permitted persons are associated with a plurality of types representing the attributes of the permitted persons in a one-to-one correspondence, The notification output unit notifies the person of the notification information according to the type corresponding to the one candidate permitted person that matches the person. The notification system according to claim 3.

5. The processing unit further has a state determination unit that determines, based on the determination result of the authentication unit, whether the state within the shared area is a first state where the permitted person exists within the shared area and the non-permitted person does not exist, a second state where the non-permitted person exists within the shared area and the permitted person does not exist, or a third state where both the permitted person and the non-permitted person exist within the shared area, The notification output unit notifies the person of the notification information according to the determination result of the state determination unit. The notification system according to claim 3.

6. When the state determination unit determines that the state in the shared area is the second state or the third state, the notification output unit notifies the person of the notification information for prompting the unauthorized person to stop entering from the first area to the second area. When the state is the third state, the notification information prompts the unauthorized person to stop entering from the first area to the second area more indirectly than the notification information when the state is the second state. The notification system according to claim 5.

7. The system further includes a display device for displaying an image on the floor surface of the shared area. The notification output unit notifies the person of the notification information by causing the display device to display a notification image including the notification information on the floor surface. The notification system according to claim 1 or 2.

8. The notification output unit causes the display device to display the notification image in a display area including the area where the person is present on the floor surface. The notification system according to claim 7.

9. The notification output unit changes the display area following the movement of the person. The notification system according to claim 8.

10. The movement includes movement on the floor surface. The notification system according to claim 9.

11. The movement includes a change in body orientation. The notification system according to claim 9.

12. The movement includes a change in face orientation. The notification system according to claim 9.

13. The system further includes a display device having a display unit. The notification output unit cuts out a display image in which at least the head of the person is shown from the captured image and displays it on the display unit. The notification system according to claim 1 or 2.

14. The notification output unit causes the display unit to display the display image so that the display image has a certain size. The notification system according to claim 13.

15. The notification output unit updates the display image to be displayed on the display unit at a predetermined interval. The notification system according to claim 13.

16. When a plurality of people are shown in the captured image, the notification output unit cuts out a plurality of display images corresponding to each of the plurality of people from the captured image and displays them on the display unit. The notification system according to claim 13.

17. The system further includes a display device for displaying an image on the floor surface of the shared area. The notification output unit By causing the display device to display a first image including the notification information on the floor surface, the notification information is notified to the person. When the state determination unit determines that the state in the shared area is the third state, a second image for allowing the permitted person to recognize the presence of the non-permitted person is displayed on at least a part of a second display area that is different from the first display area where the first image on the floor surface is displayed, on the display device. The notification system according to claim 5.

18. The authentication unit When there is no candidate permitted person who matches the person among the plurality of candidate permitted persons whose entry from the first area to the second area is permitted, it is determined that the person is a non-permitted person. When there is a candidate non-permitted person who matches the non-permitted person among at least one candidate non-permitted person whose entry from the first area to the second area is not permitted, it is determined that the person is a specific non-permitted person. The at least one candidate non-permitted person is associated one-to-one with at least one type representing the attribute of the non-permitted person. The notification output unit notifies the person of the notification information corresponding to the type corresponding to the one candidate non-permitted person who matches the person who is the specific non-permitted person. The notification system according to claim 3.

19. Further comprising an audio output device that outputs audio, The notification output unit notifies the person of the notification information by causing the audio output device to output a notification audio including the notification information. The notification system according to claim 1 or 2.

20. The motion detection unit detects the moving direction and moving speed of the person. The notification system according to claim 1 or 2.

21. A processing step of determining the attribute of a person based on a captured image of the person moving in a shared area of a facility, A motion detection step of detecting the motion of the person based on the captured image, A notification output step of notifying the person of notification information according to at least one of the determination result in the processing step and the detection result in the motion detection step. Notification method.

22. A program for causing one or more processors to execute the notification method according to claim 21.

Images