Utilization management device, system, method, and program

Abstract

A usage management device (1) comprising: an acquisition unit (11) that acquires a captured image of a prospective user of a plurality of facilities having usage restrictions; an authentication control unit (12) that causes an authentication device in which facial feature information of people having permission to use the plurality of facilities is stored to perform face authentication on the captured image; a reception unit (13) that receives a selection of any one of the plurality of facilities from the prospective user; a restriction removal unit (14) that, if face authentication has succeeded, performs restriction removal for the selected facility; and a record registration unit (15) that registers, in a storage unit (16), a removal record (170) associating a facility (171) for which restriction removal was performed and a date and time (172) with a permitted user (173) who is the prospective user for whom face authentication has succeeded.

Description

[Technical field]

[0001] The present invention relates to a utilization management device, system, method, and program, and more particularly to a utilization management device, system, method, and program for managing the utilization of a plurality of facilities. [Background technology]

[0002] Patent Document 1 discloses a technology that performs facial recognition using images of the face of the person being monitored taken by a camera installed at the entrance or exit of a building, and when a face that matches the facial recognition data is detected, starts recording the video captured by the camera.

[0003] Patent Document 2 discloses a technology in which mailboxes corresponding to each dwelling unit in an apartment building are each provided with an openable / closable door, and the door opens when authentication of the resident of each dwelling unit is successful. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-111506 A [Patent Document 2] JP 2015-089441 A Summary of the Invention [Problem to be solved by the invention]

[0005] The technologies disclosed in Patent Documents 1 and 2 enable individual control of building entrances and mailboxes by face recognition, but have the problem of insufficient comprehensive utilization of these usage histories.

[0006] The present disclosure has been made to solve such problems, and aims to provide a usage management device, system, method, and program for comprehensively understanding the living conditions of facility users. [Means for solving the problem]

[0007] A usage management device according to a first aspect of the present disclosure includes: an acquisition unit that acquires images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control unit that causes an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in a storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; Equipped with.

[0008] A usage management device according to a second aspect of the present disclosure includes: A storage unit that stores facial feature information of a person who is permitted to use a plurality of facilities that are subject to usage restrictions; an acquisition unit that acquires photographed images of the users of the plurality of facilities; an authentication control unit that performs face authentication on the captured image using the facial feature information; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in the storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; Equipped with.

[0009] A usage management system according to a third aspect of the present disclosure includes: a usage management device connected to a plurality of facilities on which usage restrictions are imposed; an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities; The usage management device includes: an acquisition unit that acquires photographed images of the users of the plurality of facilities; an authentication control unit that causes the authentication device to perform face authentication on the captured image; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in a storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; Equipped with.

[0010] A usage management method according to a fourth aspect of the present disclosure includes: The computer Acquire photographs of people who wish to use multiple facilities that are subject to usage restrictions, performing face authentication on the captured image using an authentication device that stores facial feature information of persons who are permitted to use the plurality of facilities; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; A release history that associates the facility and date and time when the restriction was released with the authorized user who is the intended user and has succeeded in the face authentication is registered in a storage unit.

[0011] A usage management method according to a fifth aspect of the present disclosure includes: A computer including a storage unit that stores facial feature information of a person permitted to use a plurality of facilities that are subject to usage restrictions, Acquire photographed images of the persons who wish to use the facilities, performing face authentication on the captured image using the facial feature information; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; A release history that associates the facility and date and time when the restriction was released with the authorized user who is the intended user and has succeeded in the face authentication is registered in the storage unit.

[0012] A usage management program according to a sixth aspect of the present disclosure includes: An acquisition process for acquiring images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control process for causing an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in a storage unit a release history in which the restriction is released in association with the equipment and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; to be executed by the computer.

[0013] A usage management program according to a seventh aspect of the present disclosure includes: A computer including a storage unit that stores facial feature information of a person permitted to use a plurality of facilities that are subject to usage restrictions, An acquisition process for acquiring photographed images of the users of the plurality of facilities; an authentication control process for performing face authentication on the captured image using the facial feature information; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in the storage unit a release history in which the restriction is released in association with the equipment and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; Execute the command. Effect of the Invention

[0014] The present disclosure makes it possible to provide a usage management device, system, method, and program for comprehensively understanding the living conditions of facility users. [Brief description of the drawings]

[0015] [Figure 1] 1 is a block diagram showing a configuration of a usage management device according to a first embodiment of the present invention. [Diagram 2] 4 is a flowchart showing the flow of a usage management method according to the first embodiment. [Diagram 3] FIG. 11 is a block diagram showing a configuration of a usage management device according to a second embodiment. [Figure 4] 11 is a flowchart showing the flow of a usage management method according to the second embodiment. [Diagram 5] FIG. 11 is a block diagram showing the overall configuration of a usage management system according to a third embodiment. [Figure 6] FIG. 11 is a block diagram showing a configuration of an authentication device according to a third embodiment. [Figure 7] 13 is a flowchart showing the flow of face information registration processing according to the third embodiment. [Figure 8] 11 is a flowchart showing the flow of face recognition processing according to the third embodiment. [Figure 9] FIG. 11 is a block diagram showing a configuration of a usage management device according to a third embodiment. [Figure 10] 13 is a flowchart showing the flow of a restriction removal process according to the third embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a screen for designating a facility to be used according to the third embodiment. [Figure 12] 13 is a flowchart showing the flow of a trend analysis process according to the third embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a release history according to the third embodiment. [Figure 14] FIG. 11 is a block diagram showing the overall configuration of a usage management system according to a fourth embodiment. [Figure 15] FIG. 11 is a block diagram showing a configuration of a usage management terminal according to the fourth embodiment. [Figure 16] FIG. 11 is a block diagram showing the configuration of a usage management server according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated descriptions will be omitted as necessary for clarity of explanation.

[0017] <Embodiment 1> Fig. 1 is a block diagram showing the configuration of a usage management device 1 according to the first embodiment. The usage management device 1 is an information processing device for managing the usage of multiple facilities (not shown) with usage restrictions. The usage management device 1 is connected to multiple facilities and an authentication device (not shown). The multiple facilities include, for example, at least two or more of an entrance control device in an apartment building, a garbage storage, a delivery box, and an electric vehicle charger.

[0018] The authentication device is assumed to store in advance facial feature information of a person who is permitted to use multiple facilities. The authentication device also accepts input of a face image or facial feature information from the usage management device 1, compares it with the pre-stored facial feature information, determines whether it matches or does not match, and outputs the determination result to the usage management device 1. Here, if there is a match, the determination result is that the face authentication was successful, and if there is a mismatch, the determination result is that the face authentication was unsuccessful. If the face authentication is successful, the determination result includes the user ID of the person whose face authentication was successful.

[0019] The usage management device 1 includes an acquisition unit 11, an authentication control unit 12, a reception unit 13, a restriction lifting unit 14, a history registration unit 15, and a storage unit 16. The acquisition unit 11 acquires images of a person who wishes to use a plurality of facilities. The authentication control unit 12 causes the authentication device to perform face authentication on the captured images. The reception unit 13 receives a selection of one of a plurality of facilities from the person who wishes to use the facility. The restriction lifting unit 14 lifts the restriction on the selected facility when the face authentication is successful. The history registration unit 15 registers the lifting history 170 in the storage unit 16. The storage unit 16 stores the lifting history 170. The lifting history 170 is associated with a facility 171 that has been lifted from a restriction, a date and time 172, and an authorized user 173. Here, the authorized user 173 is an authorized user who has been successfully authenticated.

[0020] FIG. 2 is a flowchart showing the flow of the usage management method according to the first embodiment. First, the acquisition unit 11 acquires a photographed image of a person who wishes to use a plurality of facilities on which usage is restricted (S11). Next, the authentication control unit 12 causes the authentication device to perform face authentication on the photographed image (S12). Then, the reception unit 13 receives a selection of one of the plurality of facilities from the person who wishes to use (S13). The authentication control unit 12 judges whether or not the face authentication is successful (S14). If the face authentication is successful, the restriction lifting unit 14 lifts the restriction on the selected facility (S15). Then, the history registration unit 15 registers in the storage unit 16 a lifting history 170 in which the facility 171 and date and time 172 from which the restriction has been lifted are associated with the permitted user 173 who is the person who wishes to use and whose face authentication has been successful (S16).

[0021] In this way, according to this embodiment, it is possible to know when and which facility the permitted user 173 used from the release history 170, and therefore it is possible to comprehensively understand the living conditions of the user of the facility.

[0022] The usage management device 1 includes a processor, a memory, and a storage device, which are not shown in the figure. The storage device stores a computer program that implements the processing of the electronic payment method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. In this way, the processor realizes the functions of an acquisition unit 11, an authentication control unit 12, a reception unit 13, a restriction removal unit 14, a history registration unit 15, and a storage unit 16.

[0023] Alternatively, the acquisition unit 11, the authentication control unit 12, the acceptance unit 13, the restriction removal unit 14, the history registration unit 15, and the storage unit 16 may each be realized by dedicated hardware. Also, some or all of the components of each device may be realized by a general-purpose or dedicated circuit, processor, or a combination of these. hand These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and programs. In addition, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), etc. may be used as the processor.

[0024] Furthermore, when some or all of the components of the usage management device 1 are realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally arranged or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, etc., in a form in which each is connected via a communication network. Furthermore, the functions of the usage management device 1 may be provided in a SaaS (Software as a Service) format.

[0025] <Embodiment 2> The present embodiment 2 is a modified example of the above-mentioned embodiment 1. The usage management device 1 according to the embodiment 1 has an external authentication device perform face authentication. On the other hand, the usage management device 1a according to the present embodiment 2 performs face authentication inside the device.

[0026] 3 is a block diagram showing the configuration of a usage management device 1a according to the present embodiment 2. The usage management device 1a includes an acquisition unit 11, an authentication control unit 12a, a reception unit 13, a restriction lifting unit 14, a history registration unit 15, and a storage unit 16. The functions of the acquisition unit 11, the reception unit 13, the restriction lifting unit 14, and the history registration unit 15 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0027] The storage unit 16 prestores facial feature information 174 of persons permitted to use a plurality of facilities. The authentication control unit 12a uses the facial feature information 174 to perform face authentication on the facial area of ​​the person who wishes to use the facility that is included in the captured image.

[0028] Fig. 4 is a flowchart showing the flow of the usage management method according to the present embodiment 2. In Fig. 4, step S12 in Fig. 2 is replaced with step S12a, and the other steps are the same as those in Fig. 2. In step S12a, the authentication control unit 12a performs face authentication on the captured image using the facial feature information 174.

[0029] In this way, the second embodiment can also achieve the same effects as the first embodiment described above.

[0030] <Embodiment 3> The third embodiment is a specific example of the first embodiment described above. Fig. 5 is a block diagram showing the overall configuration of a usage management system 1000 according to the third embodiment. The usage management system 1000 includes a usage management device 100, an entrance gate 210, a waste storage 220, a delivery box 230, and an authentication device 400. The usage management device 100 and the authentication device 400 are connected via a network N. The network N is a wired or wireless communication line.

[0031] The entrance gate 210, the garbage storage 220, and the delivery box 230 are examples of facilities installed in, for example, a specific apartment building, and their usage is restricted by opening and closing controllers 211, 221, and 231. Each of the opening and closing controllers 211, 221, and 231 is connected to the usage management device 100.

[0032] For example, the entrance gate 210 is a door (gate) for restricting entry to the apartment house, and includes an opening / closing controller 211. The opening / closing controller 211 controls the door to be unlocked in response to a control release signal from the usage management device 100. The garbage storage 220 is a waste disposal site shared by the residents of the apartment house, and includes an opening / closing controller 221. The opening / closing controller 221 controls the lid of the garbage storage 220 to be unlocked in response to a control release signal from the usage management device 100. The delivery box 230 is a storage box for temporarily storing delivery items, and includes an opening / closing controller 231. The opening / closing controller 231 controls the lid of the delivery box 230 to be unlocked in response to a control release signal from the usage management device 100. The facilities connected to the usage management device 100 are not limited to these. Examples of facilities connected to the usage management device 100 include normal (standard charging speed) chargers and rapid chargers for electric vehicles (EVs), locking devices for shared bicycles, locking devices for shared parking lots, and vending machines that perform payments through facial recognition.

[0033] The authentication device 400 is an information processing device that associates and stores the user ID and facial feature information of a person (e.g., a resident of an apartment building) who is permitted to use the entrance gate 210, the garbage storage 220, and the delivery box 230. In addition, in response to a facial authentication request received from the outside, the authentication device 400 compares the facial image or facial feature information included in the request with the facial feature information of each user, and returns the comparison result (authentication result) to the request source.

[0034] 6 is a block diagram showing the configuration of an authentication device 400 according to the third embodiment. The authentication device 400 includes a face information DB 410, a face detection unit 420, a feature point extraction unit 430, a registration unit 440, and an authentication unit 450. The face information DB 410 stores a user ID 411 and facial feature information 412 of the user ID in association with each other. The facial feature information 412 is a collection of feature points extracted from a face image.

[0035] The face detection unit 420 detects a face area included in a registration image for registering face information, and outputs the face area to the feature point extraction unit 430. The feature point extraction unit 430 extracts feature points from the face area detected by the face detection unit 420, and outputs face feature information to the registration unit 440. Here, the face feature information is a collection of the extracted feature points. In addition, the feature point extraction unit 430 extracts feature points included in the face image received from the usage management device 100, and outputs the face feature information to the authentication unit 450.

[0036] The registration unit 440 issues a new user ID 411 when registering the facial feature information. The registration unit 440 associates the issued user ID 411 with facial feature information 412 extracted from the registered image and registers them in the facial information DB 410. The authentication unit 450 performs face authentication using the facial feature information 412. Specifically, the authentication unit 450 compares the facial feature information extracted from the face image with the facial feature information 412 in the facial information DB 410. The authentication unit 450 returns a response to the usage management device 100 regarding whether or not the facial feature information matches. Whether or not the facial feature information matches corresponds to the success or failure of authentication.

[0037] FIG. 7 is a flowchart showing the flow of the face information registration process according to the third embodiment. First, the authentication device 400 acquires a registration image included in a face information registration request (S21). For example, the authentication device 400 accepts a face information registration request from a user terminal (not shown) or the like via a network N. Next, the face detection unit 420 detects a face area included in the registration image (S22). Next, the feature point extraction unit 430 extracts feature points from the face area detected in step S22, and outputs face feature information to the registration unit 440 (S23). Finally, the registration unit 440 issues a user ID 411, associates the user ID 411 with face feature information 412, and registers the user ID 411 and face feature information 412 in the face information DB 410 (S24). Note that the authentication device 400 may receive the face feature information 412 from the usage management device 100 or the like, and register the face feature information 412 in the face information DB 410 in association with the user ID 411.

[0038] FIG. 8 is a flowchart showing the flow of face authentication processing by the authentication device 400. First, the feature point extraction unit 430 acquires a face image for authentication included in a face authentication request (S31). For example, the authentication device 400 receives a face authentication request from the usage management device 100 via the network N, and extracts face feature information from the face image included in the face authentication request as in steps S21 to S23. Alternatively, the authentication device 400 may receive face feature information from the usage management device 100. Next, the authentication unit 450 collates the acquired face feature information with the face feature information 412 in the face information DB 410 (S32). If the face feature information matches (Yes in S33), the authentication unit 450 identifies the user ID 411 of the user whose face feature information matches (S34), and returns the fact that face authentication was successful and the identified user ID 411 to the usage management device 100 (S35). If there is no matching facial feature information (No in S33), the authentication unit 450 returns a message to the usage management device 100 indicating that face authentication has failed (S36).

[0039] Returning to Fig. 5, the description will be continued. The usage management device 100 is an information terminal installed near the entrance of an apartment building. The usage management device 100 performs face authentication on the face area of ​​a person (user U) included in an image captured by a camera, and unlocks the selected equipment if the face authentication is successful.

[0040] 9 is a block diagram showing a configuration of a usage management device 100 according to the third embodiment. The usage management device 100 includes a storage unit 110, a memory 120, a communication unit 130, a camera 140, a display unit 150, and a control unit 160. The storage unit 110 is a storage device such as a hard disk or a flash memory. The storage unit 110 stores a program 111, a release history 112, and a notification setting 113. The program 111 is a computer program in which the processing of the usage management method according to the present embodiment is implemented.

[0041] The release history 112 is an example of the release history 170 described above. The release history 112 is information associating a facility ID 1121, a date and time 1122, and a user ID 1123. The facility ID 1121 is identification information of the facility whose usage restriction (lock) was released as a result of the user U having succeeded in face authentication. The date and time 1122 is the date and time when the usage restriction was released. The user ID 1123 is identification information of the user U whose face authentication was successful. The storage unit 110 accumulates a plurality of release histories 112, and may store two or more release histories for each user.

[0042] The notification setting 113 is information that associates a user ID 1131 with a notification destination 1132. The user ID 1131 is identification information of a resident of the apartment complex. The notification destination 1132 is information that indicates contact information for a family member, relative, or the like of the resident who does not reside in the apartment complex. The notification destination 1132 is a telephone number, an email address, or the like.

[0043] The memory 120 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 160. The communication unit 130 is a communication interface with the network N.

[0044] The camera 140 photographs a user U who wishes to use a facility such as the entrance gate 210, and outputs the photographed image to the control unit 160. The display unit 150 is a touch panel equipped with a display device such as a display and an input unit. The display unit 150 displays a selection screen for a facility (service) desired to be used, accepts a selection operation by the user U, and outputs the ID of the selected facility to the control unit 160.

[0045] The control unit 160 is a processor, that is, a control device, that controls each component of the usage management device 100. The control unit 160 loads the program 111 from the storage unit 110 into the memory 120 and executes the program 111. In this way, the control unit 160 realizes the functions of an acquisition unit 161, an authentication control unit 162, a reception unit 163, a restriction removal unit 164, a history registration unit 165, an analysis unit 166, and a notification unit 167.

[0046] The acquisition unit 161 is an example of the above-mentioned acquisition unit 11. The acquisition unit 161 acquires a captured image captured by the camera 140. It is assumed that the captured image includes a user U. Here, it is assumed that the user U is a person who wishes to use a facility such as the entrance gate 210.

[0047] The authentication control unit 162 is an example of the above-mentioned authentication control unit 12. The authentication control unit 162 causes the authentication device 400 to perform face authentication on the captured image acquired by the acquisition unit 161. For example, the authentication control unit 162 transmits a face authentication request including the acquired captured image to the authentication device 400 via the network N, and receives a face authentication result from the authentication device 400. The authentication control unit 162 may detect a face area of ​​the user U from the captured image, and include an image of the face area in the face authentication request. Alternatively, the authentication control unit 162 may extract face feature information from the face area, and include the face feature information in the face authentication request.

[0048] The reception unit 163 is an example of the above-mentioned reception unit 13. When the face authentication is successful, the reception unit 163 causes the display unit 150 to display a selection screen for the facility to be used. Then, the reception unit 163 receives the facility ID selected in response to a selection operation by the user U on the selection screen.

[0049] The restriction lifting unit 164 is an example of the above-mentioned restriction lifting unit 14. The restriction lifting unit 164 outputs a restriction lifting signal to the equipment corresponding to the selected equipment ID.

[0050] The history registration unit 165 is an example of the above-mentioned history registration unit 15. The history registration unit 165 registers in the storage unit 110 a release history 112 in which a facility ID 1121 and a date and time 1122 for which the restriction was released are associated with a user ID 1123 of a user U whose face authentication has been successful.

[0051] The analysis unit 166 analyzes the usage tendency of each facility of the permitted user from the release history 112 registered in the storage unit 110. For example, when release history 112 exists for a certain facility ID 1121 of a certain user ID 1123 in a similar time period on the same day of the week for several consecutive months, it can be understood that this is the weekly life pattern (usage tendency) of the user.

[0052] The notification unit 167 notifies the notification destination corresponding to the permitted user according to the release history 112. That is, the notification unit 167 identifies the notification destination 1132 associated with the user ID 1131, and notifies the identified notification destination 1132. In particular, when the usage tendency analyzed by the analysis unit 166 differs from a predetermined tendency, the notification unit 167 may notify the notification destination 1132 to that effect. For example, when the usage tendency of a certain user for the last two weeks differs from the user's usual usage tendency (several months before two weeks), the notification unit 167 may notify related parties of the user to that effect so that the related parties can grasp the change in the user's living situation. In addition, the notification unit 167 may determine whether or not the usage tendency differs from a predetermined tendency based on a combination of two or more facilities in the release history of a certain user. For example, the release history of two facilities, a "garbage storage" and an "entrance gate", may be combined to determine the tendency of the user's outing time.

[0053] 10 is a flowchart showing the flow of the restriction release process according to the third embodiment. First, the camera 140 captures an image of the user U standing in front of the usage management device 100. Then, the acquisition unit 161 acquires a captured image including the user U from the camera 140 (S401). Next, the authentication control unit 162 makes a face authentication request to the authentication device 400 (S402). That is, the authentication control unit 162 transmits a face authentication request including the captured image to the authentication device 400 via the network N. Then, the authentication control unit 162 receives a face authentication result from the authentication device 400 via the network N (S403). The face authentication result includes the user ID of the user whose face authentication was successful.

[0054] Here, the authentication control unit 162 judges whether or not the face authentication has been successful based on the face authentication result (S404). Specifically, the authentication control unit 162 judges whether or not the received face authentication result includes information indicating that the face authentication has been successful. If the face authentication has been successful, the reception unit 163 outputs and displays a selection screen for the facility to be used on the display unit 150 (S405).

[0055] FIG. 11 is a diagram showing an example of a selection screen 500 for facilities to be used according to the third embodiment. Here, it is assumed that there are five facilities connected to the utilization management device 100. The five facilities are, for example, the above-mentioned entrance gate 210, the garbage storage 220, and the delivery box 230, as well as an EV charger and a locking device for a shared bicycle. It is also assumed that the selection screen 500 displays selection buttons in terms of the services provided by each facility. That is, the selection screen 500 displays an entrance button 510, a garbage disposal button 520, a delivery receipt button 530, an EV charging button 540, and a bicycle sharing button 550. Each button is associated with the facility ID of the corresponding facility, and when the button is pressed, the associated facility ID is notified to the release history 112.

[0056] The entry button 510 is a selection button for releasing the restrictions of the opening / closing controller 211 and entering the apartment complex through the entrance gate 210. The trash disposal button 520 is a selection button for releasing the restrictions of the opening / closing controller 221 and disposing of trash in the trash storage 220. The delivery acceptance button 530 is a selection button for releasing the restrictions of the opening / closing controller 231 and receiving a parcel addressed to the user from the delivery box 230. The EV charging button 540 is a selection button for unlocking the EV charger and charging an electric vehicle using the EV charger. The bicycle sharing button 550 is a selection button for unlocking a shared bicycle and using a shared bicycle.

[0057] Returning to Fig. 10, the description will be continued. The user U performs a selection operation on any of the buttons on the selection screen 500 displayed on the display unit 150. In response to this, the reception unit 163 receives the selection of the facility to be used (S406). Specifically, the reception unit 163 acquires a facility ID associated with the button selected by the user U on the selection screen 500.

[0058] Then, the restriction release unit 164 releases the restriction on the facility corresponding to the selected facility ID (S407). For example, when the user U presses the trash disposal button 520, the restriction release unit 164 accepts the selection of the facility ID of the trash storage 220, and outputs a restriction release signal to the opening / closing controller 221.

[0059] Thereafter, the history registration unit 165 registers in the storage unit 110 the release history 112 in which the restriction-released facility ID 1121 and date and time 1122 are associated with the user ID 1123 of the user U whose face has been successfully authenticated (S408).

[0060] If the face authentication fails in step S404, the control unit 160 outputs (displays) a message to the effect that the face authentication failed on the display unit 150 (S409). In this case, the lock on the equipment is not released, and unauthorized use of the equipment by the user U can be prevented.

[0061] FIG. 12 is a flowchart showing the flow of the trend analysis process according to the third embodiment. It is assumed that the memory unit 110 stores the release history 112 for a specific user for a predetermined period (for example, several months). The analysis unit 166 analyzes the release history 112 for the specific user (S411). Specifically, the analysis unit 166 reads out from the memory unit 110 a plurality of release histories 112 whose date and time 1122 is within several months of the current date and time and includes a specific user ID 1123. The analysis unit 166 then analyzes the usage tendency of the plurality of release histories 112 that have been read out. Here, a known technique can be used for the analysis process of the usage tendency. When a certain regularity is found in the date and time of release of a certain piece of equipment, the analysis unit 166 can analyze the tendency that the equipment is used regularly in daily life. For example, if there is a release history of a garbage storage unit for a certain user every Monday and Thursday morning, this can be grasped as the life pattern of the user. Furthermore, the analysis unit 166 may store and save the analyzed usage trends in the storage unit 110 in association with the user. This allows the analysis unit 166 to use the analyzed usage trends for the same user for comparison at a later date.

[0062] Next, the notification unit 167 determines whether the usage tendency is different from a normal tendency (S412). The normal tendency may be a model life pattern. For example, the normal tendency may be that the restriction on the garbage storage unit is lifted between 7:00 and 8:00 a.m. every Monday and Thursday. Alternatively, the normal tendency may be the past usage tendency of the same user.

[0063] If it is determined in step S412 that the usage tendency is different from the normal tendency, the notification unit 167 notifies the notification destination that the usage tendency is different (S413). Specifically, the notification unit 167 refers to the notification setting 113, identifies the notification destination 1132 associated with the user ID 1131 to be analyzed, and notifies the identified notification destination 1132 of a predetermined message. The predetermined message may be, for example, a message that the user to be analyzed shows a tendency different from the normal usage tendency. This allows the family, relatives, etc. of the user to be analyzed to detect the possibility of an abnormality in the user at an early stage.

[0064] On the other hand, if it is determined in step S412 that the usage tendency is not different from the normal tendency, the notification unit 167 notifies the notification destination that the usage tendency is normal (S414). Specifically, the notification unit 167 refers to the notification setting 113, identifies the notification destination 1132 associated with the user ID 1131 to be analyzed, and notifies the identified notification destination 1132 of a predetermined message. The predetermined message may be, for example, a message that the user to be analyzed is following the normal usage tendency. This allows the family, relatives, etc. of the user to be analyzed to know that the user is safe. Note that the notification in step S414 does not necessarily have to be sent.

[0065] FIG. 13 is a diagram showing an example of the release history of a specific user A according to the third embodiment. For example, first, assume that the usage tendency is analyzed for the release history from the 1st to the 19th of X month. In this case, there is a usage tendency 1 of releasing the restriction on the garbage storage unit between 7:00 and 8:00 every Monday and Thursday, and it can be understood that the user takes out the garbage regularly. In addition, there is a usage tendency 2 of releasing the restriction on the entrance gate between 18:20 and 19:00 every Monday to Friday, and it can be understood that the user returns home during this time period on weekdays. In addition, since there is an interval of about 11 hours between the release of the restriction on the garbage storage unit and the release of the restriction on the entrance gate on Mondays and Thursdays, it is considered that the user is out during this time. Therefore, it can be said that there is a usage tendency 3 of going out for about 11 hours on weekdays.

[0066] Next, assume that the usage tendency is analyzed for the release history from the 22nd to the 26th of the Xth month. In this case, the restriction on the garbage storage unit was not released on the 22nd, which is a different tendency from the usage tendency 1. Also, since the time when the restriction on the entrance gate was released on weekdays is earlier than that of the usage tendency 2, this tendency is also different from the usage tendency 2. Furthermore, on the 25th, there was only about five and a half hours between the release of the restriction on the garbage storage unit and the release of the restriction on the entrance gate, which is a different tendency from the usage tendency 3 in terms of the time spent outside. In other words, it can be said that the usage tendency based on the combination of the two facilities, the "garbage storage unit" and the "entrance gate", is determined to be different from normal. Therefore, a notification is sent to the notification destination of user A in the above-mentioned step S413. This allows user A's family members and others to detect the possibility of an abnormality in user A at an early stage.

[0067] Here, there have been three main types of monitoring services that allow distant family members and relatives to monitor the living conditions of elderly people, etc. However, each type has its disadvantages.

[0068] The first method is to attach sensors to equipment used in daily life. Equipment used in daily life is, for example, doors and toilet seats. This method has the advantage that information can be obtained naturally during daily life. On the other hand, it has the disadvantage that individuals cannot be identified.

[0069] The second method is to attach sensors to the body. The sensors are built into, for example, a wristwatch or a mobile phone. In this case, the advantage is that information can be acquired naturally during daily life and the individual can also be identified. On the other hand, the disadvantage is that the sensor must be attached to the body or carried, and if the subject does not do so, information cannot be acquired.

[0070] The third method is to install surveillance sensors such as cameras inside homes or on the street. This has the advantage that information can be collected naturally while you are living your life, and there is no need to attach sensors to your body. On the other hand, it has the disadvantage that privacy is not protected.

[0071] In addition, as aging has become a social issue, attention has been focused on preventing frailty. To achieve this, it is essential to detect early on those who are unable to go out and do normal activities such as shopping, and to start treatment as soon as possible.

[0072] Therefore, in this embodiment, by applying face recognition technology that does not require the installation or wearing of sensors and can identify individuals to places that are naturally used in daily life, early detection of frailty can be realized. Furthermore, this embodiment is not limited to early detection of frailty, and is also effective for understanding the living conditions of children who live alone away from their parents.

[0073] In addition, in this embodiment, information on the safety of residents can be notified using the history of face recognition by a face recognition terminal that is naturally used during daily life and installed in a shared place.

[0074] <Embodiment 4> The fourth embodiment is a modified example of the third embodiment described above. In the fourth embodiment, the core processing of the usage management process is performed on the server side. FIG. 14 is a block diagram showing the overall configuration of a usage management system 2000 according to the fourth embodiment. Compared to the above-mentioned usage management system 1000, the usage management system 2000 replaces the usage management device 100 with a usage management terminal 600 and adds a usage management server 100a. The usage management terminal 600 and the usage management server 100a are connected to a network N. Note that other configurations of the usage management system according to the fourth embodiment are the same as those of the third embodiment, so that overlapping explanations will be omitted below.

[0075] 15 is a block diagram showing the configuration of the usage management terminal 600 according to the fourth embodiment. The usage management terminal 600 is an information terminal installed near the entrance of the apartment house. Similarly to the usage management device 100, the usage management terminal 600 is connected to the opening and closing controllers 211, 221, and 231. The usage management terminal 600 includes a storage unit 610, a memory 620, a communication unit 630, a camera 640, a display unit 650, and a control unit 660. The storage unit 610, the memory 620, the communication unit 630, the camera 640, and the display unit 650 are equivalent to the above-mentioned storage unit 110, the memory 120, the communication unit 130, the camera 140, and the display unit 150, and therefore detailed description thereof will be omitted.

[0076] The control unit 660 is a processor, that is, a control device, that controls each component of the usage management terminal 600. The control unit 660 loads a program 611 from the storage unit 610 into the memory 620 and executes the program 611. In this way, the control unit 660 realizes the functions of an imaging unit 661, a restriction removal unit 662, and a display control unit 663.

[0077] The photographing unit 661 controls the camera 640 to take an image including a user U who wishes to use a facility such as the entrance gate 210. The photographing unit 661 transmits the taken image via the network N to the usage management server 100a.

[0078] The restriction lifting unit 662 receives a restriction lifting instruction specifying a facility ID from the usage management server 100a via the network N, and outputs a restriction lifting signal to any one of the switching controllers 211, 221, or 231 corresponding to the specified facility ID.

[0079] The display control unit 663 displays on the display unit 650 various types of output information received from the usage management server 100a via the network N.

[0080] 16 is a block diagram showing the configuration of the usage management server 100a according to the fourth embodiment. Compared to the above-mentioned usage management device 100, the usage management server 100a does not necessarily require the camera 140 and the display unit 150. Also, it is sufficient for the control unit 160 to include at least an acquisition unit 161, an authentication control unit 162, a reception unit 163, a restriction removal unit 164, and a history registration unit 165. Also, each component of the control unit 160 transmits and receives data to and from the usage management terminal 600 via the network N and the communication unit 130. Other functions are the same as those of the above-mentioned configuration.

[0081] In this way, the present embodiment can also achieve the effects of the above-mentioned third embodiment.

[0082] <Other embodiments> In the above embodiment, the present disclosure has been described as a hardware configuration, but is not limited to this. Any process of the present disclosure can be realized by causing a CPU to execute a computer program.

[0083] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, DVD (Digital Versatile Disc), and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The transitory computer readable media can provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0084] The present disclosure is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0085] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix A1) an acquisition unit that acquires images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control unit that causes an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in a storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; A usage management device comprising: (Appendix A2) A notification section that notifies the notification destination corresponding to the authorized user according to the release history. The usage management device according to claim A1, further comprising: (Appendix A3) An analysis unit that analyzes the usage tendency of each facility of the permitted user from the release history, When the analyzed usage tendency differs from a predetermined tendency, the notification unit notifies the notification destination accordingly. 2. The utilization management device according to claim 1 . (Appendix A4) The storage unit registers release histories in two or more pieces of equipment for each authorized user, The notification unit determines whether the combination of the two or more pieces of equipment differs from the predetermined trend. 2. The utilization management device according to claim 1 , (Appendix A5) The plurality of facilities include at least two of an entrance control device in an apartment building, a garbage storage, a delivery box, and an electric vehicle charger. A usage management device according to any one of appendices A1 to A4. (Appendix B1) A storage unit that stores facial feature information of a person who is permitted to use a plurality of facilities that are subject to usage restrictions; an acquisition unit that acquires photographed images of the users of the plurality of facilities; an authentication control unit that performs face authentication on the captured image using the facial feature information; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in the storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; A usage management device comprising: (Appendix B2) A notification section that notifies the notification destination corresponding to the authorized user according to the release history. The usage management device according to claim B1, further comprising: (Appendix C1) a usage management device connected to a plurality of facilities on which usage restrictions are imposed; an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities; The usage management device includes: an acquisition unit that acquires photographed images of the users of the plurality of facilities; an authentication control unit that causes the authentication device to perform face authentication on the captured image; a reception unit that receives a selection of one of the plurality of facilities from the user; a restriction release unit that releases restrictions on the selected equipment when the face authentication is successful; a history registration unit that registers in a storage unit a release history that associates the equipment and date and time when the restriction was released with an authorized user who is a user applicant who has succeeded in the face authentication; A usage management system comprising: (Appendix C2) The usage management device includes: A notification section that notifies the notification destination corresponding to the authorized user according to the release history. The usage management system according to claim C1, further comprising: (Appendix D1) The computer Acquire photographs of people who wish to use multiple facilities that are subject to usage restrictions, performing face authentication on the captured image using an authentication device that stores facial feature information of persons who are permitted to use the plurality of facilities; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; registering a release history in a storage unit, the release history correlating the equipment and date and time when the restriction was released with the authorized user who is the user applicant and who succeeded in the face authentication; Usage management method. (Appendix E1) A computer including a storage unit that stores facial feature information of a person permitted to use a plurality of facilities that are subject to usage restrictions, Acquire photographed images of the persons who wish to use the facilities, performing face authentication on the captured image using the facial feature information; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; registering in the storage unit a release history in which the restriction is released in association with the facility and date and time when the restriction is released and the authorized user who is the user applicant and has succeeded in the face authentication; Usage management method. (Appendix F1) An acquisition process for acquiring images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control process for causing an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in a storage unit a release history in which the restriction is released in association with the equipment and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; A usage management program that causes a computer to execute the above. (Appendix G1) A computer including a storage unit that stores facial feature information of a person permitted to use a plurality of facilities that are subject to usage restrictions, An acquisition process for acquiring photographed images of the users of the plurality of facilities; an authentication control process for performing face authentication on the captured image using the facial feature information; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in the storage unit a release history in which the restriction is released in association with the equipment and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; A usage management program that executes the above.

[0086] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0087] This application claims priority based on Japanese Patent Application No. 2020-056490, filed on March 26, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0088] 1 Usage management device 1a Usage management device 11 Acquisition Department 12 Authentication control section 12a Authentication control section 13 Reception 14 Restriction Release Section 15 History Registration Section 16 Memory section 170 Release History 171 Equipment 172 Date 173 Licensed User 174 Facial Feature Information 1000 Usage Management System 2000 User Management System 100 Usage management device 100a Usage management server 110 Storage section 111 Program 112 Cancellation History 1121 Equipment ID 1122 Date 1123 User ID 113 Notification Settings 1131 User ID 1132 Notification destination 120 Memory 130 Communications Department 140 Camera 150 Display section 160 Control section 161 Acquisition Department 162 Authentication control section 163 Reception 164 Restriction Release Section 165 History Registration Section 166 Analysis Department 167 Notification Department 210 Entrance Gate 211 Switching controller 220 Garbage Storage 221 Switching Controller 230 Delivery Box 231 Switching Controller 400 Authentication Device 410 Face Information DB 411 User ID 412 Facial Feature Information 420 Face detection unit 430 Feature Point Extraction Unit 440 Registration Department 450 Authentication Department 500 Selection screen 510 Entry button 520 Trash disposal button 530 Delivery receipt button 540 EV charging button 550 Bike Share Button 600 User management terminal 610 Storage section 611 Program 620 Memory 630 Communications Department 640 Camera 650 Display 660 Control Unit 661 Photography Department 662 Restriction Release Department 663 Display control unit U User N Network

Claims

1. An acquisition means for acquiring photographed images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control means for causing an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception means for receiving a selection of any one of the plurality of facilities from the user; a restriction release means for releasing the restriction on the selected equipment when the face authentication is successful; a history registration means for registering in a storage means a release history in which the restriction is released in association with the facility and date and time and the permitted user who is a user applicant who has succeeded in the face authentication; an analysis means for analyzing the usage tendency of each facility of the permitted user from the release history; a notification means for notifying a notification destination corresponding to the authorized user of the analyzed usage tendency when the analyzed usage tendency differs from a predetermined tendency; A usage management device comprising:

2. The storage means registers release histories for two or more pieces of equipment for each authorized user, The notification means determines whether the combination of the two or more pieces of equipment differs from the predetermined trend. The utilization management device according to claim 1 .

3. The plurality of facilities include at least two of an entrance control device in an apartment building, a garbage storage, a delivery box, and an electric vehicle charger.

3. The utilization management device according to claim 1 or 2.

4. A storage means for storing facial feature information of a person permitted to use a plurality of facilities subject to usage restrictions; An acquisition means for acquiring photographed images of persons who wish to use the facilities; an authentication control means for performing face authentication on the captured image using the facial feature information; a reception means for receiving a selection of any one of the plurality of facilities from the user; a restriction release means for releasing the restriction on the selected equipment when the face authentication is successful; a history registration means for registering in the storage means a release history in which the restriction is released in association with the facility and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; an analysis means for analyzing the usage tendency of each facility of the permitted user from the release history; a notification means for notifying a notification destination corresponding to the authorized user of the analyzed usage tendency when the analyzed usage tendency differs from a predetermined tendency; A usage management device comprising:

5. a usage management device connected to a plurality of facilities on which usage restrictions are imposed; an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities; The usage management device includes: An acquisition means for acquiring photographed images of persons who wish to use the facilities; an authentication control means for causing the authentication device to perform face authentication on the captured image; a reception means for receiving a selection of any one of the plurality of facilities from the user; a restriction release means for releasing the restriction on the selected equipment when the face authentication is successful; a history registration means for registering in a storage means a release history in which the restriction is released in association with the facility and date and time and the permitted user who is a user applicant who has succeeded in the face authentication; an analysis means for analyzing the usage tendency of each facility of the permitted user from the release history; a notification means for notifying a notification destination corresponding to the authorized user of the analyzed usage tendency when the analyzed usage tendency differs from a predetermined tendency; A usage management system comprising:

6. The computer Acquire photographs of people who wish to use multiple facilities that are subject to usage restrictions, performing face authentication on the captured image using an authentication device that stores facial feature information of persons who are permitted to use the plurality of facilities; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; registering a release history in a storage device, the release history correlating the equipment and date and time when the restriction was released with the authorized user who is the user applicant and who succeeded in the face authentication; Analyzing the usage trends of each facility by the permitted user from the release history; If the analyzed usage tendency differs from a predetermined tendency, a notification to that effect is sent to a notification destination corresponding to the permitted user. Usage management method.

7. A computer having a storage means for storing facial feature information of a person permitted to use a plurality of facilities subject to usage restrictions, Acquire photographed images of the persons who wish to use the facilities, performing face authentication on the captured image using the facial feature information; Accepting a selection of any one of the plurality of facilities from the user; If the face authentication is successful, the restriction on the selected device is lifted; registering in the storage means a release history in which the restriction is released in association with the facility and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; Analyzing the usage trends of each facility by the permitted user from the release history; If the analyzed usage tendency differs from a predetermined tendency, a notification to that effect is sent to a notification destination corresponding to the permitted user. Usage management method.

8. An acquisition process for acquiring images of people who wish to use a plurality of facilities that are subject to usage restrictions; an authentication control process for causing an authentication device that stores facial feature information of persons permitted to use the plurality of facilities to perform face authentication on the captured image; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in a storage device a release history in which the restriction is released in association with the equipment and date and time and the permitted user who is the user applicant and has succeeded in the face authentication; an analysis process for analyzing the usage tendency of each facility of the permitted user from the release history; a notification process for notifying a notification destination corresponding to the authorized user of the analyzed usage tendency when the analyzed usage tendency differs from a predetermined tendency; A usage management program that causes a computer to execute the above.

9. A computer including a storage means for storing facial feature information of a person permitted to use a plurality of facilities subject to usage restrictions, An acquisition process for acquiring photographed images of the users of the plurality of facilities; an authentication control process for performing face authentication on the captured image using the facial feature information; a reception process for receiving a selection of any one of the plurality of facilities from the user; a restriction release process for releasing the restriction on the selected equipment when the face authentication is successful; a history registration process for registering in the storage means a release history in which the restriction is released in association with the facility and date and time and the permitted user who is a user applicant who has succeeded in the face authentication; an analysis process for analyzing the usage tendency of each facility of the permitted user from the release history; a notification process for notifying a notification destination corresponding to the authorized user of the analyzed usage tendency when the analyzed usage tendency differs from a predetermined tendency; A usage management program that executes the above.

Images