Monitoring system, monitoring method, and computer program

Abstract

Provided is a monitoring system that provides appropriate notification in accordance with whether or not a person to be monitored is with a registered companion. This monitoring system is provided with: a recognition means which recognizes a person to be monitored and a registered companion associated with the person to be monitored; and a notification means which notifies a prescribed contact that the person to be monitored has been recognized. When it is recognized that the person to be monitored is with the registered companion, the notification means refrains from notifying the contact.

Description

[Technical field]

[0001] The present disclosure relates to a monitoring system and the like. [Background technology]

[0002] 2. Description of the Related Art Systems are known for verifying that children and elderly people are in designated locations.

[0003] Patent Document 1 discloses a monitoring system that makes it easy to search for children or elderly people who go out and go missing. In Patent Document 1, a camera that detects the person being watched over is installed at the entrance to a room or building. When the person being watched over is detected, an email is sent to a registered address. In Patent Document 1, when the user turns on the camera switch when leaving the person being watched over, the monitoring system starts monitoring. Patent Document 1 discloses that when the guardian of the person being watched over goes out with them, the user turns off the switch.

[0004] Patent Document 2 discloses a vehicle management server in a monitoring shuttle system in which a vehicle monitors a person being monitored during transportation. In Patent Document 2, information to be notified to the person being monitored is extracted from the video captured by the vehicle-mounted camera according to set conditions. For example, the set conditions may be limited to video showing the person being monitored, or a specific location or time period may be specified. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2017-111506 A [Patent Document 2] JP 2018-169942 A Summary of the Invention [Problem to be solved by the invention]

[0006] When the person being watched over is with the guardian, notification may not be necessary. However, when notification is not necessary as in Patent Document 1, it is troublesome to perform an operation every time. Patent Document 2 does not take into consideration that the person being watched over is with the guardian.

[0007] The present disclosure aims to provide a monitoring system etc. that provides appropriate notifications depending on whether the person being monitored is with a companion or not. [Means for solving the problem]

[0008] The monitoring system according to the present disclosure includes a recognition means for recognizing a person being watched over and a registered companion associated with the person being watched over; A notification means for notifying a predetermined contact that the person being watched over has been recognized, When it is recognized that the person being watched over and the registered accompanying person are together, the notification means stops sending notifications to the contact information.

[0009] The monitoring system according to the present disclosure includes a recognition means for recognizing a person being watched over and a registered companion associated with the person being watched over; a first notification means for executing a first notification when it is recognized that the person being watched over and the registered accompanying person are not together; When it is recognized that the person being watched over and the registered accompanying person are together, a second notification different from the first notification is executed.

[0010] The monitoring method according to the present disclosure includes: recognizing a person being watched over and a registered companion associated with the person being watched over; Notifying a predetermined contact that the person being watched over has been recognized; When it is recognized that the person being watched over and the registered accompanying person are together, notification to the contact address is stopped.

[0011] The monitoring method according to the present disclosure includes: recognizing a person being watched over and a registered companion associated with the person being watched over; When it is recognized that the person being watched over and the registered accompanying person are not together, a first notification is sent; When it is recognized that the person being watched over and the registered accompanying person are together, a second notification different from the first notification is given.

[0012] The recording medium according to the present disclosure recognizes a person being watched over and a registered companion associated with the person being watched over, notifying a predetermined contact that the person being watched over has been recognized, and stopping the notification to the contact when it is recognized that the person being watched over and the registered companion are together; A program that causes a computer to execute a process is non-temporarily recorded.

[0013] The recording medium according to the present disclosure includes a process for recognizing a person being watched over and a registered companion associated with the person being watched over; When it is recognized that the person being watched over and the registered accompanying person are not together, a process of notifying a first notification; When it is recognized that the person being watched over and the registered accompanying person are together, a program that causes a computer to execute a process of sending a second notification different from the first notification is non-temporarily recorded. Effect of the Invention

[0014] According to the present disclosure, appropriate notification can be given depending on whether the person being watched over is with a companion or not. [Brief description of the drawings]

[0015] [Figure 1] 1 is a block diagram showing a configuration of an information system 1 according to a first embodiment. [Diagram 2] 1 is a block diagram showing a configuration of a monitoring system 100 according to a first embodiment. [Diagram 3] FIG. 11 is a diagram illustrating an example of information stored in a user database. [Figure 4] 13 is a diagram showing an example of a notification displayed by the second terminal 12. FIG. [Diagram 5]4 is a sequence diagram showing an example of the operation of the information system 1 according to the first embodiment. FIG. [Figure 6] FIG. 11 is a block diagram showing the configuration of a watching system 200 according to a second embodiment. [Figure 7A] FIG. 11 is a diagram showing an example of the contents of a first notification. [Figure 7B] FIG. 11 is a diagram showing an example of the content of a second notification. [Figure 8] FIG. 11 is a sequence diagram showing an example of the operation of the information system 1 according to the second embodiment. [Figure 9] FIG. 13 is a block diagram showing a configuration of an information system 2 according to a third embodiment. [Figure 10] FIG. 2 is a block diagram showing the configuration of a monitoring system 300. [Figure 11] FIG. 11 is a diagram illustrating an example of information stored in a user database. [Figure 12A] 13 is a diagram showing an example of a notification transmitted by a notification unit 202. FIG. [Figure 12B] 13 is a diagram showing another example of a notification transmitted by the notification unit 202. FIG. [Figure 13] FIG. 11 is a diagram showing another example of information stored in the user database. [Figure 14] FIG. 11 is a sequence diagram showing the operation of the information system 2 according to the third embodiment. [Figure 15] 13 is a flowchart showing an operation example of the watching system 100 according to the fourth embodiment. [Figure 16] FIG. 4 is a block diagram showing the configuration of a monitoring system 400. [Figure 17] 13 is a flowchart showing an operation example of the watching system 400 according to the fifth embodiment. [Figure 18] FIG. 5 is a block diagram showing an example of the hardware configuration of a computer 500. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] A monitoring system according to an embodiment of the present disclosure will be described below with reference to the drawings. In each embodiment, when a person being watched over is recognized, a notification of the safety of the person being watched over is sent to the contact information of a person watching over the person remotely. The person who receives the notification can confirm the safety of the person being watched over.

[0017] [First embodiment] The monitoring system according to the first embodiment does not notify the registered contact when it is recognized that the person being watched over is with a companion who is associated with the person being watched over in advance. The registered companion is a person who accompanies the person being watched over to ensure their safety. The registered companion may be the same as the person to whom the notification is sent, or may be different. The registered companion is also called a guardian or a guardian responsible person.

[0018] For example, if the person being watched over is an elderly person, the registered accompanying person is a relative or other caregiver. For example, if the person being watched over is a child, the registered accompanying person is a parent, a relative or acquaintance who is asked by the parent to pick up the child, or a school-related person. For example, the watching system according to the first embodiment notifies the parent when a child is recognized. However, for example, when it is recognized that a child is with a registered accompanying person, the watching system does not notify the parent.

[0019] (composition) 1 is a block diagram showing the configuration of an information system 1 according to a first embodiment. The information system 1 includes a first terminal 11, a monitoring system 100, an authentication server 20, and a notification server 30. The first terminal 11, the monitoring system 100, the authentication server 20, and the notification server 30 are connected to each other via a network in a wired or wireless manner. Furthermore, the notification server 30 may be connected to a second terminal 12 via a network in a wired or wireless manner.

[0020] The first terminal 11 is installed in a place used by the person being watched over, such as a facility, a building, or a vehicle. The first terminal 11 may be installed in a predetermined place, such as a care facility, a school, an after-school facility, a home, a station, or an entrance or exit of a bus, or a ticket gate of a train. The first terminal 11 may be, for example, a smartphone, a tablet, a personal computer, or another terminal. The first terminal 11 includes an acquisition unit 111.

[0021] The acquisition unit 111 acquires identification information used for authentication. The acquisition unit 111 transmits the acquired identification information to the watching system 100.

[0022] The acquisition unit 111 may acquire biometric information used for biometric authentication as the identification information. The biometric information is, for example, information about a face, an iris, a fingerprint, a blood vessel, a voiceprint, and the like. The biometric information may be, for example, a face image or a feature amount acquired from a face image. When the biometric information is information about a face, the acquisition unit 111 may be a camera.

[0023] The second terminal 12 is a terminal used by a guardian or a caregiver who receives remote notifications about the person being watched over, such as a child or an elderly person. The second terminal 12 is, for example, a mobile terminal, a smartphone, a tablet, or a personal computer. The second terminal 12 receives and displays notifications from the notification server 30. Note that there may be multiple second terminals 12 depending on the usage of the person receiving notifications about the person being watched over, or there may be cases where the second terminal 12 is not used.

[0024] 2 is a block diagram showing the configuration of the watching system 100 according to the first embodiment. The watching system 100 includes a recognition unit 101 and a notification unit 102. The watching system 100 refers to a user database (DB (database)) not shown.

[0025] 3 is a diagram showing an example of information stored in the user DB. The user DB includes a user's identification ID (identifier). The user includes at least the person being watched over. The user may include users other than the person being watched over who use the facility or transportation where the first terminal 11 is installed. The identification ID is an identifier that uniquely identifies the user.

[0026] The identification ID of the person being watched over is associated with the identification ID of the registered accompanying person and a predetermined contact. The identification ID of the registered accompanying person is the identification ID of a person registered in association with the person being watched over. Multiple registered accompanying persons may be registered for one person being watched over. The predetermined contact is, for example, a destination for sending notifications regarding the person being watched over, such as contact information for a guardian or caregiver. The contact is, for example, an email address, a telephone number, or a messaging application account. The contact may also be other information that uniquely identifies the second terminal 12. Furthermore, multiple contacts may be registered for one person being watched over. The user DB may include the identification ID or contact information of users who are not being watched over.

[0027] The recognition unit 101 recognizes an individual based on, for example, the identification information received from the acquisition unit 111 of the first terminal 11. The recognition unit 101 may recognize an individual when entering or leaving a facility, or when getting on or off a vehicle. For example, when recognizing an individual, the recognition unit 101 recognizes whether the person whose identification information has been acquired is a person being watched over and a registered companion. When a face image is used as the identification information, the recognition unit 101 recognizes the person being watched over and the registered companion based on a face image captured at a predetermined location where the first terminal is installed. Furthermore, the recognition unit 101 recognizes whether the person being watched over and the registered companion are together.

[0028] Specifically, the recognition unit 101 recognizes an individual, for example, by transmitting identification information received from the first terminal 11 to the authentication server 20 and receiving an authentication result from the authentication server 20. The recognition unit 101 may receive an identification ID common to the user DB as the authentication result. The recognition unit 101 refers to the user DB and determines whether the identification ID is an identifier of the person being watched over. Furthermore, the recognition unit 101 may refer to the user DB and determine whether the identification ID is an identifier of a registered accompanying person.

[0029] The recognition unit 101 may recognize that the person being watched over and the accompanying person are together when, for example, a registered accompanying person is recognized within a predetermined time before or after the recognition of the person being watched over. Alternatively, when the acquisition unit 111 is a camera and the person being watched over and the accompanying person are photographed within the imaging range of one camera, or when the faces of the person being watched over and the accompanying person are photographed simultaneously by multiple cameras, the recognition unit 101 may recognize that the person being watched over and the accompanying person are together. When a registered accompanying person is not recognized within a predetermined time after the person being watched over is recognized, the recognition unit 101 may recognize that the person being watched over is alone.

[0030] When the notification unit 102 recognizes the person being watched over, it notifies a predetermined contact. However, when the notification unit 102 recognizes that the person being watched over and a registered accompanying person are together, it does not issue a notification.

[0031] Specifically, for example, the notification unit 102 refers to the user DB and transmits a notification request to the notification server 30 to send a notification to a contact associated with the person being watched over. The format of the notification is not particularly limited. The notification may be, for example, an email to an email address, an SMS (Short Message Service) to a telephone number, or a message to a messaging application account.

[0032] The authentication server 20 receives the identification information from the monitoring system 100 and authenticates the user by referring to an identification information DB (not shown). The identification information DB stores, for example, an identification ID and the identification information in association with each other. The authentication server 20 transmits the authentication result to the monitoring system 100.

[0033] The notification server 30 is, for example, a mail server or a messaging application server. The notification server 30 sends a notification to a specified contact based on a notification request from the notification unit 102 of the monitoring system 100. The notification indicates that the person being watched over has been recognized. The notification server 30 sends the notification to, for example, the second terminal 12. The person who receives the notification can know that the person being watched over has been recognized by the monitoring system.

[0034] Fig. 4 is a diagram showing an example of a notification displayed by the second terminal 12. Fig. 4 shows an example of a notification in the form of an email. The email in Fig. 4 is also called a monitoring notification email, and includes the name of the person being watched over and the location where the person being watched over was recognized.

[0035] (operation) An example of the operation of the information system 1 according to the first embodiment will be described below. FIG.

[0036] First, the acquisition unit 111 of the first terminal 11 acquires identification information used for authentication (step S11). The acquisition unit 111 transmits the acquired identification information to the watching system 100.

[0037] The recognition unit 101 of the watching system 100 transmits the identification information to the authentication server 20. The watching system 100 may process the identification information received from the first terminal 11 before transmitting it to the authentication server 20.

[0038] The authentication server 20 receives the identification information from the watching system 100 and authenticates the user (step S12). The authentication server 20 transmits to the watching system 100 an identification ID corresponding to the identification information.

[0039] The recognition unit 101 of the watching system 100 recognizes an individual based on the identification ID received from the authentication server 20 (step S13). For example, the recognition unit 101 recognizes the person being watched over and the registered accompanying person.

[0040] The information system 1 repeats the processes of steps S11 to S13, for example, every time the first terminal 11 acquires identification information. When the acquisition unit 111 acquires identification information of a plurality of people simultaneously or consecutively, the acquisition unit 111 may transmit the plurality of pieces of identification information to the watching system 100 in association with each other.

[0041] Then, the recognition unit 101 recognizes that the person being watched over is not together with the registered companion, or is together with the registered companion. For example, if the recognition unit 101 does not recognize the registered companion within a predetermined time after recognizing the person being watched over, it recognizes that the person being watched over is not together with the registered companion. The recognition unit 101 transmits to the notification unit 102 that the person being watched over is not together with the registered companion.

[0042] If the person being watched over is not with the registered accompanying person (step S14: No), the notification unit 102 issues a notification (step S15). Specifically, the notification unit 102 sends a notification request to the notification server 30 to send a notification to the contact associated with the person being watched over. The notification server 30 sends a notification to the specified contact based on the notification request from the notification unit 102 of the watching system 100 (step S16). For example, the notification server 30 sends a notification to the second terminal 12. The second terminal 12 displays the notification (step S17).

[0043] If the person being watched over and a companion are present together (step S14: Yes), the notification unit 102 does not issue a notification.

[0044] (effect) According to the first embodiment, appropriate notification can be given depending on whether the person being watched over is with a registered companion or not. Specifically, for example, it is convenient because the person receiving the notification about the person being watched over does not need to set it up every time when the notification is not required. The reason is that the recognition unit 101 recognizes the person being watched over and the registered companion, and the notification unit 102 notifies the person being watched over when the person being watched over is recognized, but does not notify the person being watched over when the person being watched over and the registered companion are recognized together.

[0045] Specifically, for example, a person who receives a notification about a person being watched over can obtain confirmation that the person being watched over is in a specified location. By using biometric information as confirmation, spoofing is more difficult than when other identification information is used, so the person who receives the notification can feel at ease.

[0046] [Second embodiment] In the second embodiment, the contents or destination of the notification differ depending on whether the person being watched over is together with a companion (registered companion) associated with the person being watched over or not.

[0047] (composition) Compared to the information system 1 according to the first embodiment, the information system 1 according to the second embodiment includes a monitoring system 200 instead of the monitoring system 100. FIG. 6 is a block diagram showing the configuration of the monitoring system 200 according to the second embodiment. The monitoring system 200 includes a recognition unit 101 and a notification unit 202. The notification unit 202 includes a first notification unit 212 and a second notification unit 222.

[0048] The configuration of the recognition unit 101 is similar to the configuration of the recognition unit 101 according to the first embodiment.

[0049] When the notification unit 202 recognizes the person being watched over, it notifies the contact information stored in the user DB. When it is recognized that the person being watched over and the registered accompanying person are not together, the first notification unit 212 issues a first notification. When it is recognized that the person being watched over and the registered accompanying person are together, the second notification unit 222 issues a second notification different from the first notification. The first notification unit 212 and the second notification unit 222 each send a notification request to the notification server 30 to notify the contact information associated with the person being watched over.

[0050] <Content and address of notification> The first notification and the second notification may have different contents, for example. The contents of the first notification may include, for example, that the person being watched over is not with the registered companion. The contents of the second notification may include, for example, that the person being watched over and the registered companion are together.

[0051] Alternatively, the content of the first notification may include additional information regarding the person being watched over, and the content of the second notification may not include the additional information. The additional information may be an image of the person being watched over acquired by the acquisition unit 111. In addition to the image of the person being watched over, the additional information may be, for example, the type of bus the person being watched over rode in or the time the person being watched over was recognized.

[0052] 7A and 7B are diagrams showing examples of the contents notified by notification unit 202. FIG. 7A shows an example of the contents of a first notification. FIG. 7B shows an example of the contents of a second notification. For example, the first notification includes an image of the person being watched over as additional information, and the second notification does not include an image of the person being watched over. For example, if the first notification includes an image of the child's face, the parent can rest assured that the child has been correctly recognized. If the second notification does not include a face image, the amount of communication data can be saved.

[0053] The first notification and the second notification may, for example, have different destinations. That is, the first notification unit 212 executes a notification to a first contact, and the second notification unit 222 executes a notification to a second contact that is different from the first contact. Also, the first notification and the second notification may have different contents and destinations.

[0054] When the notification destinations are different, the user DB stores a first contact which is the destination of the first notification and a second contact which is the destination of the second notification. When there are multiple destinations of the first notification, the destination of the second notification may include the destination of the first notification. For example, when the person being watched over is recognized alone, multiple destinations such as relatives, school, and police are notified. When the person being watched over is recognized together with a registered companion, the contact of a close relative is notified.

[0055] (operation) 8 is a sequence diagram showing an example of the operation of the information system 1 according to the second embodiment. The operation of the information system 1 according to the second embodiment is similar to the operation according to the first embodiment. For example, the information system 1 performs the same processes as steps S11 to S13 in FIG.

[0056] In step S13, the recognition unit 101 recognizes whether the recognized individual is a person being watched over and a registered companion. Next, the recognition unit 101 determines whether the person being watched over and the registered companion are together. If the person being watched over and the registered companion are not together (step S24: No), the first notification unit 212 performs a first notification (step S251). Specifically, the first notification unit 212 requests the notification server 30 to send a notification with the contents of the first notification or to the destination of the first notification. If the person being watched over and the registered companion are together (step S24: Yes), the second notification unit 222 performs a second notification (step S252). Specifically, the second notification unit 222 requests the notification server 30 to send a notification with the contents of the second notification or to the destination of the second notification.

[0057] The notification server 30 transmits a notification to a specified contact based on the notification request from the monitoring system 200 (step S26). For example, the notification server 30 transmits the notification to the second terminal 12. The second terminal 12 displays the notification (step S27).

[0058] (effect) According to the second embodiment, an appropriate notification can be given depending on whether the person being watched over is with a registered companion or not. Specifically, for example, an appropriate notification can be given to a person who receives a notification about the person being watched over. The reason is that when it is recognized that the person being watched over and the registered companion are not together, the first notification unit 212 gives a first notification, and when it is recognized that the person being watched over and the registered companion are together, the second notification unit 222 gives a second notification different from the first notification.

[0059] [Third embodiment] The third embodiment differs from the first and second embodiments in that the third embodiment further includes a function for the person being watched over to make a payment. Climb When you are not with a recording companion and when you are with a recording companion and The content or destination of the notification is different.

[0060] (composition) 9 is a block diagram showing the configuration of an information system 2 according to the third embodiment. The information system 2 differs from the above-described embodiments in that it includes a monitoring system 300 instead of the monitoring systems 100 and 200. Furthermore, the information system 2 includes a payment server 40. The configurations of the first terminal 11, the second terminal 12, the authentication server 20, and the notification server 30 are the same as those of the above-described embodiments.

[0061] The first terminal 11 may be installed at the entrance or exit of a bus, a train ticket gate, or at a place where payments are made in a store, etc. When each user makes a payment, the first terminal 11 acquires identification information.

[0062] Fig. 10 is a block diagram showing the configuration of the monitoring system 300. The monitoring system 300 includes a recognition unit 301, a notification unit 302, and a payment unit 303. Fig. 11 is a diagram showing an example of information stored in a user DB referenced by the monitoring system 300. The user DB according to the third embodiment differs from the user DB of Fig. 3 in that a payment method is further stored in association with each identification ID. The contact points included in the user DB may be contact points for notifying about payments.

[0063] The payment method may be any of prepayment, immediate payment, and postpayment. The user DB stores information on any of the payment methods, such as electronic money payment, credit card payment, and debit card payment. For example, if the person being watched over is a child, the payment method associated with the child's identification ID may be the parent's credit card.

[0064] The configuration of the recognition unit 301 is basically the same as the configuration of the recognition unit 101 according to the first and second embodiments. The recognition unit 301 recognizes the person being watched over and the registered accompanying person, for example, by using identification information acquired for payment. The recognition unit 301 may recognize the person being watched over and the registered accompanying person, for example, by using authentication results acquired for payment. The recognition unit 301 recognizes an individual at the time of payment. The recognition unit 301 may determine whether the person being watched over is together with the registered accompanying person.

[0065] The configuration of the notification unit 302 is basically the same as the configuration of the notification unit 202 according to the second embodiment. When the person being watched over is recognized and the payment is completed, the notification unit 302 notifies a predetermined contact point stored in the user DB. The notification unit 302 includes a first notification unit 312 and a second notification unit 322. The first notification unit 312 issues a first notification when it is recognized that the person being watched over and the registered accompanying person are not together. The second notification unit 322 issues a second notification different from the first notification when it is recognized that the person being watched over and the registered accompanying person are together.

[0066] The settlement unit 303 performs settlement based on the identification information acquired by the acquisition unit 111 of the first terminal 11. Specifically, for example, the settlement unit 303 transmits the identification information received from the first terminal 11 to the authentication server 20 and receives an authentication result. The settlement unit 303 may receive an identification ID common to the user DB as the authentication result. The settlement unit 303 refers to the user DB, communicates with the payment server 40, and performs settlement using the payment method associated with the identification ID. The settlement unit 303 receives the settlement result from the payment server 40.

[0067] <Content and address of notification> In the third embodiment, the first notification and the second notification may differ depending on whether or not they have the above-mentioned additional information, as described in the second embodiment. FIG. 12A and FIG. 12B are diagrams showing examples of notifications transmitted by the notification unit 202. For example, a case will be described in which FIG. 12A is the first notification and FIG. 12B is the second notification. Each of the first notification and the second notification may include payment information. The payment information includes at least one of the amount, the payment method, and the slip number. The payment information may include the date and time of payment or the place of payment (store name). The first notification in FIG. 12A includes, as additional information, the route number of the bus on which the person being watched boarded and information on the bus stop where the person got off. The notifications in FIG. 12A and FIG. 12B are also called payment notifications because they include payment information.

[0068] Alternatively, the first notification may differ in that the first notification includes payments made by the monitored person when the registered companion is not present, and the second notification includes payments made by the monitored person when the registered companion is present.

[0069] Alternatively, the first notification and the second notification may be different in both destination and content. FIG. 13 is a diagram showing an example of data in a user DB when both destination and content are different. For example, the first notification unit 212 may notify both the monitoring notification of FIG. 4 and the payment notification of FIG. 12B as the first notification to a predetermined contact. Specifically, as shown in the first row of FIG. 13, when A1 is recognized as being alone, the first notification unit 212 notifies the payment notification to the destination of X2 and the monitoring notification to the destination of X3. The second notification unit 222 may notify the payment notification of FIG. 12B as the second notification to a predetermined contact. In this case, the second notification differs from the first notification in that it does not include a monitoring notification to be notified to a predetermined contact. Specifically, as shown in the second row of FIG. 13, when A1 and C2 are recognized as being together, the second notification unit 222 notifies the payment notification to the destination of X2.

[0070] Note that multiple payment methods may be associated with the identification ID. The payment unit 303 may perform payment using different payment methods when the person being watched over is alone and when the person is with a registered companion. The recognition unit 301 may transmit the result of determining whether the person being watched over is with a registered companion to the payment unit 303. The payment unit 303 performs payment based on the determination result.

[0071] <Payment using facial images> The monitoring system 2 may use a face image as the identification information. In this case, the payment unit 303 may make a payment using the face image. The recognition unit 301 may recognize the person being watched over and the registered accompanying person based on the face image acquired for the payment. In this case, the second notification may include the face image acquired for the payment as additional information, as shown in FIG. 7A.

[0072] If payment can be made using the face image of the person being watched over, the person being watched over will not need to carry a medium for payment, which is convenient. Furthermore, the face image acquired for payment can also be used for the monitoring notification, making it possible to make effective use of the face image.

[0073] (operation) 14 is a sequence diagram showing the operation of the information system 2 according to the third embodiment. In the following operation example, a case will be described in which the recognition unit 301 recognizes the watching target and the registered accompanying person by using the authentication result acquired for payment.

[0074] The acquisition unit 111 of the first terminal 11 acquires identification information to perform payment (step S31). The payment unit 303 receives the acquired identification information and transmits it to the authentication server 20. The authentication server 20 performs authentication based on the identification information acquired for payment and information stored in the identification information DB (step S32). The payment unit 303 passes the received identification ID to the recognition unit 301 and the notification unit 302.

[0075] The recognition unit 301 receives the identification ID, which is the authentication result, from the authentication server 20, and recognizes the individual (step S33). The recognition unit 301 recognizes whether the recognized individual is a person being watched over and a registered companion. Next, the recognition unit 301 determines whether the person being watched over and the registered companion are together.

[0076] The settlement unit 303 refers to the user DB and performs settlement by the payment method associated with the identification ID. For example, the settlement unit 303 transmits a settlement request to the settlement server 40. The settlement server 40 executes the settlement process (step S34). The settlement server 40 transmits, as a result of the settlement, for example, the completion of the settlement to the monitoring system 300.

[0077] The subsequent processing is similar to the processing from step S24 to step S27 according to the second embodiment, and therefore a description thereof will be omitted.

[0078] The process of the recognition unit 301 when the recognition unit 301 recognizes the watching target and the registered accompanying person using the identification information acquired for payment is similar to the process of the recognition unit 101 according to the first and second embodiments, and therefore the description will be omitted. The payment unit 303 performs payment in the same manner as in step S34 above, for example, based on the identification ID that the recognition unit 301 receives from the authentication server.

[0079] (effect) According to the third embodiment, an appropriate notification can be given depending on whether the person being watched over is with a registered companion or not. Specifically, for example, an appropriate notification can be given to a person who receives a notification about the person being watched over. The reason is that when it is recognized that the person being watched over and the registered companion are not together, the first notification unit 212 gives a first notification, and when it is recognized that the person being watched over and the registered companion are together, the second notification unit 222 gives a second notification different from the first notification.

[0080] Moreover, according to the third embodiment, it is convenient because payment and confirmation of the safety of the person being watched over can be performed at the same time. This is because the recognition unit 301 recognizes the person being watched over and the registered accompanying person by using the identification information acquired for payment. Alternatively, the recognition unit 301 recognizes the person being watched over and the registered accompanying person by using the authentication result acquired for payment.

[0081] Furthermore, according to the third embodiment, the person who receives the notification can feel secure even if the person being watched over makes a payment. Also, security can be provided even if the person being watched over makes a payment alone. This is because the notification unit 302 notifies the person being watched over of the payment made by the person being watched over.

[0082] [Fourth embodiment] As the fourth embodiment, the basic configuration of the first embodiment will be described. The configuration of a monitoring system 100 according to the fourth embodiment is as shown in Fig. 2. The monitoring system 100 includes a recognition unit 101 and a notification unit 102. The recognition unit 101 and the notification unit 102 may be realized by a single information processing device, or may be realized by a combination of multiple devices.

[0083] The recognition unit 101 recognizes the person being watched over and a companion (registered companion) associated with the person being watched over. When the person being watched over is recognized, the notification unit 102 notifies a predetermined contact. However, when the notification unit 102 recognizes that the person being watched over and the registered companion are together, the notification unit 102 stops the notification.

[0084] The watching system 100 may include any one of the first terminal 11, the authentication server 20, or the notification server 30 according to the first embodiment. The watching system 100 may also include other devices.

[0085] Fig. 15 is a flowchart showing an example of the operation of the watching system 100 according to the fourth embodiment. The recognition unit 101 recognizes the person being watched over and the registered accompanying person (step S41). The recognition unit 101 recognizes whether the person being watched over is not together with the registered accompanying person, or is together with the registered accompanying person. If the person being watched over is not together with the registered accompanying person (step S42: No), the notification unit 102 notifies that the person being watched over has been recognized (step S43). If the person being watched over is together with the registered accompanying person (step S42: Yes), the notification unit 102 does not notify.

[0086] According to the fourth embodiment, appropriate notification can be given depending on whether the person being watched over is with a registered companion or not. Specifically, for example, it is convenient because the person receiving the notification about the person being watched over does not need to set it up every time when the notification is not required. The reason is that the recognition unit 101 recognizes the person being watched over and the registered companion, and the notification unit 102 notifies when the person being watched over is recognized, but does not notify when it is recognized that the person being watched over and the registered companion are together.

[0087] [Fifth embodiment] As the fifth embodiment, the basic configuration of the second and third embodiments will be described. Fig. 16 is a block diagram showing the configuration of a monitoring system 400 according to the fifth embodiment. The monitoring system 400 includes a recognition unit 101, a first notification unit 212, and a second notification unit 222. The recognition unit 101, the first notification unit 212, and the second notification unit 222 may be realized by a single information processing device, or may be realized by a combination of multiple devices.

[0088] The recognition unit 101 recognizes the person being watched over and a companion (registered companion) associated with the person being watched over. The first notification unit 212 issues a first notification when it is recognized that the person being watched over and the registered companion are not together. The second notification unit 222 issues a second notification different from the first notification when it is recognized that the person being watched over and the registered companion are together.

[0089] 17 is a flowchart showing an example of the operation of the watching system 400 according to the fifth embodiment. The recognition unit 101 recognizes the person being watched over and the registered companion (step S51). The recognition unit 101 recognizes whether the person being watched over is not together with the registered companion or is together with the registered companion. If the person being watched over is not together with the registered companion (step S52: No), the first notification unit 212 performs the first notification (step S53). If the person being watched over is together with the registered companion (step S52: Yes), the second notification unit 222 performs the second notification (step S54).

[0090] According to the fifth embodiment, an appropriate notification can be given depending on whether the person being watched over is with a registered companion or not. Specifically, for example, an appropriate notification can be given to a person who receives a notification about the person being watched over. The reason is that when it is recognized that the person being watched over and the registered companion are not together, the first notification unit 212 gives a first notification, and when it is recognized that the person being watched over and the registered companion are together, the second notification unit 222 gives a second notification different from the first notification.

[0091] [Variations] The above-described embodiments can be modified, for example, as shown in the following modified examples.

[0092] (Variation 1) Registration in the user DB and identification information DB In order to register information in the user DB and the identification information DB, the monitoring systems 100, 200, and 300 may further include a registration unit. The registration unit provides the second terminal 12 with, for example, an application screen or a web page for performing registration. The user inputs contact information, identification information of the person being watched over and the registered accompanying person, and other necessary information via the second terminal 12. When a face image is used as the identification information, the identification information may be input by capturing an image of the person being watched over and the registered accompanying person with a camera provided in the second terminal 12. The second terminal 12 transmits the input information to the monitoring systems 100, 200, and 300.

[0093] The registration unit registers the information received from the second terminal 12 in the user DB and the identification information DB. Note that, although the case where the information is registered via the second terminal 12 has been described, the registration may be similarly performed via the first terminal 11.

[0094] (Variation 2) Registration of notification destination When multiple registered accompanying persons are registered in the user DB for one person being watched over, different contact information may be registered for each registered accompanying person. For example, a case will be described where registered accompanying persons C1 and C2 are registered in association with the person being watched over A1. For the person being watched over A1, the contact information of registered accompanying person C2 may be registered in association with the registered accompanying person C1, and the contact information of C1 may be registered in association with the registered accompanying person C2. According to this, for example, in the second embodiment, when the recognition unit 101 recognizes that the person being watched over A and the registered accompanying person C1 are together, the notification unit 202 notifies the contact information of registered accompanying person C2.

[0095] (Variation 3) Type of Identification Information The acquiring unit 111 may acquire, as the identification information, an identifier of a mobile terminal such as an RFID (radio frequency identifier) ​​tag, an IC (integrated circuit) card, or a smartphone. In this case, the acquiring unit 111 may be a tag reader, a card reader, or an NFC (near field communication) reader.

[0096] Furthermore, the acquisition unit 111 may acquire, as the identification information, a personal ID input by the user via an input device connected to the first terminal 11. The personal ID is an identifier that uniquely identifies the user, and may be common to the identification ID. The acquisition unit 111 may acquire authentication information together with the personal ID that is the identification information, and transmit it to the monitoring system 100. The authentication information is, for example, a passcode, a password, a PIN (Personal Identification Number) code, or the like that is registered in advance in the authentication server 20 to improve the security of the identification information. The authentication information is, for example, input by the user via an input device, similar to the identification information.

[0097] The watching system 100 transmits the identification information and authentication information acquired by the acquisition unit 111 to the authentication server 20. The authentication server 20 collates the identification information and authentication information with information registered in advance, and transmits the authentication result to the watching system 100.

[0098] (Variation 4) Recognition of the person being watched over and the registered accompanying person In the above embodiment, the recognition unit 101, 301 determines whether the authenticated person is a person being watched over or a registered companion, and whether the person being watched over is together with the registered companion. However, the recognition unit 101, 301 may receive the result of the determination of the above items from the authentication server 20. In this case, the authentication server 20 stores the person being watched over and the registered companion in advance in association with each other.

[0099] The authentication server 20 may receive the identification information from the first terminal 11. In the fourth modification, the authentication server 20 judges whether the person whose identification information has been acquired is a person being watched over or a registered companion, and whether the person being watched over is together with the registered companion. The authentication server 20 transmits the judgment result to the recognition unit 101, 301.

[0100] (Variation 5) Facial Expression Analysis Each of the above embodiments may include a facial expression analysis unit. The facial expression analysis unit estimates facial expressions using any estimation technique by analyzing a face image, and determines whether the person being watched over is in distress. The facial expression analysis unit extracts facial feature points such as the eyes, eyebrows, nose, and mouth, and estimates happiness, surprise, confusion, and the like from the facial expression. The facial expression analysis unit may calculate a smile score, a degree of surprise, and a degree of confusion. The facial expression analysis unit may determine that the person being watched over is in distress when the calculated degree of confusion exceeds a predetermined value. The facial expression analysis unit may estimate emotions using multiple consecutive face images. By using multiple images, for example, the degree of distress of the person being watched over can be confirmed more accurately, and erroneous determination of the degree of confusion can be suppressed. Each of the above-mentioned notification units may provide a notification according to the emotion of the person being watched over.

[0101] (Variation 6) Notification of lateness In each embodiment, the notification unit may provide a notification regarding lateness. The notification regarding lateness may include, for example, that the person being watched over will be late, that there is a risk of being late, that the person being watched over is late, the expected arrival time, or the arrival time. In this case, for example, the user DB may include a time limit for the person being watched over. For example, the time limit may be "recognize the person being watched over between 8:00 and 8:30". The user DB may include the arrival location and expected arrival time of the person being watched over.

[0102] The recognition unit 101, 301 further refers to the user DB and the time when the watching target was recognized, and recognizes that the watching target will be late, that there is a possibility of being late, that the watching target is late, the expected arrival time, or the arrival time. For example, the recognition unit 101, 301 may calculate the time until arrival based on the time when the watching target was recognized and its location, and the arrival location and expected arrival time of the watching target, and recognize the watching target's lateness.

[0103] As a modification of the first embodiment, the notification unit 102 issues a notification when it is recognized that the person being watched over will be late. However, when the person being watched over is with a registered accompanying person, the notification unit 102 does not issue a notification regarding the lateness.

[0104] As a modification of the second and third embodiments, the first notification unit 212, 312 and the second notification unit 222, 322 issue notifications regarding lateness with different destinations or message contents depending on whether the person being watched over is with a registered companion or not. For example, the first notification may be addressed to the guardian and the school, and the second notification may be addressed to the school. The contents of the first notification may be, for example, "(person being watched over) has boarded the 8:35 bus. He will be late for school." The contents of the second notification may be, for example, "It's late, but (person being watched over) and (registered companion) have passed through (location) together."

[0105] (Variation 7) Functions and database of the monitoring system In the first to third embodiments, the monitoring systems 100, 200, and 300, the first terminal 11, the authentication server 20, the notification server 30, and the payment server 40 are each implemented by a separate device. However, the monitoring systems 100, 200, and 300 may have some or all of the functions of the first terminal 11, the authentication server 20, the notification server 30, and the payment server 40.

[0106] In addition, the user DB referred to by the monitoring systems 100, 200, and 300 and the identification information DB referred to by the authentication server 20 may be provided in a storage unit of the monitoring systems 100, 200, and 300.

[0107] [Hardware configuration] In each of the above-mentioned embodiments, each component of the monitoring systems 100, 200, 300, and 400 represents a functional block. A part or all of each component of each device (monitoring system, authentication server, notification server, settlement server, first terminal, and second terminal) may be realized by any combination of the computer 500 and a program.

[0108] Fig. 18 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 18, the computer 500 includes, for example, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0109] The program 504 includes instructions for implementing each function of each device. The program 504 is stored in advance in the ROM 502, the RAM 503, or the storage device 505. The CPU 501 implements each function of each device by executing instructions included in the program 504. For example, the CPU 501 of the monitoring system 100 implements the functions of the monitoring system 100 by executing instructions included in the program 504. The RAM 503 may also store data to be processed in each function of each device. For example, identification information in the monitoring system 100 may be stored in the RAM 503 of the computer 500.

[0110] The drive device 507 reads and writes data from and to the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and accepts information input from a system administrator or a user. The output device 510 is, for example, a display, and outputs (displays) information to a user or an administrator. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0111] It should be noted that the hardware configuration shown in FIG. 18 is merely an example, and other components may be added, or some components may not be included.

[0112] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0113] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits including a processor, etc., or a combination of these. These circuits may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0114] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be arranged in a centralized manner or in a distributed manner.

[0115] At least a part of the information system and the monitoring system may be provided in a Software as a Service (SaaS) format, i.e., at least a part of the functions for realizing the information system and the monitoring system may be executed by software executed via a network.

[0116] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with each other without departing from the scope of the present disclosure.

[0117] A part or all of the above-described embodiments may be described as, but are not limited to, the following supplementary notes.

[0118] [Appendix 1] A recognition means for recognizing a person being watched over and a registered companion associated with the person being watched over; A notification means for notifying a predetermined contact that the person being watched over has been recognized, When the notification means recognizes that the person being watched over and the registered companion are together, the notification means stops notifying the contact information. Monitoring system.

[0119] [Appendix 2] A recognition means for recognizing a person being watched over and a registered companion associated with the person being watched over; a first notification means for executing a first notification when it is recognized that the person being watched over and the registered accompanying person are not together; a second notification means for executing a second notification different from the first notification when it is recognized that the person being watched over and the registered accompanying person are together; A monitoring system equipped with

[0120] [Appendix 3] The first notification includes that the person being watched over is not with the registered companion, The second notification includes that the person being watched over and the registered companion are together. Attachment 2: A monitoring system.

[0121] [Appendix 4] The first notification means executes a notification to a first contact; The monitoring system according to claim 2 or 3, wherein the second notification means executes notification to a second contact point different from the first contact point.

[0122] [Appendix 5] A monitoring system according to any one of appendices 2 to 4, wherein the first notification includes additional information regarding the person being monitored, and the second notification does not include the additional information.

[0123] [Appendix 6] A monitoring system as described in Appendix 5, wherein the first notification includes, as the additional information, a facial image used to recognize the person being monitored.

[0124] [Appendix 7] A monitoring system according to any one of claims 1 to 6, wherein the recognition means recognizes the person being monitored and the registered accompanying person based on a facial image taken at a predetermined location.

[0125] [Appendix 8] A monitoring system described in any one of Appendices 1 to 7, wherein the recognition means recognizes the person being monitored and the registered companion using authentication results obtained for payment.

[0126] [Appendix 9] Further comprising a payment means for making a payment using the identification information, The recognition means recognizes the person being watched over and the registered accompanying person based on the identification information acquired for payment. A monitoring system according to any one of claims 1 to 8.

[0127] [Appendix 10] Further comprising a payment means for making a payment using a face image, A monitoring system described in any one of Appendices 1 to 9, wherein the recognition means recognizes the person being monitored and the registered accompanying person based on the facial image acquired for payment.

[0128] [Appendix 11] The first notification includes that the person being watched over made a payment when the registered companion was not present, A monitoring system as described in Appendix 2, wherein the second notification includes information that the person being monitored made a payment while the registered companion was present.

[0129] [Appendix 12] The recognition means recognizes the person being watched over and the registered accompanying person based on a facial image captured at a predetermined location, and further determines whether the person being watched over is in trouble based on the facial image, The monitoring system according to claim 1, wherein the notification means executes a notification to the contact person when it is determined that the person being monitored is in distress.

[0130] [Appendix 13] The recognition means recognizes the person being watched over and the registered accompanying person based on a facial image captured at a predetermined location, and further determines whether the person being watched over is in trouble based on the facial image, A monitoring system as described in Appendix 2, wherein the first notification means and the second notification means execute the first notification or the second notification when it is determined that the person being monitored is in distress.

[0131] [Appendix 14] Recognizing a person to be watched over and a registered companion associated with the person to be watched over, Notifying a predetermined contact that the person being watched over has been recognized; A method for monitoring people, which stops notifications to the contacts when it is recognized that the person being monitored and the registered companion are together.

[0132] [Appendix 15] Recognizing a person to be watched over and a registered companion associated with the person to be watched over, When it is recognized that the person being watched over and the registered accompanying person are not together, a first notification is sent; A method for monitoring people, which, when it is recognized that the person being monitored and the registered companion are together, issues a second notification different from the first notification.

[0133] [Appendix 16] Recognizing a person to be watched over and a registered companion associated with the person to be watched over, notifying a predetermined contact that the person being watched over has been recognized, and stopping the notification to the contact when it is recognized that the person being watched over and the registered companion are together; A recording medium that non-temporarily records a program that causes a computer to execute a process.

[0134] [Appendix 17] A process of recognizing a person being watched over and a registered companion associated with the person being watched over; When it is recognized that the person being watched over and the registered accompanying person are not together, a process of notifying a first notification; A recording medium that non-temporarily records a program that causes a computer to execute a process of making a second notification different from the first notification when it is recognized that the person being monitored and the registered companion are together.

[0135] [Appendix 18] A recognition means for recognizing a person to be watched over and a person in charge of protecting the person to be watched over; A notification means for executing a notification to the terminal of the protection officer when the person being watched over is recognized at a predetermined location, A monitoring system in which the notification means stops sending notifications to the terminal of the protection officer when it is recognized that the person being monitored and the protection officer are together.

[0136] [Appendix 19] A recognition means for recognizing a person to be watched over and a person in charge of protecting the person to be watched over at an entrance or exit of a facility or a vehicle; A payment means for making a payment based on a result of recognizing the person being watched over; A notification means for executing a notification to the terminal of the protection officer when the person being watched over is recognized at the entrance or exit, A monitoring system in which the notification means stops sending notifications to the terminal of the protection officer when it is recognized that the person being monitored and the protection officer are together.

[0137] [Appendix 20] A monitoring system as described in Appendix 1, wherein when it is recognized that the person being monitored is going to be late, the notification means executes a notification of the lateness to the contact information, and if the person being monitored and the registered companion are together, the notification of the lateness is stopped. [Explanation of symbols]

[0138] 1, 2 Information Systems 100, 200, 300, 400 Monitoring System 11 Terminal 1 12 Terminal 2 20 Authentication Server 30 Notification Server 40 Payment Server 500 Computers

Claims

1. A recognition means for recognizing a person being watched over and a registered companion associated with the person being watched over; A first notification means for executing a first notification to a first contact when it is recognized that the person being watched over and the registered accompanying person are not together; a second notification means for executing a second notification, different from the first notification, to a second contact, different from the first contact, when it is recognized that the person being watched over and the registered accompanying person are together; A monitoring system equipped with

2. The recognition means recognizes the person being watched over and the registered accompanying person based on a face image captured at a predetermined location. The monitoring system according to claim 1 .

3. The recognition means includes: using the face image acquired when making a payment, determining whether the person being watched over is together with the registered accompanying person; The monitoring system according to claim 2.

4. Further comprising a payment means for making a payment using a payment method associated with the person being watched over. The monitoring system according to claim 3.

5. The payment means performs payment using different payment methods depending on whether the person being watched over is alone or is with the registered companion. The monitoring system according to claim 4.

6. Recognizing a person to be watched over and a registered companion associated with the person to be watched over, If it is recognized that the person being watched over and the registered accompanying person are not together, a first notification is sent to a first contact point; A monitoring method in which, when it is recognized that the person being monitored and the registered companion are together, a second notification different from the first notification is sent to a second contact different from the first contact.

7. A process of recognizing a person being watched over and a registered companion associated with the person being watched over; When it is recognized that the person being watched over and the registered accompanying person are not together, a process of sending a first notification to a first contact; A computer program that causes a computer to execute a process of sending a second notification, different from the first notification, to a second contact, different from the first contact, when it is recognized that the person being monitored and the registered companion are together.

Images