Notification system control method and control device

Abstract

A method for controlling a notification system (2000) that includes a notification device (2200) located inside of a facility (2010), the method involving: detecting a visitor (2050) to the facility (2010) on the basis of detection information of a first sensor (2041) (S2001); acquiring the current relationship of users (2021 and 2022) located inside of the facility (2010) (S2005); and, when the visitor (2050) to the user (2021) in the facility (2010) is detected, notifying the user (2022) about the visit of the visitor (2050) using the notification device (2202) (S2006-S2008).

Description

[Technical field]

[0001] The present disclosure relates to a control method and a control device for a notification system that notifies a user of a visitor's arrival when the visitor to a facility is detected. [Background technology]

[0002] Conventionally, there is a technology for displaying images taken by a camera installed at the entrance of a facility on a display terminal within the facility. For example, in the intercom system of Patent Document 1, in order to improve security against spoofing of delivery personnel by delivery companies, a delivery company server queries the delivery personnel, and an electronic visit schedule is displayed on a monitor installed within the facility. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6321995 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-described conventional technology, a notification of a delivery person (visitor)'s visit to a facility is sent regardless of the status of the user inside the facility, so that the notification may be sent to an inappropriate user.

[0005] Therefore, the present disclosure provides a control method for a notification system that can notify appropriate users of the visitor's arrival when a visitor to a facility is detected. [Means for solving the problem]

[0006] A method for controlling a notification system according to one embodiment of the present disclosure is a method for controlling a notification system including a notification device located inside a facility, the method including: notifying a visitor to the facility based on detection information of a first sensor; a visitor to a first user located inside the facility, Detects The first user Located inside the facility The2 users Between Get the current relationship of When the visitor is detected in the facility, (i) based on a current relationship between the first user and the second user, it is determined whether or not to notify the second user of the visitor's visit to the first user, and (ii) when it is determined that the second user should be notified of the visitor's visit, the notification device is used to notify the second user of the visitor's visit to the first user, and in the determination of whether or not to notify the visitor's visit, the current relationship between the first user and the second user is used. If the current relationship indicates that the first user is planning an event for the second user, then using the notification device. For the first user Not notifying the second user of the visitor's visit It is judged that .

[0007] These comprehensive or specific aspects may be realized by a system, an apparatus, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a system, an apparatus, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0008] A method for controlling a notification system according to one aspect of the present disclosure can notify appropriate users of a visitor's arrival when a visitor to a facility is detected. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 shows a use case of the notification system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of the notification system according to the first embodiment. [Diagram 3] FIG. 3 shows an example of visiting schedule information in the first embodiment. [Figure 4] FIG. 4 shows an example of the relationship information according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart illustrating a process of the control unit according to the first embodiment. [Figure 6] FIG. 6 shows an example of relationship information according to the first modification of the first embodiment. [Figure 7] FIG. 7 is a flowchart illustrating a process of the control unit according to the first modification of the first embodiment. [Figure 8] FIG. 8 shows an example of relationship information according to the second modification of the first embodiment. [Figure 9]FIG. 9 is a flowchart illustrating a process of the control unit according to the second modification of the first embodiment. [Figure 10] FIG. 10 shows an example of a display screen in the second modification of the first embodiment. [Figure 11] FIG. 11 shows an example of a display screen in the second modification of the first embodiment. [Figure 12] FIG. 12 shows an example of a display screen in the second modification of the first embodiment. [Figure 13] FIG. 13 shows a use case of the notification system according to the second embodiment. [Figure 14] FIG. 14 is a block diagram showing a functional configuration of the entire system including the notification system according to the second embodiment. [Figure 15] FIG. 15 is a block diagram showing a functional arrangement of a notification system according to the second embodiment. [Figure 16A] FIG. 16A shows an example of order information according to the second embodiment. [Figure 16B] FIG. 16B shows an example of delivery request information in the second embodiment. [Figure 16C] FIG. 16C shows an example of reception information according to the second embodiment. [Figure 16D] FIG. 16D shows an example of delivery contact information in the second embodiment. [Figure 16E] FIG. 16E shows an example of delivery status information in the second embodiment. [Figure 17] FIG. 17 is a sequence diagram of the entire system including the notification system according to the second embodiment. [Figure 18] FIG. 18 is a flowchart showing the process of the ordering device according to the second embodiment. [Figure 19] FIG. 19 is a flowchart illustrating the process of the mail-order merchant server according to the second embodiment. [Figure 20] FIG. 20 is a flowchart illustrating the process of the delivery company server according to the second embodiment. [Figure 21] FIG. 21 is a flowchart showing the process of the notification system according to the second embodiment. [Figure 22] FIG. 22 is a flowchart showing the process of the notification system according to the second embodiment. [Figure 23A] FIG. 23A shows an example of a screen including delivery information in the second embodiment. [Figure 23B] FIG. 23B shows an example of a screen that does not include delivery information in the second embodiment. [Figure 24] FIG. 24 is a block diagram showing a functional arrangement of a notification system according to a variation of the second embodiment. [Diagram 25] FIG. 25 is a block diagram showing a functional configuration of a notification system according to the third embodiment. As shown in FIG. [Figure 26] FIG. 26 is a flowchart showing the process of the notification system according to the third embodiment. [Figure 27] FIG. 27 shows an example of a display screen in the third embodiment. [Figure 28] FIG. 28 shows an example of a screen including delivery information in a variation of the third embodiment. [Figure 29] FIG. 29 shows an example of a screen not including delivery information in a variation of the third embodiment. [Diagram 30] FIG. 30 is a flowchart showing the process of the notification system according to the fourth embodiment. [Diagram 31] FIG. 31 is a flowchart showing the process of the notification system according to the fifth embodiment. [Figure 32A] FIG. 32A shows an overall view of a service providing system in the sixth embodiment. [Figure 32B] FIG. 32B illustrates an example of a data center operating company according to the sixth embodiment. [Figure 32C] FIG. 32C illustrates an example of a data center operating company according to the sixth embodiment. [Diagram 33] FIG. 33 shows type 1 (own data center type) of the service in the sixth embodiment. [Diagram 34] FIG. 34 shows type 2 (IaaS usage type) of the service in the sixth embodiment. [Diagram 35]FIG. 35 shows service type 3 (PaaS usage type) in the sixth embodiment. [Diagram 36] FIG. 36 shows the fourth type (SaaS type) of service in the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiment will be specifically described with reference to the drawings.

[0011] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, the arrangement and connection of the components, steps, and the order of steps shown in the following embodiments are merely examples and are not intended to limit the scope of the claims. Furthermore, among the components in the following embodiments, those components that are not described in the independent claims showing the highest concept are described as optional components. Furthermore, each figure is not necessarily a strict illustration. In each figure, substantially the same configuration is given the same reference numeral, and duplicated explanations are omitted or simplified.

[0012] (Embodiment 1) [Use case of notification system] First, a use case of the notification system 2000 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 shows a use case of the notification system 2000 according to the first embodiment.

[0013] In this use case, the notification system 2000 is used in a facility 2010 where users 2021 to 2023 are present. The facility 2010 may be, for example, a residence, but is not limited to this. For example, the facility 2010 may be an apartment building, a store, an office, etc.

[0014] A first sensor 2041 and a second sensor 2042 are installed in a facility 2010. The first sensor 2041 is disposed near an entrance / exit 2030 of the facility 2010 in order to detect a visitor 2050 to the facility 2010. The second sensor 2042 is disposed within the facility 2010 in order to detect users 2021 to 2023. As the first sensor 2041 and the second sensor 2042, for example, a camera and / or a microphone, or an information terminal (such as a smartphone) equipped with them can be used, but is not limited thereto.

[0015] The notification system 2000 includes a control device 2100 and notification devices 2201 to 2203. The control device 2100 and the notification devices 2201 to 2203 are connected to each other via a computer network (for example, the Internet) so as to be able to communicate with each other.

[0016] A cloud server or an edge server having a physical or virtual processor and memory can be used as the control device 2100, but is not limited thereto. For example, a mobile terminal (e.g., a smartphone, a tablet computer, etc.) may be used as the control device 2100.

[0017] The notification devices 2201 to 2203 notify the users 2021 to 2023 of information, respectively. The notification devices 2201 to 2203 may be, but are not limited to, portable terminals. For example, the notification devices 2201 to 2203 may be displays or the like installed on the walls or floors of the facility 2010, or on equipment or devices within the facility 2010. In this case, each of the notification devices 2201 to 2203 can notify information to a user present in the vicinity of the notification device. In the following, when it is not necessary to distinguish between the notification devices 2201 to 2203, they will be referred to as notification device 2200.

[0018] [Notification system configuration] Here, the functional configuration of the notification system 2000 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the notification system 2000 according to the embodiment 1. The notification system 2000 is connected to a first sensor 2041 and a second sensor 2042, and includes a control device 2100 and a notification device 2200.

[0019] The first sensor 2041 outputs detection information when the visitor 2050 arrives at the facility 2010. Specifically, for example, if the first sensor 2041 has a camera, the first sensor 2041 outputs a camera image of the visitor 2050 as the detection information.

[0020] The second sensor 2042 detects the users 2021-2023 in the facility 2010. Specifically, for example, if the second sensor 2042 is a microphone, the second sensor 2042 outputs voice information of the users 2021-2023 as detection information.

[0021] As shown in FIG. 2, the control device 2100 includes a control unit 2102, a storage unit 2103, and a communication unit 2104.

[0022] The storage unit 2103 is implemented by, for example, a semiconductor memory and / or a hard disk drive. The storage unit 2103 stores visit schedule information 2103a indicating a visit schedule of a visitor and relationship information 2103b indicating a current relationship between the users 2021 to 2023. Here, the visit schedule information 2103a and the relationship information 2103b will be specifically described with reference to FIGS. 3 and 4.

[0023] 3 shows an example of visit schedule information 2103a in the first embodiment. The visit schedule information 2103a includes the visitee, type, visitor, scheduled visit date and time, and information for identification. For example, FIG. 3 shows that delivery person A is scheduled to visit user A for home delivery between 14:00 and 16:00 on January 10, 2020. Furthermore, it shows that delivery person A is identified using delivery person information (face image, QR code (registered trademark), etc.) and item information.

[0024] Note that the visit schedule information 2103a in Fig. 3 is an example, and the visit schedule information is not limited to this. Some of the items included in the visit schedule information 2103a shown in Fig. 3 may be omitted, or other items may be included.

[0025] FIG. 4 shows an example of the relationship information 2103b in the first embodiment. The relationship information 2103b includes update dates and times, and indicates the relationships between users A and B, between users B and C, and between users C and A. For example, in FIG. 4, the relationship information 2103b is updated at 12:00 on January 10, 2020, and indicates that the relationship between users A and B is poor, and that the relationships between users B and C and between users C and A are good. Here, users A, B, and C represent users 2021 to 2023, respectively.

[0026] Such relationship information 2103b may be set manually by the user, or may be set automatically by the control unit 2102, or may be a combination of these.

[0027] For example, the control unit 2102 may recognize a plurality of users based on the detection information of the second sensor 2042, and update the relationship information 2103b for the recognized plurality of users. Specifically, the control unit 2102 may update the relationship information 2103b based on the similarity between the conversation content of the recognized plurality of users and a predetermined conversation content. As the predetermined conversation content, a conversation content indicating that the relationship between the plurality of users is poor and / or a conversation content indicating that the relationship between the plurality of users is good can be used. Note that the control unit 2102 may update the relationship information 2103b from the conversation content using a machine learning model.

[0028] Also, for example, the control unit 2102 may update the relationship between the recognized users to poor if the detection information of the second sensor 2042 satisfies a first condition. On the other hand, the control unit 2102 may update the relationship between the recognized users to good if the detection information of the second sensor 2042 satisfies a second condition.

[0029] In this case, the first condition may be that the sound pressure of the voices of the multiple users indicated by the detection information of the second sensor 2042 is equal to or higher than a predetermined sound pressure. The predetermined sound pressure is a sound pressure for determining whether the multiple users are arguing. The first condition may be that the voices of the multiple users include a first predetermined word. The first predetermined word is a word for determining whether the multiple users are arguing. The first condition may be that the user's actions indicated by the detection information of the second sensor 2042 include a predetermined action. The predetermined action is a action for determining whether the multiple users are arguing. The first condition may be a combination of a voice condition and an action condition. The predetermined sound pressure, the first predetermined word, and the predetermined action may be empirically and / or experimentally defined in advance, or may be manually set by the user.

[0030] Furthermore, as the second condition, it is possible to use that the voices (conversation) of the multiple users indicated by the detection information of the second sensor 2042 continue for a predetermined time or more. The predetermined time is a time for determining that the conversation of the multiple users is long. Furthermore, it is possible to use, as the second condition, that the voices of the multiple users contain a second predetermined word. The second predetermined word is a word for determining an improvement in the relationship between the multiple users. The predetermined time and the second predetermined word may be defined in advance empirically and / or experimentally, or may be manually set by the user.

[0031] In addition, the recognition of the multiple users can use the feature amounts of the multiple users registered in advance, but is not limited to this. In the user recognition, when an unknown user is recognized, the unknown user may be treated as all users who have not been recognized among the multiple users registered in advance. For example, in a case where users A, B, and C are registered in advance, when user A and the unknown user are recognized from the detection information, the relationship between user A and all other users (users B and C) registered in advance may be updated.

[0032] The controller 2102 may be implemented, for example, by a processor and a memory. For example, the processor functions as the controller 2102 when instructions or software programs stored in the memory are executed.

[0033] The control unit 2102 detects a visitor 2050 to the facility 2010 based on detection information of the first sensor 2041. For example, the control unit 2102 receives a detection signal from the first sensor 2041 via the communication unit 2104, and identifies the visitor and the visited person by referring to the visit schedule information 2103a. More specifically, for example, if the first sensor 2041 includes a camera, the control unit 2102 receives a camera image of the visitor 2050 from the first sensor 2041. Then, the control unit 2102 refers to the visit schedule information 2103a stored in the storage unit 2103, and identifies the visitor and the visited person based on the current date and time and the camera image.

[0034] Furthermore, the control unit 2102 acquires the current relationships of the users 2021 to 2023 located inside the facility 2010. For example, the control unit 2102 refers to the relationship information 2103b stored in the storage unit 2103 to acquire the current relationships of the users 2021 to 2023.

[0035] Then, when the control unit 2102 detects a visitor 2050 to the first user in the facility 2010, the control unit 2102 determines whether or not to notify the second user of the visitor 2050's visit via the notification device 2200 based on the acquired current relationship. The control unit 2102 transmits notification information to the notification device 2200 according to the result of the determination. Here, the notification information functions as control information for controlling the notification device 2200, and allows the notification device 2200 to notify the second user of the visitor 2050's visit.

[0036] For example, when a visitor 2050 to the user 2021 is detected, the control unit 2102 determines whether or not to notify the user 2022 of the visitor 2050's visit by the notification device 2202 based on the relationship between the users 2021 and 2022. More specifically, when the current relationship between the users 2021 and 2022 indicates that it is poor, the control unit 2102 determines not to notify the user 2022 of the visitor 2050's visit and does not transmit notification information to the notification device 2202. On the other hand, when the current relationship between the users 2021 and 2022 indicates that it is good, the control unit 2102 determines to notify the user 2022 of the visitor 2050's visit and transmits notification information to the notification device 2202.

[0037] The communication unit 2104 is implemented by, for example, a network adapter, and transmits and receives information to and from the notification devices 2201 to 2203, the first sensor 2041, and the second sensor 2042.

[0038] The notification devices 2201 to 2203 can notify the users 2021 to 2023 of information, respectively. Specifically, the notification devices 2201 to 2203 display the notification information received from the control device 2100, thereby notifying the users 2021 to 2023 of the visit of the visitor 2050 to the facility 2010, respectively.

[0039] 2, the control unit 2102 is included in the control device 2100, but may be included in the notification device 2200. In this case, the notification device 2200 may acquire the current relationship between a first user and a second user located inside the facility 2010. Furthermore, when the notification device 2200 detects a visitor 2050 to the first user in the facility 2010, the notification device 2200 may notify the second user of the visitor 2050's visit based on the acquired current relationship.

[0040] [Control unit processing] Next, the processing of the control unit 2102 in the notification system 2000 configured as above will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the processing of the control unit 2102 according to the first embodiment.

[0041] First, the control unit 2102 detects a visitor 2050 to the facility 2010 based on detection information of the first sensor 2041 (S2001). Furthermore, the control unit 2102 identifies the visiting user (visited user) (S2002). Specifically, the control unit 2102 identifies the visitor 2050 by, for example, matching a camera image obtained from the first sensor 2041 with face information included in the visiting schedule information 2103a, and identifies the visited user corresponding to the visitor 2050.

[0042] The control unit 2102 transmits notification information to the notification device 2200 of the identified visited person (S2003). As a result, the visited person is notified of the visit of the visitor 2050.

[0043] The control unit 2102 selects another user in the facility 2010 (S2004). For example, if the visited person is user 2021, user 2022 or 2023 is selected. Then, the control unit 2102 acquires the relationship between the visited person and the selected user (S2005). For example, if the visited person is user 2021 and the selected user is user 2022, the control unit 2102 acquires "bad" as the relationship between users 2021 and 2022 by referring to relationship information 2103b in FIG. 4.

[0044] If the update date and time of the relationship information 2103b is old, the control unit 2102 may refer to default relationship information. The default relationship information may be set in advance by the user, or may be information in which all relationships are set to good or bad. Whether the update date and time is old or not can be determined by whether the difference between the current date and time and the update date and time is greater than a predetermined time. The predetermined time may be empirically and / or experimentally defined in advance, or may be manually set by the user.

[0045] The control unit 2102 judges whether the acquired relationship indicates a good relationship (S2006). Here, if the relationship indicates a good relationship (Yes in S2006), the control unit 2102 judges that the selected user should be notified of the visitor 2050's visit, and transmits the notification information to the notification device 2200 of the selected user (S2007). As a result, the notification device 2200 notifies the selected user of the visitor 2050's visit. Note that a notification device (e.g., a smartphone) previously associated with the selected user may be used as the notification device 2200 of the selected user. Also, a notification device (e.g., a display installed in a kitchen) located near the selected user may be used as the notification device 2200 of the selected user. In this case, the control unit 2102 may acquire the location of the selected user in the facility 2010, and transmit the notification information to the notification device 2200 located near the location.

[0046] On the other hand, if the relationship is poor (No in S2006), the control unit 2102 determines not to notify the selected user of the visitor 2050's visit and does not transmit the notification information to the notification device 2200 of the selected user (S2008). As a result, the selected user is not notified of the visitor 2050's visit.

[0047] The control unit 2102 determines whether or not to end the selection of other users (S2009). For example, the control unit 2102 determines not to end the selection when an unselected user exists in the facility. Also, for example, the control unit 2102 may determine to end the selection when the selected user has already been notified of the visit of the visitor 2050. The determination rule here is not particularly limited.

[0048] If it is determined that the selection of other users is not to be completed (No in S2009), the control unit 2102 selects another unselected user (S2004) and repeats the subsequent processes. On the other hand, if it is determined that the selection of other users is to be completed (Yes in S2009), the control unit 2102 ends the process.

[0049] [Effects, etc.] As described above, the control method of the notification system 2000 according to this embodiment is a control method of the notification system 2000 including the notification device 2200 located inside the facility 2010 and the control unit 2102, which detects a visitor 2050 to the facility 2010 based on detection information from the first sensor 2041, and the control unit 2102 acquires the current relationship between the users 2021 and 2022 located inside the facility 2010, and when a visitor 2050 to the user 2021 is detected in the facility 2010, the control unit 2102 determines whether or not to notify the user 2022 of the visitor 2050's visit via the notification device 2202 based on the current relationship.

[0050] According to this, it is possible to determine whether or not to notify the user 2022 of the visit of the visitor 2050 to the user 2021 based on the current relationship between the users 2021 and 2022. Therefore, it is possible to prevent a user who has an inappropriate relationship with the user 2021 from being notified of the visit of the visitor 2050 to the user 2021.

[0051] Also, for example, in the control method of the notification system 2000 according to the present embodiment, in determining whether or not to notify the user 2022 of the visitor 2050's visit, the control unit 2102 may determine not to notify the user 2022 of the visitor 2050's visit via the notification device 2202 if the current relationship indicates that it is poor.

[0052] According to this, when the current relationship between the users 2021 and 2022 is poor, it can be determined not to notify the user 2022 of the visit of the visitor 2050 to the user 2021. For example, when the user 2022 is fighting with the user 2021, the visit of the visitor 2050 to the user 2021 is notified to the user 2022, so that the relationship between the users 2021 and 2022 can be prevented from further deteriorating.

[0053] (First Modification of First Embodiment) Next, a first modified example of the first embodiment will be described. In this modified example, the main difference from the first embodiment is that whether or not to notify other users of the visitor's visit is determined depending on whether or not the user who is the visitor is planning an event for the other users (for example, a birthday surprise). Below, this modified example will be described with reference to the drawings, focusing on the differences from the first embodiment.

[0054] It should be noted that since the use cases and functional configuration of the notification system according to this modification are similar to those of the above-mentioned first embodiment, illustrations and explanations thereof will be simplified or omitted.

[0055] In this modified example, the facility 2010 has a plurality of spaces that are separated from one another. The plurality of spaces are separated, for example, by walls and / or partitions, and may be called rooms.

[0056] The storage unit 2103 of the control device 2100 stores relationship information 2103c instead of the relationship information 2103b. Fig. 6 shows an example of the relationship information 2103c according to the first modification of the first embodiment.

[0057] Relationship information 2103c according to this modification indicates whether users A to C are planning an event for other users. In Fig. 6, relationship information 2103c indicates that users A and C are planning an event for user B, and indicates that no one is planning an event for users A and C. Such relationship information 2103c may be set manually by the user, may be set automatically by control unit 2102, or may be a combination of these.

[0058] Next, the processing of control unit 2102 in notification system 2000 according to this modification will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the processing of control unit 2102 according to the first modification of the first embodiment.

[0059] After steps S2001 to S2003 are performed as in Fig. 5, the control unit 2102 acquires information on target users of the event planned by the visited person (S2101). For example, if the visited person is user 2021 (user A), the control unit 2102 refers to the relationship information 2103c in Fig. 6 and specifies user 2022 (user B) as the target user.

[0060] The control unit 2102 selects other users in the facility 2010 (S2004). Then, the control unit 2102 determines whether the selected user matches the target user (S2102). In other words, the control unit 2102 determines whether the visited user is planning an event for the selected user.

[0061] Here, if the selected user matches the target user (Yes in S2102), the control unit 2102 determines not to notify the selected user of the visitor 2050's visit and does not transmit notification information to the notification device of the selected user (S2008). As a result, the selected user is not notified of the visitor 2050's visit. On the other hand, if the selected user does not match the target user (No in S2102), the control unit 2102 determines whether the selected user and the target user are present in the same space within the facility 2010 (S2103). The positions of the selected user and the target user within the facility 2010 are detected, for example, by the second sensor 2042.

[0062] Here, if the selected user is in the same space as the target user (Yes in S2103), the control unit 2102 determines not to notify the selected user of the visitor 2050's visit and does not send notification information to the notification device of the selected user (S2008). As a result, the selected user is not notified of the visitor 2050's visit. On the other hand, if the selected user is in a different space from the target user (No in S2103), the control unit 2102 determines to notify the selected user of the visitor 2050's visit and sends notification information to the notification device of the selected user (S2007). As a result, the selected user is notified of the visitor 2050's visit by the notification device of the selected user.

[0063] For example, according to the relationship information 2103c in Fig. 6, the user 2021 (user A) is planning an event for the user 2022 (user B). Therefore, when the visited person is the user 2021, the visit of the visitor 2050 is not notified to the user 2022, but the visit of the visitor 2050 is notified to the user 2023 who exists in a different space from the user 2022.

[0064] As described above, in the control method of the notification system 2000 according to this modified example, when determining whether to notify the user 2022 of the visitor 2050's visit, the control unit 2102 may determine not to notify the user 2022 of the visitor 2050's visit via the notification device 2202 if the current relationship indicates that the user 2021 is planning an event for the user 2022.

[0065] According to this, when the user 2021 is planning an event for the user 2022, it can be determined not to notify the user 2022 of the visit of the visitor 2050 to the user 2021. Therefore, it is possible to prevent the plan of the event for the user 2022 from being revealed to the user 2022. For example, when the visitor 2050 is a delivery person who delivers a birthday cake for the user 2022 purchased by the user 2021, it is possible to prevent the plan of a birthday surprise for the user 2022 from being revealed to the user 2022 by the delivery person or the delivered birthday cake.

[0066] Also, for example, in the control method of notification system 2000 according to this modified example, facility 2010 has a plurality of spaces partitioned off from one another, user 2022 is present in one of the plurality of spaces, and in determining whether to notify user 2023 of the visitor 2050's visit, control unit 2102 may determine not to notify user 2023 of the visitor 2050's visit if user 2023 is present in the same space as user 2022 among the plurality of spaces, and may determine to notify user 2023 if user 2023 is present in a different space from user 2022 among the plurality of spaces.

[0067] According to this, it can be determined not to notify users who are in the same space as the user 2022 of the visit of the visitor 2050. Therefore, it is possible to prevent the user 2022 from noticing the visit of the visitor 2050. In other words, it is possible to further prevent the event plan for the user 2022 from being revealed to the user 2022.

[0068] In this modification, the relationship information 2103c is used instead of the relationship information 2103b, but both the relationship information 2103b and 2103c may be used. For example, when the relationship between the visited person and the user is good and the visited person has not planned an event for the user, the control unit 2102 may determine to notify the user of the visit of the visitor 2050. Conversely, when the relationship between the visited person and the user is bad and / or the visited person has planned an event for the user, the control unit 2102 may determine not to notify the user of the visit of the visitor 2050.

[0069] (Modification 2 of the First Embodiment) Next, a second modification of the first embodiment will be described. This modification is mainly different from the first embodiment in that other users are notified of a visitor's arrival according to the priority order. Below, this modification will be described with reference to the drawings, focusing on the differences from the first embodiment.

[0070] It should be noted that since the use cases and functional configuration of the notification system according to this modification are similar to those of the above-mentioned first embodiment, illustrations and explanations thereof will be simplified or omitted.

[0071] The storage unit 2103 of the control device 2100 stores relationship information 2103d instead of the relationship information 2103b. Fig. 8 shows an example of the relationship information 2103d according to the second modification of the first embodiment.

[0072] Relationship information 2103d according to this modification indicates the priority order of other users among users A to C. This priority order indicates the level of the relationship between the user and other users. In FIG. 8, relationship information 2103d indicates that user B has a higher priority order than user C for user A. Furthermore, relationship information 2103d indicates that user C has a higher priority order than user A for user B. Furthermore, relationship information 2103d indicates that user A has a higher priority order than user B for user C.

[0073] Furthermore, the relationship information 2103d includes information indicating the locations of the users A to C. In Fig. 8, it is shown that the users A and B exist in a first space, and the user C exists in a second space. The locations of the users are detected by, for example, the second sensor 2042, and updated by the control unit 2102.

[0074] Furthermore, the relationship information 2103d includes information indicating whether each of the users A to C can receive an item from a visitor (delivery person). That is, the relationship information 2103d includes information indicating whether the users A to C can respond to a visitor. Whether the user can receive an item is detected by, for example, the second sensor 2042, and updated by the control unit 2102. For example, the control unit 2102 may update the information indicating whether the user can receive an item by recognizing the user's behavior based on the video captured by the second sensor 2042. Specifically, when it is recognized that the user is taking a bath, cooking, or sleeping, the control unit 2102 may update the information indicating that the user cannot receive the item. In FIG. 8, the relationship information 2103d indicates that the user A cannot receive the item, but the users B and C can receive the item.

[0075] Next, the processing of control unit 2102 in notification system 2000 according to this modification will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the processing of control unit 2102 according to the second modification of the first embodiment.

[0076] After steps S2001 and S2002 are performed as in Fig. 5, the control unit 2102 judges whether the visited person is available to receive the item (S2201). If the visited person is available to receive the item (Yes in S2201), the control unit 2102 judges to notify the visited person of the visitor 2050's visit, transmits the notification information to the notification device 2200 of the visited person (S2003), and ends the process. As a result, the notification device 2200 of the visited person notifies the visited person of the visitor 2050's visit. For example, in Fig. 10, notification information 4100 for notifying the visited user A of the visitor A's visit is displayed on the notification device 2201.

[0077] On the other hand, if the visited person is not available to receive the package (No in S2201), the control unit 2102 decides not to notify the visited person of the visitor's 2050 visit, and does not transmit the notification information to the visited person's notification device (S2202).

[0078] The control unit 2102 refers to the relationship information 2103d, acquires the priority of other users for the visited person, and selects other users according to the priority (S2203). For example, when the user A is the visited person, the control unit 2102 refers to the relationship information 2103d of FIG. 8 and selects the user B with priority over the user C.

[0079] The control unit 2102 judges whether the selected user is available to receive the item (S2204). If the selected user is available to receive the item (Yes in S2204), the control unit 2102 judges to notify the selected user of the visitor 2050's visit, transmits the notification information to the notification device 2200 of the selected user (S2007), and ends the process. As a result, the notification device 2200 of the selected user notifies the selected user of the visitor 2050's visit. For example, in FIG. 11, notification information notifying user B of the visitor A's visit to user A is displayed on the notification device 2202. The notification information includes an image 4101 of visitor A (delivery person), an image 4102 of the delivered item, and delivery information 4103.

[0080] On the other hand, if the selected user is unable to receive the item (No in S2204), the control unit 2102 determines not to notify the selected user of the visitor 2050's arrival, does not transmit the notification information to the notification device of the selected user (S2008), and returns to step S2203. As a result, the selected user is not notified of the visitor 2050's arrival.

[0081] The notification information displayed on the notification device in Fig. 10 and Fig. 11 is an example, and is not limited thereto. For example, as shown in Fig. 12, an image related to an item may be displayed instead of an image of a visitor. In Fig. 12, an image 4111 of pet X and an image 4102 of the item are displayed as images related to the items, together with delivery information 4112 indicating that an item for pet X has arrived at the facility 2010. In other words, the notification device 2200 may notify the visit of a delivery person and image information related to the item.

[0082] As described above, in the control method of the notification system 2000 according to this modified example, the user 2023 is present within the facility 2010, and the control unit 2102 acquires information on whether the user 2021 is able to accommodate the visitor 2050 based on the detection information of the second sensor 2042. If the control unit 2102 indicates that the user 2021 is unable to accommodate the visitor 2050, it acquires a priority indicating the level of the relationship between the user 2021 and the users 2022 and 2023 as the current relationship, and the notification device 2200 may notify the users with the highest priority that there is a visitor 2050 at the facility 2010.

[0083] According to this, when the user 2021 is unable to respond to the visitor 2050, it is possible to notify other users of the visitor's 2050 visit in order of priority.

[0084] For example, in the control method of the notification system 2000 according to this modified example, the visitor 2050 may be a delivery person delivering an item to the facility 2010, and the notification device 2200 may notify the visitor of the delivery person and image information related to the item.

[0085] This allows notification of the delivery person's visit and image information related to the item.

[0086] This modification may be implemented in combination with the first embodiment and / or the first modification.

[0087] (Embodiment 2) [Use case of notification system] Next, a use case of the notification system 400 according to the second embodiment will be described with reference to Fig. 13. Fig. 13 shows a use case of the notification system 400 according to the second embodiment.

[0088] The notification system 400 according to this embodiment is used in a facility 10 which is the residence of a user 20. The facility 10 does not need to be limited to a residence, but may be any building that a delivery person visits to deliver an item. For example, the facility 10 may be an apartment building, a store, an office, etc.

[0089] 13, the notification system 400 includes a notification device 410 and an intercom device 420. The notification device 410 and the intercom device 420 are communicatively connected to each other.

[0090] The notification device 410 confirms whether the visitor 50 is a delivery person, and notifies the user 20 of delivery information according to the confirmation result. In other words, the notification device 410 judges whether the photographed image of the visitor 50 satisfies a predetermined condition, and notifies the user 20 of the delivery information according to the judgment result. The notification device 410 is located inside the facility 10, and is fixed to, for example, a wall, floor, or ceiling of the facility 10. Note that the notification device 410 may be portable.

[0091] The intercom device 420 is placed outside the facility 10, for example, near the entrance / exit 30 of the facility 10. The intercom device 420 accepts a visit from a visitor 50 to the facility 10 and takes a facial image of the visitor 50. The intercom device 420 can be used for communication with the notification device 410 within the facility 10.

[0092] Generally, an intercom is a telephone that is used exclusively within a building. Therefore, an intercom device may refer to a device that includes equipment outside the building and equipment inside the building. However, in this disclosure, the term intercom device is used primarily to refer to equipment outside the building.

[0093] The ordering device 300 orders products from a mail-order company through electronic commerce. The ordering device 300 is used by a user 20, and is, for example, a smartphone, a tablet computer, a laptop computer, a desktop computer, or any combination thereof.

[0094] [System-wide functional configuration including notification system] Here, the functional configuration of the entire system including notification system 400 and an external server will be described with reference to Figs. 14 to 16E. Fig. 14 is a block diagram showing the functional configuration of the entire system including notification system 400 according to embodiment 2. Fig. 15 is a block diagram showing the functional configuration of notification system 400 according to embodiment 2. Figs. 16A to 16E respectively show examples of order information 501, delivery request information 502, reception information 503, delivery contact information 504, and delivery status information 505 according to embodiment 2.

[0095] As shown in FIG. 14, a mail-order company server 100, a delivery company server 200, and an ordering device 300 are communicatively connected to a notification system 400.

[0096] [Functional configuration of mail order merchant server 100] First, the functional configuration of the mail-order company server 100 will be described with reference to Fig. 14 and Figs. 16A to 16C. The mail-order company server 100 is an example of an external server. As shown in Fig. 14, the mail-order company server 100 includes a communication unit 101, an order receiving unit 102, a package delivery instruction unit 103, and a display unit 104.

[0097] The communication unit 101 is realized, for example, by a wired and / or wireless communication circuit. The communication unit 101 receives the order information 501 from the ordering device 300 via a communication network. The communication network may be, for example, the Internet, a wide area network (WAN), a local area network (LAN), or any combination thereof.

[0098] As shown in Fig. 16A, the order information 501 includes an order ID for identifying the order, a user ID for identifying the orderer, a product ID for identifying the ordered product, the quantity of the ordered product, and the delivery address of the ordered product. Note that the order information 501 shown in Fig. 16A is an example and is not limited to this. For example, the order information 501 may further include the name of the ordered product.

[0099] Furthermore, communication unit 101 transmits delivery request information 502 to delivery company server 200 via the communication network. As shown in FIG. 16B, delivery request information 502 includes a reception ID that identifies the reception of the order (i.e., order), a user ID that identifies the orderer, a product ID that identifies the ordered product, the quantity of the ordered product, and a delivery address of the ordered product. Note that delivery request information 502 shown in FIG. 16B is an example and is not limited to this. For example, the quantity may be the number of boxes in which the products are packed for delivery.

[0100] Furthermore, the communication unit 101 transmits reception information 503 to the notification system 400 via the communication network. As shown in FIG. 16C, the reception information 503 includes a reception ID that identifies the reception of the order, an order ID that identifies the order, a user ID that identifies the orderer, a product ID that identifies the ordered product, and the quantity of the ordered product. Note that the reception information 503 shown in FIG. 16C is an example and is not limited to this. For example, the reception information 503 may further include the name of the ordered product.

[0101] The order receiving unit 102 is realized, for example, by a processor and a memory in which instructions are stored. The order receiving unit 102 may also be realized by a dedicated electronic circuit. The order receiving unit 102 performs order processing based on the order information 501 received from the ordering device 300, and generates delivery request information 502, reception information 503, and received product information.

[0102] The received product information is information about the ordered product, and is transmitted to the package delivery instruction unit 103. The received product information includes the product ID and quantity in the order information 501, for example.

[0103] The parcel delivery instruction unit 103 is realized, for example, by a processor and a memory in which instructions are stored. The parcel delivery instruction unit 103 may also be realized by a dedicated electronic circuit. The parcel delivery instruction unit 103 generates packing instruction information based on the received product information received from the order receiving unit 102. The packing instruction information is information for a worker in the product warehouse to prepare the shipment of the product, and is transmitted to the display unit 104. The packing instruction information includes, for example, a product ID, a quantity, a reception ID, etc.

[0104] The display unit 104 is realized by, for example, a liquid crystal display and / or an organic EL display. The display unit 104 is disposed in a product warehouse and displays packing instruction information. In the warehouse, a worker packs the product into a box based on the packing instruction information displayed on the display unit 104, and hands over the boxed product to a delivery company in a state in which the reception ID can be recognized.

[0105] [Functional configuration of the delivery company server 200] Next, the functional configuration of the delivery company server 200 will be described with reference to Fig. 14 and Fig. 16D. The delivery company server 200 is an example of an external server. As shown in Fig. 14, the delivery company server 200 includes a communication unit 201, a delivery person face information storage unit 202, a delivery reception unit 203, and a delivery task decision unit 204.

[0106] The communication unit 201 is realized, for example, by a wired and / or wireless communication circuit. The communication unit 201 receives delivery request information 502 from the mail-order merchant server 100 via the communication network. Furthermore, the communication unit 201 transmits delivery contact information 504 to the notification system 400 via the communication network.

[0107] As shown in Fig. 16D, the delivery contact information 504 includes a reception ID for identifying the reception of the order, a delivery company ID for identifying the delivery company, a scheduled delivery date and time, and delivery staff face information showing the face of the delivery staff who will deliver the product. Note that the delivery contact information 504 shown in Fig. 16D is an example and is not limited to this. The delivery staff face information may show the faces of multiple delivery staff.

[0108] The delivery person face information storage unit 202 is realized by, for example, a hard disk drive and / or a semiconductor memory. The delivery person face information storage unit 202 stores face information of a plurality of delivery persons. The delivery person face information may be a face image of the delivery person, or may be a feature amount extracted from the face image.

[0109] The delivery reception unit 203 is realized, for example, by a processor and a memory in which instructions are stored. The delivery reception unit 203 may also be realized by a dedicated electronic circuit. The delivery reception unit 203 generates delivery instruction information based on the delivery request information 502 received from the mail-order company server 100. The delivery instruction information includes information for assigning a delivery person to the product delivery request, and is transmitted to the delivery task decision unit 204.

[0110] Furthermore, the delivery reception unit 203 generates delivery contact information 504 based on the reception ID and delivery person face information received from the delivery business determination unit 204.

[0111] The delivery task determination unit 204 is realized, for example, by a processor and a memory in which instructions are stored. The delivery task determination unit 204 may be realized by a dedicated electronic circuit. The delivery task determination unit 204 assigns a delivery person to a delivery request based on the delivery instruction information received from the delivery reception unit 203, and acquires facial information of the assigned delivery person from the delivery person facial information storage unit 202. The delivery task determination unit 204 transmits the acquired delivery person facial information together with a reception ID to the delivery reception unit 203. The operator may assign the delivery person. In this case, the delivery task determination unit 204 may present information for assigning a delivery person to the operator.

[0112] [Functional configuration of the ordering device 300] Next, the functional configuration of the ordering device 300 will be described with reference to Fig. 14. As shown in Fig. 14, the ordering device 300 includes a communication unit 301, an input receiving unit 302, a display unit 303, and a control unit 304.

[0113] The communication unit 301 is realized by, for example, a wired and / or wireless communication circuit. The communication unit 301 transmits the order information 501 to the mail-order company server 100 via a communication network. The communication unit 301 may also transmit the order information 501 to the notification system 400.

[0114] The input receiving unit 302 is an input device for receiving input from the user 20. The input receiving unit 302 is realized, for example, by a touch panel (i.e., a touch screen) provided integrally with a display. The input receiving unit 302 may also be realized, for example, by a keyboard and / or a mouse. The input receiving unit 302 receives input of information related to ordering a product from the user 20.

[0115] The display unit 303 is realized by, for example, a liquid crystal display and / or an organic EL display. The display unit 303 displays a screen including information necessary for ordering, etc., based on the information accepted by the input acceptance unit 302.

[0116] The control unit 304 is realized, for example, by a processor and a memory in which instructions are stored. The control unit 304 may be realized by a dedicated electronic circuit. The control unit 304 controls the operations of the communication unit 301, the input reception unit 302, and the display unit 303 to perform order processing.

[0117] [Configuration of Notification System 400] Next, the configuration of the notification system 400 will be described with reference to Fig. 14, Fig. 15, and Fig. 16E. As shown in Fig. 15, the notification system 400 includes a notification device 410 and an intercom device 420. As shown in Fig. 14, the notification system 400 also includes, functionally, a communication unit 401, a visit reception unit 402, a camera unit 403, a delivery contact information reception unit 404, a face image matching unit 405, and a notification unit 406. Each of the functional components of the notification system 400 is implemented in the notification device 410 and / or the intercom device 420.

[0118] The communication unit 401 is implemented in each of the notification device 410 and the intercom device 420, and is realized by, for example, a wired and / or wireless communication circuit. The communication unit 401 receives reception information 503 from the mail order company server 100 via the communication network. Furthermore, the communication unit 401 receives delivery contact information 504 from the delivery company server 200 via the communication network.

[0119] Furthermore, the communication unit 401 performs data communication between the notification device 410 and the intercom device 420. For example, the communication unit 401 transmits a camera image from the intercom device 420 to the notification device 410. For data communication, wired communication and / or wireless communication can be used. For wireless communication, wireless LAN, Bluetooth (registered trademark), Zigbee (registered trademark), or any combination thereof can be used.

[0120] The visit reception unit 402 is implemented in the intercom device 420, and is realized by, for example, a call button. The visit reception unit 402 receives a visit from a visitor 50 to the facility 10. The visit reception unit 402 may be linked to a camera unit 403.

[0121] Camera unit 403 is implemented in intercom device 420, and is realized by, for example, an image sensor and an optical lens. Camera unit 403 takes a picture of the outside of facility 10, thereby taking a facial image of visitor 50 accepted by visit acceptance unit 402. The image taken by camera unit 403 is called a camera image. Camera unit 403 may be linked to visit acceptance unit 402.

[0122] The delivery contact information receiving unit 404 is implemented in the notification device 410, and is realized, for example, by a processor and a memory in which instructions are stored. The delivery contact information receiving unit 404 may be realized by a dedicated electronic circuit. The delivery contact information receiving unit 404 associates the delivery contact information 504 received from the delivery company server 200 with the reception information 503 received from the mail order company server 100, and records it as delivery status information 505.

[0123] As shown in Fig. 16E, the delivery status information 505 includes a reception ID for identifying the reception of the order, an order ID for identifying the order, a user ID for identifying the orderer, a product ID for identifying the ordered product, the quantity of the ordered product, a delivery company ID for identifying the delivery company, a scheduled delivery date and time, delivery staff face information showing the face of the delivery staff who will deliver the product, and a status showing whether the delivery staff will visit in the future or has already visited. Note that the delivery status information 505 shown in Fig. 16E is an example and is not limited to this.

[0124] The delivery contact information receiving unit 404 further transmits the delivery person facial information that is in a future visit state in the delivery status information 505 to the facial image matching unit 405 when a face image is captured by the camera unit 403 upon reception of a visit by the visit receiving unit 402. Then, based on the matching result in the facial image matching unit 405, the delivery contact information receiving unit 404 transmits the corresponding reception ID to the notification device 410 and updates the status of the corresponding reception ID to "visited."

[0125] The facial image matching unit 405 is implemented in the notification device 410, and is realized, for example, by a processor and a memory in which instructions are stored. The facial image matching unit 405 may be realized by a dedicated electronic circuit. The facial image matching unit 405 matches the facial image captured by the camera unit 403 (i.e., the camera image) with the delivery person facial information received from the delivery contact information receiving unit 404. In other words, the facial image matching unit 405 compares the facial information with the camera image to confirm whether the visitor 50 is a delivery person or not. The facial image matching unit 405 transmits the matching result to the delivery contact information receiving unit 404.

[0126] The notification unit 406 is realized by, for example, a display, a speaker, a microphone, a user interface (e.g., a touch panel), or any combination thereof. When the notification unit 406 confirms that the visitor 50 is a delivery person, it notifies the facility 10 of delivery information indicating that a delivery person for an item has arrived at the facility 10. In this embodiment, the notification unit 406 displays the delivery information on a display (e.g., a liquid crystal display or an organic EL display). Note that the notification means in the notification unit 406 is not limited to a display. The notification unit 406 may notify the delivery information by, for example, sound and / or vibration. Furthermore, the notification unit 406 may notify the delivery information by a combination of sound and / or vibration and display.

[0127] [System-wide behavior including notification system 400] The operation of the entire system including the notification system configured as above will be described.

[0128] [Interaction between devices] First, the interactions between the mail-order company server 100, the delivery company server 200, the ordering device 300, and the notification system 400 will be described with reference to Fig. 17. Fig. 17 is a sequence diagram of the entire system including the notification system 400 according to the second embodiment. In Fig. 17, the numbers in parentheses indicate the chronological order.

[0129] First, the ordering device 300 performs an ordering process (01), which causes the ordering information 501 to be transmitted from the ordering device 300 to the mail-order company server 100 (02).

[0130] Next, the mail-order company server 100 transmits delivery request information 502 to the delivery company server 200 based on the order information 501 (03-1), and transmits acceptance information 503 to the notification system 400 (03-2). Furthermore, the mail-order company server 100 displays packing instruction information (04).

[0131] The delivery company server 200 assigns a delivery person to the delivery request based on the delivery request information 502 (05). Furthermore, the delivery company server 200 acquires face information of the assigned delivery person (06) and transmits delivery contact information 504 including the acquired face information to the notification system 400 (07).

[0132] Here, when the notification system 400 accepts the visitor 50 (08), the notification system 400 takes a photograph of the face of the visitor 50 (09). Then, the notification system 400 extracts the face information of the delivery person, which is the future visit state, from the delivery status information 505 (10). The notification system 400 compares the photographed face image of the visitor 50 with the extracted face information of the delivery person (11). The notification system 400 switches the display content based on the comparison result (12).

[0133] [Processing of the ordering device 300] Next, the processing of the ordering device 300 will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the processing of the ordering device 300 according to the second embodiment.

[0134] First, the control unit 304 performs an order process (S101). Specifically, the control unit 304 generates order information 501 based on the input of the user 20 accepted by the input acceptance unit 302. The communication unit 301 transmits the order information 501 to the mail-order company server 100 (S102).

[0135] [Processing of mail order merchant server 100] Next, the processing of the mail-order trader server 100 will be described with reference to Fig. 19. Fig. 19 is a flow chart showing the processing of the mail-order trader server 100 according to the second embodiment.

[0136] The communication unit 101 receives the order information 501 from the ordering device 300 (S111). The order receiving unit 102 transmits the received product information to the package delivery instruction unit 103 based on the order information 501 (S112).

[0137] The order receiving unit 102 transmits delivery request information 502 to the delivery company server 200 via the communication unit 101 based on the order information 501 (S113). The order receiving unit 102 transmits reception information 503 to the notification system 400 via the communication unit 101 based on the order information 501 (S114).

[0138] The parcel delivery instruction unit 103 transmits packing instruction information to the display unit 104 based on the received product information (S115). The display unit 104 displays the packing instruction information (S116).

[0139] [Processing of delivery company server 200] Next, the process of the delivery company server 200 will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the process of the delivery company server 200 according to the second embodiment.

[0140] The communication unit 201 receives delivery request information 502 from the mail order merchant server 100 (S121). The delivery reception unit 203 transmits delivery instruction information to the delivery task determination unit 204 based on the delivery request information 502 (S122). The delivery task determination unit 204 assigns a delivery person to the delivery request (S123). The delivery task determination unit 204 transmits facial information of the assigned delivery person to the delivery reception unit 203 (S124). The delivery reception unit 203 transmits delivery contact information 504 to the notification system 400 based on the delivery request information 502 (S125).

[0141] [Notification System 400 Processing] Next, the processing of the notification system 400 will be described with reference to Fig. 21 and Fig. 22. Fig. 21 and Fig. 22 are flowcharts showing the processing of the notification system 400 according to the second embodiment.

[0142] First, the communication unit 401 receives reception information 503 from the mail order company server 100 (S131). Furthermore, the communication unit 401 receives delivery contact information 504 from the delivery company server 200 (S132). The delivery contact information reception unit 404 links the reception information 503 and the delivery contact information 504 and records them as delivery status information 505 (S133).

[0143] The visit reception unit 402 receives a visit from the visitor 50 (S134). At this time, the camera unit 403 takes a facial image of the visitor 50 and sends it to the facial image matching unit 405 (S135). The delivery contact information reception unit 404 sends the delivery person facial information to the facial image matching unit 405 (S136). The facial image matching unit 405 matches the facial image of the visitor 50 taken by the camera unit 403 with the delivery person facial information and notifies the delivery contact information reception unit 404 of the matching result (S137). This matching confirms whether the visitor 50 is a delivery person or not.

[0144] Here, if the facial image of the visitor 50 matches any of the delivery person facial information (match in S141), the delivery contact information receiving unit 404 transmits delivery information indicating which delivery person for which order has arrived to the notification device 410 based on the matching result and the delivery status information 505 (S142).

[0145] The notification unit 406 displays the delivery information received from the delivery contact information receiving unit 404 (S143). At this time, the notification unit 406 may display the delivery information using a first notification method. For example, the notification unit 406 may output a first notification sound and then display the delivery information, or may display the delivery information in a first color.

[0146] The delivery contact information receiving unit 404 updates the delivery status information 505 based on the matching result (S144). Specifically, the delivery contact information receiving unit 404 changes the status corresponding to the delivery staff face information that has been successfully matched to "Visited."

[0147] On the other hand, if the face image of the visitor 50 does not match any of the delivery person face information (mismatch in S141), the notification unit 406 displays the image captured by the camera unit 403 (S145). That is, the notification unit 406 notifies the visit information indicating the visit of the visitor 50 to the facility 10. At this time, the notification unit 406 may notify the visit information by a second notification method. The second notification method is different from the first notification method in step S143. For example, the notification unit 406 may output a second notification sound different from the first notification sound and then display the visit information, or may display the visit information in a second color different from the first color.

[0148] [Example of delivery information display] Here, examples of display screens in step S143 and step S145 in Fig. 22 will be described with reference to Fig. 23A and Fig. 23B. Fig. 23A shows an example of a screen including delivery information in the second embodiment. Fig. 23B shows an example of a screen not including delivery information in the second embodiment.

[0149] 23A, an image 4101 of a visitor (delivery person) photographed by the camera unit 403, an image 4102 of the delivered item, and delivery information 4103 are displayed on the display of the notification device 410. Here, the delivery information 4103 includes information indicating the arrival of the delivery person, as well as information that allows the user 20 to recognize the order and the ordered item. Note that the delivery information 4103 is an example and is not limited to this. For example, the delivery information 4103 may further include information of the mail order company, the order date and time, the product name corresponding to the item, or any combination of these.

[0150] The image 4102 of the delivered item may be obtained from the ordering device 300 based on the order ID, or may be obtained from the mail order dealer server 100 based on the order ID.

[0151] In FIG. 23B, the display of notification device 410 displays image 4101 of the visitor captured by camera unit 403, and visit information 4104 indicating that the visitor's facial image does not match the delivery person's facial information.

[0152] [Effects, etc.] As described above, the control method of the notification system 400 in this embodiment is to (a) obtain facial information of the delivery person of the item from the delivery company server 200, (b) obtain a camera image of the face of the visitor 50 to the facility 10 taken by a camera placed outside the facility 10, (c) compare the facial information and the camera image to confirm whether the visitor 50 is a delivery person, and (d) if it is confirmed that the visitor 50 is a delivery person, the notification device 410 can notify delivery information indicating that the delivery person of the item has arrived at the facility 10.

[0153] According to this, by comparing the facial information of the delivery person with the facial image of the visitor 50, it is possible to confirm whether the visitor 50 is a delivery person or not. Then, if it is confirmed that the visitor 50 is a delivery person, it is possible to notify the delivery information. Therefore, if the visitor 50 is disguised as a delivery person, it is possible to confirm that the visitor 50 is not a delivery person, thereby improving security. Furthermore, since the comparison is performed by the notification system 400, there is no need to send the camera image to the delivery company, and the privacy of the visitor 50 can also be protected.

[0154] Furthermore, in the control method of the notification system 400 according to this embodiment, (g) if the visitor 50 is not confirmed to be a delivery person, the notification device 410 may notify visit information indicating the visitor 50's arrival at the facility 10 by a second notification method, and in the above step (d), the delivery information may be notified by a first notification method different from the second notification method.

[0155] According to this, different notification methods can be used depending on whether the visitor 50 is a delivery person or not, so that the user 20 can easily recognize whether the visitor 50 is a delivery person or not, thereby improving security.

[0156] (Modification of the second embodiment) Next, a modified example of the second embodiment will be described. In this modified example, the functional arrangement of the notification system is mainly different from the second embodiment. Specifically, in this modified example, the functional arrangement of the notification device is mainly different from the second embodiment in that a part of the function of the notification device is realized by a cloud server. Below, this modified example will be described with reference to the drawings, focusing on the differences from the second embodiment.

[0157] [Functional layout of notification system 400A] 24 is a block diagram showing a functional arrangement of a notification system 400A according to a variation of Embodiment 2. The notification system 400A includes a cloud server 410a, a notification device 410b, and an intercom device 420.

[0158] The cloud server 410a is located outside the facility 10 and is communicatively connected to the notification device 410b and the intercom device 420. The cloud server 410a performs processing using cloud computing. Note that an edge server that performs processing using edge computing may be used instead of the cloud server 410a.

[0159] As shown in FIG. 24, the cloud server 410a includes a communication unit 401, a delivery contact information receiving unit 404, and a face image matching unit 405.

[0160] The notification device 410b is located inside the facility 10, and is communicatively connected to the cloud server 410a and the intercom device 420. For example, the notification device 410b is fixed to a wall, floor, or ceiling of the facility 10. The notification device 410b may be portable. As shown in FIG. 24, the notification device 410b includes a communication unit 401 and a notification unit 406.

[0161] [Effects, etc.] As described above, in notification system 400A according to this modification, face image matching section 405 that matches face information with a camera image can be provided in cloud server 410a.

[0162] According to this, the matching between face information and camera images can be realized by cloud server 410a, and the processing load of notification device 410b can be reduced. Therefore, even if notification device 410b has low processing power, notification system 400A can be introduced, and the versatility of notification system 400A can be improved.

[0163] (Embodiment 3) Next, a third embodiment will be described. The third embodiment differs from the second embodiment in that the notification method is switched according to the user's action. The following describes the third embodiment with reference to the drawings, focusing on the differences from the second embodiment.

[0164] [Functional configuration of notification system 400B] Notification system 400B according to this embodiment includes a communication unit 401, a visit reception unit 402, a camera unit 403, a delivery contact information reception unit 404, a face image matching unit 405, a notification unit 406B, and a user status confirmation unit 407. User status confirmation unit 407 includes a detection unit 4071, a recognition unit 4072, and an output unit 4073.

[0165] The detection unit 4071 is realized by, for example, a plurality of sensors arranged inside the facility 10. As the sensor, for example, an image sensor, an infrared sensor, a visible light sensor, or a microphone can be used. The detection unit 4071 detects the user 20.

[0166] The recognition unit 4072 is realized, for example, by a processor and a memory in which instructions are stored. The recognition unit 4072 may be realized by a dedicated electronic circuit. The recognition unit 4072 recognizes the action of the user 20 based on the output signal of the detection unit 4071. The output signal of the detection unit 4071 is, for example, a time-series signal of a sensor value or data obtained by processing the time-series signal.

[0167] For example, the recognition unit 4072 refers to reference information stored in a memory to determine the motion of the user 20 corresponding to the output signal of the detection unit 4071. Here, the reference information is information in which a plurality of user motions are associated with a plurality of output signal patterns. Note that the reference information may be information in which a plurality of users are associated with a plurality of motions and a plurality of output signal patterns. In this case, the recognition unit 4072 can also recognize the user from the output signal of the detection unit 4071. Note that the method of recognizing the user motion by the recognition unit 4072 may use a conventional technique and is not particularly limited.

[0168] The output unit 4073 outputs the motion information of the user 20 recognized by the recognition unit 4072 to the notification unit 406B.

[0169] The notification unit 406B judges whether the user 20 is performing a predetermined motion based on the motion information of the user 20 acquired from the user status confirmation unit 407. The notification unit 406B switches the notification method of the delivery information according to the judgment result. Specifically, when it is judged that the user 20 is performing a predetermined motion, the notification unit 406B notifies the delivery information by a first notification method, and when it is not judged that the user 20 is performing a predetermined motion, the notification unit 406B notifies the delivery information by a second notification method different from the first notification method.

[0170] For example, a first notification sound may be used in the first notification method, and a second notification sound different from the first notification sound may be used in the second notification method. Also, for example, the first notification method and the second notification method may have different screen transitions.

[0171] As the predetermined action, for example, an action that makes it difficult for the user 20 to receive an item from a delivery person may be adopted. Specifically, as the predetermined action, for example, cooking, cleaning, watching television, taking a bath, using the toilet, sleeping, etc. may be used. Information on such a predetermined action may be stored in advance in, for example, a memory. Also, for example, the predetermined action may be determined based on data received from another device, etc.

[0172] [Processing of Notification System 400B] Next, the processing of the notification system 400B will be described with reference to Fig. 26. Fig. 26 is a flowchart showing the processing of the notification system 400B according to the third embodiment.

[0173] After the processes of steps S131 to S142 are performed as in the second embodiment, the notification unit 406B judges whether the user 20 is performing a predetermined motion based on the motion information of the user 20 acquired from the user state confirmation unit 407 (S151). If it is judged that the user 20 is performing a predetermined motion (Yes in S151), the notification unit 406B displays the delivery information in a first notification method (S152). On the other hand, if it is not judged that the user 20 is performing a predetermined motion (No in S151), the notification unit 406B displays the delivery information in a second notification method (S153).

[0174] [Example of delivery information display] Here, the first notification method and the second notification method used in step S152 and step S153 in Fig. 26 will be described with reference to Fig. 23A and Fig. 27. Fig. 27 shows an example of a display screen in the third embodiment.

[0175] First, the first notification method will be described. As shown in FIG. 27, in the first notification method, notification unit 406B displays an image 4101 of the visitor (delivery person) photographed by camera unit 403, an image 4102 of the delivered item, and a reception selection button 4105 on the display. The reception selection button 4105 is a graphical user interface that allows the user to select whether to receive the item from the delivery person later or now. Here, when "receive now" is selected, for example, delivery information 4103 in FIG. 23A is displayed. On the other hand, when "receive later" is selected, for example, a screen for specifying the date and time of redelivery is displayed.

[0176] Next, the second notification method will be described. In the second notification method, the reception selection button 4105 in Fig. 27 is not displayed, and the delivery information 4103 in Fig. 23A is displayed immediately.

[0177] Note that the screen transitions in the first notification method and the second notification method in FIG. 23A and FIG. 27 are merely examples, and the present invention is not limited to these.

[0178] [Effects, etc.] As described above, in the control method of notification system 400B of this embodiment, a detection unit 4071 that detects user 20 is located inside facility 10, and the control method further includes (e) determining whether or not user 20 is performing a predetermined action based on an output signal from detection unit 4071, and in the above step (d), the method of notifying delivery information can be switched depending on the result of the determination.

[0179] This makes it possible to switch the method of notifying the delivery information according to the action of the user 20. For example, in a situation where the user 20 is performing an action that makes it difficult for the user 20 to receive an item from the delivery person, it becomes possible to notify the delivery information using a notification method suitable for that situation.

[0180] (Modification of the third embodiment) Next, a modified example of the third embodiment will be described. This modified example differs from the third embodiment mainly in that the notification device that notifies the delivery information is switched from among a plurality of notification devices in response to the actions of a plurality of users. Below, this modified example will be described with reference to the drawings, focusing on the differences from the third embodiment.

[0181] In this modification, a plurality of notification devices 410b are located inside the facility 10. Also, the detection unit 4071 is realized by, for example, a plurality of sensors arranged at different positions in the facility 10, and detects each of a plurality of users 20 located inside the facility 10.

[0182] The cloud server 410a selects at least one user 20 who is not performing a predetermined action from among the multiple users 20 based on the output signal of the detection unit 4071. The cloud server 410a transmits delivery information to at least one notification device 410b among the multiple notification devices 410b that is located within a predetermined range from the selected user 20. The at least one notification device 410b notifies the delivery information received from the cloud server 410a.

[0183] The predetermined range is defined by, for example, a predetermined distance. In this case, the predetermined distance may be stored in advance in a memory. The predetermined range may also be defined by a predefined area (e.g., a kitchen, a child's room, etc.) in the facility 10.

[0184] [Example of delivery information display] An example of a display screen in this modification will be described with reference to Fig. 28 and Fig. 29. Fig. 28 shows an example of a screen including delivery information in the modification of embodiment 3. Fig. 29 shows an example of a screen not including delivery information in the modification of embodiment 3.

[0185] Here, within the facility 10, a mother is cooking in the kitchen, and a child is reading a book in the child's room. In this case, if the face image of the visitor 50 matches the delivery person face information, the child who is not cooking, which is a predetermined action, is selected from among the mothers and children located within the facility 10. Then, the notification device 410b located in the child's room displays text information 4106 saying "Mom is busy cooking, so please accept the delivery (product C0001) on her behalf." Meanwhile, the notification device 410b located in the kitchen displays text information 4107 saying "A notification has been given to the child to accept the delivery from the delivery person."

[0186] This ensures that children can receive deliveries on behalf of their mothers who are too busy cooking to receive them.

[0187] [Effects, etc.] As described above, in the control method of the notification system according to this modification, the notification system 400B includes a plurality of notification devices 410b, the detection unit 4071 detects each of the plurality of users 20, and the control method further includes (f) selecting at least one user 20 not performing a predetermined action from among the plurality of users 20 based on an output signal from the detection unit 4071, and in the above step (d), notifying the delivery information by at least one notification device 410b among the plurality of notification devices 410b. Here, the at least one notification device 410b is located within a predetermined range from the at least one selected user 20.

[0188] This makes it possible to avoid users 20 who are in an action that makes it difficult for them to receive an item from the delivery person, and to notify delivery information to users 20 who are not in that action. This makes it possible for users 20 to reliably receive an item from the delivery person.

[0189] (Embodiment 4) Next, a fourth embodiment will be described. The fourth embodiment differs from the second embodiment in that the method of notifying the visit information is switched based on visit schedule information for the facility of a visitor other than the delivery person of the goods. The following describes the present embodiment with reference to the drawings, focusing on the differences from the second embodiment.

[0190] The configuration of notification system 400 according to this embodiment is similar to that of the second embodiment, and therefore illustration and description thereof will be omitted.

[0191] [Notification System 400 Processing] The processing of notification system 400 according to the present embodiment will be described with reference to Fig. 30. Fig. 30 is a flowchart showing the processing of notification system 400 according to the fourth embodiment.

[0192] If the face image of the visitor 50 does not match any of the delivery person face information (no match in S141), the notification device 410 acquires visit schedule information of visitors to the facility 10 during a predetermined period, and judges whether the visit date and time of the visitor 50 is within a predetermined time range from the scheduled visit date and time (S241). The visit schedule information includes first visit schedule information indicating the scheduled delivery date and time of the item, and second visit schedule information indicating the scheduled visit date and time of a visitor different from the delivery person of the item. The first visit schedule information is, for example, the delivery status information shown in FIG. 16E. The predetermined time range may be empirically or experimentally determined in advance, and is, for example, stored in advance in a memory.

[0193] Here, if the visit date and time is within a predetermined time range from the scheduled visit date and time (Yes in S241), the notification unit 406 displays visit information indicating the arrival of a scheduled visitor (S242). For example, the notification unit 406 displays text information such as "A scheduled visitor visited" or "Mr. A visited." On the other hand, if the visit date and time is not within a predetermined time range from the scheduled visit date and time (No in S241), the notification unit 406 displays visit information indicating the arrival of an unscheduled visitor (S243) and ends the process. For example, the notification unit 406 displays text information such as "An unscheduled visitor visited" or "There was a visit."

[0194] After step S144 or step S242, the notification device 410 determines whether the user 20 is absent from the facility 10 (S244). For example, the notification device 410 determines whether the user 20 is absent based on schedule information of the user 20. The notification device 410 may also determine that the user 20 is absent when no reaction of the user 20 is detected for a predetermined time after notification of delivery information or visit information. The user's reaction can be detected based on data obtained from a sensor located in the facility 10 or based on whether or not there is an operation of the user on the notification device 410.

[0195] If the user 20 is not present (Yes in S244), the visit reception unit 402 notifies the visitor 50 that the user 20 is not present (S245), and ends the process.

[0196] In the notification of the delivery information or the visit information in steps S143, S242, and S243, the voice of the delivery information or the visit information may be output instead of displaying the delivery information or the visit information. Also, in addition to displaying the delivery information or the visit information, sound or music may be output.

[0197] In addition, the notification of the delivery information or the visit information in steps S143, S242, and S243 may use first to third notification methods that are different from each other. For example, different notification sounds may be output for the first to third notification methods. Also, for example, the information may be displayed in different colors for the first to third notification methods.

[0198] [Effects, etc.] As described above, in the control method of the notification system 400 according to this embodiment, in the above step (d), the delivery information is notified by the first notification method, and the control method further includes (h) acquiring information on the planned visit of the visitor 50 to the facility 10 during a specified period, the planned visit information including first planned visit information indicating the planned delivery date and time of the item and second planned visit information indicating the planned visit date and time of a visitor other than the delivery person for the item, (i) if the visitor 50 is not confirmed to be a delivery person and the visit date and time of the visitor 50 is within a specified time range from the planned visit date and time, the notification device 410 notifies the visit information indicating the visit of the visitor 50 to the facility 10 by the second notification method, and (j) if the visitor 50 is not confirmed to be a delivery person and the visit date and time of the visitor 50 is not within a specified time range from the planned visit date and time, the notification device 410 notifies the visit information indicating the visit of the visitor 50 to the facility 10 by the third notification method.

[0199] According to this, different notification methods can be used for delivery personnel, scheduled visitors, and unscheduled visitors, making it easier for the user 20 to recognize unscheduled visitors and improving security.

[0200] Furthermore, in the case of notification by the third method, since the visitor 50 is not a scheduled visitor, there is a possibility that a crime prevention risk will increase by notifying the user 20 of his / her absence. Therefore, for example, if the user's reaction cannot be detected within a predetermined time after notification by the first and second methods, the visit reception unit 402 notifies the visitor 50 of the user's absence by notifying the visitor 50 of the user's absence without depending on the user's reaction after notification by the third method, thereby improving the convenience of the visitor 50 while suppressing an increase in crime prevention risks.

[0201] (Embodiment 5) Next, a fifth embodiment will be described. The fifth embodiment differs from the above-mentioned embodiments in that an application program for face matching is switched for each delivery business. The following describes the present embodiment, focusing on the differences from the above-mentioned embodiments.

[0202] The configuration of notification system 400 according to this embodiment is similar to that of the second embodiment, and therefore illustration and description thereof will be omitted.

[0203] [Notification System 400 Processing] The processing of notification system 400 according to the present embodiment will be described with reference to Fig. 31. Fig. 31 is a flowchart showing the processing of notification system 400 according to the fifth embodiment.

[0204] After the processes of steps S131 to S135 are performed, the face image matching unit 405 recognizes the delivery person (S331). For example, the face image matching unit 405 recognizes the delivery person from the delivery person's uniform, etc. in the image of the visitor captured by the camera unit 403.

[0205] Next, the face image matching unit 405 starts an application program corresponding to the recognized delivery company among the multiple application programs corresponding to the multiple delivery companies (S332). The application program corresponding to the delivery company is a program that is permitted to access the delivery staff face information of the delivery company. In other words, the application program can access the delivery staff face information of at least one of the multiple delivery companies, but cannot access the delivery staff face information of the other delivery companies.

[0206] Thereafter, the process of step S136 and / or step S137 is performed using the started application program.

[0207] In addition, in FIG. 31, an example is shown in which an application program is started after a delivery company is recognized from an image captured by the camera unit 403, but this is not limited thereto. For example, the face image matching unit 405 may refer to the delivery status information 505 shown in FIG. 16E, for example, and start an application program corresponding to the company ID based on the scheduled delivery date and time of the future visit status. In addition, the face image matching unit 405 may obtain the position information of the delivery person from the delivery company server 200, and start the application program when the delivery person approaches the facility 10. In addition, when the delivery person checks an item using a terminal in front of the facility 10, a message may be transmitted from the delivery company server 200 to the notification system 400, and the application program may be started based on the message.

[0208] [Effects, etc.] As described above, in the control method of notification system 400 according to this embodiment, prior to the above step (c), (j) a delivery company associated with the visitor is recognized from the camera image of visitor 50 captured by camera unit 403, and in the above step (c), the facial information and the camera image are compared using an application program corresponding to the recognized delivery company.

[0209] This allows the application program to be automatically switched when it is necessary for the delivery company to switch.

[0210] (Embodiment 6) Next, a sixth embodiment will be described. In this embodiment, a service providing system that provides services including notification of delivery information will be described.

[0211] [Overall image of services provided] FIG. 32A shows an overall view of a service providing system according to the sixth embodiment.

[0212] The group 1000 may be, for example, a company, an organization, a home, or the like, and may be of any size. The group 1000 includes a device A, a device B, and a home gateway 1020, which are included in a plurality of devices 1010. For example, the device A may be a notification device in each of the above-mentioned embodiments. The plurality of devices 1010 may include devices that can connect to the Internet (e.g., a smartphone, a PC, a TV, etc.), and devices that cannot connect to the Internet by themselves (e.g., a light, a washing machine, etc.). Even if a device cannot connect to the Internet by itself, it may be possible for the device to connect to the Internet via the home gateway 1020. The group 1000 also includes a user 990A who uses a plurality of devices 1010.

[0213] The data center operating company 1100 has a cloud server 1110. The cloud server 1110 is a virtualized server that cooperates with various devices via the Internet. For example, the cloud server 1110 may be the control device and cloud server in each of the above-mentioned embodiments. The cloud server 1110 mainly manages huge data (big data) that is difficult to handle with a normal database management tool. The data center operating company 1100 manages data and the cloud server 1110, and operates the data center that performs these operations. The services performed by the data center operating company 1100 will be described in detail later. Here, the data center operating company 1100 is not limited to a company that only manages data and operates the cloud server 1110. For example, when a device manufacturer that develops and manufactures one of the multiple devices 1010 also manages data and the cloud server 1110, the device manufacturer corresponds to the data center operating company 1100 (FIG. 32B). Furthermore, the data center operating company 1100 is not limited to one company. For example, if a device manufacturer and another management company jointly or jointly manage data and operate the cloud server 1110, either one or both of them corresponds to the data center operating company 1100 (FIG. 32C).

[0214] The service provider 1200 owns a server 1210. The server 1210 referred to here includes, for example, a memory in a personal PC, regardless of its scale. Also, there are cases where the service provider does not own the server 1210.

[0215] Note that the home gateway 1020 is not essential for the above services. For example, when the cloud server 1110 manages all data, the home gateway 1020 is not necessary. Also, there may be cases where there is no device that cannot connect to the Internet by itself, such as when all devices in a home are connected to the Internet.

[0216] Next, the flow of information in the above service will be described.

[0217] First, device A or device B of group 1000 transmits information obtained by each device to cloud server 1110 of data center operating company 1100. Cloud server 1110 collects information of device A or device B ((a) of FIG. 32A). The collected information is information indicating, for example, the operation status, operation date and time, operation mode, location, etc. of multiple devices 1010. For example, the collected information is information indicating the operation date and time of a television viewing history, recording reservation information of a recorder, operation date and time of a washing machine, amount of laundry, date and time of opening and closing a refrigerator, number of times of opening and closing, amount of food in the refrigerator, etc., but is not limited to these, and refers to all information that can be obtained from any device. Information may be provided to cloud server 1110 directly from multiple devices 1010 themselves via the Internet. Information may also be collected from multiple devices 1010 once in home gateway 1020, and provided from home gateway 1020 to cloud server 1110.

[0218] Next, the cloud server 1110 of the data center operating company 1100 provides the accumulated information to the service provider 1200 in a certain unit. Here, the certain unit may be a unit in which the data center operating company can organize the accumulated information and provide it to the service provider 1200, or may be a unit requested by the service provider 1200. Although it is described as a certain unit, it does not have to be a certain unit, and the amount of information provided may change depending on the situation. The information is stored in the server 1210 owned by the service provider 1200 as necessary ((b) of FIG. 32A). Then, the service provider 1200 organizes the information into information suitable for the service to be provided to the user, and provides it to the user. The user to whom the information is provided may be a user 990A who uses multiple devices 1010, or an external user 990B. The method of providing the service to the user may be, for example, a method in which the service provider directly provides the information to the user ((e) and (f) of FIG. 32A). In addition, the method of providing the service to the user may be, for example, to be provided to the user via the cloud server 1110 of the data center operating company 1100 again ((c) and (d) in FIG. 32A). In addition, the cloud server 1110 of the data center operating company 1100 may organize information into information suitable for the service to be provided to the user, and provide the information to the service provider 1200.

[0219] It should be noted that user 990A and user 990B may be different or the same.

[0220] The technology described in the above aspects may be realized in the following types of cloud services, for example. However, the types in which the technology described in the above aspects is realized are not limited thereto.

[0221] [Service type 1: In-house data center type] FIG. 33 shows service type 1 (own data center type). In this type, a service provider 1200 acquires information from a group 1000 and provides a service to a user. In this type, the service provider 1200 has the function of a data center operating company. That is, the service provider owns a cloud server 1110 that manages big data. Therefore, there is no data center operating company.

[0222] In this type, the service provider 1200 operates and manages a data center 903 (cloud server 1110). The service provider 1200 also manages an OS 902 and an application 901. The service provider 1200 provides a service 904 by using the OS 902 and the application 901 managed by the service provider 1200.

[0223] [Service type 2: IaaS usage type] Figure 34 shows service type 2 (IaaS type). Here, IaaS stands for Infrastructure as a Service, and is a cloud service model that provides the infrastructure for building and running computer systems as a service via the Internet.

[0224] In this type, a data center operating company 1100 operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 manages an OS 902 and an application 901. The service provider 1200 provides a service 904 using the OS 902 and the application 901 managed by the service provider 1200.

[0225] [Service type 3: PaaS usage type] Figure 35 shows service type 3 (PaaS type). PaaS stands for Platform as a Service, a cloud service model that provides a platform for building and running software as a service via the Internet.

[0226] In this type, a data center operating company 1100 manages an OS 902, and operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 manages an application 901. The service provider 1200 provides a service 904 using the OS 902 managed by the data center operating company and the application 901 managed by the service provider 1200.

[0227] [Service type 4: SaaS] Figure 36 shows service type 4 (SaaS type). Here, SaaS is an abbreviation for Software as a Service. For example, it is a cloud service provision model that allows companies or individuals (users) that do not own a data center (cloud server) to use applications provided by a platform provider that owns a data center (cloud server) via a network such as the Internet.

[0228] In this type, a data center operating company 1100 manages an application 901, an OS 902, and operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 provides a service 904 using the OS 902 and the application 901 managed by the data center operating company 1100.

[0229] In any of the above types, it is assumed that the service provider 1200 provides the service. For example, the service provider or the data center operating company may develop an OS, an application, a big data database, or the like by itself, or may outsource it to a third party.

[0230] (Other embodiments) Although the information processing system according to one or more aspects of the present disclosure has been described based on the embodiment, the present disclosure is not limited to this embodiment. As long as it does not deviate from the gist of the present disclosure, various modifications conceived by a person skilled in the art to this embodiment and forms constructed by combining components in different embodiments may also be included within the scope of one or more aspects of the present disclosure.

[0231] For example, one aspect of the present disclosure may be not only such an information processing system, but also a display control method in which steps are processes performed by a processor included in the information processing system. Also, one aspect of the present disclosure may be a computer program that causes a computer to execute each of the characteristic steps included in the display control method. Also, one aspect of the present disclosure may be a computer-readable non-transitory recording medium on which such a computer program is recorded.

[0232] Such a program causes a computer to (a) use a sensor to acquire a user status indicating whether the user is cooking using a cooking appliance when an image of a delivery person delivering an object to a user's building is captured by a camera installed at the entrance or exit of the building, (b) acquire content information of the object, (c) acquire at least one suggested content corresponding to the user status and the content information of the object, and (d) display the image of the delivery person, the content information of the object, and the at least one suggested content on a display terminal installed in the building.

[0233] In the present disclosure, all or part of the units, devices, or all or part of the functional blocks of the block diagrams shown in FIG. 2 and FIG. 14 may be implemented by one or more electronic circuits including a semiconductor device, a semiconductor integrated circuit (IC), or an LSI (large scale integration). The LSI or IC may be integrated into one chip, or may be configured by combining multiple chips. For example, functional blocks other than memory elements may be integrated into one chip. Although LSI and IC are referred to here, the names may vary depending on the degree of integration, and may be called system LSI, VLSI (very large scale integration), or ULSI (ultra large scale integration). Field programmable gate arrays (FPGAs), which are programmed after the manufacture of LSIs, or reconfigurable logic devices, which can reconfigure the junction relationship within LSIs or set up circuit partitions within LSIs, may also be used for the same purpose.

[0234] Furthermore, all or part of the functions or operations of the unit, device, or part of the device can be executed by software processing. In this case, the software is recorded in one or more non-transitory recording media such as ROM, optical disk, hard disk drive, etc., and when the software is executed by a processor, the software causes the processor and peripheral devices to execute specific functions in the software. The system or device may include one or more non-transitory recording media in which the software is recorded, a processor, and necessary hardware devices, such as interfaces. [Industrial Applicability]

[0235] This can be used as a notification system that notifies a user of delivery information when a delivery person who delivers an item arrives at a facility. [Explanation of symbols]

[0236] 10, 2010 Facility 20, 2021, 2022, 2023 Users 30, 2030 entrance / exit 50, 2050 visitors 100 Mail Order Business Server 101, 201, 301, 401, 2104 Communications Department 102 Order Reception Department 103 Baggage Delivery Instructions Department 104, 303 Display section 200 Delivery Company Server 202 Delivery Person Face Information Storage Department 203 Delivery Reception Department 204 Delivery Operation Decision Department 300 Ordering device 302 Input reception section 304, 2102 Control unit 400, 400A, 400B, 2000 Notification System 402 Visitor Reception Department 403 Camera Department 404 Delivery Contact Information Reception Department 405 Face image matching unit 406, 406B Notification Department 410, 410b, 2200, 2201, 2202, 2203 Notification device 410a Cloud Server 420 Intercom Device 501 Ordering Information 502 Delivery request information 503 Reception Information 504 Delivery contact information 505 Delivery Status Information 2041 First Sensor 2042 Second Sensor 2100 Control Unit 2103 Storage section 2103a Visit schedule 2103b, 2103c, 2103d Relationship information

Claims

1. A method for controlling a notification system including a notification device located inside a facility, comprising: Detecting a visitor to the facility and a visitor to a first user located inside the facility based on detection information of a first sensor; Obtaining a current relationship between the first user and a second user located within the facility; When the visitor is detected at the facility, (i) based on a current relationship between the first user and the second user, determine whether or not to notify the second user of the visitor's visit to the first user, and (ii) when it is determined that the second user should be notified of the visitor's visit, notify the second user of the visitor's visit to the first user using the notification device; In determining whether to notify the second user of the visitor's arrival, if the current relationship between the first user and the second user indicates that the first user is planning an event for the second user, determining not to notify the second user of the visitor's arrival to the first user using the notification device. Control methods.

2. In determining whether to notify the second user of the visit of the visitor, if the current relationship between the first user and the second user indicates that it is poor, it is determined not to notify the second user of the visitor's visit to the first user using the notification device. The control method according to claim 1 .

3. The facility has a plurality of spaces that are partitioned from each other, the second user is present in one of the plurality of spaces; The control method includes: when a third user is present in the same space as the second user among the plurality of spaces, not notifying the third user of the visitor's visit using the notification device; When the third user is present in a space different from the second user among the plurality of spaces, notifying the third user of the visitor's visit using the notification device. The control method according to claim 1 .

4. A third user is present within the facility; The control method includes: acquiring information on whether the first user is available to serve the visitor based on detection information from a second sensor; When the first user indicates that he / she is unavailable to respond to the visitor, acquiring a priority indicating a level of a relationship between the first user and the second user and the third user as the current relationship; using the notification device to notify the users of the presence of a visitor to the facility in order of the users with the highest priority; The control method according to claim 1 .

5. the visitor is a delivery person delivering an item to the facility; In the notification of the visitor's visit, the notification device is used to notify the visit of the delivery person and image information related to the item. The control method according to claim 4.

6. A circuit, A memory, The circuit, in operation, Detecting a visitor to the facility and a visitor to a first user located inside the facility based on detection information of a first sensor; Obtaining a current relationship between the first user and a second user located within the facility; When the visitor is detected at the facility, (i) based on a current relationship between the first user and the second user, determine whether or not to notify the second user of the visitor's visit to the first user, and (ii) when it is determined that the second user should be notified of the visitor's visit, notify the second user of the visitor's visit to the first user; If the current relationship between the first user and the second user indicates that the first user is planning an event for the second user, the circuitry determines not to notify the second user of the visitor's visit to the first user. Control device.

Images