Mailing notification system, mailing notification method, and program

Abstract

To make it easier to notify recipients of mail being delivered to communal mailboxes. [Solution] The mailing notification system 100 comprises a video acquisition unit 11, a sensor information acquisition unit 10, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. The video acquisition unit 11 acquires video information acquired by an imaging device 2 installed in a position capable of photographing the exterior of a collection mailbox including multiple mailboxes. The sensor information acquisition unit 10 acquires sensor information regarding the detection results of multiple open / close detection sensors G1 that detect the opening and closing of the doors of multiple mailing slots, respectively. The mailing detection unit 12 detects mailings for multiple mailboxes on a per-mailing-slot basis based on the sensor information. The notification unit 16 notifies mailing information including the determination result of the destination determination unit 13 and specific information based on the video information. The mailing detection unit 12 identifies the detection timing of door opening and closing based on the sensor information. The specific information is information extracted from the video information based on the detection timing.

Description

[[Technical Field]]

[0001] The present disclosure generally relates to a posting notification system, a posting notification method, and a program. More specifically, the present disclosure relates to a posting notification system, a posting notification method, and a program for notifying that an item has been posted into a post box. [[Background Art]]

[0002] Patent Document 1 discloses a post box and a posting notification system that allow items posted and delivered to a post box to be checked via images in near real-time at a remote location, and collectively manage notification destinations from a remote location. According to Patent Document 1, when mail (a delivery item) is posted into a post box, a posting opening sensor detects the posting, and the item is photographed by lighting and a camera (which may be a camera with a flash function) installed inside the post box. The captured image data is transmitted to a posting notification system on a cloud, and a posting notification is sent to communication devices such as PCs and smartphones by e-mail or push notification. [[Prior Art Documents]] [[Patent Documents]]

[0003] [[Patent Document 1]] Japanese Unexamined Patent Application Publication No. 2017-80362 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] By the way, even for collective post boxes installed in facilities such as multi-dwelling buildings, there is a demand for posting notifications of posted items such as mail. However, when the technology disclosed in Patent Document 1 is applied to a collective post box, it is necessary to install lighting and a camera inside each of the plurality of post boxes of the collective post box. Therefore, implementation is not easy when considering the cost of lighting and cameras prepared for the number of post boxes, and the labor required to install lighting and cameras in each post box.

[0005] This disclosure is made in view of the above circumstances and aims to provide a mailing notification system, mailing notification method, and program that facilitate the notification of mailing to collective mailboxes. [Means for solving the problem]

[0006] A mailing notification system according to one aspect of the present disclosure comprises a video acquisition unit, a sensor information acquisition unit, a mailing detection unit, a destination determination unit, and a notification unit. The video acquisition unit acquires video information acquired by an imaging device installed at a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes. The sensor information acquisition unit acquires sensor information relating to the detection results of a plurality of open / close detection sensors that detect the opening and closing of the doors of a plurality of mailing slots in the plurality of mailboxes, respectively. The mailing detection unit detects mailings for the plurality of mailboxes on a per-mailing basis based on the sensor information. The destination determination unit determines the destination of the mailing based on the detection result of the mailing detection unit. The notification unit notifies mailing information including the determination result of the destination determination unit and specific information based on the video information. If the mailing detection unit determines, based on the sensor information, that any of the open / close detection sensors among the plurality of open / close detection sensors has detected the opening and closing of the door, it identifies the detection timing of the door opening and closing. The specific information is information extracted from the video information based on the detection timing.

[0007] A mailing notification system according to one aspect of the present disclosure comprises a video acquisition unit, a sensor information acquisition unit, a mailing detection unit, a destination determination unit, and a notification unit. The video acquisition unit acquires video information acquired by an imaging device installed at a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes. The sensor information acquisition unit acquires sensor information relating to the detection results of multiple detection sensors. The multiple detection sensors are arranged within the multiple mailboxes and each detects the weight or movement of an object within the multiple mailboxes. The mailing detection unit detects mailings for the multiple mailboxes on a per-mailbox basis based on the sensor information. The destination determination unit determines the destination of the mailing based on the detection result of the mailing detection unit. The notification unit notifies mailing information including the determination result of the destination determination unit and specific information based on the video information. When the mailing detection unit determines, based on the sensor information, that any of the multiple detection sensors has detected the weight or movement of an object, it identifies the detection timing of the object. The specific information is information extracted from the video information based on the detection timing.

[0008] A mailing notification method according to one aspect of the present disclosure is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device installed at a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes. In the sensor information acquisition step, sensor information is acquired regarding the detection results of a plurality of open / close detection sensors that detect the opening and closing of the doors of a plurality of mailing slots of the plurality of mailboxes, respectively. In the mailing detection step, based on the sensor information, mailing is detected for each of the plurality of mailboxes. In the destination determination step, the destination of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step and specific information based on the video information is notified. In the mailing detection step, if it is determined that any of the open / close detection sensors among the plurality of open / close detection sensors has detected the opening and closing of the door, the timing of the door opening and closing detection is specified. The aforementioned specific information is information extracted from the video information based on the detection timing.

[0009] A method for notifying a mailing according to one aspect of the present disclosure is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device installed at a position capable of photographing the appearance of a collection of mailboxes including multiple mailboxes. In the sensor information acquisition step, sensor information relating to the detection results of multiple detection sensors is acquired. The multiple detection sensors are arranged inside the multiple mailboxes and each detects the weight or movement of an object inside the multiple mailboxes. In the mailing detection step, based on the sensor information, mailing detection is performed for each of the multiple mailboxes. In the destination determination step, the destination of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step and specific information based on the video information is notified. In the mailing detection step, if it is determined that any of the multiple detection sensors has detected the weight or movement of an object based on the sensor information, the timing of the object detection is specified. The aforementioned specific information is information extracted from the video information based on the detection timing.

[0010] A program relating to one aspect of this disclosure is a program that causes one or more of the above-described mailing notification methods to execute the above-described mailing notification method. [Effects of the Invention]

[0011] According to this disclosure, there is an advantage in that it can be made easier to notify recipients of mail being delivered to communal mailboxes. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a block diagram of a mailing notification system and its surrounding components according to one embodiment. [Figure 2] Figure 2 is a schematic external view of a communal mailbox and its surroundings to which the above-mentioned mailing notification system is applied. [Figure 3]Figure 3 is a schematic front view of one post in the same collection of post boxes. [Figure 4] Figure 4 is a conceptual diagram of a mailed image in the mailing notification system described above, showing a mailed item being mailed by the mailer after being detected by the mailing detection unit. [Figure 5] Figure 5 is a conceptual diagram illustrating the target image extracted from the same mailed image. [Figure 6] Figure 6 is a sequence diagram illustrating the operation of the mailing notification system described above. [Figure 7] Figure 7 is a block diagram of a modified example 1 of the above-mentioned mailing notification system and its surrounding configuration. [Figure 8] Figure 8 is a schematic external view of a communal post and its surroundings to which the above-mentioned modified example 1 is applied. [Figure 9] Figure 9 is an image based on auxiliary video information from the auxiliary imaging device in the modified example 1 described above, and is a conceptual diagram of the mailer's image in the process of mailing detected by the mailing detection unit. [Figure 10] Figure 10 is a block diagram of a modified example 2 of the above-mentioned mailing notification system and its surrounding configuration. [Figure 11] Figure 11 is a schematic external view of a communal mailbox and its surroundings to which the modified example 3 of the above-mentioned mailing notification system is applied. [Figure 12] Figure 12 is a block diagram of the modified example 3 and its surrounding configuration. [Figure 13] Figure 13 is a schematic external view of a communal mailbox and its surroundings to which the modified example 4 of the above-mentioned mailing notification system is applied. [Figure 14] Figure 14 is a conceptual diagram of a submitted image based on the first video information from the first imaging device in the modified example 4 described above. [Figure 15] Figure 15 is a conceptual diagram of the submitted image based on the second video information from the second imaging device in the modified example 4 described above. [Figure 16] Figure 16 is a block diagram of the modified example 4 described above and its surrounding configuration. [Figure 17] FIG. 17 is a block configuration diagram of Modification 5 related to the aforementioned posting notification system and the peripheral configuration thereof. [Figure 18] FIG. 18 is a conceptual diagram for explaining a difference between two posting images captured at different timings in Modification 6 related to the aforementioned posting notification system. [Figure 19] FIG. 19 is a block configuration diagram of Modification 8 related to the aforementioned posting notification system and the peripheral configuration thereof. MODE FOR CARRYING OUT THE INVENTION

[0013] (Overview) Hereinafter, a posting notification system, a posting notification method, and a program according to embodiments and modifications will be described with reference to the drawings. The following embodiments and modifications are merely one of the various embodiments of the present disclosure. In addition, various changes can be made to the following embodiments and modifications according to design and the like as long as the object of the present disclosure can be achieved. Further, the configuration of each of the following modifications can be appropriately combined with the following embodiment or other modifications. In addition, the drawings described in the present disclosure are schematic diagrams, and the ratios of sizes and thicknesses of respective constituent elements in the drawings do not necessarily reflect actual dimensional ratios.

[0014] A posting notification system 100 according to one aspect (see FIG. 1) is applied to a group mailbox P1 (see FIG. 2) installed in a facility 200, and notifies posting (posting information) of a posted item A1 such as a postcard (see FIG. 2) to each of a plurality of mailboxes P10 (reception mailboxes) of the group mailbox P1. The posted items A1 posted into the mailboxes P10 can be, besides postcards, sealed letters, direct mails, flyers, absence notices for delivered parcels, and the like.

[0015] It is assumed that the facility 200 is, for example, an apartment complex including a plurality of dwelling units. However, the facility 200 is not limited to an apartment complex as long as it is a facility where the group mailbox P1 is installed, and may be a non-residential facility such as a factory, a store, an office building, a commercial building, a hospital, a nursing care facility, a school, a train station, or an airport.

[0016] The recipient of the mailing information notification is assumed to be, for example, the resident (user U1) to whom the mail is delivered. In other words, if multiple mailboxes P10 are assigned to multiple dwelling units, and mail A1 is delivered to a mailbox P10, the recipient of the mailing information notification is the resident (user U1) of the dwelling unit to which that mailbox P10 is assigned. If facility 200 is, for example, an office building, the recipient of the mailing information notification could be a person (user U1) working at the office to which the mail is delivered.

[0017] As described later, the mailing information may be transmitted, for example, to a master unit 33 in the dwelling unit (see Figure 1: room master unit) and notified to user U1. Alternatively, as described later, the mailing information may be transmitted, for example, to an information terminal 6 such as a smartphone owned by user U1 (see Figure 17) and notified to user U1, or to a lobby intercom 31 (see Figure 19) and notified to user U1. However, the recipient of the mailing information notification is not limited to the mailing address. The recipient of the mailing information notification may be the administrator of the facility 200 (in the case of an apartment building, the building manager). The mailing information may also be transmitted to a master unit 33 installed in the manager's office. Furthermore, the mailing information may be transmitted to an external server operated by the management company of the facility 200.

[0018] Here, the mailing notification system 100, as shown in Figure 1, comprises a video acquisition unit 11, a sensor information acquisition unit 10, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. The video acquisition unit 11 acquires video information acquired by an imaging device 2 (see Figures 1 and 2) installed in a position capable of photographing the exterior of a collection post P1 including multiple posts P10. The sensor information acquisition unit 10 acquires sensor information regarding the detection results of multiple open / close detection sensors G1 (see Figure 1) that detect the opening and closing of the doors Q10 (see Figure 3) of multiple mailing slots Q1 of the multiple posts P10. Based on the sensor information, the mailing detection unit 12 detects mailings for each of the multiple posts P10. Based on the detection results of the mailing detection unit 12, the destination of the mailing is determined. The notification unit 16 notifies the mailing information, which includes the determination result of the destination determination unit 13 and specific information based on the video information. Based on sensor information, the mail delivery detection unit 12 determines that any of the multiple open / close detection sensors G1 have detected the opening or closing of door Q10, and then identifies the detection timing of the door Q10's opening or closing. The identified information is extracted from the video information based on the detection timing.

[0019] According to the configuration of the mailing notification system 100 in the above-described embodiment, the information from which specific information is extracted based on the detection timing of the opening and closing of the door Q10 of the mailing slot Q1 is video information of the exterior of the collective mailbox P1 acquired by the imaging device 2. Therefore, there is no need to install lighting (device) and cameras (imaging device) at each of the multiple mailboxes P10, and costs related to lighting and cameras, as well as the effort involved in installing lighting and cameras at each mailbox P10, are reduced. As a result, it becomes easier to notify the collective mailbox P1 of mailings.

[0020] In the following explanation, "image (information)" may refer to video information, still image information, or individual frames of a stop-motion sequence. Furthermore, while the various "images" in the following explanation are primarily assumed to be still images, they are not limited to still images and may also refer to video or individual frames of a stop-motion sequence.

[0021] Furthermore, one embodiment of the mailing notification method is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device 2 installed in a position capable of photographing the exterior of a collection post P1 including multiple posts P10. In the sensor information acquisition step, sensor information is acquired regarding the detection results of multiple open / close detection sensors G1 that detect the opening and closing of the doors Q10 of multiple mailing slots Q1 of the multiple posts P10, respectively. In the mailing detection step, mailing is detected for each of the multiple posts P10 based on the sensor information. In the destination determination step, the destination of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step and specific information based on the video information is notified. In the mail delivery detection step, based on sensor information, if it is determined that any of the multiple open / close detection sensors G1 have detected the opening or closing of door Q10, the detection timing of the door Q10's opening or closing is identified. The identified information is extracted from the video information based on the detection timing. The configuration of the mail delivery notification method according to the above embodiment also makes it easier to notify the collective mailbox P1 of mail delivery.

[0022] The above mailing notification method is used on a computer system (mailing notification system 100). In other words, the above mailing notification method can also be implemented as a computer program. A program according to one embodiment is a program that causes one or more processors to execute the above mailing notification method. The program may be recorded on a computer-readable non-temporary recording medium. A computer program product according to one embodiment includes a computer program that, when executed by one or more processors, realizes the steps of the above mailing notification method.

[0023] In the following, it is assumed that the mail delivery notification system 100 is provided by the control device 1 (see Figure 1). In other words, as an example, it is assumed that all the functions of the mail delivery notification system 100 are implemented within the control device 1. The control device 1 may be installed, for example, in the lobby (common entrance) of the facility 200 or in its vicinity.

[0024] (1) Overall structure The following describes in detail the entire system, including the mailing notification system 100 and its peripheral configuration according to this embodiment, with reference to Figure 1. As mentioned above, as an example, the mailing notification system 100 (control device 1) is applied to a communal mailbox P1 installed in a facility 200 which is an apartment building, and notifies the resident (user U1), who is the recipient of the mail, of the mailing to the communal mailbox P1.

[0025] The communal mailbox P1 may be installed in or near the lobby (common entrance) of facility 200. The communal mailbox P1 includes multiple rectangular box-shaped posts P10 (in the example in Figure 2, there are six posts P10 arranged in 2 columns x 3 rows). The dimensions of the communal mailbox P1 are not particularly limited, nor is the number of posts P10.

[0026] In the following, when the six post boxes P10 are described in a way that distinguishes them from one another, they will be referred to as post boxes P11, P12, P13, P14, P15, and P16. When they are not distinguished from one another, they will simply be referred to as post box P10. Also, in the following, as shown in Figure 2, the example of when mail item A1 (postcards or other mail, or flyers, etc.) is deposited into post box P16, the bottom post box in the right column, will be used for explanation.

[0027] As shown in Figure 3, each postbox P10 has a mail slot Q1 on its front for mail carriers or flyer distributors B1 (see Figure 2) to insert mail A1. The mail slot Q1 is a long slit in the left-right direction. The mail slot Q1 is also provided with a door Q10 (flap) that can open and close the mail slot Q1. The body of the postbox P10 is pivotally supported so that the door Q10 rotates around the upper flap axis of the door Q10. The door Q10 is pushed forward by a coil spring or the like on its back side, and is in the closed position with the mail slot Q1 closed unless the front of the door Q10 is being pushed by mail A1 or a fingertip. By pushing the front of door Q10 inward with the mail item A1 or your fingertip, resisting the stress from the coil spring, door Q10 rotates so that its lower side retracts inward, displacing it to the open position with the mail slot Q1 open, allowing mail item A1 to be inserted. By releasing the pressure on the front of door Q10 from the mail item A1 or your fingertip, door Q10 returns to its original closed position with the mail slot Q1 closed due to the elastic recovery of the coil spring.

[0028] Here, each post P10 has an open / close detection sensor G1 (see Figure 1) inside the main body that detects the opening and closing of the door Q10. In other words, multiple open / close detection sensors G1 are provided to detect the opening and closing of the doors Q10 of multiple mail slots Q1 of multiple posts P10 in the collective post P1. Each open / close detection sensor G1 outputs a sensor signal (electrical signal) that includes sensor information indicating the occurrence (detection) of the opening and closing of the corresponding door Q10.

[0029] The type of open / close detection sensor G1 is not particularly limited, and known sensors may be used. For example, each open / close detection sensor G1 may be a sensor that detects the opening and closing of the door Q10 using magnetic force detection. Specifically, each open / close detection sensor G1 may include a magnet part and a magnetic force detection part. The magnet part is installed, for example, on the back side of the door Q10. The magnetic force detection part is installed near the magnet part on a wall surface inside the main body of the post P10, etc., so as to face the magnet part when the door Q10 is in the closed position, and detects the magnetic force of the magnet part.

[0030] When the front of door Q10 is pushed by the mail A1 or a fingertip, causing door Q10 to move from the closed position to the open position, the magnet on the back of door Q10 moves away from the magnetic field detection unit, and the magnetic force of the magnet detected by the magnetic field detection unit weakens. Subsequently, when the pressure on the front of door Q10 by the mail A1 or a fingertip is released and door Q10 returns from the open position to its original closed position, the magnet on the back of door Q10 approaches the magnetic field detection unit again, and the magnetic force of the magnet detected by the magnetic field detection unit strengthens again. The opening and closing of door Q10 can be detected in response to this series of changes in magnetic force.

[0031] Multiple open / close detection sensors G1 (e.g., magnetic detection units) are connected to a consolidation device H1 via wired or wireless communication. The consolidation device H1 is installed, for example, on the top surface of a collection post P1. The control device 1 is connected to the consolidation device H1 via wired or wireless communication. The consolidation device H1 receives (collects) sensor signals from the multiple open / close detection sensors G1 and transmits them to the control device 1. The consolidation device H1 may be omitted, and the multiple open / close detection sensors G1 may transmit sensor signals directly to the control device 1. As will be described in detail later, the mailing notification system 100 (control device 1) performs various processes to detect mailing, determine the mailing destination, and notify mailing information based on sensor information regarding the detection results of the open / close detection sensors G1.

[0032] Furthermore, as shown in Figure 3, each post box P10 has a plate S1 on its front that is printed with the corresponding dwelling unit number (room number). For example, if mail is deposited into post box P10 with plate S1 for dwelling unit number "101", the recipient of the mail is the resident (user U1) living in dwelling unit 101.

[0033] Furthermore, each post box P10 has a retrieval opening below the mail slot Q1 on its front for the user U1 to retrieve the mail A1. In front of the retrieval opening is a front-opening retrieval door T1 that can be opened and closed. The retrieval door T1 is equipped with, for example, a dial lock. By turning the dial knob J1 on the front of the retrieval door T1 left and right to match a specific number, the dial lock is unlocked and the retrieval door T1 can be opened and closed. The user U1 unlocks the dial lock, grasps the knob J1 to open the retrieval door T1 towards them, and retrieves the mail A1 that has been placed inside their post box P10 from the retrieval opening.

[0034] As shown in Figure 3, each post P10 is, as an example, a so-called "front-loading, front-retrieval" type post. However, this is not the only option, and each post P10 may also be a so-called "front-loading, rear-retrieval" type post. Also, as an example, each post P10 shown in Figure 3 has a separate mail slot Q1 and retrieval opening, but a mail slot Q1 that also serves as the retrieval opening may be provided.

[0035] The control device 1 is connected to the imaging device 2, for example, via a wired connection. Communication between the control device 1 and the imaging device 2 is not limited to a wired connection and may be wireless. In this embodiment, it is assumed that there is one imaging device 2, but as will be described later, there may be multiple imaging devices 2. The imaging device 2 is installed on the ceiling surface C1 of the facility 200, as shown in Figure 2. The imaging device 2 may also be installed on the collective post P1 (for example, on the top surface of the collective post P1). The imaging device 2 is installed in a position that can photograph the exterior of the collective post P1, which includes multiple posts P10. Here, the imaging device 2 is installed so that the mail slots Q1 of all posts P10 of the collective post P1 are included in the image. As long as the mail slots Q1 of all posts P10 are included in the image, the installation position, imaging range, and field of view of the imaging device 2 are not particularly limited. In the examples shown in Figures 2 and 4, the imaging device 2 is installed approximately directly above the collection post P1 so that, for example, the front surfaces of all the posts P10 (the sides with the mail slot Q1) are included in the image. In this embodiment, the imaging device 2 is assumed to be either a color camera or a monochrome camera.

[0036] The imaging device 2, for example, continuously images the collective post box P1 and transmits the image (image information) to the control device 1. As will be described in detail later, the mailing notification system 100 (control device 1) notifies the mailing information, which includes specific information based on the image information received from the imaging device 2.

[0037] Furthermore, as shown in Figure 1, the control device 1 is connected to the intercom system 3 installed in the facility 200, for example, via a wired connection. Communication between the control device 1 and the intercom system 3 is not limited to wired connections; it may also be wireless.

[0038] The intercom system 3 comprises a lobby intercom 31 located in the lobby of the facility 200, and multiple master units 33 (room master units) installed in various locations such as individual dwelling units and the caretaker's office. For convenience, only one master unit 33 is shown in Figure 1. The intercom system 3 also includes a control device 32 connected to the lobby intercom 31 via a first main line. The control device 32 is connected to the multiple master units 33 via a second main line and multiple branch lines branching from the second main line. The control device 32 controls communication between the lobby intercom 31 and each master unit 33.

[0039] In the example shown in Figure 1, the control device 1 is connected to the lobby intercom 31. In this embodiment, it is assumed that the mail delivery information from the mail delivery notification system 100 is transmitted to the lobby intercom 31 and, via the control device 32, is notified to the user U1 from the master unit 33 in the corresponding dwelling unit. The mail delivery information is notified by a screen display from the display unit (e.g., liquid crystal display) of the master unit 33. Alternatively, the mail delivery information may be notified by sound output from the speaker of the master unit 33 (e.g., output of electronic sound or synthesized voice message) instead of (or in addition to) a screen display.

[0040] In this embodiment, the multiple open / close detection sensors G1, the aggregation device H1, the imaging device 2, and the intercom system 3 are not included as components of the mail delivery notification system 100, but they may be included as components of the mail delivery notification system 100. In other words, the mail delivery notification system 100 may include at least some of the multiple open / close detection sensors G1 and the aggregation device H1. The mail delivery notification system 100 may also include the imaging device 2. The mail delivery notification system 100 may also include at least some of the intercom system 3.

[0041] (2) Configuration of the control device As shown in Figure 1, the control device 1 (mailing notification system 100) includes a sensor information acquisition unit 10, an image acquisition unit 11, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. Furthermore, as shown in Figure 1, the control device 1 (mailing notification system 100) also includes a mailing object determination unit 14, an image cropping processing unit 15, a detection area storage unit 17, a cropping setting storage unit 18, and a sensor destination corresponding storage unit 19.

[0042] The control device 1 (mailing notification system 100) includes a computer system having one or more processors and memory. At least some functions of the control device 1 (sensor information acquisition unit 10, image acquisition unit 11, mailing detection unit 12, destination determination unit 13, mailing item determination unit 14, image cropping processing unit 15, notification unit 16, etc.) are realized by the computer system's processor executing a program recorded in the computer system's memory. The program may be recorded in memory, provided via a telecommunications line such as the Internet, or provided on a non-temporary recording medium such as a memory card.

[0043] Each of the detection area storage unit 17, the extraction setting storage unit 18, and the sensor destination correspondence storage unit 19 includes an electrically rewritable non-volatile semiconductor memory such as flash memory. The detection area storage unit 17, the extraction setting storage unit 18, and the sensor destination correspondence storage unit 19 may be implemented by the same single semiconductor memory. The detection area storage unit 17 stores detection area setting information in advance. The extraction setting storage unit 18 stores extraction setting information for the area to be extracted from the image in advance. The sensor destination correspondence storage unit 19 stores sensor destination correspondence information in advance, which associates identification information (sensor ID information) unique to each open / close detection sensor G1 with the destination of the post P10 where the open / close detection sensor G1 is installed (for example, the dwelling number, name, email address, etc. of user U1). In other words, the sensor destination correspondence storage unit 19 stores sensor destination correspondence information in advance to identify which destination (user U1)'s post P10 corresponds to (for example, which dwelling unit number) of any open / close detection sensor G1 that has detected the opening or closing of door Q10.

[0044] The video acquisition unit 11 executes video acquisition processing and acquires video information acquired by the imaging device 2. The video acquisition unit 11 acquires (receives) video information from the imaging device 2 via the communication interface of the control device 1. The video acquisition unit 11 outputs the video information to the mailing detection unit 12. The mailing detection unit 12 has a storage unit for storing (reserving) video information, and stores the video information acquired by the video acquisition unit 11 in the storage unit as history information.

[0045] The sensor information acquisition unit 10 executes sensor information acquisition processing and acquires sensor information regarding the detection results of multiple open / close detection sensors G1. Here, as an example, the sensor information acquisition unit 10 acquires (receives) sensor information regarding the detection results of the opening and closing of the door Q10 included in the sensor signals from multiple open / close detection sensors G1 via the aggregation device H1. The sensor information also includes sensor ID information of the open / close detection sensor G1 to identify the source of the detection result transmission.

[0046] The mail detection unit 12 executes mail detection processing and, based on the sensor information acquired by the sensor information acquisition unit 10, detects mail being deposited into each of the multiple post boxes P10 on a per-post-box basis. In other words, regardless of which of the multiple post boxes P10 (any post box) the mail is deposited into, the mail detection unit 12 can determine whether or not mail has been deposited into that post box P10 based on the detection result of the opening and closing of the door Q10 by the opening and closing detection sensor G1, and thus detect the mail being deposited.

[0047] Furthermore, based on the sensor information, the mail delivery detection unit 12 determines that any of the multiple open / close detection sensors G1 have detected the opening or closing of door Q10, and identifies the detection timing (detection time) of the door Q10 detected by that sensor G1. Based on this detection timing, the mail delivery detection unit 12 extracts specific video information (specific information) from the video information acquired from the video acquisition unit 11. In other words, the specific information is, for example, specific video information captured at the same time as the detection timing. Alternatively, the specific information may be specific video information captured at a time prior to the detection timing. As described later, this specific information is included in the mail delivery information and notified to the recipient, user U1.

[0048] The mail drop detection unit 12 may use not only sensor information, but also video information (of the exterior of the collective mailbox P1) acquired by the video acquisition unit 11 in addition to the sensor information to comprehensively determine whether or not mail has been dropped. In other words, video information is used in addition to sensor information to improve the accuracy of determining whether or not mail has been dropped. However, it is not mandatory for the mail drop detection unit 12 to use both sensor information and video information to determine whether or not mail has been dropped; it may also determine whether or not mail has been dropped using only sensor information.

[0049] If the mail detection unit 12 determines (provisionally) that a mail has been mailed by performing a mail detection process based on the sensor information described above (hereinafter also referred to as the first mail detection process), it identifies the detection timing (detection time). Subsequently, the mail detection unit 12 performs a mail detection process based on specific video information (specific information) extracted based on the detection timing (hereinafter also referred to as the second mail detection process).

[0050] The second mailing detection process will be explained in detail below with reference to Figure 4. Figure 4 shows an example of a mailing image IM1 that may be included in the extracted specific video information. The mailing image IM1 is an image showing the moment when mailing item A1 is being performed by mailer B1. The mailing image IM1 is, for example, an image taken at the same time (or slightly earlier) as the detection timing of the opening and closing of door Q10, and is specific information extracted from the video information acquired from the video acquisition unit 11. In other words, the mailing image IM1 is an image extracted based on the detection timing.

[0051] In addition, in images such as the mailing image IM1 in Figure 4, the image regions corresponding to real-world elements have the code "X" appended to the end of the code assigned to the real-world element. For example, for the hand B2 of the mailing person B1 and the mailed item A1 shown in Figure 2, the image regions corresponding to the hand B2 and mailed item A1 in the mailing image IM1 in Figure 4 are assigned the codes B2X and A1X, respectively. Similarly, for the collective post box P1, post box P10, and mail slot Q1 shown in Figure 2, the image regions corresponding to the collective post box P1, post box P10, and mail slot Q1 in the mailing image IM1 in Figure 4 are assigned the codes P1X, P10X, and Q1X, respectively.

[0052] The mailing image IM1 is an image taken from approximately directly above the collective post P1, with a field of view that includes the front of all six posts P10 of the collective post P1, and includes the image area P10X of the six posts P10. In other words, the mailing image IM1 includes the image area Q1X of the six mailing slots Q1 of the six posts P10.

[0053] In this embodiment, multiple detection areas D0 (here, as an example, six detection areas D0 corresponding to the number of posts P10) are pre-set on the video information. In Figure 4, for clarity, the six detection areas D0 are illustrated with dashed lines on the postage image IM1, but the actual postage image IM1 does not contain dashed lines.

[0054] In the following description of the six detection areas D0, the three detection areas D0 in the left column will be referred to as detection areas D1 to D3 from top to bottom, and the three detection areas D0 in the right column will be referred to as detection areas D4 to D6 from top to bottom. The six detection areas D1 to D6 are set to correspond one-to-one with posts P11 to P16. It is preferable that each of the multiple detection areas D0 is set in the image area Q1X of the mail slot Q1 of the corresponding post P10 in the video, or in the area surrounding the image area Q1X. In the example in Figure 4, each of the multiple detection areas D0 is set as a long rectangular area of ​​the same shape and dimensions as the image area Q1X of the mail slot Q1, near the bottom of the image area Q1X of the corresponding mail slot Q1 in the video. Note that in Figure 4, for convenience, the illustration of the image areas corresponding to the door Q10 and the retrieval door T1 is omitted.

[0055] The settings for the multiple detection areas D0 may change as appropriate depending on the collective mailbox P1 actually installed in facility 200. In other words, the location, shape, dimensions, and number of the multiple detection areas D0 may change as appropriate depending on, for example, the location, shape, dimensions of the mail slot Q1 and the number of mailboxes P10. Therefore, when introducing the mailing notification system 100 to facility 200, the system configurator will configure the location, shape, dimensions, and number of the multiple detection areas D0 while checking the video information acquired by the video acquisition unit 11 on a configuration screen or the like. The system configurator will also configure which recipient's (user U1) mailbox P10 each of the multiple detection areas D0 corresponds to (for example, which dwelling unit number each corresponds to). In other words, the system configurator will configure information such as, for example, that the six detection areas D1 to D6 correspond to dwelling unit numbers "101" to "106".

[0056] The detection area setting information for multiple detection areas D0, configured by the system administrator, is stored in the detection area storage unit 17.

[0057] In other words, the video information includes video of multiple mail slots Q1 of multiple post boxes P10. Multiple detection areas D0 are pre-configured on the video information for each of the multiple mail slots Q1. The mailing notification system 100 then detects mailings in the mailing detection unit 12 based on changes in the multiple detection areas D0 on the video information, in addition to sensor information.

[0058] In other words, in the second mailing detection process, if there is a change (in the video) within any of the multiple detection areas D0, it is determined that mailing has occurred at the post P10 corresponding to that detection area D0, i.e., mailing has been detected. The right side of Figure 4 shows an enlarged view of the detection area D0 when mailing has not yet been delivered (typically detection area D4) and the detection area D6 when mailing has been delivered. In the example of mailing image IM1, since mailing item A1 is in the process of being delivered to post P16, a part of the image area A1X of mailing item A1 is present within the detection area D6 corresponding to post P16. In other words, as can be seen by comparing it with the detection area D0 when mailing has not yet been delivered (detection area D4), a change (in the video) has occurred in the detection area D6 when mailing has been delivered.

[0059] In the second mailing detection process, the mailing detection unit 12 checks the video information captured at the detection timing and the video information captured slightly prior to the detection timing to see if there is a change in any of the preset detection areas D0. If there is a change in any of the detection areas D0, and the mailing detection unit 12 has (provisionally) determined that mailing has occurred in the first mailing detection process, it then determines (confirms) that mailing has occurred at the post P10 corresponding to that detection area D0.

[0060] When performing the second mail delivery detection process, it is preferable that the mail delivery detection unit 12 first refers to the sensor destination correspondence storage unit 19 (sensor destination correspondence information) to identify the post P10 (e.g., dwelling unit number) corresponding to the open / close detection sensor G1 that detected the opening / closing. In the second mail delivery detection process, it is preferable that the mail delivery detection unit 12 refers to the detection area storage unit 17 (detection area setting information) to identify the detection area D0 of the post P10 corresponding to the open / close detection sensor G1 that detected the opening / closing, and checks whether there is a change within the detection area D0. If there is a change within the detection area D0, it is preferable that the mail delivery detection unit 12 determines (confirms) that a mail delivery has occurred at the post P10. If there is no change within the detection area D0 of the corresponding post P10, the mail delivery notification system 100 may notify the facility manager or the like of an error, as this indicates a false detection by the open / close detection sensor G1.

[0061] Incidentally, due to factors such as the structure of the post P10, where the mail slot Q1 and the retrieval opening are the same, and the type or placement of the open / close detection sensor G1, there is a possibility that the open / close detection sensor G1 may also detect the opening or closing of the door Q10 when user U1 is retrieving mail A1.

[0062] Therefore, it is preferable that the mail detection unit 12 has a function (mail insertion / removal determination function) that determines whether the detection of the opening and closing of the door Q10 occurred when mail A1 was inserted or when mail A1 was removed, based on the change in the detection area D0 corresponding to the mail slot Q1 where the opening and closing of the door Q10 was detected among the multiple detection areas D0. In other words, the mail detection unit 12 performs image analysis to determine whether the change (time change) of the corresponding detection area D0 is a first image change in which mail A1 moves into the post P10 or a second image change in which mail A1 moves out of the post P10. If the change in the detection area D0 is a first image change, the mail detection unit 12 determines that the detection of the opening and closing of the door Q10 occurred when mail A1 was inserted, and if it is a second image change, it determines that the detection of the opening and closing of the door Q10 occurred when mail A1 was removed.

[0063] Furthermore, if the mail detection unit 12 determines that the opening and closing of the door Q10 occurred when the mailed item A1 was removed, the notification unit 16 will not send a notification of the mailed item.

[0064] By providing this mail insertion / removal detection function, it is possible to reduce the possibility of a false detection of mail insertion, where the opening / closing detection sensor G1 detects the opening and closing of door Q10, even though user U1 actually removed mail A1. Furthermore, if it is determined that the opening and closing of door Q10 occurred when mail A1 was removed, the mail insertion information notification will not be executed, thus reducing the possibility of unnecessary mail insertion information being notified to user U1.

[0065] The mailing detection unit 12 outputs a message to the destination determination unit 13 indicating that mailing has been detected (that mailing has occurred). If the mailing detection unit 12 performs only the first mailing detection process and does not perform the second mailing detection process, it determines that mailing has occurred (mailing detection) when the open / close detection sensor G1 detects that the door Q10 has been opened or closed, and outputs the mailing detection result to the destination determination unit 13. Alternatively, if the mailing detection unit 12 performs both the first mailing detection process and the second mailing detection process, it determines that mailing has occurred when the open / close detection sensor G1 detects that the door Q10 has been opened or closed, and also determines that there is a change within the detection area D0, and outputs the mailing detection result to the destination determination unit 13.

[0066] Furthermore, the mailing detection unit 12 outputs the sensor ID information of the open / close detection sensor G1 that detected the opening and closing of the door Q10, as well as information on the timing of the door Q10's opening and closing detection, to the destination determination unit 13. In addition, the mailing detection unit 12 outputs information of the mailing image IM1 (for example, a still image) (while the mailing is being performed by mailer B1) extracted from the video information based on the timing of the door Q10's opening and closing detection, as specific information to the destination determination unit 13.

[0067] The destination determination unit 13 determines the destination (user U1) of the mail based on the detection result of the mailing detection unit 12. For example, if only the first mailing detection process is performed and the second mailing detection process is not performed, when the destination determination unit 13 receives notification of mailing detection from the mailing detection unit 12, it refers to the sensor destination correspondence storage unit 19 (sensor destination correspondence information). The destination determination unit 13 then determines (identifies) the destination of post P10 (for example, the dwelling number of user U1's dwelling, name, email address, etc.) corresponding to the sensor ID information of the open / close detection sensor G1 that detected the opening and closing of door Q10. In other words, the mailing notification system 100 determines the destination (user U1) in the destination determination unit 13 based on the sensor ID information (sensor information) of the open / close detection sensor G1 that detected the opening and closing of door Q10.

[0068] Even when both the first and second mailing detection processes are performed, the destination (user U1) may be determined based on sensor information as described above. Alternatively, when both the first and second mailing detection processes are performed, the destination determination unit 13 may refer to the detection area storage unit 17 (detection area setting information) and determine (identify) the destination of the post P10 associated with the detection area D0 that has changed, based on the mailing image IM1. In other words, the mailing notification system 100 may determine the destination (user U1) in the destination determination unit 13 based on changes in multiple detection areas D0 in the video information.

[0069] The information determined by the recipient determination unit 13 is not limited to the dwelling unit number, but can be any information that can identify user U1, such as user U1's name, user ID information unique to user U1, or user U1's email address. User U1's name information, ID information, and email address information can be pre-registered with the mailing notification system 100, linked to user U1's dwelling unit number, via the control unit 33 (room control unit) in each user U1's dwelling unit, the control unit 33 in the manager's office, or the lobby intercom 31.

[0070] The destination determination unit 13 outputs information regarding the destination determination result (e.g., dwelling unit number) and information regarding the mailed image IM1 (specific information) to the notification unit 16. The destination determination unit 13 also outputs information regarding the mailed image IM1 to the mailed item determination unit 14.

[0071] The mail item determination unit 14 determines the type of mail item A1 based on the video of mail item A1 detected by the mail item detection unit 12 from the video information. The video of mail item A1 is extracted from the video information based on the detection timing when the opening and closing of the door Q10 is detected. In this embodiment, the mail item determination unit 14 determines the type of mail item A1 (by image) based on information such as the image region A1X of mail item A1 contained in the mail image IM1 received from the destination determination unit 13.

[0072] In this embodiment, as an example, the mail item determination unit 14 determines whether mail item A1 is a "flyer" or "not a flyer." If mail item A1 is a flyer, it is unlikely that user U1 will need to check it immediately, and it is highly likely that they will simply discard it after retrieving it from post P10. In short, it is assumed that the importance of flyers to user U1 is lower than that of postcard or other mail. Therefore, when notifying the mail item of delivery, the subsequent processing in the mail item notification system 100 branches depending on whether mail item A1 is a "flyer" or "not a flyer." For example, as described later, if mail item A1 is a "flyer," the mail item notification system 100 does not notify user U1 of the delivery. Furthermore, it is preferable that the mail item determination unit 14 determines whether mail item A1, which has been determined to be "not a flyer," is a postcard, letter, direct mail, or delivery notice.

[0073] To explain in more detail, for example, the mail item determination unit 14 determines that mail item A1 is a flyer if, in the video, mail item A1 does not contain at least part of the postal code, recipient's name, and address. Normally, when a postal worker puts mail (mail item A1) into the mailbox P10, it is highly likely that they will put it in with the side containing the postal code, recipient's name, and address facing upwards. Therefore, if mail item A1 is not a flyer, the image area A1X of mail item A1 contained in the mail item image IM1 may contain at least part of the postal code, recipient's name, and address. Conversely, if it is a flyer, it does not contain a postal code, recipient's name, or address at all, so it is highly likely that the image area A1X of mail item A1 contained in the mail item image IM1 will not contain at least part of the postal code, recipient's name, and address.

[0074] The mail item determination unit 14 performs image analysis on the mailed image IM1 to identify the image region A1X of the entire mailed item A1 within the mailed image IM1. Alternatively, the mail item determination unit 14 may identify the image region A1X of the entire mailed item A1 within the mailed image IM1 from the region where a change has occurred in the detection area D0 (detection area D6 in Figure 4).

[0075] The mail item determination unit 14 then analyzes the words contained within the entire image area A1X. If the analyzed words correspond to at least part of the postal code, recipient's name, and address, the mail item determination unit 14 outputs the result "not a flyer" to the notification unit 16 as the type of mail item A1. On the other hand, if the analyzed words are not even at least part of the postal code, recipient's name, and address, the mail item determination unit 14 outputs the result "flyer" to the notification unit 16 as the type of mail item A1. Alternatively, the mail notification system 100 may include a memory unit that pre-stores dictionary information containing specific words that are unlikely to be found in mail other than flyers (words such as "open," "sale," "campaign," "renovation," "buyback," and "bargain"). The mail item determination unit 14 may refer to the dictionary information and, if a word matching the analyzed word exists in the dictionary information, output the result "flyer" to the notification unit 16.

[0076] If the mailed item determination unit 14 determines that mailed item A1 is "not a flyer," it may determine whether it is a postcard, letter, direct mail, or delivery notice based on the shape and size of the entire image area A1X of mailed item A1 within the mailed image IM1.

[0077] The mail item determination unit 14 may perform image determination of the type of mail item A1 using, for example, a pre-trained model that has been machine-learned using training data. For example, the training data may be data that associates images of various expected mail items A1 with labels of their type (postcards, letters, flyers, direct mail, and delivery notices, etc.).

[0078] Furthermore, the mail item determination unit 14 may determine the type of mail item A1 based on the video information of the clothing of the mailer B1 who performed the mailing, as detected by the mailing detection unit 12. The video of mailer B1's clothing is extracted from the video information based on the detection timing when the opening and closing of the door Q10 is detected. For example, if the mail item determination unit 14 determines that the clothing of mailer B1 included in the mailing image IM1 is that of a postal worker based on its color or pattern, it outputs the result "not a flyer" to the notification unit 16. If the mail item determination unit 14 determines that the clothing of mailer B1 included in the mailing image IM1 is not that of a postal worker based on its color or pattern, it outputs the result "flyer" to the notification unit 16. Note that the clothing determination may also be performed using a pre-trained model that has been machine-learned using training data, for example.

[0079] Depending on the position, imaging range, or field of view of the imaging device 2, the image IM1 may only show up to the hand B2 of the mail sender B1, and the image of the mail sender B1's clothing may not be included in the image IM1. In such cases, the mail item determination unit 14 may use video information (auxiliary video information) from the auxiliary imaging device 2A (see Figures 7 and 8) described in Modification 1 below to determine the clothing.

[0080] Both word-based and clothing-based judgments may be applied. However, the judgment results may differ between word-based and clothing-based judgments. That is, one judgment may result in "flyer," while the other judgment may result in "not a flyer." If the judgment results differ, it is preferable for the mailed item judgment unit 14 to output the result "not a flyer" to the notification unit 16 for the user U1 to confirm. Alternatively, a priority judgment may be set in advance for word-based and clothing-based judgments, and if the judgment results differ, the mailed item judgment unit 14 may apply the result of the priority judgment.

[0081] Furthermore, if the mail detection unit 12 determines that, on a day other than the first three days of the New Year, any certain number of open / close detection sensors G1 have detected the opening or closing of the door Q10 within a certain period of time, the mail item determination unit 14 may also determine the type of mail item A1 to be a flyer. When the mail item determination unit 14 receives notification from the mail detection unit 12 that a mail item has been detected for the first time, it starts timing for a certain period of time (for example, a few seconds) and suspends the determination of the type of mail item A1. Then, if the mail detection unit 12 detects mail items to multiple post boxes P10 more than a predetermined number of times (for example, 6 times, the same as the total number of post boxes P10) including the first mail item within that certain period of time, the mail item determination unit 14 outputs the result "flyer" to the notification unit 16 for all of the mail items in the series. The mail item determination unit 14, if the mail item detection unit 12 detects mailings less than a predetermined number of times, including the first mailing, within a certain period of time, individually determines the type of mail item A1 for each mailing. As mentioned above, since the condition is to exclude the first three days of the New Year, the possibility of misidentifying consecutive mailings of New Year's cards as consecutive mailings of flyers can be reduced.

[0082] Once the mail item determination unit 14 has finished determining the type of mail item A1, it outputs information regarding the determination result to the image extraction processing unit 15 and the notification unit 16.

[0083] The image extraction processing unit 15 extracts a target image IM2 (see Figure 5) from the video information, specifically from the mailing image IM1, which shows the mailing being performed by mailer B1 as detected by the mailing detection unit 12, and limits the extraction to the area around the mailing post P10 in which mailing is currently being performed among multiple mailing posts P10. As described above, the mailing image IM1 is extracted from the video information based on the detection timing when the opening and closing of the door Q10 is detected.

[0084] As shown in Figure 4, the postage image IM1 includes the image area P10X of all six posts P10. The image cropping processing unit 15 crops (extracts) the target image IM2 from the postage image IM1, which includes only the area around the post P10 where the postage occurred (post P16 in the example of Figure 4), as shown in Figure 5. The postage image IM1 could be notified to the user U1 as is, but notifying the user U1 of the target image IM2 makes the actually posted item A1 more visible in the image, thus improving convenience.

[0085] For example, when introducing the mailing notification system 100, the system setter confirms the video information acquired by the video acquisition unit 11 on a setting screen, etc., and sets multiple limited ranges that correspond one-to-one with multiple detection areas D0, which were also used in the second mailing detection process. Each of the multiple limited ranges includes the image area P10X of multiple posts P10. For example, as shown by the dashed outline on the mailing image IM1 in Figure 5, the limited range corresponding to detection area D6 (see Figure 4) includes the image area P16X of post P16.

[0086] Multiple limited areas set by the system administrator are stored in the cropping setting storage unit 18 as cropping setting information. In the cropping setting information, for example, detection area D1 (see Figure 4) is associated with a limited area that includes the image area P10X of post P11, among the image areas P10X of the six post P10s.

[0087] In the example shown in Figure 5, the image cropping processing unit 15, based on the determination result from the mail item determination unit 14, refers to the cropping setting information and extracts a target image IM2 limited to a restricted range that includes the image area P16X of the post P16 where the mail item was detected. The image cropping processing unit 15 then adjusts the target image IM2 to an enlarged image. Note that if the determination result from the mail item determination unit 14 is "flyer," the image cropping processing unit 15 does not need to perform the process of extracting the target image IM2.

[0088] The image cropping processing unit 15 outputs information about the target image IM2, which has been adjusted to an enlarged image, to the notification unit 16.

[0089] The notification unit 16 generates mailing information including the determination result of the destination determination unit 13 (e.g., dwelling unit number) and specific information based on video information, and notifies user U1. The notification unit 16 also notifies the mailing information including the mailing image IM1 as specific information, which is the mailing image IM1 in which mailing detected by the mailing detection unit 12 is in the process of being performed by mailer B1. As described above, the mailing image IM1 is extracted from the video information based on the detection timing when the opening and closing of the door Q10 is detected. In other words, the notification unit 16 generates mailing information including the determination result of the destination determination unit 13 and the mailing image IM1 (specific information), and notifies user U1. The notification unit 16 may also notify the mailing information including the target image IM2 as specific information. That is, the notification unit 16 may notify the mailing information including the target image IM2 (specific information) in addition to, or instead of, the mailing image IM1.

[0090] Furthermore, the notification unit 16 notifies the mailing information, including the determination result of the mailing item determination unit 14. For example, if the mailing item determination unit 14 determines that mailing item A1 is a postcard, the notification unit 16 notifies the mailing information, including the information that it is a postcard.

[0091] The mailing notification system 100 (control device 1) preferably includes a storage unit for storing mailing information. The notification unit 16 may store the generated mailing information as history information in the storage unit of the mailing notification system 100.

[0092] The notification unit 16 has the function of communicating with the intercom system 3 in the facility 200 where the collective mailbox P1 is installed. The notification unit 16 notifies the destination (user U1) determined by the destination determination unit 13 via the intercom system 3. The mailing information may include information such as the dwelling unit number as the destination determined by the destination determination unit 13. The intercom system 3, in accordance with the command from the notification unit 16, transmits to user U1 based on the dwelling unit number information in the mailing information. Specifically, in this embodiment, the control device 1 is connected to the lobby intercom 31, and the notification unit 16 first transmits the mailing information to the lobby intercom 31. When the lobby intercom 31 receives the mailing information, it forwards it to the control device 32. The control device 32 transmits the mailing information to the master unit 33 corresponding to the dwelling unit number in the mailing information via the first main line, second main line, and branch line of the intercom system 3.

[0093] The master unit 33 notifies the resident of the dwelling (user U1) that it has received mailing information by displaying it on the display unit of the master unit 33 and / or by outputting sound from the speaker of the master unit 33. User U1, upon learning that mailing information has been received, can operate the master unit 33 to check the mailing image IM1 and target image IM2 on the display unit screen of the master unit 33, and to check the type of mailing A1 (the result of the mailing item determination unit 14). It is preferable for the master unit 33 to store the received mailing information as history information in its own memory unit.

[0094] In this way, user U1 can, while inside their dwelling, be notified via the master unit 33 inside the dwelling that mail A1 has been delivered to their mailbox P10, and can also see a picture of mail A1.

[0095] By the way, in this embodiment, if the mail item determination unit 14 determines that the mail item A1 is a flyer, the notification unit 16 does not perform notification of mail item information. In other words, even if the mail item detection unit 12 detects mail item delivery, if the mail item determination unit 14 determines that the mail item A1 is a flyer, the mail item information will not be notified to the user U1. For example, if the mail item A1 is determined to be a flyer, the notification unit 16 does not even send the mail item information to the lobby intercom 31. Alternatively, the notification unit 16 may send the mail item information to the intercom system 3, but without notifying the user U1 of the mail item information via the master unit 33, it may simply store it in the storage unit of the master unit 33.

[0096] Furthermore, if the type of mailed item A1 is determined to be a flyer, the notification unit 16 may store the mailing information as history information in the storage unit of the mailing notification system 100 (control device 1) without notifying the user U1 of the mailing information.

[0097] Furthermore, if the type of mailed item A1 is determined to be a flyer, the notification unit 16 may notify the facility manager of the mailed item information by transmitting it to the master unit 33 in the manager's room of the facility 200 via the intercom system 3, even if it does not notify the user U1. Alternatively, if the control device 1 can communicate with the outside of the facility 200 via an external network such as the Internet, the notification unit 16 may notify the mailed item information to an external server operated by the facility management company of the facility 200 if the type of mailed item A1 is determined to be a flyer.

[0098] Furthermore, even if the mail item determination unit 14 determines that mail item A1 is a flyer, the notification unit 16 may still perform the mail item notification. In addition, the user U1 may set whether or not to notify mail item information in the case of a flyer (enable / disable flyer notification) via the operation panel of the master unit 33 or the like.

[0099] (3) Settings function The mailing notification system 100 includes a setting unit. The setting unit performs various settings based on external input. The mailing notification system 100 also includes an operation unit as a user interface. The operation unit includes, for example, one or more of the following: a mouse, a keyboard, and a pointing device. The mailing notification system 100 also includes a display unit (display device) as a user interface. The display unit displays, for example, information related to the settings of the setting unit on the screen. If the display unit is a touch panel display, the display device may also function as the operation unit.

[0100] For example, the mailing notification system 100 may include a setting terminal such as a laptop computer or tablet device having the functions of a setting unit, operation unit, and display unit as described above. The setting terminal may be connected to the control device 1 to allow various types of information to be set. For example, the system configurator can set the detection area setting information and cropping setting information described above by operating the operation unit while viewing the video information from the imaging device 2 on the display screen of the setting terminal.

[0101] The setting unit of the mailing notification system 100 may set whether the second mailing detection process is enabled or disabled in response to the operation input from the operation unit. If the second mailing detection process is set to "enabled", the mailing notification system 100 will perform both the first mailing detection process and the second mailing detection process. If the second mailing detection process is set to "disabled", the system will perform only the first mailing detection process and will not perform the second mailing detection process.

[0102] Regardless of whether or not the second mailing detection process is performed, it is preferable for the system administrator to configure the detection area settings information (settings for detection area D0) as described above.

[0103] (4) Operation of the mailing notification system The following describes the sequence of operations in the mailing notification system 100 with reference to Figure 6. The sequence diagram shown in Figure 6 is merely one example of the operation flow in the mailing notification system 100, and the order of operations may be changed as appropriate, or operations may be added or omitted as appropriate. In the following, as an example, the operation in the mailing notification system 100 (mailing detection unit 12) when only the first mailing detection process is performed and the second mailing detection process is not performed will be described. The first mailing detection process corresponds to step ST3 (mailing detection) in Figure 6.

[0104] First, the imaging device 2 photographs the exterior of the collective post box P1 where mail may be deposited, and transmits the video information to the mailing notification system 100 (control device 1) as it occurs (step ST1: video transmission).

[0105] The mailing notification system 100 acquires video information obtained by the imaging device 2 (video acquisition process). The video information is stored in the memory unit.

[0106] Each open / close detection sensor G1 monitors the opening and closing of the door Q10 of the mail slot Q1 in the corresponding post P10. When it detects the opening or closing of the door Q10, it transmits the sensor information to the mail notification system 100 via the aggregation device H1 (step ST2).

[0107] The mailing notification system 100 acquires sensor information from the open / close detection sensor G1 (sensor information acquisition process). Based on the acquired sensor information, the mailing notification system 100 performs a mailing detection process (first mailing detection process) (step ST3). When the mailing notification system 100 detects mailing (occurrence), it identifies the detection timing (detection time) when the opening and closing of the door Q10 was detected (step ST4), and based on that detection timing, it extracts the mailing image IM1 (specific information) from the video information (step ST5). Then, the mailing notification system 100 performs a destination determination process to determine the destination of the mailing (step ST6). Subsequently, the mailing notification system 100 performs a mailing item determination process to determine the type of mailing item A1 that has been mailed (step ST7), and also performs an image cropping process to extract and enlarge the target image IM2 from the mailing image IM1 (step ST8).

[0108] The mailing notification system 100 executes a notification process based on the processing results such as mailing detection processing, destination determination processing, mailing item determination processing, and image extraction processing to generate mailing information including the destination (house number), the determination result of the type of mailing item A1, and the target image IM2 (step ST9). The mailing notification system 100 transmits the mailing information to the intercom system 3 (step ST10: image and destination transmission).

[0109] When the intercom system 3 receives mailing information (step ST11), it notifies the user U1 of the target image IM2 via the display screen of the master unit 33, which corresponds to the recipient's dwelling number, based on a command from the mailing notification system 100 (step ST12: image).

[0110] Furthermore, if the second mailing detection process is implemented, the steps of the second mailing detection process may be placed, for example, between steps ST5 and ST6.

[0111] (5) Advantages As described above, according to the mailing notification system 100 of this embodiment, specific information (mailing image IM1) is extracted based on the detection timing when the opening / closing detection sensor G1 detects the opening and closing of the door Q10. The information from which the specific information is extracted is video information of the exterior of the collective mailbox P1 acquired by the imaging device 2. Therefore, there is no need to install lighting (device) and cameras (imaging device) at each of the multiple mailboxes P10, and costs related to lighting and cameras, as well as the effort involved in installing lighting and cameras at each mailbox P10, are reduced. As a result, it becomes easier to realize mailing notifications for the collective mailbox P1.

[0112] Furthermore, the mailing notification system 100 according to this embodiment notifies mailing information in cooperation with the intercom system 3 installed in the facility 200. Therefore, since the master unit 33 can be identified using the dwelling unit number of the facility 200 as the destination for mailing A1, it is easier to notify mailings to the communal mailbox P1.

[0113] Furthermore, the mailing notification system 100 according to this embodiment can detect mailings not only based on sensor information but also on changes in multiple detection areas D0 that are pre-set for multiple mailing slots Q1 on the video. This improves the accuracy of mailing detection. In particular, the mailing notification system 100 only needs to be able to set multiple detection areas D0 for multiple mailing slots Q1 on the video, and is less restricted by the installation position, imaging range, and field of view of the imaging device 2.

[0114] (6) Variant The following lists modifications of the above embodiment. In the description of the following modifications, elements similar to those in the above embodiment may be given the same reference numerals and their descriptions may be omitted as appropriate.

[0115] (6.1) Variation 1 The following description of the mailing notification system 100 according to Modification 1 (hereinafter also simply referred to as Modification 1) will be made with reference to Figures 7 to 9.

[0116] Modification 1 acquires not only video information from the imaging device 2, but also video information (auxiliary video information) from the auxiliary imaging device 2A (see Figures 7 and 8). Here, the auxiliary imaging device 2A is not a component of Modification 1, but it may be. Modification 1 may further include the auxiliary imaging device 2A.

[0117] Modification 1, as shown in Figure 7, further includes an auxiliary video acquisition unit 11A. The auxiliary video acquisition unit 11A acquires auxiliary video information acquired by an auxiliary imaging device 2A installed in a position capable of photographing the space in front of the collective post box P1. The notification unit 16 notifies the mailing information, including as specific information the image of mailing person B1 (mailing person image IM3: see Figure 9) detected by the mailing detection unit 12 from the auxiliary video information. The image of mailing person B1 is extracted from the auxiliary video information based on the detection timing when the opening and closing of the door Q10 is detected by the opening and closing detection sensor G1.

[0118] The mail sender image IM3 may be an image taken at the same time as the detection timing, or an image taken at a time slightly earlier than the detection timing. Furthermore, the mail sender image IM3 may be an image taken at the same time as the mail sender image IM1 taken by the imaging device 2, or an image taken at a time slightly earlier than the mail sender image IM1.

[0119] The auxiliary imaging device 2A is, for example, a color camera or a monochrome camera. The auxiliary imaging device 2A is installed, for example, on the ceiling surface C1 of the facility 200, similar to the imaging device 2. The auxiliary imaging device 2A may also be installed on the wall surface of the facility 200 or on the collective mailbox P1 (for example, on the top surface of the collective mailbox P1). The installation position, imaging range, and field of view of the auxiliary imaging device 2A are not particularly limited, as long as the image includes, for example, the head, torso, and the hand B2 holding the mailer A1 to some extent. The auxiliary imaging device 2A may be the same type of imaging device as the imaging device 2.

[0120] The auxiliary video acquisition unit 11A acquires (receives) auxiliary video information from the auxiliary imaging device 2A via the communication interface provided in Modification Example 1. The auxiliary video acquisition unit 11A outputs the auxiliary video information to the notification unit 16. Modification Example 1 includes a storage unit for storing (reserving) auxiliary video information, and the auxiliary video acquisition unit 11A stores the acquired auxiliary video information in the storage unit as history information.

[0121] Figure 9 shows a mailer image IM3, which includes the image region B1X of mailer B1 and the image region B2X of hand B2, extracted from auxiliary video information acquired by the auxiliary imaging device 2A. Modification 1 (notification unit 16) obtains a mailer image IM3 by extracting an image from the auxiliary video information acquired by the auxiliary imaging device 2A at the same timing as the imaging timing (imaging time) of the mailer image IM1, which is extracted based on the detection timing when the opening and closing of the door Q10 is detected.

[0122] Modified example 1 (notification unit 16) generates mailing information including the target image IM2 and the mailer image IM3, and notifies the user U1 via the master unit 33 of the intercom system 3.

[0123] According to the configuration of Modified Example 1, user U1 can verify the actual mailer B1 through the mailer image IM3. For example, user U1 can determine from the mailer image IM3 whether mailer B1 is a postal worker or someone distributing flyers. This further improves convenience.

[0124] (6.2) Variation 2 The following description of the mailing notification system 100 according to Modification 2 (hereinafter also simply referred to as Modification 2) will be provided with reference to Figure 10.

[0125] In the peripheral configuration of Modified Example 2, the imaging device 2 and the multiple open / close detection sensors G1 are connected to one or more communication devices 4 (see Figure 10: one in this case). In Modified Example 2, the multiple open / close detection sensors G1 are connected to the communication device 4 via an aggregation device H1, but the aggregation device H1 may be omitted. For example, the functions of the aggregation device H1 may be implemented in the communication device 4. Modified Example 2 is connected to one or more communication devices 4 (one in this case) via an external network NT1 for communication. The video acquisition unit 11 (see Figure 1) acquires video information from the imaging device 2 via one or more communication devices 4 (one in this case) and the external network NT1. The sensor information acquisition unit 10 (see Figure 1) acquires sensor information from the multiple open / close detection sensors G1 via one or more communication devices 4 (one in this case) and the external network NT1. Here, the communication device 4 is not a component of Modified Example 2, but it may be a component. Modified Example 2 may further include a communication device 4. The external network NT1 may be a network such as the Internet.

[0126] In the example shown in Figure 10, one communication device 4 is connected to the imaging device 2 and to multiple open / close detection sensors G1 (via the aggregation device H1) to receive information. However, there may be two or more communication devices 4. For example, two communication devices 4 may be provided, one connected to the imaging device 2 and the other connected to multiple open / close detection sensors G1 (via the aggregation device H1), with each communication device 4 communicating with the mailing notification system 100.

[0127] In Modification 2, the functions of the mailing notification system 100 are implemented on server V1. Server V1 may consist of one or more server devices (one in the example in Figure 10). If server V1 consists of multiple server devices, the multiple server devices may form a cloud (cloud computing).

[0128] Server V1 acquires video information from the imaging device 2 via the communication device 4 and the external network NT1, and also acquires sensor information from multiple open / close detection sensors G1 via the aggregation device H1, the communication device 4 and the external network NT1. Server V1 performs mail delivery detection processing, destination determination processing, mail item determination processing, image extraction processing, and notification processing. Server V1 transmits mail delivery information, including the destination (residential number), the determination result of the type of mail item A1, and the target image IM2, generated by the notification processing, to the intercom system 3 of facility 200.

[0129] In the example shown in Figure 10, the server V1 is configured to transmit the mailing information to the lobby intercom 31 via the external network NT1. However, in Modification 2, the transmission path of the mailing information to user U1 is not particularly limited, as long as the server V1 is connected to the external network NT1. For example, the server V1 may send the mailing information back to the communication device 4, and the communication device 4 may then transmit the mailing information to the lobby intercom 31.

[0130] Server V1 may manage mailing notifications for one or more facilities 200 in a single operation. In this case, Server V1 obtains video information and sensor information from the communication device 4, including identification information of the facility 200 where the communication device 4 is installed (for example, identification information of the communication device 4, or identification information of the lobby intercom 31 installed in the facility 200). Server V1 transmits mailing information to the recipient of the identification information contained in the video information and sensor information.

[0131] According to the configuration of the modified example 2, for example, the server V1 on which the functions of the mailing notification system 100 are implemented can be installed and managed outside the facility 200, making it easier to notify the collective post box P1 of mailings.

[0132] (6.3) Modification 3 The following description of the mailing notification system 100 related to Modification 3 (hereinafter also simply referred to as Modification 3) will be made with reference to Figures 11 and 12.

[0133] As a peripheral configuration of Modification 3, an output device 5 (see Figures 11 and 12) is provided that performs at least one of sound output and video output (screen display). In the example in Figure 11, the output device 5 is provided as a speaker K1 that performs sound output and a display device L1 (such as a digital signage display) that performs video output. However, only one of the speaker K1 or the display device L1 may be provided, or a single device that performs both sound output and video output may be provided. Here, the output device 5 is not a component of Modification 3, but it may be a component. Modification 3 may further include the output device 5.

[0134] Speaker K1 is installed, for example, on the ceiling surface C1 of facility 200. Speaker K1 may also be installed on the wall surface of facility 200 or on the collective post P1 (for example, on the top surface of collective post P1). Display device L1 is installed, for example, on the floor surface near collective post P1. Display device L1 may also be installed on the wall surface of facility 200 or on the collective post P1 (for example, on the top surface of collective post P1).

[0135] In Modification 3, if the mail detection unit 14 determines that mail A1 is a flyer, the notification unit 16 issues a warning to the mailer B1 who made the mailing via the output device 5. The output device 5, consisting of speaker K1 and display device L1, is connected to the control device 1 (Modification 3). In Modification 3, if the notification unit 16 determines that mail A1 is a flyer, it outputs a warning sound (an electronic sound that is likely to attract the attention of mailer B1, or a warning message using synthesized speech) from speaker K1. Also, in Modification 3, if the notification unit 16 determines that mail A1 is a flyer, it displays a warning message such as "No flyer mailing" from the display device L1, as shown in Figure 10.

[0136] According to the configuration of Modified Example 3, the possibility of flyers being delivered can be suppressed.

[0137] (6.4) Modification 4 The following description of the mailing notification system 100 according to Modification 4 (hereinafter also simply referred to as Modification 4) will be given with reference to Figures 13 to 16.

[0138] The collective post P1 to which Modification 4 is applied (see Figure 13) is larger in dimensions than the collective post P1 shown in Figure 2. The collective post P1 shown in Figure 13 includes, as an example, 12 posts P10 arranged in 4 columns x 3 rows.

[0139] In the peripheral configuration of Modified Example 4, multiple imaging devices 2 are provided, positioned to capture the exterior of the collective post P1. Here, the multiple imaging devices 2 are not components of Modified Example 4, but they may be. Modified Example 4 may further include the multiple imaging devices 2. In Modified Example 4, the multiple imaging devices 2 are arranged to compensate for blind spots with respect to the collective post P1.

[0140] In the examples shown in Figures 13 and 16, two imaging devices 2 are provided, but three or more imaging devices 2 may be provided. For the purposes of this explanation, the imaging device 2 on the left side of Figure 13 may be referred to as the first imaging device 21, and the imaging device 2 on the right side may be referred to as the second imaging device 22. The first imaging device 21 and the second imaging device 22 are installed on the ceiling surface of the ceiling C1, approximately directly above the collective post P1. In particular, the first imaging device 21 and the second imaging device 22 are installed along the left-right direction of the collective post P1 so as to compensate for each other's blind spots with respect to the collective post P1.

[0141] Modification 4, as shown in Figure 16, includes multiple video acquisition units 11. Each of the multiple video acquisition units 11 acquires multiple video information acquired by multiple imaging devices 2. Modification 4 extracts specific information (mailbox image) from at least one of the multiple video information based on the detection timing when the opening and closing of the door Q10 is detected by the opening and closing detection sensor G1. Furthermore, when performing the second mailbox detection process, Modification 4 detects mailboxing based on at least one of the multiple video information.

[0142] In the example shown in Figure 16, Modification 4 is equipped with two image acquisition units 11, depending on the number of imaging devices 2 (2). For the purposes of this explanation, the unit that acquires image information (hereinafter referred to as first image information) from the first imaging device 21 may be referred to as the first image acquisition unit 111. The unit that acquires image information (hereinafter referred to as second image information) from the second imaging device 22 may be referred to as the second image acquisition unit 112.

[0143] Figure 14 is a mailing image IM6, taken from the first video information acquired by the first video acquisition unit 111 from the first imaging device 21, showing mailing in progress to post P10, the bottom post in the rightmost column, by mailing person B1. Figure 15 is a mailing image IM7, taken from the second video information acquired by the second video acquisition unit 112 from the second imaging device 22, showing mailing in progress to post P10, the bottom post in the rightmost column, by mailing person B1. Mailing images IM6 and IM7 are images taken at the same time (simultaneous time) based on the detection timing when the opening and closing of door Q10 was detected.

[0144] As shown in Figure 14, the three posts P10 in the far right column are in a blind spot for the first imaging device 21. Therefore, in the postage image IM6 based on the first video information from the first imaging device 21, more than half of the image area A1X of the postage item A1 and the image area B2X of the poster B1's hand B2, which are posted to the bottom post P10 in the far right column, are cut off.

[0145] In contrast, the second imaging device 22 is positioned to supplement the image information of the three posts P10 in the rightmost column, which are in a blind spot for the first imaging device 21. Therefore, as shown in Figure 15, the postage image IM7 based on the second image information from the second imaging device 22 sufficiently includes the image area A1X of the postage item A1 being posted to the bottom post P10 in the rightmost column, and the image area B2X of the poster B1's hand B2. The three posts P10 in the leftmost column, which are in a blind spot for the second imaging device 22, are supplemented by the first image information from the first imaging device 21.

[0146] In Modified Example 4, it is preferable that, for example, depending on the position of the post P10 of the open / close detection sensor G1 that detects the opening and closing of the door Q10, it is predetermined whether to use first video information from the first imaging device 21 or second video information from the second imaging device 22. In the example in Figure 13, the collective post P1 includes 12 posts P10. For example, the system setter can set up sensor imaging device setting information that associates the sensor IDs of the open / close detection sensors G1 of the 6 posts P10 on the left half of the collective post P1 with the device ID of the first imaging device 21. The system setter can also set up sensor imaging device setting information that associates the sensor IDs of the open / close detection sensors G1 of the 6 posts P10 on the right half of the collective post P1 with the device ID of the second imaging device 22. Modified Example 4 includes a storage unit that stores (stores) the sensor imaging device setting information.

[0147] In the modified example 4, when the mailing detection unit 12 detects the opening or closing of the door Q10 using any of the opening / closing detection sensors G1 of the six posts P10 on the left half, it refers to the sensor imaging device setting information and extracts the mailing image IM6 (specific information) from the first video information based on the detection timing. In this case, the mailing detection unit 12 does not have to extract the mailing image IM7 (specific information) from the second video information, but it may do so. The mailing detection unit 12 outputs at least the mailing image IM6 extracted from the first video information to the destination determination unit 13.

[0148] Furthermore, in the modified example 4, if the mailing detection unit 12 detects the opening or closing of the door Q10 using any of the opening / closing detection sensors G1 of the six posts P10 on the right half, it refers to the sensor imaging device setting information and extracts the mailing image IM7 (specific information) from the second video information based on the detection timing. In this case, the mailing detection unit 12 does not have to extract the mailing image IM6 (specific information) from the first video information, but it may do so. The mailing detection unit 12 outputs at least the mailing image IM7 extracted from the second video information to the destination determination unit 13.

[0149] The system administrator may configure detection area setting information for multiple detection areas D0 (see Figure 4) for multiple mail slots Q1, for each of the first video information from the first imaging device 21 and the second video information from the second imaging device 22. When performing the second mail insertion detection process, the detection areas D0 may be set so that the first and second video information can cover 12 mail slots Q1.

[0150] In the first video information, as shown in the mailing image IM6 in Figure 14, the mailing slots Q1 of the three posts P10 in the far right column are cut off and not visible. Therefore, the system setter can, for example, set up six detection areas D0 for the mailing slots Q1 of the six posts P10 in the left half. In the second video information, as shown in the mailing image IM7 in Figure 15, the mailing slots Q1 of the three posts P10 in the far left column are completely cut off and not visible. Therefore, the system setter can, for example, set up six detection areas D0 for the mailing slots Q1 of the six posts P10 in the right half.

[0151] In Modified Example 4, the mailing detection unit 12 detects the opening or closing of the door Q10 using any of the opening / closing detection sensors G1 of the six posts P10 on the left half, and in the second mailing detection process, it detects mailing based on the corresponding change in the detection area D0 on the first video information. On the other hand, in Modified Example 4, the mailing detection unit 12 detects the opening or closing of the door Q10 using any of the opening / closing detection sensors G1 of the six posts P10 on the right half, and in the second mailing detection process, it detects mailing based on the corresponding change in the detection area D0 on the second video information.

[0152] In the modified example 4, each detection area D0 is set as a long rectangular area of ​​the same shape and dimensions as the image area Q1X of the mail slot Q1, located directly below the corresponding image area Q1X of the mail slot Q1 (see Figure 3) in the video, similar to the detection area D0 of the above embodiment (see Figure 3).

[0153] The destination determination unit 13 determines the destination based on information from one or both of the mailed images IM6 and IM7. The image extraction processing unit 15 may extract the target image IM2 from one of the mailed images IM6 and IM7, or it may extract two target images IM2 from both mailed images IM6 and IM7. The notification unit 16 may include the target image IM2 extracted from one of the mailed images IM6 and IM7 in the mailing information, or it may include two target images IM2 extracted from both mailed images IM6 and IM7 in the mailing information.

[0154] According to the configuration of the modified example 4, even for relatively large communal post boxes P1 that cannot be covered by video information from a single imaging device 2, it becomes easier to notify the recipient of mail being delivered to the communal post box P1.

[0155] Incidentally, blind spots for the imaging device 2 are not limited to cases where the collective post P1 is large, but can also occur due to the presence of a mail sender B1 standing in front of the collective post P1 and performing the mailing (for example, the area around the mailing slot Q1 is obstructed by the head of mail sender B1). Therefore, multiple imaging devices 2 may be arranged to compensate for blind spots caused by the presence of mail sender B1. For example, one of the multiple imaging devices 2 may be installed to image a certain post P10 from directly above, and another imaging device 2 may be installed to image the same post P10 from an oblique angle above.

[0156] In short, the multiple imaging devices 2 according to Modification 4 may be arranged to compensate for blind spots with respect to the collective post P1 and / or blind spots caused by the presence of the mailer B1 who performs the mailing.

[0157] (6.5) Variation 5 The following description of the mailing notification system 100 according to Modification 5 (hereinafter also simply referred to as Modification 5) will be made with reference to Figure 17.

[0158] As a peripheral configuration of Modification 5, an information terminal 6 (see Figure 17) is provided. The information terminal 6 is a terminal owned by user U1. The information terminal 6 may be, for example, a smartphone or tablet terminal carried by user U1. The information terminal 6 is connected to an external network NT1 (see Figure 17), such as the Internet. Here, the information terminal 6 is not a component of Modification 5, but it may be a component. Modification 5 may further include the information terminal 6.

[0159] In addition, as a peripheral configuration of the modified example 5, the intercom system 3 further includes a gateway 34 (see Figure 17) connected to an external network NT1. The control device 32 can communicate with the information terminal 6 via the gateway 34 and the external network NT1.

[0160] The mailing information generated by Modification 5 (Control Device 1) is transmitted to the information terminal 6 via the lobby intercom 31, control device 32, gateway 34, and external network NT1. The mailing information is notified to user U1 by a screen display on the information terminal 6's display unit and / or by sound output from the information terminal 6's speaker.

[0161] As a result, user U1, who carries the information terminal 6, can receive notifications of mailing information via the information terminal 6 even when away from home. Note that the transmission path of mailing information from modified example 5 (control device 1) to the information terminal 6 is not limited to the above path, as long as the mailing information can be received by the information terminal 6 carried by user U1 while away from home via the external network NT1.

[0162] For example, control device 1 may be connected to control device 32, and the mailing information may be transmitted via the path from control device 1 to control device 32, gateway 34, and external network NT1. Alternatively, control device 1 may be connected to gateway 34, and the mailing information may be transmitted via the path from control device 1 to gateway 34, and external network NT1. Alternatively, a master unit 33 inside the dwelling unit may be interposed in the transmission path of the mailing information. For example, the mailing information may be transmitted via the path from control device 1 to lobby intercom 31, control device 32, master unit 33 inside the dwelling unit, router (not shown) inside the dwelling unit, gateway 34, and external network NT1.

[0163] Alternatively, the mailing information may be notified via email. In that case, a mail server on the external network NT1 may be interposed in the transmission path of the mailing information, and the mail server may send an email containing the mailing information to the information terminal 6.

[0164] According to the configuration of Modification 5, even when user U1 is out, they can receive notifications of mailing information via the information terminal 6, thus improving convenience.

[0165] In the above embodiment, the master unit 33, upon receiving the mailing information, directly notifies the user U1, who is at home, of the mailing information via screen display or sound output from the master unit 33. However, it is also possible for the user U1 to receive notification of the mailing information on the information terminal 6 even when at home. The master unit 33, upon receiving the mailing information, may also transmit the mailing information directly to the information terminal 6 (or via a router in the dwelling) via wireless communication compliant with standards such as Wi-Fi® or Bluetooth®.

[0166] The intercom system 3 may have a configuration in which, for example, the master unit 33 accepts self-reports of presence or absence from user U1. In that case, if a "absent" report is received, the mailing information may be sent to the information terminal 6 via the external network NT1, or if a "present" report is received, it may be sent to the information terminal 6 via the master unit 33.

[0167] This configuration allows user U1 to receive notifications of mail delivery information via the information terminal 6, even when they are at home, thus improving convenience.

[0168] (6.6) Variation 6 The following description of the mailing notification system 100 relating to Modification 6 (hereinafter also simply referred to as Modification 6) will be made with reference to Figure 18.

[0169] Figure 18 illustrates two candidate mailed images that could serve as the basis for the target image IM2 transmitted with the mailing information: mailed image IM8 (top image in Figure 18) and mailed image IM9 (bottom image in Figure 18). Mailed image IM8 and mailed image IM9 were captured at slightly different times.

[0170] The mailed item image IM8 was captured at the first timing when the image area A1X of mailed item A1 was large. Therefore, it can be said that this image makes it easy for user U1 to confirm mailed item A1 on the image.

[0171] On the other hand, the mailing image IM9 is an image captured at the second timing, which is the same time as the detection timing when the opening and closing of door Q10 was detected by the opening and closing detection sensor G1. The first timing (time) is slightly earlier (in the past) than the second timing (time).

[0172] In the modified example 6, the mail detection unit 12 first performs image analysis on a mail image taken at a second timing, which is the same time as the detection timing when the opening and closing of the door Q10 is detected, based on the video information. If the tip of the mailed item A1 is visible in the mail image, the mail detection unit 12 uses that mail image as identifying information. On the other hand, if the tip of the mailed item A1 is not visible in the mail image, as in mail image IM9, the mail detection unit 12 extracts a mail image taken at a slightly earlier timing and performs image analysis again. The mail detection unit 12 repeats the extraction and image analysis of mail images taken at even earlier timings until it finds a mail image in which the tip of the mailed item A1 is visible. Mail image IM8 is an image in which the tip of the mailed item A1 is determined to be visible.

[0173] As described above, the mail detection unit 12 in Modification 6 extracts a mail image IM8 from the video information at a first timing slightly prior to the second timing (detection timing) when the opening and closing of the door Q10 is detected. The mail item determination unit 14 in Modification 6 determines the type of mail item A1 from the extracted mail image IM8. The image extraction processing unit 15 in Modification 6 extracts a target image IM2 from the extracted mail image IM8. The notification unit 16 in Modification 6 generates and notifies mail information including the target image IM2 extracted from the mail image IM8.

[0174] According to the configuration of Modified Example 6, images where the image area A1X of mailed item A1 is relatively large, such as the mailed image IM8, are used for determining the type of mailed item A1, thus improving the accuracy of type determination. In addition, since the mailed image IM8 is attached for notification, user U1 who receives the mailing notification can easily confirm mailed item A1 in the image. Therefore, convenience is improved. Furthermore, according to the configuration of Modified Example 6, false detections of mailings are also reduced.

[0175] (6.7) Variation 7 The following describes the mailing notification system 100 related to Modification 7 (hereinafter also simply referred to as Modification 7).

[0176] The mailing detection unit 12 in Modification 7 has a function to detect the skeleton of a human hand (fingers) in the image. When the mailing detection unit 12 in Modification 7 determines that an arbitrary opening / closing detection sensor G1 has detected the opening or closing of the door Q10, it does not immediately determine that mailing has occurred, but instead executes image judgment processing using a skeleton detection algorithm. That is, the mailing detection unit 12 in Modification 7 performs hand (fingers) skeleton discrimination on the mailing image IM1 (or mailing image IM8 or IM9 as described in Modification 6) extracted based on the detection timing when the opening or closing of the door Q10 was detected. Based on the result of this processing, the mailing detection unit 12 in Modification 7 determines whether or not only a human hand (fingers) is visible in the mailing image (without the mailed item A1). In the modified example 7, if the mailing detection unit 12 determines that only a human hand (fingers) is visible, it determines that the opening and closing of the door Q10 was detected because the front of the door Q10 was pushed by a hand (fingers). Even if the opening and closing of the door Q10 is detected, it determines that no mailing has occurred. In other words, the mailing detection unit 12 determines that only a person with no intention of mailing anything pushed the door Q10 with their hand (fingers). As a result, no mailing notification is issued.

[0177] According to the configuration of Modified Example 7, the possibility that a mailing may be mistakenly determined to have occurred and a mailing notification issued due to a person who does not intend to mail anything pressing the door Q10 with their hand (finger) can be reduced.

[0178] (6.8) Variation 8 The following description of the mailing notification system 100 relating to Modification 8 (hereinafter also simply referred to as Modification 8) will be made with reference to Figure 19.

[0179] Modification 8 transmits the mailing information to the lobby intercom 31, and notifies the user U1 of the mailing information through a screen display on the lobby intercom 31 and / or through sound output from the speaker of the lobby intercom 31.

[0180] For example, user U1 may operate the control panel of the lobby intercom 31 to unlock the electric lock at the entrance to the lobby of facility 200 upon returning home. By entering user U1's unique ID information and password, the lobby intercom 31 will notify the user via its display if it has received new mailing information. When user U1 performs an operation on the control panel of the lobby intercom 31 to confirm the new mailing information, the lobby intercom 31 displays the new mailing information on its screen. The target image IM2, etc., is displayed on the display panel of the lobby intercom 31, allowing user U1 to confirm mailing item A1 on the screen.

[0181] If there are multiple new mailings, the lobby intercom 31 displays them as a list on the screen. User U1 can select one of the mailings they wish to check from the list. The lobby intercom 31 also stores previously checked mailings (history information) in its memory, and User U1 can check this history information as needed.

[0182] In the above embodiment, it was explained that if the type of mailed item A1 is determined to be a flyer, the user U1 is not notified of the mailed item. However, in Modification 8, even if the type of mailed item A1 is determined to be a flyer, notification of the mailed item, including that it is a flyer, may be given via the lobby intercom 31. In other words, when returning home, the distance from the lobby intercom 31 to the communal mailbox P1 is relatively short, so even if it is a flyer, it is not much trouble to go to the communal mailbox P1 and collect the flyer.

[0183] According to the configuration of Modification 8, the convenience is further improved because the user can receive notification of mailing information via the lobby intercom 31 upon returning home.

[0184] (6.9) Modification 9 The following describes the mailing notification system 100 related to Modification 9 (hereinafter also simply referred to as Modification 9).

[0185] In a facility such as an apartment building 200, there may be vacant rooms that are not being used (not being lived in) by any user U1. In Modification 9, the dwelling unit numbers of vacant rooms can be registered in advance. For example, it is preferable that the manager of the facility 200 can set the dwelling unit numbers of vacant rooms to the mailing notification system 100 via an operating unit such as the master unit 33 in the manager's room, the lobby intercom, or the setting terminal of the mailing notification system 100. It is preferable that the mailing notification system 100 includes a storage unit that stores information regarding the dwelling unit numbers of vacant rooms (vacant room registration information).

[0186] First, the destination determination unit 13 in Modification 9 refers to the sensor destination correspondence information and identifies the destination of post P10 (such as the dwelling unit number, name, and email address of user U1) corresponding to the sensor ID information of the open / close detection sensor G1 that detected the opening and closing of door Q10. Next, the destination determination unit 13 in Modification 9 refers to the vacant room registration information and checks whether the identified destination (dwelling unit number) is registered as a vacant room.

[0187] If the sensor destination information includes the registered dwelling unit number, name, email address, etc. of user U1, and the specified dwelling unit number is not registered as a vacant room in the vacant room registration information, then Modification 9 will notify the mailing information in the same manner as in the above embodiment.

[0188] On the other hand, if the sensor destination information does not contain the dwelling unit number, name, email address, etc., of user U1, or if the specified dwelling unit number is registered as a vacant room in the vacant room registration information, the destination determination unit 13 will determine "destination unknown," and Modification 9 will not notify the delivery information. Alternatively, Modification 9 may notify the master unit 33 in the management room or the lobby intercom of the delivery information, including the fact that the destination is unknown.

[0189] Furthermore, in variation 9, the fact that a mail item was delivered to postbox P10 with an unknown address is also used to determine the type of mail item A1 (whether it is a flyer).

[0190] In other words, in Modification 9, the mail item determination unit 14 determines the type of mail item A1 to be a flyer if the determination result by the address determination unit 13 indicates that the address is not registered (address unknown). Furthermore, if the mail item determination unit 14 determines the type of mail item A1 to be a flyer due to the address being unregistered, and if mail item A1 is detected being deposited in another post P10 within a certain time period including the timing of the detection of the flyer's deposit, the mail item determination unit 14 also determines the type of that mail item A1 to be a flyer.

[0191] According to the configuration of Modification 9, the ability to pre-register the dwelling unit numbers of vacant rooms makes it easier to determine if a mail item is "undeliverable." Furthermore, since the fact that mail has been delivered to the undeliverable mailbox P10 is used to determine the type of mail item A1 (flyer), the accuracy of determining whether mail item A1 is a flyer is improved.

[0192] (6.10) Variation 10 The following describes the mailing notification system 100 related to Modification 10 (hereinafter also simply referred to as Modification 10).

[0193] In the above embodiment, whether or not mail has been deposited is determined by detecting the opening and closing of the door Q10 of the mail slot Q1 using the opening and closing detection sensor G1 located in each post P10. However, depending on the type of post P10, there may be a structure in which the mail slot Q1 is not provided with a door Q10, and the mail slot Q1 is always open.

[0194] In Modification 10, instead of the opening / closing detection sensor G1, a load sensor is provided at the bottom of the post P10 to detect the load of the mailed item A1 (object), or an optical sensor (such as an infrared sensor) is provided on the surrounding wall of the post P10 to detect the passage of the mailed item A1 (object). In other words, the source of the sensor information in this disclosure is not limited to the opening / closing detection sensor G1.

[0195] Modified example 10 (mailing notification system 100) includes an image acquisition unit 11, a sensor information acquisition unit 10, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16.

[0196] The video acquisition unit 11 acquires video information obtained by the imaging device 2, which is installed in a position capable of photographing the exterior of a collection post P1 that includes multiple posts P10. The configuration of the video acquisition unit 11 is the same as that of the mailing notification system 100 in the above embodiment.

[0197] The sensor information acquisition unit 10 acquires sensor information relating to the detection results of multiple detection sensors. The multiple detection sensors are arranged inside multiple posts P10 and each detects the weight or movement of an object inside the multiple posts P10. The detection sensors referred to here may be, for example, load sensors placed at the bottom of the post P10 to detect the weight of an object (mailbox A1). Alternatively, the detection sensors may be, for example, optical sensors (infrared sensors, etc.) placed on the surrounding walls of the post P10 to detect the movement of an object (passage of mailbox A1), as described above.

[0198] The mailing detection unit 12 detects mailings at multiple post boxes P10 based on sensor information, on a per-post box P10 basis.

[0199] The destination determination unit 13 determines the destination (user U1) of the mail based on the detection result of the mailing detection unit 12. The notification unit 16 notifies the mailing information, which includes the determination result of the destination determination unit 13 and specific information based on video information. The configuration of the destination determination unit 13 and the notification unit 16 is the same as that of the mailing notification system 100 in the above embodiment.

[0200] The mail delivery detection unit 12 determines, based on sensor information, that any of the multiple detection sensors has detected the weight or movement of an object, and then identifies the timing of the object detection. The identified information is extracted from the video information based on the detection timing.

[0201] In this modified example 10, the information from which specific information is extracted based on the detection timing when the detection sensor detects the weight or movement of an object inside post P10 is video information of the exterior of the collective post P1 acquired by the imaging device 2. Therefore, compared to setting up an imaging device and lighting device inside each post P10, the introduction cost and installation work effort are lower. As a result, it becomes easier to notify the collective post P1 of mail being deposited, similar to when using the open / close detection sensor G1 in the above embodiment.

[0202] The mailing notification method corresponding to this modified example 10 is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device 2 installed in a position capable of photographing the appearance of a collection post P1 including multiple posts P10. In the sensor information acquisition step, sensor information regarding the detection results of multiple detection sensors is acquired. The multiple detection sensors are arranged inside the multiple posts P10 and each detects the weight or movement of an object inside the multiple posts P10. As described above, the detection sensor may be, for example, a load sensor placed at the bottom of the post P10 to detect the load of an object (mailing A1). Alternatively, as described above, the detection sensor may be, for example, an optical sensor (infrared sensor, etc.) placed on the surrounding wall inside the post P10 to detect the movement of an object (passage of mailing A1). In the mailing detection step, mailings are detected for each of the multiple post boxes P10 based on sensor information. In the destination determination step, the destination of the mailing is determined based on the detection results of the mailing detection step. In the notification step, mailing information is notified, including the determination result of the destination determination step and specific information based on video information. In the mailing detection step, if any of the multiple detection sensors detect the weight or movement of an object based on sensor information, the timing of the object detection is identified. The specific information is information extracted from video information based on the detection timing. With the above configuration of the mailing notification method, it becomes easier to notify mailings to the collective post box P1, similar to when using the open / close detection sensor G1.

[0203] The above mailing notification method is used on a computer system (mailing notification system 100). In other words, the above mailing notification method can also be implemented as a computer program. A program according to one embodiment is a program that causes one or more processors to execute the above mailing notification method. The program may be recorded on a computer-readable non-temporary recording medium. A computer program product according to one embodiment includes a computer program that, when executed by one or more processors, realizes the steps of the above mailing notification method.

[0204] (6.11) Other variations Functions similar to those of the mailing notification system 100 according to the above embodiment may be implemented by a mailing notification method, a computer program, or a non-temporary recording medium on which a computer program is stored.

[0205] The mailing notification system 100 in this disclosure includes a computer system. The computer system mainly consists of a processor and memory as hardware. The functionality of the mailing notification system 100 in this disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, provided via a telecommunications line, or provided on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. The processor of the computer system consists of one or more electronic circuits including semiconductor integrated circuits (ICs) or large-scale integrated circuits (LSIs). The integrated circuits such as ICs or LSIs referred to here are named differently depending on the degree of integration, and include integrated circuits called system LSIs, VLSIs (Very Large Scale Integration), or ULSIs (Ultra Large Scale Integration). Furthermore, FPGAs (Field-Programmable Gate Arrays) that are programmed after the manufacture of LSIs, or logic devices that allow for the reconfiguration of junction relationships or circuit compartments within LSIs, can also be used as processors. Multiple electronic circuits may be integrated onto a single chip or distributed across multiple chips. Multiple chips may be integrated onto a single device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller also consists of one or more electronic circuits, including semiconductor integrated circuits or large-scale integrated circuits.

[0206] Furthermore, it is not essential that the multiple functions of the mailing notification system 100 be consolidated within a single housing. For example, the components of the mailing notification system 100 may be distributed across multiple housings.

[0207] Conversely, multiple functions in the mailing notification system 100 may be integrated into a single housing, as in the control device 1 of the above embodiment. Furthermore, at least some of the functions of the mailing notification system 100, for example, some of the functions of the mailing notification system 100, may be implemented by the cloud (cloud computing) or the like.

[0208] In the above embodiment, the imaging device 2 is a color camera or a monochrome camera. However, the imaging device 2 may also be capable of acquiring depth information. Specifically, the imaging device 2 may be, for example, a depth camera (stereo camera or TOF (Time-of-Flight) camera, etc.). The mailing notification system 100 may, for example, use depth information from the depth camera (imaging device 2) in the second mailing detection process to distinguish between posts P10 in the depth direction.

[0209] (summary) Based on the embodiments described above, the following aspects are disclosed.

[0210] The first embodiment of the mailing notification system (100) comprises an image acquisition unit (11), a sensor information acquisition unit (10), a mailing detection unit (12), a destination determination unit (13), and a notification unit (16). The image acquisition unit (11) acquires image information acquired by an imaging device (2) installed in a position capable of photographing the exterior of a collection post (P1) including multiple postboxes (P10). The sensor information acquisition unit (10) acquires sensor information relating to the detection results of multiple open / close detection sensors (G1) that detect the opening and closing of the doors (Q10) of multiple mailing slots (Q1) of the multiple postboxes (P10). The mailing detection unit (12) detects mailings for the multiple postboxes (P10) on a per-postbox basis based on the sensor information. The destination determination unit (13) determines the destination (user U1) of the mailing based on the detection results of the mailing detection unit (12). The notification unit (16) notifies the mailing information, which includes the determination result of the destination determination unit (13) and specific information based on the video information. The mailing detection unit (12), based on the sensor information, determines that any of the multiple open / close detection sensors (G1) has detected the opening or closing of the door (Q10), and then identifies the detection timing of the door (Q10) opening or closing. The specific information is information extracted from the video information based on the detection timing.

[0211] According to the above configuration, the information from which specific information is extracted based on the detection timing when the opening / closing detection sensor (G1) detects the opening and closing of the door (Q10) of the mail slot (Q1) is the video information of the exterior of the collective mailbox (P1) acquired by the imaging device (2). Therefore, compared to setting up imaging devices and lighting devices inside each mailbox (P10), the introduction costs and installation work are less burdensome. As a result, it becomes easier to implement notifications of mail being deposited into the collective mailbox (P1).

[0212] With respect to the second embodiment of the mailing notification system (100), in the first embodiment, the video information includes video of multiple mailing slots (Q1). Multiple detection areas (D0) are pre-set on the video information for each of the multiple mailing slots (Q1). The mailing notification system (100) detects mailings in the mailing detection unit (12) based on changes in the multiple detection areas (D0) on the video information, in addition to sensor information.

[0213] According to the above embodiment, the accuracy of detecting mail delivery is improved compared to the case where only sensor information is used.

[0214] With respect to the third embodiment of the mailing notification system (100), in the second embodiment, the mailing detection unit (12) has a function to determine whether the detection of the opening and closing of the door (Q10) occurred when the mailing item (A1) was inserted or when the mailing item (A1) was removed, based on the change in the detection area (D0) corresponding to the mailing slot (Q1) where the opening and closing of the door (Q10) was detected, among a plurality of detection areas (D0).

[0215] According to the above configuration, even though the user (U1) actually took out the mailed item (A1), the possibility of the opening / closing detection sensor (G1) detecting the opening and closing of the door (Q10) and mistakenly detecting that mailed item (A1) has been deposited can be reduced.

[0216] In the fourth embodiment of the mailing notification system (100), in the third embodiment, the notification unit (16) does not perform the notification of mailing information if the mailing detection unit (12) determines that the detection of opening and closing of the door (Q10) occurred when the mailed item (A1) was removed.

[0217] According to the above configuration, the possibility of unnecessary notification of mailing information to the user (U1) can be reduced.

[0218] With respect to the fifth embodiment of the mailing notification system (100), in any one of the first to fourth embodiments, the notification unit (16) notifies mailing information by including, as specific information, mailing images (IM1, IM6~IM8) from the video information in which the mailing detected by the mailing detection unit (12) is in the process of being carried out by the mailer (B1). The mailing images (IM1, IM6~IM8) are extracted from the video information based on the detection timing.

[0219] According to the above configuration, the user (U1) can confirm the actual mailing process through the mailing images (IM1, IM6~IM8), thus improving convenience.

[0220] With respect to the mailing notification system (100) according to the sixth embodiment, in any one of the first to fifth embodiments, the notification unit (16) has the function of communicating with an intercom system (3) in a facility (200) where a communal mailbox (P1) is installed. The notification unit (16) notifies the recipient (user U1) determined by the recipient determination unit (13) via the intercom system (3).

[0221] According to the above configuration, since notification of mail delivery is made via the intercom system (3), it becomes easier to notify the communal mailbox (P1) of mail delivery.

[0222] The seventh embodiment of the mailing notification system (100) further comprises an image extraction processing unit (15) in any one of the first to sixth embodiments. The image extraction processing unit (15) extracts a target image (IM2) from the mailing images (IM1, IM6~IM8) of the video information, which are images of mailings being performed by the mailer (B1) as detected by the mailing detection unit (12), and is limited to the area around the post (P10) in which the mailing is being performed among multiple post boxes (P10). The mailing images (IM1, IM6~IM8) are extracted from the video information based on the detection timing. The notification unit (16) notifies the mailing information, including the target image (IM2) as specific information.

[0223] According to the above configuration, the user (U1) can confirm the actual mailing process through the target image (IM2), thus improving convenience.

[0224] The eighth embodiment of the mailing notification system (100) further comprises an auxiliary video acquisition unit (11A) in any one of the first to seventh embodiments. The auxiliary video acquisition unit (11A) acquires auxiliary video information acquired by an auxiliary imaging device (2A) installed in a position capable of photographing the space in front of the collective mailbox (P1). The notification unit (16) notifies the mailing information, including as identifying information the image of the mailer (B1) who performed the mailing, as detected by the mailing detection unit (12), from the auxiliary video information. The image of the mailer (B1) is extracted from the auxiliary video information based on the detection timing.

[0225] According to the above configuration, the user (U1) can verify the identity of the person who actually made the mailing (B1) through the image of the mailer (B1), thus improving convenience.

[0226] Regarding the mailing notification system (100) according to the ninth embodiment, in any one of the first to eighth embodiments, the imaging device (2) and the multiple open / close detection sensors (G1) are connected to one or more communication devices (4). The mailing notification system (100) is connected to one or more communication devices (4) via an external network (NT1) in a communicable manner. The video acquisition unit (11) acquires video information from the imaging device (2) via one or more communication devices (4) and the external network (NT1). The sensor information acquisition unit (10) acquires sensor information from the multiple open / close detection sensors (G1) via one or more communication devices (4) and the external network (NT1).

[0227] According to the above embodiment, for example, a server with the functionality of a mailing notification system (100) can be installed and managed outside the facility (200), making it easier to notify mailings to the collective mailbox (P1).

[0228] The postage notification system (100) according to the tenth embodiment further comprises a postage item determination unit (14) in any one of the first to ninth embodiments. The postage item determination unit (14) determines the type of postage item (A1) based on the video information of the postage item (A1) detected by the postage detection unit (12). The video of the postage item (A1) is extracted from the video information based on the detection timing. The notification unit (16) notifies the postage information, including the determination result of the postage item determination unit (14).

[0229] According to the above embodiment, the user (U1) can find out the type of mailed item (A1) through the mailing information, thus improving convenience.

[0230] The eleventh embodiment of the mailing notification system (100) further comprises a mailing item determination unit (14) in any one of the first to tenth embodiments. The mailing item determination unit (14) determines the type of mailing item (A1) based on video information of the clothing of the mailer (B1) who performed the mailing, as detected by the mailing detection unit (12). The video of the mailer's (B1) clothing is extracted from the video information based on the detection timing. The notification unit (16) notifies the mailing information, including the determination result of the mailing item determination unit (14).

[0231] According to the above configuration, the user (U1) can learn the type of mailed item (A1) through the mailing information, thus improving convenience. In addition, the accuracy of determining the type of mailed item (A1) is improved.

[0232] With respect to the mailing notification system (100) according to the 12th embodiment, in the 10th or 11th embodiment, if the mailing determination unit (14) determines that the type of mailing (A1) is a flyer, the notification unit (16) does not perform the notification of mailing information.

[0233] According to the above configuration, the possibility of a user (U1) receiving notifications about flyers that are unlikely to require immediate attention is reduced. As a result, convenience is improved.

[0234] With respect to the mailing notification system (100) according to the 13th embodiment, in any one of the 10th to 11th embodiments, the mailing detection unit (12) determines that, on a day other than the first three days of the New Year, any certain number or more of the multiple opening / closing detection sensors (G1) have detected the opening or closing of the door (Q10) within a certain period of time. In that case, the mailing determination unit (14) determines that the type of mailing (A1) is a flyer.

[0235] According to the above configuration, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved. In particular, since the condition excludes the first three days of the New Year, the possibility of misidentifying consecutive mailings of New Year's cards as consecutive mailings of flyers can be reduced.

[0236] With respect to the mailing notification system (100) according to the 14th aspect, in any one of the 10th to 13th aspects, the mailing determination unit (14) determines the type of mailing (A1) to be a flyer if the mailing (A1) does not have at least a postal code, recipient's name, and address on the video.

[0237] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0238] With respect to the mailing notification system (100) according to the 15th embodiment, suppose that in any one of the 10th to 14th embodiments, the mailing determination unit (14) determines that the type of mailing (A1) is a flyer. In that case, the notification unit (16) issues a warning to the mailer (B1) who performed the mailing via an output device (5) that performs at least one of sound output and video output.

[0239] According to the above configuration, the possibility of flyers being delivered can be suppressed.

[0240] With respect to the mailing notification system (100) according to the 16th embodiment, in any one of the 10th to 15th embodiments, the mailing determination unit (14) determines the type of mailing (A1) to be a flyer if the determination result by the address determination unit (13) indicates that the address is not registered.

[0241] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0242] With respect to the mailing notification system (100) according to the 17th embodiment, in the 16th embodiment, the mailing determination unit (14) determines that the type of mailing (A1) is a flyer because the recipient address is not registered. In that case, if mailing (A1) is detected in another postbox (P10) within a certain period of time including the time when the mailing of the flyer is detected, the mailing determination unit (14) also determines that the type of mailing (A1) is a flyer.

[0243] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0244] The mailing notification system (100) according to the 18th embodiment includes a plurality of video acquisition units (11) in any one of the 1st to 17th embodiments. Each of the plurality of video acquisition units (11) acquires a plurality of video information acquired by a plurality of imaging devices (2) installed in a position capable of photographing the exterior of the collective mailbox (P1). The plurality of imaging devices (2) are arranged to compensate for blind spots with respect to the collective mailbox (P1) and / or blind spots caused by the presence of the mailer (B1) performing the mailing. Identifiable information is extracted from at least one of the plurality of video information based on the detection timing.

[0245] According to the above configuration, even in cases where video information from a single imaging device (2) is insufficient, it becomes easier to notify the collective mailbox (P1) of mail being delivered.

[0246] The 19th embodiment of the mailing notification system (100) comprises an image acquisition unit (11), a sensor information acquisition unit (10), a mailing detection unit (12), a destination determination unit (13), and a notification unit (16). The image acquisition unit (11) acquires image information acquired by an imaging device (2) installed in a position capable of photographing the exterior of a collection post (P1) including multiple posts (P10). The sensor information acquisition unit (10) acquires sensor information relating to the detection results of multiple detection sensors. The multiple detection sensors are arranged within the multiple posts (P10) and each detects the weight or movement of objects within the multiple posts (P10). The mailing detection unit (12) detects mailings for the multiple posts (P10) on a per-post-post basis based on the sensor information. The destination determination unit (13) determines the destination (user U1) of the mailing based on the detection results of the mailing detection unit (12). The notification unit (16) notifies the mailing information, which includes the determination result of the destination determination unit (13) and specific information based on the video information. The mailing detection unit (12) determines, based on the sensor information, that any of the multiple detection sensors has detected the weight or movement of an object, and then identifies the timing of the object detection. The specific information is information extracted from the video information based on the detection timing.

[0247] According to the above configuration, the information from which specific information is extracted based on the detection timing when the detection sensor detects the weight or movement of an object inside the post (P10) is video information of the exterior of the collective post (P1) acquired by the imaging device (2). Therefore, compared to setting up an imaging device and lighting device inside each post (P10), the introduction cost and installation work effort are lower. As a result, it becomes easier to notify the collective post (P1) of mail being deposited.

[0248] The mailing notification method according to the 20th embodiment is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device (2) installed in a position capable of photographing the exterior of a collection post (P1) including multiple postboxes (P10). In the sensor information acquisition step, sensor information is acquired regarding the detection results of multiple open / close detection sensors (G1) that detect the opening and closing of the doors (Q10) of multiple mailing slots (Q1) of the multiple postboxes (P10). In the mailing detection step, based on the sensor information, mailing is detected for each of the multiple postboxes (P10). In the destination determination step, the destination (user U1) of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step and specific information based on the video information is notified. In the mail delivery detection step, based on sensor information, if it is determined that any of the multiple open / close detection sensors (G1) has detected the opening or closing of the door (Q10), the detection timing of the door (Q10) opening or closing is identified. The identified information is extracted from the video information based on the detection timing.

[0249] According to the above embodiment, a method for notifying mail delivery to a communal mailbox (P1) can be provided, which facilitates the notification of mail delivery to the communal mailbox (P1).

[0250] The mailing notification method according to the 21st embodiment is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a sensor information acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device (2) installed in a position capable of photographing the appearance of a collection post (P1) including multiple posts (P10). In the sensor information acquisition step, sensor information regarding the detection results of multiple detection sensors is acquired. The multiple detection sensors are placed inside the multiple posts (P10) and each detects the weight or movement of objects inside the multiple posts (P10). In the mailing detection step, mailing is detected for each of the multiple posts (P10) based on the sensor information. In the destination determination step, the destination (user U1) of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step and specific information based on the video information is notified. In the mail delivery detection step, based on sensor information, if any of the multiple detection sensors detect the weight or movement of an object, the detection timing of the object is identified. This identified information is extracted from the video information based on the detection timing.

[0251] According to the above embodiment, a method for notifying mail delivery to a communal mailbox (P1) can be provided, which facilitates the notification of mail delivery to the communal mailbox (P1).

[0252] The program relating to the 22nd aspect is a program that causes one or more processors to execute the mailing notification method according to the 20th or 21st aspect.

[0253] According to the above embodiment, a function can be provided that makes it easier to notify the recipient of mail being delivered to the collective mailbox (P1). [Explanation of symbols]

[0254] 200 facilities 100 Mailing Notification System 10 Sensor information acquisition unit 11. Video Acquisition Unit 11A Auxiliary video acquisition unit 12 Mailing detection unit 13 Destination determination unit 14 Mail item detection unit 15 Image cropping processing unit 16 Notification Department 2. Imaging device 3. Intercom System 4. Communication equipment 5. Output device A1 Mail B1 Posted by D0 detection area G1 Open / Close Detection Sensor IM1, IM6~IM8 Posted Images IM2 Target Image NT1 External Network P1 Collective Mailbox P10 Post Q1 Mail slot Q10 Door U1 User (Recipient)

Claims

1. A video acquisition unit that acquires video information obtained by an imaging device installed in a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes, A sensor information acquisition unit acquires sensor information relating to the detection results of multiple open / close detection sensors that detect the opening and closing of the doors of multiple mail slots of the multiple post boxes, A mailing detection unit that detects mailings into the plurality of mailboxes on a per-mailbox basis based on the sensor information, A destination determination unit determines the destination of the mail based on the detection result of the mailing detection unit, A notification unit that notifies mailing information including the determination result of the destination determination unit and specific information based on the video information, Equipped with, Based on the sensor information, the mail delivery detection unit determines that any of the multiple open / close detection sensors has detected the opening or closing of the door, and then identifies the timing of the door's opening or closing detection. The aforementioned specific information is information extracted from the video information based on the detection timing. Mailing notification system.

2. The aforementioned video information includes images of the multiple mail slots, For each of the aforementioned multiple mail slots, multiple detection areas are pre-set in the video information. The mailing detection unit detects mailing based on changes in the multiple detection areas on the video information, in addition to the sensor information. The mailing notification system according to claim 1.

3. The mail insertion detection unit has a function to determine whether the detection of the door opening and closing occurred when mail was inserted or when mail was removed, based on the change in the detection area corresponding to the mail slot where the opening and closing of the door was detected among the plurality of detection areas. The mailing notification system according to claim 2.

4. If the notification unit determines that the detection of the opening and closing of the door occurred when the mailed item was being removed, it will not perform the notification of the mailed item information. The mailing notification system according to claim 3.

5. The notification unit notifies the mailing information, including, as the specific information, a mailing image from the video information that shows the mailing being performed by the mailing person as detected by the mailing detection unit. The aforementioned mailed image is extracted from the video information based on the detection timing. The mailing notification system according to claim 1.

6. The notification unit has the function of communicating with the intercom system in the facility where the collective mailbox is installed. The notification unit sends a notification to the destination determined by the destination determination unit via the intercom system. The mailing notification system according to claim 1.

7. The system further includes an image extraction processing unit that extracts a target image from the video information, specifically from the image of a mailing in progress detected by the mailing detection unit, which shows the mailing being performed by the mailer, and limits the target image to the area around the mailing post in progress among the multiple mailing posts. The aforementioned mailing image is extracted from the video information based on the detection timing. The notification unit notifies the mailing information, including the target image as the specific information. The mailing notification system according to claim 1.

8. The system further includes an auxiliary video acquisition unit that acquires auxiliary video information obtained by an auxiliary imaging device installed in a position capable of photographing the space in front of the aforementioned collective post, The notification unit notifies the mailing information, including the image of the mailer who performed the mailing, as detected by the mailing detection unit, as the identification information from the auxiliary video information. The image of the mailer is extracted from the auxiliary video information based on the detection timing. A mailing notification system according to any one of claims 1 to 7.

9. The imaging device and the plurality of open / close detection sensors are connected to one or more communication devices. The mailing notification system is connected to the one or more communication devices via an external network, and The video acquisition unit acquires the video information from the imaging device via the one or more communication devices and the external network. The sensor information acquisition unit acquires the sensor information from the plurality of open / close detection sensors via the one or more communication devices and the external network. The mailing notification system according to claim 1.

10. The system further includes a mail item determination unit that determines the type of mail item based on the video of the mail item detected by the mail item detection unit from the aforementioned video information. The video of the mailed item is extracted from the video information based on the detection timing. The notification unit notifies the mailing information, including the determination result of the mailing determination unit. The mailing notification system according to claim 1.

11. The system further includes a mail item determination unit that determines the type of mail item based on the video footage of the clothing of the mailer who performed the mailing, as detected by the mailing detection unit, from the aforementioned video information. The video of the clothing of the person who mailed the item is extracted from the video information based on the detection timing. The notification unit notifies the mailing information, including the determination result of the mailing determination unit. The mailing notification system according to claim 1.

12. If the mail item determination unit determines that the type of mail item is a flyer, the notification unit will not perform the notification of the mail item information. The mailing notification system according to claim 10 or 11.

13. If the mail detection unit determines that, on a day other than the first three days of the New Year, a certain number of the multiple open / close detection sensors have detected the opening or closing of the door within a certain period of time, the mail item determination unit determines that the type of mail item is a flyer. The mailing notification system according to claim 10 or 11.

14. The mail item determination unit determines that the mail item is a flyer if, in the video, the mail item does not contain at least a postal code, recipient's name, and address. The mailing notification system according to claim 10 or 11.

15. If the mail item determination unit determines that the mail item is a flyer, the notification unit will issue a warning to the person who made the mailing via an output device that performs at least one of sound output and video output. The mailing notification system according to claim 10 or 11.

16. The mail item determination unit determines the type of mail item to be a flyer if the determination result by the address determination unit indicates that the address is not registered. The mailing notification system according to claim 10 or 11.

17. If the mailing detection unit determines that the mailing is a flyer due to the recipient not being registered, and if mailing is detected in another mailbox within a certain period of time including the time when the mailing of the flyer was detected, it will also determine that the mailing is a flyer. The mailing notification system according to claim 16.

18. The system comprises multiple video acquisition units, each acquiring multiple video information acquired by multiple imaging devices installed in a position capable of photographing the exterior of the collective mailbox, Multiple imaging devices are arranged to compensate for blind spots with respect to the collective post box and / or blind spots caused by the presence of the person making the mail, The specified information is extracted from at least one of the multiple video information based on the detection timing. The mailing notification system according to claim 1.

19. A video acquisition unit that acquires video information obtained by an imaging device installed in a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes, A sensor information acquisition unit that acquires sensor information relating to the detection results of a plurality of detection sensors arranged in the plurality of posts and each detecting the weight or movement of an object within the plurality of posts, A mailing detection unit that detects mailings into the plurality of mailboxes on a per-mailbox basis based on the sensor information, A destination determination unit determines the destination of the mail based on the detection result of the mailing detection unit, A notification unit that notifies mailing information including the determination result of the destination determination unit and specific information based on the video information, Equipped with, Based on the sensor information, the mail delivery detection unit determines that any of the multiple detection sensors has detected the weight or movement of the object, and then identifies the timing of the object's detection. The aforementioned specific information is information extracted from the video information based on the detection timing. Mailing notification system.

20. A method for sending a notification, which is executed by one or more processors, A video acquisition step involves acquiring video information obtained by an imaging device installed in a position where it can photograph the exterior of a collection of mailboxes including multiple mailboxes, and A sensor information acquisition step involves acquiring sensor information relating to the detection results of multiple open / close detection sensors that detect the opening and closing of the doors of multiple mail slots of the multiple postboxes, respectively. A mailing detection step is performed based on the sensor information, in which mailings are detected for each of the multiple postboxes, A destination determination step, which determines the destination of the mailing based on the detection result of the mailing detection step, A notification step that notifies mailing information including the determination result of the destination determination step and specific information based on the video information, Includes, In the mail delivery detection step, if it is determined that any of the multiple open / close detection sensors has detected the opening or closing of the door based on the sensor information, the timing of the door opening or closing detection is identified. The aforementioned specific information is information extracted from the video information based on the detection timing. Method of notification of mailing.

21. A method for sending a notification, which is executed by one or more processors, A video acquisition step involves acquiring video information obtained by an imaging device installed in a position where it can photograph the exterior of a collection of mailboxes including multiple mailboxes, and Sensor information acquisition step: Acquire sensor information relating to the detection results of a plurality of detection sensors arranged in the plurality of posts and each detecting the weight or movement of an object within the plurality of posts. A mailing detection step is performed based on the sensor information, in which mailings are detected for each of the multiple postboxes, A destination determination step, which determines the destination of the mailing based on the detection result of the mailing detection step, A notification step that notifies mailing information including the determination result of the destination determination step and specific information based on the video information, Includes, In the aforementioned mailing detection step, if it is determined that any of the multiple detection sensors has detected the weight or movement of the object based on the sensor information, the detection timing of the object is identified. The aforementioned specific information is information extracted from the video information based on the detection timing. Method of notification of mailing.

22. A program for causing one or more processors to execute the mailing notification method described in claim 20 or 21.

Images