Mailing notification system, mailing notification method, and program

Abstract

To make it easier to notify recipients of mail being delivered to communal mailboxes. [Solution] The mailing notification system 100 comprises an image acquisition unit 11, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. The image acquisition unit 11 acquires image information obtained by an imaging device 2 installed in a position capable of photographing the appearance of a collection post P1 including multiple posts P10. The mailing detection unit 12 detects mailings for the multiple posts P10 on a per-post-P10 basis based on the image information. The destination determination unit 13 determines the destination of the mailing based on the detection result of the mailing detection unit 12. The notification unit 16 notifies the mailing information, including the determination result of the destination determination unit 13.

Description

Technical Field

[0001] The present disclosure generally relates to a posting notification system, a posting notification method, and a program. More specifically, the present disclosure relates to a posting notification system, a posting notification method, and a program for notifying posting to a post.

Background Art

[0002] Patent Document 1 discloses a postal post and a posting notification system capable of remotely and semi-real-time viewing an image of an object posted and delivered to a post and collectively managing notification destinations from a remote location. According to Patent Document 1, when a postal item (delivery item) is posted to a post, a posting port sensor detects it, and it is photographed with lighting and a camera (a camera with a flash function may also be used) inside the post. The photographed image data is transmitted to a posting notification system on the cloud, and a posting notification is sent to a communication device such as a PC or a smartphone by email or push notification.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, even in a collective post installed in a facility such as an apartment building, a posting notification of a posted item such as a postal item is desired. However, when applying the technology disclosed in Patent Document 1 to a collective post, it is necessary to install a posting port sensor in each of the plurality of posts of the collective post and install lighting and a camera inside each post. Therefore, it is not easy to realize considering the cost of the posting port sensors, lighting, and cameras to be prepared for each post and the labor of the work of installing the posting port sensors, lighting, and cameras in each post.

[0005] This disclosure is made in view of the above circumstances and aims to provide a mailing notification system, mailing notification method, and program that facilitate the notification of mailing to collective mailboxes. [Means for solving the problem]

[0006] A mailing notification system according to one aspect of the present disclosure comprises a video acquisition unit, a mailing detection unit, a destination determination unit, and a notification unit. The video acquisition unit acquires video information obtained by an imaging device installed at a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes. The mailing detection unit detects mailings for the multiple mailboxes on a per-mailbox basis based on the video information. The destination determination unit determines the destination of the mailing based on the detection result of the mailing detection unit. The notification unit notifies the mailing information, including the determination result of the destination determination unit.

[0007] A method for notifying a mailing according to one aspect of the present disclosure is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device installed at a position capable of photographing the appearance of a collection of mailboxes including multiple mailboxes. In the mailing detection step, mailing is detected for each of the multiple mailboxes based on the video information. In the destination determination step, the destination of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step is notified.

[0008] A program relating to one aspect of this disclosure is a program that causes one or more processors to execute the above-described mailing notification method. [Effects of the Invention]

[0009] According to this disclosure, there is an advantage in that it can be made easier to notify recipients of mail being delivered to communal mailboxes. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a block diagram of a mailing notification system and its surrounding components according to one embodiment. [Figure 2] Figure 2 is a schematic external view of a communal mailbox and its surroundings to which the above-mentioned mailing notification system is applied. [Figure 3] Figure 3 is a conceptual diagram of a mailed image in the mailing notification system described above, showing a mailed item being mailed by the mailer after being detected by the mailing detection unit. [Figure 4] Figure 4 is a conceptual diagram illustrating the target image extracted from the same mailed image. [Figure 5] Figure 5 is a sequence diagram illustrating the operation of the mailing notification system described above. [Figure 6] Figure 6 is a block diagram of a modified example 1 of the above-mentioned mailing notification system and its surrounding configuration. [Figure 7] Figure 7 is a schematic external view of a communal post and its surroundings to which the above-mentioned modified example 1 is applied. [Figure 8] Figure 8 is an image based on auxiliary video information from the auxiliary imaging device in the modified example 1 described above, and is a conceptual diagram of the mailer's image in the process of mailing detected by the mailing detection unit. [Figure 9] Figure 9 is a block diagram of a modified example 2 of the above-mentioned mailing notification system and its surrounding configuration. [Figure 10] Figure 10 is a schematic external view of a communal mailbox and its surroundings to which the modified example 3 of the above-mentioned mailing notification system is applied. [Figure 11] Figure 11 is a block diagram of the modified example 3 and its surrounding configuration. [Figure 12] Figure 12 is a conceptual diagram of a communal mailbox viewed from the side, illustrating a modified example 4 of the above-mentioned mailing notification system. [Figure 13] Figure 13 is a conceptual diagram of a collection of mailboxes viewed from the side, illustrating the modified example 4 described above. [Figure 14]FIG. 14 is a conceptual diagram of the collective post as seen from above for explaining Modification Example 4 described above. [Figure 15] FIG. 15 is a conceptual diagram of the posting image based on the video information from the depth camera in Modification Example 4 described above. [Figure 16] FIG. 16 is a conceptual diagram of the posting image based on the video information from the depth camera in Modification Example 4 described above. [Figure 17] FIG. 17 is a conceptual diagram for explaining the detection area set in the video information from the depth camera in Modification Example 4 described above. [Figure 18] FIG. 18 is a schematic external view of the collective post and its surroundings to which Modification Example 5 according to the above-described posting notification system is applied. [Figure 19] FIG. 19 is a conceptual diagram of the posting image based on the first video information from the first imaging device in Modification Example 5 described above. [Figure 20] FIG. 20 is a conceptual diagram of the posting image based on the second video information from the second imaging device in Modification Example 5 described above. [Figure 21] FIG. 21 is a block configuration diagram of Modification Example 5 described above and its surrounding configuration. [Figure 22] FIG. 22 is a block configuration diagram of Modification Example 6 according to the above-described posting notification system and its surrounding configuration. [Figure 23] FIG. 23 is a conceptual diagram for explaining the difference between the image used for detecting the posting and the image for notification in Modification Example 7 according to the above-described posting notification system. [Figure 24] FIG. 24 is a block configuration diagram of Modification Example 9 according to the above-described posting notification system and its surrounding configuration.

MODE FOR CARRYING OUT THE INVENTION

[0011] (Overview) The following describes a mailing notification system, mailing notification method, and program relating to embodiments and modifications, with reference to the drawings. Note that the embodiments and modifications described below are merely one of many embodiments of this disclosure. Furthermore, the embodiments and modifications described below can be modified in various ways depending on the design, etc., as long as the objectives of this disclosure are achieved. Also, the configurations of each of the modifications described below can be appropriately combined with the embodiments or other modifications described below. Furthermore, the figures described in this disclosure are schematic diagrams, and the ratios of the size and thickness of each component in the figures do not necessarily reflect the actual dimensional ratios.

[0012] One embodiment of the mailing notification system 100 (see Figure 1) is applied to a collective mailbox P1 (see Figure 2) installed in a facility 200, and notifies the recipient of mailing information (mailing information) for each of the multiple mailboxes P10 (postboxes) of the collective mailbox P10. Mailings A1 that are mailed to mailboxes P10 may include not only postcards, but also letters, direct mail, flyers, delivery notices, etc.

[0013] Facility 200 is assumed to be, for example, an apartment building containing multiple dwelling units. However, facility 200 is not limited to apartment buildings, as long as it is a facility where a communal mailbox P1 is installed, it may also be a non-residential facility such as a factory, shop, office building, commercial building, hospital, nursing home, school, train station, or airport.

[0014] The recipient of the mailing information notification is assumed to be, for example, the resident (user U1) to whom the mail is delivered. In other words, multiple mailboxes P10 are assigned to multiple dwelling units, and when mail A1 is delivered to a particular mailbox P10, the recipient of the mailing information notification is the resident (user U1) of the dwelling unit to which that mailbox P10 is assigned.

[0015] As described later, the mailing information may be transmitted, for example, to a master unit 33 in the dwelling unit (see Figure 1: room master unit) and notified to user U1. Alternatively, as described later, the mailing information may be transmitted, for example, to an information terminal 6 such as a smartphone owned by user U1 (see Figure 22) and notified to user U1, or to a lobby intercom 31 (see Figure 24) and notified to user U1. However, the recipient of the mailing information notification is not limited to the mailing address. The recipient of the mailing information notification may be the administrator of the facility 200 (in the case of an apartment building, the building manager). The mailing information may also be transmitted to a master unit 33 installed in the manager's office. Furthermore, the mailing information may be transmitted to an external server operated by the management company of the facility 200.

[0016] Here, the mailing notification system 100, as shown in Figure 1, comprises a video acquisition unit 11, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. The video acquisition unit 11 acquires video information obtained by an imaging device 2 (see Figures 1 and 2) installed in a position capable of photographing the exterior of a collection post P1 including multiple posts P10. The mailing detection unit 12 detects mailings for each of the multiple posts P10 based on the video information. The destination determination unit 13 determines the destination of the mailing based on the detection results of the mailing detection unit 12. The notification unit 16 notifies the mailing information, including the determination result of the destination determination unit 13.

[0017] According to the configuration of the mailing notification system 100 in the above-described embodiment, mailing is detected based on video information acquired by an imaging device 2 installed in a position capable of photographing the exterior of the collective mailbox P1. Based on the mailing detection result, the destination of the mailing is determined, and the mailing information is notified. Therefore, there is no need to install a mailing slot sensor, lighting (device), and camera at each of the multiple mailboxes P10, which reduces costs related to mailing slot sensors, lighting, and cameras, as well as the effort involved in installing them at each mailbox P10. As a result, it becomes easier to notify the collective mailbox P1 of mailings.

[0018] In the following explanation, "image (information)" may refer to video information, still image information, or individual frames of a stop-motion sequence. Furthermore, while the various "images" in the following explanation are primarily assumed to be still images, they are not limited to still images and may also refer to video or individual frames of a stop-motion sequence.

[0019] Another method for notifying mail delivery, according to one embodiment, is a method for notifying mail delivery executed by one or more processors. The mail delivery notification method includes a video acquisition step, a mail delivery detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device 2 installed in a position capable of photographing the appearance of a collection post P1 including multiple posts P10. In the mail delivery detection step, mail delivery is detected for each of the multiple posts P10 based on the video information. In the destination determination step, the destination of the mail is determined based on the detection result of the mail delivery detection step. In the notification step, mail delivery information including the determination result of the destination determination step is notified.

[0020] The above mailing notification method is used on a computer system (mailing notification system 100). In other words, the above mailing notification method can also be implemented as a computer program. A program according to one embodiment is a program that causes one or more processors to execute the above mailing notification method. The program may be recorded on a computer-readable non-temporary recording medium. A computer program product according to one embodiment includes a computer program that, when executed by one or more processors, realizes the steps of the above mailing notification method.

[0021] In the following, it is assumed that the mail delivery notification system 100 is provided by the control device 1 (see Figure 1). In other words, as an example, it is assumed that all the functions of the mail delivery notification system 100 are implemented within the control device 1. The control device 1 may be installed, for example, in the lobby (common entrance) of the facility 200 or in its vicinity.

[0022] (1) Overall structure The following describes in detail the entire system, including the mailing notification system 100 and its peripheral configuration according to this embodiment, with reference to Figure 1. As mentioned above, as an example, the mailing notification system 100 (control device 1) is applied to a communal mailbox P1 installed in a facility 200 which is an apartment building, and notifies the resident (user U1), who is the recipient of the mail, of the mailing to the communal mailbox P1.

[0023] The communal mailbox P1 may be installed in or near the lobby (common entrance) of facility 200. The communal mailbox P1 includes multiple rectangular box-shaped posts P10 (in the example in Figure 2, there are six posts P10 arranged in 2 columns x 3 rows). The dimensions of the communal mailbox P1 are not particularly limited, nor is the number of posts P10.

[0024] In the following, when the six post boxes P10 are described in a way that distinguishes them from one another, they will be referred to as post boxes P11, P12, P13, P14, P15, and P16. When they are not distinguished from one another, they will simply be referred to as post box P10. Also, in the following, as shown in Figure 2, the example of when mail item A1 (postcards or other mail, or flyers, etc.) is deposited into post box P16, the bottom post box in the right column, will be used for explanation.

[0025] Each post box P10 has a slot Q1 on its front for a mail carrier or flyer distributor B1 (see Figure 2) to insert mail A1. The slot Q1 is a long, slit-shaped opening in the left-right direction. In addition, each post box P10 has a plate S1 on its front that is printed with the corresponding dwelling unit number. For example, if mail is deposited into post box P10 with plate S1 for dwelling unit number "101", the recipient of the mail is the resident (user U1) living in dwelling unit 101.

[0026] Although not shown in Figure 2, etc., each post P10 has a retrieval opening on its front for user U1 to take out mail A1, and a door that can be opened and closed (for example, a front-opening retrieval door). The retrieval door is equipped with a dial lock, for example. By turning the dial knob on the front of the retrieval door left and right to match a specific number, the dial lock is unlocked and the retrieval door can be opened and closed. User U1 unlocks the dial lock, grasps the knob, opens the retrieval door towards them, and takes out mail A1 from inside their post P10 through the retrieval opening. Thus, each post P10 is, as an example, a so-called "front-loading, front-retrieval" type post. However, this is not limited to this, and each post P10 may also be a so-called "front-loading, rear-retrieval" type post. In addition, each post P10 may have separate mail slots Q1 and retrieval openings, or it may have a mail slot Q1 that also serves as the retrieval opening.

[0027] The control device 1 is connected to the imaging device 2, for example, via a wired connection. Communication between the control device 1 and the imaging device 2 is not limited to a wired connection and may be wireless. In this embodiment, it is assumed that there is one imaging device 2, but as will be described later, there may be multiple imaging devices 2. The imaging device 2 is installed on the ceiling surface C1 of the facility 200, as shown in Figure 2. The imaging device 2 may also be installed on the collective post P1 (for example, on the top surface of the collective post P1). The imaging device 2 is installed in a position that can photograph the exterior of the collective post P1, which includes multiple posts P10. Here, the imaging device 2 is installed so that the mail slots Q1 of all posts P10 of the collective post P1 are included in the image. As long as the mail slots Q1 of all posts P10 are included in the image, the installation position, imaging range, and field of view of the imaging device 2 are not particularly limited. In the examples shown in Figures 2 and 3, the imaging device 2 is installed approximately directly above the collection post P1 so that, for example, the front surfaces of all the posts P10 (the sides with the mail slot Q1) are included in the image. In this embodiment, the imaging device 2 is assumed to be either a color camera or a monochrome camera.

[0028] The imaging device 2, for example, continuously images the collective post box P1 and transmits the image (image information) to the control device 1. As will be described in detail later, the mailing notification system 100 (control device 1) uses the image information received from the imaging device 2 to perform various processes for detecting mailings, determining the mailing destination, and notifying the mailing information.

[0029] Furthermore, as shown in Figure 1, the control device 1 is connected to the intercom system 3 installed in the facility 200, for example, via a wired connection. Communication between the control device 1 and the intercom system 3 is not limited to wired connections; it may also be wireless.

[0030] The intercom system 3 comprises a lobby intercom 31 located in the lobby of the facility 200, and multiple master units 33 (room master units) installed in various locations such as individual dwelling units and the caretaker's office. For convenience, only one master unit 33 is shown in Figure 1. The intercom system 3 also includes a control device 32 connected to the lobby intercom 31 via a first main line. The control device 32 is connected to the multiple master units 33 via a second main line and multiple branch lines branching from the second main line. The control device 32 controls communication between the lobby intercom 31 and each master unit 33.

[0031] In the example shown in Figure 1, the control device 1 is connected to the lobby intercom 31. In this embodiment, it is assumed that the mail delivery information from the mail delivery notification system 100 is transmitted to the lobby intercom 31 and, via the control device 32, is notified to the user U1 from the master unit 33 in the corresponding dwelling unit. The mail delivery information is notified by a screen display from the display unit (e.g., liquid crystal display) of the master unit 33. Alternatively, the mail delivery information may be notified by sound output from the speaker of the master unit 33 (e.g., output of electronic sound or synthesized voice message) instead of (or in addition to) a screen display.

[0032] In this embodiment, the imaging device 2 and the intercom system 3 are not included as components of the mail delivery notification system 100, but they may be included as components of the mail delivery notification system 100. In other words, the mail delivery notification system 100 may include the imaging device 2. Also, the mail delivery notification system 100 may include at least a part of the intercom system 3.

[0033] (2) Configuration of the control device As shown in Figure 1, the control device 1 (mailing notification system 100) includes an image acquisition unit 11, a mailing detection unit 12, a destination determination unit 13, and a notification unit 16. Furthermore, as shown in Figure 1, the control device 1 (mailing notification system 100) also includes a mailing object determination unit 14, an image cropping processing unit 15, a detection area storage unit 17, and a cropping setting storage unit 18.

[0034] The control device 1 (mailing notification system 100) includes a computer system having one or more processors and memory. At least some of the functions of the control device 1 (image acquisition unit 11, mailing detection unit 12, destination determination unit 13, mailing item determination unit 14, image cropping processing unit 15, notification unit 16, etc.) are realized by the computer system's processor executing a program recorded in the computer system's memory. The program may be recorded in memory, provided via a telecommunications line such as the Internet, or provided on a non-temporary recording medium such as a memory card.

[0035] Each of the detection area storage unit 17 and the extraction setting storage unit 18 includes an electrically rewritable non-volatile semiconductor memory such as flash memory. The detection area storage unit 17 and the extraction setting storage unit 18 may be implemented by the same single semiconductor memory. The detection area storage unit 17 stores detection area setting information in advance. The extraction setting storage unit 18 stores extraction setting information for the region to be extracted from the image in advance.

[0036] The video acquisition unit 11 executes video acquisition processing and acquires video information acquired by the imaging device 2. The video acquisition unit 11 acquires (receives) video information from the imaging device 2 via the communication interface of the control device 1. The video acquisition unit 11 outputs the video information to the mailing detection unit 12. The mailing notification system 100 includes a storage unit for storing (reserving) video information, and the video acquisition unit 11 may store the acquired video information in the storage unit as history information.

[0037] The mailing detection unit 12 performs mailing detection processing and, based on the video information acquired by the video acquisition unit 11, detects mailings to multiple post boxes P10 on a per-post-box basis. In other words, the mailing detection unit 12 can detect mailings regardless of which of the multiple post boxes P10 the mailing is made to.

[0038] The mailing detection process will be explained in detail below with reference to Figure 3. Figure 3 shows an example of a mailing image IM1 that may be included in the video information. The mailing image IM1 is an image showing the mailing process being carried out by mailing person B1, as detected by the mailing detection unit 12.

[0039] In addition, in images such as the mailing image IM1 in Figure 3, the image regions corresponding to real-world elements have the code "X" appended to the end of the code assigned to the real-world element. For example, for the hand B2 of the mailing person B1 and the mailed item A1 shown in Figure 2, the image regions corresponding to the hand B2 and mailed item A1 in the mailing image IM1 in Figure 3 are assigned the codes B2X and A1X, respectively. Similarly, for the collective postbox P1, postbox P10, and mail slot Q1 shown in Figure 2, the image regions corresponding to the collective postbox P1, postbox P10, and mail slot Q1 in the mailing image IM1 in Figure 3 are assigned the codes P1X, P10X, and Q1X, respectively.

[0040] The mailing image IM1 is an image taken from approximately directly above the collective post P1, with a field of view that includes the front of all six posts P10 of the collective post P1, and includes the image area P10X of the six posts P10. In other words, the mailing image IM1 includes the image area Q1X of the six mailing slots Q1 of the six posts P10.

[0041] In this embodiment, multiple detection areas D0 (here, as an example, six detection areas D0 corresponding to the number of posts P10) are pre-set on the video information. In Figure 3, for clarity, the six detection areas D0 are illustrated with dashed lines on the postage image IM1, but the actual postage image IM1 does not contain dashed lines.

[0042] In the following description of the six detection areas D0, the three detection areas D0 in the left column will be referred to as detection areas D1 to D3 from top to bottom, and the three detection areas D0 in the right column will be referred to as detection areas D4 to D6 from top to bottom. The six detection areas D1 to D6 are set to correspond one-to-one with posts P11 to P16. It is preferable that each of the multiple detection areas D0 is set in the image area Q1X of the mail slot Q1 of the corresponding post P10 in the video, or in the surrounding area of ​​image area Q1X. In the example in Figure 3, each of the multiple detection areas D0 is set as a long rectangular area of ​​the same shape and dimensions as the image area Q1X of the mail slot Q1, near the bottom of the image area Q1X of the corresponding mail slot Q1 in the video.

[0043] The settings for the multiple detection areas D0 may change as appropriate depending on the collective mailbox P1 actually installed in facility 200. In other words, the location, shape, dimensions, and number of the multiple detection areas D0 may change as appropriate depending on, for example, the location, shape, dimensions of the mail slot Q1 and the number of mailboxes P10. Therefore, when introducing the mailing notification system 100 to facility 200, the system configurator will configure the location, shape, dimensions, and number of the multiple detection areas D0 while checking the video information acquired by the video acquisition unit 11 on a configuration screen or the like. The system configurator will also configure which recipient's (user U1) mailbox P10 each of the multiple detection areas D0 corresponds to (for example, which dwelling unit number each corresponds to). In other words, the system configurator will configure information such as, for example, that the six detection areas D1 to D6 correspond to dwelling unit numbers "101" to "106".

[0044] The detection area setting information for multiple detection areas D0, configured by the system administrator, is stored in the detection area storage unit 17.

[0045] In other words, the video information includes video of multiple mail slots Q1 of multiple post boxes P10. Multiple detection areas D0 are pre-configured in the video information for each of the multiple mail slots Q1. The mailing notification system 100 then detects mailings in the mailing detection unit 12 based on changes in the multiple detection areas D0 in the video information.

[0046] In other words, in the mailing detection process, if there is a change (in the video) within any of the multiple detection areas D0, it is determined that mailing has occurred at the post P10 corresponding to that detection area D0, i.e., mailing has been detected. The right side of Figure 3 shows an enlarged view of the detection area D0 when mailing has not yet been delivered (typically detection area D4) and the detection area D6 when mailing has been delivered. In the example of mailing image IM1, since mailing item A1 is in the process of being delivered to post P16, a part of the image area A1X of mailing item A1 is present within the detection area D6 corresponding to post P16. In other words, as can be seen by comparing it with the detection area D0 when mailing has not yet been delivered (detection area D4), a change (in the video) has occurred in the detection area D6 when mailing has been delivered.

[0047] The mailing detection unit 12 monitors video information to see if there is a change in any of the multiple detection areas D0 that have been set in advance. If a change is detected in any of the detection areas D0, it determines that a mailing has occurred at the post P10 corresponding to that detection area D0.

[0048] Incidentally, due to the structure of post P10, such as the fact that the mail slot Q1 and the retrieval opening are the same, or due to the positional relationship between the mail slot Q1, the retrieval opening and the detection area D0, when user U1 retrieves mail A1, a change may occur within the corresponding detection area D0, potentially leading to a false detection that mail has been deposited in post P10 corresponding to that detection area D0.

[0049] Therefore, it is preferable that the mailing detection unit 12 does not immediately determine that mailing has occurred when there is a change in any of the multiple detection areas D0, but rather has a function (mailing / removal determination function) to determine whether the change occurred when mailing item A1 was deposited or when mailing item A1 was removed. In other words, the mailing detection unit 12 performs image analysis to determine whether the change (time change) in the corresponding detection area D0 is a first image change indicating that mailing item A1 is moving into the post P10, or a second image change indicating that mailing item A1 is moving out of the post P10. If the change in the detection area D0 is a first image change, the mailing detection unit 12 determines that the change occurred when mailing item A1 was deposited, and if it is a second image change, it determines that the change occurred when mailing item A1 was removed.

[0050] Furthermore, if the mail detection unit 12 determines that the change in detection area D0 occurred when mail item A1 was retrieved, the notification unit 16 will not send a notification of mail information.

[0051] By providing this mail entry / exit detection function, it is possible to reduce the possibility of a false detection of mail entry, where, even though user U1 actually retrieved mail A1, a change in detection area D0 is detected at that time, leading to the false detection that mail A1 has been deposited. Furthermore, if it is determined that the change in detection area D0 occurred when mail A1 was retrieved, the mail entry notification will not be executed, thus reducing the possibility of unnecessary mail entry notifications being sent to user U1.

[0052] The mailing detection unit 12 outputs a message to the destination determination unit 13 indicating that mailing has been detected (that mailing has occurred). The mailing detection unit 12 also extracts a mailing image IM1 (for example, a still image) from the video information, which is the basis for the determination that mailing has occurred (while mailing is being performed by mailer B1), and outputs the information of the extracted mailing image IM1 to the destination determination unit 13.

[0053] The destination determination unit 13 determines the destination of the mail (user U1) based on the detection result of the mailing detection unit 12. For example, when the destination determination unit 13 receives notification of mailing detection from the mailing detection unit 12, it refers to the detection area setting information and determines (identifies) the destination of the post P10 associated with the changed detection area D0 (for example, the dwelling unit number of user U1) based on the mailing image IM1 which is the basis for the determination that mailing has occurred. In other words, the mailing notification system 100 determines the destination (user U1) in the destination determination unit 13 based on changes in multiple detection areas D0 in the video information. Note that the information determined by the destination determination unit 13 is not limited to the dwelling unit number, but can be any information that can identify user U1, such as user U1's name information, user U1's unique ID information, or user U1's email address. User U1's name information, ID information, and email address information can be pre-registered with the mail delivery notification system 100, linked to User U1's dwelling number, via the control unit 33 (room control unit) in each user U1's dwelling unit, the control unit 33 in the manager's office, or the lobby intercom 31.

[0054] The destination determination unit 13 outputs information regarding the destination determination result (e.g., dwelling unit number) and information regarding the mailed image IM1 to the notification unit 16. The destination determination unit 13 also outputs information regarding the mailed image IM1 to the mailed item determination unit 14.

[0055] The mail item determination unit 14 determines the type of mail item A1 based on the video information of the mail item A1 detected by the mail item detection unit 12. In this embodiment, the mail item determination unit 14 determines the type of mail item A1 (by image) based on information such as the image region A1X of mail item A1 contained in the mail image IM1 received from the destination determination unit 13.

[0056] In this embodiment, as an example, the mail item determination unit 14 determines whether mail item A1 is a "flyer" or "not a flyer." If mail item A1 is a flyer, it is unlikely that user U1 will need to check it immediately, and it is highly likely that they will simply discard it after retrieving it from post P10. In short, it is assumed that the importance of flyers to user U1 is lower than that of postcard or other mail. Therefore, when notifying the mail item of delivery, the subsequent processing in the mail item notification system 100 branches depending on whether mail item A1 is a "flyer" or "not a flyer." For example, as described later, if mail item A1 is a "flyer," the mail item notification system 100 does not notify user U1 of the delivery. Furthermore, it is preferable that the mail item determination unit 14 determines whether mail item A1, which has been determined to be "not a flyer," is a postcard, letter, direct mail, or delivery notice.

[0057] To explain in more detail, for example, the mail item determination unit 14 determines that mail item A1 is a flyer if, in the video, mail item A1 does not contain at least part of the postal code, recipient's name, and address. Normally, when a postal worker puts mail (mail item A1) into the mailbox P10, it is highly likely that they will put it in with the side containing the postal code, recipient's name, and address facing upwards. Therefore, if mail item A1 is not a flyer, the image area A1X of mail item A1 contained in the mail item image IM1 may contain at least part of the postal code, recipient's name, and address. Conversely, if it is a flyer, it does not contain a postal code, recipient's name, or address at all, so it is highly likely that the image area A1X of mail item A1 contained in the mail item image IM1 will not contain at least part of the postal code, recipient's name, and address.

[0058] The mail item determination unit 14 performs image analysis on the mailed image IM1 and identifies the image area A1X of the entire mailed item A1 within the mailed image IM1 from the region where there was a change in the detection area D0 (detection area D6 in Figure 3) on which the mailing was detected. The mail item determination unit 14 then analyzes the words that appear in the entire image area A1X. If the analyzed words correspond to at least part of the postal code, recipient's name, and address, the mail item determination unit 14 outputs the result "not a flyer" as the type of mailed item A1 to the notification unit 16. On the other hand, if the analyzed words are not even at least part of the postal code, recipient's name, and address, the mail item determination unit 14 outputs the result "flyer" as the type of mailed item A1 to the notification unit 16. Alternatively, the mailing notification system 100 may include a memory unit that pre-stores dictionary information containing specific words (such as "open," "sale," "campaign," "renovation," "buyback," and "bargain") that are unlikely to be found on mailings other than flyers. The mailing determination unit 14 may refer to the dictionary information and, if a word matching the analyzed word exists in the dictionary information, output the result "flyer" to the notification unit 16.

[0059] If the mailed item determination unit 14 determines that mailed item A1 is "not a flyer," it may determine whether it is a postcard, letter, direct mail, or delivery notice based on the shape and size of the entire image area A1X of mailed item A1 within the mailed image IM1.

[0060] The mail item determination unit 14 may perform image determination of the type of mail item A1 using, for example, a pre-trained model that has been machine-learned using training data. For example, the training data may be data that associates images of various expected mail items A1 with labels of their type (postcards, letters, flyers, direct mail, and delivery notices, etc.).

[0061] Furthermore, the mail item determination unit 14 may determine the type of mail item A1 based on the video information of the clothing of the mailer B1 who performed the mailing, as detected by the mailing detection unit 12. For example, if the mail item determination unit 14 determines that the clothing of mailer B1 included in the mailing image IM1 is that of a postal worker based on its color or pattern, it outputs the result "not a flyer" to the notification unit 16. If the mail item determination unit 14 determines that the clothing of mailer B1 included in the mailing image IM1 is not that of a postal worker based on its color or pattern, it outputs the result "flyer" to the notification unit 16. Note that the clothing determination may also be performed using a pre-trained model that has been machine-learned using training data, for example.

[0062] Depending on the position, imaging range, or field of view of the imaging device 2, the image IM1 may only show up to the hand B2 of the mail sender B1, and the image of the mail sender B1's clothing may not be included in the image IM1. In such cases, the mail item determination unit 14 may use video information (auxiliary video information) from the auxiliary imaging device 2A (see Figures 6 and 7) described in Modification 1 below to determine the clothing.

[0063] Both word-based and clothing-based judgments may be applied. However, the judgment results may differ between word-based and clothing-based judgments. That is, one judgment may result in "flyer," while the other judgment may result in "not a flyer." If the judgment results differ, it is preferable for the mailed item judgment unit 14 to output the result "not a flyer" to the notification unit 16 for the user U1 to confirm. Alternatively, a priority judgment may be set in advance for word-based and clothing-based judgments, and if the judgment results differ, the mailed item judgment unit 14 may apply the result of the priority judgment.

[0064] Furthermore, if the mail detection unit 12 detects that mail has been mailed to the collective post box P1 more than a predetermined number of times within a certain period of time, the mail item determination unit 14 may also determine the type of mail item A1 to be a flyer. In addition, it is preferable that the mail item determination unit 14 determines the type of mail item A1 to be a flyer when it detects that mail has been mailed more than a predetermined number of times within a certain period of time on days other than the first three days of the New Year. When the mail item determination unit 14 receives notification from the mail detection unit 12 that a mailing has been detected for the first time, it starts timing for a certain period of time (for example, a few seconds) and suspends the determination of the type of mail item A1. Then, if the mail detection unit 12 detects mailings to multiple post boxes P10 more than a predetermined number of times (for example, 6 times, the same as the total number of post boxes P10) including the first mailing within that certain period of time, the mail item determination unit 14 outputs the result "flyer" to the notification unit 16 for all of the mailings in that series. The mail item determination unit 14, if the mail item detection unit 12 detects mailings less than a predetermined number of times, including the first mailing, within a certain period of time, individually determines the type of mail item A1 for each mailing. Furthermore, as mentioned above, by setting the condition that mailings are excluded from the first three days of the New Year, the possibility of misidentifying consecutive mailings of New Year's cards as consecutive mailings of flyers can be reduced.

[0065] Once the mail item determination unit 14 has finished determining the type of mail item A1, it outputs information regarding the determination result to the image extraction processing unit 15 and the notification unit 16.

[0066] The image extraction processing unit 15 extracts a target image IM2 (see Figure 4) from the video information, specifically from the postage image IM1, which shows the postage being detected by the postage detection unit 12 and being carried out by the poster B1, and limits the area to the vicinity of the post P10 in which the postage is being carried out among multiple post P10s.

[0067] As shown in Figure 3, the postage image IM1 includes the image area P10X of all six posts P10. As shown in Figure 4, the image cropping processing unit 15 crops (extracts) a target image IM2 from the postage image IM1, which includes only the area around the post P10 where the postage occurred (post P16 in the example of Figure 3). The postage image IM1 could be notified to the user U1 as is, but notifying the user U1 of the target image IM2 makes the actually posted item A1 more visible in the image, thus improving convenience.

[0068] For example, when introducing the mailing notification system 100, the system administrator sets multiple limited areas that correspond one-to-one with multiple detection areas D0, while checking the video information acquired by the video acquisition unit 11 on a setting screen or the like. Each of the multiple limited areas includes the image area P10X of multiple posts P10. For example, as shown by the dashed box on the mailing image IM1 in Figure 4, the limited area corresponding to detection area D6 (see Figure 3) includes the image area P16X of post P16.

[0069] Multiple limited areas set by the system administrator are stored in the cropping setting storage unit 18 as cropping setting information. In the cropping setting information, for example, detection area D1 (see Figure 3) is associated with a limited area that includes the image area P10X of post P11, among the image areas P10X of the six post P10s.

[0070] In the example shown in Figure 4, the image cropping processing unit 15, in accordance with the determination result of the mail item determination unit 14, refers to the cropping setting information and extracts a target image IM2 limited to a restricted range that includes the image area P16X of the post P16 associated with the detection area D6 where the mail item was detected. The image cropping processing unit 15 then adjusts the target image IM2 to an enlarged image. Note that if the determination result of the mail item determination unit 14 is "flyer", the image cropping processing unit 15 does not need to perform the process of extracting the target image IM2.

[0071] The image cropping processing unit 15 outputs information about the target image IM2, which has been adjusted to an enlarged image, to the notification unit 16.

[0072] The notification unit 16 generates mailing information including the determination result of the destination determination unit 13 (e.g., dwelling unit number, etc.) and notifies the user U1. The notification unit 16 also notifies the mailing information including the mailing image IM1 from the video information, which shows the mailing detected by the mailing detection unit 12 being carried out by the mailer B1. In other words, the notification unit 16 generates mailing information including the determination result of the destination determination unit 13 and the mailing image IM1, which was the basis for the determination that mailing was detected by the mailing detection unit 12, and notifies the user U1. The notification unit 16 may also notify the mailing information including the target image IM2. That is, the notification unit 16 may notify the mailing information including the target image IM2 in addition to the mailing image IM1, or instead of the mailing image IM1.

[0073] Furthermore, the notification unit 16 notifies the mailing information, including the determination result of the mailing item determination unit 14. For example, if the mailing item determination unit 14 determines that mailing item A1 is a postcard, the notification unit 16 notifies the mailing information, including the information that it is a postcard.

[0074] The mailing notification system 100 (control device 1) preferably includes a storage unit for storing mailing information. The notification unit 16 may store the generated mailing information as history information in the storage unit of the mailing notification system 100.

[0075] The notification unit 16 has the function of communicating with the intercom system 3 in the facility 200 where the collective mailbox P1 is installed. The notification unit 16 notifies the destination (user U1) determined by the destination determination unit 13 via the intercom system 3. The mailing information may include information such as the dwelling unit number as the destination determined by the destination determination unit 13. The intercom system 3, in accordance with the command from the notification unit 16, transmits to user U1 based on the dwelling unit number information in the mailing information. Specifically, in this embodiment, the control device 1 is connected to the lobby intercom 31, and the notification unit 16 first transmits the mailing information to the lobby intercom 31. When the lobby intercom 31 receives the mailing information, it forwards it to the control device 32. The control device 32 transmits the mailing information to the master unit 33 corresponding to the dwelling unit number in the mailing information via the first main line, second main line, and branch line of the intercom system 3.

[0076] The master unit 33 notifies the resident of the dwelling (user U1) that it has received mailing information by displaying it on the display unit of the master unit 33 and / or by outputting sound from the speaker of the master unit 33. User U1, upon learning that mailing information has been received, can operate the master unit 33 to check the mailing image IM1 and target image IM2 on the display unit screen of the master unit 33, and to check the type of mailing A1 (the result of the mailing item determination unit 14). It is preferable for the master unit 33 to store the received mailing information as history information in its own memory unit.

[0077] In this way, user U1 can, while inside their dwelling, be notified via the master unit 33 inside the dwelling that mail A1 has been delivered to their mailbox P10, and can also see a picture of mail A1.

[0078] By the way, in this embodiment, if the mail item determination unit 14 determines that the mail item A1 is a flyer, the notification unit 16 does not perform notification of mail item information. In other words, even if the mail item detection unit 12 detects mail item delivery, if the mail item determination unit 14 determines that the mail item A1 is a flyer, the mail item information will not be notified to the user U1. For example, if the mail item A1 is determined to be a flyer, the notification unit 16 does not even send the mail item information to the lobby intercom 31. Alternatively, the notification unit 16 may send the mail item information to the intercom system 3, but without notifying the user U1 of the mail item information via the master unit 33, it may simply store it in the storage unit of the master unit 33.

[0079] Furthermore, if the type of mailed item A1 is determined to be a flyer, the notification unit 16 may store the mailing information as history information in the storage unit of the mailing notification system 100 (control device 1) without notifying the user U1 of the mailing information.

[0080] Furthermore, if the type of mailed item A1 is determined to be a flyer, the notification unit 16 may notify the facility manager of the mailed item information by transmitting it to the master unit 33 in the manager's room of the facility 200 via the intercom system 3, even if it does not notify the user U1. Alternatively, if the control device 1 can communicate with the outside of the facility 200 via an external network such as the Internet, the notification unit 16 may notify the mailed item information to an external server operated by the facility management company of the facility 200 if the type of mailed item A1 is determined to be a flyer.

[0081] Furthermore, even if the mail item determination unit 14 determines that mail item A1 is a flyer, the notification unit 16 may still perform the mail item notification. In addition, the user U1 may set whether or not to notify mail item information in the case of a flyer (enable / disable flyer notification) via the operation panel of the master unit 33 or the like.

[0082] (3) Settings function The mailing notification system 100 includes a setting unit. The setting unit performs various settings based on external input. The mailing notification system 100 also includes an operation unit as a user interface. The operation unit includes, for example, one or more of the following: a mouse, a keyboard, and a pointing device. The mailing notification system 100 also includes a display unit (display device) as a user interface. The display unit displays, for example, information related to the settings of the setting unit on the screen. If the display unit is a touch panel display, the display device may also function as the operation unit.

[0083] For example, the mailing notification system 100 may include a setting terminal such as a laptop computer or tablet device having the functions of a setting unit, operation unit, and display unit as described above. The setting terminal may be connected to the control device 1 to allow various types of information to be set. For example, the system configurator can set the detection area setting information and cropping setting information described above by operating the operation unit while viewing the video information from the imaging device 2 on the display screen of the setting terminal.

[0084] (4) Operation of the mailing notification system The following describes the sequence of operations in the mailing notification system 100 with reference to Figure 5. The sequence diagram shown in Figure 5 is merely one example of the operation flow in the mailing notification system 100, and the order of operations may be changed as appropriate, or operations may be added or omitted as appropriate.

[0085] First, the imaging device 2 takes a picture of the exterior of the collective post box P1 where mail may be deposited (Step ST1: Mail Deposit), and transmits the video information to the mail deposit notification system 100 (control device 1) as needed (Step ST2: Video Transmission).

[0086] The mailing notification system 100 acquires video information acquired by the imaging device 2 (video acquisition process). Based on the acquired video information, the mailing notification system 100 performs mailing detection processing as needed (step ST3), and when it detects mailing (occurrence), it performs destination determination processing to determine the destination of the mailing (step ST4). Subsequently, the mailing notification system 100 performs mailing item determination processing to determine the type of mailing item A1 that has been mailed (step ST5), and also performs image cropping processing to extract and enlarge the target image IM2 from the mailing image IM1 (step ST6).

[0087] The mailing notification system 100 executes a notification process based on the processing results of the mailing detection process, destination determination process, mailing item determination process, and image extraction process to generate mailing information including the destination (house number), the determination result of the type of mailing item A1, and the target image IM2 (step ST7). The mailing notification system 100 transmits the mailing information to the intercom system 3 (step ST8: image and destination transmission).

[0088] When the intercom system 3 receives mailing information (step ST9), it notifies the user U1 of the target image IM2 via the display screen of the master unit 33, which corresponds to the recipient's dwelling unit number, based on a command from the mailing notification system 100 (step ST10: image).

[0089] (5) Advantages As described above, according to the mailing notification system 100 of this embodiment, mailing is detected based on video information acquired by an imaging device 2 installed in a position capable of photographing the exterior of the collective mailbox P1, and the destination of the mailing is determined based on the mailing detection result, and the mailing information is notified. Therefore, there is no need to install a mailing slot sensor, lighting (device), and camera in each of the multiple mailboxes P10, and the costs related to mailing slot sensors, lighting, and cameras, as well as the effort involved in installing mailing slot sensors, lighting, and cameras in each mailbox P10, are reduced. As a result, it becomes easier to notify mailings to the collective mailbox P1.

[0090] Furthermore, the mailing notification system 100 according to this embodiment notifies mailing information in cooperation with the intercom system 3 installed in the facility 200. Therefore, since the master unit 33 can be identified using the dwelling unit number of the facility 200 as the destination for mailing A1, it is easier to notify mailings to the communal mailbox P1.

[0091] Furthermore, the mailing notification system 100 according to this embodiment detects mailings and determines the destination based on changes in multiple detection areas D0 that are pre-set for multiple mailing slots Q1 on the video. As a result, the accuracy of mailing detection and destination determination is improved. In particular, the mailing notification system 100 only needs to be able to set multiple detection areas D0 for multiple mailing slots Q1 on the video, and is less subject to limitations on the installation position, imaging range, and field of view of the imaging device 2.

[0092] (6) Variant The following lists modifications of the above embodiment. In the description of the following modifications, elements similar to those in the above embodiment may be given the same reference numerals and their descriptions may be omitted as appropriate.

[0093] (6.1) Variation 1 The following description of the mailing notification system 100 according to Modification 1 (hereinafter also simply referred to as Modification 1) will be given with reference to Figures 6 to 8.

[0094] Modification 1 acquires not only video information from the imaging device 2, but also video information (auxiliary video information) from the auxiliary imaging device 2A (see Figures 6 and 7). Here, the auxiliary imaging device 2A is not a component of Modification 1, but it may be a component. Modification 1 may further include the auxiliary imaging device 2A.

[0095] Modification 1, as shown in Figure 6, further includes an auxiliary video acquisition unit 11A. The auxiliary video acquisition unit 11A acquires auxiliary video information acquired by an auxiliary imaging device 2A installed in a position capable of photographing the space in front of the collective post P1. The notification unit 16 notifies the mailing information, including the image of the mailing person B1 who performed the mailing, as detected by the mailing detection unit 12 (mailing person image IM3: see Figure 8), from the auxiliary video information.

[0096] The auxiliary imaging device 2A is, for example, a color camera or a monochrome camera. The auxiliary imaging device 2A is installed, for example, on the ceiling surface C1 of the facility 200, similar to the imaging device 2. The auxiliary imaging device 2A may also be installed on the wall surface of the facility 200 or on the collective mailbox P1 (for example, on the top surface of the collective mailbox P1). The installation position, imaging range, and field of view of the auxiliary imaging device 2A are not particularly limited, as long as the image includes, for example, the head, torso, and the hand B2 holding the mailer A1 to some extent. The auxiliary imaging device 2A may be the same type of imaging device as the imaging device 2.

[0097] The auxiliary video acquisition unit 11A acquires (receives) auxiliary video information from the auxiliary imaging device 2A via the communication interface provided in Modification Example 1. The auxiliary video acquisition unit 11A outputs the auxiliary video information to the notification unit 16. Modification Example 1 may include a storage unit for storing (reserving) the auxiliary video information, and the auxiliary video acquisition unit 11A may store the acquired auxiliary video information in the storage unit as history information.

[0098] Figure 8 shows the mailer image IM3, which includes the image region B1X of mailer B1 and the image region B2X of hand B2, extracted from the auxiliary video information acquired by the auxiliary imaging device 2A. Modification example 1 (notification unit 16) obtains the mailer image IM3 by extracting an image from the auxiliary video information acquired by the auxiliary imaging device 2A at the same timing as the acquisition timing (imaging time) of the mailing image IM1, which was the basis for the mailing detection unit 12's determination that mailing had occurred.

[0099] Modified example 1 (notification unit 16) generates mailing information including the target image IM2 and the mailer image IM3, and notifies the user U1 via the master unit 33 of the intercom system 3.

[0100] According to the configuration of Modified Example 1, user U1 can verify the actual mailer B1 through the mailer image IM3. For example, user U1 can determine from the mailer image IM3 whether mailer B1 is a postal worker or someone distributing flyers. This further improves convenience.

[0101] (6.2) Variation 2 The following description of the mailing notification system 100 according to Modification 2 (hereinafter also simply referred to as Modification 2) will be provided with reference to Figure 9.

[0102] In the peripheral configuration of Modification 2, the imaging device 2 is connected to a communication device 4 (see Figure 9). Modification 2 is connected to the communication device 4 via an external network NT1 so as to be able to communicate. The video acquisition unit 11 (see Figure 1) acquires video information from the imaging device 2 via the communication device 4 and the external network NT1. Here, the communication device 4 is not a component of Modification 2, but it may be a component. Modification 2 may further include the communication device 4. The external network NT1 may be a network such as the Internet.

[0103] In Modification 2, the functions of the mailing notification system 100 are implemented on server V1. Server V1 may consist of one or more server devices (one in the example in Figure 9). If server V1 consists of multiple server devices, the multiple server devices may form a cloud (cloud computing).

[0104] Server V1 acquires video information from the imaging device 2 via the communication device 4 and the external network NT1, and performs mail delivery detection processing, destination determination processing, mail item determination processing, image extraction processing, and notification processing. Server V1 transmits the mail delivery information, including the destination (residential number), the determination result of the type of mail item A1, and the target image IM2, generated by the notification processing, to the intercom system 3 of facility 200.

[0105] In the example shown in Figure 9, the server V1 is configured to transmit the mailing information to the lobby intercom 31 via the external network NT1. However, in Modification 2, the transmission path of the mailing information to user U1 is not particularly limited, as long as the server V1 is connected to the external network NT1. For example, the server V1 may send the mailing information back to the communication device 4, and the communication device 4 may then transmit the mailing information to the lobby intercom 31.

[0106] Server V1 may manage mailing notifications for one or more facilities 200 in a single operation. In this case, Server V1 obtains video information from the communication device 4 that includes identification information of the facility 200 where the communication device 4 is installed (for example, the identification information of the communication device 4, or the identification information of the lobby intercom 31 installed in the facility 200). Server V1 sends the mailing information to the recipient of the identification information contained in the video information.

[0107] According to the configuration of the modified example 2, for example, the server V1 on which the functions of the mailing notification system 100 are implemented can be installed and managed outside the facility 200, making it easier to notify the collective post box P1 of mailings.

[0108] (6.3) Modification example 3 The following description of the mailing notification system 100 according to Modification 3 (hereinafter also simply referred to as Modification 3) will be made with reference to Figures 10 and 11.

[0109] As a peripheral configuration of Modification 3, an output device 5 (see Figures 10 and 11) is provided that performs at least one of sound output and video output (screen display). In the example in Figure 10, the output device 5 is provided as a speaker K1 that performs sound output and a display device L1 (such as a digital signage display) that performs video output. However, only one of the speaker K1 or the display device L1 may be provided, or a single device that performs both sound output and video output may be provided. Here, the output device 5 is not a component of Modification 3, but it may be a component. Modification 3 may further include the output device 5.

[0110] Speaker K1 is installed, for example, on the ceiling surface C1 of facility 200. Speaker K1 may also be installed on the wall surface of facility 200 or on the collective post P1 (for example, on the top surface of collective post P1). Display device L1 is installed, for example, on the floor surface near collective post P1. Display device L1 may also be installed on the wall surface of facility 200 or on the collective post P1 (for example, on the top surface of collective post P1).

[0111] In Modification 3, if the mail detection unit 14 determines that mail A1 is a flyer, the notification unit 16 issues a warning to the mailer B1 who made the mailing via the output device 5. The output device 5, consisting of speaker K1 and display device L1, is connected to the control device 1 (Modification 3). In Modification 3, if the notification unit 16 determines that mail A1 is a flyer, it outputs a warning sound (an electronic sound that is likely to attract the attention of mailer B1, or a warning message using synthesized speech) from speaker K1. Also, in Modification 3, if the notification unit 16 determines that mail A1 is a flyer, it displays a warning message such as "No flyer mailing" from the display device L1, as shown in Figure 10.

[0112] According to the configuration of Modified Example 3, the possibility of flyers being delivered can be suppressed.

[0113] (6.4) Modification 4 The following description of the mailing notification system 100 according to Modification 4 (hereinafter also simply referred to as Modification 4) will be given with reference to Figures 12 to 17.

[0114] As a peripheral configuration of Modification 4, the imaging device 2 is capable of acquiring depth information. Specifically, the imaging device 2 may be, for example, a depth camera (stereo camera or TOF (Time-of-Flight) camera, etc.). Here, the depth camera is not a component of Modification 4, but it may be a component. Modification 4 may further include an imaging device 2 (depth camera).

[0115] In modification 4, the video information acquired by the video acquisition unit 11 includes depth information. The destination determination unit 13 determines the recipient (user U1) of the mailing based on the depth information.

[0116] Figures 12 and 13 are conceptual diagrams of the collective mailbox P1 viewed from the left side. Figure 12 shows mailer B1 dropping mail item A1 into mailbox P10 (mailbox P16: see Figure 2) on the right side of the third row (bottom row). Figure 13 shows mailer B1 dropping mail item A1 into mailbox P10 (mailbox P15: see Figure 2) on the right side of the second row (middle row).

[0117] Unlike the above embodiment, where the imaging device 2 is installed so that the front of all posts P10 are included in the image, the imaging device 2 may be installed so that the front of the posts P10 is roughly linear, as shown in Figure 14. In other words, depending on the installation of the imaging device 2, the mail slot Q1 may not be included in the image of the imaging device 2. In the case of an image like the one shown in Figure 14, if the imaging device 2 is a color camera or a monochrome camera as in the above embodiment, it may be possible to distinguish between the posts P10 in the left and right rows, but it is highly likely that it will not be possible to distinguish between the posts P10 in the depth direction (up and down direction) as shown in Figures 12 and 13.

[0118] In contrast, in Modification 4, as shown in Figures 15 to 17, depth information from a depth camera (imaging device 2), such as a stereo camera or TOF camera, is used to distinguish post-P10 in the depth direction.

[0119] Figure 15 is a video image IM4 showing the process of mailing a letter to the lowest post P16 (see Figure 2) by mailer B1, which includes depth information. Figure 16 is a video image IM5 showing the process of mailing a letter to the middle post P15 (see Figure 2) by mailer B1, which includes depth information. In other words, both mailing images IM4 and IM5 include depth information.

[0120] Figures 15 to 17 show depth information in grayscale (shades of gray). The darker the shade (higher density) in the image, the closer the object is to the depth camera (imaging device 2) (see Figure 17).

[0121] Image IM4 shows the mail being mailed to the bottommost post P16. Therefore, because the mailer B1's hand B2 and the mailed item A1 are far from the depth camera (imaging device 2), the image area B2X of hand B2 and the image area A1X of mailed item A1 show faint areas.

[0122] Image IM5 shows the mail being mailed into the central post box P15. Therefore, because the mailer B1's hand B2 and the mailed item A1 are at a moderate distance from the depth camera (imaging device 2), the image area B2X of hand B2 and the image area A1X of mailed item A1 show moderately dense areas.

[0123] In Modification 4, two rectangular detection areas D10, which are elongated in the left-right direction, are pre-set in the video, one in front of the mail slot Q1 of post P10 in the left column and the other in front of the mail slot Q1 of post P10 in the right column. Hereinafter, the detection area D10 on the left column side may be referred to as detection area D101, and the detection area D10 on the right column side may be referred to as detection area D102.

[0124] In Modification 4, the detection area memory unit 17 pre-stores detection area setting information in which multiple shading patterns within each detection area D10 are associated with the three posts P10 (and their dwelling unit numbers) in the depth direction. In the detection area setting information, the lightest (lowest density) shading pattern is associated with no mail being delivered (not delivered).

[0125] The mailing detection unit 12 detects mailings based on changes in density within each detection area D10 on the video. The destination determination unit 13 refers to the detection area setting information and determines which of the three post boxes P10 (and their dwelling unit numbers) in the depth direction corresponds to the density pattern within each detection area D10 on the video, thereby determining the destination of the mailing (user U1).

[0126] In the examples of mailing images IM4 and IM5, the mailing detection unit 12 determines that mailing has been performed (in the right column) because a change in grayscale was detected in detection area D102 of the two detection areas D101 and D102 in the video. In the example of mailing image IM4, the destination determination unit 13 refers to the detection area setting information and identifies the bottom post P16 in the right column from the grayscale pattern that changed within detection area D102, thereby determining the destination of the mailing. In the example of mailing image IM5, the destination determination unit 13 refers to the detection area setting information and identifies the middle post P15 in the right column from the grayscale pattern that changed within detection area D102, thereby determining the destination of the mailing.

[0127] According to the configuration of the modified example 4, for example, even when the imaging device 2 photographs a collection of mailboxes P1 in which two or more posts P10 are arranged vertically, without each mail slot Q1 being included in the image, it is possible to determine the mailing destination using the image.

[0128] In Modification 4, the number of depth cameras (imaging devices 2) is not particularly limited, and two or more depth cameras may be provided. Also, if two or more imaging devices 2 are provided, the two or more imaging devices 2 may include one or more depth cameras and one or more color cameras or monochrome cameras. In Modification 4, if destination determination using video information from a color camera (or monochrome camera) fails, destination determination using video information from a depth camera may be performed.

[0129] (6.5) Variation 5 The following description of the mailing notification system 100 according to Modification 5 (hereinafter also simply referred to as Modification 5) will be given with reference to Figures 18 to 21.

[0130] The collective post P1 to which Modification 5 is applied (see Figure 18) is larger in dimensions than the collective post P1 shown in Figure 2. The collective post P1 shown in Figure 18 includes, as an example, 12 posts P10 arranged in 4 columns x 3 rows.

[0131] In the peripheral configuration of Modified Example 5, multiple imaging devices 2 are provided, positioned to capture the exterior of the collective post P1. Here, the multiple imaging devices 2 are not components of Modified Example 5, but they may be. Modified Example 5 may further include the multiple imaging devices 2. In Modified Example 5, the multiple imaging devices 2 are arranged to compensate for blind spots with respect to the collective post P1.

[0132] In the examples shown in Figures 18 and 21, two imaging devices 2 are provided, but three or more imaging devices 2 may be provided. For the purposes of this explanation, the imaging device 2 on the left side of Figure 18 may be referred to as the first imaging device 21, and the imaging device 2 on the right side as the second imaging device 22. The first imaging device 21 and the second imaging device 22 are installed on the ceiling surface of the ceiling C1, approximately directly above the collective post P1. In particular, the first imaging device 21 and the second imaging device 22 are installed along the left-right direction of the collective post P1 so as to compensate for each other's blind spots with respect to the collective post P1.

[0133] Modification 5, as shown in Figure 21, includes multiple video acquisition units 11. Each of the multiple video acquisition units 11 acquires multiple video information acquired by multiple imaging devices 2. In Modification 5, the mailing detection unit 12 detects mailing and the destination determination unit 13 determines the destination (user U1) based on at least one of the multiple video information.

[0134] In the example shown in Figure 21, Modification 5 is equipped with two image acquisition units 11, depending on the number of imaging devices 2 (2). For the purposes of this explanation, the unit that acquires image information (hereinafter referred to as first image information) from the first imaging device 21 will be called the first image acquisition unit 111, and the unit that acquires image information (hereinafter referred to as second image information) from the second imaging device 22 will be called the second image acquisition unit 112.

[0135] Figure 19 is a postage image IM6, taken from the first video information acquired by the first video acquisition unit 111 from the first imaging device 21, showing postage being carried out by poster B1 in the process of posting to post P10, the bottommost post in the rightmost column. Figure 20 is a postage image IM7, taken from the second video information acquired by the second video acquisition unit 112 from the second imaging device 22, showing postage being carried out by poster B1 in the process of posting to post P10, the bottommost post in the rightmost column. Postage images IM6 and IM7 are images taken at the same time (simultaneous time).

[0136] As shown in Figure 19, the three posts P10 in the far right column are in a blind spot for the first imaging device 21. Therefore, in the postage image IM6 based on the first video information from the first imaging device 21, more than half of the image area A1X of the postage item A1 and the image area B2X of the poster B1's hand B2, which are posted to the bottom post P10 in the far right column, are cut off.

[0137] In contrast, the second imaging device 22 is positioned to supplement the image information of the three posts P10 in the rightmost column, which are in a blind spot for the first imaging device 21. Therefore, as shown in Figure 20, the postage image IM7 based on the second image information from the second imaging device 22 sufficiently includes the image area A1X of the postage item A1 and the image area B2X of the hand B2 of the poster B1, which are posted to the bottom post P10 in the rightmost column. The three posts P10 in the leftmost column, which are in a blind spot for the second imaging device 22, are supplemented by the first image information from the first imaging device 21.

[0138] The system administrator sets detection area setting information for multiple detection areas D0 (see Figure 3) for multiple mail slots Q1, for each of the first video information from the first imaging device 21 and the second video information from the second imaging device 22. In the example in Figure 18, the collective post P1 contains 12 posts P10, so the detection area D0 is set so that the first and second video information can cover 12 mail slots Q1.

[0139] In the first video information, as shown in the mailing image IM6 in Figure 19, the mailing slots Q1 of the three posts P10 in the far right column are cut off and not visible. Therefore, the system administrator can, for example, set up nine detection areas D0 for the mailing slots Q1 of the nine posts P10 other than the three posts P10 in the far right column.

[0140] In the second video information, as shown in the mailing image IM7 in Figure 20, the mailing slots Q1 of the three posts P10 in the leftmost column are completely cut off and not visible. Therefore, the system administrator can, for example, set up nine detection areas D0 for the mailing slots Q1 of the nine posts P10 other than the three posts P10 in the leftmost column.

[0141] In the modified example 5, the mailing detection unit 12 detects mailing based, for example, on changes in nine detection areas D0 on the first video information and changes in nine detection areas D0 on the second video information.

[0142] In the modified example 5, each detection area D0 is set as a long rectangular area of ​​the same shape and dimensions as the image area Q1X of the mail slot Q1, located directly below the corresponding image area Q1X of the mail slot Q1 (see Figure 3) in the video, similar to the detection area D0 of the above embodiment (see Figure 3).

[0143] In the modified version 5, if there is a change in a certain detection area D0, the mailing detection unit 12 applies the mailing image based on either the first video information or the second video information if that detection area D0 is set to only one of the first video information or the second video information.

[0144] In the examples in Figures 19 and 20, a mailing is detected in detection area D0 of post P10, the bottom post in the rightmost column, which is set in the second video information but not in the first video information. The mailing image IM7 based on the second video information is applied (the mailing image IM6 is not applied). In other words, the mailing detection unit 12 extracts the mailing image IM7 (for example, a still image) from the second video information, which is the basis of the detection result (while the mailing is being performed by mailing person B1), and outputs the information of the extracted mailing image IM7 to the destination determination unit 13.

[0145] In Modification 5, if a change occurs in a certain detection area D0, the mailing detection unit 12 may apply both mailing images based on both video information if that detection area D0 is set in both the first video information and the second video information. For example, the six detection areas D0 corresponding to the six posts P10 in the second and third columns from the right are set in both the first video information and the second video information. Therefore, if a change occurs in any of these six detection areas D0, both mailing images may be applied. That is, if a change occurs in any of these six detection areas D0, the mailing detection unit 12 may extract the mailing image IM6, which is the basis for the detection result, from the first video information and the mailing image IM7, which is the basis for the detection result, from the second video information and output them to the destination determination unit 13. Alternatively, if a change occurs in any of these six detection areas D0, the mailing detection unit 12 may extract only one of the mailing images IM6 and IM7 and output it to the destination determination unit 13.

[0146] The destination determination unit 13 determines the destination based on information from one or both of the mailed images IM6 and IM7. The image extraction processing unit 15 may extract the target image IM2 from one of the mailed images IM6 and IM7, or it may extract two target images IM2 from both mailed images IM6 and IM7. The notification unit 16 may include the target image IM2 extracted from one of the mailed images IM6 and IM7 in the mailing information, or it may include two target images IM2 extracted from both mailed images IM6 and IM7 in the mailing information.

[0147] According to the configuration of Modified Example 5, even for relatively large communal post boxes P1 that cannot be covered by video information from a single imaging device 2, it becomes easier to notify the recipient of mail being delivered to the communal post box P1.

[0148] Incidentally, blind spots for the imaging device 2 are not limited to cases where the collective post P1 is large, but can also occur due to the presence of a mail sender B1 standing in front of the collective post P1 and performing the mailing (for example, the area around the mailing slot Q1 is obstructed by the head of mail sender B1). Therefore, multiple imaging devices 2 may be arranged to compensate for blind spots caused by the presence of mail sender B1. For example, one of the multiple imaging devices 2 may be installed to image a certain post P10 from directly above, and another imaging device 2 may be installed to image the same post P10 from an oblique angle above.

[0149] In short, the multiple imaging devices 2 according to Modification 5 may be arranged to compensate for blind spots with respect to the collective post P1 and / or blind spots caused by the presence of the mailer B1 who performs the mailing.

[0150] (6.6) Variation 6 The following description of the mailing notification system 100 relating to Modification 6 (hereinafter also simply referred to as Modification 6) will be made with reference to Figure 22.

[0151] As a peripheral configuration of Modification 6, an information terminal 6 (see Figure 22) is provided. The information terminal 6 is a terminal owned by user U1. The information terminal 6 may be, for example, a smartphone or tablet terminal carried by user U1. The information terminal 6 is connected to an external network NT1 (see Figure 22), such as the Internet. Here, the information terminal 6 is not a component of Modification 6, but it may be a component. Modification 6 may further include the information terminal 6.

[0152] Furthermore, in the peripheral configuration of the modified example 6, the intercom system 3 further includes a gateway 34 (see Figure 22) connected to an external network NT1. The control device 32 can communicate with the information terminal 6 via the gateway 34 and the external network NT1.

[0153] The mailing information generated by Modification 6 (Control Device 1) is transmitted to the information terminal 6 via the lobby intercom 31, control device 32, gateway 34, and external network NT1. The mailing information is notified to user U1 by a screen display on the information terminal 6's display unit and / or by sound output from the information terminal 6's speaker.

[0154] As a result, user U1, who carries the information terminal 6, can receive notifications of mailing information via the information terminal 6 even when away from home. Note that the transmission path of mailing information from modified example 6 (control device 1) to the information terminal 6 is not limited to the above path, as long as the mailing information can be received by the information terminal 6 carried by user U1 while away from home via the external network NT1.

[0155] For example, control device 1 may be connected to control device 32, and the mailing information may be transmitted via the path from control device 1 to control device 32, gateway 34, and external network NT1. Alternatively, control device 1 may be connected to gateway 34, and the mailing information may be transmitted via the path from control device 1 to gateway 34, and external network NT1. Alternatively, a master unit 33 inside the dwelling unit may be interposed in the transmission path of the mailing information. For example, the mailing information may be transmitted via the path from control device 1 to lobby intercom 31, control device 32, master unit 33 inside the dwelling unit, router (not shown) inside the dwelling unit, gateway 34, and external network NT1.

[0156] Alternatively, the mailing information may be notified via email. In that case, a mail server on the external network NT1 may be interposed in the transmission path of the mailing information, and the mail server may send an email containing the mailing information to the information terminal 6.

[0157] According to the configuration of Modification 6, even when user U1 is out, they can receive notifications of mailing information via the information terminal 6, thus improving convenience.

[0158] In the above embodiment, the master unit 33, upon receiving the mailing information, directly notifies the user U1, who is at home, of the mailing information via screen display or sound output from the master unit 33. However, it is also possible for the user U1 to receive notification of the mailing information on the information terminal 6 even when at home. The master unit 33, upon receiving the mailing information, may also transmit the mailing information directly to the information terminal 6 (or via a router in the dwelling) via wireless communication compliant with standards such as Wi-Fi® or Bluetooth®.

[0159] The intercom system 3 may have a configuration in which, for example, the master unit 33 accepts self-reports of presence or absence from user U1. In that case, if a "absent" report is received, the mailing information may be sent to the information terminal 6 via the external network NT1, or if a "present" report is received, it may be sent to the information terminal 6 via the master unit 33.

[0160] This configuration allows user U1 to receive notifications of mail delivery information via the information terminal 6, even when they are at home, thus improving convenience.

[0161] (6.7) Variation 7 The following description of the mailing notification system 100 according to Modification 7 (hereinafter also simply referred to as Modification 7) will be made with reference to Figure 23.

[0162] In Modification 7, the notification-based mailing image IM8 (upper image in Figure 23), which forms the basis of the target image IM2 transmitted along with the mailing information, and the judgment-based mailing image IM9 (lower image in Figure 23), which is used to detect mailing, are images captured at slightly different timings.

[0163] The notification image IM8 is captured at the first timing when the image area A1X of the mailed item A1 is large, making it easier for user U1 to confirm the mailed item A1 in the image. On the other hand, the judgment image IM9 is captured at the second timing when the mailed item A1 has entered the mail slot Q1 to some extent, prioritizing the reduction of false detections of mailed items. The first timing (time) is slightly earlier (past) than the second timing (time).

[0164] In the modified example 7, the mailing detection unit 12 determines that mailing has occurred if, for example, a change in any of the multiple detection areas D0 continues for a specified time or longer. The mailing image IM9 is an image taken at the point when the change has continued for a specified time or longer (second timing). Alternatively, the mailing detection unit 12 may determine that mailing has occurred based on the position of the hand obtained by skeletal detection in the modified example 8 described later, and determine that mailing has occurred when the mailed item A1 has been placed all the way to the back of the post P10, in which case the mailing image IM9 may be an image taken at that point.

[0165] On the other hand, the notification unit 16 of Modified Example 7 extracts the mailing image IM8 from the video information at a first timing slightly prior to the second timing when the mailing image IM9 was captured. The image extraction processing unit 15 of Modified Example 7 extracts the target image IM2 from the extracted mailing image IM8. The notification unit 16 of Modified Example 7 generates and notifies mailing information including the target image IM2 extracted from the mailing image IM8.

[0166] According to the configuration of Modified Example 7, an image of the mailed item A1 with a relatively large image area A1X, as in the mailed image IM8, is attached for notification purposes. Therefore, user U1, who receives the mailing notification, can easily confirm the mailed item A1 in the image. This improves convenience. Furthermore, according to the configuration of Modified Example 7, false detections of mailings are also reduced.

[0167] (6.8) Variation 8 The following describes the mailing notification system 100 related to Modification 8 (hereinafter also simply referred to as Modification 8).

[0168] The mailing detection unit 12 in Modification 8 has a function to detect the skeleton of a human hand (fingers) in the video. When the mailing detection unit 12 in Modification 8 determines that there is a change in any of the multiple detection areas D0 based on the video information, it does not immediately determine that mailing has occurred, but instead performs image judgment processing using a skeleton detection algorithm to determine the skeleton of a hand (fingers) in the detection area D0 where the change occurred. Based on the result of this processing, the mailing detection unit 12 in Modification 8 determines whether only a human hand (fingers) is visible (without the mailed item A1), and determines that the change is due to a human hand (or its skeleton), and therefore determines that no mailing has occurred even if there is a change in the detection area D0. In other words, the mailing detection unit 12 determines that only a human hand (fingers) without the intention to mail something has entered the detection area D0. As a result, no mailing notification is issued.

[0169] According to the configuration of Modified Example 8, the possibility of a mailing being mistakenly determined to have occurred and a mailing notification being issued due to a person's hand (fingers) entering one of the multiple detection areas D0 can be reduced.

[0170] (6.9) Modification 9 The following description of the mailing notification system 100 according to Modification 9 (hereinafter also simply referred to as Modification 9) will be made with reference to Figure 24.

[0171] Modification 9 transmits the mailing information to the lobby intercom 31, and notifies the user U1 of the mailing information through a screen display on the lobby intercom 31 and / or through sound output from the speaker of the lobby intercom 31.

[0172] For example, user U1 may operate the control panel of the lobby intercom 31 to unlock the electric lock at the entrance to the lobby of facility 200 upon returning home. By entering user U1's unique ID information and password, the lobby intercom 31 will notify the user via its display if it has received new mailing information. When user U1 performs an operation on the control panel of the lobby intercom 31 to confirm the new mailing information, the lobby intercom 31 displays the new mailing information on its screen. The target image IM2, etc., is displayed on the display panel of the lobby intercom 31, allowing user U1 to confirm mailing item A1 on the screen.

[0173] If there are multiple new mailings, the lobby intercom 31 displays them as a list on the screen. User U1 can select one of the mailings they wish to check from the list. The lobby intercom 31 also stores previously checked mailings (history information) in its memory, and User U1 can check this history information as needed.

[0174] In the above embodiment, it was explained that if the type of mailed item A1 is determined to be a flyer, the user U1 is not notified of the mailed item. However, in Modification 9, even if the type of mailed item A1 is determined to be a flyer, notification of the mailed item, including that it is a flyer, may be given via the lobby intercom 31. In other words, when returning home, the distance from the lobby intercom 31 to the communal mailbox P1 is relatively short, so even if it is a flyer, it is not much trouble to go to the communal mailbox P1 and collect the flyer.

[0175] According to the configuration of Modification 9, the convenience is further improved because the user can receive notification of mailing information via the lobby intercom 31 upon returning home.

[0176] (6.10) Variation 10 The following describes the mailing notification system 100 related to Modification 10 (hereinafter also simply referred to as Modification 10).

[0177] In a facility such as an apartment building 200, there may be vacant rooms that are not being used (not being lived in) by any user U1. In modified example 10, the dwelling unit numbers of vacant rooms can be registered in advance. For example, it is preferable that the manager of the facility 200 can set the dwelling unit numbers of vacant rooms to the mailing notification system 100 via an operating unit such as the master unit 33 in the manager's room, the lobby intercom, or the setting terminal of the mailing notification system 100. It is preferable that the mailing notification system 100 includes a storage unit that stores information regarding the dwelling unit numbers of vacant rooms (vacant room registration information).

[0178] First, in Modification 10, upon receiving notification of mailing detection from the mailing detection unit 12, the destination determination unit 13 refers to the detection area setting information and, based on the mailing image IM1 which is the basis for the determination that mailing has occurred, identifies the destination of post P10 associated with the changed detection area D0 (such as the dwelling unit number, name, and email address of user U1). Next, the destination determination unit 13 in Modification 10 refers to the vacant room registration information and checks whether the identified destination (dwelling unit number) is registered as a vacant room.

[0179] If the mailing notification system 100 contains registrations of user U1's apartment number, name, email address, etc., and the specified apartment number is not registered as a vacant apartment in the vacant apartment registration information, then the modified example 10 will notify the mailing information in the same manner as the embodiment described above.

[0180] On the other hand, if the delivery notification system 100 does not have any registration of user U1's apartment number, name, email address, etc., or if the specified apartment number is registered as an empty apartment in the vacant apartment registration information, the destination determination unit 13 will determine that the destination is unknown, and the modified example 10 will not send a notification of delivery information. Alternatively, the modified example 10 may send a notification of delivery information, including the fact that the destination is unknown, to the master unit 33 in the management office or the lobby intercom.

[0181] Furthermore, in variation 10, the fact that a mail item was delivered to postbox P10 with an unknown address is also used to determine the type of mail item A1 (determination of it being a flyer).

[0182] In other words, in the modified example 10, the mail item determination unit 14 determines that mail item A1 is a flyer if the determination result by the address determination unit 13 indicates that the address is not registered (address unknown). Furthermore, if the mail item determination unit 14 determines that mail item A1 is a flyer due to an unregistered address, and if mail item A1 is detected being deposited in another post P10 within a certain time period including the time when the deposit of the flyer is detected, the mail item determination unit 14 also determines that the type of mail item A1 in that post is also a flyer.

[0183] According to the configuration of Modified Example 10, the ability to pre-register the dwelling unit numbers of vacant rooms makes it easier to determine if a mail item is "undeliverable." Furthermore, since the fact that mail has been delivered to the undeliverable mailbox P10 is used to determine the type of mail item A1 (whether it is a flyer), the accuracy of determining whether mail item A1 is a flyer is improved.

[0184] (6.11) Other variations Functions similar to those of the mailing notification system 100 according to the above embodiment may be implemented by a mailing notification method, a computer program, or a non-temporary recording medium on which a computer program is stored.

[0185] The mailing notification system 100 in this disclosure includes a computer system. The computer system mainly consists of a processor and memory as hardware. The functionality of the mailing notification system 100 in this disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, provided via a telecommunications line, or provided on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. The processor of the computer system consists of one or more electronic circuits including semiconductor integrated circuits (ICs) or large-scale integrated circuits (LSIs). The integrated circuits such as ICs or LSIs referred to here are named differently depending on the degree of integration, and include integrated circuits called system LSIs, VLSIs (Very Large Scale Integration), or ULSIs (Ultra Large Scale Integration). Furthermore, FPGAs (Field-Programmable Gate Arrays) that are programmed after the manufacture of LSIs, or logic devices that allow for the reconfiguration of junction relationships or circuit compartments within LSIs, can also be used as processors. Multiple electronic circuits may be integrated onto a single chip or distributed across multiple chips. Multiple chips may be integrated onto a single device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller also consists of one or more electronic circuits, including semiconductor integrated circuits or large-scale integrated circuits.

[0186] Furthermore, it is not essential that the multiple functions of the mailing notification system 100 be consolidated within a single housing. For example, the components of the mailing notification system 100 may be distributed across multiple housings.

[0187] Conversely, multiple functions in the mailing notification system 100 may be integrated into a single housing, as in the control device 1 of the above embodiment. Furthermore, at least some of the functions of the mailing notification system 100, for example, some of the functions of the mailing notification system 100, may be implemented by the cloud (cloud computing) or the like.

[0188] (summary) Based on the embodiments described above, the following aspects are disclosed.

[0189] The first embodiment of the mailing notification system (100) comprises an image acquisition unit (11), a mailing detection unit (12), a destination determination unit (13), and a notification unit (16). The image acquisition unit (11) acquires image information acquired by an imaging device (2) installed in a position capable of photographing the exterior of a collection post (P1) including multiple postboxes (P10). The mailing detection unit (12) detects mailings for each of the multiple postboxes (P10) based on the image information. The destination determination unit (13) determines the destination (user U1) of the mailing based on the detection result of the mailing detection unit (12). The notification unit (16) notifies the mailing information, including the determination result of the destination determination unit (13).

[0190] According to the above configuration, mail is detected based on video information acquired by an imaging device (2) installed in a position capable of photographing the exterior of the communal mailbox (P1). Based on the mail detection result, the recipient of the mail is determined, and the mailing information is notified. This makes it easier to notify the communal mailbox (P1) of mailings.

[0191] With respect to the second embodiment of the mailing notification system (100), in the first embodiment, the video information includes video of multiple mailing slots (Q1) of multiple postboxes (P10). Multiple detection areas (D0) are pre-set on the video information for each of the multiple mailing slots (Q1). The mailing notification system (100) detects mailings in the mailing detection unit (12) and determines the destination (user U1) in the destination determination unit (13) based on changes in the multiple detection areas (D0) on the video information.

[0192] According to the above embodiment, the accuracy of detecting mailings and determining the recipient is improved.

[0193] With respect to the third embodiment of the mailing notification system (100), in the second embodiment, the mailing detection unit (12) has a function to determine whether a change in any of the multiple detection areas (D0) occurred when the mailing (A1) was deposited or when the mailing (A1) was retrieved.

[0194] According to the above embodiment, even though the user (U1) actually took out the mailed item (A1), the possibility of a false detection that a change in the detection area (D0) has occurred and that the mailed item (A1) has been deposited can be reduced.

[0195] With respect to the mailing notification system (100) according to the fourth embodiment, in the third embodiment, the notification unit (16) does not perform the notification of mailing information if the mailing detection unit (12) determines that the change in the detection area (D0) occurred when the mailed item (A1) was retrieved.

[0196] According to the above configuration, the possibility of unnecessary notification of mailing information to the user (U1) can be reduced.

[0197] With respect to the fifth embodiment of the mailing notification system (100), in any one of the first to fourth embodiments, the notification unit (16) notifies mailing information including mailing images (IM1, IM4 to IM8) from the video information, in which the mailing detected by the mailing detection unit (12) is in the process of being carried out by the mailer (B1).

[0198] According to the above configuration, the user (U1) can confirm the actual mailing process through the mailing images (IM1, IM4~IM8), thus improving convenience.

[0199] With respect to the mailing notification system (100) according to the sixth embodiment, in any one of the first to fifth embodiments, the notification unit (16) has the function of communicating with an intercom system (3) in a facility (200) where a communal mailbox (P1) is installed. The notification unit (16) notifies the recipient (user U1) determined by the recipient determination unit (13) via the intercom system (3).

[0200] According to the above configuration, since notification of mail delivery is made via the intercom system (3), it becomes easier to notify the communal mailbox (P1) of mail delivery.

[0201] The seventh embodiment of the mailing notification system (100) further comprises an image extraction processing unit (15) in any one of the first to sixth embodiments. The image extraction processing unit (15) extracts a target image (IM2) from the mailing images (IM1, IM4~IM8) of the video information, which show mailing being performed by the mailer (B1) as detected by the mailing detection unit (12), and limits the target image (IM2) to the area around the post (P10) in which mailing is currently being performed among multiple post (P10). The notification unit (16) notifies the mailing information including the target image (IM2).

[0202] According to the above configuration, the user (U1) can confirm the actual mailing process through the target image (IM2), thus improving convenience.

[0203] The eighth embodiment of the mailing notification system (100) further comprises an auxiliary video acquisition unit (11A) in any one of the first to seventh embodiments. The auxiliary video acquisition unit (11A) acquires auxiliary video information acquired by an auxiliary imaging device (2A) installed in a position capable of photographing the space in front of the collective mailbox (P1). The notification unit (16) notifies the mailing information, including the image of the mailer (B1) who performed the mailing as detected by the mailing detection unit (12) from the auxiliary video information.

[0204] According to the above configuration, the user (U1) can verify the identity of the person who actually made the mailing (B1) through the image of the mailer (B1), thus improving convenience.

[0205] Regarding the mailing notification system (100) according to the ninth embodiment, in any one of the first to eighth embodiments, the imaging device (2) is connected to the communication device (4). The mailing notification system (100) is connected to the communication device (4) via an external network (NT1) in a communicative manner. The video acquisition unit (11) acquires video information from the imaging device (2) via the communication device (4) and the external network (NT1).

[0206] According to the above embodiment, for example, a server with the functionality of a mailing notification system (100) can be installed and managed outside the facility (200), making it easier to notify mailings to the collective mailbox (P1).

[0207] The postage notification system (100) according to the tenth embodiment further comprises a postage item determination unit (14) in any one of the first to ninth embodiments. The postage item determination unit (14) determines the type of postage item (A1) based on the video information of the postage item (A1) detected by the postage detection unit (12). The notification unit (16) notifies the postage information, including the determination result of the postage item determination unit (14).

[0208] According to the above embodiment, the user (U1) can find out the type of mailed item (A1) through the mailing information, thus improving convenience.

[0209] The eleventh embodiment of the mailing notification system (100) further comprises a mailing item determination unit (14) in any one of the first to tenth embodiments. The mailing item determination unit (14) determines the type of mailing item (A1) based on video information of the clothing of the mailer (B1) who performed the mailing, as detected by the mailing detection unit (12). The notification unit (16) notifies the mailing information, including the determination result of the mailing item determination unit (14).

[0210] According to the above configuration, the user (U1) can learn the type of mailed item (A1) through the mailing information, thus improving convenience. In addition, the accuracy of determining the type of mailed item (A1) is improved.

[0211] With respect to the mailing notification system (100) according to the 12th embodiment, in the 10th or 11th embodiment, if the mailing determination unit (14) determines that the type of mailing (A1) is a flyer, the notification unit (16) does not perform the notification of mailing information.

[0212] According to the above configuration, the possibility of a user (U1) receiving notifications about flyers that are unlikely to require immediate attention is reduced. As a result, convenience is improved.

[0213] With respect to the 13th embodiment of the mailing notification system (100), in any one of the 10th to 12th embodiments, if the mailing detection unit (12) detects that mailings have been made to the collective mailbox (P1) a predetermined number of times or more within a certain period of time, the mailing determination unit (14) determines that the type of mailing (A1) is a flyer.

[0214] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0215] With respect to the mailing notification system (100) according to the 14th aspect, in any one of the 10th to 13th aspects, the mailing determination unit (14) determines the type of mailing (A1) to be a flyer if the mailing (A1) does not have at least part of a postal code, recipient's name, and address on the video.

[0216] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0217] With respect to the mailing notification system (100) according to the 15th embodiment, in any one of the 10th to 14th embodiments, if the mailing determination unit (14) determines that the type of mailing (A1) is a flyer, the notification unit (16) issues a warning to the mailer (B1) who performed the mailing via an output device (5) that performs at least one of sound output and video output.

[0218] According to the above configuration, the possibility of flyers being delivered can be suppressed.

[0219] With respect to the mailing notification system (100) according to the 16th embodiment, in any one of the 10th to 15th embodiments, the mailing determination unit (14) determines the type of mailing (A1) to be a flyer if the determination result by the address determination unit (13) indicates that the address is not registered.

[0220] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0221] With respect to the mailing notification system (100) according to the 17th embodiment, in the 16th embodiment, the mailing determination unit (14) determines that the type of mailing (A1) is a flyer because the recipient address is not registered. In that case, if mailing (A1) is detected in another postbox (P10) within a certain period of time including the time when the mailing of the flyer is detected, the mailing determination unit (14) also determines that the type of mailing (A1) is a flyer.

[0222] According to the above embodiment, the accuracy of determining whether the type of mailed item (A1) is a flyer is improved.

[0223] Regarding the mailing notification system (100) according to the 18th embodiment, in any one of the 1st to 17th embodiments, the imaging device (2) is capable of acquiring depth information. The video information includes depth information. The destination determination unit (13) determines the mailing destination (user U1) based on the depth information.

[0224] According to the above embodiment, for example, even when the imaging device (2) photographs a collection of mailboxes (P1) in which two or more posts (P10) are arranged vertically from directly above, it is possible to determine the recipient of the mail (user U1) using the image.

[0225] The mailing notification system (100) according to the 19th embodiment includes a plurality of video acquisition units (11) in any one of the first to 18 embodiments. Each of the plurality of video acquisition units (11) acquires a plurality of video information acquired by a plurality of imaging devices (2) installed in a position capable of photographing the exterior of the collective mailbox (P1). The plurality of imaging devices (2) are arranged to compensate for blind spots with respect to the collective mailbox (P1) and / or blind spots caused by the presence of the mailer (B1) performing the mailing. The mailing notification system (100) performs mailing detection in the mailing detection unit (12) and destination determination in the destination determination unit (13) based on at least one of the plurality of video information.

[0226] According to the above configuration, even in cases where video information from a single imaging device (2) is insufficient, it becomes easier to notify the collective mailbox (P1) of mail being delivered.

[0227] The 20th embodiment of the mailing notification method is a mailing notification method executed by one or more processors. The mailing notification method includes a video acquisition step, a mailing detection step, a destination determination step, and a notification step. In the video acquisition step, video information is acquired by an imaging device (2) installed in a position capable of photographing the appearance of a collection post (P1) including multiple posts (P10). In the mailing detection step, mailing is detected for each of the multiple posts (P10) based on the video information. In the destination determination step, the destination (user U1) of the mailing is determined based on the detection result of the mailing detection step. In the notification step, mailing information including the determination result of the destination determination step is notified.

[0228] According to the above embodiment, a method for notifying mail delivery to a communal mailbox (P1) can be provided, which facilitates the notification of mail delivery to the communal mailbox (P1).

[0229] The program relating to the 21st aspect is a program that causes one or more processors to execute the mailing notification method according to the 20th aspect.

[0230] According to the above embodiment, a function can be provided that makes it easier to notify the recipient of mail being delivered to the collective mailbox (P1). [Explanation of Symbols]

[0231] 200 facilities 100 Mailing Notification System 11. Video Acquisition Unit 11A Auxiliary video acquisition unit 12 Mailing detection unit 13 Destination determination unit 14 Mail item detection unit 15 Image cropping processing unit 16 Notification Department 2. Imaging device 3. Intercom System 4. Communication equipment 5. Output device A1 Mail B1 Posted by D0 detection area IM1, IM4~IM8 Posted Images IM2 Target Image NT1 External Network P1 Collective Mailbox P10 Post Q1 Mail slot U1 User (Recipient)

Claims

1. A video acquisition unit that acquires video information obtained by an imaging device installed in a position capable of photographing the exterior of a collection of mailboxes including multiple mailboxes, Based on the aforementioned video information, a mailing detection unit detects mailings into the multiple mailboxes on a per-mailbox basis, A destination determination unit determines the destination of the mail based on the detection result of the mailing detection unit, A notification unit that notifies mailing information including the determination result of the recipient determination unit, Equipped with, Mailing notification system.

2. The aforementioned video information includes images of multiple mail slots of the multiple postboxes, For each of the aforementioned multiple mail slots, multiple detection areas are pre-set in the video information. The mailing detection unit detects the mailing, and the destination determination unit determines the destination, based on changes in the multiple detection areas on the video information. The mailing notification system according to claim 1.

3. The mailing detection unit has a function to determine whether a change in any of the multiple detection areas occurred when the mail was deposited or when the mail was retrieved. The mailing notification system according to claim 2.

4. If the notification unit determines that the change in the detection area occurred when the mailed item was removed, it will not perform the notification of the mailed item information. The mailing notification system according to claim 3.

5. The notification unit notifies the mailing information, including, from the video information, a mailing image that shows the mailing being performed by the mailing person as detected by the mailing detection unit. The mailing notification system according to claim 1.

6. The notification unit has the function of communicating with the intercom system in the facility where the collective mailbox is installed. The notification unit sends a notification to the destination determined by the destination determination unit via the intercom system. The mailing notification system according to claim 1.

7. The system further includes an image extraction processing unit that extracts a target image from the video information, specifically from the image of a mailing in progress detected by the mailing detection unit, which shows the mailing being performed by the mailer, and limits the target image to the area around the mailing post in progress among the multiple mailing posts. The notification unit notifies the mailing information, including the target image. The mailing notification system according to claim 1.

8. The system further includes an auxiliary video acquisition unit that acquires auxiliary video information obtained by an auxiliary imaging device installed in a position capable of photographing the space in front of the aforementioned collective post, The notification unit notifies the mailing information, including the image of the mailer who performed the mailing, as detected by the mailing detection unit, from the auxiliary video information. A mailing notification system according to any one of claims 1 to 7.

9. The imaging device is connected to a communication device, The mailing notification system is connected to the communication device via an external network in a communicative manner. The video acquisition unit acquires the video information from the imaging device via the communication device and an external network. The mailing notification system according to claim 1.

10. The system further includes a mail item determination unit that determines the type of mail item based on the video of the mail item detected by the mail item detection unit from the aforementioned video information. The notification unit notifies the mailing information, including the determination result of the mailing determination unit. The mailing notification system according to claim 1.

11. The system further includes a mail item determination unit that determines the type of mail item based on the video footage of the clothing of the mailer who performed the mailing, as detected by the mailing detection unit, from the aforementioned video information. The notification unit notifies the mailing information, including the determination result of the mailing determination unit. The mailing notification system according to claim 1.

12. If the mail item determination unit determines that the type of mail item is a flyer, the notification unit will not perform the notification of the mail item information. The mailing notification system according to claim 10 or 11.

13. If the mailing detection unit detects that mailings have been made to the collective mailbox a predetermined number of times or more within a certain period of time, the mailing determination unit determines that the type of mailing is a flyer. The mailing notification system according to claim 10 or 11.

14. The mail item determination unit determines that the mail item is a flyer if, in the video, the mail item does not contain at least a postal code, recipient's name, and address. The mailing notification system according to claim 10 or 11.

15. If the mail item determination unit determines that the mail item is a flyer, the notification unit will issue a warning to the person who made the mailing via an output device that performs at least one of sound output and video output. The mailing notification system according to claim 10 or 11.

16. The mail item determination unit determines the type of mail item to be a flyer if the determination result by the address determination unit indicates that the address is not registered. The mailing notification system according to claim 10 or 11.

17. If the mailing detection unit determines that the mailing is a flyer due to the recipient not being registered, and if mailing is detected in another mailbox within a certain period of time including the time when the mailing of the flyer was detected, it will also determine that the mailing is a flyer. The mailing notification system according to claim 16.

18. The imaging device is capable of acquiring depth information, The aforementioned video information includes the aforementioned depth information, The destination determination unit determines the destination of the mailing based on the depth information. The mailing notification system according to claim 1.

19. The system comprises multiple video acquisition units, each acquiring multiple video information acquired by multiple imaging devices installed in a position capable of photographing the exterior of the collective mailbox, Multiple imaging devices are arranged to compensate for blind spots with respect to the collective post box and / or blind spots caused by the presence of the person making the mail, The mailing detection unit detects the mailing, and the destination determination unit determines the destination, based on at least one of the multiple pieces of video information. The mailing notification system according to claim 1.

20. A method for sending a notification, which is executed by one or more processors, A video acquisition step involves acquiring video information obtained by an imaging device installed in a position where it can photograph the exterior of a collection of mailboxes including multiple mailboxes, and A mailing detection step is performed based on the aforementioned video information to detect mailings to the multiple postboxes on a per-postbox basis, A destination determination step, which determines the destination of the mailing based on the detection result of the mailing detection step, A notification step that notifies the mailing information including the determination result of the aforementioned destination determination step, including, Method of notification of mailing.

21. A program for causing one or more processors to execute the mailing notification method described in claim 20.

Images