Delivery management system, delivery management method, and program

Abstract

The present invention aims to provide a delivery management system that can generate an image that confirms placement of a delivery item, without bothering delivery staff. This delivery management system comprises: a detection means that detect the placement of the delivery item in the placement location; and a generation means that generates a confirmation image that shows the placement location at the time that the detection means detected the placement.

Description

[Technical field]

[0001] The present disclosure relates to a delivery management system and the like. [Background technology]

[0002] In order to efficiently deliver packages, a service is provided in which a delivery person leaves the package at a location designated by the recipient. Since such a service does not hand the package directly to the user, the recipient needs to know whether it has been delivered to the designated location. To address this issue, a service is provided in which a picture of the location where the delivery person leaves the package is taken and sent to the recipient.

[0003] Patent Document 1 discloses a delivery receipt management system for a carrier to manage the delivery of packages. The package deliverer takes a picture of the package receiving box with the box ID displayed. The captured image is sent to a server by a communication terminal carried by the package deliverer.

[0004] Patent Document 2 discloses an article delivery confirmation system that uses location information at the time when an article identifier of a delivered article is read to confirm whether the delivered article has been delivered normally.

[0005] Patent Document 3 discloses a parcel delivery method in which a deliverer takes a picture of the state of the parcel when delivery is completed, transmits the photographed data to a delivery company, determines whether delivery is complete from the photographed data, and notifies the deliverer of the completion of delivery.

[0006] Patent Document 4 discloses a wearable device that includes a photographing device and a control unit that starts photographing at a predetermined photographing start timing related to unlocking of the luggage compartment in order to improve security when delivering luggage to the luggage compartment of a vehicle. The wearable device is carried by the user who delivers the luggage. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2019-058334 A [Patent Document 2] JP 2017-013923 A [Patent Document 3] JP 2006-225048 A [Patent Document 4] JP 2019-094167 A Summary of the Invention [Problem to be solved by the invention]

[0008] In Patent Documents 1-3, photographing and reading identifiers are troublesome for delivery personnel. Also, in Patent Documents 1-3, images that can provide conclusive evidence of the placement of the delivery item are not obtained.

[0009] In Patent Document 4, when delivering luggage to the luggage compartment of a vehicle, an image can be obtained that enables determination that the luggage has been placed, but if the locking / unlocking device disclosed in Patent Document 4 is not present, an image that provides confirmation that the delivery item has been placed cannot be obtained.

[0010] The present disclosure aims to provide a delivery management system, a confirmation acquisition method, and a program that can generate an image that serves as confirmation of the placement of a delivery item without bothering a delivery person. [Means for solving the problem]

[0011] The delivery management system of the present disclosure includes a detection means for detecting the placement of a delivery item at a placement location, and a generation means for generating a confirmation image of the placement location when the detection means detects the placement.

[0012] The delivery management method according to the present disclosure detects the placement of a delivery at a placement location, and generates a confirmation image of the placement location at the time the placement is detected.

[0013] The program according to the present disclosure causes a computer to execute a process of detecting the placement of a delivery item at a placement location, and a process of generating a confirmation image of the placement location when placement is detected. Effect of the Invention

[0014] According to the present disclosure, an image can be generated that provides confirmation of the placement of a delivery item without bothering the delivery person. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a block diagram showing a configuration of a delivery management system 1 according to a first embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of a minimum configuration of a delivery management system 1. [Diagram 3] 4 is a flowchart illustrating an operation of the delivery management device 100 according to the first embodiment. [Figure 4A] FIG. 13 is a diagram showing an example of a state when the detection unit 101 detects the act of placing a delivery. [Figure 4B] FIG. 2 is a diagram showing an example of a confirmation image according to the first embodiment. [Diagram 5] FIG. 11 is a block diagram showing the configuration of a delivery management system 1 according to a second embodiment. [Figure 6A] FIG. 11 is a diagram showing an example of a delivery list according to the second embodiment. [Figure 6B] FIG. 11 is a diagram showing an example of a confirmation image according to the second embodiment. [Figure 7] 11 is a sequence diagram illustrating the operation of the delivery management system 1 according to the second embodiment. FIG. [Figure 8] FIG. 11 is a block diagram showing the configuration of a delivery management device 100 according to a third embodiment. [Figure 9] 13 is a flowchart illustrating an operation of the delivery management device 100 according to the third embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a delivery list according to the third embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a confirmation image according to the third embodiment. [Figure 12] FIG. 13 is a diagram showing an example of a confirmation image according to the third embodiment. [Figure 13A] 1A and 1B are diagrams illustrating an example of a state when the detection unit 101 detects the placement of a mail piece. [Figure 13B] FIG. 13 is a diagram showing an example of a confirmation image according to Modification 1 of the third embodiment. [Figure 14A] FIG. 13 is a diagram showing an example of a delivery list according to the second modification of the third embodiment. [Figure 14B] 1 is a diagram showing a state when the detection unit 101 detects placement of a newspaper in a mailbox. FIG. [Figure 14C] FIG. 13 is a diagram showing an example of a confirmation image according to Modification 2 of the third embodiment. [Figure 15] FIG. 5 is a block diagram showing an example of the hardware configuration of a computer 500. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] [First embodiment] In the first embodiment, a delivery person who delivers a delivery item places the delivered item in a predetermined location. The location can be selected appropriately by the delivery person or the user of the delivery service, such as next to the front door, in a mailbox, or in a parcel receiving box. The delivery item includes packages, mail, newspapers, advertisements, and other items. A carrier requests the delivery person to deliver the item to the recipient and manages the delivery status.

[0017] (composition) 1 is a block diagram showing the configuration of a delivery management system 1 according to the first embodiment. The delivery management system 1 includes a delivery management device 100 and a wearable device 20.

[0018] The delivery management device 100 is communicatively connected to the wearable device 20 worn by the delivery person via wired or wireless communication. The delivery management device 100 may be provided, for example, in a terminal carried by the delivery person, or in a server of a carrier that manages deliveries by the delivery person.

[0019] The wearable device 20 includes a camera 21 and a communication unit 22. The wearable device 20 is attached to any position of the delivery person, such as the head, chest, shoulder, arm, or wrist. The camera 21 is provided in a position and orientation that allows it to capture an image that allows the location of the delivery item to be identified. The camera 21 captures images using an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image obtained by capturing images may be either a still image or a video. For example, the camera 21 may continue capturing images while the delivery person is performing his / her duties. The communication unit 22 transmits data of the images captured by the camera 21 to the delivery management device 100.

[0020] 2 is a block diagram showing an example of a minimum configuration of the delivery management system 1. The minimum configuration of the delivery management system 1 is a delivery management device 100.

[0021] The delivery management device 100 includes a detection unit 101 and a generation unit 102. The detection unit 101 detects the placement of a delivery at a placement location. Detecting the placement of a delivery at a placement location means, for example, detecting the act of placing the delivery at the placement location, detecting the state of the delivery at the placement location, or detecting the state of the delivery immediately before it is placed at the placement location. Alternatively, it may be detecting actions before and after placing the delivery. Each detection example will be described in detail below.

[0022] 1) Detection of the act of placing a delivery As an example of detecting the placement of a delivery, a method in which the detection unit 101 detects the act of placing the delivery at a placement location will be described.

[0023] The detection unit 101 detects the movement of the delivery person when placing the delivery item by using a known image recognition technology or image analysis technology based on the image acquired from the above-mentioned camera 21. The detection unit 101 may detect, for example, any movement of the delivery person's hand, arm, leg, or waist. The movement when placing the delivery item includes, for example, the movement of the delivery person to insert the delivery item into a mailbox, the movement to put the delivery item into a parcel receiving box, and the movement to put the delivery item down.

[0024] Furthermore, instead of detecting the motion by image recognition technology, the detection unit 101 may detect the motion when placing the delivery item based on a sensor value of an acceleration sensor, a gyro sensor, a magnetic sensor, or the like that measures the motion of the delivery person. The sensor may be provided integrally with the wearable device 20, or may be attached to the body, gloves, or clothes of the delivery person separately from the wearable device 20.

[0025] 2) Detecting when a delivery item is placed As an example of detecting the placement of a piece, a method in which the detection unit 101 detects the placement state of the piece will be described.

[0026] The detection unit 101 may detect the delivery person's hands and the delivery item using known image recognition technology or image analysis technology based on the image acquired from the camera 21, and detect a state in which the delivery person's hands have been removed from the delivery item, thereby detecting a state in which the delivery item has been placed. Note that the detection unit 101 may also detect a state in which the delivery person's hands have been removed from the delivery item based on the measurement value of a contact sensor provided on the delivery person's gloves or the like. Furthermore, by providing a TOF (Time of Flight) sensor in the camera 21, the detection unit 101 may detect the surface of the delivery item and the surface on which the delivery item is placed, such as a floor or a stand, from the acquired image, and detect the state in which the delivery item is placed in a predetermined place. The detection unit 101 may determine that the delivery item has been placed when the distance between the surface of the delivery item and the surface on which the delivery item is placed remains unchanged over a predetermined time.

[0027] Furthermore, the detection unit 101 may detect that the delivery person has left the delivery piece by detecting that the delivery person has left the delivery piece by a predetermined distance. The predetermined distance is set appropriately, for example, to 50 cm or more from the delivery piece. The distance between the delivery person and the delivery piece may be measured by, for example, measuring the size of the delivery piece in an image captured by the camera 21 by image recognition technology or image analysis technology. A TOF sensor may be provided in the camera 21 to measure the distance from the delivery piece to the camera 21. An RF (Radio Frequency) tag may be attached to the delivery piece, and the delivery person may carry a tag reader to measure that the delivery person has left the delivery piece. For example, the detection unit 101 may receive a notification that the delivery person has left the delivery piece by a predetermined distance from the above-mentioned camera 21 or tag reader.

[0028] 3) Detection of the state of the delivery item immediately before it is placed Instead of detecting the state in which the delivery item has been placed, the detection unit 101 may detect the state immediately before the delivery item is placed. As the state immediately before the delivery item is placed, the detection unit 101 detects, for example, by image recognition technology, a state in which the delivery item is held up in front of the mailbox, a state in which a part of the delivery item has been dropped into the mailbox, or a state in which the parcel receiving box is opened and the delivery item is being carried into the box.

[0029] 4) Detection of movements before and after placing a delivery The detection unit 101 may detect the act of placing the delivery item by detecting an action performed by the delivery person before placing the delivery item. The detection unit 101 may also detect the state in which the delivery item has been placed by detecting an action performed by the delivery person after placing the delivery item. The actions before and after placing the delivery item may be detected by employing a method similar to the method of detecting the action when placing the delivery item.

[0030] As the action performed before placing, the detection unit 101 may detect an action performed by the delivery person before placing the delivery in the mailbox, such as twisting the arm, or an action to make it easier to place the delivery in the mailbox. If the delivery is a newspaper, the action to make it easier to put the newspaper in the mailbox includes, for example, an action of folding the newspaper or an action of tapping the newspaper to make it flat. Furthermore, as the action after placing, the detection unit 101 may detect an action of pointing at the delivery after placement is completed.

[0031] The detection unit 101 may also detect the act of placing the delivery item or the state in which the delivery item has been placed by recognizing the voice of the delivery person using a voice recognition technology. The detection unit 101 detects the act of placing the delivery item or the state in which the delivery item has been placed by recognizing the voice of the delivery person, for example, "I will place it here" or "Placement is complete."

[0032] The actions of the delivery personnel detected by the detection unit 101 may be set so as to be detectable by generalizing the above-mentioned actions performed by the delivery personnel as basic actions and derived actions. Alternatively, the actions detected by the detection unit 101 may be set in advance for each delivery personnel. By storing the actions for each delivery personnel in advance, it becomes possible to detect the actions with high accuracy.

[0033] The generation unit 102 generates a confirmation image of the placement location photographed when the detection unit 101 detects the placement of the delivery item. Specifically, the generation unit 102 acquires an image photographed by the camera 21. Furthermore, the generation unit 102 receives a notification from the detection unit 101 that the act of placing the delivery item has been detected. For example, the generation unit 102 selects, from the acquired images, an image photographed when the detection unit 101 detects the placement of the delivery item. For example, the image is selected based on the time the image was photographed and the time the placement of the delivery item was detected. The generation unit 102 generates a confirmation image based on the selected image. Note that the generation unit 102 may identify the delivery item from the acquired image and generate a confirmation image to include the delivery item.

[0034] (operation) Next, the operation of the delivery management system 1 according to the first embodiment will be described using the delivery management device 100, which is the minimum configuration.

[0035] Hereinafter, the operation of the delivery management device 100 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart illustrating the operation of the delivery management device 100 according to the first embodiment.

[0036] The delivery management device 100 is communicatively connected to a wearable device 20 including a camera 21. The wearable device 20 is attached, for example, to the chest of a delivery person, and the camera 21 is provided in a position and orientation that allows it to capture an image that enables the location of a delivery item to be identified. The camera 21 starts capturing images, for example, when the delivery person leaves the delivery vehicle, and stops capturing images when the delivery person returns to the delivery vehicle. The wearable device 20 transmits data of images captured by the camera 21 to the delivery management device 100 via the communication unit 22.

[0037] When a delivery person carries the item and delivers it to a predetermined destination, the detection unit 101 detects that the delivery person has placed the item at the placement location (step S101). For example, the detection unit 101 detects the act of placing the item. FIG. 4A is a diagram showing an example of the state of the front door when the detection unit 101 detects that the delivery person has placed the item. In FIG. 4A, the delivery person has completed placing the item at the front door.

[0038] The generation unit 102 generates a confirmation image of the placement location when the placement of the delivery is detected (step S102). Fig. 4B is a diagram showing an example of a confirmation image generated from an image captured in the state of Fig. 4A. The confirmation image shown in Fig. 4B includes the delivery and the state of its surroundings.

[0039] (effect) According to the first embodiment, an image that serves as proof of the placement of a delivery item can be obtained without bothering the delivery person because the generation unit 102 generates a proof image that captures the placement location when the placement is detected.

[0040] Furthermore, according to the first embodiment, even if the recipient does not have the receiving unit ready, an image that serves as confirmation of placement can be obtained because the detection unit 101 detects placement of the delivery by the delivery person, and the generation unit 102 generates a confirmation image that captures the placement location at the time the placement is detected.

[0041] (Variation) Delivery by robot In the present disclosure, the delivery of the delivery may be performed by a robot. In the present disclosure, the description of a delivery person may be replaced with a robot as appropriate. The delivery robot includes an unmanned ground vehicle and an unmanned aerial vehicle (drone). In a modified example, the delivery management device 100 may be mounted on the robot, or may be provided on the server of a carrier that manages the robot. The delivery management device 100 is connected to, for example, a camera 21 provided on the robot so as to be able to communicate with the robot via wired or wireless communication.

[0042] The robot acquires its position information using a GPS (Global Positioning System) or the like. The robot may store images of roads, building exteriors, building interiors, etc. in advance in association with a map, and acquire current position information by comparing the stored images with images captured by the camera 21. The position information may include information regarding height. The robot carries the delivery item to the destination based on the destination's position information. When the robot arrives at the destination, the robot places the delivery item in a predetermined placement location. The placement location may be, for example, in front of the front door.

[0043] When a flying drone delivers a package, the drone may place the package on a balcony of a building. At this time, the drone may measure the flight altitude. The drone may calculate the flight altitude, for example, based on the first floor of the building, by image recognition processing based on an image of the building. The drone may also measure the distance from the ground using a TOF sensor. The standard for measuring the height is set appropriately. By measuring the height using a method other than GPS, the drone can measure the height more accurately than if a method other than GPS is not used. Therefore, the drone can carry the package to the correct height of the building.

[0044] In the same way as when a delivery person makes a delivery, the delivery management device 100 detects the placement of the delivery by the robot. The delivery management device 100 also generates a confirmation image of the placement location when the placement is detected.

[0045] The detection unit 101 may detect the placement of the delivery by detecting a signal output by the robot when placing the delivery or when placement is completed. The detection unit 101 may also detect the state in which the delivery has been placed by detecting that the robot has released the arm that holds the delivery from the delivery.

[0046] The detection unit 101 may detect that the delivery has been placed by detecting that the robot has moved a predetermined distance away from the delivery. This allows the generation unit 102 to generate a confirmation image of the placement location photographed after the robot has moved a predetermined distance away from the delivery. Thus, the generation unit 102 can generate a confirmation image including the delivery and its surroundings. From the confirmation image including the surroundings, it may be possible to obtain information about the placement location, which will be described later in the description of the third embodiment of the present disclosure. For example, the recipient's belongings placed on the balcony serve as a landmark for the placement location. For example, location information may be obtained from the confirmation image.

[0047] (Variation) Photographing the surrounding area of ​​the placement location The camera 21 may have a wide angle of view, such as a 360-degree camera. The camera 21 may capture the exterior of the building, including the placement location and its surroundings. The generation unit 102 may generate an image including the exterior of the building as a confirmation image. This allows the recipient (or the carrier, etc.) to confirm whether the delivery has been placed in the correct location based on the relative positions of the exterior of the building and the placement location. For example, the camera 21 may capture the entire side of the building.

[0048] The generating unit 102 may generate a corroborative image in which the location is mapped by coloring the location in the corroborative image or by indicating the location with an arrow. The generating unit 102 may generate a corroborative image in which a mosaic process is performed on the exterior of the building other than the location. This makes it possible to generate a corroborative image that takes privacy into consideration when, for example, the camera 21 captures an image including the exterior of a neighboring house.

[0049] [Second embodiment] (composition) A delivery management system 1 according to the second embodiment will be described. Fig. 5 is a block diagram showing the configuration of the delivery management system 1 according to the second embodiment. The delivery management system 1 includes the delivery management device 100 according to the first embodiment, a wearable device 20, a delivery person terminal 200, a display terminal 300, and a server 400.

[0050] In the delivery management system 1 of the second embodiment, the wearable device 20, the delivery management device 100, and the deliveryman terminal 200 are communicatively connected to each other. The deliveryman terminal 200 is communicatively connected to the server 400, and the server 400 is communicatively connected to the display terminal 300.

[0051] The configuration of the delivery management system 1 according to the second embodiment will be described in detail below, but descriptions of the delivery management device 100 and the wearable device 20 that are similar to those of the first embodiment may be omitted.

[0052] The deliveryman terminal 200 is a terminal carried by a deliveryman. The deliveryman terminal 200 may be a small computer such as a smartphone, a mobile phone, a tablet terminal, or a wearable computer (such as a smart watch), or may be a personal computer.

[0053] The wearable device 20 and the deliveryman terminal 200 may be integrated or may be provided separately. The image captured by the camera 21 may be sent to the delivery management device 100 or the deliveryman terminal 200 via the communication unit 22.

[0054] The delivery person terminal 200 may receive and store a delivery list from the server 400. The delivery list is, for example, a list including information for identifying the deliveries that the delivery person is responsible for and information regarding the destinations of the deliveries. The information for identifying the deliveries may be a delivery item identifier represented by numbers or letters. The information regarding the destination may include the address, name, or telephone number of the recipient. The delivery list may include information regarding items. FIG. 6A is a diagram showing an example of a delivery list. The delivery person delivers the deliveries based on the delivery list.

[0055] The delivery management device 100 may transmit the generated confirmation image to the deliveryman terminal 200. The deliveryman terminal 200 may receive the confirmation image and transmit the received confirmation image to the server 400.

[0056] The server 400 may generate a delivery list and output the generated delivery list to the deliveryman terminal 200 carried by each deliveryman. The server 400 receives and stores the confirmation image. Furthermore, the server 400 outputs the confirmation image of the placement location to the display terminal 300.

[0057] The display terminal 300 is used by a carrier, a delivery person, a sender, or a recipient to check the confirmation image. The display terminal 300 is, for example, a smartphone, a personal computer, or a display of an intercom with a display.

[0058] The display terminal 300 requests the server to output a confirmation image. Furthermore, the display terminal 300 receives and displays the requested confirmation image. The display terminal 300 of the carrier can request confirmation images of all delivery personnel. The display terminal 300 of the delivery personnel requests confirmation images for deliveries for which the delivery personnel are responsible. The display terminals 300 of the sender and recipient request confirmation images for deliveries they are sending or receiving.

[0059] (operation) Hereinafter, the operation of the delivery management system 1 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a sequence diagram illustrating the operation of the delivery management system 1 according to the second embodiment.

[0060] The deliveryman terminal 200 receives a delivery list from the server 400. The deliveryman moves one by one to the addresses listed in the delivery list shown by the deliveryman terminal 200. When the deliveryman terminal 200 detects that the deliveryman has approached an address in the delivery list, the delivery management system 1 starts an image acquisition process. The approach to the address is detected using position information such as GPS and a map. The deliveryman terminal 200 instructs the wearable device 20 to start shooting, and the wearable device 20 starts shooting (step S201). The wearable device 20 transmits the captured image to the delivery management apparatus 100. If the image to be transmitted is a still image, the wearable device 20 repeats shooting and transmitting the still image at a predetermined time interval until an instruction to end shooting is received from the deliveryman terminal 200. The time interval is arbitrary, but is preferably within 10 seconds. If the image to be transmitted is a video, the wearable device 20 continues shooting and transmitting the video until an instruction to end shooting is received from the deliveryman terminal 200.

[0061] The detection unit 101 of the delivery management device 100 detects the placement of the delivery piece (step S202). Next, the generation unit 102 of the delivery management device 100 generates a confirmation image of the placement location when the detection unit 101 detects the placement (step S203). The delivery management device 100 transmits the generated confirmation image to the deliveryman terminal 200.

[0062] The deliveryman terminal 200 outputs the confirmation image to the server 400 (step S204). The server 400 stores the received confirmation image (step S205).

[0063] When the deliveryman terminal 200 detects that the deliveryman has left the address listed on the delivery list, it instructs the wearable device 20 to end image capture, and the wearable device 20 ends image capture (step S206). Note that the deliveryman may register information indicating the completion of delivery in the deliveryman terminal 200, which may then send an instruction to end image capture to the wearable device 20. This ends the image acquisition process.

[0064] Next, when the display terminal 300 requests a confirmation image from the server 400, the delivery management system 1 starts the image display process. Upon receiving the request, the server 400 transmits the requested confirmation image to the display terminal 300. The display terminal 300 displays the received confirmation image (step S207). This ends the image display process.

[0065] (effect) According to the second embodiment, it is possible to confirm an image that serves as confirmation of the placement of the delivery piece. This is because the server 400 outputs the confirmation image generated by the delivery management device 100 to the display terminal 300.

[0066] When a delivery list including a confirmation image is output to the display terminal 300 used by the delivery person, the delivery person can check at a glance whether the delivery item has been placed based on the presence or absence of the confirmation image. When a confirmation image is output to the display terminal 300 used by the transport company, the transport company's manager can determine whether the delivery person has made the delivery and whether the placement has been made in accordance with the rules established for the business. When a confirmation image is output to the display terminal 300 used by the sender, the sender can confirm that the delivery item has been placed without being lost en route. When a confirmation image is output to the display terminal 300 used by the recipient, the recipient can confirm that the delivery item has been placed at the correct destination.

[0067] (Modification) In the second embodiment, the case where the deliveryman terminal 200 transmits a confirmation image to the server 400 has been described. However, the delivery management device 100 may transmit the confirmation image to the server 400 without going through the deliveryman terminal 200.

[0068] The deliveryman terminal 200 or the server 400 receives a notification from the detection unit 101 that the placement has been detected, and may further transmit a notification regarding the placement to the recipient's mobile terminal or an intercom installed in the recipient's house.

[0069] The deliveryman terminal 200 may acquire location information of the deliveryman using a GPS or the like. When the deliveryman terminal 200 detects that the deliveryman has approached an address listed on the delivery list based on the acquired location information, the deliveryman terminal 200 may control the camera 21 to start up and start taking pictures. The deliveryman terminal 200 may transmit images captured by the camera 21 to the server 400. This allows the server 400 to transmit images of the area before and after the placement of the delivery item. The deliveryman terminal 200 may transmit images of areas other than the placement location with a lower resolution to the server 400. This allows the amount of communication to be reduced and privacy to be taken into consideration.

[0070] Furthermore, the deliveryman terminal 200 may transmit the acquired position information when the placement is detected to the server 400. The server 400 stores the acquired position information and the confirmation image in association with each other.

[0071] The delivery list may include information regarding whether or not a confirmation image is required. Some senders and recipients do not wish to have their placement location photographed. Furthermore, if the recipient receives the delivery directly or if the delivery is placed in the presence of the recipient, confirmation of placement is not required. Therefore, the deliveryman terminal 200 may determine whether or not a confirmation image is required based on the delivery list. If the deliveryman terminal 200 determines that a confirmation image is not required, it may control the camera 21 not to be activated.

[0072] When the server 400 receives the confirmation image, the server 400 may update the delivery list to include the confirmation image. Figure 6B shows an example of a delivery list including the confirmation image. For example, when the updated delivery list of Figure 6B is output to the display terminal 300 of the carrier, the carrier can easily check the confirmation image.

[0073] [Third embodiment] A delivery management device 100 according to the third embodiment will be described. The delivery management device 100 according to the third embodiment further includes a matching unit 103 so that the delivery management device 100 of the delivery management systems 1 according to the first and second embodiments can confirm the placement location. FIG. 8 is a block diagram showing the configuration of the delivery management device 100 according to the third embodiment. Note that the matching unit 103 according to the third embodiment may be included in the delivery personnel terminal 200 or the server 400.

[0074] In the following description, the description of the same configuration as in the first embodiment or the second embodiment may be omitted.

[0075] In the third embodiment, the generating unit 102 generates a confirmation image showing information related to the placement location. The information related to the placement location is information related to the landmark of the placement location. The information related to the placement location includes information specifying the placement location. The position information is included in the information specifying the placement location. When placement is at the front door, the information related to the placement location includes the name or room number displayed on the front door nameplate or door, and the decoration placed at the front door. Also, when the delivery is placed in a mailbox, the information related to the placement location includes the name or room number displayed on the mailbox.

[0076] The generation unit 102 may recognize the piece from the image acquired by the camera 21. At this time, the generation unit 102 may generate a confirmation image that shows both the piece and information related to the placement location.

[0077] The verification unit 103 verifies the placement location by verifying the information on the placement location indicated by the confirmation image with the information included in the delivery list. If the information indicated by the confirmation image matches the information included in the delivery list, the delivery management device 100 may transmit to the server 400 that placement has been completed.

[0078] The collation unit 103 may output the collation result to the delivery person terminal 200. The delivery person terminal 200 may display the collation result. This makes it possible to notify the delivery person whether the placement location is correct or not. Also, if the placement location is incorrect, the delivery person can relocate the delivery item. When the collation result is sent to the server 400, if the placement location is incorrect, the server 400 or the carrier can instruct the delivery person to relocate the delivery item.

[0079] In one example, the generation unit 102 uses image recognition technology to recognize a nameplate as information related to the placement location from an image captured when the placement of a delivery is detected. The generation unit 102 generates a confirmation image so that the recognized nameplate is included. The matching unit 103 may obtain the confirmation image from the generation unit 102 and recognize the name displayed on the nameplate by image recognition processing. The matching unit 103 matches the name shown in the confirmation image with the names included in the delivery list.

[0080] In another example, the matching unit 103 may obtain a confirmation image of a mailbox and recognize the room number displayed on the mailbox through image recognition processing. The matching unit 103 may match the room number shown in the confirmation image with the room number of the address included in the delivery list.

[0081] In another example, the matching unit 103 may use a label on which an identifier of the placement location is printed and attached near the placement location as information on the landmark of the placement location for matching. The identifier of the placement location is a character string or a code obtained by encoding a character string. The label is attached to a nameplate, a mailbox, a parcel receiving box, a front door, a wall of the entrance, etc. FIG. 12 is a diagram showing an example of a confirmation image including an identifier of the placement location and a delivery placed near the identifier. The matching unit 103 may match the identifier of the placement location included in the delivery list with the identifier indicated by the confirmation image. When the delivery is placed in front of a water, gas, or electricity meter, the identifier attached to the meter may be used as the identifier of the placement location.

[0082] The collation unit 103 may further collate the location information acquired by the deliveryman terminal 200 or the robot when the placement is detected with the location information of the destination included in the delivery list.

[0083] The server 400 may store information about the placement location in advance in association with the destination. The collation unit 103 may refer to the information about the placement location stored in the server 400 and collate the information about the placement location indicated by the confirmation image. The information about the placement location may be stored in the delivery person terminal 200 before placement. If the information about the placement location is displayed on the delivery person terminal 200, the delivery person can know in advance where to place the delivery.

[0084] (operation) Hereinafter, the operation of the delivery management device 100 according to the third embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart illustrating the operation of the delivery management device 100 according to the third embodiment.

[0085] FIG. 10 is a diagram showing an example of a delivery list according to the third embodiment. The delivery management device 100 acquires an identifier of a piece that the delivery person is to deliver from the delivery list. The delivery person terminal 200 may accept a selection of a piece that the delivery person is to deliver, and notify the delivery management device 100 of the selected identifier. The delivery person terminal 200 may also read the identifier of the piece attached to the piece, and notify the detection unit 101 of the read identifier. The delivery person terminal 200 may determine the piece that the delivery person is to deliver, based on location information of the delivery person.

[0086] In the following example, a case will be described in which a delivery person places a piece associated with a piece identifier "3." The detection unit 101 detects the act of the delivery person placing the piece at the placement location (step S301).

[0087] The generating unit 102 generates a confirmation image of the placement location when the placement of the delivery is detected, so as to include information on the placement location (step S302). Fig. 11 is a diagram showing an example of the generated confirmation image.

[0088] The collation unit 103 obtains information on the placement location indicated by the confirmation image. For example, from the confirmation image of FIG. 11, the collation unit 103 obtains the room number "201" posted on the door using image recognition technology. Furthermore, the collation unit 103 obtains information on the placement location included in the delivery list based on the identifier of the delivery item obtained from the delivery person terminal 200. For example, the collation unit 103 obtains from the delivery list of FIG. 10 that the destination of the delivery item with the delivery item identifier "3" is room 201. Next, the collation unit 103 compares the room number indicated by the confirmation image with the room number of the destination included in the delivery list (step S303). If the information on the placement location indicated by the confirmation image matches the information included in the delivery list (step S304: Yes), the delivery management device 100 ends the operation.

[0089] If the confirmation image and the information on the delivery list do not match and the delivery person rearranges the delivery piece (step S304: No), the delivery management device 100 executes steps S301 to S303 again.

[0090] (effect) According to the third embodiment, by comparing information regarding the destination contained in the delivery list with information regarding the placement location shown in the confirmation image, it is possible to confirm whether the delivery has been placed at the wrong address.

[0091] (Variation 1) Matching the address and location of the delivery In the third embodiment, the comparison unit 103 compares the information shown in the confirmation image with the information included in the delivery list. However, in the first modification, the comparison unit 103 may compare information about the destination attached to the piece shown in the confirmation image with information about the placement location shown in the confirmation image. Information about the destination includes an address, a name, or an encoded version of these.

[0092] An example will be described in which a delivery person places a piece in a mailbox as shown in Fig. 13A. When the generation unit 102 detects the delivery person placing the piece, it generates a confirmation image as shown in Fig. 13B. In this case, the generation unit 102 recognizes information indicating the destination attached to the piece, and generates a confirmation image indicating information regarding the destination.

[0093] The matching unit 103 acquires the name "SUZUKI" displayed on the mailbox as information related to the placement location through image recognition processing based on the confirmation image. Furthermore, the matching unit 103 acquires the addressee name "Suzuki" written on the mail piece as information related to the destination through image recognition processing based on the confirmation image. Next, the matching unit 103 compares the acquired name of the mailbox with the name of the mail piece.

[0094] According to the first modification, by comparing the information about the destination shown in the confirmation image with the information about the placement location, it is possible to confirm that the delivery has been delivered to the destination given to the delivery.

[0095] (Variation 2) Matching the brand and location of the delivery In the second modification, the matching unit 103 may match information on the brand of the delivery item shown in the confirmation image with information on the brand included in the delivery list. The delivery management system 1 according to the second modification can be applied to a case where a delivery person distinguishes brands of delivery items without destinations, such as newspapers and dairy products, and delivers them to multiple destinations.

[0096] In the following, an example will be described in which a newspaper delivery person delivers newspapers from multiple companies to each address according to a delivery list. FIG. 14A is a diagram showing an example of a delivery list according to Modification Example 2. The delivery list includes the address of the recipient, the name of the recipient, the brand of the delivery item, and whether or not the delivery has been completed. FIG. 14B is a diagram showing a state when the detection unit 101 detects the placement of a newspaper in a mailbox. For example, a name is displayed on the mailbox, and information indicating the brand is displayed on the newspaper.

[0097] 14C is a diagram showing an example of a confirmation image according to Modification Example 2. The matching unit 103 matches the name shown in the confirmation image, which is information related to the destination, with the name included in the delivery list. Furthermore, the matching unit 103 matches the brand included in the delivery list with the brand of the piece shown in the confirmation image. The matching unit 103 transmits the matching result to the delivery person terminal 200 or the server 400.

[0098] According to the second variant, by comparing the information regarding the brand of the delivery item shown in the confirmation image with the information regarding the brand included in the delivery list, it is possible to confirm whether the correct brand of product has been placed in the placement location. The delivery list may further include the number of pieces to be placed at the placement location. The matching unit 103 may match the number of pieces recognized from the confirmation image with the number of pieces included in the delivery list. If the pieces are newspapers, the matching unit 103 may recognize the number of newspapers based on the thickness of the newspapers in the confirmation image.

[0099] A delivery person may make placement errors, such as placing the wrong number of deliveries or placing deliveries of the wrong brand. Therefore, a collection point may be provided to store undelivered deliveries and excess deliveries. The collection point may be, for example, a convenience store. The recipient displays a confirmation image on the display terminal 300 used by the recipient at the collection point to indicate that a placement error has occurred, and receives the deliveries at the collection point. Instead of displaying the confirmation image, the display terminal 300 may display the collation result of the collation unit 103 to indicate that a placement error has occurred. If a collection point is used, the delivery person does not need to redeliver the deliveries.

[0100] [Hardware configuration] In each of the above-described embodiments, each component of the delivery management device 100 is represented as a functional block. Some or all of the components of each device, including the delivery management device 100, the deliveryman terminal 200, the display terminal 300, and the server 400, may be realized by any combination of a computer 500 and a program.

[0101] Fig. 15 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 15, the computer 500 includes, for example, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0102] The program 504 includes instructions for implementing each function of each device. The program 504 is stored in advance in the ROM 502, the RAM 503, or the storage device 505. The CPU 501 implements each function of each device by executing instructions included in the program 504. For example, the CPU 501 of the delivery management device 100 implements the functions of the delivery management device 100 by executing instructions included in the program 504. The RAM 503 may also store data to be processed in each function of each device. For example, a confirmation image of the delivery management device 100 may be stored in the RAM 503 of the computer 500.

[0103] The drive device 507 reads and writes data from and to the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and receives information input from a carrier or a recipient. The output device 510 is, for example, a display, and outputs (displays) information to the carrier or the recipient. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0104] It should be noted that the hardware configuration shown in FIG. 15 is merely an example, and other components may be added, or some components may not be included.

[0105] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0106] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits including a processor, etc., or a combination of these. These circuits may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0107] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be arranged in a centralized manner or in a distributed manner.

[0108] In addition, at least a part of the delivery management system 1 may be provided in a SaaS (Software as a Service) format. That is, at least a part of the functions for realizing the delivery management device 100 may be executed by software executed via a network.

[0109] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with each other without departing from the scope of the present disclosure.

[0110] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. [Appendix 1] A detection means for detecting placement of a delivery at a placement location; A generating means for generating a confirmation image of the placement location when the detection means detects the placement, Delivery management system. [Appendix 2] The detection means detects the placement by detecting an act of placing the delivery at the placement location. Attachment 1 describes a delivery management system. [Appendix 3] The detection means detects the action based on an image capturing the action of the delivery person or a sensor value measuring the action of the delivery person. Attachment 2, a delivery management system. [Appendix 4] The detection means detects the placement of the delivery by detecting a state in which the delivery is placed. A delivery management system according to any one of appendix 1 to 3. [Appendix 5] The detection means detects the placement state based on an image capturing the delivery person's actions or a sensor value measuring the delivery person's actions. Attachment 4, a delivery management system. [Appendix 6] The detection means detects the placement by detecting a state immediately before the placement. A delivery management system according to any one of appendix 1 to 5. [Appendix 7] The detection means detects the state immediately before the placement based on an image capturing the movement of the delivery person or a sensor value measuring the movement of the delivery person. Attachment 6, a delivery management system. [Appendix 8] The detection means detects the location of the delivery item based on the fact that the delivery person or the robot has left the delivery item. A delivery management system according to any one of appendix 1 to 7. [Appendix 9] The generating means generates the verification image showing information regarding the placement location. A delivery management system according to any one of appendix 1 to 8. [Appendix 10] The information about the location indicated by the confirmation image is any one of information about a nameplate, information about a mailbox, an identifier of the location, or location information. 9. A delivery management system as described in Appendix 9. [Appendix 11] Further, a verification means is provided for verifying information regarding the destination included in the delivery list with information regarding the placement location indicated by the confirmation image. 11. A delivery management system according to claim 9 or 10. [Appendix 12] a verification means for verifying information related to the destination and information related to the placement location, the verification image being displayed on the confirmation image, 11. A delivery management system according to claim 9 or 10. [Appendix 13] Detecting the placement of a delivery item in a placement location; Generate a confirmation image of the placement location when placement is detected How to manage delivery. [Appendix 14] A process of detecting placement of a delivery item at a placement location in a computer; and generating a confirmation image of the placement location when placement is detected.

[0111] This application claims priority based on Japanese Patent Application No. 2020-118333, filed on July 9, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0112] 1. Delivery management system 100 Delivery Management Device 101 Detection unit 102 Generation part 103 Matching Unit 20. Wearable Devices 200 Delivery Person Terminal 300 Display terminal 400 Servers 500 Computers

Claims

1. A detection means for detecting placement of a delivery item at a placement location based on an image of a delivery person's actions or a sensor value measuring the delivery person's actions; A generating means for generating a confirmation image of the placement location when the detection means detects the placement, Delivery management system.

2. A detection means for detecting placement of a delivery item at a placement location based on a fact that a delivery person or a robot has left the delivery item; A generating means for generating a confirmation image of the placement location when the detection means detects the placement, Delivery management system.

3. The detection means detects the placement by detecting at least one of an act of placing the delivery at the placement location, a state in which the delivery has been placed, and a state immediately before the delivery is placed. The delivery management system according to claim 1 or 2.

4. The generating means generates the verification image showing information regarding the placement location. A delivery management system according to any one of claims 1 to 3.

5. Further, a verification means is provided for verifying information regarding the destination included in the delivery list with information regarding the placement location indicated by the confirmation image. The delivery management system according to claim 4.

6. a verification means for verifying information related to the destination and information related to the placement location, the verification image being displayed on the confirmation image, The delivery management system according to claim 4.

7. Detecting the placement of a delivery item at a placement location based on an image capturing the movement of a delivery person or a sensor value measuring the movement of the delivery person; Generate a confirmation image of the placement location when placement is detected How to manage delivery.

8. Detecting placement of a delivery item at a placement location based on a delivery person or a robot leaving the delivery item; Generate a confirmation image of the placement location when placement is detected How to manage delivery.

9. A process of detecting placement of a delivery item at a placement location based on an image of the delivery person's actions or a sensor value measuring the delivery person's actions in a computer; and generating a confirmation image of the placement location when placement is detected.

10. A process of detecting placement of the delivery item at a placement location based on a fact that the delivery person or the robot has left the delivery item in a computer; and generating a confirmation image of the placement location when placement is detected.

Images