Program and collection support method

Abstract

To provide a collection support device capable of identifying a collection target at a place indicated in a cargo collection request even when information for identifying the cargo is not added to the cargo.SOLUTION: A collection support device comprises: determination means for determining whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of an object located at a location related to the collection request; and output means for outputting a determination result.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a collection assistance device and the like. [Background technology]

[0002] In order to efficiently deliver packages, a service is being offered in which a worker from a collection and delivery company (hereinafter simply referred to as a worker) leaves the package at a location designated by the recipient. In addition, a service is being considered in which a person requesting collection leaves the package at a collection location designated by the person, such as in front of the front door, and a worker picks it up. In such a collection service, it is necessary to identify the package to be collected at the collection location.

[0003] For example, Patent Document 1 discloses an aircraft that detects a sign for identifying a package to be collected in an image of a collection area, obtains the collection location of the package based on the position of the sign, and flies to the collection location. In Patent Document 1, the sign is a code indicating the identification information of the package, and is attached to the package to be collected or to the case in which the package is stored.

[0004] As a related technique, Patent Document 2 discloses a technique for indicating the location of items to be collected at an item collection site such as an item warehouse. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2019-006356 A [Patent Document 2] Patent No. 5247854 Summary of the Invention [Problem to be solved by the invention]

[0006] When using the air vehicle of Patent Document 1, the person requesting collection must prepare a case with a label attached or attach a label to the package. In other words, the person requesting collection must attach information identifying the package to be collected to the package. Here, the information identifying the package is an identification number, code (including a barcode and a two-dimensional code) that identifies the package, such as the label, printed on the package or on a collection slip or the like that is affixed to the package. Generally, the package to be collected is identified by such information identifying the package.

[0007] One of the objectives of the present disclosure is to solve the above-mentioned problems and provide a collection support device, etc. that can identify the item to be collected at the location indicated in the collection request even if information identifying the item is not attached to the item. [Means for solving the problem]

[0008] The collection support device of the present disclosure includes a determination means for determining whether an object is a collection target based on information regarding the appearance of the object and information regarding the appearance of an object located at a location related to a collection request, and an output means for outputting the determination result.

[0009] The collection support method of the present disclosure determines whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of an object located at a location related to a collection request, and outputs the determination result.

[0010] The program recording medium of the present disclosure non-temporarily records a program that causes a computer to execute a determination process that determines whether an object is a collection target based on information regarding the appearance of the object and information regarding the appearance of an object at a location related to a collection request, and an output process that outputs the determination result. Effect of the Invention

[0011] According to the present disclosure, even if information identifying a package is not attached to the package, the package can be identified as a pickup target at the location indicated in the pickup request. [Brief description of the drawings]

[0012] [Figure 1] 1 is a block diagram illustrating a configuration of a collection support system 1 according to a first embodiment. [Diagram 2] 1 is a block diagram illustrating a configuration of a collection support device 100. FIG. [Diagram 3] 4 is a flowchart illustrating a process of the collection support device 100. [Figure 4] 4 is a sequence diagram showing an example of the operation of the collection support system 1. FIG. [Diagram 5] FIG. 13 is a diagram showing an example of a collection request screen. [Figure 6] FIG. 13 is a diagram showing an example of a confirmation screen. [Figure 7] FIG. 13 is a block diagram illustrating a configuration of a collection support system 1 according to a modified example. [Figure 8] FIG. 5 is a block diagram showing an example of the hardware configuration of a computer 500. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [First embodiment] In the first embodiment, a case will be described in which a collection and delivery company instructs a worker to collect a package based on a collection request from a collection requester, and the worker collects the package placed at the collection location. The collection requester can appropriately select a location at the collection location, for example, next to the front door, in a mailbox, in a package receiving box, or in a locker. The worker may receive the package from a person at the collection location. The package may be three-dimensional or flat. The collected package is, for example, collected at a package collection point, and then delivered to the delivery location indicated in the collection request.

[0014] (composition) 1 is a block diagram illustrating the configuration of a collection support system 1 according to the first embodiment. The collection support system 1 includes a collection support device 100, a sender terminal 200, and a worker terminal 300.

[0015] The collection support device 100 is a server used by a collection and delivery company. In the first embodiment, the collection support device 100 receives information on the appearance of the collection target A related to the collection request from the sender terminal 200. Furthermore, in the first embodiment, the collection support device 100 receives information on the appearance of the object X placed at the collection location from the worker terminal 300. The information on the appearance includes, for example, photographed data of the object (collection target A or object X), the size of the object, and the three-dimensional shape (three-dimensional shape) of the object. Furthermore, the information on the appearance may include information on the color, pattern, or type of package of the object. The information on the type of package is, for example, information indicating whether the object is in a cardboard box, a paper bag or a plastic bag, or wrapped in cushioning material. The photographed data to be received may be a still image or a video.

[0016] The sender terminal 200 is a mobile phone, tablet, personal computer, etc., used by a user requesting collection. The sender terminal 200 accepts input of a collection request by a user. The sender terminal 200 is equipped with a camera that photographs collection target A. If the sender terminal 200 does not have a camera, it may receive photographed data of collection target A from an external device (not shown). The sender terminal 200 transmits the photographed data of collection target A to the collection support device 100. The sender terminal 200 also generates a collection request including a collection location and transmits it to the collection support device 100.

[0017] The collection request generated by the sender terminal 200 may include the address of the collection location, as well as the location of the collection target A at the collection location, such as next to the front door, in a mailbox, in a parcel receiving box, etc. Furthermore, the collection request may include the sender's desired collection time period, the weight of the collection target A, or information identifying the collection requester.

[0018] The worker terminal 300 is a mobile phone, tablet, wearable device, etc., used by a worker who collects the collection target A. The worker terminal 300 is equipped with a camera that captures an image of the object X placed at the collection location. The worker terminal 300 may receive image data of the object X from an external device (not shown). The worker terminal 300 transmits the image data of the object X to the collection support device 100. Furthermore, the worker terminal 300 may receive a determination result from the collection support device 100 and display it on a display (not shown).

[0019] In various modified examples, when photographed data is not used, the client terminal 200 and the worker terminal 300 do not need to be equipped with a camera. In this case, the client terminal 200 and the worker terminal 300 do not need to receive photographed data from an external device.

[0020] 2 is a block diagram illustrating an example of the configuration of the collection support device 100. The collection support device 100 includes a determination unit 101 and an output unit 102.

[0021] The determination unit 101 determines whether the object is a collection target based on information about the appearance of the collection target and information about the appearance of an object located at a position related to the collection request.

[0022] The output unit 102 outputs the result of the determination made by the determination unit 101. The result of the determination includes whether the object at the position related to the collection request is a collection target or not a collection target. In the first embodiment, the output unit 102 outputs the determination result to, for example, the worker terminal 300.

[0023] The determination method used by determining section 101 will be described below.

[0024] (Determined based on photographic data) The determination unit 101 may determine whether an object is a collection target by using image data obtained by photographing the object as information regarding the external appearance of the object.

[0025] In this case, the sender places the collection target A in an arbitrary location, and uses the sender terminal 200 to photograph the collection target A from one or more directions to obtain photographed data. For example, if a certain direction toward the collection target A having a three-dimensional shape is defined as the front, the sender may photograph it from two or more directions so that the appearance when viewed from six directions, the front, back, left and right sides, top, and bottom, can be understood. Note that photographing some surfaces, such as the bottom, may be omitted as appropriate.

[0026] The worker uses the worker terminal 300 to photograph the object X placed at the collection location from one or more directions and acquires the photographed data. The worker may photograph the object X from two or more directions in the same manner as the requester.

[0027] The determination unit 101, for example, determines whether the photographed data of the collection target A from one direction matches any of the photographed data of the object X from multiple directions. Alternatively, the determination unit 101 may determine whether the photographed data of the object X from one direction matches any of the photographed data of the collection target A from multiple directions. Here, the determination unit 101 may use, for example, a known image similarity calculation technique to compare the photographed data of the object X with the photographed data of the collection target A to calculate the similarity, and determine that the photographed data match when the similarity is equal to or greater than a threshold value. In this case, the determination unit 101 calculates the similarity using, for example, the color or pattern of each area in the photographed data, and the shape of the object included in the photographed data as a feature.

[0028] In addition, the determination unit 101 may use a known pattern matching technique to compare an image of object X extracted from the shooting data with an image of collection target A to calculate a similarity, and determine that the shooting data match if the similarity is equal to or greater than a threshold value.

[0029] Then, the determination unit 101 determines that the object X is the collection target A, for example, when the photography data of the object X matches the photography data of the collection target A in a predetermined number or more pairs of photography data of the collection target A and the photography data of the object X.

[0030] The photographed data taken during collection may include images of multiple objects X. In this case, the determination unit 101 may, for example, extract images of the multiple objects X, and compare the images with the image of the collection target A. Then, the determination unit 101 determines, for example, an object X having a higher similarity than other objects X among the multiple objects X, as the collection target A.

[0031] Furthermore, the collection target A related to the collection request may be photographed by the sender terminal 200 while the collection target A is placed at the collection location, and photographed data including the background of the collection target A may be acquired. Similarly, photographed data including the background of the object X may be acquired by the worker terminal 300. In this case, the determination unit 101 may compare the photographed data of the collection target A including the background with the photographed data of the object X including the background. This makes it possible to prevent the collection of an object placed at a location different from the collection request.

[0032] (Determined by size) The determination unit 101 may further determine whether the object X is the collection target A based on the size of the collection target A and the size of the object X at the collection location. This allows the determination unit 101 to distinguish between objects that are similar in shape but different in size.

[0033] In this case, the determination unit 101 may further include a measurement unit (not shown) that measures the size of the objects (collection target A and object X) from the photographed data. Some or all of the functions of the measurement unit may be provided in the sender terminal 200 and the worker terminal 300. In this case, the determination unit 101 receives the measured size of the object from the sender terminal 200 and the worker terminal 300.

[0034] The measurement unit recognizes the shape of the object using existing image recognition technology from image data captured from one direction, for example. The measurement unit then measures the size of the object. For example, the measurement unit measures the height and width of the object when viewed from one direction. The measurement unit may measure the length of each side of the recognized object's shape, or the length from one side to another side, or the length from the center of gravity of the shape to any point on the contour, etc.

[0035] The measuring unit may measure the size of the object using the parallax between two pieces of image data captured from approximately the same direction, for example. The measuring unit may measure the size of the object based on the size of a reference object of known size that is captured together with the object.

[0036] The measurement unit may predict the three-dimensional shape of the object in the depth direction from the image capture data from one direction, and measure the depth as the size of the object in addition to the height and width of the object.

[0037] The measurement unit may also recognize the shape of the target object and measure the size of the target object based on distance information instead of the imaging data. The distance information indicates the distance between the object and the sensor. In this case, the distance information is acquired by an infrared sensor or the like provided in the client terminal 200 and the worker terminal 300, and transmitted to the measurement unit. When the distance information is used, it is not necessary to use the imaging data to measure the size.

[0038] The measurement section may further measure the size of the object viewed from other directions using a similar technique.

[0039] The determination unit 101 may further include a matching unit (not shown) that matches the size of the collection target A seen from one or more directions with the size of the object X seen from one or more directions. When the difference in size between the collection target A and the object X is within a predetermined error range, the matching unit determines that the sizes of the collection target A and the object X match.

[0040] Then, the determination unit 101 determines that the object X is the collection target A, for example, when the photographing data of the object X and the photographing data of the collection target A match and the size of the object X and the size of the collection target A match.

[0041] The collation unit may collate whether the size of the collection target A in a certain direction matches any of the sizes of the object X from multiple directions. In this case, the determination unit 101 may determine that the object X is the collection target A when the measured sizes match in a set of two or more directions.

[0042] (Determination based on 3D shape) The determination unit 101 may determine the collection target A based on the three-dimensional data of the collection target A related to the collection request and the three-dimensional data of the object X at the collection location.

[0043] The three-dimensional data represents, for example, the position of the surface of the object in a predetermined three-dimensional coordinate space. The three-dimensional data indicates the three-dimensional shape of the object, and may also indicate the size of the object. Since the three-dimensional data can be compared to compare the three-dimensional shapes of the objects, the determination unit 101 can distinguish even collection objects whose shapes change depending on the viewing direction.

[0044] The determination unit 101 may include a three-dimensional data generation unit (not shown) that generates the three-dimensional data. The determination unit 101 compares the generated three-dimensional data of the object X with the three-dimensional data of the collection target A. The resolution of the three-dimensional data may be such that the overall shape can be roughly measured. The function of the three-dimensional data generation unit may be included in the sender terminal 200 and the worker terminal 300. In this case, the determination unit 101 receives the three-dimensional data from the sender terminal 200 and the worker terminal 300.

[0045] For example, the three-dimensional data generation unit may generate three-dimensional data using image data of an object photographed from multiple directions received from the client terminal 200 or the worker terminal 300. The three-dimensional data generation unit may estimate a three-dimensional shape of the object from one or more still images and generate three-dimensional data.

[0046] The three-dimensional data generating unit may generate three-dimensional data based on 3D scan data of the object obtained using infrared rays or a laser provided in the sender terminal 200 or the worker terminal 300. When the collection support device 100 does not use the photographed data to generate the three-dimensional data, it does not need to receive the photographed data from the sender terminal 200 and the worker terminal 300.

[0047] The determination unit 101 may include a matching unit (not shown) that matches the three-dimensional shape of the object. The matching unit uses a known three-dimensional (three-dimensional) shape similarity calculation technique to compare the three-dimensional data of the object X with the three-dimensional data of the collection target A to calculate the similarity, and determines that the three-dimensional shapes match when the similarity is equal to or greater than a threshold value.

[0048] Then, the determination unit 101 determines that the object X is the collection target A when the three-dimensional shape of the object X and the three-dimensional shape of the collection target A match.

[0049] (Compare the images when held in hand) The collection target A and the object X at the collection location may be photographed while being held in the hands of the collection requester or worker. In this case, the determination unit 101 may compare the photographed data, the size of the object, and the three-dimensional shape of the object, excluding the hand included in the photographed data or three-dimensional data, based on the color, shape, position, etc. of the hand.

[0050] (operation) 3 is a flowchart illustrating the process of the collection support device 100. The determination unit 101 determines whether the object is a collection target based on information about the appearance of the collection target and information about the appearance of the object at the position related to the collection request (step S101). The output unit 102 outputs the determination result (step S102).

[0051] FIG. 4 is a sequence diagram showing an example of the operation of the collection support system 1. In FIG. 4, a case where photographed data of an object is used will be described. First, the sender terminal 200 photographs the collection object located at the collection requester (step S201). Next, the sender terminal 200 transmits a collection request including photographed data of the collection object and information specifying the collection location to the collection support device 100. FIG. 5 is a diagram showing an example of a collection request screen displayed on the sender terminal 200 when accepting input of information related to the collection request. For example, the sender inputs the collection date and time, the collection location, the destination of the package, and photographed data of the collection object A on the collection request screen.

[0052] When the collection support device 100 accepts a collection request (step S202), it transmits a collection instruction to the worker terminal 300. The collection instruction includes the collection date and time, and the collection location. Furthermore, the collection instruction may include photographed data of the collection target A related to the collection request. Upon seeing the delivery instruction, the worker heads to the collection location indicated in the collection instruction on the collection date and time. The worker searches for the collection target using the photographed data of the collection target A related to the collection request as a reference. The worker terminal 300 photographs the object X found by the worker at the collection location (step S203) and transmits the photographed data to the collection support device 100.

[0053] The determination unit 101 of the collection support device 100 determines whether the photographed object X is the collection target A based on the received photographed data of the object (step S204). Next, the output unit 102 of the collection support device outputs the determination result (step S205) and transmits the determination result to the worker terminal 300.

[0054] The worker checks the determination result displayed on the display of the worker terminal 300, and if the photographed object is a collection target, collects the object. The worker terminal 300 transmits a collection completion notice to the sender terminal 200 via the collection support device 100. The collection support device 100 may transmit a collection completion notice including the photographed data used to determine the collection target to the sender terminal 200.

[0055] (effect) According to the first embodiment, even if information for identifying a package is not attached to the package, the package can be identified as a collection target at the location indicated in the collection request because the determination unit 101 determines whether the object is a collection target based on information on the appearance of the collection target and information on the appearance of an object at the location related to the collection request.

[0056] In the present disclosure, after the collection support device 100 identifies the collection target, a worker may add information identifying the package to the collection target. For example, a printing unit (not shown) of the worker terminal 300 may print a collection slip based on the collection request when the collection target is identified. The collection slip indicates, for example, an identification number that is assigned by the collection support device 100 or the like to identify the collection request or package, and the destination of the package included in the collection request. The worker attaches the printed collection slip to the collection target.

[0057] [Second embodiment] In the second embodiment, the process of the collection support system 1 when the collection target cannot be identified will be described. Regarding the configuration of the second embodiment, the description of the same configuration as the first embodiment will be omitted.

[0058] (If there are no candidates for collection) If there is no object at the collection location, the worker terminal 300 cannot transmit information regarding the appearance of the object X to the collection support device 100. In this case, the worker terminal 300 may transmit an image of the collection location and location information of the current location to the collection support device 100. The determination unit 101 compares the received image and location information of the collection location with the image and location information related to the collection request, and determines that collection target A is not at the collection location.

[0059] In addition, when the calculated similarity is less than the threshold value as a result of the comparison between the object X and the collection target A related to the collection request, the determination unit 101 cannot identify the collection target A. When the collection target cannot be identified based on the information on the appearance of the object, the collection support device 100 may transmit the photographed data of the object X placed at the collection position to the sender terminal 200 and request the collection requester to confirm. FIG. 6 is a diagram showing an example of a confirmation screen displayed on the display of the sender terminal 200. When "Yes" is selected in FIG. 6, the determination unit 101 determines that the object X is the collection target A. When "No" is selected in FIG. 6, the determination unit 101 determines that the object X is not a collection target. When the collection support device 100 outputs the result that the object X is not a collection target, the worker terminal 300 may transmit information on the appearance of another object X to the collection support device 100. In addition, the worker terminal 300 may perform the operation when there is no object at the collection position described above.

[0060] In this way, when there is no candidate for collection target A, such as when there is no object at the collection location or when it is not possible to determine that object X is collection target A, the worker terminal 300 may transmit a collection cancellation to the collection support device 100. The collection support device 100 may transmit a collection cancellation notice including an image of the collection location to the sender terminal 200.

[0061] (If there are multiple candidates for collection) When multiple objects X are detected whose photographed data matches that of collection target A as a result of comparing object X at the collection location with collection target A, the determination unit 101 cannot determine the collection target. In this case, the collection support device 100 sets the detected multiple objects X as candidates for collection targets and transmits photographed data including the multiple candidates to the sender terminal 200. The sender terminal 200 displays the photographed data and accepts the selection of collection target A from the collection requester. The determination unit 101 determines that the selected object X is collection target A. The collection support device 100 notifies the worker terminal 300 of the object X selected in the determination result, and the worker collects the selected collection target A.

[0062] If no selection is made by the collection requester, for example, the collection support device 100 may transmit an instruction to cancel collection to the worker terminal 300.

[0063] (effect) According to the second embodiment, even if the collection support device 100 cannot identify the collection target A based on information on the appearance of the target, it is possible to identify the collection target. This is because the collection support device 100 transmits photographic data of the object X to the collection requester, and the determination unit 101 determines that the object X is the collection target A based on the input by the collection requester.

[0064] [Variation] Collection by robot In each of the above-described embodiments, the collection of parcels may be performed by a robot. That is, in the above description, the actions of the worker may be replaced with operations performed by the robot. The robot that collects parcels includes unmanned ground vehicles and unmanned aerial vehicles (drones). In this modification, the worker terminal 300 is replaced with a robot. Also, the collection support device 100 may be mounted on the robot, or may be provided in a server of a collection and delivery company that manages the robot.

[0065] Fig. 7 is a block diagram illustrating the configuration of the collection support system 1 according to this modification. In this modification, the collection support device 100 may include, in addition to the configuration described in the above embodiment, an instruction unit 103 that instructs the robot to collect the item at the location related to the collection request. Regarding the other configuration shown in Fig. 7, the description of the parts similar to the configuration of the above embodiment will be omitted.

[0066] The robot acquires its location information using a global positioning system (GPS) or the like. The robot may store images of roads, building exteriors, building interiors, etc. in advance in association with a map, and acquire its current location information by comparing the stored images with images captured by a camera. When an airborne drone collects packages, the drone may collect packages placed on a balcony of a building.

[0067] As in the case of a worker collecting a package, the robot, at the location related to the collection request, transmits information on the appearance of object X acquired from object X at that location to the collection support device 100. The output unit 102 of the collection support device 100 notifies the robot of the determination result. When the robot is notified that object X is collection target A, it collects object X. When collecting the package, the robot may grab object X with an arm, or may hook the object with an arbitrary mechanism.

[0068] [Variation] Packaging service The worker or robot may bring a case such as a box that fits the object to be collected to the collection location according to the three-dimensional data related to the collection request. After the object to be collected is identified, the worker or robot stores the object in the case. The robot may also use the three-dimensional data of object X at the collection location to pack the object to be collected using a freely deformable packing material. The robot may use, for example, an expandable box or sheet as the packing material.

[0069] If a packing service like this modified example is adopted, the person requesting collection does not need to pack the items to be collected.

[0070] [Modification] Other application examples The present disclosure may be used for collecting garbage and recyclable items in addition to collecting deliveries. For example, a user who wishes to have garbage collected uses a sender terminal 200 to take a picture of the garbage and transmit a collection request (collection request) to the collection support device 100. A garbage collector transmits a collection instruction to a worker terminal 300. When the determination unit 101 determines that garbage placed at the instructed location is to be collected, the worker collects the garbage.

[0071] [Hardware configuration] In each of the above-described embodiments, each component of the collection support device 100 represents a functional block. Some or all of the components of each device (collection support device 100, sender terminal 200, worker terminal 300) may be realized by any combination of a computer 500 and a program. The collection support device 100 and the sender terminal 200 may be realized by a single computer 500. The collection support device 100 and the worker terminal 300 may be realized by a single computer 500. In this case, the worker terminal 300 may include each component of the collection support device 100 (determination unit 101, output unit 102).

[0072] Fig. 8 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 8, the computer 500 includes, for example, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0073] The program 504 includes instructions for implementing each function of each device. The program 504 is stored in advance in the ROM 502, the RAM 503, or the storage device 505. The CPU 501 implements each function of each device by executing the instructions included in the program 504. For example, the CPU 501 of the collection support device 100 implements the functions of the collection support device 100 by executing the instructions included in the program 504. The RAM 503 may also store data to be processed in each function of each device. For example, a collection request for the collection support device 100 may be stored in the RAM 503 of the computer 500.

[0074] The drive device 507 reads and writes data from the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and receives input of information from a collection and delivery company or the like. The output device 510 is, for example, a display, and outputs (displays) information to the collection and delivery company or the like. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0075] It should be noted that the hardware configuration shown in FIG. 8 is merely an example, and other components may be added, or some components may not be included.

[0076] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0077] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits including a processor, etc., or a combination of these. These circuits may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0078] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be arranged in a centralized manner or in a distributed manner.

[0079] At least a part of the collection support system 1 may be provided in a SaaS (Software as a Service) format. That is, at least a part of the functions for realizing the collection support device 100 may be executed by software executed via a network.

[0080] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with each other without departing from the scope of the present disclosure.

[0081] A part or all of the above-described embodiments may be described as, but are not limited to, the following supplementary notes.

[0082] [Appendix 1] A determination means for determining whether an object is a collection target based on information about the appearance of the object and information about the appearance of an object located at a location related to the collection request; An output means for outputting the result of the determination; A collection assistance device comprising: [Appendix 2] The determination means determines whether the object is the collection target by comparing the photographing data of the collection target with the photographing data of the object as the information regarding the appearance. 2. A collection assistance device as described in claim 1. [Appendix 3] The photographic data of the collection target and the photographic data of the object include a background of the collection target and a background of the object, respectively. 3. A collection assistance device as described in appendix 2. [Appendix 4] The determination means determines whether the object is the collection target by comparing the shape of the collection target with the shape of the object as the information on the appearance. 4. A collection support device according to any one of claims 1 to 3. [Appendix 5] and an instruction means for instructing the robot to collect the package at the location when the collection request is accepted, The output means notifies the robot of the result of the determination, The robot transmits information regarding the appearance of the object obtained from the object at the location to the collection support device, and collects the object when notified by the collection support device that the object is the object to be collected. 5. A collection support device according to any one of claims 1 to 4. [Appendix 6] When the determination means cannot determine that the object is the collection target based on the information on the appearance, the determination means transmits photographic data of the object to the collection requester, and determines whether the object is the collection target based on an input by the collection requester. 6. A collection support device according to any one of claims 1 to 5. [Appendix 7] When it is not possible to determine that the object is the collection target, the similarity between the object and the collection target is less than a threshold value, or when there are multiple candidates for the collection target. 7. A collection assistance device as described in appendix 6. [Appendix 8] When there is no candidate for the collection target, the determination means determines that the collection target is not present at the location based on an image captured at the location. 8. A collection support device according to any one of claims 1 to 7. [Appendix 9] If it is not possible to determine that the object is the object to be collected, or if there is no object at the location, notify the requester of the cancellation of the collection. 9. A collection support device according to any one of claims 1 to 8. [Appendix 10] determining whether the object is a collection target based on information regarding the appearance of the object and information regarding the appearance of an object at a location related to the collection request; Output the judged result. Collection assistance methods. [Appendix 11] determining whether the object is the collection target by comparing the photographing data of the collection target with the photographing data of the object as the information regarding the appearance; A collection assistance method as described in Appendix 10. [Appendix 12] The photographic data of the collection target and the photographic data of the object each include a background of the collection target and a background of the object, The collection assistance method described in Appendix 11. [Appendix 13] determining whether the object is the collection target by comparing the shape of the collection target with the shape of the object as the information on the appearance; 13. A collection assistance method according to any one of appendixes 10 to 12. [Appendix 14] When the pickup request is accepted, instructing a robot to pick up the package at the location; receiving from the robot at the location information regarding an appearance of the object obtained by the robot from the object at the location; notifying the robot of the result of the determination; The robot collects the object when notified that the object is the object to be collected. 14. A collection assistance method according to any one of appendixes 10 to 13. [Appendix 15] If it is not possible to determine that the object is the collection target based on the information regarding the appearance, transmitting photographic data of the object to a collection requester, and determining whether the object is the collection target based on an input by the collection requester. A collection assistance method according to any one of appendixes 10 to 14. [Appendix 16] On the computer, a determination process for determining whether an object is a collection target based on information about the appearance of the object and information about the appearance of an object at a location related to the collection request; and an output process for outputting the determined result. [Appendix 17] The determination process determines whether the object is the collection target by comparing the photographing data of the collection target with the photographing data of the object as the information on the appearance. 17. A program recording medium according to claim 16. [Appendix 18] The photographic data of the collection target and the photographic data of the object include a background of the collection target and a background of the object, respectively. 18. A program recording medium as described in appendix 17. [Appendix 19] The determination process determines whether the object is the collection target by comparing a shape of the collection target with a shape of the object as information about the appearance. 19. A program recording medium according to any one of appendices 16 to 18. [Appendix 20] The program includes a process of instructing a robot to collect the package at the location when the collection request is accepted; receiving from the robot at the location information regarding an appearance of the object obtained from the object at the location; The output process notifies the robot of the result of the determination, The robot collects the object when notified that the object is the object to be collected. 20. A program recording medium according to any one of appendices 16 to 19. [Appendix 21] The program further includes a process of transmitting photographic data of the object to a collection requester when the object cannot be determined to be the collection target based on the information on the appearance, and determining whether the object is the collection target based on an input by the collection requester. 21. A program recording medium according to any one of appendices 16 to 20. [Explanation of symbols]

[0083] 100 Collection support device 101 Judgment section 102 Output section 200 Client terminal 300 Worker terminal 500 Computers

Claims

1. A determination means for determining whether an object is a collection target by comparing information on the appearance of the collection target based on image data obtained by a collection requester photographing the appearance of the collection target with information on the appearance of the object based on image data obtained by a collection requester photographing the appearance of the object at the location related to the collection request; An output means for outputting the determined result to the terminal of the collector.

2. 2. The collection support device according to claim 1, wherein the determination means determines whether the object is the collection target by comparing image data of the collection target with image data of the object as the information regarding the appearance.

3. The collection support device according to claim 2, wherein the determination means, in addition to comparing the collection target with the object, determines whether the object is the collection target by comparing a background of the collection target contained in the photographed data with a background of the object.

4. The collection support device according to claim 1 , wherein the determination means determines whether the object is the collection target by comparing a shape of the collection target with a shape of the object as the information regarding the appearance.

5. The method further includes an instruction unit that instructs the robot to collect the package at the location when the collection request is accepted, and an information acquisition unit that acquires information, the information acquiring means acquires, from the robot in response to an instruction from the instruction means, information relating to an external appearance of the object at the position acquired from the object; The collection support device according to any one of claims 1 to 4, wherein the output means notifies the robot of the result of the judgment, and if the result indicates that the object is to be collected, requests the robot to collect the object.

6. The collection support device according to any one of claims 1 to 5, wherein when the determination means cannot determine that the object is the collection target based on the information regarding the appearance, it transmits photographic data of the object to the collection requester and determines whether the object is the collection target based on input by the collection requester.

7. When it is not possible to determine that the object is the collection target, the similarity between the object and the collection target is less than a threshold value, or when there are multiple candidates for the collection target. The collection assistance device according to claim 6.

8. When there is no candidate for the collection target, the determination means determines that the collection target is not present at the location based on an image captured at the location. A collection support device according to any one of claims 1 to 7.

9. The computer By comparing information on the appearance of the collection target based on the photographing data obtained by the collection requester photographing the appearance of the collection target with information on the appearance of the object based on the photographing data obtained by the collection requester photographing the appearance of the object at the location related to the collection request, it is determined whether the object is the collection target; The result of the determination is output to the terminal of the collector. Collection assistance methods.

10. A determination process for determining whether an object is a collection target by comparing information on the appearance of the object based on image data obtained by the collection requester photographing the appearance of the object with information on the appearance of the object based on image data obtained by the collection requester photographing the appearance of the object at the location related to the collection request; A program that causes a computer to execute an output process that outputs the judgment results to the collector's terminal.

Images