Program and collection support method

Abstract

To provide a collection support device capable of identifying a collection target at a place indicated in a cargo collection request even when information for identifying the cargo is not added to the cargo.SOLUTION: A collection support device comprises: determination means for determining whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of an object located at a location related to the collection request; and output means for outputting a determination result.SELECTED DRAWING: Figure 2

Description

Technical Field

[0006] , , , , ,

[0001] The present disclosure relates to a cargo consolidation support device and the like.

Background Art

[0002] In order to efficiently deliver goods, a service is provided where a worker of a logistics provider (hereinafter simply referred to as a worker) places the goods at a placement location designated by the recipient. Also, consideration is being given to providing a service where the shipper places the goods to be consolidated at a consolidation location designated by the shipper, such as in front of the entrance door, and the worker performs the consolidation. In such a consolidation service, it is necessary to identify the goods to be consolidated at the consolidation location.

[0003] For example, Patent Document 1 discloses a flying object that detects a label for identifying goods to be consolidated in an image of a consolidation area, obtains the consolidation position of the goods based on the position of the label, and flies to the consolidation position. In Patent Document 1, the label is a code indicating identification information of the goods and is attached to the goods to be consolidated or the case storing the goods.

[0004] As related art, Patent Document 2 discloses a technique for presenting the position of goods to be consolidated at a goods collection site such as a goods warehouse.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] When using the aircraft described in Patent Document 1, the person requesting collection must either prepare a case with a mark attached or affix the mark to the package. In other words, the person requesting collection must attach information to the package to identify the package to be collected. Here, the information identifying the package is an identification number, code (including barcodes and 2D codes), etc., that identifies the package, such as the mark mentioned above, and is printed on the package or on the collection slip attached to the package. Generally, the package to be collected is identified by such information that identifies the package.

[0007] One of the purposes of this disclosure is to solve the above-mentioned problems and to provide a collection support device that can identify the items to be collected at the location indicated in the collection request, even when information identifying the items is not attached to the items. [Means for solving the problem]

[0008] The collection support device according to this disclosure includes a determination means for determining whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of an object located at the location related to the collection request, and an output means for outputting the result of the determination.

[0009] The collection support method relating to this disclosure determines whether an object is the object to be collected based on information regarding the appearance of the object to be collected and information regarding the appearance of the object located at the location related to the collection request, and outputs the result of the determination.

[0010] The program recording medium relating to this disclosure non-temporarily stores a program that causes a computer to perform a determination process to determine whether an object is the object to be collected, based on information regarding the appearance of the object to be collected and information regarding the appearance of the object at the location related to the collection request, and an output process to output the result of the determination. [Effects of the Invention]

[0011] According to this disclosure, even if information identifying the package is not attached to the package, the package can be identified at the location indicated in the pickup request. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram illustrating the configuration of the collection support system 1 according to the first embodiment. [Figure 2] This is a block diagram illustrating the configuration of the collection support device 100. [Figure 3] This is a flowchart illustrating the processing performed by the collection support device 100. [Figure 4] This is a sequence diagram showing an example of the operation of the collection support system 1. [Figure 5] This diagram shows an example of a pickup request screen. [Figure 6] This figure shows an example of a confirmation screen. [Figure 7] This is a block diagram illustrating the configuration of the collection support system 1 in a modified example. [Figure 8] This is a block diagram showing an example of the hardware configuration of Computer 500. [Modes for carrying out the invention]

[0013] [First Embodiment] In the first embodiment, a case is described in which a delivery company instructs a worker to collect a package based on a collection request from a collection requester, and the worker collects the package placed at the collection location. The location at the collection location can be appropriately selected by the collection requester, for example, next to the front door, inside the mailbox, inside the package receiving box, inside the locker, etc. The worker may also receive the package from a person at the collection location. The package may be three-dimensional or flat. The collected package is gathered at, for example, a package collection point, and then delivered to the delivery location indicated in the collection request.

[0014] (composition) Figure 1 is a block diagram illustrating the configuration of the collection support system 1 according to the first embodiment. The collection support system 1 comprises a collection support device 100, a client terminal 200, and a worker terminal 300.

[0015] The cargo collection support device 100 is a server or the like used by a logistics operator. In the first embodiment, the cargo collection support device 100 receives information regarding the appearance of the cargo collection target A related to the cargo collection request from the requester terminal 200. Further, in the first embodiment, the cargo collection support device 100 receives information regarding the appearance of the object X placed at the cargo collection position from the worker terminal 300. The information regarding the appearance includes, for example, shooting data obtained by shooting the target object (cargo collection target A or object X), the size of the target object, and the three-dimensional shape (3D shape) of the target object. Further, the information regarding the appearance may include information regarding the color, pattern of the target object, or the type of the packaging. The information regarding the type of the packaging is, for example, information indicating whether the target object is contained in a cardboard box, a paper bag, a plastic bag, or wrapped in a cushioning material. The received shooting data may be a still image or a moving image.

[0016] The requester terminal 200 is a mobile phone, a tablet, a personal computer, or the like used by a user who requests cargo collection. The requester terminal 200 receives an input of a cargo collection request by the user. The requester terminal 200 includes a camera for shooting the cargo collection target A. In addition, when the requester terminal 200 does not include a camera, it may receive the shooting data of the cargo collection target A from an external device not shown in the figure. The requester terminal 200 transmits the shooting data of the cargo collection target A to the cargo collection support device 100. Further, the requester terminal 200 generates a cargo collection request including the cargo collection position and transmits it to the cargo collection support device 100.

[0017] The cargo collection request generated by the requester terminal 200 may include, in addition to the address of the cargo collection position, the location where the cargo collection target A is placed at the cargo collection position, such as beside the front door, inside the postbox, or inside the parcel locker. Further, the cargo collection request may include the desired time slot for cargo collection by the requester, the weight of the cargo collection target A, or information for identifying the cargo collection requester.

[0018] The operator terminal 300 is a mobile phone, tablet, wearable device, etc. used by an operator who collects the collection target A. The operator terminal 300 includes a camera that captures an object X placed at the collection position. Note that the operator terminal 300 may receive the captured data of the object X from an external device (not shown). The operator terminal 300 transmits the captured data of the object X to the collection support device 100. Further, the operator terminal 300 may receive the determination result from the collection support device 100 and display it on a display (not shown).

[0019] In various modifications, when the captured data is not used, the requester terminal 200 and the operator terminal 300 may not include a camera. Also, in this case, the requester terminal 200 and the operator terminal 300 may not receive the captured data from an external device.

[0020] FIG. 2 is a block diagram illustrating the configuration of the collection support device 100. The collection support device 100 includes a determination unit 101 and an output unit 102.

[0021] The determination unit 101 determines whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of an object at the position related to the collection request.

[0022] The output unit 102 outputs the result determined by the determination unit 101. The determined result includes that the object at the position related to the collection request is determined to be a collection target or is determined not to be a collection target. In the first embodiment, the output unit 102 outputs the determination result to, for example, the operator terminal 300.

[0023] Hereinafter, the determination method by the determination unit 101 will be described.

[0024] (Determination by captured data) The determination unit 101 may determine whether an object is a collection target using the captured data obtained by capturing the object as information regarding the appearance of the object.

[0025] In this case, the client, for example, places the item to be collected A in any location and uses the client terminal 200 to photograph the item from one or more directions and acquire the photographic data. The client may, for example, photograph the item to be collected A, which has a three-dimensional shape, from two or more directions so that the appearance can be seen from six directions: front, back, left and right sides, top and bottom. Note that the photography of some surfaces, such as the bottom, may be omitted as appropriate.

[0026] The worker uses the worker terminal 300 to photograph object X placed at the collection location from one or more directions and acquires the photographic data. The worker may also photograph object X from two or more directions in the same manner as the client.

[0027] The determination unit 101 determines, for example, whether the image data of the object to be collected A from one direction matches any of the multiple image data of object X from multiple directions. Alternatively, the determination unit 101 may determine whether the image data of object X from one direction matches any of the multiple image data of object A from multiple directions. Here, the determination unit 101 may, for example, use a known image similarity calculation technique to compare the image data of object X and the image data of object A to calculate similarity, and determine that the image data matches if the similarity is above a threshold. In this case, the determination unit 101 calculates similarity using, for example, the color and pattern of each region in the image data, or the shape of the object included in the image data as features.

[0028] Alternatively, the determination unit 101 may use known pattern matching techniques to compare the image of object X extracted from the captured data with the image of the item to be collected A, calculate the similarity, and determine that the captured data matches if the similarity is above a threshold.

[0029] The determination unit 101 then determines that object X is the object A if, for example, in a predetermined number of pairs of photographic data of object A and photographic data of object X, the photographic data of object X matches the photographic data of object A.

[0030] Furthermore, the image data captured during collection may include images of multiple objects X. In this case, the determination unit 101 may, for example, extract images of each of the multiple objects X and compare those images with the image of the object to be collected A. Then, the determination unit 101 may, for example, determine that the object X with a greater similarity to the other objects X is the object to be collected A.

[0031] Furthermore, the object to be collected, A, may be photographed by the client terminal 200 while it is placed at the collection location, and photographic data including the background of object A may be obtained. Similarly, photographic data including the background of object X may be obtained by the worker terminal 300. In this case, the determination unit 101 may compare the photographic data of object A including the background with the photographic data of object X including the background. This prevents the collection of an object that is placed in a different location than the one requested for collection.

[0032] (Determination by size) The determination unit 101 may further determine whether object X is collection target A based on the size of collection target A and the size of object X at the collection location. This makes it possible for the determination unit 101 to distinguish between objects that are similar in shape but different in size.

[0033] In this case, the determination unit 101 may further include a measurement unit (not shown) that measures the size of the objects (collection target A and object X) from the captured data. Some or all of the functions of the measurement unit may be provided by the client terminal 200 and the worker terminal 300. In this case, the determination unit 101 receives the measured size of the objects from the client terminal 200 and the worker terminal 300.

[0034] The measurement unit recognizes the shape of an object using existing image recognition technology from image data captured from one direction. The measurement unit then measures the size of the object. For example, it measures the height and width of the object when viewed from one direction. The measurement unit may also measure the length of each side of the recognized object's shape, the distance from one side to another, or the distance from the centroid of the shape to an arbitrary point on the contour.

[0035] Furthermore, the measurement unit may measure the size of an object using, for example, the parallax between two sets of photographic data taken from approximately the same direction. Alternatively, the measurement unit may measure the size of an object based on the size of a known reference object photographed together with the object.

[0036] Furthermore, the measurement unit may predict the three-dimensional shape of the object in the depth direction from the image data taken from one direction, and measure the depth in addition to the height and width of the object as its size.

[0037] Alternatively, the measurement unit may recognize the shape of the object and measure its size based on distance information instead of the captured data. The distance information represents the distance between the object and the sensor. In this case, the distance information is acquired by infrared sensors, etc., provided in the client terminal 200 and the worker terminal 300, and transmitted to the measurement unit. When using distance information, the captured data does not need to be used to measure the size.

[0038] The measuring unit may also measure the size of the object from other directions using a similar method.

[0039] Furthermore, the determination unit 101 may further include a comparison unit (not shown) that compares the size of the object to be collected A as viewed from one or more directions with the size of object X as viewed from one or more directions. The comparison unit determines that the sizes of the object to be collected A and object X match if the difference in size between the object to be collected A and object X is within a predetermined error range.

[0040] The determination unit 101 then determines that object X is the item to be collected A if, for example, the image data of object X matches the image data of item A to be collected, and the size of object X matches the size of item A to be collected.

[0041] The matching unit may also compare whether the size of the object A to be collected from a certain direction matches the size of any of the objects X from multiple directions. In this case, the determination unit 101 may determine that object X is the object A to be collected if the measured sizes match in a set of two or more directions.

[0042] (Determination based on 3D shape) The determination unit 101 may determine the object to be collected A based on the three-dimensional data of the object to be collected A related to the collection request and the three-dimensional data of the object X at the collection location.

[0043] The 3D data represents, for example, the position of the object's surface in a predetermined three-dimensional coordinate space. The 3D data may also indicate the object's three-dimensional shape and size. By comparing the 3D data, the three-dimensional shapes of the objects can be compared, making it possible for the determination unit 101 to distinguish between collection targets whose shapes differ depending on the viewing direction.

[0044] The determination unit 101 may include a 3D data generation unit (not shown) that generates the 3D data. The determination unit 101 compares the generated 3D data of object X with the 3D data of the object to be collected A. The resolution of the 3D data may be sufficient to measure the general overall shape. The functions of the 3D data generation unit may also be provided by the client terminal 200 and the worker terminal 300. In this case, the determination unit 101 receives the 3D data from the client terminal 200 and the worker terminal 300.

[0045] For example, the 3D data generation unit may generate 3D data using photographic data of the object taken from multiple directions, received from the client terminal 200 or the worker terminal 300. Alternatively, the 3D data generation unit may estimate the three-dimensional shape of the object from one or more still images and generate 3D data.

[0046] Furthermore, the 3D data generation unit may generate 3D data based on 3D scan data of the object obtained using infrared or laser technology provided by the client terminal 200 or the worker terminal 300. If the collection support device 100 does not use photographic data to generate 3D data, it does not need to receive photographic data from the client terminal 200 and the worker terminal 300.

[0047] The determination unit 101 may include a matching unit (not shown) for comparing the three-dimensional shape of the object. The matching unit uses known three-dimensional shape similarity calculation techniques to compare the three-dimensional data of object X with the three-dimensional data of the object to be collected A to calculate similarity, and determines that the three-dimensional shapes match if the similarity is above a threshold.

[0048] The determination unit 101 then determines that object X is the item to be collected A if the three-dimensional shape of object X matches the three-dimensional shape of the item to be collected A.

[0049] (Comparison using images of the item being held in the hand) The object to be collected A and the object X at the collection location may be photographed while being held in the hand of the collection requester or worker. In this case, the determination unit 101 may compare the photographic data, the size of the object, and the three-dimensional shape of the object, excluding the hand included in the photographic data or 3D data, based on the color, shape, position, etc. of the hand.

[0050] (operation) Figure 3 is a flowchart illustrating the processing of the collection support device 100. The determination unit 101 determines whether an object is a collection target based on information regarding the appearance of the collection target and information regarding the appearance of the object at the location related to the collection request (step S101). The output unit 102 outputs the determination result (step S102).

[0051] Figure 4 is a sequence diagram showing an example of the operation of the collection support system 1. In Figure 4, the case in which photographic data of the target object is used will be explained. First, the client terminal 200 photographs the item to be collected at the client's location (step S201). Next, the client terminal 200 transmits a collection request to the collection support device 100, which includes the photographic data of the item to be collected and information identifying the collection location. Figure 5 is a diagram showing an example of the collection request screen displayed on the client terminal 200 when receiving input of information related to the collection request. For example, the client inputs the collection date and time, collection location, destination of the package, and photographic data of the item to be collected A on the collection request screen.

[0052] When the collection support device 100 receives a collection request (step S202), it transmits a collection instruction to the worker terminal 300. The collection instruction includes the collection date and time, and the collection location. Furthermore, the collection instruction may also include photographic data of the item A to be collected in connection with the collection request. Upon seeing the delivery instruction, the worker goes to the collection location indicated in the collection instruction at the collection date and time. The worker searches for the item A to be collected, referring to the photographic data of the item A to be collected in connection with the collection request. The worker terminal 300 photographs the object X found by the worker at the collection location (step S203) and transmits the photographic data to the collection support device 100.

[0053] The determination unit 101 of the collection support device 100 determines whether the photographed object X is the object to be collected A based on the received photographic data of the object (step S204). Next, the output unit 102 of the collection support device outputs the determination result (step S205) and transmits the determination result to the worker terminal 300.

[0054] The worker checks the determination result displayed on the worker terminal 300's screen, and if the photographed object is eligible for collection, collects the object. The worker terminal 300 sends a collection completion notification to the client terminal 200 via the collection support device 100. The collection support device 100 may also send a collection completion notification to the client terminal 200 that includes the photographic data used to determine the object to be collected.

[0055] (effect) According to the first embodiment, even if information identifying the package is not attached to the package, the package can be identified as a package to be picked up at the location indicated in the pickup request. This is because the determination unit 101 determines whether an object is a package to be picked up based on information regarding the appearance of the package to be picked up and information regarding the appearance of the object at the location related to the pickup request.

[0056] In this disclosure, after the collection support device 100 identifies the items to be collected, the worker may add information to identify the packages to the items to be collected. For example, a printing unit (not shown) of the worker terminal 300 may print a collection slip based on the collection request once the items to be collected have been identified. The collection slip will show, for example, an identification number that identifies the collection request and the packages, which may be assigned by the collection support device 100, etc., and the destination of the packages included in the collection request. The worker will then attach the printed collection slip to the items to be collected.

[0057] [Second Embodiment] In the second embodiment, the processing of the collection support system 1 when the collection target cannot be identified will be described. Regarding the configuration of the second embodiment, the same configuration as in the first embodiment will be omitted from the description.

[0058] (If there are no candidates for pickup) If there is no object at the collection location, the worker terminal 300 cannot transmit information regarding the appearance of the object X to the collection support device 100. In this case, the worker terminal 300 may transmit an image of the collection location and location information of its current location to the collection support device 100. The determination unit 101 compares the received image and location information of the collection location with the image and location information related to the collection request and determines that there is no object A to be collected at the collection location.

[0059] Furthermore, if the similarity calculated as a result of comparing object X with the collection target A related to the collection request is below a threshold, the determination unit 101 cannot identify collection target A. If the collection target cannot be identified based on information regarding the appearance of the object, the collection support device 100 may send photographic data of object X placed at the collection location to the client terminal 200 and request confirmation from the collection requester. Figure 6 shows an example of a confirmation screen displayed on the display of the client terminal 200. If "Yes" is selected in Figure 6, the determination unit 101 determines that object X is collection target A. If "No" is selected in Figure 6, the determination unit 101 determines that object X is not a collection target. If the collection support device 100 outputs a result indicating that object X is not a collection target, the worker terminal 300 may send information regarding the appearance of other objects X to the collection support device 100. The worker terminal 300 may also perform the actions described above for when there is no object at the collection location.

[0060] Thus, if there is no object at the collection location, or if it cannot be determined that object X is collection target A, or if there are no candidates for collection target A, the worker terminal 300 may send a notification to the collection support device 100 to cancel the collection. The collection support device 100 may send a collection cancellation notification, including an image of the collection location, to the client terminal 200.

[0061] (If there are multiple candidates for pickup) If, after comparing object X at the collection location with collection target A, multiple object X objects are detected whose captured data matches that of collection target A, the determination unit 101 cannot determine which object is being collected. In this case, the collection support device 100 considers the multiple detected object X objects as candidates for collection and transmits the captured data including these candidates to the client terminal 200. The client terminal 200 displays the captured data and accepts the selection of collection target A from the collection requester. The determination unit 101 determines that the selected object X is collection target A. The collection support device 100 notifies the worker terminal 300 of the selected object X in the determination result, and the worker collects the selected collection target A.

[0062] If the person requesting the pickup does not make a selection, the pickup support device 100 may, for example, send an instruction to the worker terminal 300 to cancel the pickup.

[0063] (effect) According to the second embodiment, even if the collection support device 100 cannot identify the collection target A based on information regarding the appearance of the object, it becomes possible to identify the collection target. This is because the collection support device 100 transmits the image data of object X to the collection requester, and the determination unit 101 determines that object X is the collection target A based on the input from the collection requester.

[0064] [Variation] Collection by robot In each of the embodiments described above, the collection of packages may be performed by a robot. That is, in the above description, the actions of a worker may be replaced by actions performed by a robot. The robots that collect packages include unmanned ground vehicles and unmanned aerial vehicles (drones). In this modified example, the worker terminal 300 is replaced by a robot. The package collection support device 100 may be mounted on the robot or provided on a server of the delivery company that manages the robot.

[0065] Figure 7 is a block diagram illustrating the configuration of the collection support system 1 according to this modified example. In this modified example, the collection support device 100 may include, in addition to the configuration described in the above embodiment, an instruction unit 103 that instructs the robot to collect goods at the location related to the collection request. Regarding the other configurations shown in Figure 7, the parts that are the same as those in the above embodiment will not be explained.

[0066] The robot acquires its location information using GPS (Global Positioning System) or similar means. The robot may also pre-store images of roads, building exteriors, and building interiors in a map, and then compare these stored images with images captured by a camera to obtain its current location information. When a flying drone collects packages, the drone may collect packages placed on the balcony of a building.

[0067] Similar to when a worker collects an object, the robot transmits information about the appearance of object X obtained from object X at the location related to the collection request to the collection support device 100. The output unit 102 of the collection support device 100 notifies the robot of the determination result. When the robot is notified that object X is collection target A, it collects object X. When collecting an object, the robot may grasp object X with its arm, or it may hook the object with any mechanism.

[0068] [Variation] Packaging service A worker or robot may bring a box or other case that matches the item to be collected to the collection location, based on the 3D data related to the collection request. After the item to be collected is identified, the worker or robot places the item in the case. Alternatively, the robot may use the 3D data of object X at the collection location to pack the item using a packing material that can be freely deformed. The robot may use, for example, an expandable box or a sheet as packing material.

[0069] By adopting a packaging service like the one shown in this modified example, the person requesting the pickup does not need to pack the items to be picked up.

[0070] [Variations] Other application examples This disclosure may be used not only for the collection of delivered items but also for the collection of garbage and recyclable materials. For example, a user who wishes to have garbage collected takes a photograph of the garbage using the request terminal 200 and sends a collection request (collection request) to the collection support device 100. The garbage collection company sends a collection instruction to the worker terminal 300. If the determination unit 101 determines that the garbage placed at the instructed location is eligible for collection, the worker collects the garbage.

[0071] [Hardware configuration] In each of the embodiments described above, each component of the collection support device 100 represents a functional unit block. Some or all of the components of each device (collection support device 100, client terminal 200, worker terminal 300) may be implemented by any combination of computer 500 and program. The collection support device 100 and the client terminal 200 may be implemented by a single computer 500. The collection support device 100 and the worker terminal 300 may be implemented by a single computer 500. In this case, the worker terminal 300 may include each component of the collection support device 100 (determination unit 101, output unit 102).

[0072] Figure 8 is a block diagram showing an example of the hardware configuration of computer 500. Referring to Figure 8, computer 500 includes, for example, a CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0073] Program 504 includes instructions for realizing each function of each device. Program 504 is pre-stored in ROM 502, RAM 503, and storage device 505. The CPU 501 realizes each function of each device by executing the instructions contained in Program 504. For example, the CPU 501 of the collection support device 100 realizes the functions of the collection support device 100 by executing the instructions contained in Program 504. In addition, RAM 503 may store data processed in each function of each device. For example, the collection requests of the collection support device 100 may be stored in the RAM 503 of the computer 500.

[0074] The drive device 507 reads and writes to the recording medium 506. The communication interface 508 provides an interface with the communication network. The input device 509 is, for example, a mouse or keyboard, and receives information input from delivery personnel, etc. The output device 510 is, for example, a display, and outputs (displays) information to delivery personnel, etc. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects each of these hardware components. The program 504 may be supplied to the CPU 501 via the communication network, or it may be stored in the recording medium 506 beforehand, read by the drive device 507, and supplied to the CPU 501.

[0075] Note that the hardware configuration shown in Figure 8 is an example, and other components may be added, or some components may be omitted.

[0076] There are various variations in how each device is implemented. For example, each device may be implemented by any combination of different computers and programs for each component. Alternatively, the multiple components of each device may be implemented by any combination of a single computer and program.

[0077] Furthermore, some or all of the components of each device may be implemented by general-purpose or dedicated circuits, including processors, or by combinations thereof. These circuits may consist of a single chip or multiple chips connected via a bus. Some or all of the components of each device may be implemented by a combination of the aforementioned circuits and programs.

[0078] Furthermore, if some or all of the components of each device are implemented by multiple computers or circuits, these computers or circuits may be centrally located or distributed.

[0079] Furthermore, at least a portion of the collection support system 1 may be provided in SaaS (Software as a Service) format. That is, at least a portion of the functions for realizing the collection support device 100 may be executed by software that runs via a network.

[0080] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the configuration and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with one another, as long as they do not depart from the scope of the present disclosure.

[0081] Some or all of the above embodiments may be described as follows, but are not limited to the following:

[0082] [Note 1] A determination means for determining whether an object is the object to be collected, based on information regarding the appearance of the object to be collected and information regarding the appearance of the object at the location related to the collection request. An output means for outputting the result of the determination, A collection support device equipped with the following features. [Note 2] The determination means determines whether the object is the object to be collected by comparing the photographic data of the object to be collected with the photographic data of the object as information regarding the appearance. The collection support device described in Appendix 1. [Note 3] The photographic data of the item to be collected and the photographic data of the object each include the background of the item to be collected and the background of the object, respectively. The collection support device described in Appendix 2. [Note 4] The determination means determines whether the object is the object to be collected by comparing the shape of the object with the shape of the object as information regarding the appearance. A collection support device as described in any one of the appendices 1 to 3. [Note 5] The system further includes an instruction means for instructing a robot to collect the goods at the aforementioned location once the collection request is received. The output means notifies the robot of the result of the determination, The robot transmits information about the appearance of an object obtained from the object at the position to the collection support device, and collects the object when notified by the collection support device that the object is a target for collection. A collection support device as described in any one of the appendices 1 to 4. [Note 6] If the determination means cannot determine that the object is the object to be collected based on the information regarding its appearance, it transmits the photographic data of the object to the collection requester and determines whether the object is the object to be collected based on the input from the collection requester. A collection support device as described in any one of the appendices 1 to 5. [Note 7] If it cannot be determined that the object is the object to be collected, this includes at least one of the following cases: the similarity between the object and the object is below a threshold, and there are multiple candidates for the object to be collected. Collection support device as described in Appendix 6. [Note 8] If there are no candidates for the items to be collected, the determination means determines that there are no items to be collected at the location based on an image taken of that location. A collection support device as described in any one of the appendices 1 to 7. [Note 9] If it cannot be determined that the object is the object to be collected, or if the object is not at the location, the collection requester will be notified that the collection has been canceled. A collection support device as described in any one of the appendices 1 to 8. [Note 10] Based on information regarding the appearance of the object to be collected and information regarding the appearance of the object at the location related to the collection request, it is determined whether the object is the object to be collected. Output the result of the determination. Collection support methods. [Note 11] As information regarding the appearance, the method of determining whether the object is the object to be collected is by comparing the photographic data of the object to be collected with the photographic data of the object. Collection support method as described in Appendix 10. [Note 12] The photographic data of the item to be collected and the photographic data of the object each include the background of the item to be collected and the background of the object, respectively. Collection support method as described in Appendix 11. [Note 13] As information regarding the appearance, by comparing the shape of the object to be collected with the shape of the object, it is determined whether the object is the object to be collected. A collection support method described in any one of the appendices 10 to 12. [Note 14] When the aforementioned collection request is received, the robot is instructed to collect the goods at the aforementioned location. At the aforementioned position, the robot receives information from the robot regarding the appearance of an object located at that position, The result of the determination is notified to the robot, When the robot is notified that the object is to be collected, it collects the object. The collection support method described in any one of the appendices 10 to 13. [Note 15] If, based on the information regarding the appearance, it cannot be determined that the object is subject to collection, the photographic data of the object is sent to the collection requester, and based on the input from the collection requester, it is determined whether the object is subject to collection. A collection support method described in any one of the appendices 10 to 14. [Note 16] On the computer, A determination process that determines whether an object is the object to be collected based on information regarding the appearance of the object to be collected and information regarding the appearance of the object located at the location related to the collection request, A program recording medium that non-temporarily stores a program that causes a computer to execute an output process that outputs the result of a judgment. [Note 17] The determination process determines whether the object is the object to be collected by comparing the photographic data of the object to be collected with the photographic data of the object as information regarding its appearance. The program recording medium described in Appendix 16. [Note 18] The photographic data of the item to be collected and the photographic data of the object each include the background of the item to be collected and the background of the object, respectively. The program recording medium described in Appendix 17. [Note 19] The determination process determines whether the object is the object to be collected by comparing the shape of the object with the shape of the object as information regarding the appearance. A program recording medium as described in any one of the appendices 16 to 18. [Note 20] The program, upon receiving the collection request, includes a process of instructing the robot to collect the goods at the location, The process further includes receiving from the robot information regarding the appearance of an object at the aforementioned position, obtained from the object at that position. The output processing notifies the robot of the result of the determination, When the robot is notified that the object is to be collected, it collects the object. A program recording medium as described in any one of the appendices 16 to 19. [Note 21] The program further includes, if it cannot determine from the information regarding the appearance that the object is subject to collection, sending the photographic data of the object to the collection requester, and determining whether the object is subject to collection based on the input from the collection requester. A program recording medium as described in any one of the appendices 16 to 20. [Explanation of symbols]

[0083] 100 Collection support device 101 Judgment section 102 Output section 200 Client terminals 300 worker terminals 500 Computers

Claims

1. We accept input of photographic data of the exterior of the item to be collected, taken from multiple angles. The collection request, including the collection date, collection location, destination of the package, and the aforementioned photographic data taken from multiple directions, is transmitted to the collection support device. When the collection support device determines that the object is the object to be collected based on a comparison of information regarding the object's appearance and the photographic data taken by the collector of the object's appearance at the collection location, the collection support device receives a collection completion notification, which includes photographic data of the object's appearance, transmitted from the collection support device. Display the received collection completion notification. A program that causes the processing to be executed on the terminal of the person requesting the pickup.

2. If the collection support device cannot determine that the object is the object to be collected based on the information regarding its appearance, the device receives the photographic data of the object transmitted from the collection support device. Display the image data of the received object. The system accepts input as to whether the displayed object is the item to be collected. The information corresponding to the input is transmitted to the collection support device. The program according to claim 1, which causes the processing to be executed on the terminal of the person requesting the collection.

3. If it cannot be determined that the object is the object to be collected, this includes the case where the similarity between the object and the object is less than a threshold and the collection support device cannot determine that the object is the object to be collected. Along with the aforementioned photographic data, a selection button is displayed to indicate whether or not the object is the item to be collected. Accepts the selection of the aforementioned selection button. The program according to claim 2, which causes the processing to be performed on the terminal of the person requesting the collection.

4. If it cannot be determined that the object is the object to be collected, this includes cases where there are multiple candidates for the object to be collected and the collection support device cannot determine that the object is the object to be collected. The collection support device receives image data of the object, including multiple candidates for collection. The system accepts the selection of the item to be collected from among several candidates for the item to be collected. The program according to claim 2, which causes the processing to be performed on the terminal of the person requesting the collection.

5. If it cannot be determined that the object is the object to be collected, this includes cases where there are no candidates for the object to be collected, and it is determined that there is no object to be collected at the collection location based on an image taken of the collection location, A collection cancellation notice, including an image of the collection location, is received from the collection support device. Display the received notification of the cancellation of collection. A program according to any one of claims 1 to 4, which causes the processing to be performed on the terminal of the person requesting the collection.

6. Based on the image data captured from multiple directions or distance information from an infrared sensor, the size of the item to be collected is measured, The collection support device is transmitted information indicating the measured size of the items to be collected. A program according to any one of claims 1 to 5, which causes the processing to be performed on the terminal of the person requesting the collection.

7. Based on the image data captured from multiple directions, a three-dimensional data representing the three-dimensional shape of the item to be collected is generated. A program according to any one of claims 1 to 6, which causes the processing to be performed on the terminal of the person requesting the collection.

8. In the process of receiving input of photographic data of the appearance of the item to be collected, the process receives photographic data including the background of the item to be collected, taken with the item to be collected in the collection position. A program according to any one of claims 1 to 7, which causes the processing to be performed on the terminal of the person requesting the collection.

9. In the process of receiving input for the collection location, the system receives input of data including an address and the location where the items to be collected will be placed at that address. A program according to any one of claims 1 to 8, which causes the processing to be performed on the terminal of the person requesting the collection.

10. The terminal of the person requesting pickup, We accept input of photographic data of the exterior of the item to be collected, taken from multiple angles. The collection request, including the collection date, collection location, destination of the package, and the aforementioned photographic data taken from multiple directions, is transmitted to the collection support device. When the collection support device determines that the object is the object to be collected based on a comparison of information regarding the object's appearance and the photographic data taken by the collector of the object's appearance at the location related to the collection request, the collection support device receives a collection completion notification, which includes photographic data of the object's appearance, transmitted from the collection support device. Display the received collection completion notification. Collection support methods.

Images