Shipping support device and shipping support system

Abstract

To allow a user, when packing an unpacked package for shipment, to purchase a necessary packaging by a self-checkout system.SOLUTION: A shipping support device comprises: a placement table 21 on which a user places a package; an upper photographing unit 31 and a lateral photographing unit 35 that photograph the package placed on the placement table; a storage unit 52 that stores the package posted by the user; a front display 41 that presents information to the user; a nearby display 42 that presents information to the user and on which the user performs operations related to shipping; and a processor. The processor measures the size of the package based on images photographed by the upper photographing unit and the lateral photographing unit, when the user instructs purchasing a packaging for posting on the nearby display, does not measure the size of an object placed on the placement table, determines whether the object placed on the placement table is the packaging for posting through image recognition for the image photographed by the upper photographing unit, and displays a result of the determination on the displays.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a shipping support device and a shipping support system that assist a user in the shipping procedure for delivering a package to a shipping carrier.

Background Art

[0002] In recent years, the use of person-to-person EC (Electronic Commerce) sites that mediate person-to-person commercial transactions such as free markets and auctions has been rapidly expanding. In particular, companies operating person-to-person EC sites have made efforts to provide users with dedicated applications installed on user terminals (such as smartphones) so that person-to-person commercial transactions can be easily carried out. For example, when shipping an item traded on a person-to-person EC site as a package, the shipper (seller) inputs delivery information (information such as the shipper and the recipient) according to the procedures of the dedicated application, and then goes to a store (agent store) such as a nearby convenience store, and thus can easily perform the shipping procedure of the package. At this time, if the shipping procedure is easily completed by a device that supports the shipping procedure without interacting with the store clerk, the convenience of the user can be further enhanced.

[0003] As a technology for supporting such a shipping procedure of a package, conventionally, on a user terminal, the size of a package is measured using a sensor such as a camera, and a delivery type corresponding to the size of the package is presented to the user. If the delivery type allows posting to a postal box, a technology that enables the user to post the package to the postal box is known (see Patent Document 1).

[0004] Also, based on the identification information of a two-dimensional code printed on a label attached to the packaging material of a package, the shipping, delivery, and receipt of the package are managed by a database. On a user terminal, after registering the package to be shipped by reading the two-dimensional code of the package, a technology that enables the user to post the package to a collection box installed in a postal box or a convenience store is known (see Patent Document 2).

[0005] Furthermore, a technology is known in which the user inputs information about the sender and recipient (postal information) and the type of delivery at the user terminal, the size of the package is measured at the shipping support device (unmanned reception machine), the shipping fee is calculated at the user terminal based on the package size obtained from the shipping support device and processing is performed for payment of the shipping fee, and the shipping support device prints a label containing the information entered at the user terminal, and the user drops the package with the label attached into the shipping support device (see Patent Document 3).

[0006] Furthermore, there is a known technology in which a shipping support device (parcel collection terminal device) allows the user to input shipping information (such as the recipient's address), processes the payment of shipping fees based on that information, prints a label containing the shipping information, and allows the user to drop the package with the label attached into the shipping support device (see Patent Document 4).

[0007] Furthermore, in a shipping support device (automatic parcel collection device), when a user drops in a parcel, a technology is known in which the size of the parcel is measured, it is determined whether or not the size of the parcel conforms to a predetermined standard, the result of the determination is presented to the user, and the parcel is either stored or returned according to the user's selection (see Patent Document 5). In particular, this technology can count and record the number of parcels stored in the shipping support device.

[0008] Furthermore, a technology is known in which a shipping support device (delivery box device) measures the size of the package to be shipped, processes the payment of shipping fees based on the package size, and completes the shipping procedure when the user places the package in the shipping support device (see Patent Document 6). In particular, this technology can be used to ship not only packaged packages but also unpackaged packages. That is, the size of the unpackaged package is measured, appropriate packaging materials corresponding to the package size are presented to the user, and the user packs the package with the presented packaging materials and then places it in the shipping support device. [Prior art documents] [Patent Documents]

[0009] [Patent Document 1] Patent No. 6490282 [Patent Document 2] Patent No. 6664601 [Patent Document 3] Patent No. 6524601 [Patent Document 4] Japanese Patent Application Publication No. 10-91678 [Patent Document 5] Japanese Patent Publication No. 2001-76262 [Patent Document 6] Patent No. 5891394 [Overview of the Initiative] [Problems that the invention aims to solve]

[0010] With conventional technology, users can complete the necessary operations on a shipping support device and then drop off their packages on the spot, thus completing the shipping process without the need for store staff, and thus improving user convenience.

[0011] On the other hand, when a package is unpackaged, the user needs to pack it with appropriate packaging materials before shipping. However, if they do not have suitable packaging materials on hand, they will need to purchase them. In this case, providing a self-checkout system for purchasing necessary packaging materials at the shipping support device that handles the package shipping process would improve user convenience.

[0012] Therefore, the main objective of the present invention is to provide a shipping support device and shipping support system that allows users to purchase necessary packaging materials for packaging and shipping unpackaged items using a self-checkout system. [Means for solving the problem]

[0013] The present invention relates to a shipping support device that assists a user in the shipping procedure of handing over a package to a delivery company, comprising: a placement section where the user places the package; one or more imaging sections that photograph the package placed in the placement section; a storage section for storing the package deposited by the user; a display section that presents information to the user; an operation section where the user performs operations related to shipping; and a processor that performs control related to shipping support. The processor is configured such that, when the user gives an instruction to purchase packaging materials for mailing using the operation section, it determines the type of packaging material placed in the placement section by image recognition of the image captured by the imaging section, and displays the determination result on the display section.

[0014] Furthermore, the present invention relates to a shipping support system that assists a user in the shipping procedure of handing over a package to a delivery company, comprising: a shipping support device having a placement section where the user places the package; one or more imaging sections that detect the package placed in the placement section; a storage section for storing the package deposited by the user; a display section that presents information to the user; and an operation section where the user performs operations related to shipping; and a server device connected to the shipping support device via a network, wherein the shipping support device transmits images captured by the imaging section and operation information from the operation section to the server device, and when the user instructs the purchase of packaging materials for mailing using the operation section, the server device determines the type of packaging material placed in the placement section by image recognition of the images captured by the imaging section and transmits information regarding the determination result to the shipping support device, and the shipping support device displays the information regarding the determination result received from the server device on the display section. [Effects of the Invention]

[0015] According to the present invention, since the system can recognize the mailing packaging material selected by the user, it can display the purchase price of the mailing packaging material to the user and process the payment. This allows the user to purchase the necessary packaging material using a self-checkout system. In particular, since the mailing packaging material is recognized by image recognition without performing the same size measurements as for packages, the mailing packaging material can be recognized efficiently with sufficient accuracy. [Brief explanation of the drawing]

[0016] [Figure 1] Overall Configuration Diagram of the Shipping Support System According to the First Embodiment [Figure 2] Front View of the Shipping Support Device 1 [Figure 3] Perspective View Showing the Main Part of the Shipping Support Device 1 [Figure 4] Cross - sectional View of the Shipping Support Device 1 Looking at the Mounting Table 21 from Above [Figure 5] Cross - sectional View of the Shipping Support Device 1 Looking at the Mounting Table 21 from the Side [Figure 6] Explanatory Diagram for Explaining the Shipping Label Printed by the Shipping Support Device 1 [Figure 7] Block Diagram Showing the Schematic Configuration of the Shipping Support Device 1 [Figure 8] Explanatory Diagram Showing the Outline of the Process for Packed Luggage Performed by the Shipping Support Device 1 [Figure 9] Explanatory Diagram Showing the Outline of the Process for Unpacked Luggage Performed by the Shipping Support Device 1 [Figure 10] Flowchart Showing the Procedure of the Process for Packed Luggage Performed by the Shipping Support Device 1 [Figure 11] Flowchart Showing the Procedure of the Process for Packed Luggage Performed by the Shipping Support Device 1 [Figure 12] Flowchart Showing the Procedure of the Process for Unpacked Luggage Performed by the Shipping Support Device 1 [Figure 13] Explanatory Diagram Showing the Screen Displayed During Standby in the Shipping Support Device 1 [Figure 14] Explanatory Diagram Showing the Screen Displayed in the Automatic Dimension Measurement Mode in the Shipping Support Device 1 [Figure 15] This diagram illustrates the screen displayed in the automatic measurement mode of the shipping support device 1. [Figure 16] This diagram illustrates the screen displayed in the automatic measurement mode of the shipping support device 1. [Figure 17] This diagram illustrates the screen displayed in the automatic measurement mode of the shipping support device 1. [Figure 18] This diagram illustrates the screen displayed in the self-dropping mode of the shipping support device 1. [Figure 19] This diagram illustrates the screen displayed in the self-dropping mode of the shipping support device 1. [Figure 20] This diagram illustrates the screen displayed in the self-dropping mode of the shipping support device 1. [Figure 21] This diagram illustrates the screen displayed in the self-dropping mode of the shipping support device 1. [Figure 22] This diagram illustrates the screen displayed in the shipping support device 1 when in packaging material purchase mode. [Figure 23] This diagram illustrates the screen displayed in the shipping support device 1 when in packaging material purchase mode. [Figure 24] This diagram illustrates the screen displayed in the shipping support device 1 when in packaging material purchase mode. [Figure 25] This is an explanatory diagram showing the screen displayed in the self-dropping mode of the shipping support device 1 according to the first modified example of the first embodiment. [Figure 26] Flowchart showing the procedure for processing unpackaged goods according to a second modified example of the first embodiment. [Figure 27] An explanatory diagram showing the main parts of the shipping support device 1 according to the third modified example of the first embodiment. [Figure 28] Flowchart showing the operation procedure of the processor 63 of the shipping support device 1 according to the third modified example of the first embodiment. [Figure 29] Block diagram showing the schematic configuration of the shipping support device 1 and server device 2 according to the second embodiment. [Modes for carrying out the invention]

[0017] The first invention made to solve the aforementioned problems is a shipping support device that assists a user in the shipping procedure of handing over a package to a delivery company, comprising: a placement section where the user places the package; one or more imaging sections that photograph the package placed in the placement section; a storage section that stores the package deposited by the user; a display section that presents information to the user; an operation section where the user performs operations related to shipping; and a processor that performs control related to shipping support, wherein when the user gives an instruction to purchase packaging materials for mailing using the operation section, the processor determines the type of packaging material placed in the placement section by image recognition of the image captured by the imaging section, and displays the determination result on the display section.

[0018] According to this system, it can recognize the packaging material selected by the user for mail delivery, and can then display the purchase price to the user and process the payment. This allows users to purchase the necessary packaging materials using a self-checkout system. In particular, because it recognizes the packaging material for mail delivery using image recognition without performing the same size measurements as for packages, it can recognize the packaging material for mail delivery efficiently and with sufficient accuracy.

[0019] Furthermore, the second invention is configured such that the aforementioned mounting unit, the imaging unit, the storage unit, the display unit, and the operation unit are integrally provided in the same housing.

[0020] According to this, the device will be space-saving, making it easy to install in stores such as convenience stores.

[0021] Furthermore, the third invention is configured such that the processor displays guidance on the display unit regarding the settlement of the purchase price of the mailing packaging material, corresponding to the type of mailing packaging material determined by the judgment result.

[0022] According to this, users will be able to smoothly complete the payment process for the purchase of packaging materials for mailing.

[0023] Furthermore, the fourth invention is configured such that when the processor receives an instruction from the user using the operation unit to re-select the mailing packaging material, it repeatedly performs the process of determining the type of mailing packaging material placed in the aforementioned storage unit by image recognition of the captured image.

[0024] According to this, if a user has selected the wrong packaging material for mailing, they can re-select the packaging material.

[0025] Furthermore, the fifth invention further includes a packaging material storage section for accommodating multiple types of the aforementioned mailing packaging materials.

[0026] According to this, the necessary packaging materials for mailing can be purchased by taking them out of the packaging material storage section. In this case, it is preferable to install the packaging material storage section adjacent to the main unit, in which the mounting section, detection section, storage section, and display section are integrally provided in a single housing.

[0027] Furthermore, the sixth invention is a shipping support system that assists a user in the process of handing over a package to a delivery company, comprising: a shipping support device having a placement section where the user places the package; one or more imaging sections that detect the package placed in the placement section; a storage section for storing the package deposited by the user; a display section that presents information to the user; and an operation section where the user performs operations related to shipping; and a server device connected to the shipping support device via a network, wherein the shipping support device transmits images captured by the imaging section and operation information from the operation section to the server device, and when the user instructs the purchase of packaging materials for mailing using the operation section, the server device determines the type of packaging material placed in the placement section by image recognition of the images captured by the imaging section and transmits information regarding the determination result to the shipping support device, and the shipping support device displays the information regarding the determination result received from the server device on the display section.

[0028] According to this, similar to the first invention, when packing and shipping unpackaged items, the necessary packing materials can be purchased using a self-checkout system.

[0029] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0030] (First Embodiment) Figure 1 is an overall diagram of the shipping support system according to the first embodiment.

[0031] This shipping support system assists users (clients) in the shipping process of handing over packages to delivery companies, and comprises a shipping support device 1, a server device 2, and a smartphone 3 (user device). The shipping support device 1 and the server device 2 are connected via a network. The smartphone 3 and the server device 2 are also connected via a network. This shipping support system can also be used for shipping goods traded on peer-to-peer e-commerce sites that mediate commercial transactions between individuals, such as flea markets and auctions.

[0032] The shipping support device 1 is installed in stores such as convenience stores. This shipping support device 1 has the function of measuring the size of the package brought in by the user and displaying the shipping fee to the user. The shipping support device 1 also functions as a post box into which packages are dropped off. Furthermore, the shipping support device 1 functions as a self-checkout counter that sells packaging materials (packaging containers). In addition, the shipping support device 1 has the function of printing a shipping label with the required information based on information that the user has entered in advance using a smartphone 3. The user attaches the printed shipping label to the package and drops it into the shipping support device 1.

[0033] Smartphone 3 is operated by a user who requests delivery of a package from a delivery company using the shipping support device 1. Smartphone 3 has a shipping application and a payment application installed. In the shipping application, the user inputs shipping declaration information about the package being shipped (information such as item name, sender, recipient, and handling instructions (fragile, precision equipment, refrigeration required, etc.)). Note that the input of shipping declaration information may also be done on a user terminal other than smartphone 3, such as a PC or tablet. The payment application allows for smartphone payments, i.e., payment services such as electronic money and credit cards, using smartphone 3. Through this payment application, the user can pay for the purchase of packaging materials using the designated payment service.

[0034] Server device 2 has the function of managing package shipments. Specifically, it registers and manages information entered by the user in advance using a smartphone 3 or the like as shipment declaration information for each user, and provides the shipment declaration information to the shipment support device 1 upon request from the shipment support device 1. Server device 2 also has a payment function. Specifically, it processes payment for the cost of packaging materials purchased by the user upon request from the shipment support device 1. Server device 2 may be installed in a remote location separate from the store (e.g., a management center), or it may be installed in an appropriate location within the store (e.g., a back room or management room).

[0035] In this embodiment, the server device 2 has functions for managing the shipment of packages and functions for payment processing. However, the functions for managing the shipment of packages and functions for payment processing may be implemented separately by different server devices.

[0036] Next, the general configuration of the shipping support device 1 will be described. Figure 2 is a front view of the shipping support device 1. Figure 3 is a perspective view showing the main parts of the shipping support device 1. Figure 4 is a cross-sectional view of the shipping support device 1 with the mounting table 21 viewed from above. Figure 5 is a cross-sectional view of the shipping support device 1 with the mounting table 21 viewed from the side. Figure 6 is an explanatory diagram illustrating the shipping label printed by the shipping support device 1.

[0037] As shown in Figure 2, the shipping support device 1 comprises a main body 11 and a rack 12.

[0038] Rack 12 (storage unit) holds packaging materials (standard packaging materials, suitable packaging materials) that can be deposited into this device. In this embodiment, two types of packaging materials, a first category of standard packaging materials (Type A standard boxes) and a second category of standard packaging materials (Type B standard boxes), are stored in rack 12. The packaging materials stored in rack 12 can be purchased by the user using the shipping support device 1. The packaging materials are stored in rack 12 in either an unfolded or folded state, and the user assembles them when packing.

[0039] As shown in Figure 3, the main unit 11 is equipped with a placement platform 21 (placement section). Luggage brought in by the user is placed on this placement platform 21. In this embodiment, by placing packaged or unpacked luggage on the placement platform 21, the size of the luggage is measured and the size category to which the luggage belongs is determined. In addition, by placing packaging materials taken from the rack 12 on the placement platform 21, the type of packaging material is recognized.

[0040] The mounting platform 21 is formed in a tray shape and has a rectangular mounting surface 22 on which the object (packaged goods, unpackaged goods, and packaging materials to be purchased) is placed, and front, rear, left, and right side walls 23 surrounding the mounting surface 22. In this embodiment, the horizontal direction (left-right direction) of the rectangular mounting surface 22 is defined as the X direction, the vertical direction (front-back direction) of the mounting surface 22 is defined as the Y direction, and the direction perpendicular to the mounting surface 22 (height direction) is defined as the Z direction.

[0041] An upward imaging unit 31 (first detection unit) is provided on the upper side of the mounting table 21, facing the mounting surface 22. This upward imaging unit 31 is equipped with a color camera 32 (2D camera) and a depth camera 33 (3D camera). The color camera 32 and depth camera 33 photograph the object (packaged goods, unpackaged goods, purchased packaging materials) placed on the mounting surface 22 from above. The color camera 32 outputs a color image (detection result), and the depth camera 33 outputs a depth image (3D position information of the subject) (detection result). In addition, a predetermined camera included in the depth camera 33, which is composed of multiple cameras, may be used as the color camera 32. In this case, the number of cameras can be reduced, thus reducing the cost of the device.

[0042] The depth camera 33 is a 3D camera that outputs 3D positional information of the subject, and may be a stereo camera or a TOF (Time of Flight) camera. The depth image is a distance image that includes information on the Z coordinate (distance from the depth camera 33) for each pixel defined by the X and Y coordinates.

[0043] A side imaging unit 35 (second detection unit) is provided on the side wall surface 23 of the mounting platform 21 (right side). This side imaging unit 35 is equipped with two color cameras 36 (2D cameras). The two color cameras 36 are positioned offset from each other in the front-to-back (depth direction). The color cameras 36 photograph the object (packaged goods) placed on the mounting surface 22 from the side. The color cameras 36 output a color image (detection result). Note that the side imaging unit 35 may be equipped with three or more color cameras 36.

[0044] As shown in Figure 5, a reference marker 39 is provided on one (left) side wall surface 23 so as to face the color camera 36 of the side imaging unit 35 provided on the other (right) side wall surface 23. A predetermined pattern image (for example, a checkerboard pattern) is drawn on this reference marker 39.

[0045] Here, the color camera 36 of the side imaging unit 35 photographs a reference marker 39 located on the opposite side of the color camera 36, ​​with the luggage placed on the mounting platform 21 in between. Therefore, in the color image acquired by the color camera 36, ​​depending on the height of the luggage, the image of the reference marker 39 may be partially obscured by the luggage. Therefore, based on the degree of occlusion of the image of the reference marker 39 in the color image, it is possible to determine whether or not the height of the luggage exceeds the upper limit.

[0046] In this embodiment, if even a portion of the image of the reference marker 39 in the color image is missing, it is determined that the height has exceeded the upper limit. Specifically, the height of the lower edge of the reference marker 39 from the mounting surface 22 is positioned to match the upper limit Hmax. Therefore, if the height of the luggage placed on the mounting surface 22 exceeds the upper limit Hmax, the reference marker 39 is partially obscured by the luggage, resulting in a state where a portion of the image of the reference marker 39 in the color image is missing. This allows for accurate determination of whether or not the height of the luggage exceeds the upper limit Hmax. Furthermore, as shown in Figure 4, since two color cameras 36 are provided in the side imaging unit 35, offset front to back, the height of the luggage placed on the mounting surface 22 can be detected comprehensively and without omission.

[0047] As shown in Figure 3, a front display 41 is provided on the upper side of the mounting base 21, facing the user. This front display 41 mainly displays various guidance screens, for example, a screen that guides users through the procedures for the shipping support service.

[0048] A handheld display 42 is provided on the front side of the mounting base 21. This handheld display 42 is a touch panel display. Various operation screens are displayed on this handheld display 42.

[0049] A reader 43 is provided on the side of the handheld display 42. This reader 43 reads the 2D code displayed on the screen of the smartphone 3. In this embodiment, when purchasing packaging materials, a 2D code for payment is displayed on the screen by the payment application of the smartphone 3. Also, when dropping off a package at this device, a 2D code for shipping is displayed on the screen by the shipping application of the smartphone 3.

[0050] A printer 44 is provided on the front of the main unit 11. This printer 44 prints a shipping label 45 in a predetermined format based on shipping declaration information (product name, sender, recipient, handling instructions (fragile, precision equipment, refrigerated, etc.)) entered by the user using a smartphone 3 or the like (see Figure 6). This shipping label 45 is then affixed to the packaged item by the user. From the perspective of protecting personal information, it is also possible to print a shipping label in a confidential format that can only be reproduced by the delivery company, containing the sender and recipient information. Furthermore, by printing an ID (2D code) in a scannable location on the packaging material itself and linking the shipping declaration information to that ID, the function of printing shipping labels can be eliminated (see Patent No. 6664601).

[0051] As shown in Figure 6, the shipping label 45 includes shipping declaration information (item name, sender, recipient, etc.) for the package in question, as well as an approval mark 46 as approval information regarding the size measurement results of the package. This approval mark 46 indicates that the package size measurement was performed correctly by the shipping support device 1.

[0052] In this embodiment, for packaged packages, if the measured package size category falls within the size category permitted for mailing, and no handling designation unsuitable for mailing is set, that is, if the shipping declaration information does not include handling designation information, it is determined that mailing is permitted. If the determination result is that mailing is permitted, a shipping label 45 including the approval mark 46 is printed by the shipping support device 1. Note that the approval mark 46 is not drawn (printed) on a general shipping label not produced by the shipping support device 1.

[0053] In the example shown in Figure 6, the words "Measured" are printed on the shipping label 45 as the approval mark 46. Alternatively, the approval mark 46 may be a predetermined symbol or graphic (icon) drawn on the shipping label 45. Alternatively, the approval mark 46 may be text indicating the size category of the package based on the measurement results.

[0054] In this embodiment, a shipping label including an approval mark 46 indicating that the measurement results have been approved is printed. However, the approval or rejection of the measurement results may be expressed by the shipping label format instead of the approval mark 46. In other words, the shipping label printed after the package size measurement is properly performed by the shipping support device 1 may be printed in a special format different from that of a general shipping label.

[0055] Furthermore, if the package in question has specific handling requirements (fragile, precision equipment, refrigeration required, etc.), the handling requirements information may be printed on the shipping label in addition to the sender and recipient information and approval mark (approval information).

[0056] In this embodiment, the visualized approval information allows delivery personnel to immediately confirm, simply by visually inspecting the shipping label attached to the package, that the package size measurement in the shipping support device 1 has been performed correctly and that further size measurement is unnecessary. Therefore, after the package is collected, the transportation of the package can proceed immediately.

[0057] In addition to this visualized approval information, electronic approval information can also be used to show the delivery company that the package size measurement was performed correctly by the shipping support device 1. In this case, the delivery company's workers cannot confirm whether the package size measurement was performed correctly simply by visually inspecting the package. Therefore, the package ID managed by the server device 2 may be linked to approval information of the measurement results, in addition to information such as the sender and recipient, and the approval information may be sent to the delivery company's terminal in response to inquiries from the terminal. Note that the approval information only needs to be shown to the delivery company and does not need to be sent to the shipping support device 1.

[0058] Furthermore, in order to facilitate the inquiry of approval information from the delivery company's terminal, a 2D code containing the package ID may be attached to the package, for example, by drawing the 2D code on the shipping label or printing the 2D code on the packaging material of the package. In this case, the delivery company's terminal should query the server device 2 for approval information regarding the target package based on the package ID obtained by reading the 2D code. The delivery company's terminal should also be equipped with a screen display or audio output so that the worker can confirm whether or not the measurement results have been approved.

[0059] One possible fraud scenario involves swapping the package used for measurement with the package used for mailing; that is, measuring a smaller package, printing a shipping label on it, and then attaching it to a larger package before mailing. To address such fraud, a check function could be implemented that photographs the package with the shipping label attached before mailing, remeasures the package's size, uses image recognition on the camera's image to obtain the size category indicated on the shipping label, and verifies that the size category indicated on the shipping label matches the actual size category of the package.

[0060] As shown in Figure 2, the main body 11 is provided with a mail slot 51 for inserting packages and a storage section 52 for storing inserted packages. The delivery company can collect packages by taking them out of the storage section 52. In this embodiment, only packages of a predetermined size category, as properly measured by the shipping support device 1, can be inserted. Therefore, the delivery company does not need to recheck the size category of the packages after collection, and the size measurement work that was previously required after collection can be eliminated.

[0061] Furthermore, the front of the storage compartment 52 is covered by a door 53, which is equipped with a handle 54 and a lock 55. The lock 55 can be unlocked by the worker in charge of collecting packages for the delivery company, preventing anyone other than that worker from removing packages from the storage compartment 52.

[0062] In this embodiment, the mounting base 21 (mounting section), the upper imaging section 31 (detection section), the side imaging section 35 (detection section), the front display 41 (display section), the handheld display 42 (display section, operation section), and the storage section 52 are integrally provided in the same housing 11 of the main body 11 of the shipping support device 1. As a result, the shipping support device 1 is space-saving and can be easily installed in stores such as convenience stores.

[0063] Furthermore, the mail slot 51 is formed in a shape and size that is appropriate for the size of packages that can be mailed. Specifically, the mail slot 51 is provided with an opening of a predetermined area (width, height) that is adjusted to allow only small packages that fall under a predetermined size category to be mailed.

[0064] Furthermore, in this embodiment, in order to measure the height of the luggage with high accuracy, a color camera 36 is provided in the side imaging unit 35 and the height of the luggage is measured based on the shielding status of the reference marker 39 on the opposing surface. However, a sensor other than a camera, for example, a sensor that measures the height of an object based on the shielding state of light between the light-emitting unit and the light-receiving unit (for example, a photoelectric sensor), may also be provided and the measurement may be performed based on the detection result. In addition, a sensor other than a camera (for example, a measuring instrument that outputs 3D information using a multi-laser) may also be provided in the upper imaging unit 31 and the measurement may be performed based on the detection result.

[0065] Furthermore, in this embodiment, the mounting base 21, the upward shooting unit 31, the side shooting unit 35, the front display 41, the handheld display 42, and the storage unit 52 are integrally provided on the main body 11. However, the mounting base 21, the upward shooting unit 31, and the side shooting unit 35, which are related to photographing the object, may be configured separately from the storage unit 52, or the front display 41 and the handheld display 42, which are related to guiding the user and the user's operation, may be configured separately from the storage unit 52. In particular, as long as the mounting base 21 is positioned between the front display 41 and the handheld display 42, it does not matter whether it is integrated or separate. By arranging it in this way, the device can be made more space-efficient and the user's operability of the device can be improved.

[0066] Next, the general configuration of the shipping support device 1 will be described. Figure 7 is a block diagram showing the general configuration of the shipping support device 1.

[0067] As described above, the shipping support device 1 includes a color camera 32 and a depth camera 33 constituting the upper imaging unit 31, two color cameras 36 constituting the side imaging unit 35, a front display 41, a handheld display 42, a reader 43, and a printer 44.

[0068] Furthermore, the shipping support device 1 includes a communication unit 61, a memory 62, and a processor 63.

[0069] The communication unit 61 communicates with the server device 2 via the network.

[0070] Memory 62 stores programs and other items executed by processor 63.

[0071] The processor 63 performs various processes related to shipping support by executing programs stored in the memory 62. In this embodiment, the processor 63 performs processes such as object detection, placement position determination, size measurement, size classification determination, packaging material selection, pre-declaration content inquiry, mailing eligibility determination, shipping label printing, packaging material recognition, payment instruction processing, and screen control processing. Here, the configuration of the communication unit 61, memory 62, and processor 63 is realized by employing a general-purpose PC or tablet (information processing device).

[0072] In the object detection process, the processor 63 detects objects (unpackaged goods, packaged goods, and packaging materials to be purchased) placed on the mounting table 21 based on color images acquired from the color camera 32 of the upper imaging unit 31.

[0073] In the placement position determination process, the processor 63 determines whether the object is placed in the reference position based on the color image acquired from the color camera 32 of the upper imaging unit 31. In this embodiment, the left rear corner of the placement surface 22 is used as the reference point, and the state in which the left rear corner of the package aligns with the reference point is defined as the reference position of the package (see Figure 4).

[0074] In the size measurement process, the processor 63 measures the size (length, width, and height) of the target luggage (packaged luggage, unpackaged luggage) placed on the platform 21 by the user, based on the color image from the color camera 32 of the upper imaging unit 31, the depth image from the depth camera 33 of the upper imaging unit 31, and the color image from the color camera 36 of the side imaging unit 35. Note that the size measurement based on the color image from the color camera 36 of the side imaging unit 35 can be omitted depending on the accuracy of the size measurement based on the depth image from the depth camera 33 of the upper imaging unit 31.

[0075] In the size classification determination process, the processor 63 determines the size classification to which the luggage placed by the user on the platform 21 belongs, based on the measurement results of the size measurement process. Furthermore, in the size classification determination process, the processor 63 determines, based on the measurement results of the size measurement process, whether the size classification of the luggage may change from the size classification determined. This determination is made by comparing the dimensions of the luggage as measured (length, width, and height) with the standard value of the size classification determined and the standard value of a less expensive size classification. At this time, it is determined whether the dimensions of the luggage in question slightly exceed the standard value of the size classification determined, and whether the size classification of the luggage may change if the user changes how the luggage is placed, for example, by rearranging the luggage or moving the luggage towards the reference point.

[0076] In the packaging material selection process, if the target is an unpackaged package, the processor 63 selects the most recommended packaging material for the unpackaged package, i.e., the packaging material corresponding to the size category of the target package, based on the measurement results of the size measurement process.

[0077] In the pre-declaration information inquiry process, processor 63 queries server device 2 regarding the target package and obtains shipping declaration information from server device 2. This shipping declaration information is information that the user has entered (declared) in advance using a smartphone 3 or the like, and includes the name of the item, sender and recipient information, and handling designation information for the target package. Handling designation information is information regarding handling requirements that make the package unsuitable for postal mail, and is added to the shipping declaration information if, for example, handling requirements such as fragile, precision equipment, or requiring refrigeration are set. Furthermore, by accessing server device 2 based on the user's registration information obtained by reading the shipping 2D code displayed on the smartphone 3 screen with reader 43, shipping declaration information can be obtained from server device 2.

[0078] In the mailing eligibility determination process, the processor 63 determines whether the package can be mailed using this device, based on the determination result of the size classification determination process and the inquiry result of the pre-declaration content inquiry process. Specifically, in the case of unpackaged packages, if the measured size classification of the package matches a size classification that allows mailing, it is determined that mailing is permitted. In the case of packaged packages, if the measured size classification of the package matches a size classification that allows mailing, and there are no handling designations that make the package unsuitable for mailing, that is, if the shipping declaration information does not include handling designation information, it is determined that mailing is permitted. If mailing is deemed permitted, the mailing process continues; if mailing is deemed unacceptable, the mailing process is interrupted.

[0079] In the shipping label printing process, the processor 63 instructs the printer 44 to print a shipping label to be affixed to the package, based on the shipping declaration information (product name, sender, recipient, etc.) obtained from the server device 2. In addition to the sender and recipient information, this shipping label includes approval information confirming that the package size measurement was performed correctly by the shipping support device 1.

[0080] In the packaging material recognition process, the processor 63 recognizes the type of packaging material that the user has placed on the display stand 21 for purchase by performing image recognition on the color image acquired from the color camera 32 of the upper imaging unit 31.

[0081] In the payment instruction process, the processor 63 accesses the server device 2 based on the user's payment information obtained by reading the payment QR code displayed on the smartphone 3 screen with the reader 43, and instructs the server device 2 to process the payment for the packaging materials purchased by the user.

[0082] In the screen control process, the processor 63 displays guidance screens on the front display 41 and the handheld display 42 to assist the user with the shipping procedure, in response to the user's operation of the handheld display 42. In this embodiment, for example, a screen is displayed that presents the user with the measurement results of the size measurement process (measurement result presentation process). Specifically, the screen displays the size of the package (length, width, and height) and the costs required for shipping (shipping charges and packaging material prices) as measurement results. In addition, in this embodiment, if the package is unpackaged, a screen is displayed that presents the user with suitable packaging materials for that package (packaging material presentation process).

[0083] Next, we will explain the processing performed on pre-packaged packages by the shipping support device 1. Figure 8 is an explanatory diagram showing an overview of the processing performed on pre-packaged packages.

[0084] The shipping support device 1 can only accept packages that fall under a specified size category. In this embodiment, only packages that fall under two size categories, the first category and the second category, can be accepted by the shipping support device 1.

[0085] In the first category, as shown in Figure 8(A), only packages packaged in standardized packaging materials of a predetermined size can be deposited into the shipping support device 1. The standardized packaging materials in the first category are, for example, cardboard boxes.

[0086] In the second category, as shown in Figure 8(B), packages packaged in standard packaging materials of a predetermined size, and packages packaged in suitable packaging materials that fit within the size of the second category, as shown in Figure 8(C), can be deposited into the shipping support device 1. The standard packaging materials for the second category are, for example, cardboard boxes. The suitable packaging materials for the second category are packaging materials other than the standard packaging materials, such as envelopes with cushioning material.

[0087] In processing for packaged packages (size measurement processing and size classification processing), the color image from the color camera 32 of the upper imaging unit 31, the depth image from the depth camera 33 of the upper imaging unit 31, and the color image from the color camera 36 of the side imaging unit 35 are used to distinguish between packages packaged with standard packaging materials of the first classification shown in Figure 8(A), packages packaged with standard packaging materials of the second classification shown in Figure 8(B), packages packaged with suitable packaging materials of the second classification shown in Figure 8(C), and packages packaged with other packaging materials.

[0088] In particular, the process of identifying standard packaging materials in the first category shown in Figure 8(A) and the process of identifying standard packaging materials in the second category shown in Figure 8(B) utilize the color image from the color camera 32 of the upward imaging unit 31 and the depth image from the depth camera 33 of the upward imaging unit 31. Specifically, the 3D size information of the object (vertical dimension, horizontal dimension, and height) is acquired based on the depth image (3D position information of the subject) from the upward imaging unit 31, and a determination is made as to whether or not it is standard packaging material based on that 3D size information. Furthermore, image recognition of the color image from the upward imaging unit 31 is used to detect images printed on the surface of the standard packaging material (service marks and unique patterns) and to determine whether or not it is standard packaging material.

[0089] On the other hand, in the process of identifying suitable packaging materials for the second category shown in Figure 8(C), the color image from the color camera 32 of the upper imaging unit 31 and the color image from the color camera 36 of the side imaging unit 35 are used. Specifically, two-dimensional size information (vertical and horizontal dimensions) of the object is obtained based on the color image from the upper imaging unit 31, and a determination is made as to whether or not it is suitable packaging material based on that two-dimensional size information. Furthermore, height information of the object is obtained based on the occlusion status of the reference marker 39 in the color image from the side imaging unit 35, and a determination is made as to whether or not it is suitable packaging material based on that height information. Note that even in the process of identifying suitable packaging materials for the second category shown in Figure 8(C), the process may be carried out using the color image from the color camera 32 of the upper imaging unit 31 and the depth image from the depth camera 33 of the upper imaging unit 31 without changing the processing method.

[0090] In the determination of standard packaging materials in Category 1, it is determined whether the measured length, width, and height match the size of the standard packaging material (length, width, and height). Similarly, in the determination of standard packaging materials in Category 2, it is determined whether the measured length, width, and height match the size of the standard packaging material (length, width, and height).

[0091] Furthermore, in determining whether a packaging material is suitable for Category 2, the size (length, width, and height) of the standard packaging material in Category 2 is the maximum size, and upper limits are set for each of the length, width, and height. In addition, a minimum planar size is set; that is, lower limits are set for both the length and width. Therefore, a packaging material is determined to be suitable for Category 2 if the width is less than or equal to the upper limit and greater than or equal to the lower limit, and the length is less than or equal to the upper limit and greater than or equal to the lower limit, and the height is less than or equal to the upper limit.

[0092] In this embodiment, when processing pre-packaged packages that are packed in standard packaging materials, the size classification of the package is determined by combining the three-dimensional size information (provisional size information) contained in the depth image taken by the depth camera 33 of the upper imaging unit 31 and the image recognition result of the color image taken by the color camera 32 of the upper imaging unit 31. As a result, even if there is an error in the height information contained in the depth image, standard packaging materials can be identified by image recognition, and by combining the two, the size classification of the package can be determined efficiently with sufficient accuracy.

[0093] On the other hand, when processing packages packaged with packaging materials other than standard packaging materials, the size classification of the package is determined by combining 2D size information obtained from the color image by the color camera 32 of the upper imaging unit 31 and height information (corrected size information) based on the occlusion status of the reference marker 39 in the color image by the color camera 36 of the side imaging unit 35. As a result, in the case of packaging materials other than standard packaging materials, the packaging material cannot be identified by image recognition, and if the classification is determined only from the image of the upper imaging unit 31, there is a possibility of errors in the height information, so the size classification of the package cannot be determined with sufficient accuracy. However, since high-precision height information can be obtained by detecting the reference marker 39 from the color image of the side imaging unit 35, the size classification of the package can be determined efficiently with sufficient accuracy by combining the two.

[0094] In this embodiment, only packages belonging to two size categories, the first and second categories, can be deposited into the shipping support device 1. However, it is also possible to configure the device to accept packages belonging to three or more size categories. In this case, the deposit slot 51 may be made larger, or separate deposit slots 51 corresponding to the package size categories may be provided to allow the corresponding packages to be deposited.

[0095] Furthermore, in this embodiment, two types of packaging materials, a standard packaging material of the first category (Type A standard box) and a standard packaging material of the second category (Type B standard box), are stored in the rack 12 and sold to users. However, since packaging materials other than standard packaging materials are also permitted in the second category, other packaging materials that conform to the second category, such as cushioned envelopes, may also be stored in the rack 12 and sold to users.

[0096] Next, we will explain the processing of unpackaged packages performed by the shipping support device 1. Figure 9 is an explanatory diagram showing an overview of the processing of unpackaged packages.

[0097] The shipping support device 1 determines whether an unpackaged package falls into one of the size categories (first category and second category) that can be deposited into the device (size category determination process). At this time, based on the depth image (3D position information) obtained by the depth camera 33 of the overhead imaging unit 31 when it photographs the unpackaged package placed on the loading platform 21, the device obtains the lengths of the three sides (dimensions in the X direction, Y direction, and Z direction) of a circumscribed rectangular parallelepiped surrounding the foreground region on the depth image corresponding to the object (unpackaged package), and determines whether the object falls into one of the size categories (first category and second category) that can be deposited into the device based on the lengths of the three sides of that circumscribed rectangular parallelepiped.

[0098] Specifically, the foreground region (object) is extracted from the color image acquired by the color camera 32 of the upward imaging unit 31, and 2D position information of the foreground region (object) is obtained. Next, a circumscribed rectangular parallelepiped surrounding the foreground region (object) is set based on the depth image (3D position information) acquired by the depth camera 33 of the upward imaging unit 31 and the 2D position information of the foreground region (object). Next, the dimensions in the X, Y, and Z directions of the circumscribed rectangular parallelepiped are calculated. Then, based on the dimensions in the X, Y, and Z directions of the circumscribed rectangular parallelepiped, it is determined whether the object falls into one of the size categories (first category and second category) that can be deposited into this device.

[0099] The height of the foreground region (object) from the mounting surface 22 becomes the Z-direction dimension of the circumscribed rectangular parallelepiped. Therefore, the Z-direction dimension of the circumscribed rectangular parallelepiped can be obtained by calculating the background difference with respect to the Z-coordinate of the foreground region, that is, the difference between the current depth image and the depth image (background image) taken by the depth camera 33 of the mounting platform 21 when no object is placed on it. Also, since the height from the mounting surface 22 is not constant, the maximum value of the height from the mounting surface 22 becomes the Z-direction dimension of the circumscribed rectangular parallelepiped.

[0100] By the way, in this embodiment, the height of the object is measured based on the background difference of the depth image. However, if the height of the object is lower than the detection limit (e.g., 1 cm), such as in the case of CD or DVD packaging, the background difference of the depth image cannot be properly obtained, and the height of the object cannot be properly measured. In this case, there is no particular problem in using the 2D size information obtained from the color image and generating size information with the height detection limit (e.g., 1 cm) as the height of the object.

[0101] Furthermore, the shipping support device 1 performs packaging material recognition processing for packaging materials purchased by the user. In this embodiment, packaging materials (standard packaging materials of the first category and standard packaging materials of the second category) stored in the rack 12 can be purchased. At this time, the user selects the packaging materials from the rack 12 and places them on the display stand 21. The shipping support device 1 determines whether the packaging materials placed on the display stand 21 are either standard packaging materials of the first category or standard packaging materials of the second category by performing image recognition processing on the color image acquired by the color camera 32 of the overhead imaging unit 31. The surface of the standard packaging materials of the first category and standard packaging materials of the second category has a unique image (for example, a service mark or a unique pattern) printed on it. In the packaging material recognition processing, the packaging materials placed on the display stand 21 are detected from the color image acquired by the color camera 32 of the overhead imaging unit 31, and the type of packaging material is recognized based on the shape and size of the packaging material and the image printed on its surface.

[0102] Furthermore, the rack 12 stores the packaging materials in their unassembled state (unfolded or folded), and the packaging materials can be identified based on their shape, size, and the image printed on their surface in this unassembled state.

[0103] In this embodiment, when an object (packaged goods, unpackaged goods, or packaging materials to be purchased) is placed on the placement platform 21, a placement position determination process is performed. In this embodiment, as shown in Figure 4, the left rear corner of the placement surface 22 becomes the reference point, and the state in which the left rear corner of the goods aligns with the reference point is defined as the reference position of the goods. The user places the object (packaged goods, unpackaged goods, or packaging materials to be purchased) at the reference position.

[0104] The shipping support device 1 detects the position of an object by performing image recognition on a color image acquired by the color camera 32 of the upward imaging unit 31, and determines whether or not the object is positioned at a reference location. If the object is deviated from the reference location, the device guides the user to reposition the object at the reference location using the screen and audio on the front display 41.

[0105] Next, we will describe the processing procedure for packaged packages performed by the shipping support device 1. Figures 10 and 11 are flowcharts showing the processing procedure for packaged packages.

[0106] As shown in Figure 10, in the shipping support device 1, first, the processor 63 acquires a color image from the color camera 32 of the upper imaging unit 31 (ST101). Next, the processor 63 detects the object placed on the mounting table 21 by image recognition of the color image (object detection process) (ST102). Then, the processor 63 determines whether or not the object is placed in the reference position (mounting position determination process) (ST103).

[0107] If the object is placed in the reference position (Yes in ST103), the processor 63 then acquires a depth image (3D position information of the subject) from the depth camera 33 of the upper imaging unit 31 (ST104). Next, the processor 63 detects the object from the depth image (ST105). Next, the processor 63 acquires the size information of the object (length, width, height) based on the depth image (size measurement process) (ST106). Then, the processor 63 determines whether the size of the object matches the size of the standard packaging material of the first category (ST107).

[0108] If the size of the object matches the size of a standard packaging material in the first category (Yes in ST107), the processor 63 then performs image recognition on the color image (ST108). Based on the image recognition result, it determines whether or not the object is a standard packaging material in the first category (size category determination process) (ST109).

[0109] If the object is determined to be a standard packaging material of Category 1 (Yes in ST109), the object is confirmed to be a package packed with standard packaging material of Category 1 (ST110).

[0110] On the other hand, if the size of the object does not match the size of the standard packaging material in the first category (No in ST107), the processor 63 then determines whether the size of the object matches the size of the standard packaging material in the second category (ST111).

[0111] If the size of the object matches the size of the standard packaging material in the second category (Yes in ST111), the processor 63 then performs image recognition on the color image (ST112). Based on the image recognition result, it then determines whether or not the object is a standard packaging material in the second category (size category determination process) (ST113).

[0112] If the object is determined to be a standard packaging material of category 2 (Yes in ST113), the object is confirmed to be a package packed with standard packaging material of category 2 (ST114).

[0113] On the other hand, if the object is determined not to be a standard packaging material of Category 1 (No in ST109), if the size of the object does not match the size of a standard box of Category 2 (No in ST111), or if the object is determined not to be a standard box of Category 2 (No in ST113), the process proceeds to determine whether the object is a suitable product other than a standard box of Category 2 (Category 2 conformity determination).

[0114] As shown in Figure 11, in the second category conformity determination, the processor 63 first extracts the foreground region from the color image captured by the color camera 32 of the upper imaging unit 31 (ST115). At this time, the processor 63 extracts the foreground region by calculating the background difference of the color image, that is, the difference between the current color image and the color image (background image) of the mounting table 21 with no object placed on it, captured by the color camera 32 beforehand. Next, the processor 63 sets an external frame surrounding the foreground region and calculates the dimensions of the external frame in the X direction and the Y direction (size measurement process) (ST116).

[0115] Next, the processor 63 determines whether the X-direction dimension of the circumscribed frame is less than or equal to the upper limit for the width of the second section, and whether the Y-direction dimension is less than or equal to the upper limit for the depth of the second section (ST117).

[0116] Here, if the X-direction dimension of the circumscribed frame is less than or equal to the upper limit of the second category, and the Y-direction dimension is less than or equal to the upper limit of the second category (Yes in ST117), then the processor 63 determines whether the X-direction dimension of the circumscribed frame is greater than or equal to the lower limit of the width of the second category, and whether the Y-direction dimension is greater than or equal to the lower limit of the depth of the second category (ST118).

[0117] Here, if the X-direction dimension of the circumscribed frame is greater than or equal to the lower limit of the second category, and the Y-direction dimension is greater than or equal to the lower limit of the second category (Yes in ST118), then the processor 63 acquires a color image from the color camera 36 of the lateral imaging unit 35 (ST119). Next, the processor 63 detects a reference marker 39 from the color image (ST120). Then, the processor 63 determines whether the height of the object is less than or equal to the upper limit of the height for the second category based on the occlusion status of the reference marker 39 in the color image (size category determination process) (ST121). In addition, in the size measurement process (ST116), the size information of the object (vertical dimension, horizontal dimension, height) may be acquired based on the depth image to determine the height of the object. In this case, the configuration of the color camera 36 of the lateral imaging unit 35 can be omitted.

[0118] If the height of the object is less than or equal to the upper limit of the second category (Yes in ST121), then the processor 63 determines that the object is a package of the second category (a package packaged with packaging materials other than standard packaging materials) (ST122).

[0119] On the other hand, if the X-direction dimension of the circumscribed frame exceeds the upper limit of the second category, or if the Y-direction dimension exceeds the upper limit of the second category (No in ST117), or if the X-direction dimension of the circumscribed frame is less than the lower limit of the second category, or if the Y-direction dimension is less than the lower limit of the second category (No in ST118), or if the height of the object exceeds the upper limit of the second category (No in ST121), the object is determined to be a package that cannot be mailed (ST123).

[0120] Next, we will explain the procedure for processing unpackaged packages performed by the shipping support device 1. Figure 12 is a flowchart showing the procedure for processing unpackaged packages.

[0121] In the shipping support device 1, first, the processor 63 acquires a color image and a depth image (3D position information) from the color camera 32 and depth camera 33 of the upper imaging unit 31 (ST201). At this time, if it is detected that an object has been placed on the mounting table 21 based on the background difference of the Z coordinate (height information) of the depth image, the process may proceed to the next step. If the height of the object is lower than the detection limit and the object is not detected, the 2D size information obtained by extracting the foreground region from the color image may be used to generate size information with the height detection limit as the height of the object.

[0122] Next, processor 63 extracts the foreground region (object) from the color image (ST202). Then, based on the depth image (3D position information), processor 63 sets up a bounding box surrounding the foreground region (object) and calculates the dimensions of the bounding box in the X, Y, and Z directions (size measurement process) (ST203).

[0123] Next, the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the Z direction is less than or equal to the upper limit of the first category (ST204).

[0124] If the dimension of the circumscribed rectangular parallelepiped in the Z direction is less than or equal to the upper limit of the first division (Yes in ST204), then the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit of the width of the first division, and whether the dimension in the Y direction is less than or equal to the upper limit of the depth of the first division (ST205).

[0125] Here, if the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit of the first category, and the dimension in the Y direction is less than or equal to the upper limit of the first category (Yes in ST205), the processor 63 determines that the object is a package of the first category (ST206).

[0126] On the other hand, if the dimension of the circumscribed rectangular parallelepiped in the X direction exceeds the upper limit of the first category, or if the dimension in the Y direction exceeds the upper limit of the first category (No in ST205), the processor 63 then determines whether the maximum height from the mounting surface 22 is less than or equal to the upper limit for height in the second category (ST207).

[0127] If the dimension of the circumscribed rectangular parallelepiped in the Z direction is less than or equal to the upper limit of the second division (Yes in ST207), then the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit of the width of the second division, and whether the dimension in the Y direction is less than or equal to the upper limit of the depth of the second division (ST208).

[0128] Here, if the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit of the second division, and the dimension in the Y direction is less than or equal to the upper limit of the second division (Yes in ST208), then the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the X direction is greater than or equal to the lower limit of the width of the second division, and whether the dimension in the Y direction is greater than or equal to the lower limit of the depth of the second division (ST209).

[0129] Here, if the dimension of the circumscribed rectangular parallelepiped in the X direction is greater than or equal to the lower limit of the second category, and the dimension in the Y direction is greater than or equal to the lower limit of the second category (Yes in ST209), the processor 63 determines that the object is a package of the second category (ST210).

[0130] On the other hand, if the maximum height from the mounting surface 22 exceeds the upper limit of the first category (No in ST204), if the maximum height from the mounting surface 22 exceeds the upper limit of the second category (No in ST207), if the X-direction dimension of the circumscribed rectangular parallelepiped exceeds the upper limit of the second category, or if the Y-direction dimension exceeds the upper limit of the second category (No in ST208), or if the X-direction dimension of the circumscribed rectangular parallelepiped is less than the lower limit of the second category, or if the Y-direction dimension is less than the lower limit of the second category (No in ST209), the processor 63 determines that the object is a package that cannot be mailed (ST211).

[0131] Next, we will explain the screen displayed in the dispatch support device 1 while it is in standby mode. Figure 13 is an explanatory diagram showing the screen displayed in the dispatch support device 1 while it is in standby mode.

[0132] In the dispatch support device 1, when in standby mode, the screen shown in Figure 13(A) (standby screen) is displayed on the front display 41, and the screen shown in Figure 13(B) (standby screen) is displayed on the handheld display 42.

[0133] The front display 41 shown in Figure 13(A) displays text guiding the user through the menu of shipping support services, namely, text 101 guiding the user through the automatic measurement mode (first mode) titled "Automatic Size Check", text 102 guiding the user through the self-drop-off mode (second mode) titled "Self-Delivery Post", and text 103 guiding the user through the packaging material purchase mode (third mode) titled "Purchase Packaging Materials". The screen also displays text 104 indicating that the user can select one of the three operating modes—automatic measurement mode, self-drop-off mode, and packaging material purchase mode—by operating the handheld display 42.

[0134] The screen of the handheld display 42 shown in Figure 13(B) displays an automatic measurement mode selection section 105 with the title "Automatic Size Check," a self-delivery mode selection section 106 with the title "Self-Delivery Post," and a packaging material purchase mode selection section 107 with the title "Purchase Packaging Materials." By operating any of these selection sections 105, 106, or 107, the user can select one of the three operating modes.

[0135] The automatic measurement mode, titled "Automatic Size Check," is designed to display suitable packaging materials to users when they bring in unpackaged items, allowing them to purchase the materials themselves using a self-checkout system.

[0136] The processing in this automatic measurement mode consists of a packaging material selection step and a packaging material purchase step. In the packaging material selection step, the processor 63 of the shipping support device 1 determines the size category of the unpackaged package placed by the user on the loading platform 21 and determines whether the package can be deposited using this device (deposit feasibility determination process). If the package can be deposited using this device, it selects the packaging material corresponding to the size category of the package and presents it to the user (packaging material presentation process). In the packaging material purchase step, the processor 63 recognizes the type of packaging material that the user has taken out of the rack 12 and placed on the loading platform 21 based on the image captured by the color camera 32 of the overhead imaging unit 31 (packaging material recognition process), and processes the payment (settlement) for the sale price of that packaging material (settlement process).

[0137] The self-delivery mode, titled "Self-Delivery Post," allows users to bring in pre-packaged packages, print a shipping label based on pre-registered shipping declaration information, and then attach the label to the packaged package before dropping it into the device's mail slot 51.

[0138] In this self-drop-off mode, the processor 63 of the shipping support device 1 determines the size category of the packaged item placed by the user on the loading platform 21 (size category determination process), queries the server device 2 for handling specification information (included in the shipping declaration information) regarding items unsuitable for drop-off (e.g., fragile items, precision equipment, items requiring refrigeration) (pre-declaration content inquiry process), and determines that drop-off is permitted if the measured size category of the item matches a size category that allows drop-off and no handling specification is set (drop-off eligibility determination process). If drop-off is deemed permitted, the processor 63 prints a shipping label based on the shipping declaration information registered by the user in advance (shipping label printing process).

[0139] The packaging material purchase mode, titled "Purchase Packaging Materials," allows users to purchase packaging materials using a self-checkout system. In this packaging material purchase mode, the processor 63 of the shipping support device 1 recognizes the type of packaging material that the user has taken from the rack 12 and placed on the display stand 21 based on the color image taken by the color camera 32 of the overhead imaging unit 31 (packaging material recognition processing), and then processes the payment for the purchase of that packaging material (settlement instruction processing).

[0140] Next, we will explain the screens displayed in the automatic measurement mode of the shipping support device 1. Figures 14, 15, 16, and 17 are explanatory diagrams showing the screens displayed in the automatic measurement mode of the shipping support device 1.

[0141] In the shipping support device 1, when a user operates the automatic measurement mode selection unit 105, which displays the title "Automatic Size Check" on the handheld display 42 shown in Figure 13(B), the front display 41 first transitions to the screen shown in Figure 14(A-1), and the handheld display 42 transitions to the screen shown in Figure 14(B-1).

[0142] As shown in Figure 14(A-1), the front display 41 screen displays text 111 prompting the user to place the luggage to be measured on the platform 21, and an image 112 guiding the user on how to place the luggage on the platform 21. Since the luggage needs to be placed in a reference position towards the back left of the platform 21, image 112 shows a video of the luggage moving from the center of the platform 21 towards the back left.

[0143] The screen of the handheld display 42 shown in Figure 14(B-1) is equipped with text 115 prompting the user to place the package to be measured on the platform 21, and a button 116 to instruct the user to measure the size. When the user presses the button 116 to instruct the user to measure the size, the size measurement starts, followed by a determination of whether or not the package can be mailed. Alternatively, once the size measurement starts, the screen may transition to a screen that notifies the user that the size measurement is in progress.

[0144] At this point, the processor 63 of the shipping support device 1 detects the package placed on the loading platform 21, measures the size of the package, determines that the package can be mailed, and determines that there is no possibility of changing the size category. Then, the front display 41 transitions to the screen shown in Figure 14(A-2), and the handheld display 42 transitions to the screen shown in Figure 14(B-2).

[0145] As shown in Figure 14(A-2), the screen of the front display 41 displays size information, which is the result of the size measurement. This includes text 121 representing the three dimensions of the package, specifically the length, width, and height of the circumscribing rectangle surrounding the package, and text 122 representing the cost of shipping the package, specifically the shipping fee and the price of the packaging materials. The screen also displays text 123 indicating that the size measurement can be redone by re-securing the package. While the dimensions of the package itself are displayed as size information, the dimensions of the size category to which the package belongs may also be displayed.

[0146] The screen of the handheld display 42 shown in Figure 14(B-2) displays text 125 representing the size of the package (length, width, and height), text 126 representing the shipping fee, and text 127 guiding the user to the most recommended packing materials for packing the package. The screen also includes a button 128 to instruct the user to remeasure the size and a button 129 to proceed to the packing material purchase step.

[0147] If the user presses button 128 to instruct the device to remeasure the size, the size measurement will be performed again. For example, if the size category may change due to rearranging or changing the placement of items such as multiple items of clothing, the user can instruct the device to remeasure the size. Also, if the user presses button 129 to proceed to the packing material purchase step, the front display 41 will transition to the screen shown in Figure 15(A-2), and the handheld display 42 will transition to the screen shown in Figure 15(B-2).

[0148] On the other hand, if the processor 63 determines that there is a possibility of a change in size classification, the handheld display 42 transitions to the screen shown in Figure 14(B-3). On this screen of the handheld display 42 shown in Figure 14(B-3), instead of the characters 127 on the screen in Figure 14(B-2), characters 130 representing advice information on how to place unpackaged items are displayed.

[0149] The advice information encourages users to remeasure their packages, suggesting that by adjusting how they place their packages—for example, arranging them or moving them towards a reference point—the package size category may change, potentially allowing them to ship with less expensive packaging materials. In the example shown in Figure 14 (B-3), the advice information displays the message, "There is still room in terms of height." Alternatively, the message could display, for example, "Please move your packages towards the reference point."

[0150] By viewing this kind of advice information, users can easily confirm that they can ship their packages with more appropriate (cheaper) shipping costs and packaging materials. Then, the user adjusts the way they place their packages, for example, by rearranging them or moving them towards a reference point, and then operates button 128 to instruct the system to remeasure the size. At this point, in some cases, the package size category may be changed to a more appropriate (cheaper) size category, and more appropriate (cheaper) packaging materials will be presented to the user. This allows the user to quickly find the optimal packaging materials for the unpacked package they have brought in.

[0151] Furthermore, advice information may be displayed on the front display 41 shown in Figure 13(A-2). In addition to screen display, advice may also be provided via audio output.

[0152] Thus, in this embodiment, the size of the package can be remeasured repeatedly. Unlike when the package is already packaged, when the package is unpackaged, the size measurement result (size category) may change if the user changes how the package is placed. Therefore, by allowing the user to remeasure the size of the package until they are satisfied, the costs required for shipping the package (shipping fees and the cost of packaging materials) can be kept low.

[0153] The user's handheld display 42 screen (Figure 14 (B-1), etc.) displays a button 119 to indicate termination. This button 119 allows the user to terminate the process at an appropriate time. When this button 119 is pressed, the user is taken to a screen (not shown) to confirm termination. Upon confirming termination on this screen, the automatic measurement mode is terminated and the device returns to standby mode.

[0154] Furthermore, since payment for the purchase of packaging materials is made using a designated payment service via smartphone 3, before transitioning to the screen shown in Figure 15 (A-2), a screen may be displayed on the user's handheld display 42 to inquire whether registration for the designated payment service has been completed, or a screen prompting the user to ask a store staff member for information regarding the designated payment service.

[0155] On the other hand, if the mailing eligibility check determines that the package cannot be mailed, the front display 41 transitions to the screen shown in Figure 15(A-1), and the handheld display 42 transitions to the screen shown in Figure 15(B-1).

[0156] As shown in Figure 15(A-1), the front display 41 screen shows text 131 prompting the user to complete the shipping procedure at the store counter because the package cannot be deposited using this device, and an image 132 guiding the user to the store counter.

[0157] As shown in Figure 15(B-1), the screen of the handheld display 42 displays characters 135 representing the size of the package (length, width, and height), characters 136 indicating that the package cannot be dropped off using this device, and characters 137 prompting the user to complete the shipping procedure at the counter inside the store. In addition, if the package cannot be dropped off using this device, the parts of the numbers representing the length, width, and height of the package that exceed the drop-off size may be highlighted.

[0158] As shown in Figure 15(A-2), the front display 41 screen displays an image 141 guiding the user through the packaging materials available for purchase from this device, and text 142 prompting the user to select packaging materials from the rack 12 located next to the main unit 11. In this embodiment, standard packaging materials of the first category (Type A standard boxes) and standard packaging materials of the second category (Type B standard boxes) can be purchased from this device. Furthermore, this screen highlights packaging materials suitable for the package in order to present them to the user. Packaging materials unsuitable for the package may be grayed out.

[0159] As shown in Figure 15(B-2), the screen of the handheld display 42 displays text 145 and 146 prompting the user to select packaging materials suitable for their luggage. Alternatively, the packaging materials may be sorted by type and stored on the shelves of the rack 12, and an indicator (not shown) such as an LED lamp on the shelf may be lit in conjunction with the display of packaging materials suitable for the user's luggage to prompt the user to take out the displayed packaging material.

[0160] At this point, after a predetermined time has elapsed since the screen of the front display 41 shown in Figure 15(A-2) and the screen of the handheld display 42 shown in Figure 15(B-2), the front display 41 transitions to the screen shown in Figure 16(A-1), and the handheld display 42 transitions to the screen shown in Figure 16(B-1).

[0161] As shown in Figure 16(A-1), the screen of the front display 41 displays text 151 prompting the user to place the selected packaging material on the platform 21, text 152 instructing the user to place each piece of packaging material on the platform 21 if multiple pieces are purchased, an image 153 showing how to place the packaging material on the platform 21, and text 154 instructing the user that a payment application on the smartphone 3 is required. Since the packaging material needs to be placed in a reference position towards the back left of the platform 21, image 153 displays a video showing the packaging material moving from the center of the platform 21 towards the back left.

[0162] The screen of the handheld display 42 shown in Figure 16(B-1) displays text 155 prompting the user to place the selected packaging material on the placement platform 21, and text 156 indicating the name and price of the packaging material suitable for the package.

[0163] Here, the processor 63 of the shipping support device 1 detects the packaging material placed on the mounting table 21 and recognizes the type of packaging material, at which point the handheld display 42 transitions to the screen shown in Figure 16(B-2).

[0164] As shown in Figure 16(B-2), the screen of the handheld display 42 displays text 157 prompting the user to confirm the selected packaging material and give instructions to purchase it, text 156 representing the name and price of the recognized packaging material, a button 158 instructing the user to re-select the packaging material, and a button 159 instructing the user to purchase the packaging material.

[0165] If the user presses button 158 to request a re-selection of packaging materials, the screen will transition to the one shown in Figure 16(B-3). On the other hand, if the user presses button 159 to request the purchase of packaging materials, the front display 41 will transition to the screen shown in Figure 17(A-1), and the handheld display 42 will transition to the screen shown in Figure 17(B-1). Users who only wish to be shown the most suitable packaging materials based on the size of their package and do not wish to purchase any packaging materials can simply press button 119 on the handheld display 42 screen shown in Figure 16(B-2) to indicate that the process is complete.

[0166] The screen of the handheld display 42 shown in Figure 16(B-3) displays text 161 prompting the user to select a packing material, a packing material selection section 162, and a cancel button 163. When the user operates the packing material selection section 162, the front display 41 transitions to the screen shown in Figure 17(A-1), and the handheld display 42 transitions to the screen shown in Figure 17(B-1). When the user operates the cancel button 163, the automatic measurement mode ends and the device returns to standby mode.

[0167] As shown in Figure 17(A-1), the front display 41 screen displays text 171 prompting the user to display the code payment screen on the smartphone 3, an image 172 guiding the user through the procedure for displaying the code payment screen on the smartphone 3, an image 173 guiding the user to the position of the reader 43 of the shipping support device 1, and text 174 prompting the user to hold the payment 2D code displayed on the code payment screen over the reader 43.

[0168] The screen of the handheld display 42 shown in Figure 17(B-1) displays text 175 prompting the user to hold the payment 2D code displayed on the code payment screen over the reader 43, and text 156 indicating the name and price of the packaging material to be purchased.

[0169] Here, the processor 63 of the shipping support device 1 receives reading information from the reader 43 when the reader 43 reads the payment 2D code displayed on the smartphone 3, and then sends a payment instruction to the server device 2. The server device 2 executes the payment processing for the purchase price for the user. When the payment processing is completed successfully, the front display 41 transitions to the screen shown in Figure 17(A-2), and the handheld display 42 transitions to the screen shown in Figure 17(B-2).

[0170] As shown in Figure 17(A-2), the front display 41 screen displays text 181 expressing gratitude for the purchase of packaging materials and images 182 guiding the user through the subsequent steps. The images guiding the user through the subsequent steps include, for example, instructions that packaging can be done in the store, instructions that the package can be sent (dropped) using the self-service drop-off mode of this device once packaging is complete, and video images prompting the user to enter information about the package (such as size classification) into the shipping application on their smartphone 3.

[0171] As shown in Figure 17(B-2), the screen of the handheld display 42 displays text 183 expressing gratitude for the purchase of packaging materials, and text 156 indicating the name and price of the packaging materials for which payment has been completed.

[0172] If an error occurs during the processing of the automatic measurement mode, an error screen (not shown) will be displayed on the front display 41 and the handheld display 42. This error screen will display text indicating that an error has occurred and processing cannot be performed normally, text prompting the user to complete the shipping procedure at a counter in the store, an image guiding the user to a counter in the store (for example, a store floor plan), and text prompting the user to call a store staff member.

[0173] Next, we will explain the screens displayed in the self-dropping mode of the shipping support device 1. Figures 18, 19, 20, and 21 are explanatory diagrams showing the screens displayed in the self-dropping mode of the shipping support device 1.

[0174] In the shipping support device 1, when a user operates the self-delivery mode selection unit 106, which is titled "Self-Delivery Post" on the handheld display 42 shown in Figure 13(B), the front display 41 first transitions to the screen shown in Figure 18(A-1), and the handheld display 42 transitions to the screen shown in Figure 18(B-1).

[0175] As shown in Figure 18(A-1), the screen of the front display 41 shows text 201 prompting the user to place the packaged item on the loading platform 21 and launch the shipping app on their smartphone 3, and an image 202 showing how to place the item on the loading platform 21. Since the item needs to be placed in a reference position towards the back left of the loading platform 21, image 202 shows a video of the item moving from the center of the loading platform 21 towards the back left.

[0176] As shown in Figure 18(B-1), the screen of the handheld display 42 displays text 205 prompting the user to place the packed package on the tray 21 and launch the shipping app on their smartphone 3, as well as a button 206 to instruct the user on how to proceed with shipping.

[0177] Furthermore, when the processor 63 detects that a packaged package has been placed on the platform 21, the handheld display 42 may transition to a screen indicating that the package size is being measured.

[0178] When the user presses the button 206 to instruct the shipping procedure, the front display 41 transitions to the screen shown in Figure 18(A-2), and the handheld display 42 transitions to the screen shown in Figure 18(B-2).

[0179] As shown in Figure 18(A-2), the front display 41 screen shows text 211 prompting the user to display the shipping 2D code on the payment application of the smartphone 3 and hold it over the reader 43, and an image 212 guiding the user to the location of the reader 43 of this device. The image shows a frame surrounding the reader 43 to guide the user to its location.

[0180] As shown in Figure 18(B-2), the screen of the handheld display 42 displays text 213 prompting the user to hold the shipping 2D code over the reader 43, and an image 214 indicating that the reader 43 is reading the code.

[0181] At this time, when the processor 63 obtains the result of reading the two-dimensional code for shipping from the reader 43, it accesses the server device 2 to inquire about the handling designation information included in the shipping declaration information for the user and checks whether there are any handling designations that make the item unsuitable for mailing (for example, fragile items, precision equipment, items requiring refrigeration).

[0182] Furthermore, if a network failure occurs and connection to server device 2 cannot be established, the system may redirect the user to a screen notifying them of this fact.

[0183] If the measured size of the package falls within the specified size category, and there are no handling instructions that make it unsuitable for mailing (i.e., the shipping declaration information does not include handling instructions), and the package is determined to be mailable, the front display 41 transitions to the screen shown in Figure 19(A-1), and the handheld display 42 transitions to the screen shown in Figure 19(B-1).

[0184] As shown in Figure 19(A-1), the front display 41 screen shows text 221 notifying that the package size measurement and mailing eligibility determination are complete and the package can be mailed, and an image 222 alerting users who have not set specific handling instructions for fragile items that the package is fragile. In addition, as a warning about fragile items, a confirmation message may be displayed to check whether the package is packaged with cushioning material that can withstand the impact of mailing, etc.

[0185] As shown in Figure 19(B-1), the screen of the handheld display 42 displays text 225 indicating that the package size measurement and mailing feasibility determination are complete and the package can be mailed, as well as a button 226 that instructs the user to print the shipping label.

[0186] On the other hand, if the measured size of the package does not fall under the specified size category, or if it is determined that the package cannot be delivered because it has handling instructions that make it unsuitable for delivery (e.g., fragile, precision equipment, refrigerated), that is, because the shipping declaration information includes handling instructions, the front display 41 will transition to the screen shown in Figure 19(A-2). Also, if the measured size of the package does not fall under the specified size category, and it is determined that the package cannot be delivered, the handheld display 42 will transition to the screen shown in Figure 19(B-2). On the other hand, if the package is determined that it cannot be delivered because it has handling instructions that make it unsuitable for delivery, that is, because the shipping declaration information includes handling instructions, the handheld display 42 will transition to the screen shown in Figure 19(B-3).

[0187] If a package is deemed unsuitable for delivery, the user will leave it with a staff member at the store counter, and the package will be handed over to the delivery company via the store staff. This ensures that even packages with specific handling requirements are safely handed over to the delivery company without damage.

[0188] The front display 41 screen shown in Figure 19(A-2) displays text 231 prompting the user to complete the shipping procedure at the counter inside the store, and an image 232 guiding the user to the counter inside the store.

[0189] As shown in Figure 19(B-2), the screen of the handheld display 42 displays text 235 indicating that the package is too large to be mailed, and text 236 prompting the user to complete the shipping procedure at the counter inside the store.

[0190] As shown in Figure 19(B-3), the screen of the handheld display 42 displays text 237 notifying that the item is not suitable for mailing and text 236 prompting the user to complete the shipping procedure at the counter inside the store.

[0191] Furthermore, when the user operates the button 226 that instructs printing the shipping label on the handheld display 42 shown in Figure 19(B-1), the front display 41 transitions to the screen shown in Figure 20(A-1), and the handheld display 42 transitions to the screen shown in Figure 20(B-1).

[0192] As shown in Figure 20(A-1), the front display 41 screen displays text 241 indicating that printing of the shipping label has started, and an image 242 guiding the user to the location of the printer 44 of this device. The image shows a frame surrounding the printer 44 to indicate its location.

[0193] As shown in Figure 20(B-1), the screen of the handheld display 42 displays text 245 indicating that printing of the shipping label has started, and an image 246 indicating that the shipping label is being printed.

[0194] At this point, once the printing of the shipping label is complete, the front display 41 transitions to the screen shown in Figure 20(A-2), and the handheld display 42 transitions to the screen shown in Figure 20(B-2).

[0195] As shown in Figure 20(A-2), the front display 41 screen displays text 251 indicating that the printing of the shipping label is complete, text 252 prompting the user to attach the shipping label to the packaged item, and an image 253 showing the process of attaching the shipping label to the packaged item.

[0196] As shown in Figure 20(B-2), the screen of the handheld display 42 displays text 255 indicating that the printing of the shipping label is complete, text 256 prompting the user to attach the shipping label to the packaged item, and an OK button 258 to approve the attachment of the shipping label.

[0197] Here, if the user wants to attach the shipping label to the package on the spot, they press the OK button 258. In this case, the front display 41 transitions to the screen shown in Figure 21(A-1), and the handheld display 42 transitions to the screen shown in Figure 21(B-1). On the other hand, if the user does not want to attach the shipping label to the package on the spot, they press the button 119 to indicate completion.

[0198] As shown in Figure 21(A-1), the front display 41 screen displays text 261 prompting the user to deposit a package, and an image 262 guiding the user to the location of the mail slot 51 of the device. In image 262, the location of the mail slot 51 is indicated by a frame image surrounding the mail slot 51.

[0199] As shown in Figure 21(B-1), the screen of the handheld display 42 displays text 265 prompting the user to drop off the package, and an OK button 268 to approve dropping off the package.

[0200] Here, if the user decides to drop off the package on the spot, they press the OK button 268. In this case, the front display 41 transitions to the screen shown in Figure 21(A-2), and the handheld display 42 transitions to the screen shown in Figure 21(B-2). On the other hand, if the user does not decide to drop off the package on the spot, they press the button 119 to indicate completion.

[0201] As shown in Figure 21(A-2), the front display 41 screen displays text 271 indicating that the shipping procedure is completed by dropping off the package, text 272 prompting the user to enter information (shipping notification) that the shipping procedure is complete using the shipping application on the smartphone 3, and an image 273 showing the status of the package being shipped.

[0202] The screen of the handheld display 42 shown in Figure 21(B-2) displays the following: text 275 indicating that the shipping procedure is complete, text 276 expressing gratitude for using the device, and text 277 prompting the user to input (notify) that the shipping procedure is complete using the shipping application on the smartphone 3. At this point, the system may be configured to automatically send an instruction to the server device 2 to change the status information of the user's package from "awaiting shipment" to "shipped" in conjunction with the display on the handheld display 42 shown in Figure 21(B-2).

[0203] If an error occurs during the processing of the automatic measurement mode, an error screen (not shown) will be displayed on the front display 41 and the handheld display 42. This error screen will display text indicating that an error has occurred and processing cannot be performed normally, text prompting the user to complete the shipping procedure at the counter in the store, an image guiding the user to the counter in the store (for example, a store floor plan), and text prompting the user to call a store staff member if the shipping label printing paper runs out.

[0204] Next, we will explain the screens displayed in the shipping support device 1 when in packaging material purchase mode. Figures 22, 23, and 24 are explanatory diagrams showing the screens displayed in the shipping support device 1 when in packaging material purchase mode.

[0205] In the shipping support device 1, when a user operates the selection unit 107 for the packaging material purchase mode, which is titled "Purchase Packaging Materials" on the handheld display 42 shown in Figure 13(B), the front display 41 first transitions to the screen shown in Figure 22(A), and the handheld display 42 transitions to the screen shown in Figure 22(B).

[0206] Furthermore, when a user operates the selection unit 107 for the packaging material purchase mode on the handheld display 42 shown in Figure 13(B), the handheld display 42 may transition to a screen (not shown) that asks the user whether registration for the specified payment service has been completed. Only if registration for the specified payment service has been completed, the display may transition to the screens shown in Figures 22(A) and (B). Alternatively, if registration for the specified payment service has not been completed, the display may transition to a screen (not shown) that instructs the user to purchase packaging materials at the counter in the store.

[0207] As shown in Figure 22(A), the front display 41 screen displays an image 301 that guides viewers to the packaging materials stored in the rack 12, and text 302 that guides viewers to the rack 12 located next to the main unit 11.

[0208] As shown in Figure 22(B), the screen of the handheld display 42 displays text 305 prompting the user to select packaging materials stored in the rack 12, and text 306 indicating that packaging materials can only be purchased one at a time.

[0209] At this point, after a predetermined time has elapsed since the screens shown in Figures 22(A) and (B), the front display 41 transitions to the screen shown in Figure 23(A-1), and the handheld display 42 transitions to the screen shown in Figure 23(B-1).

[0210] The subsequent steps are the same as the packaging material purchase step in automatic measurement mode. Specifically, the front display 41 sequentially displays the screens shown in Figure 23(A-1), Figure 24(A-1), and Figure 24(A-2), respectively, and these screens are the same as the screens shown in Figure 16(A-1), Figure 17(A-1), and Figure 17(A-2), respectively, in automatic measurement mode. Also, the handheld display 42 sequentially displays the screens shown in Figure 23(B-1), Figure 23(B-2), Figure 23(B-3), Figure 24(B-1), and Figure 24(B-2), respectively, and these screens are the same as the screens shown in Figure 16(B-1), Figure 16(B-2), Figure 16(B-3), Figure 17(B-1), and Figure 17(B-2), respectively, in automatic measurement mode.

[0211] (First embodiment, first modified example) Next, a first modified example of the first embodiment will be described. Points that are not specifically mentioned here are the same as in the above embodiment. Figure 25 is an explanatory diagram showing the screen displayed in the self-dropping mode of the shipping support device 1 according to the first modified example of the first embodiment.

[0212] In the first embodiment, even if the measured size of the package falls within the category of package that can be mailed, if the package in question has handling instructions that make it unsuitable for mailing, that is, if the shipping declaration information obtained from the server device 2 includes handling instructions, it is determined that mailing is not possible, the screen shown in Figure 19(B-3) is displayed on the handheld display 42, the shipping procedure by this device is interrupted, and the shipping procedure is to be carried out at the store counter.

[0213] On the other hand, in this modified version, if the item in question has handling instructions that make it unsuitable for mailing, guidance for proceeding with the mailing procedure is displayed on the user-controlled display 42. At this time, the user is asked whether or not to proceed with the mailing procedure, and if the user agrees, the mailing procedure proceeds and the process moves to printing the shipping label.

[0214] Specifically, if the package in question has handling instructions that make it unsuitable for mailing, that is, if the shipping declaration information obtained from the server device 2 includes handling instruction information, the front display 41 transitions to the screen shown in Figure 25(A), and the handheld display 42 transitions to the screen shown in Figure 25(B). These screens are generated based on the handling instruction information included in the pre-declaration information.

[0215] As shown in Figure 25(A), the front display 41 screen shows the following: character 281 notifying that handling instructions unsuitable for mailing have been set; character 282 representing the content of the handling instructions set by the user; and character 283 indicating guidance for cases where mailing is exceptionally permitted. The example shown in Figure 25(A) indicates that even if the user has set handling instructions for fragile items, mailing is possible if the package is sufficiently protected with cushioning material.

[0216] The screen of the handheld display 42 shown in Figure 25(B) displays text 285 asking whether to proceed with the mailing procedure for the package, and a button 286 instructing the user to proceed with the mailing procedure. When the user presses the button 286 to proceed, the screen changes to the one shown in Figure 19(A-1) and Figure 19(B-1), and the shipping label is printed.

[0217] Furthermore, if the handling instructions for the package in question require refrigeration, it is advisable to interrupt the shipping process without contacting the user to inquire whether they wish to continue the shipping procedure, and to display a notice indicating that the package cannot be shipped by post.

[0218] (Second modified example of the first embodiment) Next, a second modification of the first embodiment will be described. Points not specifically mentioned here are the same as in the previous embodiment. Figure 26 is a flowchart showing the procedure for processing unpackaged goods according to the second modification of the first embodiment.

[0219] In the first embodiment, as shown in Figure 11, in the case of packages packaged with packaging materials other than standard packaging materials, provisional size information based on the image captured by the upper imaging unit 31 is corrected with corrected size information based on the image captured by the side imaging unit 35 to obtain final size information. Also, as shown in Figure 12, in the case of unpackaged packages, no correction is made using the corrected size information based on the image captured by the side imaging unit 35, and the provisional size information based on the image captured by the upper imaging unit 31 is used as the final size information.

[0220] On the other hand, in this modified example, in the case of unpackaged goods, as in the case of packaged goods shown in Figure 11, provisional size information based on the image captured by the upper imaging unit 31 is corrected with corrected size information based on the image captured by the side imaging unit 35 to obtain final size information. Specifically, instead of provisional height information based on the depth image from the upper imaging unit 31, the size classification of the goods is determined based on height information based on the occlusion status of the reference marker 39 in the color image from the side imaging unit 35.

[0221] Specifically, as shown in Figure 26, after the ST201 to ST203 processes similar to those in the first embodiment (see Figure 12), the processor 63 acquires a color image from the color camera 36 of the side imaging unit 35 (ST221) and detects a reference marker 39 from the color image (ST222). Then, the processor 63 determines whether the height of the object is less than or equal to the upper limit value for the height of the first classification based on the occlusion status of the reference marker 39 in the color image (size classification determination process) (ST223).

[0222] If the height of the object is less than or equal to the upper limit of the first category (Yes in ST223), the process proceeds to ST205. On the other hand, if the height of the object exceeds the upper limit of the first category (No in ST223), the processor 63 determines that the object is a package that cannot be mailed (ST211). Also, in ST205, if the XY dimensions of the circumscribed rectangular parallelepiped of the object are less than or equal to the upper limit of the first category (Yes in ST205), the processor 63 determines that the object is a package of the first category (ST206).

[0223] On the other hand, if the XY dimensions of the circumscribed rectangular parallelepiped of the object exceed the upper limit of the first category (No in ST205), the processor 63 then determines whether the height of the object is less than or equal to the upper limit of the height for the second category based on the occlusion status of the reference marker 39 in the color image (size category determination process) (ST224).

[0224] If the height of the object is less than or equal to the upper limit of the second category (Yes in ST224), proceed to ST208. The processing from ST208 onward is the same as in the first embodiment. On the other hand, if the height of the object exceeds the upper limit of the second category (No in ST224), proceed to ST211. The processing in ST211 is the same as in the first embodiment.

[0225] In this modified example, in order to accurately distinguish between two size categories with different upper height limits, two reference markers 39 corresponding to the two size categories may be provided.

[0226] (Third modified example of the first embodiment) Next, a third modification of the first embodiment will be described. Points not specifically mentioned here are the same as in the previous embodiment. Figure 27 is an explanatory diagram showing the main parts of the shipping support device 1 according to the third modification of the first embodiment. Figure 28 is a flowchart showing the operation procedure of the processor 63 of the shipping support device 1.

[0227] As shown in Figure 27, the main body 11 of the shipping support device 1 is provided with a storage section 52 for storing packages, and this storage section 52 is provided with a mail slot 51 that is suitable for the size of packages that can be mailed. Furthermore, the storage section 52 is provided with a lid 81 that covers the mail slot 51, and a locking mechanism 82 that restrains the opening and closing operation of the lid 81 to prevent the mailing of packages. The locking mechanism 82 can be configured, for example, by driving a locking member (not shown) that restrains the opening and closing operation of the lid 81 with a drive unit (not shown) consisting of an actuator such as a solenoid.

[0228] Furthermore, the storage compartment 52 is equipped with a sensor 83 for detecting the insertion of packages, that is, packages passing through the mail slot 51. The detection of package insertion is based on publicly known technology (see, for example, Japanese Patent Publication No. 10-91678), and various configurations can be adopted. In addition to being configured as a passage sensor, the sensor 83 may also be configured as an open / close sensor for detecting the opening and closing of the lid 81 covering the mail slot 51. Alternatively, a reader may be provided near the mail slot 51 to read a two-dimensional code printed on the shipping label, thereby detecting package insertion and simultaneously identifying the inserted package.

[0229] The processor 63 controls the locked state of the locking mechanism 82 to prevent unmeasured packages or items other than packages (such as garbage) from being inserted into the mail slot 51. In this embodiment, the processor 63 temporarily releases the locked state of the locking mechanism based on a determination that package insertion is permitted. In this embodiment, the processor 63 also temporarily releases the locked state of the locking mechanism 82 when the printer 44 has finished printing the shipping label. In this embodiment, the processor 63 returns the locking mechanism 82 to the locked state when it detects that a package has been inserted based on the detection result of the sensor 83.

[0230] Furthermore, the processor 63 counts the number of packages that have been determined to be ready for delivery and have been placed in the storage unit 52. In this embodiment, the processor 63 counts the number of packages placed in the storage unit 52 based on the detection results of the sensor 83. That is, each time the sensor 83 detects the delivery of a package, the number of packages is incremented. The counting of packages ready for delivery is also based on publicly known technology (see, for example, Japanese Patent Application Publication No. 2001-76262), and various configurations can be adopted.

[0231] In this embodiment, the processor 63 compares the count of deposited packages with a threshold value (upper limit, or a predetermined number smaller than the upper limit) related to the number of packages that can be stored in the storage unit 52, and based on the comparison result, it processes an alert for a package collection request. Specifically, when the count of packages exceeds the threshold value, it processes an alert for a collection request. In this case, for example, the notification of the collection request alert from the shipping support device 1 may be sent via the server device 2 and the delivery company's server device (not shown) to a terminal (not shown) held by the worker in charge of collection. After the notification of the collection request alert, it is advisable to set a threshold value that allows for the deposit of approximately 2 to 5 packages so that the shipping support device 1 can be used continuously until the packages are collected.

[0232] Furthermore, in this embodiment, the processor 63 resets the count value of the packages once the collection of packages from the storage unit 52 is complete. In this case, for example, when a worker of a delivery company unlocks the lock 55 (see Figure 2) of the storage unit 52 and finishes collecting the packages, they perform a collection completion operation, and the processor 63 resets the count value of the packages in response to this operation. Alternatively, the completion of package collection may be detected based on the opening and closing of the door 53 of the storage unit 52 or the unlocking and locking of the lock 55, and the count value of the packages may be reset accordingly. It should be noted that resetting the count value after package collection is also a known technique (see, for example, Japanese Patent Publication No. 6-30738), and various configurations can be adopted.

[0233] Furthermore, in this embodiment, if the number of packages already deposited reaches the upper limit of the number of packages that can be stored in the storage unit 52 when packages are collected, the threshold for determining whether an alert is necessary is updated. In this threshold update, the threshold is reset to a value that is a predetermined number smaller than the current set value.

[0234] Specifically, as shown in Figure 28, first, when the sensor 83 detects that a package has been deposited (Yes in ST301), the processor 63 increments the number of deposited packages (the count of deposited packages) by 1 (ST302). Next, the processor 63 determines whether the number of deposited packages has reached a predetermined threshold (determination of whether an alert needs to be issued) (ST303). If the number of deposited packages has reached the threshold (Yes in ST303), it determines whether a pickup request alert has already been issued (ST304). If a pickup request alert has not already been issued (No in ST304), it performs the process of issuing a pickup request alert (collection request alert issuance process) (ST305).

[0235] On the other hand, if an alert for a pickup request has already been issued (Yes in ST304), the processor 63 then determines whether or not it has detected that the package has been picked up by a worker of the delivery company (ST306). If it has detected that the package has been picked up (Yes in ST306), the processor 63 then determines whether or not the number of packages that have been delivered has reached a predetermined upper limit (S307). If the number of packages that have been delivered has reached the upper limit (Yes in ST307), the threshold for determining whether or not an alert needs to be issued is reset to a value that is a predetermined number smaller than the current setting (threshold update) (ST308).

[0236] Next, processor 63 resets the number of mailed packages (the total number of mailed packages) (ST309).

[0237] Here, the threshold for determining whether an alert is necessary is set to a value less than the upper limit of the number of packages that can be stored in the storage unit 52 (the number of packages deposited when the storage unit 52 is full). In other words, the threshold for determining whether an alert is necessary is set to a value that is a predetermined number of leeway units (for example, about 2 to 5) smaller than the upper limit. This allows a predetermined number of packages to be deposited between the issuance of the pickup request alert and the collection of the packages. The number of leeway units can be set based on the time required from the issuance of the pickup request alert to the collection of the packages, or the pace at which packages are deposited (number of packages deposited per unit time).

[0238] In this modified version, since an alert for a pickup request is issued when there is still space in the storage unit 52, packages are picked up before the storage unit 52 becomes full, thus reducing the likelihood of a situation where packages cannot be deposited because the storage unit 52 is full. Furthermore, by controlling the threshold for determining whether an alert is necessary according to the actual number of packages deposited, it is possible to reliably avoid a situation where packages cannot be deposited because the storage unit 52 is full.

[0239] In this embodiment, as shown in Figures 2 and 27, there is one mail slot 51 adjusted to match the maximum size category of mailable packages. However, it is also possible to provide two or more mail slots 51 corresponding to different size categories of mailable packages, and the shipping support device 1 releases the lock on the lid of the mail slot 51 corresponding to the package size category when it determines whether mailing is permitted or when the printer 44 prints a shipping label. By controlling the lock state of the lid of the mail slot 51 according to the package size category in this way, it is possible to reliably prevent fraud such as swapping packages during measurement with packages during mailing.

[0240] (Second Embodiment) Next, a second embodiment will be described. Points not specifically mentioned here are the same as in the previous embodiment. Figure 29 is a block diagram illustrating the schematic configuration of the shipping support device 1 and server device 2 according to the second embodiment.

[0241] In the first embodiment (see Figure 7), the processor 63 of the shipping support device 1 performed the processing related to shipping support, namely, object detection processing, shooting position determination processing, size measurement processing, size classification determination processing, packaging material selection processing, pre-declaration content inquiry processing, mailing feasibility determination processing, shipping label printing processing, packaging material recognition processing, payment processing, and screen control processing. However, in this embodiment, the processor 73 of the server device 2 performs the processing related to shipping support. In addition, the processor 73 of the server device 2 also performs the management of shipping declaration information entered in advance by the user and processing related to payment. The processor 73 of the server device 2 performs the necessary processing by executing programs stored in memory 72.

[0242] In the shipping support device 1, the color image acquired by the color camera 32 of the upper imaging unit 31, the depth image acquired by the depth camera 33 of the upper imaging unit 31, and the color image acquired by the color camera 36 of the side imaging unit 35 are transmitted from the communication unit 61 to the server device 2. In addition, the shipping support device 1 receives information transmitted from the communication unit 71 of the server device 2 in the communication unit 61, and based on that information, the processor 63 controls the front display 41 and the handheld display 42 to display the required screen, controls the reader 43 to read the 2D code, and controls the printer 44 to print the shipping label.

[0243] By the way, regarding user management when providing the shipping support service to users, the system currently involves inputting information about shipping packages using the shipping application on smartphone 3, reading a 2D code for shipping displayed on the shipping application on smartphone 3, and reading a 2D code for payment using the payment application on smartphone 3. However, it is also possible to identify users and process payments using facial recognition. In this case, the user's registered facial image (feature data) may be registered in advance on server device 2, and facial recognition payment processing may be performed by matching the authenticated facial image obtained from the user's captured image on shipping support device 1 with the registered facial image.

[0244] As described above, embodiments have been explained as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these embodiments and can be applied to embodiments that have been modified, replaced, added, or omitted. Furthermore, it is possible to create new embodiments by combining the components described in the above embodiments. [Industrial applicability]

[0245] The shipping support device and shipping support system according to the present invention have the effect of allowing users to purchase necessary packaging materials in a self-checkout manner when packaging and shipping unpackaged packages, and are useful as a shipping support device and shipping support system that support the shipping procedures of users who hand over packages to delivery companies. [Explanation of Symbols]

[0246] 1. Shipping support device 2 Server devices 3. Smartphone 11 Main unit 12 racks 21 Mounting platform (mounting section) 22 Mounting surface 23 Side wall 31. Upward imaging unit (detection unit) 32 Color Camera 33 Depth Camera 35. Lateral imaging unit (detection unit) 36 Color Camera 39 Reference Marker 41 Front display (display unit) 42. Handheld display (display unit, operation unit) 43 Leader 44 Printer (Printing Section) 51 Mail slot 52 Storage compartment 53 Doors 54 Handle 55 tablets 61 Communications Department 62 memory 63 processors 71 Communications Department 72 memory 73 processors

Claims

1. A shipping support device that supports a shipping procedure of a user who delivers a package to a delivery company, a loading section where a user places their luggage; One or more photographing units that photograph the luggage placed on the placement unit; a storage unit for storing parcels posted by users; a display unit that presents information to a user; an operation unit on which a user performs operations related to shipping; a processor that performs control related to shipping assistance, The processor: When a user uses the operation unit to instruct the purchase of a packaging material to be posted, the type of packaging material to be posted placed in the placement unit is determined by image recognition of the image captured by the imaging unit, The shipping support device is characterized in that the result of the determination is displayed on the display unit.

2. 2. The shipping support device according to claim 1, wherein the placement unit, the photographing unit, the storage unit, the display unit, and the operation unit are integrally provided in a single housing.

3. The processor: The shipping support device according to claim 1, characterized in that the display unit displays guidance regarding payment of the purchase price of the packaging material to be posted in accordance with the type of packaging material to be posted according to the determination result.

4. The processor: The shipping support device of claim 1, characterized in that when it receives an instruction from a user using the operation unit to reselect packaging material to be posted, it repeats the process of determining the type of packaging material to be posted placed in the placement unit by image recognition of the captured image.

5. 2. The shipping support device according to claim 1, further comprising a packing material storage unit that stores a plurality of types of packing materials to be posted.

6. A shipping support system that supports a user in a shipping procedure for handing over a package to a delivery company, a shipping support device having a placement unit where a user places a package, one or more photographing units that detect the package placed on the placement unit, a storage unit that stores the package posted by the user, a display unit that presents information to the user, and an operation unit that allows the user to perform operations related to shipping; a server device connected to the shipping support device via a network, The shipping support device includes: transmitting the captured image of the imaging unit and operation information of the operation unit to the server device; The server device When a user uses the operation unit to instruct the purchase of a packaging material to be posted, the type of packaging material to be posted placed in the placement unit is determined by image recognition of the image captured by the imaging unit, transmitting information about the determination result to the shipping support device; The shipping support device includes: The shipping support system is characterized in that information regarding the determination result received from the server device is displayed on a display unit.

Images