Shipping support device and shipping support system

Abstract

To provide a shipping support device and a shipping support system that, when packages subjected to size measurement include a package packed with a dedicated packaging and a package packed with a packaging other than the dedicated packaging, can efficiently perform processing for measuring the size of a package with sufficient accuracy.SOLUTION: A shipping support device 1 comprises: a placement table 21 on which a user places a package; an upper photographing unit 31 that photographs the package placed on the placement table 21 from above; a lateral photographing unit 35 that photographs the package placed on the placement table from a lateral side; a storage unit 52 that stores the package posted by the user; displays 41, 42 that present information to the user; and a processor. The processor measures the size of the package based on an image photographed by the upper photographing unit 31, when determining that the package is packed with a dedicated packaging based on a result of the measurement, omits processing for measuring the size of the package based on an image photographed by the lateral photographing unit 35, determines that the package can be posted, and displays information on a result of the determination on the displays 41, 42.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a shipping support device and a shipping support system that support the shipping procedure of a user who hands over a package to a delivery company. [Background technology]

[0002] In recent years, the use of person-to-person EC (Electronic Commerce) sites that mediate commercial transactions between individuals, such as flea markets and auctions, has been rapidly expanding. In particular, companies that operate person-to-person EC sites have been making efforts to make commercial transactions between individuals easier by providing users with dedicated applications to be installed on user terminals (such as smartphones). For example, when shipping an item traded on a person-to-person EC site as a package, the sender (seller) can easily complete the shipping procedure by following the procedure in the dedicated application and then visiting a store (agency) such as a nearby convenience store. At this time, if a device that supports the shipping procedure allows the user to easily complete the shipping procedure without interacting with a store clerk, the convenience of the user can be further improved.

[0003] A known technology for assisting with such package shipping procedures is one that uses a sensor such as a camera on a user terminal to measure the size of the package, presents the user with a delivery type corresponding to the package size, and allows the user to post the package in a mailbox if the delivery type allows for posting in a mailbox (see Patent Document 1).

[0004] There is also known technology in which a database manages the dispatch, delivery and receipt of packages based on identification information in a two-dimensional code printed on a label affixed to the package's packaging, and the user registers the package to be dispatched by reading the two-dimensional code on the package at a user terminal, and then drops the package into a receiving box installed in a post box, convenience store, etc. (see Patent Document 2).

[0005] In addition, a technology is known in which a user inputs information (postal information) regarding the sender and destination and the delivery type into a user terminal, the size of the package is measured by a shipping support device (unmanned reception machine), the user terminal calculates the delivery fee based on the package size obtained from the shipping support device and processes the payment of the delivery fee, and the shipping support device prints a label including the information entered on the user terminal, and the user drops the package with the label affixed into the shipping support device (see Patent Document 3).

[0006] Also, a technology is known in which a shipping support device (parcel collection terminal device) allows a user to input parcel delivery information (information such as the destination) and processes the payment of delivery charges based on that information, and also prints a label containing the delivery information, and the user then drops the parcel with the label affixed into the shipping support device (see Patent Document 4).

[0007] Also, a technology is known in which, when a user places a package in a shipping support device (automatic parcel collection device), the size of the package is measured, and it is determined whether the size of the package complies with a predetermined standard, and the result of the determination is presented to the user, and the package is stored or returned according to the user's selection operation (see Patent Document 5). In particular, this technology can count and record the number of packages stored in the shipping support device.

[0008] Also, a technology is known in which a shipping support device (delivery box device) measures the size of a target package, processes the payment of delivery charges based on the size of the package, and the shipping procedure is completed when the user places the package in the shipping support device (see Patent Document 6). In particular, this technology allows shipping procedures to be carried out not only for packaged packages but also for unpackaged packages. That is, the size of an unpackaged package is measured, and appropriate packaging materials corresponding to the size of the package are presented to the user, who then packs the package in the presented packaging materials and places it in the shipping support device. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Patent No. 6490282 [Patent Document 2] Patent No. 6664601 [Patent Document 3] Patent No. 6524601 [Patent Document 4] Japanese Patent Application Publication No. 10-91678 [Patent Document 5] JP 2001-76262 A [Patent Document 6] Patent No. 5891394 Summary of the Invention [Problem to be solved by the invention]

[0010] Conventional technology allows users to complete the necessary operations on a shipping support device and then post the package on the spot, so that shipping procedures can be completed without the involvement of store staff, thereby improving user convenience.

[0011] On the other hand, when users send their packages, they need to pack them in appropriate packaging materials. fixed form While we recommend packaging materials, fixed form Packaging materials other than packaging materials may also be accepted. In this case, the packages that are the subject of size measurement by the shipping support device include: fixed form Packages packed in packaging materials; fixed form There are also packages packed with packaging materials other than packaging materials. For this reason, the process of measuring the size of packages is fixed form It is desirable to be able to do this efficiently by focusing on whether the item is a packaging material or not.

[0012] Therefore, the present invention provides the following to the luggage to be measured: fixed form Packages packed in packaging materials; fixed formTo provide a shipping support device and a shipping support system capable of efficiently measuring the size of a package with sufficient accuracy when the package is packed with a packing material other than a packing material. [Means for solving the problem]

[0013] The shipping support device of the present invention is a shipping support device that supports the shipping procedures of a user who hands over a package to a delivery company, and includes a placement section on which the user places the package, a first detection section that outputs a photographed image of the package placed on the placement section, a second detection section that outputs three-dimensional position information of the package placed on the placement section, and a third detection section that outputs height information of the package placed on the placement section. The designated size category that users are permitted to post a storage unit for storing packages corresponding to the above-mentioned, a display unit for presenting information to a user, and a processor for controlling shipping support, the processor identifying whether or not the package placed on the placement unit is packed in a standard packaging material of the designated size category by image recognition processing of the captured image acquired from the first detection unit, acquiring provisional size information of the package placed on the placement unit by size measurement processing using the three-dimensional position information acquired from the second detection unit, acquiring corrected size information regarding the height of the package placed on the placement unit by the height information acquired from the third detection unit, and when the processor has identified that the package placed on the placement unit is packed in the standard packaging material, the processor performs a process of calculating the size of the package placed on the placement unit based on the provisional size information. If the package matches the size category specified above that allows posting, When the package placed on the placement section is determined to be not packed with the standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package placed on the placement section. Whether the package matches the size category specified above that allows posting and information regarding the result of the determination is displayed on the display unit.

[0014] The shipping assistance system of the present invention is a shipping assistance system that assists a user in the shipping procedure of handing over a package to a delivery company, and includes a placement section where the user places the package, a first detection section that outputs a photographed image of the package placed on the placement section, a second detection section that outputs three-dimensional position information of the package placed on the placement section, and a third detection section that outputs height information of the package placed on the placement section. The designated size category that users are permitted to post and a server device connected to the shipping support device via a network, the shipping support device transmitting the captured image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit to the server device, the server device, upon receiving the captured image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit from the shipping support device, identifies whether or not the package placed on the placement unit is packed in a standard packaging material of the specified size category by image recognition processing of the captured image, obtains provisional size information of the package placed on the placement unit by size measurement processing using the three-dimensional position information, obtains corrected size information regarding the height of the package placed on the placement unit from the height information, and when the server device identifies that the package placed on the placement unit is packed in the standard packaging material, based on the provisional size information, The package fits within the size range specified above that allows posting. and when it is determined that the package placed on the placement section is not packed with the standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package placed on the placement section. Whether the package matches the size category specified above that allows posting and transmits information relating to the determination result to the shipping support device, and the shipping support device displays the information relating to the determination result received from the server device on the display unit. Effect of the Invention

[0015] According to the present invention, whether or not the package is packed in a standard packing material is identified by image recognition processing of the captured image, and if the package is packed in a standard packing material, the package placed on the placement section is identified based on the provisional size information. The package fits within the designated size range that allows posting Since the processing based on the corrected size information regarding the height is omitted, the processing can be simplified. If the package is not packed in a standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package. Whether the package fits within the size range specified for permitted postingThis makes it possible to accurately determine the size of a package when the package falls within a specified size category is posted, and thus makes it possible to efficiently measure the size of the package with sufficient accuracy. [Brief description of the drawings]

[0016] [Figure 1] Overall configuration diagram of the shipping support system according to the first embodiment [Diagram 2] Front view of the shipping support device 1 [Diagram 3] FIG. 1 is a perspective view showing a main part of a shipping support device 1. [Figure 4] A cross-sectional view of the delivery support device 1, in which the placement table 21 is viewed from above. [Diagram 5] A cross-sectional view of the delivery support device 1, in which the placement table 21 is viewed from the side. [Figure 6] FIG. 1 is an explanatory diagram illustrating a waybill printed by the shipping support device 1. [Figure 7] A block diagram showing a schematic configuration of a shipping support device 1. [Figure 8] FIG. 1 is an explanatory diagram showing an overview of processing performed by the shipping support device 1 for packed packages. [Figure 9] FIG. 1 is an explanatory diagram showing an overview of processing for unpackaged packages performed by the shipping support device 1. [Figure 10] FIG. 1 is a flow diagram showing the procedure of processing for packed packages performed by the shipping support device 1. [Figure 11] FIG. 1 is a flow diagram showing the procedure of processing for packed packages performed by the shipping support device 1. [Figure 12] FIG. 1 is a flow diagram showing a procedure for processing unpackaged packages performed by the shipping support device 1. [Figure 13] FIG. 13 is an explanatory diagram showing a screen displayed on the shipping support device 1 during standby. [Figure 14] FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. [Figure 15] FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. [Figure 16]FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. [Figure 17] FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. [Figure 18] FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. [Figure 19] FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. [Figure 20] FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. [Figure 21] FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. [Figure 22] FIG. 13 is an explanatory diagram showing a screen displayed in a packing material purchase mode in the shipping support device 1. [Diagram 23] FIG. 13 is an explanatory diagram showing a screen displayed in a packing material purchase mode in the shipping support device 1. [Figure 24] FIG. 13 is an explanatory diagram showing a screen displayed in a packing material purchase mode in the shipping support device 1. [Diagram 25] FIG. 11 is an explanatory diagram showing a screen displayed in a self-posting mode in a shipping support device 1 according to a first modified example of the first embodiment. [Figure 26] FIG. 11 is a flow diagram showing a procedure of processing for unpackaged packages according to a second modified example of the first embodiment. [Figure 27] FIG. 11 is an explanatory diagram showing a main part of a shipping support device 1 according to a third modified example of the first embodiment. [Figure 28] FIG. 11 is a flow diagram showing an operation procedure of the processor 63 of the dispatch support device 1 according to the third modified example of the first embodiment. [Figure 29] A block diagram showing a schematic configuration of a delivery support device 1 and a server device 2 according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The first invention made to solve the above problem is a shipping support device that supports the shipping procedure of a user who hands over a package to a delivery company, comprising: a placement section on which the user places the package; a first detection section that outputs a photographed image of the package placed on the placement section; a second detection section that outputs three-dimensional position information of the package placed on the placement section; and a third detection section that outputs height information of the package placed on the placement section. The designated size category that users are permitted to post a storage unit for storing packages corresponding to the above-mentioned, a display unit for presenting information to a user, and a processor for controlling shipping support, the processor identifying whether or not the package placed on the placement unit is packed in a standard packaging material of the designated size category by image recognition processing of the captured image acquired from the first detection unit, acquiring provisional size information of the package placed on the placement unit by size measurement processing using the three-dimensional position information acquired from the second detection unit, acquiring corrected size information regarding the height of the package placed on the placement unit by the height information acquired from the third detection unit, and when the processor has identified that the package placed on the placement unit is packed in the standard packaging material, the processor performs a process of calculating the size of the package placed on the placement unit based on the provisional size information. If the package matches the size category specified above that allows posting, When the package placed on the placement section is determined to be not packed with the standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package placed on the placement section. Whether the package matches the size category specified above that allows posting and information regarding the result of the determination is displayed on the display unit.

[0018] According to this, whether or not the package is packed in a standard packing material is identified by image recognition processing of the captured image, and if the package is packed in a standard packing material, the package placed on the placement section is determined based on the provisional size information. The package fits within the designated size range that allows posting Since the processing based on the corrected size information regarding the height is omitted, the processing can be simplified. If the package is not packed in a standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package. Whether the package fits within the size range specified for permitted posting This makes it possible to accurately determine the size of a package when the package falls within a specified size category is posted, and thus makes it possible to efficiently measure the size of the package with sufficient accuracy.

[0019] In a second aspect of the present invention, the placement section, the first detection section, the second detection section, the storage section, and the display section are integrally provided in a single housing.

[0020] This allows the device to take up less space, making it easy to install in stores such as convenience stores.

[0023] Also, Third The invention relates to the Second The detection unit is a 3D camera that outputs 3D position information of the subject. Consists of do.

[0024] According to this, it is possible to simultaneously obtain planar size information and height information of the luggage placed on the placement section with a single image capture. In addition, although the accuracy of the height information is relatively low, fixed form It is possible to determine with sufficient accuracy whether or not the item is packaging material.

[0025] Also, Fourth The present invention relates to the first Third Both detection units are 2D cameras that output 2D images of the subject. Consists of do.

[0026] This makes it possible to obtain high-resolution two-dimensional images of the luggage placed on the placement section, and this high-resolution two-dimensional image can be used to: fixed form Packaging materials can be recognized with high accuracy.

[0027] In a fifth aspect of the present invention, the third detection unit includes a two-dimensional camera that outputs a two-dimensional image of a subject, and the baggage placed on the placement unit is sandwiched between the two-dimensional camera and the third detection unit. Third The configuration is such that an image of a reference marker provided on the opposite side of the detection unit is captured.

[0028] This makes it possible to obtain height information of luggage with high accuracy.

[0029] In addition, the seventh invention is further configured to include a printing unit that prints a shipping label, and when the processor determines that a package placed in the placement unit can be posted, it instructs the printing unit to print a shipping label for that package.

[0030] This allows the user to immediately obtain the shipping invoice required for shipping and to post the package in the device on the spot.

[0031] A seventh invention is a shipping support system that supports the shipping procedures of a user who hands over a package to a delivery company, comprising: a placement unit on which the user places the package; a first detection unit that outputs a photographed image of the package placed on the placement unit; a second detection unit that outputs three-dimensional position information of the package placed on the placement unit; and a third detection unit that outputs height information of the package placed on the placement unit. The designated size category that users are permitted to post and a server device connected to the shipping support device via a network, the shipping support device transmitting the captured image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit to the server device, the server device, upon receiving the captured image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit from the shipping support device, identifies whether or not the package placed on the placement unit is packed in a standard packaging material of the specified size category by image recognition processing of the captured image, obtains provisional size information of the package placed on the placement unit by size measurement processing using the three-dimensional position information, obtains corrected size information regarding the height of the package placed on the placement unit from the height information, and when the server device identifies that the package placed on the placement unit is packed in the standard packaging material, based on the provisional size information, The package fits within the size range specified above that allows posting. and when it is determined that the package placed on the placement section is not packed with the standard packing material, the provisional size information and the corrected size information are combined to determine the size of the package placed on the placement section. Whether the package matches the size category specified above that allows postingand transmits information relating to the determination result to the shipping support device, and the shipping support device displays the information relating to the determination result received from the server device on the display unit.

[0032] According to this, as with the first invention, the luggage to be measured for size includes: fixed form Packages packed in packaging materials; fixed form If there are packages packed in packaging materials other than packaging materials, When posting parcels that fall into a specified size category, The process of measuring the size of luggage can be carried out efficiently with sufficient accuracy.

[0033] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0034] (First embodiment) FIG. 1 is an overall configuration diagram of a shipping support system according to the first embodiment.

[0035] This shipping support system supports the shipping procedures of a user (requester) who hands over a package to a delivery company, and includes a shipping support device 1, a server device 2, and a smartphone 3 (user device). The shipping support device 1 and the server device 2 are connected via a network. The smartphone 3 and the server device 2 are also connected via a network. This shipping support system can also be used for shipping goods traded on person-to-person e-commerce sites that mediate commercial transactions between individuals, such as flea markets and auctions.

[0036] The shipping support device 1 is installed in a store such as a convenience store. This shipping support device 1 has a function of measuring the size of a package brought in by a user and presenting the user with the delivery fee for the package and the like. The shipping support device 1 also has a function as a postbox where packages are dropped off. The shipping support device 1 also has a function as a self-checkout that sells packaging materials (packaging containers). The shipping support device 1 also has a function of printing a waybill with specified information written on it based on information input in advance by a user using a smartphone 3. The user attaches the printed waybill to the package and drops it into the shipping support device 1.

[0037] The smartphone 3 is operated by a user who uses the shipping support device 1 to request a delivery company to deliver a package. A shipping application and a payment application are installed on this smartphone 3. In the shipping application, the user inputs shipping declaration information (information on the item name, sender, destination, handling instructions (fragile, precision equipment, refrigeration required), etc.) regarding the package to be shipped. Note that the shipping declaration information may be input on a user terminal other than the smartphone 3, such as a PC or a tablet terminal. The payment application is for smartphone payment, that is, payment services such as electronic money and credit cards, using the smartphone 3. The user can use this payment application to pay for the purchase of packaging materials using a specified payment service.

[0038] The server device 2 has a function of managing the shipment of packages. Specifically, the server device 2 registers and manages information input by a user in advance using a smartphone 3 or the like when shipping a package as shipping declaration information for each user, and provides the shipping declaration information to the shipping support device 1 in response to a request from the shipping support device 1. The server device 2 also has a function related to payment. Specifically, the server device 2 performs a payment process related to the payment of the price of packaging materials purchased by a user in response to a request from the shipping support device 1. The server device 2 may be installed in a remote location separate from the store (e.g., a management center), or may be installed in an appropriate location within the store (e.g., a back yard or a management room).

[0039] In this embodiment, the server device 2 has a function for managing the shipment of packages and a function related to payment, but the function for managing the shipment of packages and the function related to payment may be realized separately in different server devices.

[0040] Next, a schematic configuration of the shipping support device 1 will be described. Fig. 2 is a front view of the shipping support device 1. Fig. 3 is a perspective view showing a main part of the shipping support device 1. Fig. 4 is a cross-sectional view of the shipping support device 1 when the placement table 21 is viewed from above. Fig. 5 is a cross-sectional view of the shipping support device 1 when the placement table 21 is viewed from the side. Fig. 6 is an explanatory diagram explaining a waybill printed by the shipping support device 1.

[0041] As shown in FIG. 2, the shipping support device 1 includes a main body 11 and a rack 12.

[0042] The rack 12 (stocker) stores packaging materials (standard packaging materials, compatible packaging materials) that can be dropped into this device. In this embodiment, two types of packaging materials are stored in the rack 12: a first category of standard packaging materials (A-type standard boxes) and a second category of standard packaging materials (B-type standard boxes). The user can use the shipping support device 1 to purchase the packaging materials stored in the rack 12. The packaging materials are stored in the rack 12 in an unfolded or folded state, and are assembled by the user when packing.

[0043] As shown in Fig. 3, the main body 11 includes a platform 21 (platform section). Baggage brought in by a user is placed on this platform 21. In this embodiment, when a packaged or unpackaged baggage is placed on the platform 21, the size of the baggage is measured and the size category to which the baggage belongs is determined. In addition, when a packaging material removed from the rack 12 is placed on the platform 21, the type of the packaging material is recognized.

[0044] The placement table 21 is formed in a tray shape and has a rectangular placement surface 22 on which an object (packaged luggage, unpackaged luggage, packaging material to be purchased) is placed, and front, rear, left and right side wall surfaces 23 surrounding the placement surface 22. In this embodiment, the horizontal direction (left and right direction) of the rectangular placement surface 22 is defined as the X direction, the vertical direction (front and rear direction) of the placement surface 22 is defined as the Y direction, and the direction perpendicular to the placement surface 22 (height direction) is defined as the Z direction.

[0045] An upper photographing section 31 (first detection section) is provided on the upper side of the placement table 21 so as to face the placement surface 22. This upper photographing section 31 includes a color camera 32 (two-dimensional camera) and a depth camera 33 (three-dimensional camera). The color camera 32 and the depth camera 33 photograph objects (packaged luggage, unpackaged luggage, packaging materials to be purchased) placed on the placement surface 22 from above. The color camera 32 outputs a color image (detection result), and the depth camera 33 outputs a depth image (three-dimensional position information of the subject) (detection result). Note that a predetermined camera included in the depth camera 33 composed of multiple cameras may be used as the color camera 32. In this case, the number of cameras can be reduced, thereby reducing the cost of the device.

[0046] The depth camera 33 is a three-dimensional camera that outputs three-dimensional position information of a subject, and may be a stereo camera or a TOF (Time of Flight) camera, etc. The depth image is a distance image that includes information on the Z coordinate (distance from the depth camera 33) for each pixel defined by the X coordinate and the Y coordinate.

[0047] A lateral photographing section 35 (second detection section) is provided on the side wall surface 23 on the lateral side (right side) of the placement table 21. This lateral photographing section 35 includes two color cameras 36 (two-dimensional cameras). The two color cameras 36 are arranged offset in the front and rear (depth direction). The color cameras 36 photograph an object (packaged luggage) placed on the placement surface 22 from the side. The color cameras 36 output a color image (detection result). It is to be noted that the lateral photographing section 35 may be provided with three or more color cameras 36.

[0048] 5, a reference marker 39 is provided on one (left) side wall surface 23 so as to face the color camera 36 of the lateral imaging unit 35 provided on the other (right) side wall surface 23. A predetermined pattern image (e.g., a checkered pattern) is drawn on this reference marker 39.

[0049] Here, the color camera 36 of the lateral photographing unit 35 photographs a reference marker 39 provided on the opposite side of the baggage placed on the platform 21. Therefore, in the color image acquired by the color camera 36, ​​depending on the height of the baggage, the image of the reference marker 39 may be partially blocked by the baggage. Therefore, it is possible to determine whether the height of the baggage exceeds the upper limit based on the blocking state of the image of the reference marker 39 in the color image.

[0050] In this embodiment, if the image of the reference marker 39 in the color image is partially missing, it is determined that the upper limit value for height has been exceeded. Specifically, the reference marker 39 is disposed so that the height of the lower side from the placement surface 22 coincides with the upper limit value Hmax for height. Therefore, when the height of the baggage placed on the placement surface 22 exceeds the upper limit value Hmax, the reference marker 39 is partially blocked by the baggage, and the image of the reference marker 39 in the color image is partially missing. This makes it possible to accurately determine whether the height of the baggage has exceeded the upper limit value Hmax. In addition, as shown in FIG. 4, the two color cameras 36 of the side photographing unit 35 are provided at the front and rear, so that the height of the baggage placed on the placement surface 22 can be detected without omission.

[0051] 3, a front display 41 facing the user is provided above the platform 21. This front display 41 mainly displays various guidance screens, for example, a screen that provides guidance on the procedures for the shipping support service.

[0052] A handheld display 42 is provided on the front side of the mounting table 21. The handheld display 42 is configured as a touch panel display. Various operation screens are displayed on the handheld display 42.

[0053] A reader 43 is provided to the side of the handheld display 42. This reader 43 reads the two-dimensional code displayed on the screen of the smartphone 3. In this embodiment, when purchasing packaging material, a two-dimensional code for payment is displayed on the screen by a payment application of the smartphone 3. Also, when dropping off a package in the device, a two-dimensional code for shipping is displayed on the screen by a shipping application of the smartphone 3.

[0054] A printer 44 is provided on the front of the main body 11. This printer 44 prints a waybill 45 in a predetermined format based on the shipping declaration information (item name, sender, destination, handling instructions (fragile, precision equipment, refrigeration required), etc.) entered by the user using the smartphone 3 or the like (see FIG. 6). The user attaches this waybill 45 to the package that has already been packed. From the viewpoint of protecting personal information, it is also possible to print a waybill in a secret format in which the sender and destination information can be reproduced only by the delivery company. Furthermore, an ID (two-dimensional code) can be printed in a scannable position on the packaging material itself, and the shipping declaration information can be linked to the ID, making the waybill printing function unnecessary (see Patent No. 6664601).

[0055] 6, in addition to the shipping declaration information (item name, sender, destination, etc.) regarding the target package, an approval mark 46 is drawn (printed) on the waybill 45 as approval information regarding the size measurement result of the target package. This approval mark 46 is for approving that the size measurement of the package has been properly performed by the shipping support device 1.

[0056] In this embodiment, in the case of a packaged item, if the size category of the package actually measured corresponds to a size category that allows posting, and if no handling instructions that are not suitable for posting are set, i.e., if the shipping declaration information does not include handling instructions, it is determined that posting is permitted. If the determination result indicates that posting of the item is permitted, a waybill 45 including an approval mark 46 is printed by the shipping support device 1. Note that the approval mark 46 is not drawn (printed) on general waybills that are not produced by the shipping support device 1.

[0057] 6, the characters "measured" are printed on the waybill 45 as the approval mark 46. Alternatively, a predetermined symbol or figure (icon) may be drawn on the waybill 45 as the approval mark 46. Alternatively, characters indicating the size category of the package based on the measurement result may be printed as the approval mark 46.

[0058] In this embodiment, a waybill is printed that includes an approval mark 46 indicating that the measurement results have been approved, but the presence or absence of approval of the measurement results may be expressed by the format of the waybill instead of the approval mark 46. In other words, the waybill that is printed after the size of the package is properly measured in the shipping support device 1 may be printed in a special format that is different from general waybills.

[0059] In addition, if the target package has handling instructions (fragile, precision equipment, requires refrigeration, etc.), the handling instructions may be printed on the shipping label in addition to the sender and destination information and the approval mark (approval information).

[0060] In this embodiment, the visualized approval information allows the delivery company worker to immediately confirm that the size measurement of the package was properly performed by the shipping support device 1 and that there is no need to measure the size again, simply by visually checking the waybill attached to the package. Therefore, after the package is collected, the delivery company worker can immediately proceed with the transport of the package.

[0061] In addition to such visualized approval information, electronic approval information can be used to present to the delivery company that the size measurement of the parcel was properly performed in the shipping support device 1. In this case, the delivery company's worker cannot confirm whether the size measurement of the parcel was properly performed by just visually inspecting the parcel. Therefore, the parcel ID managed by the server device 2 may be managed by linking approval information of the measurement result in addition to information such as the sender and destination, and the approval information may be sent to the terminal of the delivery company in response to an inquiry from the terminal. Note that the approval information may not be sent to the shipping support device 1, since it is only necessary to present it to the delivery company.

[0062] Also, in order to facilitate the inquiry of approval information from the terminal of the delivery company, a two-dimensional code storing a parcel ID may be attached to the parcel, for example, the two-dimensional code may be drawn on the waybill of the parcel or the two-dimensional code may be printed on the packaging material of the parcel. In this case, the terminal of the delivery company may inquire the server device 2 about the approval information regarding the target parcel based on the parcel ID acquired by reading the two-dimensional code. Note that the terminal of the delivery company may enable the worker to check whether or not the measurement result has been approved by displaying on the screen or outputting audio, etc.

[0063] Here, a fraudulent act may be considered in which the parcel at the time of measurement is swapped with the parcel at the time of posting, that is, a waybill printed after measuring the size of a smaller parcel is attached to another larger parcel and posted. In order to deal with such fraud, a check function may be provided that takes a picture of the parcel with the waybill attached before posting, measures the size of the parcel again, obtains the size category indicated on the waybill through image recognition of the image taken by the camera, and confirms that there is no difference between the size category indicated on the waybill and the actual size category of the parcel.

[0064] As shown in Fig. 2, the main body 11 is provided with a mail slot 51 for mailing parcels and a storage section 52 for storing mailed parcels. A delivery company can collect parcels by removing the parcels stored in the storage section 52. In this embodiment, only parcels of a predetermined size category properly measured by the shipping support device 1 can be mailed, so the delivery company does not need to recheck the size category of the parcel after collection, and can omit the size measurement work that was previously necessary after collection.

[0065] The front side of the storage section 52 is covered with a door 53, and this door 53 is provided with a handle 54 and a lock 55. The lock 55 can be unlocked by a worker in charge of collection of the delivery company, and no one other than the worker can take out the packages from the storage section 52.

[0066] In this embodiment, the mounting base 21 (mounting section), upper photographing section 31 (detection section), side photographing section 35 (detection section), front display 41 (display section), handheld display 42 (display section, operation section), and storage section 52 are integrally provided in the same housing of the main body 11 of the shipping support device 1. This allows the shipping support device 1 to be space-saving, making it easy to install in stores such as convenience stores.

[0067] Furthermore, the drop slot 51 is formed in a shape and size suited to the size of parcels that can be dropped in. That is, the drop slot 51 is provided with an opening of a predetermined area (width, height) adjusted so that only parcels that fall into a predetermined size category, which are small parcels, can be dropped in.

[0068] In this embodiment, in order to measure the height of the luggage with high accuracy, a color camera 36 is provided in the side photographing unit 35, and the height of the luggage is measured based on the shading state of the reference marker 39 on the opposing surface, but a sensor other than a camera, for example, a sensor (e.g., a photoelectric sensor) that measures the height of an object based on the shading state of light between a light emitting unit and a light receiving unit, may be provided and measurement may be performed based on the detection result. Furthermore, a sensor other than a camera (e.g., a measuring device that uses a multi-laser to output three-dimensional information) may also be provided in the upper photographing unit 31, and measurement may be performed based on the detection result.

[0069] In this embodiment, the mounting base 21, the upper photographing section 31, the side photographing section 35, the front display 41, the handheld display 42, and the storage section 52 are integrally provided in the main body 11, but the mounting base 21, the upper photographing section 31, and the side photographing section 35, which are related to photographing the object, may be configured separately from the storage section 52, and the front display 41 and the handheld display 42, which are related to guidance to the user and the user's operation, may be configured separately from the storage section 52. In particular, as long as the mounting base 21 is disposed between the front display 41 and the handheld display 42, it does not matter whether they are integral or separate. By disposing them in this way, the space of the device can be saved and the operability of the device for the user can be improved.

[0070] Next, a description will be given of a schematic configuration of the shipping support device 1. Fig. 7 is a block diagram showing a schematic configuration of the shipping support device 1.

[0071] As described above, the shipping support device 1 is equipped with a color camera 32 and a depth camera 33 that constitute the upward shooting section 31, two color cameras 36 that constitute the lateral shooting section 35, a front display 41, a handheld display 42, a reader 43, and a printer 44.

[0072] The shipping support device 1 also includes a communication unit 61, a memory 62, and a processor 63.

[0073] The communication unit 61 communicates with the server device 2 via the network.

[0074] The memory 62 stores programs executed by the processor 63 and the like.

[0075] The processor 63 executes various processes related to the shipping support by executing the programs stored in the memory 62. In this embodiment, the processor 63 performs target object detection process, placement position determination process, size measurement process, size classification determination process, packaging material selection process, advance declaration content inquiry process, posting permission determination process, waybill printing process, packaging material recognition process, payment instruction process, screen control process, etc. Here, the configuration of the communication unit 61, memory 62, and processor 63 is realized by adopting a general-purpose PC or tablet (information processing device).

[0076] In the object detection process, the processor 63 detects objects (unpackaged luggage, packed luggage, packaging materials to be purchased) placed on the platform 21 based on color images acquired from the color camera 32 of the upper photographing unit 31.

[0077] In the placement position determination process, the processor 63 determines whether or not the object is placed at the reference position based on the color image acquired from the color camera 32 of the upper photographing unit 31. In this embodiment, the left rear corner of the placement surface 22 is set as the reference point, and the state in which the left rear corner of the luggage is aligned with the reference point is set as the reference position of the luggage (see FIG. 4).

[0078] In the size measurement process, the processor 63 measures the size (length, width, and height) of the target luggage (packaged luggage, unpackaged luggage) placed on the platform 21 by the user based on the color image captured by the color camera 32 of the upper photographing unit 31, the depth image captured by the depth camera 33 of the upper photographing unit 31, and the color image captured by the color camera 36 of the side photographing unit 35. Note that the size measurement based on the color image captured by the color camera 36 of the side photographing unit 35 can be omitted depending on the accuracy of the size measurement based on the depth image captured by the depth camera 33 of the upper photographing unit 31.

[0079] In the size category determination process, processor 63 determines the size category to which the target luggage placed on platform 21 by the user falls based on the measurement results of the size measurement process. Furthermore, in the size category determination process, processor 63 determines whether or not the size category of the target luggage is likely to be changed from the size category of the determined result based on the measurement results of the size measurement process. This determination is made by comparing the dimensions (length, width, and height) of the luggage as the measurement result with the standard values ​​of the determined size category and the standard values ​​of less expensive size categories. At this time, it is determined whether or not the dimensions of the target luggage slightly exceed the standard values ​​of the determined size category and the size category of the luggage is likely to be changed by the user changing the way the luggage is placed, for example, by rearranging the luggage or moving the luggage toward the reference point.

[0080] In the packaging material selection process, when the processor 63 is dealing with an unpackaged package, it selects, based on the measurement results of the size measurement process, the most recommended packaging material for packaging the unpackaged package, i.e., the packaging material that corresponds to the size category of the package.

[0081] In the advance declaration content inquiry process, the processor 63 inquires of the server device 2 regarding the target parcel and acquires shipping declaration information from the server device 2. This shipping declaration information is information that the user inputs (declares) in advance using the smartphone 3 or the like, and includes the item name, sender and destination information, handling specification information, and the like regarding the target parcel. The handling specification information is information regarding handling specifications that are not suitable for posting, and is added to the shipping declaration information when handling specifications such as fragile items, precision equipment, and refrigeration are set. The shipping declaration information can be acquired from the server device 2 by accessing the server device 2 based on the user's registration information acquired by reading the two-dimensional shipping code displayed on the screen of the smartphone 3 with the reader 43.

[0082] In the post-posting permission determination process, the processor 63 determines whether the target parcel can be posted by this device based on the determination result of the size category determination process and the inquiry result of the pre-declaration content inquiry process. Specifically, in the case of an unpacked parcel, if the measured size category of the parcel matches the size category that allows posting, it is determined that it can be posted. In the case of a packed parcel, if the measured size category of the parcel matches the size category that allows posting and no handling specifications that are not suitable for posting are set, that is, if the shipping declaration information does not include handling specification information, it is determined that it can be posted. Here, if it is determined that it can be posted, the shipping procedure by posting continues, and if it is determined that it cannot be posted, the shipping procedure by posting is interrupted.

[0083] In the waybill printing process, the processor 63 instructs the printer 44 to print a waybill to be affixed to the package based on the shipping declaration information (item name, sender, destination, etc.) acquired from the server device 2. In addition to the sender and destination information, this waybill contains approval information that approves that the size measurement of the package was properly performed in the shipping support device 1.

[0084] In the packaging material recognition process, the processor 63 recognizes the type of packaging material placed on the placement table 21 by image recognition of the color image acquired from the color camera 32 of the upper photographing unit 31.

[0085] In the payment instruction process, the processor 63 accesses the server device 2 based on the user's payment information obtained by reading the two-dimensional payment code displayed on the screen of the smartphone 3 with the reader 43, and instructs the server device 2 to perform the payment process regarding the payment of the packaging materials purchased by the user.

[0086] In the screen control process, the processor 63 displays guidance screens on the front display 41 and the handheld display 42 in response to the user's operation of the handheld display 42 to assist the user in the shipping procedure. In this embodiment, for example, a screen is displayed that presents the measurement results of the size measurement process to the user (measurement result presentation process). Specifically, the measurement results include the size of the package (length, width, and height) and the cost required for shipping (delivery fee and packaging material price). Furthermore, in this embodiment, when the target package is an unpackaged package, a screen is displayed that presents the user with packaging materials suitable for the package (packaging material presentation process).

[0087] Next, a description will be given of the processing carried out on packed packages by the shipping support device 1. Fig. 8 is an explanatory diagram showing an overview of the processing carried out on packed packages.

[0088] Only parcels that fall into a specified size category can be placed in the shipping support device 1. In this embodiment, only parcels that fall into the first and second size categories can be placed in the shipping support device 1.

[0089] 8(A), in the first section, only parcels packed in standard packaging materials of a predetermined size can be dropped into the delivery support device 1. The standard packaging materials in the first section are, for example, cardboard boxes.

[0090] In the second category, as shown in Fig. 8(B), parcels packed in standard packaging materials of a predetermined size and parcels packed in suitable packaging materials that fit the size of the second category can be dropped into the shipping support device 1. The standard packaging materials in the second category are, for example, cardboard boxes. The suitable packaging materials in the second category are packaging materials other than the standard packaging materials, for example, envelopes with cushioning.

[0091] In processing (size measurement processing and size classification determination processing) for packaged luggage, color images taken by color camera 32 of the upper photographing unit 31, depth images taken by depth camera 33 of the upper photographing unit 31, and color images taken by color camera 36 of the side photographing unit 35 are used to distinguish between luggage packaged in standard packaging material of the first category shown in Figure 8(A), luggage packaged in standard packaging material of the second category shown in Figure 8(B), luggage packaged in compatible packaging material of the second category shown in Figure 8(C), and luggage packaged in other packaging materials.

[0092] In particular, in the process of identifying standard packaging materials of the first category shown in Fig. 8(A) and the process of identifying standard packaging materials of the second category shown in Fig. 8(B), a color image captured by the color camera 32 of the upper photographing unit 31 and a depth image captured by the depth camera 33 of the upper photographing unit 31 are used. Specifically, three-dimensional size information (vertical dimension, horizontal dimension, and height) of the target is obtained based on the depth image (three-dimensional position information of the subject) of the upper photographing unit 31, and whether or not it is a standard packaging material is determined based on the three-dimensional size information. Furthermore, by image recognition of the color image of the upper photographing unit 31, an image (service mark or unique pattern) printed on the surface of the standard packaging material is detected, and whether or not it is a standard packaging material is determined.

[0093] On the other hand, in the process of identifying suitable packaging materials of the second category shown in FIG. 8(C), a color image captured by the color camera 32 of the upper photographing unit 31 and a color image captured by the color camera 36 of the side photographing unit 35 are used. Specifically, two-dimensional size information (vertical and horizontal dimensions) of the object is obtained based on the color image captured by the upper photographing unit 31, and whether or not the packaging material is suitable is determined based on the two-dimensional size information. Furthermore, height information of the object is obtained based on the occlusion state of the reference marker 39 in the color image captured by the side photographing unit 35, and whether or not the packaging material is suitable is determined based on the height information. Note that, in the process of identifying suitable packaging materials of the second category shown in FIG. 8(C), the color image captured by the color camera 32 of the upper photographing unit 31 and the depth image captured by the depth camera 33 of the upper photographing unit 31 may be used for identification without changing the processing method.

[0094] Here, in the determination of standard packaging materials of the first category, it is determined whether the measured length, width, and height match the size (length, width, and height) of the standard packaging material. In addition, in the determination of standard packaging materials of the second category, it is determined whether the measured length, width, and height match the size (length, width, and height) of the standard packaging material, similarly to the determination of standard packaging materials of the first category.

[0095] In addition, when determining whether a packaging material is suitable for the second category, the size (length, width, and height) of a standard packaging material in the second category is the maximum size, and an upper limit is set for each of the length, width, and height. A minimum size is also set in plan view. In other words, a lower limit is set for each of the length and width. Therefore, if the width is less than the upper limit and greater than the lower limit, the length is less than the upper limit and greater than the lower limit, and the height is less than the upper limit, the material is determined to be suitable for the second category.

[0096] Thus, in this embodiment, in processing of parcels packed with standard packaging materials among the already-packed parcels, the size category of the parcel is determined by combining the three-dimensional size information (provisional size information) contained in the depth image captured by the depth camera 33 of the upper photographing unit 31 with the image recognition result of the color image captured by the color camera 32 of the upper photographing unit 31. As a result, even if an error occurs in the height information contained in the depth image, the standard packaging material can be identified by image recognition, and by combining the two, the size category of the parcel can be determined efficiently with sufficient accuracy.

[0097] On the other hand, in processing for packages packed with packaging materials other than standard packaging materials, the size category of the package is determined by combining two-dimensional size information acquired from color images captured by the color camera 32 of the upper photographing unit 31 with height information (corrected size information) based on the occlusion status of the reference marker 39 in the color image captured by the color camera 36 of the side photographing unit 35. As a result, in the case of packaging materials other than standard packaging materials, the packaging material cannot be identified by image recognition, and the size category of the package cannot be determined with sufficient accuracy when determining only the image from the upper photographing unit 31 because there is a possibility that an error occurs in the height information. However, highly accurate height information can be obtained by detecting the reference marker 39 using the color image from the side photographing unit 35, so by combining the two, the size category of the package can be determined efficiently with sufficient accuracy.

[0098] In this embodiment, only parcels that fall into the first and second size categories can be dropped into the shipping support device 1, but parcels that fall into three or more size categories may be dropped into the shipping support device 1. In this case, the dropping slot 51 may be made large, or dropping slots 51 may be provided that correspond to the size categories of the parcels so that the corresponding parcels can be dropped into the shipping support device 1.

[0099] In addition, in this embodiment, two types of packaging materials, namely, standard packaging materials in the first category (standard packaging materials of type A) and standard packaging materials in the second category (standard packaging materials of type B), are stored on rack 12 and sold to users. However, since packaging materials other than standard packaging materials are also permitted in the second category, other packaging materials that fit the second category, such as packaging materials such as cushioned envelopes, may also be stored on rack 12 and sold to users.

[0100] Next, a description will be given of the processing for unpackaged packages that is performed by the shipping support device 1. Fig. 9 is an explanatory diagram showing an overview of the processing for unpackaged packages.

[0101] The shipping support device 1 determines whether an unpackaged package falls into a size category (first category and second category) that can be dropped off in the device (size category determination process). At this time, based on a depth image (three-dimensional position information) acquired by the depth camera 33 of the upper imaging unit 31 photographing the unpackaged package placed on the mounting table 21, the lengths (X-direction dimension, Y-direction dimension, and Z-direction dimension) of three sides of a circumscribed rectangular parallelepiped that surrounds the foreground area on the depth image corresponding to the target object (unpackaged package) are acquired, and based on the lengths of the three sides of the circumscribed rectangular parallelepiped, it is determined whether the target object falls into a size category (first category and second category) that can be dropped off in the device.

[0102] Specifically, the foreground region (object) is extracted from the color image acquired by the color camera 32 of the upper photographing unit 31, and two-dimensional position information of the foreground region (object) is acquired. Next, a circumscribed rectangular parallelepiped surrounding the foreground region (object) is set based on the depth image (three-dimensional position information) acquired by the depth camera 33 of the upper photographing unit 31 and the two-dimensional position information of the foreground region (object). Next, the dimensions in the X direction, Y direction, and Z direction of the circumscribed rectangular parallelepiped are calculated. Then, based on the dimensions in the X direction, Y direction, and Z direction of the circumscribed rectangular parallelepiped, it is determined whether or not the object falls into a size category (first category and second category) that can be posted in this device.

[0103] The height of the foreground region (object) from the placement surface 22 is the dimension of the circumscribed rectangular parallelepiped in the Z direction. Therefore, the dimension of the circumscribed rectangular parallelepiped in the Z direction can be obtained by calculating the background difference regarding the Z coordinate of the foreground region, that is, the difference between the current depth image and a depth image (background image) captured by the depth camera 33 of the placement table 21 in a state where no object is placed thereon. In addition, since the height from the placement surface 22 is not constant, the maximum value of the height from the placement surface 22 is the dimension of the circumscribed rectangular parallelepiped in the Z direction.

[0104] In this embodiment, the height of the object is measured based on the background difference of the depth image, but when the height of the object is lower than the detection limit (e.g., 1 cm), such as in the case of a CD or DVD package, the background difference of the depth image cannot be properly acquired, and the height of the object cannot be properly measured. In this case, there is no particular problem in generating size information using the two-dimensional size information acquired from the color image and using the height detection limit (e.g., 1 cm) as the height of the object.

[0105] In addition, the shipping support device 1 performs a packaging material recognition process for packaging materials purchased by the user. In this embodiment, the packaging materials (standard packaging materials of the first category and standard packaging materials of the second category) stored in the rack 12 can be purchased. At this time, the user selects a packaging material from the rack 12 and places it on the placement table 21. The shipping support device 1 determines whether the packaging material placed on the placement table 21 is either the standard packaging material of the first category or the standard packaging material of the second category by image recognition process for the color image acquired by the color camera 32 of the upper photographing unit 31. A unique image (for example, a service mark or a unique pattern) is printed on the surface of the standard packaging material of the first category and the standard packaging material of the second category. In the packaging material recognition process, the packaging material placed on the placement table 21 is detected from the color image acquired by the color camera 32 of the upper photographing unit 31, and the type of the packaging material is recognized based on the shape and size of the packaging material and the image printed on the surface.

[0106] The packaging materials are stored in the rack 12 in an unassembled state (unfolded or folded state), and the packaging materials can be identified based on the shape, size, and image printed on the surface of the packaging materials in the unassembled state.

[0107] In this embodiment, a placement position determination process is performed when an object (packaged luggage, unpackaged luggage, packaging materials to be purchased) is placed on placement platform 21. In this embodiment, as shown in Fig. 4, the left rear corner of placement surface 22 is set as a reference point, and the state in which the left rear corner of the luggage is aligned with the reference point is set as the reference position of the luggage. The user places the object (packaged luggage, unpackaged luggage, packaging materials to be purchased) at the reference position.

[0108] In the delivery support device 1, the position of the object is detected by image recognition of the color image captured by the color camera 32 of the upper photographing unit 31, and it is determined whether the object is placed at the reference position. If the object is displaced from the reference position, the user is guided by the screen of the front display 41 and by voice to reposition the object at the reference position.

[0109] Next, there will be described the procedure of processing for packed packages, which is performed by the shipping support device 1. Fig. 10 and Fig. 11 are flow diagrams showing the procedure of processing for packed packages.

[0110] 10, in the shipping support device 1, the processor 63 first acquires a color image from the color camera 32 of the upper photographing unit 31 (ST101). Next, the processor 63 detects an object placed on the placement platform 21 by image recognition of the color image (object detection process) (ST102). Then, the processor 63 determines whether the object is placed at a reference position (placement position determination process) (ST103).

[0111] Here, if the object is placed at the reference position (Yes in ST103), the processor 63 then acquires a depth image (three-dimensional position information of the subject) from the depth camera 33 of the upper shooting unit 31 (ST104). The processor 63 then detects the object from the depth image (ST105). The processor 63 then acquires size information (length, width, height) of the object based on the depth image (size measurement process) (ST106). The processor 63 then determines whether the size of the object matches the size of the standard packaging material of the first category (ST107).

[0112] If the size of the object matches the size of the standard packaging material of the first category (Yes in ST107), the processor 63 then performs image recognition on the color image (ST108). Then, based on the image recognition result, it is determined whether the object is a standard packaging material of the first category (size category determination process) (ST109).

[0113] If the object is determined to be a package made of standard packaging material of the first category (Yes in ST109), the object is determined to be a package packed in standard packaging material of the first category (ST110).

[0114] On the other hand, if the size of the object does not match the size of the standard packaging material in the first category (No in ST107), processor 63 then determines whether the size of the object matches the size of the standard packaging material in the second category (ST111).

[0115] If the size of the object matches the size of the standard packaging material of the second category (Yes in ST111), the processor 63 then performs image recognition on the color image (ST112). Then, based on the image recognition result, it is determined whether the object is a standard packaging material of the second category (size category determination process) (ST113).

[0116] If the object is determined to be a package made of standard packaging material of the second category (Yes in ST113), the object is determined to be a package packed in standard packaging material of the second category (ST114).

[0117] On the other hand, if it is determined that the object is not a standard packaging material of the first category (No in ST109), if the size of the object does not match the size of a standard box of the second category (No in ST111), or if it is determined that the object is not a standard box of the second category (No in ST113), the process proceeds to determine whether the object is a conforming product other than a standard box of the second category (conformity determination for the second category).

[0118] 11, in determining whether a product conforms to the second category, first, processor 63 extracts a foreground region from a color image captured by color camera 32 of upper photographing unit 31 (ST115). At this time, processor 63 extracts the foreground region by determining a background difference of the color image, that is, a difference between a current color image and a color image (background image) captured by color camera 32 of mounting table 21 in a state where no object is placed thereon in advance. Next, processor 63 sets a circumscribing frame surrounding the foreground region, and calculates the dimensions of the circumscribing frame in the X direction and the Y direction (size measurement process) (ST116).

[0119] Next, processor 63 determines whether the X-direction dimension of the circumscribing box is equal to or smaller than the upper limit value for the width of the second section, and the Y-direction dimension is equal to or smaller than the upper limit value for the depth of the second section (ST117).

[0120] Here, if the X-direction dimension of the circumscribing frame is equal to or less than the upper limit value of the second section, and the Y-direction dimension is equal to or less than the upper limit value of the second section (Yes in ST117), processor 63 then determines whether the X-direction dimension of the circumscribing frame is equal to or greater than the lower limit value for the width of the second section, and the Y-direction dimension is equal to or greater than the lower limit value for the depth of the second section (ST118).

[0121] Here, if the X-direction dimension of the circumscribing frame is equal to or greater than the lower limit of the second division and the Y-direction dimension is equal to or greater than the lower limit of the second division (Yes in ST118), the processor 63 then acquires a color image from the color camera 36 of the side photographing unit 35 (ST119). Next, the processor 63 detects the reference marker 39 from the color image (ST120). Then, the processor 63 determines whether the height of the object is equal to or less than the upper limit of the height of the second division based on the occlusion state of the reference marker 39 in the color image (size division determination process) (ST121). Note that in the size measurement process (ST116), the size information (vertical dimension, horizontal dimension, height) of the object may be acquired based on the depth image to determine the height of the object. In this case, the configuration of the color camera 36 of the side photographing unit 35 can be omitted.

[0122] Here, if the height of the object is equal to or less than the upper limit value of the second category (Yes in ST121), the processor 63 then determines that the object is a second category package (package packed in packaging material other than standard packaging material) (ST122).

[0123] On the other hand, if the X-direction dimension of the circumscribing frame exceeds the upper limit value of the second category or the Y-direction dimension exceeds the upper limit value of the second category (No in ST117), or if the X-direction dimension of the circumscribing frame is less than the lower limit value of the second category or the Y-direction dimension is less than the lower limit value of the second category (No in ST118), or if the height of the object exceeds the upper limit value of the second category (No in ST121), the object is determined to be a package that cannot be posted (ST123).

[0124] Next, there will be described the procedure of processing for unpackaged packages, which is performed by the shipping support device 1. Fig. 12 is a flow diagram showing the procedure of processing for unpackaged packages.

[0125] In the shipping support device 1, first, the processor 63 acquires a color image and a depth image (three-dimensional position information) from the color camera 32 and the depth camera 33 of the upper shooting unit 31 (ST201). At this time, if it is detected that an object has been placed on the mounting table 21 based on the background difference of the Z coordinate (height information) of the depth image, the process may proceed to the subsequent process. If the height of the object is lower than the detection limit and the object is not detected, the size information may be generated by extracting the foreground region from the color image and using the height detection limit as the height of the object.

[0126] Next, the processor 63 extracts a foreground region (object) from the color image (ST202). Next, the processor 63 sets a circumscribed rectangular parallelepiped that surrounds the foreground region (object) based on the depth image (three-dimensional position information), and calculates the dimensions in the X direction, the Y direction, and the Z direction of the circumscribed rectangular parallelepiped (size measurement process) (ST203).

[0127] Next, processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the Z direction is equal to or smaller than the upper limit of the first division (ST204).

[0128] Here, if the Z-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value of the first section (Yes in ST204), processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value for the width of the first section, and whether the Y-direction dimension is less than or equal to the upper limit value for the depth of the first section (ST205).

[0129] Here, if the X-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value of the first division, and the Y-direction dimension is less than or equal to the upper limit value of the first division (Yes in ST205), processor 63 determines that the object is a first division item (ST206).

[0130] On the other hand, if the X-direction dimension of the circumscribed rectangular solid exceeds the upper limit value of the first division, or the Y-direction dimension exceeds the upper limit value of the first division (No in ST205), processor 63 then determines whether the maximum value of the height from mounting surface 22 is less than or equal to the upper limit value for the height of the second division (ST207).

[0131] Here, if the Z-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value of the second section (Yes in ST207), processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value for the width of the second section and whether the Y-direction dimension is less than or equal to the upper limit value for the depth of the second section (ST208).

[0132] Here, if the X-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit value of the second section, and the Y-direction dimension is equal to or less than the upper limit value of the second section (Yes in ST208), processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is equal to or greater than the lower limit value for the width of the second section, and the Y-direction dimension is equal to or greater than the lower limit value for the depth of the second section (ST209).

[0133] Here, if the X-direction dimension of the circumscribed rectangular solid is greater than or equal to the lower limit of the second division, and the Y-direction dimension is greater than or equal to the lower limit of the second division (Yes in ST209), processor 63 determines that the object is a piece of luggage in the second division (ST210).

[0134] On the other hand, if the maximum value of the height from placing surface 22 exceeds the upper limit value of the first category (No in ST204), if the maximum value of the height from placing surface 22 exceeds the upper limit value of the second category (No in ST207), if the X-direction dimension of the circumscribed rectangular solid exceeds the upper limit value of the second category or the Y-direction dimension exceeds the upper limit value of the second category (No in ST208), or if the X-direction dimension of the circumscribed rectangular solid is less than the lower limit value of the second category or the Y-direction dimension is less than the lower limit value of the second category (No in ST209), processor 63 determines that the object is a package that cannot be dropped (ST211).

[0135] Next, a description will be given of screens displayed during standby in the shipping support device 1. Fig. 13 is an explanatory diagram showing screens displayed during standby in the shipping support device 1.

[0136] In the shipping support device 1, when in standby mode, the screen shown in FIG. 13(A) (standby screen) is displayed on the front display 41, and the screen shown in FIG. 13(B) (standby screen) is displayed on the handheld display .

[0137] 13(A) shows characters guiding the user to the menu of the shipping support service, that is, characters 101 guiding the automatic measurement mode (first mode) titled "Automatic Size Check", characters 102 guiding the self-posting mode (second mode) titled "Self-Posting Post", and characters 103 guiding the packing material purchase mode (third mode) titled "Purchase Packing Material". Also shown on this screen are characters 104 guiding the user to select one of three operation modes, the automatic measurement mode, the self-posting mode, and the packing material purchase mode, by operating the handheld display 42.

[0138] 13B, the screen of the handheld display 42 displays an automatic measurement mode selection section 105 with the title "Automatic Size Check", a self-posting mode selection section 106 with the title "Self-Posting Post", and a packing material purchase mode selection section 107 with the title "Purchase Packing Material". The user can select one of the three operation modes by operating one of the selection sections 105, 106, 107.

[0139] Here, the automatic measurement mode, entitled "Automatic Size Check," is a mode in which, when a user brings in unpackaged luggage, suitable packaging materials are presented to the user, allowing the user to purchase the packaging materials using a self-checkout system.

[0140] The process of the automatic measurement mode is composed of a packing material selection step and a packing material purchase step. In the packing material selection step, the processor 63 of the shipping support device 1 determines the size category of the unpacked package placed on the placement table 21 by the user, and determines whether or not the package can be posted by this device (posting feasibility determination process), and if the package can be posted by this device, selects a packing material that corresponds to the size category of the package and presents it to the user (packing material presentation process). In the packing material purchase step, the processor 63 recognizes the type of packing material that the user removed from the rack 12 and placed on the placement table 21 based on the image captured by the color camera 32 of the upper photographing unit 31 (packing material recognition process), and performs a process related to the payment (settlement) of the sales price of the packing material (settlement process).

[0141] The self-mailing mode, entitled "Self-Mail Post," allows a user to bring in a packaged item and have a waybill printed based on the shipping declaration information registered in advance for the shipment of the package, and then have the user affix the waybill to the package, allowing the package to be mailed through the mail slot 51 of the device.

[0142] In the self-posting mode, the processor 63 of the shipping support device 1 determines the size category of the packed parcel placed on the platform 21 by the user (size category determination process), queries the server device 2 for handling designation information (contained in the shipping declaration information) regarding handling designation not suitable for posting (e.g., fragile item, precision equipment, requires refrigeration) (pre-declaration content inquiry process), and determines that posting is permitted if the measured size category of the parcel matches a size category that permits posting and no handling designation has been set (posting permission determination process).If it is determined that posting is permitted, a waybill is printed based on the shipping declaration information registered by the user in advance (waybill printing process).

[0143] The packing material purchase mode entitled "Purchase Packing Material" allows the user to purchase packing materials using a self-checkout system. In this packing material purchase mode, the processor 63 of the shipping support device 1 recognizes the type of packing material that the user has taken out of the rack 12 and placed on the placement table 21 based on the color image captured by the color camera 32 of the upper photographing unit 31 (packing material recognition process), and performs a process related to the payment (settlement) of the purchase price of the packing material (settlement instruction process).

[0144] Next, a description will be given of screens displayed in the automatic measurement mode in the shipping support device 1. Figures 14, 15, 16, and 17 are explanatory diagrams showing screens displayed in the automatic measurement mode in the shipping support device 1.

[0145] In the shipping support device 1, when a user operates the automatic measurement mode selection section 105, which displays the title "Automatic size check" on the screen of the handheld display 42 shown in Figure 13 (B), first the front display 41 transitions to the screen shown in Figure 14 (A-1), and then the handheld display 42 transitions to the screen shown in Figure 14 (B-1).

[0146] 14(A-1) displays text 111 urging the user to place the luggage to be measured on platform 21, and an image 112 showing how to place the luggage on platform 21. Since the luggage needs to be placed at a reference position near the left rear side of platform 21, image 112 displays a moving image of the luggage moving from the center of platform 21 toward the left rear side.

[0147] 14(B-1) is provided with text 115 prompting the user to place the package to be measured on the platform 21, and a button 116 for instructing the user to measure the size. When the user operates the button 116 for instructing the user to measure the size, the size measurement starts, and then a decision is made as to whether or not the package can be posted. When the size measurement starts, the screen may transition to one that notifies the user that the size measurement is in progress.

[0148] Here, when the processor 63 of the shipping support device 1 detects the package placed on the loading platform 21, measures the size of the package, and determines that the package can be posted and that there is no possibility of changing the size classification, the front display 41 transitions to the screen shown in Figure 14 (A-2), and the handheld display 42 transitions to the screen shown in Figure 14 (B-2).

[0149] On the screen of the front display 41 shown in Fig. 14(A-2), characters 121 indicating the values ​​of the three sides of the package, specifically the length, width and height of a circumscribing rectangle surrounding the package, and characters 122 indicating the cost of shipping the package, specifically the delivery charge and the price of packaging materials, are displayed as size information that is the result of the size measurement. Also displayed on this screen is character 123 indicating that the size measurement can be redone by repackaging the package. Although the dimensions of the package itself are displayed as size information, it is also possible to display the dimensions of the size category to which the package falls.

[0150] 14(B-2) of the handheld display 42 displays characters 125 indicating the size (length, width, and height) of the package, characters 126 indicating the delivery fee, and characters 127 informing the user of the most recommended packaging material for packaging the package. This screen also has a button 128 for instructing the user to remeasure the size, and a button 129 for proceeding to the step of purchasing packaging materials.

[0151] Here, when the user operates button 128 to instruct re-measurement of size, size measurement is performed again. For example, when the size category may change due to rearranging or changing the way the luggage, such as multiple items or clothing, is arranged, the user can instruct re-measurement of size. Also, when the user operates button 129 to proceed to the step of purchasing packaging materials, the front display 41 transitions to the screen shown in Fig. 15(A-2), and the handheld display 42 transitions to the screen shown in Fig. 15(B-2).

[0152] On the other hand, when the processor 63 determines that there is a possibility of changing the size category, the handheld display 42 transitions to a screen shown in Fig. 14(B-3). On the screen of the handheld display 42 shown in Fig. 14(B-3), characters 130 representing advice information on how to place unpacked packages are displayed instead of the characters 127 on the screen of Fig. 14(B-2).

[0153] The advice information is intended to encourage the user to remeasure the size of the package, since by arranging the package in a more creative way, for example, by moving the package toward the reference point, the size classification of the package may be changed, and the package may be shipped using less expensive packaging materials. In the example shown in FIG. 14(B-3), the advice information is displayed as "There is still room in the height." In addition to this, for example, the advice information may be displayed as "Please move the package toward the reference point."

[0154] By viewing such advice information, the user can easily confirm that the package can be shipped with a more appropriate (cheaper) delivery fee and packaging material. The user then manipulates how the package is placed, for example, by arranging the package or moving it toward a reference point, and then operates button 128 to instruct the size to be measured again. At this time, in some cases, the size category of the package is changed to a more appropriate (cheaper) size category, and more appropriate (cheaper) packaging material is presented to the user. This allows the user to quickly confirm the most appropriate packaging material for the unpackaged package they have brought in.

[0155] The advice information may be displayed on the screen of the front display 41 shown in Fig. 13(A-2). In addition to the screen display, the advice may be given by audio output.

[0156] In this manner, in this embodiment, the size of the package can be repeatedly remeasured. When the package is unpackaged, unlike when it is packed, the size measurement result (size category) may change if the user changes how the package is placed. For this reason, by allowing the user to repeatedly remeasure the size of the package until the user is satisfied, the costs required for shipping the package (delivery charges and packaging material prices) can be kept low.

[0157] A button 119 for instructing termination is displayed on the screen of the handheld display 42 (e.g., FIG. 14(B-1)). This button 119 allows the user to instruct termination at an appropriate timing. Operating this button 119 transitions to a screen (not shown) for confirming termination, and when an operation to confirm termination is performed on this screen, the automatic measurement mode is terminated and the system returns to the standby state.

[0158] In addition, since payment (settlement) for the purchase price of the packaging materials is made through a designated payment service using the smartphone 3, before transitioning to the screen shown in Figure 15 (A-2), a screen inquiring as to whether registration for the designated payment service has been completed or a screen urging the customer to ask a store staff member for information regarding the designated payment service may be displayed on the handheld display 42.

[0159] On the other hand, if the posting permission determination determines that the target package cannot be posted, the front display 41 transitions to the screen shown in FIG. 15(A-1), and the hand display 42 transitions to the screen shown in FIG. 15(B-1).

[0160] The screen of the front display 41 shown in FIG. 15(A-1) displays text 131 urging the customer to complete the shipping procedure at a counter in the store because the package cannot be posted using this device, and an image 132 directing the customer to the counter in the store.

[0161] 15(B-1) on the screen of the handheld display 42, characters 135 indicating the size (length, width, and height) of the package, characters 136 informing the user that the package cannot be posted using this device, and characters 137 urging the user to carry out the shipping procedure at a counter in the store are displayed. If the package cannot be posted using this device, the numbers indicating the length, width, and height of the package that exceed the size that can be posted may be highlighted.

[0162] The screen of the front display 41 shown in FIG. 15(A-2) displays an image 141 that provides information about packaging materials that can be purchased from the device, and text 142 that prompts the user to select a packaging material from the rack 12 installed next to the main body 11. In this embodiment, the device can purchase a first category of standard packaging materials (A-type standard boxes) and a second category of standard packaging materials (B-type standard boxes). In addition, in order to present the user with packaging materials that are suitable for the package, the screen highlights packaging materials that are suitable for the package. Packaging materials that are not suitable for the package may be displayed in gray.

[0163] 15(B-2) displays characters 145, 146 that prompt the user to select a packaging material suitable for the package. The packaging materials may be classified by type and stored on shelves of the rack 12, and an indicator (not shown) such as an LED lamp provided on the shelf may be turned on in conjunction with the presentation of a packaging material suitable for the user's package to prompt the user to take out the presented packaging material.

[0164] Here, when a predetermined time has elapsed since the screen of the front display 41 shown in FIG. 15(A-2) and the screen of the handheld display 42 shown in FIG. 15(B-2) have been transitioned to, the front display 41 transitions to the screen shown in FIG. 16(A-1), and the handheld display 42 transitions to the screen shown in FIG. 16(B-1).

[0165] 16(A-1) displays text 151 urging the user to place the selected packaging material on the stand 21, text 152 informing the user that if multiple packaging materials are purchased, they should be placed one by one on the stand 21, an image 153 informing the user how to place the packaging materials on the stand 21, and text 154 informing the user that a payment application on the smartphone 3 is required. Note that, since the packaging material needs to be placed at a reference position close to the rear left side of the stand 21, the image 153 displays a moving image of the packaging material moving from the center of the stand 21 toward the rear left side.

[0166] The screen of the handheld display 42 shown in FIG. 16(B-1) displays text 155 urging the user to place the selected packaging material on the placement table 21, and text 156 indicating the name and price of the packaging material suitable for the package.

[0167] Here, when the processor 63 of the shipping support device 1 detects the packaging material placed on the placement table 21 and recognizes the type of the packaging material, the handheld display 42 transitions to a screen shown in FIG. 16(B-2).

[0168] The screen of the handheld display 42 shown in Figure 16 (B-2) displays characters 157 prompting the user to confirm the selected packaging material and give an instruction to purchase it, characters 156 showing the name and price of the recognized packaging material, a button 158 for instructing the user to reselect the packaging material, and a button 159 for instructing the user to purchase the packaging material.

[0169] Here, when the user operates button 158 to instruct the user to redo the packaging material selection, the screen changes to that shown in Fig. 16 (B-3). On the other hand, when the user operates button 159 to instruct the user to purchase packaging materials, the front display 41 changes to the screen shown in Fig. 17 (A-1), and the handheld display 42 changes to the screen shown in Fig. 17 (B-1). Note that a user who does not wish to purchase packaging materials but who simply has the most suitable packaging materials presented based on the size measurement of the package, can simply instruct the user to end the screen on the handheld display 42 shown in Fig. 16 (B-2) using button 119.

[0170] The screen of the handheld display 42 shown in Fig. 16(B-3) displays text 161 prompting the user to select a packaging material, a packaging material selection area 162, and a cancel button 163. When the user operates the packaging material selection area 162, the front display 41 transitions to the screen shown in Fig. 17(A-1), and the handheld display 42 transitions to the screen shown in Fig. 17(B-1). When the user operates the cancel button 163, the automatic measurement mode ends and the device returns to the standby state.

[0171] The screen of the front display 41 shown in Figure 17 (A-1) displays text 171 prompting the user to display the code payment screen on the smartphone 3, an image 172 guiding the user through the procedure for displaying the code payment screen on the smartphone 3, an image 173 guiding the user to the location of the reader 43 of the shipping support device 1, and text 174 prompting the user to hold the two-dimensional payment code displayed on the code payment screen over the reader 43.

[0172] The screen of the handheld display 42 shown in Figure 17 (B-1) displays text 175 prompting the user to hold the two-dimensional payment code displayed on the code payment screen over the reader 43, and text 156 indicating the name and price of the packaging material to be purchased.

[0173] Here, when the processor 63 of the shipping support device 1 acquires read information from the reader 43 by having the reader 43 read the two-dimensional code for payment displayed on the smartphone 3, the processor 63 transmits a payment instruction to the server device 2. The server device 2 executes a payment process for the purchase price related to the user. When the payment process is normally completed, the front display 41 transitions to the screen shown in FIG. 17(A-2), and the handheld display 42 transitions to the screen shown in FIG. 17(B-2).

[0174] 17(A-2) on the screen of the front display 41, text 181 expressing gratitude for the purchase of packaging materials and an image 182 guiding the customer to the subsequent procedures are displayed. The image guiding the customer to the subsequent procedures may, for example, be a moving image that informs the customer that the packaging work can be done in the store, that the customer can send (post) the parcel in the self-posting mode of the device when the packaging work is completed, or a moving image that urges the customer to enter information about the parcel (such as size classification) in the shipping application on the smartphone 3.

[0175] On the screen of the handheld display 42 shown in FIG. 17(B-2), characters 183 expressing gratitude for the purchase of the packaging material and characters 156 indicating the name and price of the packaging material for which payment has been completed are displayed.

[0176] If an error occurs during processing in the automatic measurement mode, an error screen (not shown) is displayed on the front display 41 and the handheld display 42. This error screen displays text indicating that an error has occurred and processing cannot be performed normally, text urging the user to complete the shipping procedure at a counter in the store, an image showing the counter in the store (e.g., a store floor plan), text urging the user to call a store staff member, and the like.

[0177] Next, a description will be given of screens displayed in the self-posting mode on the shipping support device 1. Figures 18, 19, 20, and 21 are explanatory diagrams showing screens displayed on the shipping support device 1 in the self-posting mode.

[0178] In the shipping support device 1, when a user operates the self-mailing mode selection section 106 entitled "Self-mailing Post" on the screen of the handheld display 42 shown in FIG. 13(B), first the front display 41 transitions to the screen shown in FIG. 18(A-1), and then the handheld display 42 transitions to the screen shown in FIG. 18(B-1).

[0179] 18(A-1) displays text 201 urging the user to place the packed package on the platform 21 and launch a shipping app on the smartphone 3, and an image 202 showing how to place the package on the platform 21. Since the package needs to be placed at a reference position close to the rear left side of the platform 21, the image 202 displays a video of the package moving from the center of the platform 21 toward the rear left side.

[0180] The screen of the handheld display 42 shown in Figure 18 (B-1) displays text 205 prompting the user to place the packed package on the placement stand 21 and launch the shipping app on the smartphone 3, as well as a button 206 to instruct the user to proceed with the shipping procedure.

[0181] When the processor 63 detects that a packed package has been placed on the platform 21, the handheld display 42 may transition to a screen indicating that the size of the package is currently being measured.

[0182] Here, when the user operates the button 206 for instructing the shipping procedure, the front display 41 transitions to the screen shown in FIG. 18(A-2), and the hand display 42 transitions to the screen shown in FIG. 18(B-2).

[0183] 18(A-2) on the screen of the front display 41, text 211 is displayed that prompts the user to display the two-dimensional shipping code in the payment application of the smartphone 3 and hold it over the reader 43, and an image 212 that guides the user to the location of the reader 43 of the device. Note that in the image, the location of the reader 43 is guided by a frame image that surrounds the reader 43.

[0184] On the screen of the handheld display 42 shown in FIG. 18(B-2), text 213 is displayed urging the user to hold the two-dimensional shipping code over the reader 43, and an image 214 is displayed indicating that the reader 43 is reading the code.

[0185] At this time, when the processor 63 obtains the reading result of the two-dimensional shipping code from the reader 43, it accesses the server device 2 and queries the handling instruction information contained in the shipping declaration information related to the user, and checks whether any handling instructions have been set that are not suitable for posting (e.g., fragile item, precision equipment, requires refrigeration).

[0186] If a failure occurs in the network or the like and connection to the server device 2 cannot be established, the screen may be changed to one that notifies the user of this.

[0187] Here, if the measured size category of the package falls within the specified size category and no handling instructions have been set that make it unsuitable for posting, i.e., the shipping declaration information does not include handling instruction information, and the package is determined to be suitable for posting, the front display 41 will transition to the screen shown in Figure 19 (A-1), and the handheld display 42 will transition to the screen shown in Figure 19 (B-1).

[0188] 19(A-1) on the screen of the front display 41, text 221 is displayed notifying that the measurement of the size of the package and the decision on whether or not it can be dropped off have been completed and that the package can be dropped off, and an image 222 is displayed to alert users who have not been specified for handling fragile items to the risk of fragile items. Note that, as an alert for the risk of fragile items, a confirmation message may be displayed asking whether the package is packed with cushioning material that can withstand the impact of being dropped off, etc.

[0189] The screen of the handheld display 42 shown in Figure 19 (B-1) displays text 225 notifying the user that measurement of the package size and determination of whether the package can be posted have been completed and that the package can be posted, as well as a button 226 for instructing printing of a shipping label.

[0190] On the other hand, if the measured size category of the parcel does not fall within the designated size category, or if a handling specification that is not suitable for posting (e.g., fragile, precision equipment, refrigerated) is set, that is, if the parcel is determined to be unsuitable for posting because the handling specification information is included in the shipping declaration information, the front display 41 transitions to a screen shown in Fig. 19 (A-2). Also, if the measured size category of the parcel does not fall within the designated size category, and if the parcel is determined to be unsuitable for posting, the handheld display 42 transitions to a screen shown in Fig. 19 (B-2). On the other hand, if a handling specification that is not suitable for posting is set, that is, if the parcel is determined to be unsuitable for posting because the shipping declaration information includes handling specification information, the handheld display 42 transitions to a screen shown in Fig. 19 (B-3).

[0191] If a package is deemed unacceptable, the customer will hand it over to a staff member at the store counter, who will then hand it over to the delivery company. This allows packages to be safely handed over to the delivery company without damage, even if they have handling instructions set.

[0192] On the screen of the front display 41 shown in FIG. 19(A-2), text 231 urging the customer to complete the shipping procedure at a counter in the store and an image 232 directing the customer to the counter in the store are displayed.

[0193] The screen of the handheld display 42 shown in FIG. 19(B-2) displays text 235 informing the user that the package is too large to be dropped off, and text 236 urging the user to complete the shipping procedure at the counter in the store.

[0194] The screen of the handheld display 42 shown in Figure 19 (B-3) displays text 237 informing the user that handling instructions have been set that are not suitable for posting, and text 236 urging the user to complete the shipping procedure at the counter in the store.

[0195] In addition, when the user operates button 226, which instructs printing of a shipping label, on the screen of the handheld display 42 shown in FIG. 19 (B-1), the front display 41 transitions to the screen shown in FIG. 20 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 20 (B-1).

[0196] 20(A-1) shows a screen of the front display 41, which displays text 241 notifying that printing of the shipping label has started, and an image 242 indicating the location of the printer 44 of the device. Note that the image indicates the location of the printer 44 with a frame image surrounding the printer 44.

[0197] On the screen of the handheld display 42 shown in FIG. 20(B-1), characters 245 notifying that printing of the shipping label has started and an image 246 indicating that the shipping label is being printed are displayed.

[0198] Here, when printing of the shipping label is completed, the front display 41 transitions to the screen shown in FIG. 20(A-2), and the handheld display 42 transitions to the screen shown in FIG. 20(B-2).

[0199] The screen of the front display 41 shown in Figure 20 (A-2) displays text 251 notifying the user that printing of the waybill has been completed, text 252 prompting the user to affix the waybill to the packed package, and an image 253 showing the state of affixing the waybill to the packed package.

[0200] The screen of the local display 42 shown in Figure 20 (B-2) displays text 255 notifying the user that printing of the waybill has been completed, text 256 prompting the user to affix the waybill to the packed package, and an OK button 258 to approve the affixing of the waybill.

[0201] Here, if the user wants to affix the waybill to the package immediately, he / she operates the OK button 258. In this case, the front display 41 transitions to the screen shown in Fig. 21 (A-1), and the handheld display 42 transitions to the screen shown in Fig. 21 (B-1). On the other hand, if the user does not want to affix the waybill to the package immediately, he / she operates the button 119 to instruct the end.

[0202] 21(A-1) shows text 261 encouraging the user to post a package and an image 262 indicating the location of mail slot 51 of the device. Note that image 262 indicates the location of mail slot 51 with a frame image surrounding mail slot 51.

[0203] On the screen of the handheld display 42 shown in FIG. 21(B-1), text 265 urging the user to post the package and an OK button 268 for approving the posting of the package are displayed.

[0204] Here, if the user wishes to post the package on the spot, he / she operates the OK button 268. In this case, the front display 41 transitions to the screen shown in Fig. 21 (A-2), and the handheld display 42 transitions to the screen shown in Fig. 21 (B-2). On the other hand, if the user does not wish to post the package on the spot, he / she operates the button 119 to instruct the user to end the process.

[0205] The screen of the front display 41 shown in Figure 21 (A-2) displays text 271 indicating that the shipping procedure will be completed by dropping the package in the mailbox, text 272 prompting the user to input (shipping notification) that the shipping procedure has been completed in the shipping application of the smartphone 3, and an image 273 showing the status of the package being shipped.

[0206] 21(B-2) displays text 275 indicating that the shipping procedure has been completed, text 276 expressing gratitude for the use of the device, and text 277 prompting the user to input (shipping notification) that the shipping procedure has been completed in the shipping application of the smartphone 3. Here, in conjunction with the display on the screen of the handheld display 42 shown in FIG. 21(B-2), an instruction to rewrite the status information of the user's package from "waiting for shipping" to "shipping completed" may be automatically transmitted to the server device 2.

[0207] If an error occurs during processing in the automatic measurement mode, an error screen (not shown) is displayed on the front display 41 and the handheld display 42. This error screen displays text indicating that an error has occurred and processing cannot be performed normally, text urging the user to complete the shipping procedure at a counter in the store, an image guiding the user to the counter in the store (e.g., a store floor plan), text urging the user to call a store staff member if the user has run out of paper to print the shipping label, and so on.

[0208] Next, there will be described screens displayed in the packaging material purchasing mode in the shipping support device 1. Figures 22, 23, and 24 are explanatory diagrams showing screens displayed in the packaging material purchasing mode in the shipping support device 1.

[0209] In the shipping support device 1, when a user operates the selection section 107 for the packaging material purchasing mode entitled "Purchase packaging material" on the screen of the handheld display 42 shown in FIG. 13(B), first the front display 41 transitions to the screen shown in FIG. 22(A), and then the handheld display 42 transitions to the screen shown in FIG. 22(B).

[0210] When the user operates the selection unit 107 for the packing material purchase mode on the screen of the handheld display 42 shown in Fig. 13(B), the handheld display 42 may transition to a screen (not shown) that inquires the user as to whether or not the user has completed registration for the designated payment service, and transition to the screen shown in Fig. 22(A) or (B) only if the registration for the designated payment service has been completed. Also, if the registration for the designated payment service has not been completed, the handheld display 42 may transition to a screen (not shown) that guides the user to purchase packing materials at a counter in the store.

[0211] On the screen of the front display 41 shown in FIG. 22(A), an image 301 indicating the packaging materials stored in the rack 12 and text 302 indicating the rack 12 installed next to the main body 11 are displayed.

[0212] The screen of the handheld display 42 shown in FIG. 22(B) displays text 305 urging the user to select a packaging material stored in the rack 12, and text 306 indicating that packaging materials can only be purchased one at a time.

[0213] Here, after a predetermined time has elapsed since the transition to the screen shown in Figures 22(A) and (B), the front display 41 transitions to the screen shown in Figure 23(A-1), and the hand display 42 transitions to the screen shown in Figure 23(B-1).

[0214] The subsequent steps are the same as the packing material purchasing step in the automatic measurement mode. That is, the screens shown in Fig. 23(A-1), Fig. 24(A-1), and Fig. 24(A-2) are displayed in sequence on the front display 41, and these screens are the same as the screens shown in Fig. 16(A-1), Fig. 17(A-1), and Fig. 17(A-2) in the automatic measurement mode. Also, the screens shown in Fig. 23(B-1), Fig. 23(B-2), Fig. 23(B-3), Fig. 24(B-1), and Fig. 24(B-2) are displayed in sequence on the hand display 42, and these screens are the same as the screens shown in Fig. 16(B-1), Fig. 16(B-2), Fig. 16(B-3), Fig. 17(B-1), and Fig. 17(B-2) in the automatic measurement mode.

[0215] (First Modification of the First Embodiment) Next, a first modified example of the first embodiment will be described. Note that the points not mentioned here are the same as those of the above embodiment. Fig. 25 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1 according to the first modified example of the first embodiment.

[0216] In the first embodiment, even if the measured size category of the parcel allows it to be posted, if handling instructions have been set for the parcel that are not suitable for posting, i.e., if the handling instruction information is included in the shipping declaration information obtained from the server device 2, it is determined that the parcel cannot be posted, the screen shown in Figure 19 (B-3) is displayed on the handheld display 42, the shipping procedure by this device is interrupted, and the shipping procedure is carried out at the store counter.

[0217] On the other hand, in this modified example, if the handling specifications for the target package are not suitable for posting, guidance for continuing the procedure by posting is displayed on the handy display 42. At this time, the user is asked whether or not to continue the package shipping procedure by posting, and if the user agrees, the package shipping procedure by posting is continued and the process proceeds to the step of printing the waybill.

[0218] Specifically, when a handling specification that is not suitable for posting is set for the target package, that is, when the handling specification information is included in the shipping declaration information acquired from the server device 2, the front display 41 transitions to the screen shown in Fig. 25(A), and the hand display 42 transitions to the screen shown in Fig. 25(B). These screens are generated based on the handling specification information included in the advance declaration information.

[0219] The screen of the front display 41 shown in Fig. 25(A) displays character 281 informing that the handling specification set is not suitable for posting, character 282 showing the handling specification set by the user, and character 283 showing guidance for when posting is permitted exceptionally. The example shown in Fig. 25(A) informs the user that even if the user has set the handling specification as fragile, posting is possible if the package is sufficiently protected by cushioning material.

[0220] The screen of the handheld display 42 shown in Fig. 25(B) displays text 285 inquiring whether or not to continue the parcel shipping procedure by posting, and a button 286 for instructing the user to continue the parcel shipping procedure by posting. When the user operates the button 286 for instructing the user to continue, the screen transitions to, for example, a screen shown in Fig. 19(A-1) or Fig. 19(B-1), and the waybill is printed.

[0221] In addition, if the handling instructions set for the target package require refrigeration, the shipping procedure should be interrupted without inquiring of the user as to whether or not the shipping procedure should continue, i.e., without exception, and a message should be displayed indicating that the package cannot be shipped by posting.

[0222] (Second Modification of the First Embodiment) Next, a second modified example of the first embodiment will be described. Note that the points not mentioned here are the same as those of the above embodiment. Fig. 26 is a flow diagram showing the procedure of processing for unpackaged packages according to the second modified example of the first embodiment.

[0223] In the first embodiment, as shown in Fig. 11, in the case of a package packed with a packaging material other than a standard packaging material, the provisional size information based on the image captured by the upper photographing unit 31 is corrected with the corrected size information based on the image captured by the side photographing unit 35 to obtain the final size information. Also, as shown in Fig. 12, in the case of an unpackaged package, no correction is made with the corrected size information based on the image captured by the side photographing unit 35, and the provisional size information based on the image captured by the upper photographing unit 31 is used as the final size information as it is.

[0224] On the other hand, in this modified example, in the case of an unpacked package, like the case of a packed package shown in Fig. 11, the provisional size information based on the image captured by the upper imaging unit 31 is corrected with the corrected size information based on the image captured by the side imaging unit 35 to obtain final size information. Specifically, the size category of the package is determined based on height information based on the occlusion state of the reference marker 39 in the color image captured by the side imaging unit 35, instead of provisional height information based on the depth image captured by the upper imaging unit 31.

[0225] 26, after the processes of ST201 to ST203 similar to those of the first embodiment (see FIG. 12), the processor 63 acquires a color image from the color camera 36 of the lateral imaging unit 35 (ST221) and detects the reference marker 39 from the color image (ST222). Then, the processor 63 determines whether the height of the object is equal to or less than the upper limit value for the height of the first category based on the occlusion state of the reference marker 39 in the color image (size category determination process) (ST223).

[0226] Here, if the height of the object is equal to or less than the upper limit of the first category (Yes in ST223), the process proceeds to ST205. On the other hand, if the height of the object exceeds the upper limit of the first category (No in ST223), the processor 63 determines the object as a package that cannot be dropped (ST211). Also, in ST205, if the XY dimensions of the circumscribed rectangular parallelepiped of the object are equal to or less than the upper limit of the first category (Yes in ST205), the processor 63 determines the object as a package in the first category (ST206).

[0227] On the other hand, if the XY dimensions of the circumscribed rectangular solid of the object exceed the upper limit value of the first division (No in ST205), then processor 63 determines whether the height of the object is equal to or less than the upper limit value for height of the second division based on the occlusion status of reference marker 39 in the color image (size division determination process) (ST224).

[0228] Here, if the height of the object is equal to or less than the upper limit of the second division (Yes in ST224), the process proceeds to ST208. The processes from ST208 onwards are the same as those in the first embodiment. On the other hand, if the height of the object exceeds the upper limit of the second division (No in ST224), the process proceeds to ST211. The processes in ST211 are the same as those in the first embodiment.

[0229] In this modification, in order to accurately distinguish between two size classes having different upper limit values ​​for height, two reference markers 39 may be provided corresponding to the two size classes, respectively.

[0230] (Third modified example of the first embodiment) Next, a third modified example of the first embodiment will be described. Note that the points not mentioned here are the same as those of the above embodiment. Fig. 27 is an explanatory diagram showing the main part of the shipping support device 1 according to the third modified example of the first embodiment. Fig. 28 is a flow diagram showing the operation procedure of the processor 63 of the shipping support device 1.

[0231] 27, main body 11 of shipping support device 1 is provided with storage section 52 for storing packages, and storage section 52 is provided with drop slot 51 adapted to the size of packages that can be dropped. Storage section 52 is further provided with lid 81 for covering drop slot 51, and locking mechanism 82 for restricting the opening and closing of lid 81 to prevent dropping of packages. Locking mechanism 82 may be configured, for example, such that a locking member (not shown) for restricting the opening and closing of lid 81 is driven by a driving section (not shown) made of an actuator such as a solenoid.

[0232] Further, storage section 52 is provided with a sensor 83 that detects the dropping of a package, i.e., a package passing through drop slot 51. Detection of package dropping is a known technique (see, for example, JP-A-10-91678), and various configurations can be adopted. Sensor 83 may be configured as a passing sensor, or as an opening / closing sensor that detects the opening and closing of lid 81 covering drop slot 51. Also, a reader may be provided near drop slot 51 to read a two-dimensional code printed on the shipping label, thereby detecting the dropping of a package and identifying the dropped package at the same time.

[0233] The processor 63 controls the locked state of the locking mechanism 82 so as to prevent unweighed packages or objects other than packages (such as garbage) from being dropped through the drop slot 51. In this embodiment, the processor 63 temporarily releases the locked state of the locking mechanism based on a determination that dropping of a package is permitted. Also, in this embodiment, the processor 63 temporarily releases the locked state of the locking mechanism 82 when printing of the waybill by the printer 44 is completed. Also, in this embodiment, the processor 63 returns the locking mechanism 82 to the locked state when dropping of a package is detected based on the detection result of the sensor 83.

[0234] Processor 63 also counts the number of parcels that have been determined to be acceptable for posting and that have been posted in storage unit 52. In this embodiment, processor 63 counts the number of parcels that have been posted in storage unit 52 based on the detection results of sensor 83. That is, the number of parcels is counted up each time sensor 83 detects the posting of a parcel. Counting the number of parcels that are acceptable for posting is also a publicly known technique (see, for example, Japanese Patent Application Laid-Open No. 2001-76262), and various configurations can be adopted.

[0235] In this embodiment, the processor 63 performs a process of comparing the count value of the dropped parcels with a threshold value (upper limit value, or a value smaller than the upper limit value by a predetermined number) regarding the number of parcels that can be stored in the storage unit 52, and issuing an alert of a parcel collection request based on the comparison result. Specifically, when the count value of the parcels becomes equal to or greater than the threshold value, a process of issuing an alert of a parcel collection request is performed. In this case, for example, a notification of an alert of a parcel collection request from the shipping support device 1 may be sent to a terminal (not shown) carried by a worker in charge of collection via the server device 2 and a server device (not shown) of a delivery company. Note that it is preferable to set a threshold value that allows about 2 to 5 parcels to be dropped so that the shipping support device 1 can be used continuously until the parcels are collected after the notification of the alert of the parcel collection request.

[0236] In this embodiment, the processor 63 resets the parcel count value when collection of the parcels from the storage unit 52 is completed. In this case, for example, when a delivery company worker unlocks the lock 55 (see FIG. 2) of the storage unit 52 and finishes collection of the parcels, the worker performs a collection completion operation, and the processor 63 resets the parcel count value in response to the operation. Also, the completion of collection of the parcels may be detected based on the opening and closing of the door 53 of the storage unit 52 and the unlocking and locking of the lock 55, and the count value of the parcels may be reset. Note that resetting the count value after collection of the parcels is also a publicly known technique (see, for example, Japanese Patent Publication No. 6-30738), and various configurations may be adopted.

[0237] In this embodiment, if the number of deposited packages reaches the upper limit of the number of packages that can be stored in the storage unit 52 when the packages are collected, the threshold value for determining whether or not an alarm needs to be issued is updated. In this threshold value update, the threshold value is reset to a value that is a specified number smaller than the current setting value.

[0238] Specifically, as shown in Fig. 28, first, when sensor 83 detects dropping of a parcel (Yes in ST301), processor 63 increments the number of dropped parcels (count of dropped parcels) by 1 (ST302). Next, processor 63 determines whether the number of dropped parcels has reached a predetermined threshold (determination of whether an alert is required) (ST303). If the number of dropped parcels has reached the threshold (Yes in ST303), it determines whether an alert for a collection request has been issued (ST304). If an alert for a collection request has not been issued (No in ST304), a process for issuing an alert for a collection request is performed (collection request alert issuance process) (ST305).

[0239] On the other hand, if a collection request alert has already been issued (Yes in ST304), processor 63 then determines whether or not collection of parcels has been detected by an operation of the delivery company's worker to complete collection (ST306). If collection of parcels has been detected (Yes in ST306), processor 63 then determines whether or not the number of parcels already posted has reached a predetermined upper limit (S307). If the number of parcels already posted has reached the upper limit (Yes in ST307), the threshold for determining whether or not an alert needs to be issued is reset to a value that is a predetermined number less than the current setting (threshold update) (ST308).

[0240] Next, processor 63 resets the number of dropped packages (the count of dropped packages) (ST309).

[0241] Here, the threshold value for determining whether or not an alert needs to be issued is set to a value less than the upper limit of the number of packages that can be stored in the storage unit 52 (the number of packages already deposited when the storage unit 52 is full). In other words, the threshold value for determining whether or not an alert needs to be issued is set to a value that is less than the upper limit by a predetermined margin (for example, about 2 to 5 packages). This allows a predetermined number of packages to be deposited after the issuance of a collection request alert and until the packages are collected. The margin can be set based on the time required from the issuance of a collection request alert to the collection of the packages, the pace at which the packages are deposited (the number of packages deposited per unit time), etc.

[0242] In this manner, in this modified example, an alert for a collection request is issued when there is still room in storage unit 52, so that packages are collected before storage unit 52 becomes full, reducing the occurrence of a situation in which packages cannot be dropped off because storage unit 52 is full. Furthermore, by controlling the threshold value for determining whether or not an alert is required depending on the number of packages actually dropped off, it is possible to reliably avoid a situation in which packages cannot be dropped off because storage unit 52 is full.

[0243] 2 and 27, this embodiment is provided with one drop slot 51 adjusted to match the size category (maximum) of parcels that can be dropped, but two or more drop slots 51 corresponding to the size categories of parcels that can be dropped may be provided, and the lock state of the lid of the drop slot 51 corresponding to the size category of the parcel may be released in conjunction with the determination by the shipping support device 1 that the parcel can be dropped or the printing of the waybill by the printer 44. In this way, by controlling the lock state of the lid of the corresponding drop slot 51 according to the size category of the parcel, it is possible to reliably prevent fraud such as swapping the parcel at the time of measurement with the parcel at the time of dropping.

[0244] Second embodiment Next, a second embodiment will be described. Note that the points not mentioned here are the same as those in the above embodiment. Fig. 29 is a block diagram showing a schematic configuration of a delivery support device 1 and a server device 2 according to the second embodiment.

[0245] In the first embodiment (see FIG. 7), the processor 63 of the shipping support device 1 performs processes related to shipping support, i.e., object detection process, photography position determination process, size measurement process, size classification determination process, packaging material selection process, advance declaration content inquiry process, posting permission determination process, waybill printing process, packaging material recognition process, payment process, and screen control process, but in this embodiment, the processor 73 of the server device 2 performs processes related to shipping support. In addition, the processor 73 of the server device 2 performs processes related to management of shipping declaration information input in advance by the user and payment. The processor 73 of the server device 2 performs necessary processes by executing programs stored in the memory 72.

[0246] In the shipping support device 1, the color image acquired by the color camera 32 of the upper photographing unit 31, the depth image acquired by the depth camera 33 of the upper photographing unit 31, and the color image acquired by the color camera 36 of the side photographing unit 35 are transmitted from the communication unit 61 to the server device 2. In the shipping support device 1, the communication unit 61 receives information transmitted from the communication unit 71 of the server device 2, and based on the information, the processor 63 controls the front display 41 and the handheld display 42 to display a required screen, controls the reader 43 to read the two-dimensional code, and controls the printer 44 to print a waybill.

[0247] Incidentally, in regard to the management of users when providing the shipping support service to users, information regarding the shipment of packages is inputted into the shipping application of the smartphone 3, the two-dimensional shipping code displayed in the shipping application of the smartphone 3 is read, and the two-dimensional payment code is read by the payment application of the smartphone 3, but the user may be identified and payment processed by face authentication. In this case, a registered face image (feature amount) of the user may be registered in advance in the server device 2, and a face matching process may be performed between an authentication face image acquired from an image captured by the shipping support device 1 of the user and the registered face image to perform payment processing by face authentication.

[0248] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0249] The shipping assistance device and shipping assistance system according to the present invention are configured to: fixed form Packages packed in packaging materials; fixed form If there are packages packed in packaging materials other than packaging materials, When posting parcels that fall into a specified size category, The present invention has the effect of being able to efficiently measure the size of packages with sufficient accuracy, and is useful as a shipping support device or shipping support system that supports the shipping procedures of users who hand over their packages to delivery companies. [Explanation of symbols]

[0250] 1. Shipping Support Device 2. Server equipment 3. Smartphone 11 Main unit 12 Rack 21 Placement table (placement part) 22 Placement surface 23 Side wall 31 Upper photographing unit (first detection unit) 32 Color Camera 33 Depth Camera 35 Lateral imaging unit (second detection unit) 36 Color Camera 39 Reference Marker 41 Front display (display unit) 42 Handheld display (display unit, operation unit) 43 Leader 44 Printer (Printing Department) 51 Mail slot 52 Storage area 53 Door 54 Handle 55 tablets 61 Communications Department 62 Memory 63 processors 71 Communications Department 72 Memory 73 Processor

Claims

1. A shipping support device that supports a shipping procedure of a user who delivers a package to a delivery company, A placement section where a user places their luggage; a first detection unit that outputs a captured image of the baggage placed on the placement unit; A second detection unit that outputs three-dimensional position information of the baggage placed on the placement unit; a third detection unit that outputs height information of the baggage placed on the placement unit; a storage unit for storing parcels that fall within a designated size category that users are permitted to post; A display unit that presents information to a user; A processor for controlling the dispatch support, The processor, Identifying whether the package placed on the placement section is packed in a standard packaging material of the designated size category by performing an image recognition process on the photographed image acquired from the first detection section; acquiring provisional size information of the luggage placed on the placement unit by a size measurement process using the three-dimensional position information acquired from the second detection unit; obtaining corrected size information regarding the height of the baggage placed on the placement section based on the height information obtained from the third detection section; When the package placed on the placement section is identified as being packed with the standard packaging material, the provisional size information is used to determine that the package placed on the placement section matches the designated size category that permits posting; When it is determined that the package placed on the placement section is not packed with the standard packaging material, the provisional size information and the corrected size information are combined to determine whether the package placed on the placement section matches the designated size category that allows posting; The shipping support device further comprises a display unit that displays information regarding the result of the determination.

2. The shipping support device according to claim 1 , wherein the placement section, the first detection section, the second detection section, the storage section, and the display section are integrally provided in a single housing.

3. The second detection unit is 2. The shipping support device according to claim 1, further comprising a three-dimensional camera for outputting three-dimensional position information of a subject.

4. The first and third detection units each include 2. The shipping support device according to claim 1, further comprising a two-dimensional camera for outputting a two-dimensional image of a subject.

5. The third detection unit is a two-dimensional camera that outputs a two-dimensional image of a subject; 2. The shipping support device according to claim 1, further comprising: an image capturing unit configured to capture an image of a reference marker provided on the opposite side of the third detection unit across the baggage placed on the placement unit.

6. Further, a printing unit for printing an invoice is provided, The processor, 2. The shipping support device according to claim 1, wherein when it is determined that the package placed on the placement section is acceptable for posting, it instructs the printing section to print a waybill for the package.

7. A shipping support system that supports a shipping procedure of a user who delivers a package to a delivery company, A placement section where a user places their luggage; a first detection unit that outputs a captured image of the baggage placed on the placement unit; A second detection unit that outputs three-dimensional position information of the baggage placed on the placement unit; a third detection unit that outputs height information of the baggage placed on the placement unit; a storage unit for storing parcels that fall within a designated size category that users are permitted to post; A shipping support device having a display unit that presents information to a user; A server device connected to the shipping support device via a network, The shipping assistance device includes: Transmitting the captured image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit to the server device; The server device includes: When the photographed image output from the first detection unit, the three-dimensional position information output from the second detection unit, and the height information output from the third detection unit are received from the shipping support device, an image recognition process is performed on the photographed image to identify whether the package placed on the placement section is packed in a standard packaging material of the specified size category, provisional size information of the package placed on the placement section is obtained by a size measurement process using the three-dimensional position information, and corrected size information regarding the height of the package placed on the placement section is obtained from the height information, When the package placed on the placement section is identified as being packed with the standard packaging material, the provisional size information is used to determine that the package placed on the placement section matches the designated size category that permits posting; When it is determined that the package placed on the placement section is not packed with the standard packaging material, the provisional size information and the corrected size information are combined to determine whether the package placed on the placement section matches the designated size category that allows posting; Transmitting information regarding the determination result to the shipping support device; The shipping assistance device includes: The shipping support system further comprises: displaying, on the display unit, information relating to the determination result received from the server device.

Images