Shipping Support Device

Abstract

To provide a delivery support apparatus that can save space of an apparatus, and in which a user can efficiently perform a delivery procedure.SOLUTION: A delivery support apparatus 1 that supports a user's delivery procedure to deliver a package to a delivery business operator in a delivery support system, comprises: a placing section (placing table 21) on which a user places a package; one or more detecting sections (upward imaging section 31, lateral imaging section 35) that detect a package placed on the placing section; a storage section 52 that stores the package posted by the user; display sections (front display 41, hand display 42) that present information for the user; an operation section (hand display 42) in which the user performs an operation associated with delivery; and an information processing device that performs control associated with delivery support. The operation section and the display sections are respectively arranged before and after of the placing section.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a shipping support device that supports the shipping procedures of users who hand over packages to delivery operators.

Background Art

[0002] In recent years, the use of person-to-person EC (Electronic Commerce) sites that mediate person-to-person commercial transactions such as free markets and auctions has been rapidly expanding. In particular, companies operating person-to-person EC sites have made efforts to provide users with dedicated applications installed on user terminals (such as smartphones) so that person-to-person commercial transactions can be easily carried out. For example, when shipping an item traded on a person-to-person EC site as a package, the shipper (seller) inputs delivery information (information such as the shipper and the recipient) according to the procedures of the dedicated application, and then goes to a store (an intermediary store) such as a nearby convenience store to easily carry out the shipping procedures for the package. At this time, if the shipping procedures are facilitated by a device that supports the shipping procedures without interacting with the store clerk, the convenience of the user can be further enhanced.

[0003] As a technology for supporting such shipping procedures for packages, conventionally, on a user terminal, the size of a package is measured using a sensor such as a camera, and a delivery type corresponding to the size of the package is presented to the user. If the delivery type allows posting to a postal mailbox, a technology has been known that enables the user to post the package to the postal mailbox (see Patent Document 1).

[0004] Also, based on the identification information of a two-dimensional code printed on a label attached to the packaging material of a package, the shipping, delivery, and receipt of the package are managed by a database. On a user terminal, after registering the package to be shipped by reading the two-dimensional code of the package, a technology has been known that enables the user to post the package to a receiving box installed in a postal mailbox or a convenience store (see Patent Document 2).

[0005] Also, on the user terminal, the user inputs information regarding the sender and recipient (postal information) and the delivery type, and in the shipping support device (unattended reception machine), the size of the package is measured. On the user terminal, the shipping fee is calculated based on the size of the package obtained from the shipping support device, and processing regarding the settlement of the shipping fee is performed. Also, in the shipping support device, a label including the input information on the user terminal is printed, and the user posts the package with the label attached to the shipping support device. Such a technique is known (see Patent Document 3).

[0006] Also, in the shipping support device (parcel collection terminal device), the user inputs the delivery information of the package (information such as the destination), and based on this information, processing regarding the settlement of the shipping fee is performed. Also, a label including the delivery information is printed, and the user posts the package with the label attached to the shipping support device. Such a technique is known (see Patent Document 4).

[0007] Also, in the shipping support device (home delivery automatic collection device), when the user posts a package, the size of the package is measured, it is determined whether the size of the package conforms to a predetermined standard, and the determination result is presented to the user. Depending on the user's selection operation, the package is stored or returned. Such a technique is known (see Patent Document 5). In particular, with this technique, the quantity of the packages stored in the shipping support device can be counted and recorded.

[0008] Also, in the shipping support device (home delivery box device), the size of the target package is measured, and based on the size of the package, processing regarding the settlement of the shipping fee is performed. When the user stores the package in the shipping support device, the shipping procedure is completed. Such a technique is known (see Patent Document 6). In particular, with this technique, not only the packaged packages but also the unpackaged packages can undergo the shipping procedure. That is, the size of the unpackaged package is measured, and an appropriate packaging material corresponding to the size of the package is presented to the user. The user packages the package with the presented packaging material and then stores it in the shipping support device.

Prior Art Documents

Patent Document

[0009]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Summary of the Invention

Problems to be Solved by the Invention

[0010] Now, in the conventional technology, since the user can post the package that has completed the necessary operations on the shipping support device on the spot, the shipping procedure can be completed without going through the store staff, and the convenience of the user can be improved.

[0011] On the other hand, in the shipping support device, it is preferable to be provided with a placement part where the user places the package for measuring the size of the package, a display part that presents various kinds of guidance regarding the shipping procedure to the user, and an operation part where the user performs various selection and input operations. Also, in order to be easily installed in a store such as a convenience store, it is desirable to reduce the space occupied by the shipping support device. Furthermore, it is desirable to improve the operability of the shipping support device so that the user can efficiently perform the shipping procedure using the shipping support device.

[0012] Therefore, the main object of the present invention is to provide a shipping support device that reduces the space occupied by the device and enables the user to efficiently perform the shipping procedure.

Means for Solving the Problems

[0013] The shipping support device of the present invention is a shipping support device that supports the shipping procedures of a user who delivers a package to a delivery company, and includes a placement unit on which the user places the package, and the One or more cameras that photograph a package and output image information capable of specifying the three-dimensional position of the package and the Packages in a specified size category sent by the user are stored in a storage unit, an operation unit that performs an operation for shipping the package placed by the user on the placement unit by posting, and the Notification information regarding whether or not the package placed on the placement unit can be mailed is presented to the user. A display unit, and an information processing device that controls the presentation of the Perform size measurement processing to obtain the image information and determine the three-dimensional size information of the package placed on the placement unit from the image information, determine whether the package can be mailed based on whether the three-dimensional size information of the package corresponds to the standard value of the size category, and the notification information to the display unit based on the operation of the user by the operation unit. The operation unit and the display unit are respectively arranged in front of and behind the placement unit.

Effect of the Invention

[0014] According to the present invention, A placement unit where the user places the package is sandwiched, and An operation unit for the user to perform an operation to send the package by mail is arranged on the front side, and A display unit that presents information related to package shipping support to the user is arranged on the rear side. Therefore, the space saving of this device can be achieved. In addition, the display unit can be seen through the package, and the necessary operations can be performed while looking at the package. As a result, the operability of this device can be improved, so that the user can efficiently perform the shipping procedures using this device.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Mode for Carrying Out the Invention

[0016] The first invention made to solve the above problems is a shipping support device that supports the shipping procedure of a user who delivers luggage to a delivery company, and includes a placement unit on which the user places the luggage, and the luggage placed on the placement unit One or more cameras that photograph a package and output image information capable of specifying the three-dimensional position of the package and the user mailed Packages in a specified size category a storage unit for storing, an operation unit for performing an operation for shipping the luggage placed by the user on the placement unit by mail, a display unit for presenting to the user Notification information regarding whether or not the package placed on the placement unit can be mailed and an information processing device for controlling the presentation of Perform size measurement processing to obtain the image information and determine the three-dimensional size information of the package placed on the placement unit from the image information, determine whether the package can be mailed based on whether the three-dimensional size information of the package corresponds to the standard value of the size category, and the notification information to the display unit based on the operation of the user by the operation unit. The operation unit and the display unit are respectively arranged in front of and behind the placement unit.

[0017] According to this,[[]]END]] A placement unit where the user places the package With[]]END]] An operation unit for the user to perform an operation to send the package by mail arranged on the front side and[]]END]] A display unit that presents information related to package shipping support to the user arranged on the rear side. Therefore, the space saving of this device can be achieved. In addition, the display unit can be seen through the luggage, and the necessary operations can be performed while looking at the luggage. As a result, the operability of this device can be improved, so that the user can efficiently perform the shipping procedure using this device.

[0018] Further, in the second invention, the operation unit, the display unit, the placement unit, and the Camera and the storage unit are integrally provided in the same housing.

[0019] According to this, since the device is made more space-saving, it can be easily installed in stores such as convenience stores.

[0020] Further, in the third invention, the information processing device further includes a printing unit that prints a shipping document for the package determined to be mailable.

[0021] According to this, the user can immediately obtain the necessary shipping document and mail the package to this device on the spot.

[0022] Further, in the fourth invention, the storage unit is configured to be provided with a mailing opening adapted to the size of the package that can be mailed.

[0023] According to this, it is possible to prevent inappropriate insertion of objects such as packages of sizes that cannot be mailed and garbage.

[0024] Further, in the fifth invention, the storage unit is provided with a lid that covers the mailing opening and a lock mechanism that restricts the opening and closing operation of this lid to prevent mailing of the package, and the information processing device is configured to control the locked state of the lock mechanism.

[0025] According to this, by controlling the locked state of the lock mechanism according to the situation of this device and the like, it is possible to avoid inappropriate insertion of objects such as garbage.

[0026] Further, in the sixth invention, the information processing device is configured to temporarily release the locked state of the lock mechanism based on a determination that mailing of the package is permitted.

[0027] According to this, only packages determined to be mailable can be mailed.

[0028] Further, a seventh invention further includes a printing unit that prints a shipping document for a package determined to be mailable by the information processing device, and the information processing device is configured to temporarily release the locked state of the locking mechanism when the printing of the shipping document by the printing unit is completed.

[0029] According to this, only the package with the shipping document printed by this device attached can be mailed.

[0030] Further, an eighth invention further includes a sensor for detecting the mailing of a package provided in the storage unit, and the information processing device is configured to return the locking mechanism to the locked state based on the detection result of the sensor.

[0031] According to this, after the package is mailed, it is possible to prevent inappropriate insertion of objects other than waste, etc.

[0032] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0033] (First Embodiment) FIG. 1 is an overall configuration diagram of a shipping support system according to the first embodiment.

[0034] This shipping support system supports the shipping procedures of users (requestors) who deliver packages to delivery companies, and includes a shipping support device 1, a server device 2, and a smartphone 3 (user device). The shipping support device 1 and the server device 2 are connected via a network. Also, the smartphone 3 and the server device 2 are connected via a network. Note that this shipping support system can also be used for shipping items traded on personal-to-person EC sites that mediate personal-to-person commercial transactions such as free markets and auctions.

[0035] The shipping support device 1 is installed in a store such as a convenience store. This shipping support device 1 has a function of measuring the size of the luggage brought in by the user and presenting the shipping fee of the luggage to the user. In addition, the shipping support device 1 has a function as a post where the luggage is mailed. Further, the shipping support device 1 has a function as a self-checkout for selling packing materials (packing containers). Further, the shipping support device 1 has a function of printing a shipping bill with predetermined items based on the information previously input by the user using the smartphone 3. The user attaches the printed shipping bill to the luggage and then mails it to the shipping support device 1.

[0036] The smartphone 3 is operated by a user who requests a delivery company to deliver luggage using the shipping support device 1. A shipping application and a payment application are installed on this smartphone 3. In the shipping application, the user inputs shipping declaration information (information regarding the name of the item, the sender, the recipient, handling specifications (fragile items, precision instruments, refrigeration required), etc.) regarding the luggage to be shipped. Note that the input of the shipping declaration information may be performed on a user terminal other than the smartphone 3, such as a PC or a tablet terminal. The payment application performs smartphone payments, that is, payment services such as electronic money and credit cards, using the smartphone 3. The user can use this payment application to pay for the purchase price of the packing materials using the specified payment service.

[0037] The server device 2 has a function of managing the shipping of luggage. Specifically, the information previously input by the user using the smartphone 3 or the like when shipping the luggage is registered and managed as the shipping declaration information for each user, and in response to a request from the shipping support device 1, the shipping declaration information is provided to the shipping support device 1. In addition, the server device 2 has a function related to payment. Specifically, in response to a request from the shipping support device 1, payment processing related to the payment for the packing materials purchased by the user is performed. Note that the server device 2 may be installed at a remote location separate from the store (for example, a management center, etc.), or may be installed at an appropriate location within the store (for example, a backyard or a management room, etc.).

[0038] In addition, in the present embodiment, the server device 2 is assumed to have a function of managing the shipment of packages and a function related to settlement. However, the function of managing the shipment of packages and the function related to settlement may be separately realized by different server devices.

[0039] Next, the schematic configuration of the shipping support device 1 will be described. FIG. 2 is a front view of the shipping support device 1. FIG. 3 is a perspective view showing the main part of the shipping support device 1. FIG. 4 is a cross-sectional view of the shipping support device 1 as viewed from above the mounting table 21. FIG. 5 is a cross-sectional view of the shipping support device 1 as viewed from the side of the mounting table 21. FIG. 6 is an explanatory diagram for explaining the shipping label printed by the shipping support device 1.

[0040] As shown in FIG. 2, the shipping support device 1 includes a main body 11 and a rack 12.

[0041] The rack 12 (stocking device) stores packaging materials (standard packaging materials, compliant packaging materials) that can be mailed in this device. In the present embodiment, two types of packaging materials, i.e., the standard packaging material of the first category (A-type standard box) and the standard packaging material of the second category (B-type standard box), are stored in the rack 12. The packaging materials stored in this rack 12 can be purchased by the user through the shipping support device 1. The packaging materials are stored in the rack 12 in a deployed state or a folded state and assembled by the user during packaging.

[0042] As shown in FIG. 3, the main body 11 includes a mounting table 21 (mounting portion). The packages brought in by the user are placed on this mounting table 21. In the present embodiment, by placing the packaged or unpacked packages on the mounting table 21, the size of the package is measured and the size category to which the package belongs is determined. Also, by placing the packaging material taken out from the rack 12 on the mounting table 21, the type of the packaging material is recognized.

[0043] The placement table 21 is formed in a tray shape and has a rectangular placement surface 22 on which an object (packed luggage, unpacked luggage, packing material to be purchased) is placed, and front, rear, left, and right side wall surfaces 23 surrounding the placement surface 22. In this embodiment, the lateral direction (left - right direction) of the rectangular placement surface 22 is defined as the X - direction, the longitudinal direction (front - rear direction) of the placement surface 22 is defined as the Y - direction, and the direction orthogonal to the placement surface 22 (height direction) is defined as the Z - direction.

[0044] Above the placement table 21, an upward imaging unit 31 (first detection unit) is provided so as to face the placement surface 22. This upward imaging unit 31 includes a color camera 32 (2 - D camera) and a depth camera 33 (3 - D camera). The color camera 32 and the depth camera 33 image an object (packed luggage, unpacked luggage, packing material to be purchased) placed on the placement surface 22 from above. The color camera 32 outputs a color image (detection result), and the depth camera 33 outputs a depth image (3 - D position information of the subject) (detection result). Note that a predetermined camera included in the depth camera 33 composed of a multi - camera may be used as the color camera 32 and used in a dual - purpose manner. In this case, since the number of cameras can be reduced, the cost of the device can be reduced.

[0045] The depth camera 33 is a 3 - D camera that outputs 3 - D position information of the subject, and in addition to a stereo camera, it may be a TOF (Time of Flight) camera or the like. The depth image is a distance image including information on the Z - coordinate (distance from the depth camera 33) for each pixel defined by the X - coordinate and the Y - coordinate.

[0046] On the lateral side (right side) wall surface 23 of the placement table 21, a lateral imaging unit 35 (second detection unit) is provided. This lateral imaging unit 35 includes two color cameras 36 (2 - D cameras). The two color cameras 36 are arranged offset in the front - rear (depth direction). The color cameras 36 image an object (packed luggage) placed on the placement surface 22 from the side. The color cameras 36 output color images (detection results). Note that three or more color cameras 36 may be provided in the lateral imaging unit 35.

[0047] As shown in FIG. 5, a reference marker 39 is provided on one (left side) side wall surface 23 so as to face the color camera 36 of the side shooting unit 35 provided on the other (right side) side wall surface 23. A predetermined pattern image (for example, a checker pattern) is drawn on this reference marker 39.

[0048] Here, the color camera 36 of the side shooting unit 35 shoots the reference marker 39 provided on the opposite side of the color camera 36 with the luggage placed on the mounting table 21 in between. For this reason, in the color image acquired by the color camera 36, depending on the height of the luggage, the image of the reference marker 39 is partially shielded by the luggage. Therefore, based on the shielding state of the image of the reference marker 39 in the color image, it is possible to determine whether or not the height of the luggage exceeds the upper limit value.

[0049] In the present embodiment, when even a part of the image of the reference marker 39 in the color image is missing, it is determined that the upper limit value regarding the height has been exceeded. Specifically, it is arranged such that the height of the lower side of the reference marker 39 from the mounting surface 22 matches the upper limit value Hmax regarding the height. Therefore, when the height of the luggage placed on the mounting surface 22 exceeds the upper limit value Hmax, the reference marker 39 is partially shielded by the luggage, and the image of the reference marker 39 in the color image is in a state where a part is missing. Thereby, it is possible to accurately determine whether or not the height of the luggage exceeds the upper limit value Hmax. Further, as shown in FIG. 4, since two color cameras 36 of the side shooting unit 35 are provided with a shift in the front - rear direction, it is possible to detect the height of the luggage placed on the mounting surface 22 without omission.

[0050] As shown in FIG. 3, a front display 41 is provided above the mounting table 21 so as to face the user. On this front display 41, mainly various guidance screens, for example, a screen for guiding the procedure of the shipping support service, are displayed.

[0051] A hand-held display 42 is provided on the front side of the mounting table 21. This hand-held display 42 is composed of a touch panel display. Various operation screens are displayed on this hand-held display 42.

[0052] A reader 43 is provided on the side of the hand-held display 42. This reader 43 reads the two-dimensional code displayed on the screen of the smartphone 3. In this embodiment, when purchasing packaging materials, a payment two-dimensional code is displayed on the screen by the payment application of the smartphone 3. Also, when mailing a package using this device, a shipping two-dimensional code is displayed on the screen by the shipping application of the smartphone 3.

[0053] A printer 44 is provided on the front surface of the main body 11. This printer 44 prints a shipping label 45 in a predetermined format based on the shipping declaration information (product name, sender, recipient, handling instructions (fragile, precision equipment, refrigeration required, etc.)) input by the user using a smartphone 3 or the like (see Fig. 6). This shipping label 45 is affixed by the user to the packaged item. From the perspective of personal information protection, it is also possible to print a shipping label in a confidential format in which only the delivery company can reproduce the information of the sender and recipient. Furthermore, by printing an ID (two-dimensional code) at a scannable position on the packaging material itself and associating the shipping declaration information with the ID, the printing function of the shipping label can be made unnecessary (see Japanese Patent No. 6664601).

[0054] As shown in Fig. 6, on the shipping label 45, in addition to the shipping declaration information (product name, sender, recipient, etc.) regarding the target package, an approval mark 46 is drawn (printed) as approval information regarding the size measurement result of the target package. This approval mark 46 approves that the size measurement of the package has been properly performed in the shipping support device 1.

[0055] Here, in the present embodiment, in the case of a packed package, if the actually measured size classification of the package corresponds to the size classification that permits posting and no handling designation that does not lead to posting is set, that is, if the handling designation information is not included in the shipping declaration information, it is determined that posting is permitted. And in the case of a determination result that permits posting of the package, a shipping label 45 including an approval mark 46 is printed by the shipping support device 1. Note that the approval mark 46 is not drawn (printed) on a general shipping label not by the shipping support device 1.

[0056] In the example shown in FIG. 6, the characters "Measured" are printed on the shipping label 45 as the approval mark 46. Also, as the approval mark 46, a predetermined symbol or figure (icon) or the like may be drawn on the shipping label 45. Further, as the approval mark 46, characters representing the size classification of the package based on the measurement result may be printed.

[0057] Note that in the present embodiment, a shipping label including the approval mark 46 indicating that the measurement result has been approved is printed, but the presence or absence of approval regarding the measurement result may be expressed by the format of the shipping label instead of the approval mark 46. That is, the shipping label printed by appropriately measuring the size of the package in the shipping support device 1 may be printed in a dedicated format different from a general shipping label.

[0058] Also, when a handling designation (fragile, precision equipment, refrigeration required, etc.) is set for the target package, in addition to the shipper and consignee information and the approval mark (approval information), the handling designation information may be printed on the shipping label.

[0059] As described above, in the present embodiment, with the visualized approval information, an operator of a delivery company can immediately confirm, just by visually checking the shipping label attached to the package, that the size measurement of the package has been appropriately performed in the shipping support device 1 and that re-size measurement is unnecessary. For this reason, after the package is collected, the transfer operation of the package can be immediately advanced.

[0060] In addition to such visualized approval information, it is possible to present to the delivery operator, by means of electronic approval information, that the package size measurement has been properly performed in the shipping support device 1. In this case, just by visually inspecting the package, the operator of the delivery operator cannot confirm whether the package size measurement has been properly performed. Therefore, in addition to information such as the shipper and the recipient, the approval information of the measurement result may be linked and managed to the package ID managed by the server device 2, and the approval information may be transmitted to the terminal in response to an inquiry from the terminal of the delivery operator. Note that since the approval information only needs to be presented to the delivery operator, it may not be transmitted to the shipping support device 1.

[0061] In addition, in order to smoothly inquire about the approval information from the terminal of the delivery operator, a two-dimensional code storing the package ID may be attached to the package, for example, a two-dimensional code may be drawn on the shipping label of the package or printed on the packaging material of the package. In this case, at the terminal of the delivery operator, the approval information regarding the target package may be inquired from the server device 2 based on the package ID obtained by reading the two-dimensional code. Note that at the terminal of the delivery operator, the operator may be able to confirm the presence or absence of approval regarding the measurement result by means of screen display or voice output.

[0062] Here, fraud of swapping the package at the time of measurement and the package at the time of posting, that is, fraud of performing size measurement on a small-sized package, printing the shipping label, and attaching it to another large-sized package for posting is conceivable. Therefore, in order to deal with such fraud, before posting, the package with the shipping label attached is photographed, the package size is measured again, the size classification indicated on the shipping label is obtained by image recognition of the photographed image of the camera, and a check function may be installed to confirm that there is no difference between the size classification indicated on the shipping label and the actual size classification of the package.

[0063] As shown in FIG. 2, the main body 11 is provided with a mailing slot 51 for mailing packages and a storage section 52 for storing the mailed packages. The delivery service provider can collect the packages by taking out the packages stored in the storage section 52. In this embodiment, since only packages of a predetermined size category properly measured by the shipping support device 1 can be mailed, the delivery service provider does not need to re-check the size category of the packages after collection, and can omit the size measurement work that was necessary after collection.

[0064] Also, the front side of the storage section 52 is covered by a door 53, and a handle 54 and a lock 55 are provided on this door 53. The lock 55 can be unlocked by the operator in charge of collecting the packages by the delivery service provider, and persons other than that operator cannot take out the packages in the storage section 52.

[0065] Thus, in this embodiment, the mounting table 21 (mounting section), the upper imaging section 31 (detection section), the side imaging section 35 (detection section), the front display 41 (display section), the hand-held display 42 (display section, operation section), and the storage section 52 are integrally provided in the same housing of the main body 11 of the shipping support device 1. As a result, the shipping support device 1 is made more space-saving, and can be easily installed in a store such as a convenience store.

[0066] Also, the mailing slot 51 is formed in a shape and size adapted to the size of the packages that can be mailed. That is, as the mailing slot 51, an opening of a predetermined area (width, height) adjusted so that only packages corresponding to a predetermined size category, which are small packages, can be mailed is provided.

[0067] In addition, in this embodiment, in order to measure the height of the luggage with high precision, a color camera 36 is provided in the side imaging unit 35, and the height of the luggage is measured based on the shielding state of the reference marker 39 on the opposing surface. However, a sensor other than a camera, for example, a sensor (such as a photoelectric sensor) that measures the height of an object based on the shielding state of light between a light emitting unit and a light receiving unit may be provided, and measurement may be performed based on the detection result. Further, a sensor other than a camera (for example, a measuring instrument that outputs three-dimensional information using a multi-laser) may be provided in the upper imaging unit 31, and measurement may be performed based on the detection result.

[0068] In this embodiment, the mounting table 21, the upper imaging unit 31, the side imaging unit 35, the front display 41, the hand-held display 42, and the storage unit 52 are integrally provided on the main body 11. However, the mounting table 21, the upper imaging unit 31, and the side imaging unit 35 related to imaging of the object may be configured separately from the storage unit 52, or the front display 41 and the hand-held display 42 related to guiding the user and the user's operation may be configured separately from the storage unit 52. In particular, it does not matter whether the mounting table 21 is integrated or separate as long as it is arranged between the front display 41 and the hand-held display 42. By arranging it in this way, the space saving of the device and the operability of the device for the user can be improved.

[0069] Next, the schematic configuration of the shipping support device 1 will be described. FIG. 7 is a block diagram showing the schematic configuration of the shipping support device 1.

[0070] As described above, the shipping support device 1 includes the color camera 32 and the depth camera 33 that constitute the upper imaging unit 31, two color cameras 36 that constitute the side imaging unit 35, the front display 41, the hand-held display 42, the reader 43, and the printer 44.

[0071] The shipping support device 1 further includes a communication unit 61, a memory 62, and a processor 63.

[0072] The communication unit 61 communicates with the server device 2 via a network.

[0073] The memory 62 stores programs and the like to be executed by the processor 63.

[0074] The processor 63 performs various processes related to shipping support by executing the programs stored in the memory 62. In the present embodiment, the processor 63 performs object detection processing, placement position determination processing, size measurement processing, size classification determination processing, packaging material selection processing, advance notice content inquiry processing, mailing permission determination processing, shipping label printing processing, packaging material recognition processing, payment instruction processing, and screen control processing, etc. Here, the configurations of the communication unit 61, the memory 62, and the processor 63 are realized by adopting a general-purpose PC or tablet (information processing device).

[0075] In the object detection processing, the processor 63 detects an object (unpacked luggage, packed luggage, packaging material to be purchased) placed on the mounting table 21 based on the color image acquired from the color camera 32 of the upper imaging unit 31.

[0076] In the placement position determination processing, the processor 63 determines whether the object is placed at the reference position based on the color image acquired from the color camera 32 of the upper imaging unit 31. In the present embodiment, the corner at the left back side of the placement surface 22 is the reference point, and the state where the corner at the left back side of the luggage aligns with the reference point is defined as the reference position of the luggage (see FIG. 4).

[0077] In the size measurement processing, the processor 63 measures the size (length, width, and height) of the target luggage (packed luggage, unpacked luggage) placed on the mounting table 21 by the user based on the color image captured by the color camera 32 of the upper imaging unit 31, the depth image captured by the depth camera 33 of the upper imaging unit 31, and the color image captured by the color camera 36 of the side imaging unit 35. Note that the size measurement based on the color image captured by the color camera 36 of the side imaging unit 35 can be omitted according to the accuracy of the size measurement based on the depth image captured by the depth camera 33 of the upper imaging unit 31.

[0078] In the size classification determination process, the processor 63 determines the size classification to which the target luggage placed on the placement table 21 by the user belongs based on the measurement result of the size measurement process. Further, in the size classification determination process, the processor 63 determines whether there is a possibility that the size classification of the target luggage is changed from the size classification of the determination result based on the measurement result of the size measurement process. This determination is made by comparing the dimensions of the luggage (vertical dimension, horizontal dimension, and height) as the measurement result, the standard values of the size classification of the determination result, and the standard values of the size classification that is cheaper than that. At this time, it is determined whether there is a possibility that the size classification of the luggage is changed by slightly exceeding the standard value of the size classification of the determination result for the target luggage and the user changing the way of placing the luggage, for example, arranging the luggage or moving the luggage closer to the reference point direction.

[0079] In the packaging material selection process, when the processor 63 targets unpacked luggage, based on the measurement result of the size measurement process, it selects the most recommended packaging material for packing the target unpacked luggage, that is, the packaging material corresponding to the size classification of the target luggage.

[0080] In the advance declaration content inquiry process, the processor 63 makes an inquiry to the server device 2 regarding the target luggage and acquires the shipping declaration information from the server device 2. This shipping declaration information is information that the user previously input (declared) using a smartphone 3 or the like, and includes information such as the name of the product, the information of the shipper and the consignee, and the handling designation information regarding the target luggage. The handling designation information is information regarding the handling designation that is not for posting. For example, when handling designations such as fragile items, precision instruments, and requiring refrigeration are set, it is added to the shipping declaration information. Note that the shipping declaration information can be acquired from the server device 2 by accessing the server device 2 based on the user registration information obtained by reading the two-dimensional code for shipping displayed on the smartphone 3 with the reader 43.

[0081] In the mailing feasibility determination process, the processor 63 determines whether the target package can be mailed by this device based on the determination result of the size classification determination process and the inquiry result of the advance declaration content inquiry process. Specifically, in the case of an unpacked package, if the actually measured size classification of the package matches the size classification that permits mailing, it is determined that mailing is possible. Also, in the case of a packed package, if the actually measured size classification of the package matches the size classification that permits mailing and no handling designation that prohibits mailing is set, that is, if the shipping declaration information does not include handling designation information, it is determined that mailing is possible. Here, if it is determined that mailing is possible, the shipping procedure by mailing is continued, and if it is determined that mailing is not possible, the shipping procedure by mailing is interrupted.

[0082] In the invoice printing process, the processor 63 instructs the printer 44 to print an invoice to be affixed to the package based on the shipping declaration information (product name, shipper, consignee, etc.) acquired from the server device 2. This invoice includes, in addition to the shipper and consignee information, approval information approving that the size measurement of the package has been properly performed in the shipping support device 1.

[0083] In the packaging material recognition process, the processor 63 recognizes the type of packaging material placed on the mounting table 21 for the user to purchase by performing image recognition on the color image acquired from the color camera 32 of the upward imaging unit 31.

[0084] In the payment instruction process, the processor 63 accesses the server device 2 based on the payment information of the user acquired by reading the two-dimensional code for payment displayed on the smartphone 3 with the reader 43, and instructs the server device 2 to perform payment processing regarding the payment for the packaging material that the user purchases.

[0085] In the screen control process, the processor 63 displays, on the front display 41 and the hand-held display 42, a guidance screen that supports the user's shipping procedure in response to an operation of the hand-held display 42 by the user. In the present embodiment, for example, a screen for presenting the measurement result of the size measurement process to the user is displayed (measurement result presentation process). Specifically, as the measurement result, the size of the package (vertical dimension, horizontal dimension, and height), the cost required for shipping (delivery fee and price of packaging materials), etc. are displayed on the screen. Further, in the present embodiment, when the unpacked package is the target, a screen for presenting to the user a packaging material suitable for the package is displayed (packaging material presentation process).

[0086] Next, the process performed on the packaged package by the shipping support device 1 will be described. FIG. 8 is an explanatory diagram showing an outline of the process for the packaged package.

[0087] In the shipping support device 1, only packages corresponding to the designated size category can be mailed. In the present embodiment, only packages corresponding to two size categories, the first category and the second category, can be mailed to the shipping support device 1.

[0088] In the first category, as shown in FIG. 8(A), only packages packed with a standard packaging material of a predetermined size can be mailed to the shipping support device 1. The standard packaging material for the first category is, for example, a cardboard box.

[0089] In the second category, as shown in FIG. 8(B), a package packed with a standard packaging material of a predetermined size and, as shown in FIG. 8(C), a package packed with a compatible packaging material that fits within the size of the second category can be mailed to the shipping support device 1. The standard packaging material for the second category is, for example, a cardboard box. Also, the compatible packaging material for the second category is a packaging material other than the standard packaging material, such as an envelope with cushioning material.

[0090] In the processes for packaged luggage (size measurement process and size classification determination process), a color image captured by the color camera 32 of the upper imaging unit 31, a depth image captured by the depth camera 33 of the upper imaging unit 31, and a color image captured by the color camera 36 of the side imaging unit 35 are used to distinguish luggage packed in the standard packaging material of the first category shown in Fig. 8(A), luggage packed in the standard packaging material of the second category shown in Fig. 8(B), luggage packed in the compatible packaging material of the second category shown in Fig. 8(C), and luggage packed in other packaging materials.

[0091] In particular, in the process of identifying the standard packaging material of the first category shown in Fig. 8(A) and the process of identifying the standard packaging material of the second category shown in Fig. 8(B), a color image captured by the color camera 32 of the upper imaging unit 31 and a depth image captured by the depth camera 33 of the upper imaging unit 31 are used. Specifically, based on the depth image (three-dimensional position information of the subject) of the upper imaging unit 31, three-dimensional size information (vertical dimension, horizontal dimension, and height) of the object is obtained, and based on this three-dimensional size information, a determination is made as to whether it is a standard packaging material. Furthermore, by performing image recognition on the color image of the upper imaging unit 31, an image (service mark or unique pattern) printed on the surface of the standard packaging material is detected, and a determination is made as to whether it is a standard packaging material.

[0092] On the other hand, in the process of identifying the compatible packaging material of the second category shown in Fig. 8(C), a color image captured by the color camera 32 of the upper imaging unit 31 and a color image captured by the color camera 36 of the side imaging unit 35 are used. Specifically, based on the color image of the upper imaging unit 31, two-dimensional size information (vertical dimension and horizontal dimension) of the object is obtained, and based on this two-dimensional size information, a determination is made as to whether it is a compatible packaging material. Furthermore, based on the shielding status of the reference marker 39 in the color image of the side imaging unit 35, height information of the object is obtained, and based on this height information, a determination is made as to whether it is a compatible packaging material. Note that in the process of identifying the compatible packaging material of the second category shown in Fig. 8(C), without changing the processing method, a color image captured by the color camera 32 of the upper imaging unit 31 and a depth image captured by the depth camera 33 of the upper imaging unit 31 may also be used for identification.

[0093] Here, in the determination of the standard packaging material for the first category, it is determined whether the measured vertical dimension, horizontal dimension, and height match the size (vertical dimension, horizontal dimension, and height) of the standard packaging material. Also, in the determination of the standard packaging material for the second category, similar to the determination of the standard packaging material for the first category, it is determined whether the measured vertical dimension, horizontal dimension, and height match the size (vertical dimension, horizontal dimension, and height) of the standard packaging material.

[0094] Also, in the determination of the compliant packaging material for the second category, the size (vertical dimension, horizontal dimension, and height) of the standard packaging material for the second category becomes the maximum size, and upper limit values are set for each of the vertical dimension, horizontal dimension, and height. Also, a planar minimum size is set. That is, lower limit values are set for each of the vertical dimension and horizontal dimension. Therefore, when the horizontal dimension is less than or equal to the upper limit value and greater than or equal to the lower limit value, and further, when the vertical dimension is less than or equal to the upper limit value and greater than or equal to the lower limit value, and further, when the height is less than or equal to the upper limit value, it is determined as the compliant packaging material for the second category.

[0095] Thus, in this embodiment, in the process for the package packed with the standard packaging material among the packed luggage, the three-dimensional size information (provisional size information) included in the depth image by the depth camera 33 of the upper imaging unit 31 and the image recognition result for the color image by the color camera 32 of the upper imaging unit 31 are combined to determine the size category of the luggage. Thereby, even when an error occurs in the height information included in the depth image, since the standard packaging material can be identified by image recognition, by combining the two, the size category of the luggage can be efficiently determined with sufficient accuracy.

[0096] On the other hand, in the process for packages packed with packaging materials other than standard packaging materials, the size classification of the package is determined by combining the two-dimensional size information obtained from the color image captured by the color camera 32 of the upper imaging unit 31 and the height information (corrected size information) based on the shielding state of the reference marker 39 in the color image captured by the color camera 36 of the side imaging unit 35. In this way, in the case of packaging materials other than standard packaging materials, the packaging materials cannot be identified by image recognition, and there may be an error in the height information in the determination based only on the image of the upper imaging unit 31, so the size classification of the package cannot be determined with sufficient accuracy. However, in the detection of the reference marker 39 from the color image of the side imaging unit 35, highly accurate height information can be obtained. Therefore, by combining the two, the size classification of the package can be efficiently determined with sufficient accuracy.

[0097] In addition, in this embodiment, it is assumed that only packages corresponding to the two size classifications of the first classification and the second classification can be mailed in the shipping support device 1, but packages corresponding to three or more size classifications may also be mailed. In this case, the mailing port 51 may be formed larger, or mailing ports 51 corresponding to the size classifications of the packages may be provided respectively so that the corresponding packages can be mailed.

[0098] Also, in this embodiment, two types of packaging materials, the standard packaging material of the first classification (type A standard box) and the standard packaging material of the second classification (type B standard box), are stored in the rack 12 and sold to users. However, since packaging materials other than standard packaging materials are also allowed in the second classification, other packaging materials conforming to the second classification, such as envelopes with cushioning materials, may be stored in the rack 12 and sold to users.

[0099] Next, the process for unpacked packages performed by the shipping support device 1 will be described. FIG. 9 is an explanatory diagram showing an overview of the process for unpacked packages.

[0100] In the shipping support device 1, for unpacked packages, it is determined whether they fall within the size categories (the first category and the second category) that can be mailed by this device (size category determination process). At this time, based on the depth image (3D position information) obtained by the depth camera 33 of the upper imaging unit 31 capturing the unpacked package placed on the mounting table 21, the lengths of three sides of the circumscribed rectangular parallelepiped surrounding the foreground area on the depth image corresponding to the object (unpacked package) (the dimension in the X direction, the dimension in the Y direction, and the dimension in the Z direction) are acquired, and based on the lengths of the three sides of the circumscribed rectangular parallelepiped, it is determined whether the object falls within the size categories (the first category and the second category) that can be mailed by this device.

[0101] Specifically, the foreground area (object) is extracted from the color image obtained by the color camera 32 of the upper imaging unit 31, and the two-dimensional position information of the foreground area (object) is acquired. Next, based on the depth image (3D position information) obtained by the depth camera 33 of the upper imaging unit 31 and the two-dimensional position information of the foreground area (object), a circumscribed rectangular parallelepiped surrounding the foreground area (object) is set. Next, the dimension in the X direction, the dimension in the Y direction, and the dimension in the Z direction of the circumscribed rectangular parallelepiped are calculated. Then, based on the dimension in the X direction, the dimension in the Y direction, and the dimension in the Z direction of the circumscribed rectangular parallelepiped, it is determined whether the object falls within the size categories (the first category and the second category) that can be mailed by this device.

[0102] Note that the height of the foreground area (object) from the mounting surface 22 is the dimension in the Z direction of the circumscribed rectangular parallelepiped. Therefore, by obtaining the background difference regarding the Z coordinate of the foreground area, that is, the difference between the current depth image and the depth image (background image) obtained by the depth camera 33 capturing the mounting table 21 in a state where no object is placed in advance, the dimension in the Z direction of the circumscribed rectangular parallelepiped can be acquired. Also, since the height from the mounting surface 22 is not constant, the maximum value of the height from the mounting surface 22 is the dimension in the Z direction of the circumscribed rectangular parallelepiped.

[0103] Incidentally, in the present embodiment, the height of the object is measured based on the background difference of the depth image. However, when the height of the object is lower than the detection limit (e.g., 1 cm), as in the case of a CD or DVD package, the background difference of the depth image cannot be appropriately obtained, and the height of the object cannot be appropriately measured. At this time, there is no particular problem even if the two-dimensional size information obtained from the color image is used to generate size information with the height detection limit (e.g., 1 cm) as the height of the object.

[0104] In addition, in the shipping support device 1, a packaging material recognition process for the packaging material purchased by the user is performed. In the present embodiment, the packaging materials (standard packaging materials in the first category and standard packaging materials in the second category) stored in the rack 12 can be purchased. At this time, the user selects a packaging material from the rack 12 and places it on the placement table 21. The shipping support device 1 determines whether the packaging material placed on the placement table 21 is one of the standard packaging materials in the first category and the standard packaging materials in the second category by performing an image recognition process on the color image acquired by the color camera 32 of the upper imaging unit 31. On the surfaces of the standard packaging materials in the first category and the standard packaging materials in the second category, unique images (e.g., service marks, unique patterns, etc.) are printed. In the packaging material recognition process, the packaging material placed on the placement table 21 is detected from the color image acquired by the color camera 32 of the upper imaging unit 31, and the type of the packaging material is recognized based on the shape and size of the packaging material and the image printed on the surface.

[0105] Note that the packaging materials are stored in the rack 12 in a state before assembly (expanded state or folded state), and the packaging materials can be identified based on the shape, size, and image printed on the surface of the packaging materials in this state before assembly.

[0106] In addition, in the present embodiment, when an object (packed luggage, unpacked luggage, packing material to be purchased) is placed on the mounting table 21, a mounting position determination process is performed. In the present embodiment, as shown in FIG. 4, the corner at the left back side of the mounting surface 22 serves as a reference point, and the state where the corner at the left back side of the luggage aligns with the reference point is defined as the reference position of the luggage. The user arranges the object (packed luggage, unpacked luggage, packing material to be purchased) at the reference position.

[0107] In the shipping support device 1, the position of the object is detected by image recognition of the color image acquired by the color camera 32 of the upward imaging unit 31, and it is determined whether the object is arranged at the reference position. When the object is displaced from the reference position, the user is guided to rearrange the object at the reference position by means of the screen or voice of the front display 41.

[0108] Next, the procedure of the process for the packed luggage performed by the shipping support device 1 will be described. FIGS. 10 and 11 are flowcharts showing the procedure of the process for the packed luggage.

[0109] As shown in FIG. 10, in the shipping support device 1, first, the processor 63 acquires a color image from the color camera 32 of the upward imaging unit 31 (ST101). Next, the processor 63 detects the object placed on the mounting table 21 by image recognition of the color image (object detection process) (ST102). Then, the processor 63 determines whether the object is placed at the reference position (mounting position determination process) (ST103).

[0110] Here, when the object is placed at the reference position (Yes in ST103), next, the processor 63 acquires a depth image (three-dimensional position information of the subject) from the depth camera 33 of the upward imaging unit 31 (ST104). Next, the processor 63 detects the object from the depth image (ST105). Next, the processor 63 acquires size information (vertical dimension, horizontal dimension, height) of the object based on the depth image (size measurement process) (ST106). Then, the processor 63 determines whether the size of the object matches the size of the standard packaging material in the first category (ST107).

[0111] Here, when the size of the object matches the size of the standard packaging material in the first category (Yes in ST107), next, the processor 63 performs image recognition on the color image (ST108). Then, based on the image recognition result, it is determined whether the object is a standard packaging material in the first category (size category determination process) (ST109).

[0112] Here, when the object is determined to be a standard packaging material in the first category (Yes in ST109), the object is confirmed as a package packed with the standard packaging material in the first category (ST110).

[0113] On the other hand, when the size of the object does not match the size of the standard packaging material in the first category (No in ST107), next, the processor 63 determines whether the size of the object matches the size of the standard packaging material in the second category (ST111).

[0114] Here, when the size of the object matches the size of the standard packaging material in the second category (Yes in ST111), next, the processor 63 performs image recognition on the color image (ST112). Then, based on the image recognition result, it is determined whether the object is a standard packaging material in the second category (size category determination process) (ST113).

[0115] Here, when the object is determined to be a standard packaging material in the second category (Yes in ST113), the object is confirmed as a package packed with the standard packaging material in the second category (ST114).

[0116] On the other hand, when it is determined that the object is not a standard packaging material in the first category (No in ST109), when the size of the object does not match the size of the standard box in the second category (No in ST111), or when it is determined that the object is not a standard box in the second category (No in ST113), the process proceeds to the process of determining whether the object is a conforming product other than the standard box in the second category (second-category conforming product determination).

[0117] As shown in FIG. 11, in the second-category conforming product determination, first, the processor 63 extracts a foreground region from the color image captured by the color camera 32 of the upward imaging unit 31 (ST115). At this time, the processor 63 extracts the foreground region by obtaining the background difference of the color image, that is, the difference between the current color image and the color image (background image) obtained by capturing the mounting table 21 in a state where no object is placed thereon in advance with the color camera 32. Next, the processor 63 sets an outer circumscribing frame surrounding the foreground region and calculates the dimension in the X direction and the dimension in the Y direction of the outer circumscribing frame (size measurement process) (ST116).

[0118] Next, the processor 63 determines whether the dimension in the X direction of the outer circumscribing frame is less than or equal to the upper limit value regarding the width in the second category and the dimension in the Y direction is less than or equal to the upper limit value regarding the depth in the second category (ST117).

[0119] Here, when the dimension in the X direction of the outer circumscribing frame is less than or equal to the upper limit value in the second category and the dimension in the Y direction is less than or equal to the upper limit value in the second category (Yes in ST117), next, the processor 63 determines whether the dimension in the X direction of the outer circumscribing frame is greater than or equal to the lower limit value regarding the width in the second category and the dimension in the Y direction is greater than or equal to the lower limit value regarding the depth in the second category (ST118).

[0120] Here, when the dimension of the outer frame in the X direction is greater than or equal to the lower limit value of the second category and the dimension in the Y direction is greater than or equal to the lower limit value of the second category (Yes in ST118), next, the processor 63 acquires a color image from the color camera 36 of the side imaging unit 35 (ST119). Next, the processor 63 detects the reference marker 39 from the color image (ST120). Then, based on the shielding state of the reference marker 39 in the color image, the processor 63 determines whether the height of the object is less than or equal to the upper limit value regarding the height of the second category (size category determination process) (ST121). In the size measurement process (ST116), based on the depth image, size information (vertical dimension, horizontal dimension, height) of the object may be acquired to determine the height of the object. In this case, the configuration of the color camera 36 of the side imaging unit 35 can be omitted.

[0121] Here, when the height of the object is less than or equal to the upper limit value of the second category (Yes in ST121), next, the processor 63 determines the object as a package of the second category (a package packed with a packing material other than the standard packing material) (ST122).

[0122] On the other hand, when the dimension of the outer frame in the X direction exceeds the upper limit value of the second category or the dimension in the Y direction exceeds the upper limit value of the second category (No in ST117), or when the dimension of the outer frame in the X direction is less than the lower limit value of the second category or the dimension in the Y direction is less than the lower limit value of the second category (No in ST118), or when the height of the object exceeds the upper limit value of the second category (No in ST121), the object is determined as a non - mailable package (ST123).

[0123] Next, the procedure of the process for unpacked packages performed by the shipping support device 1 will be described. FIG. 12 is a flowchart showing the procedure of the process for unpacked packages.

[0124] In the shipping support device 1, first, the processor 63 acquires a color image and a depth image (3D position information) from the color camera 32 and the depth camera 33 of the upward imaging unit 31 (ST201). At this time, when it is detected that an object is placed on the mounting table 21 based on the background difference of the Z coordinate (height information) of the depth image, the subsequent processing may proceed. When the height of the object is lower than the detection limit and the object is not detected, the two-dimensional size information obtained by extracting the foreground region from the color image may be used to generate size information with the height detection limit as the height of the object.

[0125] Next, the processor 63 extracts the foreground region (object) from the color image (ST202). Next, the processor 63 sets an outer circumscribed rectangular parallelepiped surrounding the foreground region (object) based on the depth image (3D position information), and calculates the dimensions in the X direction, Y direction, and Z direction of the outer circumscribed rectangular parallelepiped (size measurement process) (ST203).

[0126] Next, the processor 63 determines whether the dimension in the Z direction of the outer circumscribed rectangular parallelepiped is less than or equal to the upper limit value of the first section (ST204).

[0127] Here, when the dimension in the Z direction of the outer circumscribed rectangular parallelepiped is less than or equal to the upper limit value of the first section (Yes in ST204), next, the processor 63 determines whether the dimension in the X direction of the outer circumscribed rectangular parallelepiped is less than or equal to the upper limit value regarding the width of the first section and the dimension in the Y direction is less than or equal to the upper limit value regarding the depth of the first section (ST205).

[0128] Here, when the dimension in the X direction of the outer circumscribed rectangular parallelepiped is less than or equal to the upper limit value of the first section and the dimension in the Y direction is less than or equal to the upper limit value of the first section (Yes in ST205), the processor 63 determines that the object is the package of the first section (ST206).

[0129] On the other hand, if the dimension of the circumscribed rectangular parallelepiped in the X direction exceeds the upper limit value of the first section, or if the dimension in the Y direction exceeds the upper limit value of the first section (No in ST205), then next, the processor 63 determines whether the maximum value of the height from the placement surface 22 is less than or equal to the upper limit value regarding the height of the second section (ST207).

[0130] Here, if the dimension of the circumscribed rectangular parallelepiped in the Z direction is less than or equal to the upper limit value of the second section (Yes in ST207), then next, the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit value regarding the width of the second section and whether the dimension in the Y direction is less than or equal to the upper limit value regarding the depth of the second section (ST208).

[0131] Here, if the dimension of the circumscribed rectangular parallelepiped in the X direction is less than or equal to the upper limit value and the dimension in the Y direction is less than or equal to the upper limit value of the second section (Yes in ST208), then next, the processor 63 determines whether the dimension of the circumscribed rectangular parallelepiped in the X direction is greater than or equal to the lower limit value regarding the width of the second section and whether the dimension in the Y direction is greater than or equal to the lower limit value regarding the depth of the second section (ST209).

[0132] Here, if the dimension of the circumscribed rectangular parallelepiped in the X direction is greater than or equal to the lower limit value and the dimension in the Y direction is greater than or equal to the lower limit value of the second section (Yes in ST209), the processor 63 determines the object as the package of the second section (ST210).

[0133] On the other hand, if the maximum value of the height from the placement surface 22 exceeds the upper limit value of the first section (No in ST204), or if the maximum value of the height from the placement surface 22 exceeds the upper limit value of the second section (No in ST207), or if the dimension of the circumscribed rectangular parallelepiped in the X direction exceeds the upper limit value of the second section, or if the dimension in the Y direction exceeds the upper limit value of the second section (No in ST208), or if the dimension of the circumscribed rectangular parallelepiped in the X direction is less than the lower limit value or the dimension in the Y direction is less than the lower limit value of the second section (No in ST209), the processor 63 determines the object as a package that cannot be mailed (ST211).

[0134] Next, the screen displayed during standby in the shipping support device 1 will be described. FIG. 13 is an explanatory diagram showing the screen displayed during standby in the shipping support device 1.

[0135] In the shipping support device 1 during standby, on the front display 41, the screen shown in FIG. 13(A) (standby screen) is displayed, and on the hand-held display 42, the screen shown in FIG. 13(B) (standby screen) is displayed.

[0136] On the screen of the front display 41 shown in FIG. 13(A), there are characters guiding the menu of the shipping support service provided to the user, that is, characters 101 guiding the automatic sizing mode (first mode) with the title of "Automatically Check Size", characters 102 guiding the self-mailing mode (second mode) with the title of "Self-Mail Post", and characters 103 guiding the packing material purchase mode (third mode) with the title of "Purchase Packing Materials". Also, on this screen, there are characters 104 guiding that any one of the three operation modes of the automatic sizing mode, the self-mailing mode, and the packing material purchase mode can be selected by operating the hand-held display 42.

[0137] On the screen of the hand-held display 42 shown in FIG. 13(B), there is a selection part 105 for the automatic sizing mode with the title of "Automatically Check Size" displayed, a selection part 106 for the self-mailing mode with the title of "Self-Mail Post" given, and a selection part 107 for the packing material purchase mode with the title of "Purchase Packing Materials" given. By the user operating any one of these selection parts 105, 106, 107, any one of the three operation modes can be selected.

[0138] Here, the automatic sizing mode with the title of "Automatically Check Size" is such that when the user brings in unpacked luggage, it presents the user with packing materials suitable for that luggage so that the user can purchase the packing materials in a self-checkout manner.

[0139] The processing of this automatic measurement mode consists of a packaging material selection step and a packaging material purchase step. In the packaging material selection step, the processor 63 of the shipping support device 1 determines the size classification of the unpacked package placed on the placement table 21 by the user, and determines whether the package can be mailed by this device (mailing availability determination process). When it is determined that the package can be mailed by this device, the packaging material corresponding to the size classification of the package is selected and presented to the user (packaging material presentation process). In the packaging material purchase step, the processor 63 recognizes the type of the packaging material taken out by the user from the rack 12 and placed on the placement table 21 based on the captured image by the color camera 32 of the upward imaging unit 31 (packaging material recognition process), and performs processing related to the payment (settlement) of the selling price of the packaging material (settlement process).

[0140] The self-mailing mode with the title of "Self-mailing Post" enables the user to print a shipping label based on the pre-registered shipping declaration information regarding the shipment of the packaged package, and paste the shipping label on the packaged package, so that it can be mailed from the mailing slot 51 of this device when the user brings in the packaged package.

[0141] The processing of this self-mailing mode is that the processor 63 of the shipping support device 1 determines the size classification of the packaged package placed on the placement table 21 by the user (size classification determination process), queries the server device 2 for the handling specification information (included in the shipping declaration information) regarding the handling specification that is not suitable for mailing (for example, fragile items, precision instruments, items requiring refrigeration) (pre-declaration content query process), and determines that mailing is permitted when the actually measured size classification of the package matches the size classification that permits mailing and no handling specification is set (mailing availability determination process). Then, when it is determined that mailing is permitted, a shipping label is printed based on the shipping declaration information pre-registered by the user (shipping label printing process).

[0142] The packaging material purchase mode with the title "Purchase Packaging Materials" enables users to purchase packaging materials in the self-checkout method. In this packaging material purchase mode, the processor 63 of the shipping support device 1 recognizes the type of packaging material taken out by the user from the rack 12 and placed on the placement table 21 based on the color image captured by the color camera 32 of the upward imaging unit 31 (packaging material recognition process), and performs processing related to the payment (settlement) of the purchase price of the packaging material (settlement instruction process).

[0143] Next, the screen displayed in the automatic dimension measurement mode in the shipping support device 1 will be described. FIGS. 14, 15, 16, and 17 are explanatory diagrams showing the screens displayed in the automatic dimension measurement mode in the shipping support device 1.

[0144] In the shipping support device 1, when the user operates the selection unit 105 of the automatic dimension measurement mode in which the title "Automatically Check Size" is displayed on the screen of the hand-held display 42 shown in FIG. 13(B), first, the front display 41 transitions to the screen shown in FIG. 14(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 14(B-1).

[0145] On the screen of the front display 41 shown in FIG. 14(A-1), a character 111 prompting the user to place the package to be size-measured on the placement table 21 and an image 112 guiding the way to place the package on the placement table 21 are displayed. Since it is necessary to place the package at the reference position near the left back side of the placement table 21, in the image 112, a video shows the situation where the package moves from the center of the placement table 21 toward the left back side.

[0146] On the screen of the hand-held display 42 shown in FIG. 14(B-1), a character 115 prompting the user to place the package to be size-measured on the placement table 21 and a button 116 for instructing size measurement are provided. When the user operates the button 116 for instructing size measurement, size measurement is started, and then the determination of whether the package can be mailed is performed. Note that when size measurement is started, the screen may transition to a screen notifying the user that size measurement is in progress.

[0147] Here, when the processor 63 of the shipping support device 1 detects the package placed on the mounting table 21, measures the size of the package, determines that the package can be mailed, and determines that there is no possibility of changing the size category, the front display 41 transitions to the screen shown in FIG. 14(A-2), and the hand-held display 42 transitions to the screen shown in FIG. 14(B-2).

[0148] On the screen of the front display 41 shown in FIG. 14(A-2), as size information that is the size measurement result, the values of the three sides of the package orientation, specifically, the characters 121 representing the vertical dimension, horizontal dimension, and height of the circumscribed rectangle surrounding the package, and the cost required for shipping the package, specifically, the characters 122 representing the delivery fee and the price of the packaging material, are displayed. Further, on this screen, characters 123 indicating that the size measurement can be retaken by rearranging the package are displayed. Note that although the dimensions of the package itself are displayed as the size information, the dimensions of the size category to which the package belongs may be displayed.

[0149] On the screen of the hand-held display 42 shown in FIG. 14(B-2), characters 125 representing the size (vertical dimension, horizontal dimension, and height) of the package, characters 126 representing the delivery fee, and characters 127 guiding the most recommended packaging material for packaging the package are displayed. Further, on this screen, a button 128 for instructing re-measurement of the size and a button 129 for proceeding to the packaging material purchase step are provided.

[0150] Here, when the user operates the button 128 for instructing re-measurement of the size, the size measurement is performed again. For example, when there is a possibility that the size category may change by arranging multiple items, clothing, etc. in the package or changing the placement method, the user can instruct re-measurement of the size. Also, when the user operates the button 129 for proceeding to the packaging material purchase step, the front display 41 transitions to the screen shown in FIG. 15(A-2), and the hand-held display 42 transitions to the screen shown in FIG. 15(B-2).

[0151] On the one hand, when the processor 63 determines that there is a possibility of changing the size classification, the hand-held display 42 transitions to the screen shown in FIG. 14(B-3). On the screen of the hand-held display 42 shown in FIG. 14(B-3), instead of the character 127 on the screen of FIG. 14(B-2), a character 130 representing advice information regarding how to place unpacked luggage is displayed.

[0152] The advice information is to prompt the user to re-measure the luggage size because by devising how to place the luggage, for example, arranging the luggage or moving it towards the reference point, there is a possibility that the size classification of the luggage can be changed and it can be shipped with a cheaper packing material. In the example shown in FIG. 14(B-3), as the advice information, characters such as "There is still room in height." are displayed. In addition to this, for example, characters such as "Please move the luggage towards the reference point." may also be displayed.

[0153] By the user seeing such advice information, the user can easily confirm that the luggage can be shipped with a more appropriate (cheaper) delivery fee and packing material. Then, the user devises how to place the luggage, for example, arranges the luggage or moves it towards the reference point, and then operates the button 128 for instructing re-measurement of the size. At this time, in some cases, the size classification of the luggage is changed to a more appropriate (cheaper) size classification, and a more appropriate (cheaper) packing material is presented to the user. Thereby, the user can quickly confirm the optimal packing material for the unpacked luggage brought in.

[0154] Note that the advice information may be displayed on the screen of the front display 41 shown in FIG. 13(A-2). Also, in addition to the screen display, advice may be given by voice output.

[0155] Thus, in this embodiment, the remeasurement of the size of the package can be repeated. When the package is unpacked, unlike when it is already packed, if the user changes the way the package is placed, the size measurement result (size classification) may change. Therefore, by enabling the user to repeat the remeasurement of the size of the package until they are satisfied, the cost required for sending the package (delivery fee and price of packaging materials) can be kept low.

[0156] In addition, a button 119 for instructing termination is displayed on the screen of the hand-held display 42 (such as in FIG. 14(B-1)). The user can instruct termination at an appropriate timing using this button 119. When this button 119 is operated, the screen transitions to a screen for confirming termination (not shown), and when an operation for approving termination is performed on this screen, the automatic sizing mode ends and the device returns to the standby state.

[0157] Also, since the payment (settlement) for the purchase price of the packaging materials is made using a designated payment service using the smartphone 3, a screen for inquiring whether the registration of the designated payment service is completed or a screen for prompting the store staff to request guidance on the designated payment service may be displayed on the hand-held display 42 before transitioning to the screen shown in FIG. 15(A-2).

[0158] On the other hand, when it is determined that the target package cannot be mailed in the mailing availability determination, the front display 41 transitions to the screen shown in FIG. 15(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 15(B-1).

[0159] On the screen of the front display 41 shown in FIG. 15(A-1), a character 131 prompting the user to perform the shipping procedure at the counter inside the store because the package cannot be mailed by this device and an image 132 guiding the counter inside the store are displayed.

[0160] On the screen of the hand-held display 42 shown in Fig. 15(B-1), characters 135 representing the size (length, width, and height) of the package, characters 136 notifying that the package cannot be mailed using this device, and characters 137 prompting to perform the shipping procedure at the counter inside the store are displayed. In addition, when the package cannot be mailed using this device, the numerical part exceeding the mailable size among the numbers representing the length, width, and height of the package may be highlighted.

[0161] On the screen of the front display 41 shown in Fig. 15(A-2), an image 141 guiding the packaging materials that can be purchased using this device and characters 142 prompting to select the packaging materials from the rack 12 installed next to the main body 11 are displayed. In this embodiment, the standard packaging materials in the first category (type A standard box) and the standard packaging materials in the second category (type B standard box) can be purchased using this device. Also, on this screen, in order to present the packaging materials suitable for the package to the user, the packaging materials suitable for the package are highlighted. Note that the packaging materials not suitable for the package may be grayed out.

[0162] On the screen of the hand-held display 42 shown in Fig. 15(B-2), characters 145 and 146 prompting the user to select the packaging materials suitable for the package are displayed. Note that the packaging materials are stored in the shelves of the rack 12 by category, and in conjunction with the presentation of the packaging materials suitable for the user's package, a display device (not shown) such as an LED lamp provided on the shelf may be lit to prompt to take out the packaging materials used for the presentation.

[0163] Here, when a predetermined time has elapsed after transitioning to the screen of the front display 41 shown in Fig. 15(A-2) and the screen of the hand-held display 42 shown in Fig. 15(B-2), the front display 41 transitions to the screen shown in Fig. 16(A-1), and the hand-held display 42 transitions to the screen shown in Fig. 16(B-1).

[0164] On the screen of the front display 41 shown in Fig. 16(A-1), there are displayed a character 151 prompting to place the selected packaging material on the mounting table 21, a character 152 guiding that when purchasing a plurality of packaging materials, they should be placed one by one on the mounting table 21, an image 153 guiding the manner of placing the packaging material on the mounting table 21, and a character 154 guiding that the settlement application of the smartphone 3 is required. Since it is necessary to place the packaging material at the reference position closer to the left back side of the mounting table 21, the image 153 displays a moving image of the packaging material moving from the center of the mounting table 21 toward the left back side.

[0165] On the screen of the hand-held display 42 shown in Fig. 16(B-1), there are displayed a character 155 prompting to place the selected packaging material on the mounting table 21, and a character 156 indicating the name and price of the packaging material suitable for the luggage.

[0166] Here, when the processor 63 of the shipping support device 1 detects the packaging material placed on the mounting table 21 and recognizes the type of the packaging material, the hand-held display 42 transitions to the screen shown in Fig. 16(B-2).

[0167] On the screen of the hand-held display 42 shown in Fig. 16(B-2), there are displayed a character 157 prompting to confirm the selected packaging material and give an instruction to purchase, a character 156 indicating the name and price of the recognized packaging material, a button 158 instructing to reselect the packaging material, and a button 159 instructing to purchase the packaging material.

[0168] Here, when the user operates the button 158 instructing to reselect the packaging material, it transitions to the screen shown in Fig. 16(B-3). On the other hand, when the user operates the button 159 instructing to purchase the packaging material, the front display 41 transitions to the screen shown in Fig. 17(A-1), and the hand-held display 42 transitions to the screen shown in Fig. 17(B-1). Note that a user who only wishes to be presented with the optimal packaging material based on the size measurement of the luggage and does not wish to purchase the packaging material may instruct termination by the button 119 on the screen of the hand-held display 42 shown in Fig. 16(B-2).

[0169] On the screen of the hand-held display 42 shown in FIG. 16(B-3), there are displayed a character 161 prompting to select a packing material, a selection part 162 of the packing material, and a cancel button 163. When the user operates the selection part 162 of the packing material, the front display 41 transitions to the screen shown in FIG. 17(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 17(B-1). When the user operates the cancel button 163, the automatic sizing mode ends and returns to the standby state.

[0170] On the screen of the front display 41 shown in FIG. 17(A-1), there are displayed a character 171 prompting to display the code settlement screen on the smartphone 3, an image 172 guiding the procedure for displaying the code settlement screen on the smartphone 3, an image 173 guiding the position of the reader 43 of the shipping support device 1, and a character 174 prompting to hold the two-dimensional code for settlement displayed on the code settlement screen in front of the reader 43.

[0171] On the screen of the hand-held display 42 shown in FIG. 17(B-1), there are displayed a character 175 prompting to hold the two-dimensional code for settlement displayed on the code settlement screen in front of the reader 43, and a character 156 representing the name and price of the packing material to be purchased.

[0172] Here, when the processor 63 of the shipping support device 1 obtains the reading information from the reader 43 by the reader 43 reading the two-dimensional code for settlement displayed on the smartphone 3, it sends a settlement instruction to the server device 2. The server device 2 executes the settlement process for the purchase price regarding the user. When the settlement process ends normally, the front display 41 transitions to the screen shown in FIG. 17(A-2), and the hand-held display 42 transitions to the screen shown in FIG. 17(B-2).

[0173] On the screen of the front display 41 shown in Fig. 17(A-2), a character 181 expressing gratitude for the purchase of the packing material and an image 182 guiding the subsequent procedures are displayed. In the image guiding the subsequent procedures, for example, an image guiding that the packing work can be done in the store, an image guiding that shipping (mailing) can be done in the self-mailing mode of this device when the packing work is completed, and an image related to prompting for input of information (such as size classification) about the luggage in the shipping application of the smartphone 3 are displayed as a video.

[0174] On the screen of the hand-held display 42 shown in Fig. 17(B-2), a character 183 expressing gratitude for the purchase of the packing material and a character 156 representing the name and price of the packing material for which the settlement has been completed are displayed.

[0175] In addition, when an error occurs during the process of the automatic dimension measurement mode, an error screen (not shown) is displayed on the front display 41 and the hand-held display 42. On this error screen, characters indicating that an error has occurred and normal processing cannot be executed, characters prompting to perform the shipping procedure at the counter in the store, an image guiding the counter in the store (for example, a store floor plan), characters prompting to call the store staff, etc. are displayed.

[0176] Next, the screen displayed in the self-mailing mode in the shipping support device 1 will be described. Figs. 18, 19, 20, and 21 are explanatory diagrams showing the screens displayed in the self-mailing mode in the shipping support device 1.

[0177] In the shipping support device 1, when the user operates the selection unit 106 of the self-mailing mode with the title of "Self-mailing Post" on the screen of the hand-held display 42 shown in Fig. 13(B), first, the front display 41 transitions to the screen shown in Fig. 18(A-1), and the hand-held display 42 transitions to the screen shown in Fig. 18(B-1).

[0178] On the screen of the front display 41 shown in Fig. 18(A-1), there are displayed a character 201 prompting to place the packed luggage on the mounting table 21 and start the shipping application with the smartphone 3, and an image 202 guiding how to place the luggage on the mounting table 21. Since it is necessary to place the luggage at the reference position closer to the left back side of the mounting table 21, the image 202 displays a moving image of the luggage moving from the center of the mounting table 21 toward the left back side.

[0179] On the screen of the hand-held display 42 shown in Fig. 18(B-1), there are displayed a character 205 prompting to place the packed luggage on the mounting table 21 and start the shipping application with the smartphone 3, and a button 206 instructing the shipping procedure.

[0180] In addition, when the processor 63 detects that the packed luggage has been placed on the mounting table 21, the hand-held display 42 may transition to a screen indicating that the size of the luggage is being measured.

[0181] Here, when the user operates the button 206 instructing the shipping procedure, the front display 41 transitions to the screen shown in Fig. 18(A-2), and the hand-held display 42 transitions to the screen shown in Fig. 18(B-2).

[0182] On the screen of the front display 41 shown in Fig. 18(A-2), there are displayed a character 211 prompting to display the 2D code for shipping with the payment application of the smartphone 3 and hold it in front of the reader 43, and an image 212 guiding the position of the reader 43 of this device. In the image, the position of the reader 43 is guided by a frame image surrounding the reader 43.

[0183] On the screen of the hand-held display 42 shown in Fig. 18(B-2), there are displayed a character 213 prompting to hold the 2D code for shipping in front of the reader 43, and an image 214 indicating that the reader 43 is reading.

[0184] At this time, when the processor 63 acquires the reading result of the shipping two-dimensional code from the leader 43, it accesses the server device 2 to query the handling designation information included in the shipping declaration information regarding the user, and checks whether there is a setting for a handling designation that is not suitable for mailing (for example, fragile items, precision instruments, items requiring refrigeration).

[0185] Note that when a failure occurs in the network or the like and the connection to the server device 2 cannot be established, the screen may transition to a screen that notifies the user to that effect.

[0186] Here, when the actually measured size category of the package corresponds to the designated size category and there is no setting for a handling designation that is not suitable for mailing, that is, when the shipping declaration information does not include handling designation information, if the package is determined to be mailable, the front display 41 transitions to the screen shown in FIG. 19(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 19(B-1).

[0187] On the screen of the front display 41 shown in FIG. 19(A-1), a character 221 notifying that the size measurement of the package and the determination of mailability are completed and that the package can be mailed, and an image 222 that alerts users who have no handling designation set for fragile items, etc., are displayed. Note that as an alert for fragile items, a confirmation message indicating whether the package is packed with a cushioning material that can withstand impacts such as mailing may be displayed.

[0188] On the screen of the hand-held display 42 shown in FIG. 19(B-1), a character 225 notifying that the size measurement of the package and the determination of mailability are completed and that the package can be mailed, and a button 226 for instructing the printing of the shipping note, are displayed.

[0189] On the other hand, if the measured size category of the package does not correspond to the specified size category, or if a handling designation that is not suitable for posting (for example, fragile items, precision equipment, items requiring refrigeration) is set, that is, if handling designation information is included in the shipping declaration information and the package is determined to be non-postable, the front display 41 will transition to the screen shown in Fig. 19(A-2). Also, if the package is determined to be non-postable because the measured size category of the package does not correspond to the specified size category, the hand-held display 42 will transition to the screen shown in Fig. 19(B-2). On the other hand, if a handling designation that is not suitable for posting is set, that is, if handling designation information is included in the shipping declaration information and the package is determined to be non-postable, the hand-held display 42 will transition to the screen shown in Fig. 19(B-3).

[0190] Note that if the package is determined to be non-postable, the user will leave the package with the staff at the store counter, and the package will be handed over to the delivery operator via the store staff. This enables even packages with handling designations to be safely handed over to the delivery operator without damage to the package.

[0191] On the screen of the front display 41 shown in Fig. 19(A-2), a character 231 prompting the user to perform the shipping procedure at the counter inside the store and an image 232 guiding the counter inside the store are displayed.

[0192] On the screen of the hand-held display 42 shown in Fig. 19(B-2), a character 235 notifying that the package is not of a size suitable for posting and a character 236 prompting the user to perform the shipping procedure at the counter inside the store are displayed.

[0193] On the screen of the hand-held display 42 shown in Fig. 19(B-3), a character 237 notifying that a handling designation not suitable for posting is set and a character 236 prompting the user to perform the shipping procedure at the counter inside the store are displayed.

[0194] Also, when the user operates the button 226 for instructing the printing of the invoice on the screen of the hand-held display 42 shown in FIG. 19(B-1), the front display 41 transitions to the screen shown in FIG. 20(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 20(B-1).

[0195] On the screen of the front display 41 shown in FIG. 20(A-1), a character 241 notifying that the printing of the invoice has started and an image 242 guiding the position of the printer 44 of this device are displayed. In the image, the position of the printer 44 is guided by a frame image surrounding the printer 44.

[0196] On the screen of the hand-held display 42 shown in FIG. 20(B-1), a character 245 notifying that the printing of the invoice has started and an image 246 indicating that the invoice is being printed are displayed.

[0197] Here, when the printing of the invoice is completed, the front display 41 transitions to the screen shown in FIG. 20(A-2), and the hand-held display 42 transitions to the screen shown in FIG. 20(B-2).

[0198] On the screen of the front display 41 shown in FIG. 20(A-2), a character 251 notifying that the printing of the invoice has been completed, a character 252 prompting to attach the invoice to the packaged luggage, and an image 253 representing the situation of attaching the invoice to the packaged luggage are displayed.

[0199] On the screen of the hand-held display 42 shown in FIG. 20(B-2), a character 255 notifying that the printing of the invoice has been completed, a character 256 prompting to attach the invoice to the packaged luggage, and an OK button 258 for approving the attachment of the invoice are displayed.

[0200] Here, when the user affixes a shipping label to the package on the spot, the user operates the OK button 258. In this case, the front display 41 transitions to the screen shown in FIG. 21(A-1), and the hand-held display 42 transitions to the screen shown in FIG. 21(B-1). On the other hand, when the user does not affix a shipping label to the package on the spot, the user operates the end instruction button 119.

[0201] On the screen of the front display 41 shown in FIG. 21(A-1), a character 261 prompting the user to post the package and an image 262 guiding the position of the posting slot 51 of this device are displayed. In the image 262, the position of the posting slot 51 is guided by a frame image surrounding the posting slot 51.

[0202] On the screen of the hand-held display 42 shown in FIG. 21(B-1), a character 265 prompting the user to post the package and an OK button 268 for approving the posting of the package are displayed.

[0203] Here, when the user posts the package on the spot, the user operates the OK button 268. In this case, the front display 41 transitions to the screen shown in FIG. 21(A-2), and the hand-held display 42 transitions to the screen shown in FIG. 21(B-2). On the other hand, when the user does not post the package on the spot, the user operates the end instruction button 119.

[0204] On the screen of the front display 41 shown in FIG. 21(A-2), a character 271 indicating that the shipping procedure is completed by posting the package, a character 272 prompting an input (shipping notification) indicating that the shipping procedure is completed in the shipping application of the smartphone 3, and an image 273 representing the situation where the package is shipped are displayed.

[0205] On the screen of the hand-held display 42 shown in FIG. 21(B-2), characters 275 indicating that the shipping procedure has been completed, characters 276 expressing gratitude for the use of this device, and characters 277 prompting an input (shipping notification) indicating that the shipping procedure has been completed in the shipping application of the smartphone 3 are displayed. Here, in conjunction with the display of the screen of the hand-held display 42 shown in FIG. 21(B-2), an instruction to automatically rewrite the status information of the user's luggage from waiting for shipping to shipped may be transmitted to the server device 2.

[0206] In addition, when an error occurs during the process of the automatic sizing mode, an error screen (not shown) is displayed on the front display 41 and the hand-held display 42. This error screen displays characters indicating that an error has occurred and normal processing cannot be executed, characters prompting the user to perform the shipping procedure at the counter in the store, an image guiding the counter in the store (e.g., a store floor plan), and characters prompting the user to call the store staff when the printing paper for the shipping note runs out.

[0207] Next, a screen displayed in the packaging material purchase mode in the shipping support device 1 will be described. FIGS. 22, 23, and 24 are explanatory diagrams showing the screens displayed in the packaging material purchase mode in the shipping support device 1.

[0208] In the shipping support device 1, when the user operates the selection unit 107 of the packaging material purchase mode with the title of "Purchase Packaging Materials" on the screen of the hand-held display 42 shown in FIG. 13(B), first, the front display 41 transitions to the screen shown in FIG. 22(A), and the hand-held display 42 transitions to the screen shown in FIG. 22(B).

[0209] In addition, when the user operates the selection section 107 for the packing material purchase mode on the screen of the hand-held display 42 shown in Fig. 13(B), the hand-held display 42 transitions to a screen (not shown) that asks the user whether the user's registration has been completed in the designated payment service. Only when the registration for the designated payment service is completed, it may transition to the screens shown in Figs. 22(A) and (B). Also, when the registration for the designated payment service is not completed, it may transition to a screen (not shown) that guides the user to purchase the packing material at the counter inside the store.

[0210] On the screen of the front display 41 shown in Fig. 22(A), an image 301 that guides the packing material stored in the rack 12 and characters 302 that guide the rack 12 installed next to the main body 11 are displayed.

[0211] On the screen of the hand-held display 42 shown in Fig. 22(B), characters 305 that prompt the user to select the packing material stored in the rack 12 and characters 306 indicating that the packing material is purchased one by one are displayed.

[0212] Here, when a predetermined time elapses after transitioning to the screens shown in Figs. 22(A) and (B), the front display 41 transitions to the screen shown in Fig. 23(A-1), and the hand-held display 42 transitions to the screen shown in Fig. 23(B-1).

[0213] Thereafter, it is the same as the packing material purchase steps in the automatic sizing mode. That is, on the front display 41, the screens shown in Figs. 23(A-1), 24(A-1), and 24(A-2) are sequentially displayed, and these screens are the same as the screens shown in Figs. 16(A-1), 17(A-1), and 17(A-2) in the automatic sizing mode, respectively. Also, on the hand-held display 42, the screens shown in Figs. 23(B-1), 23(B-2), 23(B-3), 24(B-1), and 24(B-2) are sequentially displayed, and these screens are the same as the screens shown in Figs. 16(B-1), 16(B-2), 16(B-3), 17(B-1), and 17(B-2) in the automatic sizing mode, respectively.

[0214] (First Modification Example of the First Embodiment) Next, a first modification example of the first embodiment will be described. Note that points not particularly mentioned here are the same as those in the above embodiment. FIG. 25 is an explanatory diagram showing a screen displayed in the self-mailing mode in the shipping support device 1 according to the first modification example of the first embodiment.

[0215] In the first embodiment, even if the actually measured size category of the package is mailable, if a handling designation not conducive to mailing is set for the target package, that is, if the shipping declaration information obtained from the server device 2 includes handling designation information, it is determined that mailing is not possible, and the screen shown in FIG. 19(B-3) is displayed on the hand-held display 42, and the shipping procedure by this device is interrupted, and the shipping procedure is carried out at the store counter.

[0216] On the other hand, in this modification example, when a handling designation not conducive to mailing is set for the target package, guidance for continuing the procedure by mailing is displayed on the hand-held display 42. At this time, the user is inquired whether to continue the shipping procedure of the package by mailing, and if the user approves, the shipping procedure of the package by mailing is continued, and the process proceeds to the step of printing the shipping label.

[0217] Specifically, when a handling designation not conducive to mailing is set for the target package, that is, if the shipping declaration information obtained from the server device 2 includes handling designation information, the front display 41 transitions to the screen shown in FIG. 25(A), and the hand-held display 42 transitions to the screen shown in FIG. 25(B). These screens are generated based on the handling designation information included in the advance declaration information.

[0218] On the screen of the front display 41 shown in Fig. 25(A), characters 281 for notifying that a handling designation not for mailing is set, characters 282 representing the content of the handling designation set by the user, and characters 283 indicating guidance in the case of exceptionally allowing mailing are displayed. The example shown in Fig. 25(A) guides that even if the user has set a handling designation for fragile items, mailing is possible when the package is sufficiently protected by cushioning materials.

[0219] On the screen of the hand-held display 42 shown in Fig. 25(B), characters 285 for inquiring whether to continue the shipping procedure of the package by mailing and a button 286 for instructing to continue the shipping procedure of the package by mailing are displayed. When the user operates this button 286 for instructing continuation, for example, the screen shown in Figs. 19(A-1) and 19(B-1) is shifted to, and a shipping bill is printed.

[0220] In addition, when the handling designation set for the target package requires refrigeration, without inquiring the user about whether to continue the shipping procedure, that is, without exception, the shipping procedure should be interrupted and a display indicating that the shipping procedure of the package by mailing cannot be performed should be made.

[0221] (Second Modified Example of the First Embodiment) Next, the second modified example of the first embodiment will be described. Note that points not particularly mentioned here are the same as those in the above-described embodiment. Fig. 26 is a flowchart showing the procedure of processing for an unpacked package according to the second modified example of the first embodiment.

[0222] In the first embodiment, as shown in Fig. 11, in the case of a package packed with a packing material other than the standard packing material, the provisional size information based on the captured image of the upper imaging unit 31 is corrected with the corrected size information based on the captured image of the side imaging unit 35 to obtain the determined size information. Also, as shown in Fig. 12, in the case of an unpacked package, correction by the corrected size information based on the captured image of the side imaging unit 35 is not performed, and the provisional size information based on the captured image of the upper imaging unit 31 is directly used as the determined size information.

[0223] On the other hand, in this modification example, in the case of unpacked luggage, similar to the case of the packed luggage shown in FIG. 11, the provisional size information based on the captured image of the upper shooting unit 31 is corrected with the correction size information based on the captured image of the side shooting unit 35 to obtain the determined size information. Specifically, instead of the provisional height information based on the depth image of the upper shooting unit 31, the size classification of the luggage is determined based on the height information based on the shielding state of the reference marker 39 in the color image of the side shooting unit 35.

[0224] Specifically, as shown in FIG. 26, after the processes of ST201 to ST203 similar to those in the first embodiment (see FIG. 12), the processor 63 acquires a color image from the color camera 36 of the side shooting unit 35 (ST221), and detects the reference marker 39 from the color image (ST222). Then, the processor 63 determines whether the height of the object is equal to or less than the upper limit value regarding the height of the first classification based on the shielding state of the reference marker 39 in the color image (size classification determination process) (ST223).

[0225] Here, when the height of the object is equal to or less than the upper limit value of the first classification (Yes in ST223), the process proceeds to ST205. On the other hand, when the height of the object exceeds the upper limit value of the first classification (No in ST223), the processor 63 determines the object as a non - mailable luggage (ST211). Also, in ST205, when the XY dimension of the circumscribed rectangular parallelepiped of the object is equal to or less than the upper limit value of the first classification (Yes in ST205), the processor 63 determines the object as a luggage of the first classification (ST206).

[0226] On the other hand, when the XY dimension of the circumscribed rectangular parallelepiped of the object exceeds the upper limit value of the first classification (No in ST205), next, the processor 63 determines whether the height of the object is equal to or less than the upper limit value regarding the height of the second classification based on the shielding state of the reference marker 39 in the color image (size classification determination process) (ST224).

[0227] Here, when the height of the object is less than or equal to the upper limit value of the second section (Yes in ST224), the process proceeds to ST208. The processing after ST208 is the same as that in the first embodiment. On the other hand, when the height of the object exceeds the upper limit value of the second section (No in ST224), the process proceeds to ST211. The processing of this ST211 is the same as that in the first embodiment.

[0228] Note that in this modified example, in order to accurately distinguish between two size sections with different upper limit values of height, two reference markers 39 corresponding to the two size sections may be provided respectively.

[0229] (Third Modified Example of the First Embodiment) Next, a third modified example of the first embodiment will be described. Note that points not particularly mentioned here are the same as those in the above-described embodiment. FIG. 27 is an explanatory diagram showing a main part of the shipping support device 1 according to the third modified example of the first embodiment. FIG. 28 is a flowchart showing the operation procedure of the processor 63 of the shipping support device 1.

[0230] As shown in FIG. 27, a storage unit 52 for storing luggage is provided in the main body 11 of the shipping support device 1, and a mailing slot 51 adapted to the size of the luggage that can be mailed is provided in this storage unit 52. Further, the storage unit 52 is provided with a lid 81 that covers the mailing slot 51 and a lock mechanism 82 that restricts the opening and closing operation of the lid 81 to prevent the mailing of luggage. Note that the lock mechanism 82 may be configured to drive a lock member (not shown) that restricts the opening and closing operation of the lid 81 by a drive unit (not shown) composed of an actuator such as a solenoid.

[0231] In addition, the storage unit 52 is provided with a sensor 83 for detecting the mailing of a package, that is, a package passing through the mailing slot 51. Note that the detection at the time of mailing a package is a known technique (see, for example, Japanese Patent Application Laid-Open No. 10-91678), and various configurations can be adopted. In addition to being configured as a passing sensor, the sensor 83 may be configured as an opening / closing sensor for detecting the opening and closing of a lid 81 that covers the mailing slot 51. Further, a reader may be provided near the mailing slot 51 to read a two-dimensional code printed on a shipping note, so as to detect the mailing of a package and at the same time identify the mailed package.

[0232] The processor 63 controls the locked state of the locking mechanism 82 so that an unmeasured package or an object other than a package (such as garbage) is not mailed from the mailing slot 51. In the present embodiment, the processor 63 temporarily releases the locked state of the locking mechanism based on a determination that mailing of a package is permitted. Further, in the present embodiment, when the printing of the shipping note by the printer 44 is completed, the processor 63 temporarily releases the locked state of the locking mechanism 82. Further, in the present embodiment, when the mailing of a package is detected based on the detection result of the sensor 83, the processor 63 returns the locking mechanism 82 to the locked state.

[0233] In addition, the processor 63 counts the number of packages mailed to the storage unit 52 among the packages determined to be mail-able. In the present embodiment, the processor 63 counts the number of packages mailed to the storage unit 52 based on the detection result of the sensor 83. That is, each time the mailing of a package is detected by the sensor 83, the number of packages is counted up. Note that the counting of the number of packages determined to be mail-able is also a known technique (see, for example, Japanese Patent Application Laid-Open No. 2001-76262), and various configurations can be adopted.

[0234] Also, in this embodiment, the processor 63 compares the counted value of the mailed packages with a threshold value (upper limit value or a value smaller than the upper limit value by a predetermined number) regarding the quantity of packages that can be stored in the storage unit 52, and performs a process of issuing an alert for the package consolidation request based on the comparison result. Specifically, when the counted value of the packages becomes equal to or greater than the threshold value, a process of issuing an alert for the consolidation request is performed. In this case, for example, a notification of the alert for the consolidation request from the shipping support device 1 may be transmitted to a terminal (not shown) held by an operator in charge of consolidation via the server device 2 and a server device of the delivery carrier (not shown). Note that, after the notification of the alert for the consolidation request, a threshold value allowing the mailing of about 2 to 5 packages may be set so that the shipping support device 1 can continue to be used until the consolidation of the packages.

[0235] Also, in this embodiment, when the consolidation of the packages from the storage unit 52 is completed, the processor 63 resets the counted value of the packages. In this case, for example, when an operator of the delivery carrier unlocks the lock 55 (see FIG. 2) of the storage unit 52 and finishes the consolidation of the packages, an operation indicating the completion of consolidation is performed, and in response to that operation, the processor 63 may reset the counted value of the packages. Also, based on the opening and closing of the door 53 of the storage unit 52 and the unlocking and locking of the lock 55, it may be detected that the consolidation of the packages is completed, and the counted value of the packages may be reset. Note that the resetting of the counted value after the consolidation of the packages is also a known technique (see, for example, Japanese Patent Publication No. 6-30738), and various configurations can be adopted.

[0236] Also, in this embodiment, when the quantity of the mailed packages reaches the upper limit value of the quantity of packages that can be stored in the storage unit 52 during the consolidation of the packages, the threshold value for determining whether an alert needs to be issued is updated. In this update of the threshold value, the threshold value is reset to a value smaller than the current set value by a predetermined number.

[0237] Specifically, as shown in FIG. 28, first, when the sensor 83 detects the mailing of a package (Yes in ST301), the processor 63 increments the number of mailed packages (the count value of the mailed packages) by 1 (ST302). Next, the processor 63 determines whether the number of mailed packages has reached a predetermined threshold (alert necessity determination) (ST303). Here, if the number of mailed packages has reached the threshold (Yes in ST303), it is determined whether an alert for a collection request has already been issued (ST304). Here, if an alert for a collection request has not been issued yet (No in ST304), a process of issuing an alert for a collection request is performed (collection request alert issuance process) (ST305).

[0238] On the other hand, if an alert for a collection request has already been issued (Yes in ST304), next, the processor 63 determines whether it has detected the collection of a package by an operation of a worker of the delivery company for completion of collection (ST306). Here, if the collection of a package has been detected (Yes in ST306), next, the processor 63 determines whether the number of mailed packages has reached a predetermined upper limit value (S307). Here, if the number of mailed packages has reached the upper limit value (Yes in ST307), the threshold for the alert necessity determination is reset to a value that is a predetermined number less than the current set value (threshold update) (ST308).

[0239] Next, the processor 63 resets the number of mailed packages (the count value of the mailed packages) (ST309).

[0240] Here, the threshold for the alert necessity determination is set to a value less than the upper limit value of the quantity of packages that can be stored in the storage unit 52 (the number of mailed packages in the full state of the storage unit 52). That is, the threshold for the alert necessity determination is set to a value that is smaller than the upper limit value by a predetermined margin number (for example, about 2 to 5). Thereby, after the issuance of the alert for the collection request, the mailing of a predetermined number of packages is permitted until the collection of the packages. Note that the margin number can be set based on the time required from the issuance of the alert for the collection request to the collection of the packages and the pace at which the packages are mailed (the number of packages mailed per unit time).

[0241] Thus, in this modified example, since an alert for a collection request is issued when there is still room in the storage unit 52, the goods are collected before the storage unit 52 becomes full, and it is possible to reduce the occurrence of a situation where the storage unit 52 is full and letters cannot be mailed. Furthermore, by controlling the threshold value for determining whether to issue an alert according to the quantity of the actually mailed goods, it is possible to surely avoid the occurrence of a situation where the storage unit 52 is full and letters cannot be mailed.

[0242] In addition, in this embodiment, as shown in FIGS. 2 and 27, one mailing slot 51 adjusted according to the size classification (maximum) of the mailable goods is provided. However, two or more mailing slots 51 corresponding to the size classification of the mailable goods may be provided, and in conjunction with the determination by the shipping support device 1 that mailing of the goods is permitted or the printing of the shipping label by the printer 44, the locked state of the lid of the mailing slot 51 corresponding to the size classification of the goods may be released. In this way, by controlling the locked state of the lid of the corresponding mailing slot 51 according to the size classification of the goods, it is possible to surely prevent fraud such as the substitution of the goods during measurement and the goods during mailing.

[0243] (Second Embodiment) Next, the second embodiment will be described. Note that points not particularly mentioned here are the same as those in the above-described embodiment. FIG. 29 is a block diagram showing a schematic configuration of the shipping support device 1 and the server device 2 according to the second embodiment.

[0244] In the first embodiment (see FIG. 7), the processor 63 of the shipping support device 1 performs processes related to shipping support, that is, object detection processing, shooting position determination processing, size measurement processing, size classification determination processing, packing material selection processing, advance declaration content inquiry processing, mailing permission determination processing, waybill printing processing, packing material recognition processing, settlement processing, and screen control processing, etc. However, in this embodiment, the processor 73 of the server device 2 performs processes related to shipping support. In addition, the processor 73 of the server device 2 also performs management of shipping declaration information previously input by the user and processes related to settlement. Note that the processor 73 of the server device 2 performs necessary processes by executing a program stored in the memory 72.

[0245] In the shipping support device 1, the color image acquired by the color camera 32 of the upper shooting unit 31, the depth image acquired by the depth camera 33 of the upper shooting unit 31, and the color image acquired by the color camera 36 of the side shooting unit 35 are transmitted from the communication unit 61 to the server device 2. Also, in the shipping support device 1, the information transmitted from the communication unit 71 of the server device 2 is received by the communication unit 61, and based on that information, the processor 63 controls the front display 41 and the hand-held display 42 to display a required screen, controls the reader 43 to read a two-dimensional code, and controls the printer 44 to print a waybill.

[0246] By the way, regarding the management of the user when providing the shipping support service to the user, information related to the shipping of the luggage is input in the shipping application of the smartphone 3, the shipping two-dimensional code displayed in the shipping application of the smartphone 3 is read, and the settlement two-dimensional code is read in the settlement application of the smartphone 3. However, the user may be identified by face authentication and the settlement process may be performed. In this case, the registered face image (feature amount) of the user may be registered in the server device 2 in advance, and face matching processing may be performed between the authenticated face image obtained from the photographed image of the user of the shipping support device 1 and the registered face image to perform the settlement process by face authentication.

[0247] As described above, embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments with changes, replacements, additions, omissions, etc. Further, it is also possible to combine the respective components described in the above embodiments to form a new embodiment.

Industrial Applicability

[0248] The shipping support device and shipping support system according to the present invention have the effect of saving space in the device and enabling the user to efficiently perform shipping procedures, and are useful as a shipping support device that supports the shipping procedures of users who deliver packages to delivery companies.

Explanation of Reference Numerals

[0249] 1 Shipping support device 2 Server device 3 Smartphone 11 Main body 12 Rack 21 Mounting table (mounting portion) 22 Mounting surface 23 Side wall surface 31 Upper shooting unit (detection unit) 32 Color camera 33 Depth camera 35 Side shooting unit (detection unit) 36 Color camera 39 Reference marker 41 Front display (display unit) 42 Handheld display (display unit, operation unit) 43 Reader 44 Printer (printing unit) 51 Mail slot 52 Storage unit 53 Door 54 Handle 55 Lock 61 Communication unit 62 Memory 63 Processor 71 Communication unit 72 Memory 73 Processor

Claims

1. A shipping support device for assisting the shipping procedure of a user who delivers a package to a shipping carrier, comprising: a placement section where the user places the package; one or more cameras that photograph the package placed on the placement section and output image information capable of specifying the three-dimensional position of the package; a storage section that stores packages of a specified size category mailed by the user; an operation section for performing an operation to send the package placed by the user on the placement section by mailing; a display section for presenting notification information to the user regarding whether the package placed on the placement section can be mailed; an information processing device that acquires the image information based on the operation of the user by the operation section, performs a size measurement process to obtain three-dimensional size information of the package placed on the placement section from the image information, determines whether the package can be mailed based on whether the three-dimensional size information of the package corresponds to the standard value of the size category, and controls the presentation of the notification information to the display section; The shipping support device, wherein the operation section and the display section are respectively arranged in front of and behind the placement section.

2. The shipping support device according to claim 1, wherein the operation section, the display section, the placement section, the camera, and the storage section are integrally provided in the same housing.

3. The shipping support device according to claim 1, further comprising a printing section that prints a shipping bill for the package determined to be mailable by the information processing device.

4. The shipping support device according to claim 1, wherein the storage section is provided with a mailing opening adapted to the size of the package that can be mailed.

5. Furthermore, the storage section is provided with a lid that covers the mailing opening and a locking mechanism that restricts the opening and closing operation of the lid to prevent the mailing of the package. The information processing device controls the locked state of the locking mechanism. The shipping support device according to claim 4.

6. The information processing device temporarily releases the locked state of the locking mechanism based on a determination that mailing of the package is permitted. The shipping support device according to claim 5.

7. Furthermore, it includes a printing section that prints a shipping bill for the package determined to be mailable by the information processing device. The information processing device temporarily releases the locked state of the locking mechanism when the printing of the shipping bill by the printing section is completed. The shipping support device according to claim 5.

8. Furthermore, the storage section is provided with a sensor for detecting the mailing of the package. The information processing apparatus The shipping support device according to claim 5, wherein the lock mechanism is returned to a locked state based on the detection result of the sensor.

Images