Method and system for controlling a shipment

Abstract

Method for controlling a shipment, comprising: arranging a box (10), including: a main body (20), having an inner space (30); a visual detection tool (110) mounted to said main body (20) and configured to capture images portraying one or more objects contained in said inner space (30). The method further comprises performing at least one of a first control operation and a second control operation. The first control operation comprises: while the main body (20) is at least partly open and before shipping of the box (10) is started, capturing first images by said visual detection tool (110); making a first comparison between said first images and first reference data, the first reference data being representative of features expected for the one or more objects (X) contained in the inner space (30); generating a first notification signal (NS1) based on said first comparison. The second control operation comprises: during shipment of the box (10), capturing second images by said visual detection tool (110); making a second comparison between said second images and second reference data, the second reference data being representative of safe conditions of the one or more objects (X) contained in the inner space (30); generating a second notification signal based (NS2) on said second comparison. Also discloses is a system (1) for controlling a shipment.

Description

[0001] “METHOD AND SYSTEM FOR CONTROLLI NG A SHI PMENT”

[0002] DESCRI PTI ON

[0003] Background of the invention

[0004] Field of the invention

[0005] The present invention refers to a method for controlling a shipment.

[0006] The present invention also refers to a system for controlling a shipment.

[0007] Description of the related art

[0008] As known, for an online com merce company, shipping involves three macro-phases: shipment com position, shipping, and delivery.

[0009] For shipment com position, warehouse operators must collect the items of interest and compose the shipment (typically, a box) with them . This process, if carried out manually, with only the support of a warehouse com puter and related inventory, could be time-consum ing and error-prone on the part of the operator, especially if he / she is tired or distracted.

[0010] The shipping phase involves transporting the package to its destination (private home or public / private locker) . At this stage, traditional systems provide only general information to the customer such as departure time and estimated time of arrival.

[0011] Regarding the delivery phase, the systems used so far involve capturing a delivery signature, which, in some circumstances, is an operation that can slow down the overall process, including subsequent shipments.

[0012] Document US 2020 / 0051015 A1 discloses a shipping package tracking or monitoring system and method.

[0013] Document WO 2021 / 209952 A1 discloses a safe delivery container, and system and method thereof.

[0014] Document US 10,546,204 B1 discloses an item information discovery with a wearable device.

[0015] Document US 2015 / 001292 A1 discloses a device, system and method for tracking and recording shipment of goods.

[0016] I n view of the above, the Applicant has felt the need to provide a technique that could help and support operators and end-users in the field of e-com merce and specifically for the control of the shipment in the various stages of its development.

[0017] Accordingly, it is one object of the present invention to provide a method and a system capable of counting and identifying the items that have to be included in the shipment, thereby greatly reducing the risk of accidental errors.

[0018] It is a further object of the present invention to provide a method and a system that allow the operator to check the status of the shipment and the contents of the package at any time and in a non-invasive way.

[0019] It is a further object of the present invention to provide a method and a system that allow precise and accurate tracking of the shipment and of the conditions of the shipped items, thereby closely controlling the quality of transportation and preservation of the items' features.

[0020] It is a further object of the present invention to provide a method and a system that allow to identify any tampering with the shipment during transport and recognize any damage caused to the shipped items.

[0021] Sum mary of the invention

[0022] A first aspect of the present invention refers to a method for controlling a shipment.

[0023] I n an em bodiment of the present invention, the method com prises arranging a box.

[0024] I n an em bodiment of the present invention, the box includes a main body, having an inner space.

[0025] I n an embodiment of the present invention, the box includes a visual detection tool.

[0026] I n an em bodiment of the present invention, the visual detection tool is mounted to said main body. I n an em bodiment of the present invention, the visual detection tool is configured to capture images portraying one or more objects contained in said inner space.

[0027] I n an em bodiment of the present invention, the method com prises perform ing at least one of a first control operation and a second control operation.

[0028] I n an em bodiment of the present invention, the first control operation com prises capturing first images by said visual detection tool.

[0029] I n an em bodiment of the present invention, the first images are captured while the main body is at least partly open and before shipping of the box is started.

[0030] I n an em bodiment of the present invention, the first control operation com prises making a first comparison between said first images and first reference data.

[0031] I n an embodiment of the present invention, the first reference data are representative of features expected for one or more objects contained in the inner space.

[0032] I n an em bodiment of the present invention, the first control operation com prises generating a first notification signal based on said first com parison.

[0033] I n an em bodiment of the present invention, the second control operation comprises capturing second images by said visual detection tool.

[0034] I n an em bodiment of the present invention, the second images are captured during the shipment of the box.

[0035] I n an em bodiment of the present invention, the second control operation com prises making a second comparison between said second images and second reference data.

[0036] I n an embodiment of the present invention, the second reference data are representative of safe conditions of the one or more objects contained in the inner space. I n an em bodiment of the present invention, the second control operation com prises generating a second notification signal based on said second com parison.

[0037] A second aspect of the present invention refers to a system for controlling a shipment.

[0038] I n an em bodiment of the present invention, the system com prises a box.

[0039] I n an em bodiment of the present invention, the box includes a main body.

[0040] I n an em bodiment of the present invention, the main body has an inner space.

[0041] I n an embodiment of the present invention, the box includes a visual detection tool.

[0042] I n an em bodiment of the present invention, the visual detection tool is mounted to said main body.

[0043] I n an em bodiment of the present invention, the visual detection tool is configured to capture images portraying one or more objects contained in said inner space.

[0044] I n an em bodiment of the present invention, the system com prises a control unit.

[0045] I n an em bodiment of the present invention, the control unit is configured to perform at least one of a first control operation and a second control operation.

[0046] I n an embodiment of the present invention, in the first control operation, the control unit is configured to receive first images, captured by said visual detection tool.

[0047] I n an em bodiment of the present invention, the first images are captured while the main body is at least partly open and before shipping of the box is started.

[0048] I n an embodiment of the present invention, in the first control operation, the control unit is configured to make a first com parison between said first images and first reference data.

[0049] I n an embodiment of the present invention, the first reference data are representative of features expected for the one or more objects contained in the inner space.

[0050] I n an embodiment of the present invention, in the first control operation, the control unit is configured to generate a first notification signal based on said first comparison.

[0051] I n an em bodiment of the present invention, in the second control operation, the control unit is configured to receive second images captured by said visual detection tool.

[0052] I n an em bodiment of the present invention, the second images are captured during the shipment of the box.

[0053] I n an em bodiment of the present invention, in the second control operation, the control unit is configured to make a second comparison between said second images and second reference data.

[0054] I n an embodiment of the present invention, the second reference data are representative of safe conditions of the one or more objects contained in the inner space.

[0055] I n an em bodiment of the present invention, in the second control operation, the control unit is configured to generate a second notification signal based on said second com parison.

[0056] I n one or more of the above aspects, the present invention can include one or more of the following preferred features.

[0057] I n an em bodiment of the present invention, the method com prises perform ing both the first and the second control operation.

[0058] I n an embodiment of the present invention, the box further com prises at least one sensor.

[0059] I n an em bodiment of the present invention, the at least one sensor is mounted to the main body. I n an em bodiment of the present invention, the at least one sensor is configured for detecting one or more parameters representative of the shipment conditions of the box.

[0060] I n an em bodiment of the present invention, the method com prises detecting by said at least one sensor said one or more parameters during the shipment of the box.

[0061] I n an em bodiment of the present invention, the method com prises activating the visual detection tool based the one or more parameters detected by the at least one sensor.

[0062] I n an em bodiment of the present invention, the one or more parameters are representative of one or more of the following events undergone by the box and / or the object(s) contained therein: shake, bum p, fall, opening, unsuitable environmental condition, tam pering.

[0063] I n an em bodiment of the present invention, the method com prises identifying, based on the one or more parameters, a condition change associated with the shipment.

[0064] I n an em bodiment of the present invention, the method com prises storing the condition change in a distributed ledger.

[0065] I n an em bodiment of the present invention, the method com prises tracking a position of the box during shipment.

[0066] I n an em bodiment of the present invention, the method com prises identifying a position change based on the box position.

[0067] I n an em bodiment of the present invention, the method com prises storing the position change in a distributed ledger.

[0068] I n an em bodiment of the present invention, the method com prises providing the first or second images to a user interface.

[0069] I n an em bodiment of the present invention, the method com prises showing, by means of said user interface, the first or second images using an augmented reality technique.

[0070] I n an embodiment of the present invention, the second reference data are defined based on the first images captured by the visual detection tool.

[0071] I n an em bodiment of the present invention, the control unit is configured to perform both the first and the second control operation.

[0072] I n an em bodiment of the present invention, the control unit is configured to receive from said at least one sensor said one or more parameters detected during shipment of the box.

[0073] I n an em bodiment of the present invention, the control unit is configured to activate the visual detection tool based the one or more parameters detected by the at least one sensor.

[0074] I n an em bodiment of the present invention, the control unit is configured to identify, based on the one or more parameters, a condition change associated with the shipment.

[0075] I n an em bodiment of the present invention, the control unit is configured to store the condition change in a distributed ledger.

[0076] I n an em bodiment of the present invention, the control unit is configured to track a position of the box during shipment.

[0077] I n an em bodiment of the present invention, the control unit is configured to identify a position change based on the box position.

[0078] I n an em bodiment of the present invention, the control unit is configured to store the position change in a distributed ledger.

[0079] I n an em bodiment of the present invention, the system com prises a user interface.

[0080] I n an em bodiment of the present invention, the user interface is configured to receive the first or second images.

[0081] I n an em bodiment of the present invention, the user interface is configured to show the first or second images using an augmented reality technique.

[0082] Brief description of the drawings

[0083] Further features and advantages will appear more clearly from the detailed description of preferred and non-exclusive embodiments of the invention. This description is provided hereinafter with reference to the accom panying illustrative and non-limiting figures, in which:

[0084] - Figure 1 schematically shows a system according to the invention;

[0085] - Figure 2 schematically shows, in terms of its functional blocks, a component of the system of figure 1 ;

[0086] - Figure 3 schematically shows a feature of the system of figure 1 .

[0087] Description of em bodiments of the present invention

[0088] According to the present invention, a technique for controlling shipments is disclosed hereinafter.

[0089] A system for performing such a technique is denoted at 1 in the attached figures.

[0090] System 1 (figure 1 ) com prises a box 10.

[0091] The box 10 has a main body 20; the main body 20 can be made, for exam ple, of plastic, cardboard, metal, or any suitable material.

[0092] The main body 20 has an inner space 30, in which objects can be housed.

[0093] Preferably, the main body 20 is box-shaped and is defined by six walls: a rectangular or square bottom wall 21 , four side walls 22-25, and a top wall 26.

[0094] Preferably, the top wall 26 is drivable between an open condition, in which it allows access to the inner space 30, and a closed condition, in which the main body 20 is closed and access to the inner space 30 is prevented.

[0095] I n a preferred embodiment, the top wall 26 com prises a first part 26a and a second part 26b. When the two parts 26a, 26b are juxtaposed with each other, the top wall 26 is in the closed condition. When the two parts 26a, 26b are spaced apart from each other, the top wall is in the open condition.

[0096] Preferably, the first part 26a and the second part 26b have different dimensions, i.e., the first part 26a covers a larger portion of the top opening of the main body 20 than the second part 26b. I n particular, the first part 26a can occupy 60% to 80% of the top opening, and the second part 26b can occupy 20% to 40% of the top opening. When the top wall 26 is in the closed condition, the first part 26a and the second part 26b together occupy 100% of the top opening of the main body 20.

[0097] Preferably, the top wall 26 further comprises reinforcing flaps 26c- 26d.

[0098] System 1 comprises a visual detection tool 1 10 (figure 2) .

[0099] The visual detection tool 1 10 is preferably part of a control apparatus 100.

[0100] The control apparatus 100, and thus the visual detection tool 1 10, is mounted to the main body 20; preferably, control apparatus 100 is mounted on the second part 26b of the top wall 26.

[0101] The visual detection tool 1 10 is arranged so as to frame at least partly the inner space 30, in order to frame objects housed therein. I n other words, the visual detection tool 1 10 is configured to capture images portraying objects X contained in the inner space 30.

[0102] Preferably, the visual detection tool 1 10 com prises an RGB camera 1 1 1 ; optionally, the visual detection tool 1 10 can also com prise an infrared camera 1 12 and / or a Time of Flight, ToF, sensor 1 13. Thus, the visual detection tool 1 10 is preferably configured to capture images even if there is little or no light in the inner space 30 and / or to estimate the depth of the objects contained in the inner space 30. I n this latter way, it is possible generating 3D images starting from 2D images captured by the RGB camera 1 1 1 / I R camera 1 12.

[0103] I n an embodiment, the main body 20 has an aperture 22a (figure 1 ). The aperture 22a allows extraction of the control apparatus 100 after the box 10 has been delivered. Preferably, the aperture 22a is formed on the side wall 22, which is the side wall from which the second part 26b of the top wall 26 extends. I n an em bodiment, the main body 20 is not provided with the aperture 22a, and the box 10 will be given back after the delivery of the goods (objects X) contained therein is completed.

[0104] The control apparatus 100, in addition to the visual detection tool 1 10, com prises a control unit 130.

[0105] The control unit 130 is configured to perform control operations, which will be disclosed in the following.

[0106] Preferably, the control apparatus 100 comprises one or more sensors 120. The sensors 120 can comprise one or more of: a 3D gyroscope, a 3D accelerometer, a m icrophone, a pressure sensor, a temperature sensor, a light sensor, and a humidity sensor. I n an em bodiment, at least one of the 3D gyroscope and the 3D accelerometer, and preferably both of them , are provided with a Machine Learning Core, MLC, which can process the detected data based on machine leaning algorithms without involving the control unit 130, thereby optim izing energy saving of the control apparatus 100. I n general, the at least one sensor 120 is mounted to the main body 20 and is configured for detecting one or more parameters P representative of shipment conditions of the box 10. For exam ple, the one or more parameters P are representative of one or more of the following events undergone by the box 10 and / or the object(s) X contained therein: shake, bum p, fall, opening, unsuitable environmental condition, tam pering.

[0107] Preferably, the control apparatus 100 comprises a radio module 140. The radio module 140 is configured to allow com m unication with external devices such as Wi-Fi routers, Bluetooth devices, NFC devices, etc. I n some em bodiments, the radio module 140 can be provided with a UICC / SI M card or virtual eSI M and a transceiver for mobile data connectivity. The radio module 140 can also implement NB- loT and / or LoRa connectivity, which can provide im proved network coverage in indoor environments.

[0108] Preferably, the control apparatus 100 com prises a battery 180, configured to supply the com ponents of the control apparatus 100 itself. Preferably, the control apparatus 100 comprises a diode module 150. The diode module can comprise an RGB led diode, which indicates battery 180 charge status and connection status; the RGB led diode can also illum inate the inner space 30 for image acquisition of the RGB camera 1 1 1 . I n addition or as an alternative, the diode module 150 can com prise an infrared diode, which supports image acquisition by the infrared camera 1 12.

[0109] Preferably, the control apparatus 100 can com prise a connection port, such as a USB-C port for example, which can be used for charging the battery 180 and / or to program the control unit 130.

[0110] Preferably, the control apparatus 100 can com prise a localization module 190, e.g. a GNSS (Global Navigation Satellite System) module such as a GPS module for example, which allows localization of the box 10.

[0111] Preferably, the control apparatus 100 can com prise a memory module 170, including a non-volatile memory device and / or a volatile memory device. The memory module 170 can also include a firmware configured to process the data provided by sensors 120 and to transm it the processing output to the control unit 130.

[0112] The control unit 130 is configured to perform at least one of a first control operation and a second control operation; preferably, the control unit 130 performs both the first and the second control operation.

[0113] I n the first control operation, the control unit 130 receives first images, captured by the visual detection tool 1 10 while the main body 20 is at least partly open and before shipping of the box 10 is started.

[0114] The control unit 130 then makes a first com parison between the first images and first reference data; the first reference data are representative of features expected for the one or more objects X contained in the inner space 30. I n practical terms, the first reference data can represent one or more of the type, the shape, the number, etc. of the objects X.

[0115] Finally, the control unit 130 generates a first notification signal NS1 based on the first comparison.

[0116] I n practical terms, the first control operation can be performed while the objects X to be shipped are loaded into the main body 20, i.e. in the inner space 30.

[0117] Advantageously, the first reference data are provided by the warehouse server system : such system is formed by a memory structure and a server structure which handle the overall process, and in particular the preparation and progress of shipments. When a box 10 is ready to be filled in, the warehouse server system associates such box with a determ ined shipment, and transmits to the respective control apparatus 100 the list and associated data regarding the objects to be placed in the main body 20. These will be the first reference data, used in order to verify that the objects placed in the inner space 30 are actually the expected ones.

[0118] Preferably, the control unit 130, in cooperation with the visual detection tool 1 10, counts and identifies the objects placed in the inner space 30. Advantageously, background subtraction and / or frame differential algorithms are applied in order to isolate each object that is added in the scene and properly recognize the same. Deep learning techniques can be em ployed for object recognition.

[0119] As said, the visual detection tool 1 10 can be provided with an RGB camera 1 1 1 , and the diode module can comprise an RGB led diode; the inner space 30 is illum inated with a green light and the first images are analyzed considering substantially the green channel only - as it provides a larger amount of information than the red and blue channels. Also, detection by the I R camera 1 12 (com bined with illum ination by an I R diode) can be leveraged, in order to enhance the informative content of the captured scene. Advantageously, ToF sensor 1 13 allows to determ ine the distance to the points defining the object’s surface, so as to obtain a 3D detection.

[0120] I n a nutshell, the first control operation com prises making a classification of the objects com posing the box with deep learning algorithms. Every time a new object is inserted in the box, it is isolated from the other objects with background subtraction techniques. Then, the object alone is classified. Finally, the algorithm counts the objects and classifies them to ensure that the shipment is com posed of the desired items.

[0121] I n an embodiment, the images representing each object are sent to the warehouse server system for enhancement of the dataset used for training the machine learning tools.

[0122] I n an em bodiment, system 1 can com prise additional cameras (not shown) , which are not mounted on the box 10, but are installed in the warehouse where the box 10 is prepared. Such additional cameras provide additional images, captured during the preparation of the box 10 at different angles and different fram ing with respect to the visual detection tool 1 10. The additional images are advantageously sent to the control unit 130 and / or to the warehouse control system in order to be combined with the first images and improve counting, recognition and classification of the objects placed in the inner space 30.

[0123] I n the second control operation, the control unit 130 receives second images captured, by the visual detection tool 1 10, during shipment of the box 10.

[0124] The control unit 130 then makes a second com parison between the second images and second reference data; the second reference data are representative of safe conditions of the one or more objects X contained in the inner space 30.

[0125] The second reference data can be defined based on the first images captured by the visual detection tool 1 10; in other terms, the second reference data (i.e. the data used as a reference during shipment of the box 10, when the latter may be subject to shocks, jolts, etc. and the objects X may be damaged) are obtained from the first images (i.e. the images captured by the visual detection tool 1 10 before the shipment is started, when the objects are still intact and undamaged) .

[0126] Finally, the control unit 130 generates a second notification signal NS2 based on the second com parison.

[0127] Preferably, the control unit 130 manages the visual detection tool 1 10 so as to limit power consum ption; accordingly, during shipment of the box 10, the visual detection tool 1 10 can be kept in a stand-by mode, i.e. a functional condition in which the visual detection tool 1 10 does not capture images, but is ready to receive com mands. Based on the one or more parameters provided by the at least one sensor 120, the control unit 130 can decide to wake the visual detection tool 1 10 up so as to start image capture. This may happen for exam ple, when the accelerometer and / or the gyroscope detect unexpected, particularly strong movements of the box 10, which may cause damages to the objects X.

[0128] As in the first control operation, the RGB / I R cameras, possibly com bined with the ToF sensor, are used for capturing the second images; if available, the illum ination provided by the RGB led diode and / or I R diode can be used.

[0129] I n an em bodiment, the control unit 130 is configured to perform a third control operation. The third control operation is preferably carried out when or im mediately after the box 10 has been delivered to the recipient. The third control operation is sim ilar to the first and second control operations, as the content of the box 10 is checked by means of the visual detection tool 1 10 when it is delivered to the recipient I opened by the recipient. The content of the box 10, as captured in the third control operation, is com pared with the images detected in the first and / or second control operation, so as to verify that it is consistent with the initial content of the same box 10.

[0130] I n an em bodiment, the system 1 comprises a user interface Ul (figure 3) . The user interface Lil can include, for exam ple, a tablet, a smartphone, a headset with augmented reality capability; the user interface Lil is configured to receive the first or second images and to show the first or second images using an augmented reality technique. More specifically, the user interface Ul may allow to look at the content of the box 10 without opening it, based on the captures of the visual detection tool 1 10 (i.e. the first / second images). This can be helpful both just after the box 10 is closed after preparation, and is ready for starting shipment, and during I at the end of the shipment. For exam ple, during the preparation of the box 10 (i.e. when the objects X to be shipped are progressively positioned in the inner space 30 of the main body 20), the operator bases the preparation operation on a checklist, which includes all the items to be placed in the box 10. While each object is placed in the inner space 30, the visual detection tool 1 10 captures and scans it (as said, preferably also with a ToF sensor, so as to have a 3D definition of the object) . Identification / recognition of the objects X can be enhanced by means of NFC / Bluetooth tags mounted on the same objects, QR codes printed on or associated to the objects, Physical Unclonable Function, PUF, chips mounted on or associated to the objects, etc. This type of identification / recognition is preferably performed any time an object is added into the inner space 30. I n this way, the content of the box 10 is certified before shipment is started. Furthermore, any image that is acquired by the visual detection tool 1 10 is transm itted to a storage server, associated to system 1 , in order to enlarge the image dataset used to train the machine learning tools which can be later loaded on control units. Once the main body 20 is closed, the operator can leverage the user interface Ul so as to check proper functioning of the control apparatus 100 and the content of the same main body 20. Figure 3 schematically depicts a scenario in which the objects X are housed in the main body 20, that is closed; thus, the objects X are not visible sim ply looking at the box 10. However, using the user interface Ul (represented as a tablet) and a suitable augmented reality tool, the objects can be visualized - refence X’ denotes the objects displayed in the augmented reality environment.

[0131] The Applicant observes that a virtual representation of the content of the box 10 and the shipment status can be generated, and made available in a metaverse.

[0132] I n view of the above, the box 10 is a device provided with a battery power supply and includes a set of sensors such as, for exam ple, an accelerometer, a gyroscope, a pressure sensor, a hum idity sensor, a tem perature sensor, a light sensor, a m icrophone, a ToF sensor, an RGB camera, and an I R camera.

[0133] The box 10 is also provided with processing capabilities (e.g. control unit 130) , thus data can be processed locally. Possibly dangerous events can be identified based on the data provided by the sensors; by means of the visual detection tool 1 10 the objects X contained in the main body 20 can be counted and identified / classified.

[0134] As said, by means of the user interface Ul and an augmented reality technique, the content of the box 10 can be checked even though the main body 20 is closed.

[0135] Preferably, the control unit 130 is further configured to identify, based on the one or more parameters P, a condition change associated to the shipment, and to store the condition change in a distributed ledger. I n particular, the parameters P can have values representative of events that are possibly dangerous for the objects’ safety; accordingly, any change in the parameters P that bring the same parameters P close to such values is identified as a transaction and consequently stored in a distributed ledger, such as the blockchain. Furthermore, irrespective of possible damages to the objects, changes in the position of the box 10 during the shipment and changes in the “responsibility” over the box 10 are identified as transactions and consequently stored in a distributed ledger, such as the blockchain. The tracking of the position of the box 10 can be based on the localization module 190, processing capabilities of the control unit 130 and com munication capabilities of the radio module 140.

[0136] I n an em bodiment, the box 10 can be unambiguously associated to a Non-Fungible Token, NFT.

[0137] For example, association between the box 10 and the NFT can be based on a private key generated by means of the Physical Unclonable Function, PUF, technology. Such technology can be used, more generally, to uniquely identify the box 10 in the network.

[0138] The NFT can be used, for exam ple, for certifying the ownership of the box 10 with the registered ledger; in addition or as an alternative, the NFT can be used to register changes / operations undergone by the box 10 (e.g. geographical tracking) .

[0139] I n an em bodiment, the NFT can be handled in a metaverse; in particular, the property of the NFT (i.e. property of the content of the box 10 represented by the NFT) can be transferred, in the metaverse, from a first entity to a second entity.

[0140] I n an em bodiment, the control apparatus 100 can operate as a node of the distributed ledger. As such, the control apparatus 100 is connected with the other nodes of the distributed ledger and participates in maintaining the network's security and consensus.

[0141] I n an em bodiment, the control apparatus 100, and in particular the radio module 140, is provided with a UICC / uSI M / SI M or eSI M. I n this case, storing the condition change and / or the position change can be performed by the network operator which can guarantee the source of the data and the date / time of the transaction, since the information leaves the control apparatus 100 to the moment in which such information reaches the operator’s systems. The network operator can also enhance the data with additional information based on network localization. Said additional information can be used, for exam ple, to double-check the position data provided by the GPS module, which is generally accurate and precise, but is not always available and is not difficult to be tampered with.

[0142] Preferably, the radio module 140 can be used for an M2M com munication, i.e. a com munication between the control apparatus 100 and another device / apparatus, or a cloud com m unication, based on which the control unit 130, via a suitable API , accesses cloud-stored data generated by other devices. I n the first scenario, the devices are directly connected to each other, and thus a large amount of data can be exchanged. This use case is particularly useful for the remote control of the box 10 and for real-time sharing of the relevant events detected by the control apparatus 100. I n the second scenario, the control apparatus 100 can use the data provided by the other devices so as to enhance the information available for event detection / recognition. For exam ple, when multiple boxes (each provided with a respective control apparatus) are stored in a same shipping container, the boxes can share data generated by the respective sensors so as to leverage such enlarged data pool for a more precise and accurate monitoring activity.

[0143] I n an em bodiment, the control apparatus 100 can be paired with a wearable or non-wearable local device (e.g. a smart-watch, a smartphone, a tablet, etc.) in order to extend its capabilities. The paired device can operate as an interface between the control apparatus 100 and the operator that uses the paired device. For exam ple, the paired device can allow the operator to interact with the control apparatus 100, providing the operator information concerning the status of the box 10 as detected / identified by the control apparatus 100; such information can be com municated to the operator via video, sound, text, vibration, etc. and buttons I touch screen features allow the operator to interact with the control apparatus 100. The paired device can also be used in configuration I set-up operations for the box 100, e.g. when the latter has to be associated to shipment details. I n an em bodiment, the paired device is the same device used as a user interface Ul for augmented reality capabilities. I n an embodiment, the paired device and the user interface Ul are two distinct devices.

[0144] I n an em bodiment, the control unit 130 can com m unicate with surrounding devices. The surrounding devices can be, for example, external humidity sensors, light sensors, cameras, pressure sensors, proxim ity sensors; com m unication can be direct or via cloud storage. For example, surrounding devices can be helpful for automatic delivery of the boxes: a reception automated apparatus can be opened by the control apparatus 100 based on previous knowledge of an opening PI N code. Furthermore, the control apparatus 100 can cooperate with such surrounding apparatus in order to certify the com pletion of the delivery operation based on proximity sensors and data storage in a distributed ledger.

[0145] I n an em bodiment, the control apparatus 100 can provide support in emergency situations, such as car accidents for exam ple. The data detected by the control apparatus 100 (e.g. by means of the accelerometer) can be shared with other devices, with technologies disclosed above. The other devices can be, for exam ple, other boxes and / or smartphones. The latter can properly process the data provided by the box(es) so as to accurately identify emergency situations, specifically situations in which the vehicle carrying the box(es) undergoes a sudden and intense stop / im pact. Moreover, based on a cooperation with a wearable device, it is possible monitoring health conditions of the operator wearing such device. Accordingly, information such as cardiac frequency, air quality can be shared, and possible incidents (e.g. a fall) to the operator can be identified.

[0146] Given the presence of the location module 190, the position of the box 10 can be tracked in order to update the one or more of the sender, the addressee, the entities responsible for partial tracts of the shipment, etc. in real-time. I n addition to the position, the interested subjects can receive details concerning the conditions of the shipment (data provided by the sensors 120 and / or images provided by the visual detection tool 1 10) . I n an embodiment, the system 1 can be used to monitor the shipment of artworks.

[0147] Artworks, such as paintings for example, can have a high value and can be extremely sensitive to temperature, hum idity and vibrations.

[0148] Accordingly, they have to be properly wrapped-up and packed in order to guarantee a safe shipment.

[0149] I n this context, a packing that perfectly fits the shape of the artwork can be very helpful.

[0150] For example, the artwork can be scanned with a laser device, and then a case having a com plementary shape with respect to the same artwork can be designed and manufactured.

[0151] I n this way, it is possible to m inim ize small displacements of the artwork in the box, thereby reducing the likelihood of damages.

[0152] More specifically, the case can have an external parallelepiped shape (corresponding to the inner space 30 of the box) , and an internal surface com plementarily shaped to the artwork.

[0153] During the preparation stage of the box, the case is divided into two parts: a lower part and an upper part. The lower part is laid on a horizontal surface (e.g. the floor, a table, or the base surface of the box itself) and the artwork is then housed in such lower part. The upper part is initially kept hanging over the lower part, so as to avoid damages due to the closure operation. While the upper part is still hanging, the visual detection tool 1 10 captures one or more images of the artwork, which are processed in order to identify the same artwork. Said one or more images (which correspond to the aforesaid first images) are also stored for further analysis (e.g. estimation of possible damages during the shipment) .

[0154] During the shipment, the control apparatus 100 can provide useful monitoring features.

[0155] The visual detection tool 1 10 and the sensors 120 can detect possibly dangerous vibrations and accelerations and / or unsuitable environment conditions (in terms of humidity, tem perature, etc.) .

[0156] I n an embodiment, the box 10 can be coupled with a conditioning system . The conditioning system can be arranged inside the box 10. I n addition or as an alternative, the box 10 can be arranged in a housing being part of the conditioning system . The conditioning system is provided with devices / actuators that guarantee optimal environment conditions for the shipment of the artwork. The conditioning system can be slaved to the sensors 120 and the control unit 130, so as to have a feedback control on the conditions in which the artwork is shipped.

[0157] By means of the visual detection tool 1 10 it is possible controlling the extent of possible damages following damaging events, and classifying the type of artwork.

[0158] The Applicant observes that each artwork is characterized by unique features, which differentiate the artwork from all the other artworks and which provide a unique value to the artwork.

[0159] Accordingly, it is im portant that effective anti-counterfeiting measures are put in place in order to avoid that false artworks are exchanged for the original ones.

[0160] The system according to the invention can provide a useful support in this context.

[0161] Firstly, the artwork is scanned / captured m ultiple times (in the first control operation, in the second control operation, in the third control operation) , so that is it recognized and monitored.

[0162] Secondly, it is possible directly coupling the artwork with an identification device, that is configured to: comm unicate with external devices based on proximity technologies (e.g. Bluetooth, NFC) ; identify itself in a unique and non-cloneable way, by means of a dedicated security chip (e.g. based on Physical Unclonable Functions) ; being inextricably and unremovably fixed to the artwork.

[0163] The control apparatus 100 is adapted to com municate with such devices, so as to unam biguously recognize them . As a consequence, it is possible to verify whether the artwork is the original one or is a fake.

[0164] Therefore, the system guarantees that the tracking operations carried out on the box 10 are exactly related to the artwork that have to be shipped / stocked, preventing possible mistakes or frauds in the shipment / stocking phases.

[0165] I n an em bodiment, an artwork can be associated to a Non Fungible Token (NFT), which can be handled in a private or public distributed ledger (e.g. blockchain) . I n this context, given that the control apparatus 100 can com municate with the identification device coupled to the artwork, it can directly authorize transactions concerning the NFT associated to said artwork.

[0166] The invention achieves im portant advantages.

[0167] The box preparation operations are more reliable, thanks to the visual detection tool and the connection among the warehouse, the inventory, and the boxes (control apparatus) . Errors are very likely to be avoided, and customer satisfaction is significantly increased.

[0168] Process reliability is im proved also by the use of augmented reality and the consequent possibility to check the content of each box at any stage of the shipment, even without opening the box itself.

[0169] Possible problems / damages are detected im mediately, thanks to the variety of sensors included in the control apparatus. This guarantees the quality of the delivered goods and, in case of damages, allows accurate identification of the moment / position in which the damage occurred, and thus the responsible actor at that shipment phase, and the early determ ination of the damage extent.

[0170] Possible damages / accidents can also be detected quickly and precisely, thereby reducing the negative consequences of such events.

Claims

CLAI MS1 . Method for controlling a shipment, com prising: arranging a box ( 10), including: a main body (20), having an inner space (30) ; a visual detection tool ( 1 10) mounted to said main body (20) and configured to capture images portraying one or more objects contained in said inner space (30) ; performing at least one of a first control operation and a second control operation, wherein:- the first control operation com prises: while the main body (20) is at least partly open and before shipping of the box ( 10) is started, capturing first images by said visual detection tool ( 1 10) ; making a first com parison between said first images and first reference data, the first reference data being representative of features expected for the one or more objects (X) contained in the inner space (30) ; generating a first notification signal (NS1 ) based on said first com parison;- the second control operation com prises: during shipment of the box (10) , capturing second images by said visual detection tool ( 1 10) ; making a second com parison between said second images and second reference data, the second reference data being representative of safe conditions of the one or more objects (X) contained in the inner space (30) ; generating a second notification signal based (NS2) on said second com parison.

2. Method according to claim 1 , com prising perform ing both the first and the second control operation.

3. Method according to claim 1 or 2, wherein the box ( 10) further com prises at least one sensor ( 120), mounted to the main body and configured for detecting one or more parameters ( P) representative ofshipment conditions of the box ( 10) .

4. Method according to claim 3, wherein the method further com prises: detecting by said at least one sensor (120) said one or more parameters ( P) during shipment of the box (10) ; activating the visual detection tool ( 1 10) based the one or more parameters ( P) detected by the at least one sensor (120) .

5. Method according to claim 4 wherein the one or more parameters (P) are representative of one or more of the following events undergone by the box and / or the object(s) contained therein: shake, bum p, fall, opening, unsuitable environmental condition, tam pering.

6. Method according to anyone of claims 3-5, wherein the method further comprises: based on the one or more parameters (P), identifying a condition change associated to the shipment; storing the condition change in a distributed ledger.

7. Method according to anyone of the preceding claims, wherein the method further com prises: tracking a position of the box (10) during shipment; identifying a position change based on the box position; storing the position change in a distributed ledger.

8. Method according to anyone of the preceding claims, wherein the method further com prises: providing the first or second images to a user interface (Ul) ; showing, by means of said user interface (Ul) , the first or secondimages using an augmented reality technique.

9. Method according to anyone of the preceding claims, wherein the second reference data are defined based on the first images captured by the visual detection tool ( 1 10) .

10. System for controlling a shipment, com prising: a box (10) , including: a main body (20), having an inner space (30) ; a visual detection tool (1 10) mounted to said main body (20) and configured to capture images portraying one or more objects (X) contained in said inner space (30) ; a control unit (130), configured to perform at least one of a first control operation and a second control operation, wherein: in the first control operation, the control unit ( 130) is configured to: receive first images, captured by said visual detection tool ( 1 10) while the main body (20) is at least partly open, before shipping of the box (10) is started; make a first comparison between said first images and first reference data, the first reference data being representative of features expected for the one or more objects (X) contained in the inner space (30) ; generate a first notification signal (NS1 ) based on said first com parison; in the second control operation, the control unit (130) is configured to: receive second images captured, by said visual detection tool (1 10), during shipment of the box (10) ; make a second com parison between said second images and second reference data, the second reference data being representative of safe conditions of the one or more objects (X) contained in the inner space (30) ; generate a second notification signal (NS2) based on said second com parison.1 1 . System according to claim 10, wherein the control unit ( 130) is configured to perform both the first and the second control operation.

12. System according to claim 9 or 10, wherein the box ( 10) further com prises at least one sensor ( 120) , mounted to the main body (20) and configured for detecting one or more parameters ( P) representative of shipment conditions of the box ( 10) .

13. System according to claim 12, wherein the control unit ( 130) is configured to: receive from said at least one sensor ( 120) said one or more parameters ( P) detected during shipment of the box (10) ; activate the visual detection tool ( 1 10) based the one or more parameters ( P) detected by the at least one sensor (120) .

14. System according to claim 13 wherein the one or more parameters (P) are representative of one or more of the following events undergone by the box ( 10) and / or the object(s) (X) contained therein: shake, bump, fall, opening, unsuitable environmental condition, tam pering.

15. System according to anyone of claims 9-14, wherein the control unit (130) is further configured to: identify, based on the one or more parameters ( P) , a condition change associated to the shipment; store the condition change in a distributed ledger.

16. System according to anyone of the preceding claims, wherein the control unit ( 130) is further configured to: track a position of the box ( 10) during shipment; identify a position change based on the box position; store the position change in a distributed ledger.

17. System according to anyone of the preceding claims, further com prises: a user interface (Ul) , configured to receive the first or second images and to show the first or second images using an augmented reality technique.

18. System according to anyone of claims 9- 17, wherein the second reference data are defined based on the first images captured by the visual detection tool (1 10) .

Images