Method and system for monitoring an inventory of objects in a cargo space for objects, vehicle, computer program product and computer-readable data carrier connected to beacon transmitters
The method and system adapt beacon signal thresholds to changing conditions, providing accurate and efficient object tracking in cargo spaces without complex additional sensors, addressing the limitations of existing systems.
Patent Information
- Application Number
- DE102021115220
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-11
- Publication Date
- 2024-12-19
- Estimated Expiration
- 2041-06-11
AI Technical Summary
Existing object tracking systems in cargo spaces require complex and potentially error-prone methods involving GPS, ultrasound, or numerous receivers/transmitters, and fail to adapt to changing reception scenarios.
A method and system that utilize beacon transmitting devices to send identification signals, with a monitoring device adjusting signal strength and repetition period thresholds based on current reception conditions, allowing accurate inventory tracking without additional position tracking sensors.
Ensures robust and simple object inventory management in varying scenarios by adapting threshold values to changing reception conditions, ensuring accurate identification of objects within the cargo space.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to a method and a system for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices, a vehicle equipped with such a system, as well as a computer program product and a computer-readable data carrier.
[0002] A loading space is a storage space into which objects can be loaded, i.e. which can be loaded with objects and from which objects can be unloaded. A loading space can in particular be a vehicle's loading space, for example the loading space of a commercial vehicle, a delivery van, but also a trunk or other interior of any other motor vehicle. A loading space within the meaning of the invention does not require any limitation by walls. The space above an open loading area, for example an open loading area of a commercial vehicle, is also referred to here as a loading space. A vehicle with a loading space is in particular a motor vehicle, but ships, aircraft or railway wagons, for example, can also have loading spaces whose object inventory can be monitored using the method presented.In some embodiments, a storage room or other interior space of a property or any other monitorable area of interest may also be a cargo space within the meaning of the invention.
[0003] There are a variety of monitoring options, often optimized for the specific application, in order to always maintain an up-to-date overview of the inventory of objects in a cargo space, even if these may be located at previously undetermined locations in the cargo space and / or may, for example, be unloaded and reloaded multiple times, whereby the arrangement of the objects in the cargo space may change each time. Object inventory monitoring can be useful, for example, if tradespeople want to keep an overview of whether the tools, spare parts and other work equipment provided in the company vehicle are actually on board, both before and after each use. A delivery vehicle in which goods or packages are transported to various locations is also suitable for the use of the system presented here. However, the terms “object” and “object inventory” do not only refer to tools or objects to be transported or stored.The inventory is not limited to the objects to be stored, but refers to all countable units, e.g., even people or animals, provided they carry a corresponding beacon transmitter. For example, the system presented can also be used to monitor the inventory of a livestock transporter or to determine whether all members of a tour group are on board the bus. The object inventory of the cargo space is the totality of all objects that can be monitored with the presented method and are currently located in the cargo space.
[0004] US 20 200 405 223 describes a system for the automatic and adaptive monitoring of objects, in which a transmitter transmits to a receiver via a wireless transmission channel, wherein the multipath reception signals modulated by the environment and a detected movement of a monitored object are evaluated in order to adapt the reception to the current channel state in order to optimize the tracking of the object.
[0005] US Patent No. 10,872,311 B2 describes a system for tracking objects or customers equipped with an array of radio frequency identification (RFID) transmitters in a retail store. At least one of the customer's transmitters should always be detectable by a receiving antenna.
[0006] US 10 197 661 B1 proposes a device with two operating states. In a first state, it receives beacon identification signals from beacon transmitters and determines the received signal strength. If this exceeds a threshold, the device emits signal bursts in the ultrasonic and / or infrared range in a second state to help locate the position of the beacon transmitter.
[0007] CN 110 458 256 A presents a cargo management system in which the distance of objects from a loading area is determined using ultrasonic sensors and the objects are identified by evaluating signals from attached RFID transmitters.
[0008] US 9,462,357 B2 describes an automatic object tracking system in which tools are equipped with RFID transmitters and suitable receivers are used to determine whether the tool is within the range of the receiver or whether it is outside the range of the transmitter monitoring the destination position.
[0009] US 8 970 377 B2 and US 9 640 054 B2 each show a tracking system for objects, in particular tools, from a cargo space. The objects are equipped with RFID transmitters and the cargo space has a suitable receiver, whereby when removed from the cargo space, the object is removed from the inventory list. Information as to whether the cargo space is locked, possibly combined with movement information if the cargo space is part of a vehicle, serves as a trigger to determine whether sufficiently strong signals are again being received from the cargo space for all objects. If this is not the case, the position of the missing object can be recorded and displayed using GPS, or the intended position of the missing object in the cargo space can be displayed.
[0010] WO 2017 / 197409 A1 presents a system for preventing tool loss for tradespeople. The tools are equipped with tags with Bluetooth transmitters that maintain a connection to tracking devices. The tracking devices have GPS, Bluetooth, and mobile network interfaces and are located in the delivery van and, for example, on the tradesperson. They are connected via the mobile network interface to a server that monitors the current assignment of the tags to the tracking devices.
[0011] DE 10 2019 113 227 A1 describes a method for tracking cargo during loading of a vehicle. It provides that each piece of cargo is provided with a cargo communication module, and the cargo space of a transport vehicle is equipped with at least two input communication modules and at least one vehicle communication module spaced apart from the entrance and the input communication modules, with which each cargo communication module communicates during loading to ensure that the cargo is actually located in the cargo space.
[0012] WO 2018 / 231 351 A1 presents a system that allows for a rapid check of whether cargo with RFID tags is on board a delivery van. Detection is performed using RFID detectors in the form of drive-through gates. A first step involves a preliminary detection with an enlarged scan area, which activates a second step with a more focused scan area, during which the actual confirmation is provided that a cargo with a specific tag is on board and is moving through the detector gates.
[0013] The systems and methods described above require, for example, the actual determination or tracking of the object position using additional detection systems such as GPS or ultrasound, or make requirements regarding the state of motion or position of an object, require a large number of receivers and / or transmitters, or do not provide for adaptation to different reception situations and are therefore complex and / or potentially error-prone.
[0014] The object of the present invention is to provide a possibility for monitoring an object inventory in a cargo space, which ensures an accurate determination of the object inventory in the cargo space in a simple and robust manner, even in different or time-changing scenarios.
[0015] This object is achieved according to the invention with a method for monitoring an object inventory in a cargo space for objects connected to beacon transmission devices according to claim 1, as well as with a system for monitoring an object inventory in a cargo space for objects connected to beacon transmission devices according to claim 11, a vehicle according to claim 13, a computer program product according to claim 14, and a computer-readable data carrier according to claim 15. Advantageous developments of the invention are specified in the subclaims.
[0016] According to a first aspect of the invention, a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices, wherein the beacon transmitting devices transmit beacon identification signals individually assigned to the respective objects, receiving, with a beacon receiving device, beacon identification signals from at least one monitored cargo space, determining, with a monitoring device connected to the beacon receiving device, signal strengths of received beacon identification signals and of the beacon repetition periods associated therewith, and checking, with the monitoring device, whether the received beacon identification signals identify objects in an object inventory of the cargo space,by comparing the signal strengths of the respective received beacon identification signals with the respective current signal strength thresholds assigned to them, and comparing the respective associated beacon repetition periods with the respective current repetition period thresholds assigned to them. Furthermore, the method comprises detecting, with the monitoring device, whether the cargo space is currently in a first or a second state, wherein loading operations of objects connected to beacon transmitting devices in the cargo space are permitted only in the first state, and only if the cargo space is currently in the second state,adjusting the current signal strength thresholds and the current repetition period thresholds associated with the respective received beacon identification signals depending on the respective associated currently received beacon identification signals and associated beacon repetition periods.
[0017] Loading processes include loading processes in which the cargo space is loaded with objects, and unloading processes in which objects are unloaded from the cargo space. Loading processes are only permitted in the first state of the cargo space, i.e. within the framework of the system presented, loading processes are only carried out when the cargo space is in the first state; otherwise they are not permitted. The first state is therefore an unstable state in which the number of objects in the cargo space is not fixed but can change. In a preferred embodiment, impermissible loading processes are also made impossible by structural or technical measures. An impermissible loading process, for example, in the case of an open loading area, is throwing an object onto the loading area, even if the cargo space, in this case the loading area, is in the second state.Another example of an impermissible loading process is the loading or unloading of an otherwise locked cargo space in the second state after it has been forcibly opened. The second state, however, is a stable state in which the inventory of objects in the cargo space is fixed and does not change during this state. The first and second states of the cargo space differ from one another in that the system implementing the method according to the invention classifies the cargo space as being in the first or second state based on user input or analysis of state parameters of the cargo space and / or the environment. This may include a visible change in the state of the cargo space (e.g., vehicle with cargo space moving or not, storage room door closed or not), but it does not have to.
[0018] A beacon signal is a radio signal repeatedly transmitted by a beacon transmitter at fixed intervals, i.e., fixed repetition periods. A beacon identification signal is a beacon signal in which the transmitted radio signal transmits an identification code assigned to the beacon transmitter. Beacon identification signals can be used, for example, with short-range communication systems, such as Bluetooth systems, but also with systems that use longer-range radio signals.
[0019] The monitoring device connected to the beacon receiving device evaluates the beacon identification signals received by the beacon receiving device. The respective signal strength, i.e., the reception field strength, as well as the repetition periods, i.e., the duration of the intervals at which the respective beacon identification signal is repeated, and the identification of the respective beacon transmitter and thus of the object connected to it, transmitted with the signal, are determined. The magnitude of the signal strength can be represented, for example, as an RSSI value (Received Signal Strength Indicator). The monitoring device is also configured to execute the remaining steps of the method.For this purpose, the monitoring device comprises suitable means, in particular a programmable device with at least one processor and a memory in which code portions of a computer program product are stored. When executed by the processor, these code portions enable the monitoring device to carry out steps of the method. The method can also be referred to as a computer-implemented method, since at least one method step is carried out using a computer program.
[0020] Each of the received beacon identification signals is assigned a current signal strength threshold and an associated current repetition period threshold. In one embodiment, initially, before the first adaptation step, each of the received beacon identification signals can be assigned the same starting signal strength threshold and the same starting repetition period threshold. In a further embodiment, different types of beacon transmitting devices are assigned different starting signal strength thresholds and starting repetition period thresholds.In addition, one embodiment provides that previously determined start signal strength thresholds and start repetition period thresholds for beacon identification signals are stored in a memory if the respective objects with the associated beacon transmitting devices have already belonged to the object inventory of the cargo space at earlier times.
[0021] The described method therefore includes providing an individual signal strength threshold and repetition period threshold for each beacon transmitter whose beacon identification signal is received. Instead of using static thresholds, these individual signal strength thresholds and repetition period thresholds, which are used to determine whether the respective assigned objects are in the cargo space or not, are adapted to the current reception situation precisely when the cargo space is in the second state, in which no permissible loading process can take place. This easily takes into account the fact that the respective reception situation may have changed due to previous loading processes in the first state.For example, objects could have been added to the inventory for the first time or re-added, or objects could have been removed from the inventory, and / or the relative positions of the objects in the cargo hold could have changed, so that the beacon identification signals could be modulated or attenuated differently due to altered multipath propagation. Furthermore, the signal strength of the beacon transmitter could also have deteriorated due to energy consumption. The reasons for adjusting the threshold values are irrelevant for the presented method.
[0022] A system operating according to the described method does not require any means for actual position tracking of the objects using other sensors or a multitude of signals. Instead, it simply evaluates the signal strengths of the respective beacon identification signals and their repetition periods, in principle independent of whether the objects are moving or not. Likewise, different beacon transmitters can use different repetition periods and signal strengths for their beacon identification signals.
[0023] By continuously adjusting the thresholds individually when the opportunity arises in the second state, in which the received beacon identification signals are more likely to identify objects in the cargo hold's inventory, an individually optimized decision can be made for each object as to whether the object is on board, i.e., within the cargo hold.
[0024] In one embodiment of the method, determining whether the cargo space is currently in the first or second state comprises determining the second state based on a signal received via a user input interface. The user indicates via the user input interface that a loading process has been completed and that no further loading will follow for the time being.
[0025] In one embodiment in which the cargo space is part of a vehicle, detecting whether the cargo space is currently in the first or second state comprises determining the second state by detecting that the vehicle is moving at a speed above a speed threshold. The speed threshold is greater than 0 km / h, preferably at least 5 km / h (kilometers per hour), for example 10 km / h. Particularly preferably, the speed threshold is greater than a speed of the vehicle at which maneuvering maneuvers can be performed with the vehicle. For example, the speed threshold is 30 km / h.Beacon identification signals received in the second state are very likely to belong to objects that are currently located in the vehicle's cargo area, since beacon transmitting devices outside the vehicle do not permanently remain within the range of the receiving device in the vehicle.
[0026] In a preferred embodiment, the method comprises, when the cargo space is currently in the second state, checking changes in the beacon repetition periods of the received beacon identification signals and classifying an object identified by a respective beacon identification signal as being in the object inventory only if the respective associated beacon repetition period remains constant during the current second state.If the loading space is part of a vehicle and the vehicle is moving at a speed above the speed threshold, which is selected at least high enough that the vehicle is unlikely to perform a manoeuvre only in a fixed area, only beacon repetition periods between beacon identification signals remain constant if the object connected to the associated transmitting device is in the loading space, so that the current object inventory can be determined in a particularly simple manner.
[0027] In a further embodiment of the method, if the cargo space is currently in the first state, checking whether the received beacon identification signals identify objects in the object inventory of the cargo space comprises the step of checking whether the current repetition period thresholds associated with the respective beacon repetition periods associated with the respective received beacon identification signals have been exceeded, and classifying the objects associated with the respective beacon identification signals as not being in the object inventory if the respective current repetition period thresholds are exceeded. In one embodiment, the repetition period threshold corresponds to the repetition period, i.e., the repetition interval of the beacon identification signal.In the first state, in which loading operations are permitted, it is possible to determine very quickly whether an unloading operation has just taken place. In another embodiment, the repetition period threshold depends on the repetition period, but is larger, e.g., by a fixed time value, or it corresponds to a multiple of the length of the repetition period. This increases reliability and ensures that, for example, the signal is not a short-term reception disruption.
[0028] In a further embodiment, checking whether the received beacon identification signals identify objects in the object inventory of the cargo space when the cargo space is currently in the second state comprises checking whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength thresholds assigned to them, and classifying an object identified by a respective beacon identification signal as being in the object inventory only if the respective current signal strength threshold is exceeded. In this simple, robust manner, in the second state, in which no loading operations are permitted, an individually adapted assessment is made for each object as to whether the object is in the cargo space or not.If the received signal strength is below the current signal strength threshold assigned to the corresponding beacon identification signal, the object is classified as still within reception range but not positioned within the cargo space.
[0029] In an exemplary embodiment, in order to check whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength thresholds assigned to them, moving signal strength averages are determined for the signal strengths of the respective received beacon identification signals over associated sliding windows comprising multiple beacon repetition periods. This means that instead of comparing the currently measured signal strengths with the associated thresholds, moving averages of the respective measured signal strengths are determined over the duration of multiple beacon repetition periods and compared with the thresholds.In this way, the reliability of the respective comparison result can be increased, since the decrease in signal strength of signals outside the cargo area, which in the case of a vehicle, for example, emanates from objects that have previously been unloaded and are initially located near the vehicle, is only taken into account in a weighted manner and, in addition, short-term reception difficulties can be compensated for.
[0030] In one embodiment of the method, it is provided that the adaptation of the current signal strength threshold values respectively assigned to the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises, during the second state, determining the respectively assigned current signal strength threshold values using a sliding window function as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. The sliding window function is, for example, a moving average function in which a moving average is determined over the selected sliding window. In a preferred embodiment, the sliding window function is a moving minimum function in which the moving minimum is determined over the selected sliding window, which is continuously updated as the sliding window is moved.
[0031] In a further embodiment, adjusting the current signal strength thresholds assigned to the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises determining the respective associated current signal strength thresholds during the second state using a statistical classification method as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. In an exemplary embodiment, the statistical classification method uses a discriminant function or separation function. A discriminant analysis is performed in which a score is assigned to each observation, i.e., each detected signal strength value. The score is then used to determine the group affiliation of the respective observation and the boundaries between them.Linear discriminant functions are preferably used.
[0032] In yet another embodiment, adapting the current signal strength threshold values respectively assigned to the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises determining the respectively assigned current signal strength threshold values during the second state using an online machine learning method as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. In an online machine learning method, the data becomes available sequentially, here bursts of beacon identification signals in a sequence of repetition periods, and with each newly received current beacon identification signal, prediction values for the next expected data or
[0033] Beacon identification signals updated. In a preferred embodiment, the online machine learning method comprises an online deep learning method, i.e., a deep or multi-layer learning method in which at least one artificial neural network with a plurality of layers is continuously trained based on the many sequentially incoming input signals, here the newly received current beacon identification signals, to decide whether or not the respectively received beacon identification signal belongs to an object in the cargo hold. With continued operation, optimized, increasingly precise results are achieved through continuous, increasingly precise adjustment or (re)calibration of the current signal strength thresholds and repetition period thresholds assigned to the beacon identification signals.In a preferred embodiment, the artificial neural network used is also pre-trained, preferably in a scenario suitable for the current use of the cargo space. In a preferred embodiment, the deep learning method is used with a Q-learning algorithm, i.e., a reinforcement learning method that does not require a model of the environment.
[0034] According to a second aspect of the invention, a system for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices, wherein the beacon transmitting devices transmit beacon identification signals individually assigned to the respective objects, comprises a cargo space for objects connected to beacon transmitting devices, a beacon receiving device for receiving beacon identification signals at least from the cargo space, and a monitoring device connected to the beacon receiving device, wherein the system is configured to carry out a method according to the first aspect of the invention. In the embodiments, the beacon transmitting devices can also be included in the system. In further embodiments, the objects connected to the beacon transmitting devices are also included in the system.
[0035] In an exemplary embodiment of the system, the cargo space is a portion of a vehicle, for example, a trunk, other interior space, or a loading area of a motor vehicle or a cargo space, e.g., of an aircraft, helicopter, ship, or train carriage. According to a third aspect of the invention, a vehicle comprises a system according to the second aspect of the invention.
[0036] According to a fourth aspect of the invention, a computer program product comprises code portions which, when loaded from a memory into a processor of a programmable device of a system for monitoring an object inventory in a loading space for objects connected to beacon transmitting devices, enable the system to carry out a method according to the first aspect of the invention. The code portions, i.e. the program code, of the computer program product correspond to a computer program comprising instructions with which the system is caused to carry out steps of the method. In particular, the monitoring device can comprise a programmable device, i.e. a computer, with a processor and a memory. According to a fifth aspect of the invention, a computer-readable data carrier comprises a computer program product according to the fourth aspect of the invention.A computer-readable medium can be either a computer-readable storage medium or a data storage signal. A computer-readable storage medium is a medium suitable for storing software, such as a CD-ROM, DVD, Blu-ray disc, USB flash drive, hard drive, etc. A data storage signal enables wired or wireless transmission of the code components.
[0037] Thus, the advantages and special features of the method according to the invention for monitoring an object inventory in a loading space for objects connected to beacon transmitting devices, including its embodiments, are also implemented within the framework of a system for monitoring an object inventory in a loading space for objects connected to beacon transmitting devices, as well as a vehicle with this system, a computer program product and a computer-readable data carrier.
[0038] Further advantages of the present invention will become apparent from the detailed description and the figures. The invention will also be explained in more detail below in connection with the following description of exemplary embodiments with reference to the accompanying figures. They show: Fig. 1 is a schematic representation of an example of a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to an embodiment of the invention; Fig. 2 is a schematic representation of an example of adapting current signal strength thresholds and repetition period thresholds associated with received beacon identification signals for a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to another embodiment of the invention; Fig. 3 a schematic representation of an example of an evaluation of received data for a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices according to yet another embodiment of the invention; Fig. 4 is a schematic representation of an example of updating the object inventory for a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to yet another embodiment of the invention; Fig. 5 is a schematic representation of another example of updating the object inventory for a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to yet another embodiment of the invention; and Fig. 6 is a schematic representation of an example of a vehicle having a system for monitoring an inventory of objects in a cargo space for objects connected to beacon transmitters according to yet another embodiment of the invention.
[0039] It is understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. It is understood that the features of the various exemplary embodiments described above and below may be combined with one another unless specifically stated otherwise. Therefore, the description is not to be construed in a limiting sense, and the scope of the present invention is defined by the appended claims.
[0040] In Fig. 1 shows a schematic representation of an example of a method 100 for monitoring an object inventory in a cargo space for objects connected to beacon transmission devices according to an embodiment of the invention, wherein the beacon transmission devices transmit beacon identification signals individually assigned to the respective objects. The objects in question are irrelevant if each of the objects is connected by the signals of a beacon transmission device connected to the object, for example, one that is glued on, clamped on, screwed on, built into the object, or otherwise connected to the object or carried by the object. The method 100 begins in a start state 101, initiated, for example, by a start command controlled by a user or an environmental parameter (e.g., starting the vehicle, operating a cargo door, time of day, etc.).In one embodiment, initial settings for operating parameters can be loaded, e.g., an initial state of the cargo space, a stored list of a recently acquired object inventory, data sets with recently valid or global, i.e., default initial values for signal strength thresholds, and repetition period thresholds for at least the beacon identification signals that identify objects of the recently acquired object inventory. The following steps of the method are repeated until the method is terminated.
[0041] In a next step, beacon identification signals are received 102 from at least one monitored cargo hold. In other words, a cargo hold whose object inventory is to be monitored has a beacon receiving device with which beacon identification signals can be received if the associated objects with active beacon transmitting devices are located in the cargo hold and, if applicable, within reception range in the vicinity of the cargo hold. The reception range depends on the signal transmission technology used between the transmitting and receiving devices. In a preferred embodiment, a short-range communication technology is used, the range of which is usually less than 100 meters, for example 50 meters, preferably up to 10 meters. For example, the transmitting and receiving devices can be Bluetooth transmitters and receivers.
[0042] In a next step, the respective signal strengths and the associated beacon repetition periods, i.e., the intervals at which the beacon identification signals identifying the same object are received again, are determined 103 for the beacon identification signals received by the beacon receiving device. This determination of the required information from the received signals is performed using a monitoring device connected to the beacon receiving device, which has a suitable interface and a control device, e.g., a computer or other suitably programmed programmable device.
[0043] By comparing the signal strengths of the respective received beacon identification signals with the respective current signal strength thresholds assigned to them and comparing the respective associated beacon repetition periods with the respective current repetition period thresholds, the monitoring device then checks 104 whether the received beacon identification signals identify objects in an object inventory of the cargo space.
[0044] In this case, a first step 105 of detecting, with the monitoring device, whether the cargo space is currently in a first state Z1 or a second state Z2 is provided, wherein loading operations of objects connected to beacon transmitting devices in the cargo space are only permitted in the first state Z1, but not in the second state Z2. Since in the first state Z1 the composition of the object inventory in the cargo space can change due to loading and unloading, while in the second state the object inventory remains unchanged, i.e. stable, the first state Z1 is also referred to as an unstable state and the second state Z2 as a stable state.
[0045] Only during the second state can this method, which does not require tracking of the actual, constantly updated position data of the individual objects and is therefore very simple and robust, ensure that every object located in the cargo space remains there throughout the entire time course of the second state. Since the object inventory and arrangement of the objects in the cargo space can change with each loading and unloading process in the first state Z1, signal strengths and repetition periods of received beacon identification signals recorded up to that point can be subject to changes and modulation due to changes in attenuation and shielding, reflections, superpositions and interference, so that the associated threshold values should therefore be adjusted or (re-)calibrated when these changes are defined for the objects in the cargo space, at least during the course of the state.Therefore, only if the cargo space is currently in the second state (in . Fig. 1 marked with "Z2"), an adaptation 106 of the current signal strength thresholds and the current repetition period thresholds respectively assigned to the respective received beacon identification signals is provided as a function of the respective associated currently received beacon identification signals and associated beacon repetition periods.
[0046] Detecting 105 whether the cargo space is currently in the first or second state may, for example, comprise determining the second state based on a signal received via a user input interface. If the cargo space is part of a vehicle, detecting 105 whether the cargo space is currently in the first or second state may comprise determining the second state by detecting that the vehicle is moving at a speed above a speed threshold, wherein the speed threshold is preferably selected to be high enough to conclude that the vehicle is not merely moving for maneuvering.
[0047] The step of adjusting 106 the current signal strength threshold values respectively associated with the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals may, depending on the embodiment, comprise, for example,During the second state, to determine the respectively assigned current signal strength thresholds using a sliding window function depending on a sequence of signal strength values of the respective most recently received beacon identification signals and / or during the second state, to determine the respectively assigned current signal strength thresholds using a statistical classification method depending on a sequence of signal strength values of the respective most recently received beacon identification signals or to determine these during the second state using an online machine learning method depending on a sequence of signal strength values of the respective most recently received beacon identification signals.
[0048] If the cargo space is currently in the second state, the Fig. 1, a check 107 of changes in the beacon repetition periods of the received beacon identification signals is provided. If the beacon repetition period associated with a beacon identification signal remains constant during the current second state (in Fig. 1 marked with “+”), a classification 108 of the object identified by a respective beacon identification signal can take place as being located in the object inventory of the cargo space.
[0049] In the Fig. In the embodiment of the method shown in Figure 1, it is also provided beforehand, when the cargo space is currently in the second state, that the checking 104 as to whether the received beacon identification signals identify objects in the object inventory of the cargo space includes a checking 111 as to whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength threshold values assigned to them. Only if the respective current signal strength threshold value is exceeded (in Fig. 1 marked with "+"), the object identified by the respective beacon identification signal is classified 108 as being located in the object inventory of the cargo space. The step of checking 111 whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength thresholds assigned to them can, for example, comprise determining moving signal strength averages for the signal strengths of the respective received beacon identification signals over associated sliding windows comprising several beacon repetition periods.
[0050] If the checking 107 of changes in the beacon repetition periods of the received beacon identification signals reveals that the beacon repetition period associated with a beacon identification signal does not remain constant during the current second state (in Fig. 1 marked with “-”), or if checking 111 whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength threshold values assigned to them results in the respective current signal strength threshold value not being exceeded (in Fig. 1 marked with “-”) are shown in the Fig. 1, the objects assigned to the respective beacon identification signals are classified 110 as not being in the object inventory.
[0051] If it is determined in the step of detecting 105 whether the loading space is currently in a first state Z1 or a second state Z2 that the loading space is currently in the first state (in Fig. 1 marked with "Z1"), in which the first loading operations of objects connected to beacon transmitting devices in the cargo space are permitted, the step of checking 104 whether the received beacon identification signals identify objects in the object inventory of the cargo space comprises checking 109 for exceeding the current repetition period threshold values associated with the respective received beacon identification signals. If this shows that the respective current repetition period threshold values are exceeded (in Fig. 1 marked with “+”), the objects assigned to the respective beacon identification signals are classified as not being in the object inventory 110). If this is not the case (in Fig. 1 marked with "-"), the object inventory remains unchanged at this time and a check is carried out 112 to determine whether the procedure should be terminated, for example, due to an abort signal received via a user interface. If the procedure should be terminated (in Fig. 1 marked with "+"), the procedure 113 ends. This may, for example, involve saving a list with the current object inventory and the signal strength thresholds and repetition period thresholds currently assigned to the objects in order to be used as suitable starting values when the procedure is repeated. If the procedure is not to be terminated (in Fig. 1 marked with “-”), it continues with receiving 102 beacon identification signals.
[0052] In Fig. 2 shows a schematic representation of an example of adapting current signal strength thresholds and repetition period thresholds associated with received beacon identification signals for a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to another embodiment of the invention. In the Fig. In the situation shown in Figure 2, beacon identification signals were already received at the beginning of 201 and are ready for evaluation, in Fig. 2 represented as received data ED. In the example shown, it is determined that the cargo space is in a second state Z2 202, in which no loading operations are permitted and which is therefore suitable for adapting or updating the threshold values assigned to the beacon identification signals. In the case of a vehicle, for example, it may have been checked to determine the state that the vehicle is moving at a minimum speed which excludes movement solely for the purpose of maneuvering the vehicle. In the case of a motor vehicle, this minimum speed may, for example, be over 5 km / h, e.g. 30 km / h. In the embodiment shown, the received beacon identification signals, i.e. received data ED, are now evaluated 203 and associated signal strengths and beacon repetition periods orThe associated beacon repetition frequencies are determined, and based on these current values, the current signal strength thresholds associated with the respective received beacon identification signals are adjusted 204, and the associated repetition period thresholds are adjusted 205. In . Fig. 2 ends 206 the procedure for the current received data ED or continues with the next received data.
[0053] In Fig. 3 shows a schematic representation of an example of an evaluation of received data, i.e., beacon identification signals, for a method for monitoring an object inventory in a cargo hold for objects connected to beacon transmitting devices according to yet another embodiment of the invention. The system is in a state in which no loading operations are permitted. In the embodiment shown, the beacon identification signals, i.e., received data ED, received at the beginning 301 are now evaluated 302, and associated signal strengths and beacon repetition periods or associated beacon repetition frequencies are determined. In addition, the identification, i.e., an identifier or a unique identification feature of the beacon identification signal, is detected 303 or read out, and then checked 304 to determine whether the associated signal strength and repetition period threshold values have already been adjusted, i.e.,whether the beacon identification signal has already been calibrated. If so (in . Fig. 3 marked with "+"), the next step involves comparing 305 the signal strength of the received beacon identification signal with the current signal strength threshold value assigned to it. This can be done, for example, by comparing the currently detected RSSI value with an assigned current RSSI threshold value.
[0054] If a check 306 as to whether the signal strength of the received beacon identification signal exceeds the current signal strength threshold value assigned to it, the threshold value is not exceeded (in Fig. 3 marked with "-"), the object assigned to the beacon identification signal is classified 307 as not being in the object inventory and the received data is discarded, and the method ends 308 for the current received data ED or continues with the next received data. If the check 306 shows that the threshold value has been exceeded (in Fig. 3 marked with "+"), the received beacon identification signal, ie the current received data, is classified 309 as usable for further processing in which the decision as to whether the associated object is in the object inventory is to be made on the basis of an entire sequence of received data, e.g. for determining a moving average or the like. In an alternative embodiment, the associated object can also be directly classified as being in the object inventory.
[0055] In the example shown, it is also provided that the specific data extracted from the current received data, in particular the current signal strength or the current RSSI value, are made available 310 for further processing. This can, for example, include temporarily storing the specific data together with the identification, i.e., the identifier of the object. The method section shown initially ends 311 for the current received data ED or continues with the next received data.
[0056] If the check 304 whether the associated signal strength and repetition period thresholds have already been adjusted shows that this is not the case (in Fig. 3 marked with "-"), i.e., if no calibration has yet been carried out for the beacon identification signal, the next step involves comparing 312 the signal strength of the received beacon identification signal with a general starting signal strength threshold value defined independently of the specific beacon identification signal. This can be done, for example, by comparing the currently detected RSSI value with an assigned general starting RSSI threshold value. In a preferred embodiment, this general starting signal strength threshold value or starting RSSI threshold value is set so high that subsequently ambiguous values are unlikely to lead to a classification of the object as being in the object inventory, but rather to the discarding of the received data.
[0057] If a check 313 whether the signal strength of the received beacon identification signal exceeds the general start signal strength threshold results in the general start signal strength threshold not being exceeded (in Fig. 3 marked with "-"), the object assigned to the beacon identification signal is classified 307 as not in the object inventory and the received data is discarded. If the check 313 shows that the initial signal strength threshold has been exceeded (in Fig. 3 marked with "+"), the received beacon identification signal, i.e., the current received data, is classified 309 as usable for further processing, and the specific data extracted from the current received data is made available 310 for further processing. In an alternative embodiment, the associated object can also be directly classified as being in the object inventory.
[0058] In Fig. 4 shows a schematic representation of an example of updating the object inventory for a method for monitoring an object inventory in a cargo hold for objects connected to beacon transmitting devices according to yet another embodiment of the invention. The system is in a state in which no loading operations are permitted. Specific data extracted from the current receive data ED, ie, the currently received beacon identification signal, is provided 401. In a preferred embodiment, these were evaluated as in Fig. 3 shown, determined and provided.
[0059] In a next step, a check is performed 402 to determine whether a minimum number of detections with usable extracted specific data has already occurred for the beacon identification signal, ie, whether repetitions of the beacon detection signal have already been received over a minimum number of associated repetition periods. If this is not the case (in Fig. 4 marked with "-"), the update is terminated 403 or continued with other received data. The provided specific data is not discarded, but buffered in case further detections follow. If a minimum number of detections with usable extracted specific data has already occurred for the beacon identification signal (in Fig. 4 marked with "+"), a check is made 404 to determine whether the corresponding signal strength and repetition period thresholds have already been adjusted, ie whether a calibration has already been performed for the beacon identification signal. If this is the case (in Fig. 4 marked with "+"), the next step involves determining a moving average for the signal strength of the received beacon identification signal over a sliding window, the length of which, in one embodiment, corresponds to the duration of the minimum number of associated repetition periods, and comparing 405 the mean with a current signal strength threshold associated with the respective beacon identification signal. This can be done, for example, by comparing the mean currently detected RSSI value with an associated current RSSI threshold. In one embodiment, the current threshold is adjusted or updated using a machine learning method based on the previously received beacon identification signal.If a check 406 as to whether the average signal strength of the received beacon identification signal exceeds the current signal strength threshold value assigned to it results in the threshold value not being exceeded (in . Fig. 3 marked with "-"), the update is terminated 408 or continued with other received data. If the check 406 shows that the threshold value has been exceeded (in Fig. 4 marked with “+”), the object associated with the received beacon identification signal is classified as being in the object inventory of the cargo space 407.
[0060] If the check 404 whether the associated signal strength and repetition period thresholds have already been adjusted shows that this is not the case (in Fig. 3 marked with "-"), i.e., if no calibration has yet been carried out for the beacon identification signal, the next step involves determining a moving average for the signal strength of the received beacon identification signal over a sliding window, the length of which in one embodiment corresponds to the duration of the minimum number of associated repetition periods, and comparing 409 the mean value of the signal strength of the received beacon identification signal with a general starting signal strength threshold value determined independently of the specific beacon identification signal. If a check 410 as to whether the average signal strength of the received beacon identification signal exceeds the general starting signal strength threshold value shows that the threshold value is not exceeded (in Fig. 3 marked with "-"), the update is terminated 408 or continued with other received data. If the check 410 shows that the threshold value has been exceeded (in Fig. 4 marked with “+”), the object associated with the received beacon identification signal is classified as being in the object inventory of the cargo space 407.
[0061] In Fig. Figure 5 shows a schematic representation of another example of updating the object inventory for a method for monitoring an object inventory in a cargo hold for objects connected to beacon transmission devices according to yet another embodiment of the invention. In the example shown, the cargo hold is in a state in which loading operations are permitted. Information stored for objects from the object inventory is provided 501, for example, retrieved from an object inventory list or database, regarding the time of the last update and the repetition period associated with the beacon information signal associated with the object.At specified time intervals 502, for example, every 2 seconds, or at time intervals whose duration corresponds at least to the assigned repetition period or preferably a multiple thereof, it is then determined 503 when the associated beacon identification signal was last detected. If a check 504 of an exceedance of a current repetition period threshold assigned to the respective object or the beacon repetition period of the associated beacon identification signal reveals that the associated beacon identification signal was detected again before the repetition period threshold was reached (in . Fig. 5 marked with "+"), the object continues to be classified as being in the object inventory, and the checking of the object ends 505 for the time being. The next object can be continued, or the check can be repeated, as long as the cargo space remains in a state in which loading operations are permitted, i.e., the object inventory can change. If the checking 504 of the exceeding of the assigned current repetition period threshold shows that the associated beacon identification signal was not detected again before the repetition period threshold was reached (in . Fig. 5 marked with “-”), the object is classified as no longer part of the object inventory 506.
[0062] In Fig. 6 shows a schematic representation of an example of a vehicle with a system for monitoring an object inventory in a cargo space for objects connected to beacon transmitters according to yet another embodiment of the invention. The vehicle 620 has a system 600 for monitoring an object inventory in a cargo space 601 for objects connected to beacon transmitters, wherein in the embodiment shown, the objects with their beacon transmitters are also components of the system. The objects are in Fig. 3 are shown as boxes or packages with transmitting devices attached to them. However, they can also be other objects, such as tools or personal items, that contain suitable transmitting devices or to which these are attached. Some objects 607, 608, 609 with beacon transmitting devices 610, 611, 612 are shown in the Fig. 6, the vehicle is loaded into the cargo space 601, while other objects 613, 614 with beacon transmitters 615, 616 are located outside the cargo space. The beacon transmitters 610, 611, 612, 615, 616 transmit individually assigned beacon identification signals to the respective objects 607, 608, 609, 613, 614. The vehicle 620 is depicted as a delivery van with a cargo space 601. Depending on the objects to be loaded, the cargo space can also be, for example, the trunk or the passenger compartment of a passenger vehicle.
[0063] The system 600 has a beacon receiving device 602 for receiving beacon identification signals at least from the cargo space 601. For this purpose, the receiving device 602 is arranged in the cargo space 601 itself in the embodiment shown. A monitoring device 603 is connected to the beacon receiving device 602. In the embodiment shown, this comprises a programmable device 603, which in particular has a processor 604 and a memory with a computer program product that includes code portions that, when executed by the processor 605 of the programmable device 604 of the system 600, cause the system 600 to execute a method for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices, for example the one shown in Fig.1. In this way, a robust system is available in which it is possible to easily monitor whether or not there are objects in the cargo space based solely on the detection and evaluation of the individual beacon identification signals.
[0064] It is understood that in the various embodiments of the method according to the invention, the method steps, although described in a certain ordered sequence, could in part be performed in a different order than that described here. It is further understood that certain steps could be performed simultaneously or sequentially, singly or multiple times, that other steps could be added, or that certain steps described here could be omitted. In other words, the present descriptions are provided for the purpose of illustrating particular embodiments and should not be construed as limiting the disclosed subject matter.
[0065] The term "and / or" used in the description, when used in a series of two or more elements, means that any of the listed elements may be used alone, or any combination of two or more of the listed elements may be used. For example, if a composition is described as containing components A, B, and / or C, the composition may contain A alone; B alone; C alone; A and B in combination; A and C in combination; B and C in combination; or A, B, and C in combination. List of reference symbols 100 procedures 101 Start 102 Receiving beacon identification signals from at least one monitored cargo space 103 Determining signal strengths of received beacon identification signals and beacon repetition periods 104 Check whether the received beacon identification signals identify objects in an object inventory of the cargo space 105 Determine whether the cargo space is currently in a first state or a second state 106 Adjusting the current signal strength thresholds and repetition period thresholds associated with the respective received beacon identification signals 107 Checking changes in the beacon repetition periods of the received beacon identification signals 108 Classifying an object identified by a respective beacon identification signal as being in the object inventory 109 Checking whether the current repetition period thresholds associated with the respective received beacon identification signals have been exceeded 110 Classifying the objects assigned to the respective beacon identification signals as not in the object inventory 111 Check whether the signal strengths of the respective received beacon identification signals exceed the current signal strength thresholds assigned to them 112 Check whether the procedure should be terminated 113 End 201 Beginn 202 Determine that the cargo space is in the second state 203 Evaluate received data 204 Adjusting the current signal strength thresholds associated with the received beacon identification signals 205 Adjusting the associated recurrence period thresholds 206 End 301 Beginn 302 Evaluate received data 303 Capturing the identification of the beacon identification signal 304 Check whether the associated signal strength and repetition period thresholds have already been adjusted 305 Comparing the signal strength of the received beacon identification signal with the assigned current signal strength threshold 306 Check whether the signal strength of the received beacon identification signal exceeds the assigned current signal strength threshold 307 Classifying an object identified by a beacon identification signal as not being in the object inventory 308 End 309 Classifying a beacon identification signal as suitable for further processing 310 Providing the specific data extracted from the current received data for further processing 311 End 312 Comparing the signal strength of the received beacon identification signal with a general starting signal strength threshold 313 Check whether the signal strength of the received beacon identification signal exceeds the general start signal strength threshold 401 Providing the specific data extracted from the current receive data 402 Check whether a minimum number of detections with usable extracted specific data has been made 403 Stop refreshing 404 Check whether the associated signal strength and repetition period thresholds have already been adjusted 405 Determining a moving average and comparing it with a current signal strength threshold assigned to the respective beacon identification signal 406 Check whether the average signal strength of the received beacon identification signal exceeds the assigned current signal strength threshold 407 Classifying the object associated with the received beacon identification signal as being in the cargo hold object inventory 408 Stop updating 409 Comparing the mean signal strength of the beacon identification signal with a starting signal strength threshold 410 Check whether the average signal strength of the beacon identification signal exceeds the start signal strength threshold 501 Providing information stored for objects from the object inventory 502 fixed time interval 503 Determine when the associated beacon identification signal was last detected 504 Checking whether a current repetition period threshold associated with the associated beacon identification signal has been exceeded 505 Stop checking the object 506 Classifying the object as no longer in the object inventory 600 system 601 cargo space 602 Beacon receiving device 603 Monitoring device 604 programmable device 605 processor 606 memory 607 Object 608 Object 609 Object 610 Beacon transmitter 611 Beacon transmitter 612 Beacon transmitter 613 Object 614 objects 615 Beacon transmitter 616 Beacon transmitter ED reception data Z1 first state Z2 second state
Claims
[1] Method (100) for monitoring an object inventory in a cargo space for objects connected to beacon transmitting devices, wherein the beacon transmitting devices transmit beacon identification signals individually assigned to the respective objects, comprising - receiving (102), with a beacon receiving device, beacon identification signals from at least one monitored cargo space; - determining (103), with a monitoring device connected to the beacon receiving device, signal strengths of received beacon identification signals and beacon repetition periods associated therewith; - checking (104) with the monitoring device whether the received beacon identification signals identify objects in an object inventory of the cargo space by comparing the signal strengths of the respective received beacon identification signals with the respective current signal strength thresholds assigned thereto and comparing the respective associated beacon repetition periods with the respective current repetition period thresholds assigned thereto; and - detecting (105), with the monitoring device, whether the loading space is currently in a first state (Z1) or a second state (Z2), wherein loading operations of objects connected to beacon transmitting devices in the loading space are only permitted in the first state, and only if the loading space is currently in the second state, - adjusting (106) the current signal strength thresholds and the current repetition period thresholds associated with the respective received beacon identification signals in dependence on the respective associated currently received beacon identification signals and associated beacon repetition periods. [2] The method of claim 1, wherein detecting (105) whether the cargo space is currently in the first or second state comprises determining the second state based on a signal received via a user input interface. [3] The method of claim 1 or claim 2, wherein, when the cargo space is part of a vehicle, detecting (105) whether the cargo space is currently in the first or second state comprises determining the second state by detecting travel of the vehicle at a speed above a speed threshold. [4] Method according to one of the preceding claims, comprising, when the cargo space is currently in the second state, checking (107) for changes in the beacon repetition periods of the received beacon identification signals and classifying (108) an object identified by a respective beacon identification signal as being in the object inventory only if the respective associated beacon repetition period remains constant during the current second state. [5] Method according to one of the preceding claims, wherein, if the cargo space is currently in the first state, checking (104) whether the received beacon identification signals identify objects in the object inventory of the cargo space comprises checking (109) for exceeding the current repetition period threshold values respectively associated with the beacon repetition periods associated with the respective received beacon identification signals and classifying (110) the objects associated with the respective beacon identification signals as not being in the object inventory if the respectively associated current repetition period threshold values are exceeded. [6] Method according to one of the preceding claims, wherein, if the cargo space is currently in the second state, checking (104) whether the received beacon identification signals identify objects in the object inventory of the cargo space comprises checking (111) whether the signal strengths of the respective received beacon identification signals exceed the respective current signal strength thresholds associated therewith, and classifying (108) an object identified by a respective beacon identification signal as being in the object inventory only if the respective associated current signal strength threshold is exceeded. [7] Method according to claim 6, wherein, in order to check (111) whether the signal strengths of the respective received beacon identification signals exceed the current signal strength threshold values respectively associated therewith, moving signal strength averages are determined for the signal strengths of the respective received beacon identification signals over associated sliding windows comprising a plurality of beacon repetition periods. [8] Method according to one of the preceding claims, wherein the adjusting (106) of the current signal strength threshold values respectively associated with the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises, during the second state, determining the respectively associated current signal strength threshold values using a sliding window function as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. [9] Method according to one of the preceding claims, wherein the adaptation (106) of the current signal strength threshold values respectively associated with the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises, during the second state, determining the respectively associated current signal strength threshold values using a statistical classification method as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. [10] Method according to one of the preceding claims, wherein the adaptation (106) of the current signal strength threshold values respectively assigned to the respective received beacon identification signals as a function of the respective associated currently received beacon identification signals comprises, during the second state, determining the respectively assigned current signal strength threshold values using an online machine learning method as a function of a sequence of signal strength values of the respective associated most recently received beacon identification signals. [11] System (600) for monitoring an inventory of objects in a cargo space for objects connected to beacon transmitting devices, wherein the beacon transmitting devices transmit beacon identification signals individually assigned to the respective objects, comprising - a loading space (601) for objects connected to beacon transmitters; - a beacon receiving device (602) for receiving beacon identification signals at least from the cargo space (601); and - a monitoring device (603) connected to the beacon receiving device (602), wherein the system (600) is configured to carry out a method (100) according to one of claims 1 to 10. [12] The system of claim 11, wherein the cargo space (601) is a portion of a vehicle (620). [13] Vehicle (620) comprising a system (600) according to claim 12. [14] A computer program product comprising code portions which, when executed by a processor of a programmable device (604) of a system (600) according to claim 11, cause the system (600) to perform a method (100) according to any one of claims 1 to 10. [15] A computer-readable medium comprising a computer program product according to claim 14.
Citation Information
Patent Citations
RFID-based cargo management method, electronic device and system
CN110458256A
Infrastructure enabled smart dual-mode tags
US10197661B1
Systems and methods of tracking objects in a retail store utilizing mobile RFID tag transmitter systems
US10872311B2
Method, apparatus, and system for automatic and adaptive wireless monitoring and tracking
US20200405223A1
System and method for tracking items stored in a compartment
US8970377B2
