Method for determining the dimensions of a product within a product display unit.

Abstract

1. A method for determining dimensions of a product placed within a product staging apparatus, comprising the steps of automatically ascertaining a change in a parameter representative of at least one dimension of the product, the parameter being captured by an electronic sensor, the sensor being disposed within the product staging apparatus; and automatically detecting the at least one dimension of the product based on the change in the ascertained parameter.

Description

Technical Field

[0001] The present invention relates to a method for specifying the dimensions of products in a product display device.

[0002] Furthermore, the present invention relates to a method for monitoring product inventory in a product display device.

Background Art

[0003] In the retail industry, there has long been a need to be able to utilize reliable information regarding the dimensions of products or their packaging provided for sale. These dimensions can be used in the retail industry for optimizing the use of available display surfaces and can also be used for controlling product logistics. What is important in product logistics is, for example, to recognize the appropriate timing for additional replenishment of products, and thereby operate this process efficiently. That is, if the start is too early, human resources will be wasted and constrained, so it should not be too early, or if the start is too late, there may be a shortage in the provision of the corresponding products in the store, which, on the other hand, may have a negative impact on sales volume, so it should not be too late.

[0004] Generally, product producers do not systematically provide the dimensions of products. Also, the dimensions may change over time. This is because, for example, the packaging changes.

[0005] In addition, retailers manually grasp many of the dimensions of the products to be displayed in the store and do not have the resources to build a systematic, particularly digitized database regarding this and to manage, particularly continuously manage, this database.

Summary of the Invention

Problems to be Solved by the Invention

[0006] Therefore, the present invention has set the task of providing a solution to this problem. [Means for solving the problem]

[0007] The above problem is solved by the method described in claim 1. The present invention is therefore a method for determining the dimensions of a product placed in a product display device, comprising the steps of: automatically checking a change in a parameter representing at least one dimension of the product, wherein the parameter is captured by an electronic sensor, the sensor is disposed within the product display device; and automatically detecting at least one dimension of the product based on the checked change in the parameter.

[0008] The above problem is further solved by the product inventory monitoring method described in claim 11. The object of the present invention is a product inventory monitoring method for monitoring product inventory in a product display device, wherein at least one product can be placed in the product display device, and for the product, at least one dimension representative of product inventory monitoring, in particular the depth of the product, is known in advance, in particular, identified and known according to the method of the present invention for identifying products placed in the product display device, and the method includes a step of automatically checking for changes in a parameter representative of at least one dimension of the product, wherein the parameter is captured by an electronic sensor, and the sensor is disposed in the product display device, and a step of automatically detecting changes in the number of products, wherein the change in the representative parameter is assessed by comparing it with at least one dimension representative of product inventory monitoring. [Effects of the Invention]

[0009] The means according to the present invention therefore offer the advantage that at least one dimension required for optimizing the use of available display surfaces and also required for optimized product logistics is automatically identified directly within the product display device, independently of the product manufacturer or supplier, that is, without relying on manufacturer or supplier declarations that may be outdated, incomplete, or subject to change over time, and subsequently made freely available.

[0010] The means according to the present invention makes it possible to automatically and dynamically identify at least one dimension of a product directly within the shelf, that is, automated over time. Therefore, the manual determination of product dimensions can be completely omitted. With this method, on the contrary, at the point in time when at least one dimension of a product is identified, it is not important which particular product is present in the shelf. The assignment between the actual product and the captured dimension can be performed at a later time.

[0011] The identification of dimensions is therefore far more flexible than a central digital database, which is created based on manufacturer declarations and must be manually maintained, where the correspondence between products and dimensions is stored centrally and provided via a server. The construction of such a digital database can now be carried out fully automatically based on at least one automatically identified dimension, each of which is detected directly at the location where the product is displayed in the product display device. The fully automated dimensions of the product can then be used in various forms in product inventory monitoring methods.

[0012] Other, particularly advantageous configurations and variations of the present invention can be seen from the dependent claims and the following description.

[0013] The parameters or changes in those parameters captured by the sensor (the sensor is, of course, designed to capture each parameter) are, to give an example, listed here: Changes in light incidence or signal incidence, pressure changes, Changes in signal flight time, Changes in the optical image of an object captured optically, And so on.

[0014] The product display device may be implemented as, for example, a standalone device placed within a shelf. However, the product display device may form a row of shelves, a shelf level, or an entire shelf. The product display device may also be, for example, a sales counter or a vending machine.

[0015] The product display device has at least one height, depth, and width. The height extends substantially along the acceleration of gravity. The depth corresponds to the distance between the front edge of the product display device and the rear edge of the product display device. If the product display device has a storage structure, such as a shelf base, the depth extends along this shelf base, from the front edge of the shelf base to the rear edge of the shelf base. The width extends along the front or rear edge of the product display device.

[0016] When a storage structure is used, it may be, for example, a shelf base or a display stand for products. The rear and front edges are formed by the boundaries of the storage area, and one or more objects may be stored on the storage structure within the storage area.

[0017] Furthermore, there may be other structural elements having a different function in front of the front edge or behind the rear edge of the product display device. Thus, in front of the front edge, there may be, for example, another shelf rail to which a (e.g., electronic) shelf label is attached, or a slim screen (video shelf rail) that substantially covers the shelf rail or forms the shelf rail itself.

[0018] A product may be broadly understood as any item with or without packaging. Products located within a product display device are also represented by at least these three dimensions (product height, product depth, and product width), and these product dimensions are defined in the local Cartesian coordinate system of each product, which may be distinct from the (Cartesian) coordinate system of the product display device. If a product is stored within a product display device on a storage structure tilted at an angle with respect to gravitational acceleration, for example, on the bottom of a shelf, the plane of the storage structure forms a reference plane, within which two of the product dimensions (e.g., depth and width) extend. In this example, the product height dimension extends in the direction normal to the reference plane, and the direction of this dimension is therefore biased from the direction of gravitational acceleration. When specifying product dimensions or dimensions, it should be noted that the correct coordinate system is used, that is, that sensors are accurately oriented within or relative to the product coordinate system, or that computer-aided calculations are used for fitting or correction.

[0019] Basically, products can take on various shapes and, as a result, have different dimensions. For product logistics or shelf management, the depth, height, and width of a product are generally important dimensions, and therefore, the following discussion will focus on forms that capture these dimensions. However, it should be noted that those skilled in the art may apply the ideas presented herein to capture other dimensions, such as the length of the product diagonal or product packaging diagonal, the product perimeter, or the product volume.

[0020] A sensor may have a fixed capture direction or a fixed capture area for the purpose of its capture operation. However, a sensor may be configured to have a variable capture direction or a variable capture area, and the variable capture direction or variable capture area may be mechanically, electronically, or electromechanically adjustable or changeable. This allows for the selective capture of different areas within the product display device. Preferably, the primary or central capture direction of the sensor is oriented according to the product coordinate system so that at least one dimension can be identified as easily as possible. That is, if the product is placed on a slanted shelf base tilted with respect to gravity, it is advantageous for a sensor positioned, for example, on the rear edge of the shelf base, to also have a similar tilt with respect to gravity, and as a result, the capture direction extends substantially parallel to the shelf base.

[0021] The sensor's capture area can be distinguishable depending on the sensor type and configuration, and may be linear, cylindrical, conical, or lobe-shaped, for example, and in particular, its width may be modelable or adjustable based on software. For this purpose, the sensor may be equipped with, for example, an optoelectronic capture system, which has an optical lens configuration (one or more lenses, and possibly even an autofocus function) and an adjacent sensor array, on which the lens configuration forms an image of the surroundings or the object to be captured. During capture, the spread angle is adapted to each scene to be captured by the software-based selective operation (inclusion) or deactivation (exclusion or fade-out) of the elements of the sensor array (especially the edge region).

[0022] The width of the spread angle can be changed to extend annularly or along any function as required, or can be adjusted individually in different directions, that is, independently of each other. Thus, for example, the first width of the spread angle in the plane of the storage structure or parallel to this plane can vary for each sensor and can be adapted to the size of the object to be captured individually, or to its grouping, generally to its placement or the scale of the placement. In contrast, for all sensors to be installed or at least for one group of these sensors, the second width of the spread angle in a plane extending transversely to the plane of the storage structure can be set identically. Thereby, areas of various widths within the shelf can be monitored by various sensors, and in contrast, the distance between the shelf bottoms is not included in the capture. This is because the shelf bottom is not captured by the second width set relatively small (narrow), that is, no capture error occurs.

[0023] According to another aspect, the sensor can be positioned variably in location or is fixedly arranged, and this will be described in detail below.

[0024] To capture parameters representative of detection or to confirm its change, the sensor can perform its capture from different directions, or with different orientations, and further from different locations. <�

[0025] The capture is carried out from different capture positions, and this will be described in detail below.

[0026] The sensor can be arranged in a stationary manner on the product display device, for example, behind the product, that is, on the product side of the back wall of the shelf, for example, or at the rear edge. In this fixed position, the sensor has a stationary capture area or a stationary capture direction. Therefore, it may be advantageous to use a sensor with a variable capture area or a variable capture direction that can be adjusted manually or electronically so as to be able to perform capture directed at the target. From this capture position, the depth, width and height of the product are detected.

[0027] Similarly, the sensor may be positioned at a fixed position above the product, and the capture may be performed from this position. From this capture position, the depth, width, and height are also detected.

[0028] However, the sensor may also perform the capture from below, that is, from under the product. From this capture position, at least the depth and width of the product are detected.

[0029] However, the sensor may be mounted on a sensor movable system, and the sensor movable system moves the sensor behind the product or above the product. The capture direction or capture area, that is, moves through the product display device together with the moved sensor. Since the sensor itself already moves, and its capture area, that is, moves together with the sensor, in this case, it may be advantageous to use a sensor having a fixed capture direction. Depending on the situation, a flexible variable capture area or a fixed capture area may be used. This moved, that is, location-variable capture position enables the detection of the described dimensions already mentioned in relation to the fixed capture position, but also the detection of dimensions in another area of the product display device, that is, for example, the detection of dimensions regarding individual product groups at different positions, or enables cross-sectional detection across multiple product groups.

[0030] The sensor movable system may have at least one of the formations described below, that is, a sensor movable system based on a Bowden cable, a sensor movable system based on a belt, a sensor movable system based on a gear or a rack, a sensor movable system based on a screw thread, a sensor movable system based on a magnet.

[0031] These formations may be combined. Thus, for example, a sensor movable system based on a Bowden cable or a sensor movable system based on a belt may be responsible for the horizontal movement or positioning of the sensor, while a sensor movable system based on a screw thread may be responsible for the vertical movement or positioning of the sensor.

[0032] The sensor may, however, be positioned on or in contact with the transport device. The transport device transports the product within the product display device. The sensor is transported along with it. This location-variable capture positioning is a accompanied capture position from which the sensor performs its capture relative to a reference object. At this accompanied capture position, the sensor is positioned so that it moves with the product and is oriented, so to speak, "from the front" toward the reference object, for example toward the back wall or rear edge of the storage structure or display device, to perform the capture. As the reference object, the back wall, or another suitable defining or reference structure provided on the bottom of the shelf or the rear edge of the shelf, may be used. For example, the product display device may be a shelf without a back wall, in which case the wall located behind the store building may form the reference object.

[0033] In other words, the sensor may be attached to a pressing body or pressing plate that presses or moves the product toward the front edge of the product display device, and the sensor's acquisition direction may be oriented toward the rear edge, in which case, for example, a wall present therein acts as a reference object. Alternatively, a rotatable spiral may be used, which allows the product to be moved toward the front edge of the product display device within its spiral structure (i.e., a helical body). In this configuration, the sensor may also be positioned behind the last product within the spiral, and may be attached to a pressing body or support, and acquisition can be performed toward the rear edge from each position of the sensor along the spiral. In any case, the depth of the product can be detected from this acquisition position.

[0034] Such a pressing plate may be formed, for example, to move an object toward the front edge of the storage structure under the influence of gravity. In most cases, however, it is advantageous for the product display device to have a product guide drive, which moves, for example, a pressing plate or a screw. This drive may be implemented by an electric motor element or by an elastic element, such as a spring. The elastic element is tightened, for example, when an object is placed in the storage structure, and partially relaxed after or during the removal of the object, moving the remaining object toward the front edge of the storage structure.

[0035] Multiple sensors may be used, positioned at different (stationary or location-dependent) acquisition locations and having different acquisition directions, particularly intersecting acquisition directions, so that acquisition can be performed in combination for a single product. Changes in parameters representing the dimensions of the product, acquired from these spatially distributed acquisition locations, can be combined and processed after acquisition, thereby enabling, for example, better or more accurate characterization or assessment of the confirmed changes. Differentiation of the confirmed changes in different directions (i.e., according to the acquisition direction) can also be performed, thereby deriving positional changes for the product (stationary or location-dependent) acquired by multiple sensors. In this case, it is also possible to use different types of sensors at different acquisition locations.

[0036] In other words, within the product display device, there are different positioning possibilities for confirming at least one parameter representing at least one dimension of the product, or a variation thereof, from which at least one dimension of the product, such as height, width, or depth, can be identified.

[0037] The detection of each dimension or dimension is performed by a data processing device, which may be located directly within the sensor or externally to the sensor, such as a server or a cloud-based solution, based on one or more capture results of the sensor, which are provided by the sensor and represented by the captured data, and evaluation software is executed, which evaluates the captured data with respect to one or more dimensions or dimensions of the product. The sensor may, according to a preferred configuration, be configured to perform capture periodically, particularly regularly. For this purpose, the sensor may have timer electronics. The sensor may perform capture, for example, at time intervals of a few seconds. Capture may be performed at time intervals of irregular or non-uniform lengths. Capture may be performed at random intervals within any time range, or distributed over store-local opening hours, or distributed over a day.

[0038] Sensors may transmit or output their acquired data via a wired connection. Multiple sensors on one product display device, or multiple sensors on multiple product display devices, may also transmit their acquired data via a wired connection to a separate wireless module, which is configured to further transmit the acquired data wirelessly. The wireless module, in other words, transmits the acquired data from a group of sensors on one or more different product display devices. Such a group may consist, for example, of multiple product display devices, each forming a row of shelves, or of multiple product display devices, each located within a row of shelves or each within a shelf.

[0039] In one preferred configuration, the sensor is configured to output, wirelessly, capture data representing the capture of an object or product. Particularly preferably, the sensor itself has a (built-in) wireless module. When the sensor itself is configured to detect at least one dimension, the sensor outputs the thus detected dimension for further processing, also via the wireless module.

[0040] The sensor may have various different configurations, or may have various sensor technologies or combinations of configurations. For capture from below, the sensor may be configured, for example, as a pressure-sensitive sensor mat, which has multiple pressure-sensitive elements, such as mechanical or capacitive sensing elements, distributed across the surface of the sensor mat, which close an electrical circuit or affect its characteristics when a product is placed on the sensor mat. Similarly, a sensor mat having an array of photosensitive elements may be used, in which case, when some of these photosensitive elements are shielded and thus darkened by a product contained on the array, this can be detected electronically. With these solutions, at least the dimensions, depth, and width of the product can be captured from a capture position below. All these configurations have in common that the sensor elements must be in contact with the product in order to provide reliable capture results.

[0041] For acquisition from other acquisition positions, for example, from above or behind the product, the sensor is configured in at least one of the following configurations (functional principles), namely: Time-of-Flight Sensor, or Flight Time Sensor camera, 3D camera system, Time-of-Flight-Kamera LIDAR (an abbreviation for "Light detection and ranging" or "Light imaging, detection and ranging") Having this has been shown to be particularly advantageous.

[0042] All of these configurations share the common characteristic of not requiring direct contact with the product to provide reliable capture results. In this regard, it should be emphasized that the sensors mentioned here are particularly suitable for accompanying capture positions.

[0043] The sensors may also capture additional parameters, such as weight or temperature, so that other information useful to retailers can be directly captured within the shelves.

[0044] In principle, the detection of product dimensions can be performed continuously. This may be desirable under certain circumstances, for example, when dealing with biological products that naturally grow and which essentially have individual dimensions. Under other circumstances, however, it may be desirable not to continuously specify dimensions. Therefore, in this method, it may be advantageous to perform product dimension detection only when the learning phase is activated.

[0045] When the learning phase is activated, at least one dimension of the product can be accurately detected within the learning phase, and this now defined, i.e., known dimension is then further utilized. The learning phase can be terminated again. This may be done manually or automatically, for example, by circumstances where automatically detected dimensions converge to a single value over time. The detected dimensions are stored and ready for optimization of the use of available display surfaces and for further product logistics. Thus, after the completion of the learning phase for a product, at least one value for at least one of its dimensions remains fixed until a new learning phase is started. Fixed values ​​do not need to be adapted to constantly changing data, enabling simple, uncomplicated, and clear product logistics.

[0046] The learning phase can be initiated, for example, by a signal received by a sensor, and can be terminated again, with the transmission of the signal being possible via wired or wireless means. For this purpose, a button may be provided, which transmits a signal when operated. For example, a mobile phone may transmit such a signal wirelessly via a corresponding application.

[0047] This external trigger Alternatively, the learning phase may be automatically initiated by changes in parameters that have been automatically detected. The learning phase is, in other words, internal trigger It will be initiated based on this.

[0048] Therefore, the representative parameter is Changes have been confirmed. So Then , at least one trigger Check this trigger The existence of but confirmation It will be done And, the learning phase but boot It will be done This is known to be particularly advantageous.

[0049] Such trigger This may be when at least one variable representing a representative parameter takes, falls below, or exceeds a certain value. In other words, when a parameter or its change is above or below a threshold, or when a parameter or its change is within or outside a certain expected range, trigger This can occur. trigger For example, a sensor may capture a parameter variable that suggests that a product display device or one of its compartments is empty, in order to measure, for example, a distance greater than the depth of the product display device or a storage structure provided therein, relative to a hypothetical product in the depth direction of the product display device.

[0050] This inside trigger This allows monitoring of when new products will be added to the shelves. However, it is not important whether this is the same product with the same dimensions as before, or a different product with different dimensions. This method ensures that at least one current dimension of the product is always identified and provided for optimal use of display space and for optimizing product logistics. This allows for dynamic changes to store local or shelf placement, such as to marketing events, and specifically, without any manual adjustments regarding product dimensions that would otherwise need to be considered. This is because this is provided automatically during the process of placing products on the shelves.

[0051] Such internal trigger This means that it may be based on the change of a variable representing a representative parameter within a temporal context. triggerThis may be based on the fact that at least one dimension calculated from changes in a representative parameter does not match a previously stored or previously detected dimension over any period of time as the automatic control is repeated. In other words, for example, if at least one dimension of one or more products in a product display device changes because a different product or a product with different packaging or orientation has been placed in the product display device, this is automatically recognized. This can also be used to recognize clutter on shelves, which in turn can initiate a tidying or reorganizing process in terms of product logistics.

[0052] trigger This may include cases where the observed change in a representative parameter falls outside a predetermined range.

[0053] trigger This may be based, for example, on the recognition of patterns, particularly patterns within a temporal context. trigger For example, trigger To trigger this, it may be predetermined that a trained employee shakes their hand three times at a specific frequency through the sensor's capture area, or presses the sensor three times at this specific frequency. The employee can then easily communicate to a system implementing the method according to the present invention that a product with new dimensions is placed in the product display device and that new capture of at least one dimension is desired. The sensor, in this case, is formed to identify this specific hand movement based on the resulting change in the capture result.

[0054] Furthermore, artificial intelligence (for example, embedded in the sensor) may be provided, and the artificial intelligence will make decisions based on pre-trained criteria. trigger Recognize. Here too, trigger Once confirmed, at least one new dimension is detected. The artificial intelligence is trained on itself. triggerThe conditions for the existence of may be determined. As will be discussed further below, artificial intelligence may also be provided to detect dimensions.

[0055] It has been found that having multiple formation modes is advantageous for automatically detecting at least one dimension.

[0056] Therefore, the detection of product dimensions may be performed directly from a single change in a parameter.

[0057] "Directly" here means that a change in a parameter (for example, a change in the time-of-flight signal in the case of a time-of-flight sensor) is converted into a corresponding change in path, which can be directly identified with the dimensions of the product, so that the dimensions can be estimated from a single change in a parameter. As discussed, the sensor may be a switch mat forming a sensor mat, having multiple contacts uniformly distributed across the surface of the mat, where the contacts close when an object is placed on it, and at this time it is possible to electronically check how many such contacts (in a row) have been operated. In this case, the change in a parameter corresponds to the number of contacts that are closed or opened in one direction. With knowledge of the distance between the contacts, it is possible to convert the number of operated contacts into the dimensions of the product by multiplying this distance.

[0058] Detecting product dimensions directly from a single change in a parameter is particularly advantageous because it requires only very low memory or computing power from the detection or data processing equipment. Furthermore, this can be stored within the sensor itself without issue. Moreover, this configuration allows for unambiguous tracking of the origin of the measured value. Since a single change in the number of products is substantially sufficient to obtain the measurement result, this can be easily checked and traced. For example, when an employee places a new product in a product display device, the detected dimensions can be immediately queried and checked for validity. Errors, such as those caused by a damaged sensor element, can then be immediately recognized.

[0059] According to another preferred configuration, the dimensions of the product may be determined from a plurality of changes in parameters.

[0060] To this end, multiple change processes are automated, verified, and each captured parameter change is recorded and evaluated using change data that represents the parameter changes. For this purpose, pre-programmed algorithms and statistical methods may be used, for example.

[0061] Detecting product dimensions from multiple parameter changes offers the advantage of enabling more accurate identification of at least one dimension, as well as allowing for the recognition and filtering of errors, particularly capture errors. Furthermore, a distinction can be made between parameter changes that should not be used to identify at least one dimension because, for example, their temporal and / or numerical behavior is presumed to be caused by hand movements within the shelf resulting from employee replenishment processes or customer product retrieval, and parameter changes that should be used to identify at least one dimension because, for example, the aforementioned temporal and numerical behavior suggests that the hand movement cannot be the one mentioned. Since hand dimensions (width / thickness) are well predictable, and hand speed within the shelf can also be determined and well predictable through measurement experiments, hand movements can be numerically well limited.

[0062] Such pre-programmed algorithms can be implemented using, for example, the following steps: - A step of selecting measurements that were within a certain range for a period shorter than a certain time threshold, -In some cases, the step involves selecting measurements that fall within or outside a certain range. -In some cases, the measured value is converted to a reference variable, such as the distance relative to the depth of the product display device. - A step of dividing the remaining values ​​into categories, where each category has a representative value, for example, the mean or median of the values ​​within the category. -In some cases, the step involves selecting categories formed from only a small number of values, - A step of identification, + The category with the lowest representative value, or + The two categories where the representative values ​​are closest together. Steps to identify, - A step of determining the dimensions to be specified, +Based on the representative value of the category with the lowest value, or +Based on the difference between the representative values ​​of two categories that have representative values ​​located closest together, The decision-making steps, It may include.

[0063] In this exemplary algorithm, values ​​that are almost certainly not corresponding to the product dimensions because they were captured during product handling are filtered out. Clearly, values ​​outside the expected order may also be filtered out. Furthermore, these are grouped together into sets of similar-sized measurements.

[0064] In another preferred configuration, the detection of at least one dimension may be performed by artificial intelligence that processes or assesses changes in a representative parameter.

[0065] This configuration is a dynamic shelf management system that requires little to no special handling by employees to capture new dimensions of new products within the product display equipment.

[0066] The artificial intelligence may be designed (trained) to distinguish between the hand movements mentioned and the estimated parameter changes, and the parameter changes available to identify at least one dimension. The artificial intelligence may learn the dimensions to be identified from an external source. trigger It may be formed to receive. Furthermore, the artificial intelligence may be trained to recognize that product dimensions change systematically, for example, because other products or products with different packaging dimensions are replenished on the shelves. This allows for the internal mechanism to learn new dimensions. trigger It is given

[0067] Furthermore, for example, a pre-programmed algorithm may be provided that processes captured parameters or their changes, and based on this processing, either initiates or stops the learning phase, and also detects at least one dimension of the object (product).

[0068] Furthermore, due to the arrangement of products within the display device, information on a single dimension is often sufficient to achieve optimized product logistics or optimized shelf management. Particularly advantageous in this regard is that the product dimension is the product depth measured in the direction of the depth of the product display device or storage structure, the parameter change is given by a distance change confirmed by a sensor in the direction of the depth of the product display device or storage structure, and the product depth is detected by the confirmed distance change.

[0069] In other words, for product logistics or shelf management, the depth of a product, especially when measured in the direction of the depth of the product display device or storage structure, is particularly important because, when products are positioned within a single row in the direction of the depth of the product display device or storage structure, and the available depth for product placement is known, this variable (as will be discussed below) allows us to estimate the number of products currently on display and the maximum number of products that can be placed.

[0070] Distance changes can be observed, for example, when the sensor is configured as a camera and the camera captures an image of a reference image or the size of this reference image. The reference image may be a symbol, such as a circle, or it may be, for example, the back wall of a shelf and its edges. Since the size of the image of the reference image changes depending on the interval, the distance of the sensor to the reference image can be estimated from the captured image. The reference image may be a product or its surface, or an image attached to its surface. However, it may also be a 2D code, such as a QR code or a barcode. Furthermore, distance measurement may not be realized based on the size of the image of the reference image, or not only based on the size of the image of the reference image, but also based on which part or proportion of the reference image is captured. Thus, the sensor may be installed on a pressing body, for example, as discussed, and capture the back wall of a product display device or storage structure. The back wall, however, may have a reference image of a wide area of ​​the back wall or a pattern extending over the entire back wall, in which case the reference image consists of, for example, a 2D code or an image appropriate to the product. Based on information about which parts of the reference image are captured by the camera, the distance can be calculated using computer assistance.

[0071] In one preferred configuration, the sensor used is one based on time-of-flight measurement of the sensor signal, particularly a sensor with a resolution in the cm range or sub-cm range. Verification of distance change is performed by time-of-flight measurement, specifically by verifying the change in time of flight between two time-of-flight measurements. In this case, the sensor transmits a sensor signal that strikes an object and is reflected from it, and measures the time elapsed from the transmission until this sensor signal is received again by the sensor's receiver. Based on the time it takes for the signal to travel from the transmitter to the object, particularly the product to be captured, and back to the receiver, the distance between the sensor and the object is estimated, with knowledge of the propagation speed of the sensor signal. In this preferred configuration, the transmitter and receiver (and the processing unit for determining time of flight) are integrated into the sensor, meaning the sensor consists of a single component. Alternatively, the transmitter may be placed on the product and the receiver on the product display device (and vice versa), in which case only the time it takes for the signal to travel directly from the transmitter to the receiver is measured. For this to work, however, the sensor must consist of two parts.

[0072] Furthermore, an innovative product inventory monitoring method can be used by retailers, such as supermarkets, to monitor product inventory within product display devices, wherein at least one product can be placed within the product display device, and at least one dimension representing product inventory monitoring, particularly the depth of the product, is known in advance.

[0073] These dimensions may be detected manually or semi-manually by the retailer in a variety of ways, or they may be provided by the product supplier or manufacturer and stored retrievably in a digital data bank at the retailer. Particularly preferred, however, the dimensions are specified by the methods discussed above. The product inventory monitoring method, however, includes the following method steps: a method step for automatically checking for changes in a parameter representing at least one dimension of a product, wherein the parameter is captured by an electronic sensor, and the sensor is located within a product display device; and a method step for automatically detecting changes in the number of products, wherein the change in the representative parameter is assessed by comparing it with at least one dimension representing product inventory monitoring.

[0074] The sensor used here may be distinct from the sensor in the previously discussed method, and may even be implemented by a separate second sensor. Preferably, however, it is the same sensor, and the same sensor is used in this method within this context. This sensor enables this product inventory monitoring method to perform automatic verification of changes in representative parameters, as in the previously discussed method, using the sensor technology already discussed on the one hand, and also using the means discussed in this context on the other hand.

[0075] When assessing changes in a representative parameter in comparison to at least one dimension representative of product inventory monitoring, it is crucial to verify that the changes in the representative parameter are made in a way that allows for a highly reliable estimation of increases or decreases in product quantities. In other words, changes in the representative parameter are rejected if they do not have a valid integer relationship with a known dimension. Of course, in this case, acceptable deviations may be considered. In other respects, various different formation forms or means discussed here again in relation to the automatic detection of at least one dimension can be used, up to artificial intelligence.

[0076] One major advantage of automatically detecting changes in product quantities in this way and communicating them digitally to the retailer's inventory management system is that, starting from the initial inventory for a particular product that may have to be re-determined from time to time, the actual inventory is available in real time and fully automated within the retailer's digital inventory management system.

[0077] According to another method of monitoring product inventory, the system automatically checks whether the change in the number of products falls below a threshold, and if the check result is positive, it activates an additional deployment alarm.

[0078] This means that the process of adding or replenishing each product in the inventory management system is initiated in a timely manner. The need for additional replenishment may be displayed on an electronic display board attached to the product, so that staff can be informed of this situation directly at the shelf without any other technical aids. Furthermore, when the need for additional replenishment is pending for different products simultaneously, the inventory management system can prioritize in order to efficiently allocate staff. When an additional deployment alarm is generated directly within the sensor, it can be transmitted electronically, for example, wirelessly, from the sensor to the inventory management system.

[0079] According to another method of monitoring product inventory, the system automatically checks whether the change in the number of products exceeds a threshold for product quantity change, and if the check result is positive, it activates a theft alarm.

[0080] This means makes it possible to directly recognize the possibility of theft within the product display device, and therefore, at the time of recognition, to implement measures such as directly activating a theft alarm using a sensor that can generate, for example, an audible signal as a theft alarm and / or output the theft alarm digitally, for example, wirelessly, to the product management system.

[0081] In relation to additional deployment alarms and theft alarms, it has been found to be highly advantageous to use product-specific or product group-specific thresholds during inspection. These individual thresholds are defined by the inventory management system, transmitted electronically to sensors, for example wirelessly, stored there, and ultimately used locally. For example, dairy products are generally purchased in relatively large quantities, for example, in orders of 3 to 20 units per person, while packs of razor blades are generally purchased only individually. Therefore, it may make great sense to define a threshold of 2 units for packs of razor blades, while not setting a threshold at all for dairy products, because the latter product is difficult to steal and is cheaper than razor blades.

[0082] In product management systems, it has been found to be particularly advantageous to activate or incorporate additional system components when automatically checking changes in the number of products, especially a payment system or register system that electronically transmits changes in the number of products, or an optical monitoring system that creates a digital record of product display devices where changes in the number of products have been confirmed.

[0083] This allows the payment system or register system to directly check, on the one hand, whether the recognition of changes in the number of products is proceeding correctly, specifically whether they are being broken down to the product level, and on the other hand, whether all products taken from the product display device have been supplied for payment. Thus, at the product level, theft or loss due to consumption can be directly detected within the store.

[0084] In addition, for any changes in the number of products observed, an optical monitoring system creates a corresponding record or marks it within a continuous record, and these records document the process of retrieval or deployment. This allows for the recording of the efficiency of in-store staff and checks the quality of additional deployments, resulting in improvements, particularly when additional deployment alarms are triggered. This also ensures that when theft alarms are triggered, the corresponding records or recording sequences are appropriately marked, for example, with metadata that allows for easier discovery of relevant records or filtering of such records. This metadata may also be used to indicate the likelihood of theft, and records or recording sequences are automatically marked with special colors, for example, green for no problem, yellow for potentially stolen, and red for tentatively identified as stolen. In the context of the razor blade example, the removal of three packs, for instance, would be classified as suspected theft (possibly theft) (marked in yellow), while the removal of ten packs would be judged with high confidence as likely theft (marked in red), unless the person was a retail employee. The resulting record or sequence indicating theft can be transmitted digitally to the register terminal screen, where the number of affected products is also displayed, allowing staff to determine the connection between the incident and the person identified in the record. These records or sequences, along with the corresponding product information and the confirmed number of removed products, can also be transmitted directly to the shop security officer's office or their mobile communication device (smartphone or tablet computer) to inform them about the incident.

[0085] The wireless module inside the sensor may be configured to output the captured data as raw data, or pre-processed, via, for example, a Wireless Local Area Network (WLAN / WIFI) or a mesh network configuration. Alternatively, another de facto standardized communication protocol, such as ZigBee or Bluetooth, may be used. The sensor may also be equipped with a 4G or 5G wireless module, which would allow its wireless communication to be deployed via a (public) mobile communication network and function as an IoT device (IoT here stands for Internet of Things). A separate 4G or 5G wireless device may be used as an access point for the sensor, to which the sensor is connected wirelessly or wired. Naturally, another device belonging to the infrastructure of a product management system or shelf logistics system may be used as an IoT hub for the sensor. For this purpose, for example, a camera may be used, and the shelf may be recorded, and possibly the aforementioned recording or sequence of recordings may be created. This camera has 4G or 5G mobile communication capabilities and communicates with the sensor, preferably wirelessly, using a different communication protocol.

[0086] To connect sensors wirelessly, a proprietary communication method or protocol may be used, for example, one publicly known in PCT / EP2014 / 053376, the disclosure of the time-slot communication method discussed therein, which is cited by reference. Unlike the system disclosed in PCT / EP2014 / 053376, here, however, this time-slot communication method is used for communication between a sensor access point and a group of sensors assigned to this sensor access point. This proprietary communication method enables extremely energy-efficient operation of the sensors, but at the expense of the temporal availability of the sensors for wireless communication. The sensor's wireless module, i.e., only very rarely, switches from its sleep mode to its active mode so that it is wirelessly available. Independently, the sensor can perform its acquisition operation or perform other functions. The (acquisition) data generated in the process can then be output at any time using the proprietary communication method.

[0087] Finally, to refer more broadly to general information, the electronic devices mentioned naturally contain electronics. These electronics may be constructed using discrete components, integrated electronics, or a combination of both. Microcomputers, microcontrollers, and application-specific integrated circuits (ASICs) may be used in combination with analog or digital electronic peripherals, depending on the circumstances. Wireless devices generally have an antenna configuration for transmitting and receiving wireless signals as a component of a transceiver module. Preferably, sensors are battery-powered.

[0088] These and further aspects of the present invention can be seen from the drawings discussed below.

[0089] The present invention will be described in more detail below, with reference to the attached drawings and based on the embodiments. However, the present invention is not limited to these embodiments. In this regard, the same components are denoted by the same reference numerals even in different figures. The drawings are schematic diagrams. [Brief explanation of the drawing]

[0090] [Figure 1] This is a diagram showing the controller used in the explanation. [Figure 2] This figure shows a product display device having a sensor that is fixedly positioned within the product display device. [Figure 3] This figure shows a product display device that has a sensor movable system that moves the sensor vertically. [Figure 4] This figure shows a product display device having a product information structure and a sensor movable system. [Figure 5] This figure shows a product display device that includes a product information structure and a sensor movement system that moves individual sensors horizontally and vertically. [Figure 6] This figure shows another product display device according to the present invention, which has a product information structure and a sensor movement system that moves a sensor fixedly positioned vertically horizontally. [Figure 7] This figure shows another embodiment of the sensor-movable system. [Figure 8] This figure shows another embodiment of the sensor-movable system. [Figure 9] This diagram shows a product display device having one pressing body and a single movable sensor for each product guidance structure. [Figure 10] This diagram shows a product display device having one pressing body and a sensor attached to each pressing body for each product guidance structure. [Figure 11] This figure shows a second embodiment of the sensor. [Figure 12] This figure shows a second embodiment of the sensor. [Figure 13] This figure shows the use of a sensor according to a second embodiment within a product display device. [Figure 14] This is a visualization diagram that discusses the fundamental functional form of the sensor. [Figure 15] This is a visualization diagram that discusses the fundamental functional form of the sensor. [Figure 16] This is a flowchart that visualizes the method of argumentation. [Modes for carrying out the invention]

[0091] Figure 1 shows sensor 2, which has a sensor unit 3 that transmits a signal and receives the signal reflected from an object. In this case, sensor unit 3 is a time-of-flight sensor unit 3. Sensor 2 also has a button 4 that is operated by the user to make settings or to activate functions. Button 4 is for external activation. Sensor 2 also has a screen 5 for displaying information.

[0092] Screen 5 is configured as an energy-saving e-paper display and displays sensor identification data in the form of sensor ID 6. Sensor ID 6 allows the user to identify sensor 2. For this purpose, sensor ID 6 corresponds to an identification number that is equal to, for example, the last part of the MAC address (Media-Access-Control-Address) of sensor 2, or a differently configured identification number. For this identification number, the corresponding MAC address is stored, for example, in the data bank. Identification of sensor 2 may, however, be done by other means, such as a number or a sequence of alphanumeric characters, or by a barcode or QR code (where QR stands for Quick Response).

[0093] The data bank can be accessed on the user's mobile phone via a corresponding application. The application also allows scanning of sensor 2 (specifically, screen content, a number or alphanumeric code, or a barcode or QR code) using the mobile phone's camera. In this case, sensor ID 6 is automatically recognized by image recognition, and as a result, scanning or taking a photograph is possible to query data about the sensor and for one or more corresponding products, instead of manually entering the code. In particular, this allows for real-time inventory level inquiries, that is, inquiries about whether the corresponding product assigned to sensor 2 still exists in the warehouse or on another shelf.

[0094] Sensor 2 has a wireless module (integrated into the housing and therefore invisible) for this purpose, which enables Sensor 2 to communicate wirelessly. Through the wireless module, Sensor 2 can transmit its detection data wirelessly. Depending on the mode the sensor is currently in, the detection data represents either at least one automatically detected dimension of a product or a change in the number of products, which will be discussed in detail in the flowchart of Figure 16.

[0095] As discussed in the general section of the specification, wireless communication of sensor 2 can be implemented in various forms. In the example given here, wireless communication with an access point is assumed, the access point itself is connected to a server via a wired network. Product management software is run on the server.

[0096] Sensor 2, through its sensor unit 3, detects the presence of an object within its detection area. The necessary signal data processing is performed within Sensor 2 by sensor electronics. Sensor electronics are essentially implemented by a microcontroller, on which sensor software runs. This sensor software is programmed to determine the depth of a product placed on a shelf. During this process, changes in a parameter representing the product's depth are automatically detected and captured by Sensor 2. If the sensor is moved with the product, the change in the parameter representing the product's depth is a change in the distance between the sensor and other objects, or a change in the distance between the sensor and the product, or an object moved with the product. The sensor detects this distance using its sensor unit 3, employing time-of-flight measurement of the sensor signal and knowledge of the signal propagation speed. This distance detection is performed approximately continuously or quasi-continuously over time, i.e., at discrete points in time. In this process, as discussed in the overview section regarding various different formation forms, sensor 2 monitors the intervals observed over time for changes that are effective in determining the depth. The sensor software, in other words, automatically detects the depth of the product based on the changes in the observed intervals.

[0097] As discussed in the general section of the specification, this method can be implemented for various acquisition positions. These acquisition positions represent from where the sensor 2 performs its acquisition. Figures 2 to 11 show examples of fixed (location-fixed) and location-variable acquisition positions from which the sensor can be positioned to implement the method according to the present invention, and the necessary means to enable such positioning.

[0098] Figure 2 shows a shelf 1 having fixedly positioned sensors 2a to 2f. Sensors 2a to 2f are mounted on the back wall 15 in fixed capture positions.

[0099] In front of the back wall 15, there is a pit-shaped storage structure 7, which is divided into six sections 7a to 7f. The storage structure 7, or each section 7a to 7f, has a front edge 11 and a rear edge 12. At the rear edge 12, the storage structure 7 transitions into the back wall 15.

[0100] Products 10a to 10o are located inside the storage structure 7. The rear edge 12 of the storage structure 7 is positioned above the front edge 11 in the direction of gravitational acceleration visualized by the arrow 16. The bottom of the storage structure 7 is formed smoothly so that the objects 10a to 12o stored above it can automatically slide towards the front edge 11.

[0101] Each section 7a to 7f has a product guidance structure 8a to 8f. These product guidance structures 8a to 8f guide each object 10a to 10o within a single section 7a to 7f along a single line, that is, along a single arrangement line.

[0102] The product guide structures 8a to 8f each have one front defining section 9a to 9f for each section 7a to 7f in order to prevent the objects 10a to 10o from rolling off the front edge 11. The defining sections 9a to 9f are formed low so that the objects 10a, 10c, 10f, 10i and 10k in the front row are clearly visible and can be easily removed by lifting them slightly. When one of these objects 10a, 10c, 10f, 10i and 10k in the front row is removed, the objects that remain after it slide down from behind, that is, towards the defining sections 9a to 9f.

[0103] Each of the sections 7a to 7f is assigned one sensor 2a to 2f. Each sensor 2a to 2f has a capture direction 13, which extends from each sensor 2a to 2f toward each object 10a to 10o within each section 7a to 7f. For illustrative purposes, the capture direction for sensor 2c is indicated by an arrow. The capture direction 13 of sensor 2c is directed toward the objects 10f to 10h located within section 7c, which corresponds to sensor 2c.

[0104] Surrounding the capture direction 13, a conical capture region 14 extends from each sensor 2a to 2f with a relatively small spread angle (width of small spread angle). This spread angle is small enough that the capture region 14 is confined to a single product guidance structure 8a to 8f over the distance from the rear edge to the front edge. This capture region 14 is also illustrated as an example for sensor 2c. The other sensors each have, in other words, one capture direction 13 and one capture region 14.

[0105] In this embodiment, each sensor 2a to 2f checks or monitors one group of objects 10a to 10o arranged without gaps within a single line from the defining units 9a to 9f toward the sensors 2a to 2f. Each sensor 2a to 2f can then capture or measure the spacing and, upon confirming a change in the spacing, automatically detect the depth of the product placed there. The detection data generated by the sensors 2a to 2f as a result of this detection, which represents or displays the detected product depth, can be evaluated or further processed by the sensors 2a to 2f themselves, by the product management system, or, for example, by a mobile device (not shown), as discussed in the general section of the specification.

[0106] Figure 3 shows one embodiment of shelf 1 without product guide structures 8a-8f. In this embodiment, the back wall 15 is also omitted to provide space for the sensor movable system 17. Nevertheless, a wall may extend behind the sensor movable system 17, for example, to separate the two shelf sides from each other or to structurally define shelf 1.

[0107] The sensor movable system 17 has two drive units 18, which are coupled to two rails 19. A carriage 20 is mounted on the rails 19 and is slidable along the rails 19. A sensor 2 is mounted on the carriage 20. The carriage 20 is coupled to a belt 21. The drive units 18 pull the belt 21 via at least one driven belt pulley located inside at least one of the drive units 18, thus causing the carriage 20 and sensor 2 to slide along the rear edge 12. The movement of sensor 2 is controlled by an electronic control unit (not further shown) that electronically drives the drive units 18.

[0108] The sensor movable system 17 is formed to position the sensor 2 by sliding it horizontally with respect to the gravitational acceleration indicated by the arrow 16, thereby enabling a location-variable capture position for the sensor 2.

[0109] In front of the sensor movable system 17 is a storage structure 7, which is divided into two sections 2a and 2b. The storage structure 7, or each section 7a and 7b, has a front edge 11 and a rear edge 12. The sensor movable system 17 is located beside the rear edge 12.

[0110] Products 10a to 10h are also present in storage structure 7.

[0111] In this embodiment, the rear edge 12 of the storage structure 7 is oriented in a single plane with respect to the direction of gravitational acceleration (indicated by arrow 16), together with the front edge 11. Unlike the embodiment discussed earlier, the objects 10a to 10f do not slide toward the front edge 11 in accordance with gravitational acceleration, but rather remain in their respective positions until they are manually moved.

[0112] The acquisition direction 13 of sensor 2 extends parallel to the surface of the storage structure 7 and is directed from sensor 2 toward the front edge 11. However, sensor 2 may be formed to change the acquisition direction 13, and as a result, the acquisition direction 13 does not need to be perpendicular to the direction of motion of sensor 2.

[0113] The capture region 14 also extends in a conical shape around the capture direction 13. When the sensor movable system 17 moves the sensor 2 along the rear edge 12, the sensor 2 can capture multiple regions, and by subsequently evaluating the capture results, the number of objects in each section where one product group is located can be estimated.

[0114] Here too, by monitoring the change in the distance between the sensor and each product group, which is automatically identified by the sensor, the sensor itself can detect the depth of each product. The starting point here is that this change occurs whenever, for example, a staff member adds products from the front, and the product located at the back is pushed backward towards the sensor.

[0115] To detect the depth of a product, the movable sensor system may be positioned on the side of the product rather than at the rear. According to another embodiment, two such movable sensor systems may be positioned on the aforementioned sides, i.e., one at the rear of the product and the other on the side of the product, so that capture can be performed dynamically from two different sides, i.e., from two location-variable capture positions, which facilitates, and in some cases improves, the automatic detection of dimensions.

[0116] Furthermore, as discussed in relation to Figure 2, if product guidance structures 8a to 8f are provided, the accuracy of estimating the number of objects 10a to 10h can be improved, and the detection of the depth of each product group can also be accelerated. One embodiment having a combination of product guidance structures 8a to 8f and a sensor movable system 17 is shown in Figure 4.

[0117] In front of the sensor movable system 17 is the storage structure 7. Above the rear edge 12, there is no back wall 15 as seen in Figure 2, and as a result, the sensor 2 can capture objects 10a to 10o located inside the storage structure 7 without obstruction.

[0118] The storage structure 7, the back wall 15 extending downward from the rear edge 12 of the storage structure 7, and the drive unit 18 may be fixedly connected to a support structure (not shown), such as a frame or another flat metal plate portion or wall.

[0119] Here too, the sensor 2 is oriented such that the capture direction 13 (details of the sensor 2 are not shown) is directed from the sensor 2 toward the front edge 11, and extends parallel to the plane on which each of the sections 7a to 7f extends.

[0120] The sensor movable system 17, and the control unit mentioned above, is configured to move the sensor 2 to discrete positions. These discrete positions are, in this case, the positions where the acquisition direction and the lines on which the objects 10a to 10o are positioned coincide. In this way, the acquisition by the sensor 2 is precisely focused on each section 7a to 7f, and unnecessary intermediate position acquisition can be avoided.

[0121] Figure 5 shows another embodiment of the product display device 1, in which the sensor 2 is movable not only horizontally but also vertically. This makes it possible to position the sensor in a location-variable capture position along two degrees of freedom, that is, to move it substantially planar, and in particular to move it transversely across multiple shelf levels.

[0122] In this case, shelf 1 has multiple storage structures 7 (shelf planes) arranged vertically to each other, but for the sake of clarity, only a single storage structure 7 is shown. The number of symbols has also been reduced for clarity.

[0123] Unlike in Figure 4, each of the two drive units 18 is here vertically movable and surrounds one threaded rod 22 with female threads. Each threaded rod 22 is driven by one threaded rod drive unit 23. The threaded rod drive unit 23 is fixedly coupled to a support structure, which is not shown here. The threaded rod drive unit 23 is fixed relative to the back wall 15.

[0124] The sensor movable system 17, or the threaded rod drive unit 23 of the sensor movable system 17, is controlled by an electronic control unit to move the sensor 2 not only along the rear edge 12 of the illustrated storage structure 7, but also to move the sensor 2 in a plane above or below the illustrated storage structure 7. In other words, the sensor 2 can capture not only the multiple compartments 7a to 7f of the storage structure 7, but also multiple storage structures 7, i.e., entire shelves.

[0125] According to this embodiment, it is possible to detect the depth of various products on the entire shelf 1 using only a single sensor 2.

[0126] Figure 6 shows another embodiment of a sensor-movable system 17 that captures multiple storage structures 7 arranged vertically relative to each other. For this purpose, multiple sensors 2a-2c are mounted on a single carriage 20, with each sensor 2a-2c assigned to one storage structure 7. The carriage 20 travels along the rear edge 12 of the storage structures 7 on both rails 19. The drive unit 18 is fixedly coupled to the support structure, including the back wall 15. The drive unit 18 is configured to move the carriage 20 via a belt 21. The middle sensor 2b is assigned to the illustrated storage structure 7, as is done by the horizontal location of the middle sensor 2b. The upper sensor 2a and the lower sensor 2c are assigned to other storage structures 7, which are not shown, as is done by the individual horizontal locations of the upper sensor 2a and the lower sensor 2c.

[0127] As the carriage 20 travels horizontally along the storage structure 7, each sensor captures an object 10a to 10o within its respective storage structure 7.

[0128] Figure 7 shows an extremely space-saving embodiment of the sensor movable system 17 or sensor 2. Sensor 2 is configured as a cylindrical drive wheel. Sensor unit 3 is positioned near the center of sensor 2. Sensor 2 resides on a single rail 19 and is formed to roll on this rail 19. The sensor movable system 17 further has three strips 26a, 26b, and 26c, which are formed to hold sensor 2 on the rail 19. For this purpose, the lower strip 26a and the upper strip 26c are located on the side of sensor 2 where the capture area 14 is located, while the middle strip 26b is located on the other side. In this way, the possibility of sensor 2 derailing from the rail 19 is eliminated.

[0129] Sensor 2 has six first magnetic elements 24a to 24f, and the first magnetic elements 24a to 24f are permanent magnets.

[0130] The rail 19 has a number of second magnetic elements 25a to 25f along its entire length, and the second magnetic elements 25a to 25f are electromagnets that can be individually switched on and off.

[0131] At the position shown in the figure, the two central second magnetic elements 25a and 25f are switched to attract the corresponding first magnetic elements 24a and 24f to themselves.

[0132] To move sensor 2 further to the right, that is, to rotate it clockwise, the leftmost second magnet element 25a of the two activated second magnet elements is deactivated, and the next second magnet element 25e on the right is activated, thereby pulling the corresponding first magnet element 24e downward toward the rail 19. Additionally, the previously activated second magnet element 25a may also be activated to reverse its polarity, thereby pushing the corresponding first magnet element 24a away from the rail 19.

[0133] Alternatively, the first magnetic elements 24a to 24f may be formed as ferromagnetic magnetic elements.

[0134] The first magnetic elements 24a to 24f may also be switchable electromagnets. Correspondingly, the second magnetic elements 25a to 25b may be permanent magnets or ferromagnetic magnetic elements. The rail 19 may also be manufactured from a suitable material.

[0135] Figure 8 shows another embodiment, which differs from the embodiment shown in Figure 7 in that the drive wheel has a polygonal shape. This means that the surfaces of the sensor 2, when that surface is facing downwards, the multiple surfaces on which the sensor 2 stands in a stable position, when viewed in a cross-section normal to these surfaces, substantially form a convex polygon.

[0136] This provides sensor 2 with reliable retention in the desired position, even when the electromagnet is not activated.

[0137] Furthermore, the sensor 2 can thus be positioned at predetermined, discrete locations. The divisions of the storage structure 7 are adapted to the dimensions of the sensor 2 so that each sensor 2 can be placed at a desired discrete location.

[0138] Figure 9 shows another embodiment of shelf 1, which is substantially the same as shelf 1 shown in Figure 4. Unlike in Figure 4, the product guide structures 8a to 8f here have plate-shaped pressing bodies 27, which are provided to press products 10a to 10n, which are located inside the storage structure 7 or in the pit-shaped compartments 7a to 7f of the storage structure 7, toward the front edge 11. For this purpose, each pressing body 27 is coupled to a spring element 28, which pushes each pressing body 27 away from the back wall 15 or pushes it toward the front edge 11.

[0139] Unlike in Figure 4, here, sensor 2 does not directly capture the distance between sensor 2 and products 10a to 10n, but rather directly captures the distance between sensor 2 and the pressing body 27. However, this does not make any difference in automatically detecting the depth of the product. This is because, when a single product, or multiple products from a group of products, are taken out or replenished, the pressing body can only move within a predetermined interval pattern or multiple thereof, determined by the depth of the product.

[0140] To add further, sections 7a to 7f do not necessarily need to exist separately from each other. Rather, sections 7a to 7f may be configured as a connected plane or group of components.

[0141] Figure 10 shows a similar embodiment to Figure 9, where each pressing body 27 is equipped with one sensor 2 (2a-2f), and the capture direction of each sensor 2a-2f is oriented from the pressing body toward the rear edge of the storage structure (shelf bottom). At the rear edge, the shelf bottom is terminated by a back wall 15. Here, the sensors 2 are moved relative to the back wall 15, which forms a reference, according to the number of products being taken out or added, and the depth of each product is detected from the change in the distance of the sensors 2 relative to this reference.

[0142] Figures 11 and 12 show a sensor vehicle, a self-propelled sensor 2 configured to be autonomously operated within a product display device, the sensor 2 having an electric drive unit, the four wheels 29 of the electric drive unit being visible, two of which wheels 29 are steerable to change direction.

[0143] As can be seen in Figure 11, sensor 2 has a sensor unit 3 and a screen 5 on its rear side. Furthermore, as can be seen in Figure 12, sensor 2 has a permanent magnet 30 built into the housing of sensor 2 on its ventral side. The permanent magnet 30 is schematically shown as a circle. Figure 12 also shows that a permanent magnet 30 may also be placed on the circumferential surface of wheel 29. In this case, the driving or positioning of the permanent magnet 30 is sized so that the permanent magnet 30 does not directly contact the shelf 1, but rather a gap is left between the permanent magnet 30 and the shelf 1.

[0144] Sensor 2 has a navigation sensor 31 on its side wall, the navigation sensor 31 is housed within a housing, and the sensor electronics that control the movement of Sensor 2 enable it to determine direction, recognize and bypass obstacles, recognize structures, recognize structures again at a later point, and potentially use them for navigation as it moves autonomously within the product display device.

[0145] As shown in Figure 13, the permanent magnet 30 (or the permanent magnet 30 on the wheel 29 as well) allows the sensor 2 to be held or attached to a ferromagnetic structural element (e.g., storage structure 7), for example, a shelf bottom made from a steel plate, or to a back wall 15 extending vertically from the shelf plane of shelf 1. This capability is particularly useful for allowing the sensor 2 to move autonomously upside down within shelf 1, i.e., with its back facing downwards, while magnetically held to the underside of shelf bottom 7, and from there to perform the capture of products 10 arranged below the sensor 2 from a location-variable capture position in order to detect the dimensions of the products 10, particularly their depth, or also their width and height.

[0146] Furthermore, it can be seen that the sensor can move between structural elements, or even between shelves 1, by utilizing the connecting elements 32 that connect the structural elements of shelf 1 so that the sensor 2 can pass through them. In addition, the battery-powered sensor 2 can move towards the charging station 33, where the sensor 2's battery can be inductively charged.

[0147] Figure 13 also shows an access point 34 typical of a communication infrastructure, which is provided and formed on the one hand for wireless communication with sensor 2 and / or on the other hand for wireless communication with electronic label (ESL) 35, and the ESL 35, which displays product information and / or price information, is attached to the shelf rail of shelf 1. The ESL 35 may be formed to be NFC-enabled (NFC stands for Near Field Communication). The same applies to sensor 2, and as a result, when sensor 2 is in direct proximity to the ESL 35 (i.e., within an NFC wireless range of up to a few centimeters), the ESL 35 can be used as a wireless beacon for sensor 2.

[0148] Figures 14, 15, and 16 visualize the functional principle of sensor 2.

[0149] More specifically, each corresponding pair of these drawings, from Figures 14.1 and 15.1 to Figures 14.5 and 15.5, shows, on the one hand, the shelf 1 from which product 10 is placed or from which product 10 is taken (Figures 14.1 to 14.5), and on the other hand, the distance to product 10 as confirmed by sensor 2 (Figures 15.1 to 15.5). Figure 16 visualizes the method flow provided by sensor 2 in the form of a flowchart.

[0150] Figure 14.1 shows a side view of shelf 1, specifically an excerpt of the shelf base 7, and the shelf rail 36 that terminates the shelf base 7 on its lower left side (the front edge 11 of shelf 1). The shelf base 7 is terminated by a back wall 15 at its rear edge 12, and a sensor 2 is mounted on the back wall 15 with a capture direction 14 toward the front edge 11. Furthermore, a Cartesian coordinate system is shown to identify the direction. In this simplified example, the y-coordinate direction is oriented from the rear edge 11 toward the front edge 12 and represents the distance between the product 10 and the sensor 2. Furthermore, a schematic representation of the sensor signal 37 is shown, which is transmitted from the sensor 2, reflected by the shelf rail 36, and returned to the sensor 2. The sensor 2 therefore captures the maximum distance M, which corresponds to the depth of the shelf base 7. The depth value captured by sensor 2 is shown against time in Figure 15.1 and, as visualized by arrow P in Figure 14.2, changes only after product 10 is placed at the bottom of the shelf 7. Sensor 2, in other words, captures a shorter interval than before. The temporal progression of the interval is shown in Figure 15.2. The interval change that occurs at the time of additional replenishment of product 10 within this temporal progression is indicated as Δy in Figure 15.2. Further Figures 14.3 and 15.4 visualize two more additional replenishments of product 10, and, similar to Figure 15.2, two further interval changes Δy occur in the direction of decreasing intervals. Sensor 2 may, in principle, confirm that this interval change Δy defines the product depth as soon as the first further interval change Δy occurs. However, sensor 2 may define the product depth because this interval change Δy occurred multiple times sequentially. As soon as sensor 2 defines the product depth, sensor 2 can determine, based on the number of interval changes that occurred, how many products 10 were added to the shelf bottom 7 (see Figure Sequences 14.2 to 15.4) or how many products 10 were removed from the shelf bottom 7 (see Figure Pairs 14.5 and 15.5). The number of products confirmed within shelf 1 is shown in Figure Sequences 15.1 to 15.5 by symbol N or the formula described therein.

[0151] The method shown in Figure 16, provided by the electronics of sensor 2, is shown here broken down into macroscopic method steps. The illustration in Figure 16 visualizes a combination of a method for identifying the dimensions of product 10 present in product display device 1 and a method for monitoring product inventory.

[0152] This method begins in Block I. In Block I, we verify the automatic capture of changes in at least one parameter that represents the dimensions of the product. In the context of Figures 14.1 to 15.5 above, this is the interval change Δy, which is detected by a sensor 2 located within shelf 1.

[0153] When sensor 2 is in the learning phase (this is checked in block II), the method is continued in block III, in which at least one dimension of product 10 is automatically detected based on the confirmed parameter change. In the context of Figures 14.1 to 15.5 above, at least one dimension of product 10 is the product depth, which is exactly equal to the interval change Δy. This product depth is stored in sensor 2 or communicated wirelessly by sensor 2 to the product management system. The method is continued again in block I after block III. Depending on the actual implementation, that is, depending on whether the product depth has already been detected by one interval change Δy or by multiple interval changes Δy, the learning phase may consist of one pass through the sequence of blocks I to III, or it may consist of multiple passes through blocks I to III until sensor 2 detects an automatically validated value for the depth of product 10. As soon as a valid value for the depth of product 10 is presented, the learning phase is exited.

[0154] In Block II, if it is confirmed that the learning phase has not been presented, the system branches to Block IV. In Block IV, the dimensions previously detected in the learning phase, i.e., the known dimensions, i.e., the depth of product 10, are used for product inventory monitoring, and changes in the number of products are automatically detected based on the interval change Δy confirmed in Block I. In the simplest case, the confirmed interval change Δy may be divided by the product depth to obtain the change in the number of products. This may be further processed within Sensor 2, or it may be wirelessly transmitted to the product management system for further processing.

[0155] In block V, the automatically detected change in the number of products is checked to determine whether it corresponds to a criterion for activating an alarm. The alarms may be various types, as discussed in the overview section in relation to additional deployment alarms and theft alarms. If one of the criteria discussed in that section is met, that is, if a positive result is obtained in block V, the respective alarm is activated in block VI, and the method is then continued in block I. If a negative result is obtained in block V, the method starts from block V and continues directly in block I.

[0156] In discussing the method visualized in Figure 16, although an infinite loop is illustrated, it should be noted that there can naturally be one start and one end to the method, and this situation can be caused by external influences on the sensor. For example, the start may be triggered by inserting the battery, and the end may be triggered by removing the battery. Furthermore, the processing flow of sensor 2 may be influenced (controlled) by wireless technology (remote control).

[0157] To reiterate, the diagrams described in detail above are merely embodiments that a person skilled in the art could modify in various ways without departing from the scope of the present invention. For the sake of clarity, the use of the indefinite article "ein" or "eine" does not preclude the existence of multiple such features. Although this application relates to the invention described in the claims, it may also encompass the following configurations as other embodiments. 1. A method for determining the dimensions of a product (10) placed inside a product display device (1), A step of automatically checking for changes in a parameter representing at least one dimension of the product (10), wherein the parameter is captured by an electronic sensor (2), and the sensor (2) is disposed within the product display device (1), A step of automatically detecting at least one dimension of the product (10) based on the confirmed change in the parameter, A method for determining the dimensions of a product placed within a product display device having the following features. 2. The aforementioned sensor (2) is Is it possible to position it in a variable location? Alternatively, the method described in item 1 above, which is fixedly arranged. 3. The sensor (2) has at least one of the following formations, namely, Time of flight sensor or flight time sensor, camera, 3D camera system, Time of Flight Camera, LIDAR, As a pressure-sensitive sensor mat, As a sensor mat having an array of photosensitive elements, The method described in 1 or 2 above, having the following characteristics. 4. The method according to any one of the above 1 to 3, wherein the detection of the dimensions of the product (10) is performed only when the learning phase is activated. 5. The method according to the above-mentioned 4, wherein the confirmed changes in the representative parameter are checked for at least one launch, and if the existence of the launch is confirmed, the learning phase is launched. 6. The method according to any one of 1 to 5 above, wherein the detection of the dimensions of the product (10) is performed directly from a single change in the parameter. 7. The method according to any one of the above 1 to 5, wherein the detection of the dimensions of the product (10) is performed from a plurality of changes in the parameters. 8. The method according to any one of 1 to 5 above, wherein the detection of at least one of the dimensions is performed by artificial intelligence that processes or evaluates the changes of the representative parameter. 9. The dimensions of the product (10) are the depth of the product (10) as measured in the direction of the depth of the product display device (1) or storage structure, and The aforementioned change in the parameter is given by the change in distance (Δy) confirmed by the sensor (2) in the direction of the depth of the product display device (1) or the depth of the storage structure, and The depth of the product (10) is detected by the observed distance change (Δy), The method described in any one of the above 1 to 8. 10. The method according to any one of 1 to 9 above, using as the sensor (2) a sensor (2) based on time-of-flight measurement of the sensor signal, in particular a sensor (2) having a resolution in the cm range or sub-cm range. 11. A product inventory monitoring method for monitoring product inventory within a product display device (1), At least one product (10) can be placed inside the product display device (1), With respect to the product (10), at least one dimension representative of the product inventory monitoring, in particular the depth of the product (10), is known in advance, in particular, is known by being identified in accordance with the method described in any one of 1 to 10 above. A method step for automatically checking for changes in a parameter representing at least one dimension of the product (10), wherein the parameter is captured by an electronic sensor (2), and the sensor (2) is disposed within the product display device (1), A product inventory monitoring method for monitoring product inventory in a product display device, comprising: a step of automatically detecting a change in the number of products, and a step of evaluating the change in the representative parameter by comparing it with at least one of the dimensions that represent the product inventory monitoring. 12. The product inventory monitoring method described in 11 above, wherein the change in the number of products, which is automatically confirmed, is checked to see if it falls below a threshold for the number of products, and if the check result is positive, an additional deployment alarm is activated. 13. The product inventory monitoring method described in 11 or 12 above, wherein the change in the number of products, which is automatically confirmed, is checked to see if it exceeds a threshold for the change in the number of products, and if the check result is positive, the theft alarm is activated. 14. The product inventory monitoring method described in 12 or 13 above, which uses a product-specific or product group-specific threshold during the inspection. 15. A product inventory monitoring method according to any one of the above 11 to 14, which, when automatically checking the aforementioned change in the number of products, incorporates an additional system component, in particular a payment system or register system that electronically transmits the aforementioned change in the number of products, or an optical monitoring system that creates a digital record of the product display device (1) in which the aforementioned change in the number of products has been confirmed.

Claims

1. A method for determining the dimensions of a product (10) placed inside a product display device (1), A step of automatically checking for changes in a parameter representing at least one dimension of the product (10), wherein the parameter is captured by an electronic sensor (2), the sensor (2) is disposed within the product display device (1) and is variably positioned by a sensor movable system (17), the sensor movable system (17) having an electronic control unit, A step of automatically detecting at least one dimension of the product (10) based on the confirmation of a change in the parameter, A method for determining the dimensions of a product placed in a product display device having, The detection and storage of the dimensions of the product (10) is performed only when a learning phase is activated in which at least one dimension of the product is detected and stored. When a change in the aforementioned representative parameter is detected, at least one trigger is checked, and if the presence of the trigger is confirmed, the learning phase is activated. The trigger is based on the method, which is determined by whether at least one dimension calculated from a change in a represented parameter matches a previously stored or previously detected dimension.

2. The aforementioned sensor movable system (17) has at least one of the following formations, namely, - A sensor-movable system based on Bowden cables. - Belt-based sensor-operated system, - A sensor-operated system based on gears or racks, - A sensor-movable system based on screw threads. - Features a magnet-based sensor movable system The method according to claim 1.

3. The sensor (2) has at least one of the following formations, namely, Time of flight sensor or flight time sensor, camera, 3D camera system, Time of Flight Camera, LIDAR, As a pressure-sensitive sensor mat, As a sensor mat having an array of photosensitive elements, The method according to claim 1 or 2, having the following characteristics:

4. The method according to any one of claims 1 to 3, wherein the dimensions of the product (10) are detected directly from a single change in the parameter.

5. The method according to any one of claims 1 to 3, wherein the dimensions of the product (10) are detected from a plurality of changes in the parameters.

6. The method according to any one of claims 1 to 3, wherein the detection of at least one dimension is performed by artificial intelligence that processes or evaluates the changes in the representative parameter.

7. The dimensions of the product (10) are the depth of the product (10) as measured in the direction of the depth of the product display device (1) or storage structure, and The changes in the aforementioned parameters are given by the change in distance (Δy) confirmed by the sensor (2) in the direction of the depth of the product display device (1) or the depth of the storage structure, and The depth of the product (10) is detected by the observed distance change (Δy). The method according to any one of claims 1 to 6.

8. The method according to any one of claims 1 to 7, wherein the sensor (2) is a sensor (2) based on time-of-flight measurement of a sensor signal or a sensor (2) having a resolution in the cm range or sub-cm range.

9. A product inventory monitoring method for monitoring product inventory within a product display device (1), At least one product (10) can be placed inside the product display device (1), With respect to the product (10), at least one dimension representing the product inventory monitoring or the depth of the product (10) is identified and known in accordance with the method described in any one of claims 1 to 8. A method step for automatically checking a change in a parameter representing at least one dimension of the product (10), wherein the parameter is captured by an electronic sensor (2), the sensor (2) is disposed within the product display device (1) and is variably positioned by a sensor movable system (17), the sensor movable system (17) having an electronic control unit, A product inventory monitoring method for monitoring product inventory in a product display device, comprising: a step of automatically detecting a change in the number of products, and a step of evaluating the change in the representative parameter by comparing it with at least one dimension that represents the product inventory monitoring.

10. Product inventory monitoring method according to claim 9, wherein the change in the number of products, which is automatically confirmed, is checked to see if it falls below a threshold for the number of products, and an additional deployment alarm is activated when the check result is positive.

11. A product inventory monitoring method according to claim 9 or 10, wherein the change in the number of products, which is automatically confirmed, is checked to see if it exceeds a threshold for the change in the number of products, and if the check result is positive, a theft alarm is activated.

12. The product inventory monitoring method according to claim 10 or 11, wherein a product-specific or product group-specific threshold is used during the inspection.

13. A product inventory monitoring method according to any one of claims 9 to 12, wherein when automatically checking the change in the number of products, an additional system component, or a payment system or register system that electronically transmits the change in the number of products, or an optical monitoring system that creates a digital record of the product display device (1) in which the change in the number of products has been confirmed.

Images