Method and system for determining the location of a shelf rail device
The two-step localization method for shelf rail devices enhances positioning accuracy and reduces power consumption, addressing inefficiencies in existing radio tag location methods by combining wireless communication with additional data for precise three-dimensional determination.
Patent Information
- Application Number
- JP2023564488
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-05
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2041-05-05
AI Technical Summary
Existing methods for determining the location of radio tags, such as those used in electronic price indicators, consume excessive power and result in short battery life due to unreliable power consumption and long processing times, making maintenance costly and inefficient.
A method for determining the location of shelf rail devices involves two-step localization: first, using wireless communication to determine coordinates in a plane, and second, incorporating additional data to accurately add a third coordinate, avoiding complex wireless communication for precise three-dimensional positioning.
This approach significantly reduces power consumption and improves location accuracy, allowing for faster and more reliable determination of shelf rail device positions with minimal maintenance costs.
Smart Images

Figure 0007739455000001 
Figure 0007739455000002 
Figure 0007739455000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a method and system for locating a shelf rail assembly. [Background technology]
[0002] A method for determining the location of radio tags is known from WO 2014059824. In this case, in a group of radio tags, in particular configured as a plurality of electronic price indicators, a location signal is transmitted a) by one or more radio tags whose location is known and received by a single radio tag whose location is unknown, or b) by a single radio tag whose location is unknown and received by one or more radio tags whose location is known, in both cases a) and b) when the radio tags receive the location signal, reception characteristics of the location signal are determined and used as a criterion for determining the location of the radio tags whose location is unknown.
[0003] In practice, this method has proven very useful for locating individual lost radio tags. In this case, it is not enough to determine their exact location in space. Rather, it is sufficient to manually search within a limited area and identify radio tags whose locations are unknown. However, if this method is used to systematically locate all radio tags, an unreliable amount of power is consumed by each radio tag, and results are only obtained after a relatively long processing time. This results in a very short battery life, especially for battery-powered radio tags. The resulting maintenance costs are not justified. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2014059824 [Patent Document 2] International Publication No. 2014053376 Summary of the Invention [Problem to be solved by the invention]
[0005] It is therefore an object of the present invention to provide an improved method. [Means for solving the problem]
[0006] This problem is solved by a method for determining the location of a shelf rail device whose position is unknown as set forth in claim 1. The present invention therefore provides a method for determining the location of a shelf rail device whose position is unknown and which is installed on a shelf rail, comprising the following method steps: automatically determining the location of the shelf rail device in a plane by wireless communication between the shelf rail device and a plurality of wireless devices whose positions are known; and automatically adding a third coordinate to the location of the shelf rail device in the plane by using additional data to determine the location of the shelf rail device in space, the additional data indicating the third coordinate and associated with the shelf rail device.
[0007] The measures of the present invention have the advantage that the position determination of a (particularly electronic) shelf rail device installed on a shelf rail is performed much more accurately, significantly faster, and with much less overall power consumption, which is achieved by dividing the spatial coordinate determination into two sub-steps.
[0008] As a first substep, wireless localization is used, which is reliable and applicable in many situations. With this localization, reliable localization is performed in one plane, preferably a horizontal plane. This localization has proven particularly useful for indoor localization, especially in retail store or supermarket sales areas, because such spaces often have large surface areas and relatively low ceiling heights. Within the space, multiple wireless devices for wirelessly localizing shelf rail devices can be installed, primarily on the ceiling, at intervals or positions optimal for wireless technology. Accordingly, this process of localizing shelf rail devices in one plane (e.g., projected parallel to or on the plane of the ceiling on which the wireless devices are installed) provides highly accurate results.
[0009] However, the situation is different when using a third coordinate (z coordinate) that is necessary to identify the spatial point where the shelf rail device is located in addition to the other two coordinates (x and y coordinates) that indicate the location within a plane. Experience has shown that wireless methods do not provide the necessary accuracy in the z direction. This can be attributed to the unfavorable ratio between the floor area and ceiling height of a sales floor and various conditions that interfere with optimal wireless propagation within the sales floor (shadowing, reflections, interfering signals from other wireless systems). Also, the (horizontal) spacing between adjacent shelf rail devices in the third coordinate direction is relatively small. As a result, inaccuracies become a major problem when wirelessly identifying the third coordinate.
[0010] To overcome this problem of the wireless method, according to the invention, the second substep, i.e., the wireless determination of the coordinates of the surface, is now additionally performed by automatically incorporating additional data, i.e., the wireless localization is not omitted completely, but rather is used for the range of automatic localization (localization within the surface) where the wireless technology provides results with an acceptable accuracy under given range or use conditions.
[0011] Thus, the weak point of fully automatic wireless localization of the shelf rail device (position resolution in the third coordinate (z coordinate)) is overcome by automatically incorporating additional data for localization of the shelf rail device in the third coordinate direction, i.e., a third coordinate obtained in a different way is added to the two coordinates of the surface obtained wirelessly.
[0012] In this regard, the additional data associated with a shelf rail device means that the additional data provides a specific third coordinate for a specific shelf rail device, and this association is achieved by a unique identifier for the shelf rail device, to which the third coordinate is also "bound."
[0013] However, if these additional third coordinates are valid for all shelf rail devices in a group, i.e., if the group of shelf rail devices has all of the third coordinates that identify the shelf rail devices in the spatial location of the group of shelf rail devices, then these additional third coordinates may be assigned to the group of shelf rail devices.
[0014] Rather than relying on the first two coordinates for determining the position within the plane being discovered by wireless communication, the determination of the third coordinate is based on a method different from the above-mentioned wireless communication, in particular not based on wireless communication, i.e., the third coordinate is determined by a method different from the method for determining the other two coordinates, in which case the coordinate pair of the plane determined by wireless communication is automatically used for the three-coordinate three-dimensional position description.
[0015] That is, in this case, a number of highly power-saving steps are combined to achieve a complete localization, each of which should be easily and quickly executed and which itself provides a partial result that is automatically combined into the final result for a complete localization in a reliable, easily reproducible manner.
[0016] Unlike the method of determining location based on a group of wireless tags mentioned at the beginning, each shelf rail device only needs to communicate wirelessly to determine its own unique location according to the method of the present invention. Furthermore, costly, complex, and potentially long-lasting wireless communication to determine a third coordinate, which is relatively difficult to determine, as accurately as possible is avoided by replacing the wireless communication to determine the third coordinate.
[0017] Further preferred and further configurations of the invention are set out in the dependent claims and the following description.
[0018] Generally, a shelf rail refers to the front end of a shelf on a shelf. Similar to the arrangement and number of shelves, the shelf rails are also arranged one on top of the other, i.e., along the z-coordinate in space. Generally, the shelf rails extend in a plane oriented perpendicular to the z-coordinate, and a position along the shelf rail can be uniquely identified within this plane by the x- and y-coordinates of a Cartesian coordinate system. The choice of the origin of this coordinate system is arbitrary and therefore a matter of convention.
[0019] Obviously, other coordinate systems can also be used for localization, such as for example cylindrical coordinate systems.
[0020] In the simplest case, the shelf rail device may be a shelf rail wireless device (e.g., a wireless transceiver) that is installed on the relevant shelf rail, or may be an integral, and possibly modularly removable, component of the shelf rail.
[0021] The shelf rail device may be configured with an electronic shelf label having a corresponding wireless module for communicating with the shelf label's access point, for example, to receive data for display on the shelf label's display, or to transmit, for example, the shelf label's battery status or shelf label display update status via the shelf label's access point. However, the wireless module may also be used for wireless communication to identify location.
[0022] In addition to the electronic shelf label mentioned above, other electronic shelf rail devices are also available. Device may be used. These various devices may include, without necessarily listing all, basic functions or components: sensors, such as temperature sensors or proximity sensors; cameras for still image capture, video recording, or infrared imaging; input devices, such as keyboards or key fields, rotary knobs or turntables, or touchscreens; and display devices, such as one or more light-emitting diodes (LEDs), video screens, or electronic shelf displays using energy-saving phase-stable display technologies, such as electronic ink or electronic paper, or active display technologies, such as liquid crystal displays (LCDs) or organic light-emitting diodes (OLEDs). Thus, the above devices primarily have one basic function. However, such devices may also have multiple basic functions combined, or one main basic function to which other supporting functions are added. These electronic devices may therefore also provide additional communication capabilities, such as an NFC interface, to operate the device, or to transfer data to and from the device, or to control the device's functions from close proximity (a few millimeters to a few centimeters), or to establish a link between the product and the electronic device, or may also provide additional communication capabilities, such as a Bluetooth low power wireless module, to wirelessly communicate with compatible wireless devices at greater distances.
[0023] In the case of wireless communication for the purpose of in-plane location, for example, an infrastructure consisting of multiple WLAN access points can be used as multiple shelf label access points, which can be used to determine, for example, by triangulation, coordinate pairs for locating devices within a plane.
[0024] However, preferably, to automatically determine the location within a plane, ultra-wideband wireless communication is used between a plurality of ultra-wideband wireless devices whose positions are known and the shelf rail device, and in particular between the shelf rail device and a plurality of access points equipped with a plurality of ultra-wideband wireless devices and installed at different positions whose positions are known and spaced apart from the shelf rail device. Thus, the advantages of ultra-wideband wireless communication (UWB wireless device for short) can be perfectly utilized to determine the precise indoor location of a device within a plane.
[0025] In this case, conventionally known methods such as "Two-way Ranging" (abbreviated as TWR), "Time-difference-of-Arrival" (abbreviated as TDoA) or "Phase-Difference-of-Arrival" (abbreviated as PDoA) can be used.
[0026] UWB radio devices can be individually configured and distributed throughout the store as fixed devices with known locations for UWB wireless communication, such as those installed on the ceiling. Alternatively, a combination radio device consisting of a WLAN access point and a UWB radio device can be provided. As a result, no additional installation costs are incurred for the UWB radio devices, since a WLAN infrastructure is generally always desirable and necessary. In this case, each combined radio device constitutes a fixed device with known location for UWB wireless or communication-based location determination within a plane.
[0027] Furthermore, for example, for the purpose of controlling shelf rail devices, a shelf rail device network dedicated to control the devices may be operated by a shelf rail device access point within the store. In parallel with this, a UWB radio device with a known location may be operated or installed. In this case, a combination radio device consisting of a shelf rail device access point and a UWB radio device may also be realized by further combining it with a WLAN access point, if necessary. In this case, each combination radio device also forms a fixed device with a known location for determining its location within a plane via UWB radio or communication.
[0028] As described above, automatically adding the third coordinate is not based on a wireless location method. Rather, the additional data can be retrieved from a data structure stored in an electronic data bank. In this case, the third coordinate may represent a z-coordinate in the classical sense, e.g., meters or millimeters. Preferably, the data structure indicates, as the third coordinate, the shelf surface on which the corresponding shelf rail device is installed. That is, the third coordinate does not necessarily represent a classical z-coordinate, but rather represents a unit defined by the shelf or the individual structure of the shelf itself, e.g., the first shelf surface, the second shelf surface, the third shelf surface, etc., or, e.g., the bottom shelf surface, the middle shelf surface, the top shelf surface, etc. Naturally, to express the physical third (z) coordinate in units such as meters, common units of length may be stored to appropriately represent the number of multiple shelf surfaces.
[0029] The data structure is constructed by obtaining identification data of a shelf rail device and assigning the identification data to the shelf surface on which the shelf rail device resides, whereby a logical link is digitally established and stored between the shelf label device uniquely identified by the identification data and the shelf surface on which the shelf label device is installed.
[0030] The construction of this data structure is carried out before wirelessly identifying the two coordinates of the surface. RememberedThat is, the construction of the data structure may be performed, for example, at the time of installing a shelf or a shelf rail device on a shelf. As a result, immediately after a coordinate pair of a surface has been wirelessly determined for a given shelf rail device (in which case the identification data of the respective shelf rail device has also been obtained), the associated third coordinate can be incorporated with knowledge of the identification data, and a space, in particular a position in the planogram, can be allocated or assigned directly to the corresponding shelf rail device.
[0031] If the construction of the data structure is performed after two coordinates of a surface have been wirelessly identified, the two coordinates of the surface must first be buffered until a third coordinate belonging to the two coordinates can be obtained and used to add to the two coordinates of the surface.
[0032] In this case, to assign the identification data to the corresponding shelf surface, the identification data is automatically read from the shelf rail device by a portable information management device, shelf surface data is generated in the information management device by receiving an input to identify the shelf surface, and the identification data is transmitted together with the shelf surface data to an electronic data bank, preferably by wireless communication, and stored in the electronic data bank.
[0033] Therefore, in this case, the identifier of the shelf rail device in question is first confirmed. This confirmation can be performed by, for example, a barcode or QR code attached to the shelf rail device and read by a portable information management device used by a retailer's employee. However, this identification can also be performed by obtaining a flashing light signal in which identification data is encoded and emitted from the shelf rail device. This identification can also be performed by RFID (Radio Frequency Identification) or NFC (Near Field Communication) between the shelf rail device in question and the portable information management device.
[0034] The shelf surface on which the relevant shelf rail device is installed is determined by an employee entering information on a portable information management device, for example, by operating a touch screen or a specified key, or by voice control, thereby identifying from which location the information management device generated the shelf surface data.
[0035] The identification data and shelf surface data thus obtained are transmitted from the information management device to a data bank, where they are associated with each other and stored as a linked data pair.
[0036] As noted above, identification can be performed by acquiring an optical signal, which requires a portable information management device to be pointed generally in the direction of the appropriate shelf rail device by an employee and held near the shelf rail device as needed.
[0037] However, the assignment to the shelf surface can also be performed fully automatically, in which case the shelf rail device outputs a first signal that can be optically detected or mechanically processed to assign the identification data to the corresponding shelf surface, a digital image of the shelf on which the corresponding shelf rail device is located is created by a camera, and computer processing is performed to identify the shelf surface on which the shelf rail device transmitting the optical signal is located by recognizing the optical signal in the digital image, and the shelf surface data generated from this shelf surface is transmitted, preferably by wireless communication, to an electronic data bank and stored in the electronic data bank.
[0038] Particularly preferably, the identification can also be automated, in which case the shelf rail device outputs its own identification data by means of an optically detectable or mechanically processable first signal, and the identification data is then determined by computer processing from a digital image. extraction and transmitted together with the shelf level data.
[0039] The computer processing of images of a scene acquired by a camera, either as still images or video sequences, with the aim of identifying the image or information content is carried out by a computer, on which software programmed for this purpose is executed, the corresponding programming being conventional for those skilled in the art of computer-aided image processing.
[0040] To acquire images, multiple cameras carrying corresponding image capture areas may be mounted, for example, on the ceiling of the sales floor or on other objects within the sales floor. These cameras may be connected to the computer in a wired manner, for example by power over Ethernet, or wirelessly, for example by WLAN, and the acquired images are provided digitally to the computer for image processing.
[0041] However, to ensure as trouble-free image acquisition as possible, it has proven useful to use the shelf itself for positioning. That is, the mechanical structure of the shelf itself, such as a support or reinforcement member of the shelf, can be used to support the camera. In this regard, it has proven particularly useful when a camera is installed on the shelf rail of a first shelf and the camera photographs a second shelf across the shelf aisle, where a shelf rail device that outputs an optically detectable or mechanically processable signal is installed. This arrangement eliminates the need to consider additional installation or orientation issues that would otherwise be required, or completely omits additional mechanical structures for securing the camera. In particular, the shelf rail itself is used to directly secure the camera.
[0042] Typically, multiple shelves are arranged parallel to one another along multiple shelf aisles, and are often, but not necessarily, the same length. Therefore, multiple cameras mounted at different positions along these shelves can be easily installed on each shelf on both sides of the shelf aisle, allowing for easy image capture of the opposite shelves. Even if the shelf aisles extend at angles to one another, or (even if only on one side) in a curved, wavy, or circular shape, good image capture of the opposite shelves is not impaired.
[0043] These cameras may have (auto)focus and zoom functions and may have a controllably (by means of a motor) adjustable objective lens, so that the imaging field can be adapted automatically, in particular under computer control.
[0044] As noted above, shelf rail devices can be configured in a variety of ways, and therefore multiple such shelf rail devices may be installed on the same shelf rail. However, it has proven particularly beneficial when the shelf rail device is a shelf rail controller that supplies power, preferably via communication technology, to at least one shelf rail client installed on its shelf rail, and the location determination of the shelf rail controller is used to limit the location of that shelf rail client to a known range on the shelf rail.
[0045] In this case, the shelf rail (and naturally the shelf rail client and shelf rail controller) can be configured to power the shelf rail client in a contactless or contact manner.
[0046] Contactless power supply at the shelf rail can be realized, for example, by incorporating an NFC communication module into the shelf rail client and a conductor loop structure into the shelf rail, in which case the shelf rail controller is configured as an NFC reader to provide power supply and communication technical power supply.
[0047] For contact-type power supply at the shelf rail, the shelf rail may be equipped with a plurality of electrical wires that extend along the longitudinal extension of the shelf rail and are contactable at the longitudinal extension. The shelf rail controller and the shelf rail client have contacts for contacting these electrical wires. An electronic communication module in each of the controller and the client enables data exchange and power supply via these electrical wires.
[0048] In both cases, i.e., in the case of contactless power supply at the shelf rail or in the case of contact power supply, the shelf rail controller can be connected to the retailer's communication network, for example, wired, such as a LAN, or wirelessly, and can therefore be connected to a central or local server or cloud-based management software to manage each device.
[0049] In the case of a wireless connection, primarily standardized communication methods or protocols, such as WLAN, ZigBee, Bluetooth, etc., may be used. For a wireless connection, naturally, proprietary communication methods or protocols, such as those known from WO 2014053376, may also be used. In this case, the disclosure of the time slot communication method described therein is incorporated by reference. However, unlike the system disclosed in WO 2014053376, this time slot communication method is used here for communication between a shelf rail controller access point and a group of shelf rail controllers assigned to this shelf rail controller access point. For example, a so-called electronic shelf label A shelf rail client or other electronic device such as a steam engine may use an entirely different communication protocol or method for communicating with the shelf rail controller on the shelf rail.
[0050] In this system, since it is known which shelf rail controller supplies power to which shelf rail client on its own shelf rail, it is practically sufficient to perform location determination only for each shelf rail controller, and it is possible to simultaneously know where the shelf rail client belonging to the located shelf rail controller is located, limited to each shelf rail, depending on the geometry or dimensions of the corresponding shelf rail.
[0051] By determining the location of the shelf rail controller on the one hand and the locations of the shelf rail clients of this shelf rail controller on the other hand on a group basis, the power budget is significantly improved, since the aforementioned location determination can be performed by only one device per shelf rail, i.e., by only this shelf rail controller, and as a result, only this shelf rail controller needs power for these location determination operations.
[0052] The positions of other shelf rail clients, limited to a known range of shelf rails, can be automatically derived by a computer process without requiring power for these shelf rail clients. Therefore, the overall power required, i.e., for the entire system, is reduced. This is further advantageous because the individual power required for each shelf rail client only needs to be supplied from a single independent power storage unit, such as a battery or rechargeable battery, or from the power storage unit of the shelf rail controller. This increases the operating life of the power storage unit, or, in other words, reduces the frequency of maintenance of the power storage unit for replacement or recharging. Furthermore, even when the shelf rail controller provides power via a cable, as explained above, the power balance is improved because, again, less communication work is required to locate the system components.
[0053] To achieve more accurate location of each shelf rail client on a shelf rail, it may be proposed that a camera or one or more of the cameras already described create a digital image of the shelf rail, and the position of the shelf rail client along the shelf rail be determined by computer-processed image evaluation. In this case, the identifier of each shelf rail client can be inferred based on the image of the appearance of the shelf rail client by computer processing. In this case, to identify the shelf rail client, for example, the image content of the display of the shelf rail client can be evaluated, since the content of this display is basically known to the computer controlling the system. In the absence of a display, another unique feature of the appearance of each shelf rail client can be used to assign each shelf rail client to at least one device class.
[0054] It has proven particularly advantageous if the shelf rail client in question, whether it has a display or not, outputs its own identification data by means of an optically detectable or mechanically processable second signal emitted therefrom, which, upon computer-processed image evaluation, extracts the identification data and determines the position of the shelf rail client in question along the shelf rail. It is therefore sufficient to provide, for example, a small light-emitting diode, which, for example, emits, at the front face of the shelf rail client, an optical signal, preferably a modulated optical signal (a pulse-code modulated optical signal, a brightness- or intensity-modulated, or a hybrid-modulated, or color-modulated optical signal), which is used to identify and, if necessary, simultaneously locate the shelf rail client on the shelf rail in question.
[0055] To determine the third coordinate, wireless communication may be used, as already mentioned at the beginning. In this case, however, the method used to determine this third coordinate differs from the method used to determine the two coordinates within the surface. For example, the distance between shelf surfaces can be calculated by time-of-flight measurements using a TOF sensor, and / or the classification of the shelf, i.e., the allocation to the corresponding shelf surface, can be performed, for example, by measuring the signal strength of the wireless signal along the third coordinate.
[0056] Therefore, by using the above-mentioned means, it is possible to ensure that a highly accurate planogram is created that digitally visually represents the items displayed on the shelf. In any case, it has proven extremely useful for generating and maintaining the planogram to have a third coordinate that directly represents or represents the corresponding shelf surface. In this planogram, all shelf rail devices and the shelf rails themselves, as well as other objects attached to the shelf rails, are accurately located and displayed in three dimensions.
[0057] According to another aspect, a plurality of shelf rail controllers mounted on or positioned on the shelf rails, each identified or otherwise identified at a respective location as described above, are configured to transmit beacons. Generally, a beacon refers to a radio signal that marks a fixed location, specifically the location of each transmitting shelf rail controller, and the radio signal enables another (particularly portable or substantially freely movable) radio device (e.g., a radio positioning system (in which case a radio signal receiver of the radio positioning system may be constituted, for example, by a customer's mobile phone or may be fixed to or incorporated into a customer's shopping cart)) to determine its relative location, e.g., direction and / or distance, relative to each transmitting shelf rail controller.
[0058] The wireless signals can carry a uniquely recognized identifier or identifiers of each shelf rail controller. In this case, the identifiers can be used by the wireless device or downstream thereof to identify which shelf rail controller among the multiple shelf rail controllers, and thus obtain the location of that shelf rail controller. However, the wireless signals can also carry the location of each shelf rail controller itself. This location can then be used directly by the wireless device, which provides multiple positioning results based on the received beacons.
[0059] Due to the presence of multiple shelf rail controllers installed relatively close together, a relatively large number of beacons are used at each location of the wireless device, and the positioning results obtained from these beacons are forwarded to a central server where they can be variously processed or evaluated, for example, to determine customer flow or dwell time (time and / or location components) in front of the shelf.
[0060] Due to the relatively high local density of beacons at each wireless device's location, the wireless device's location relative to a shelf rail controller with a known location can be determined to within an error of up to about 20 cm. This not only allows for awareness of the wireless device's presence around the shelf, as in conventional systems, but also allows for relatively accurate location determination along the shelf, and potentially even along this coordinate as the wireless device moves accordingly along the height of the shelf. If the wireless device is incorporated into a device that follows the wearer's hand movements, such as a smart watch (e.g., an Apple Watch® or similar device) or a hand-worn personal digital assistant, it can also automatically determine where the hand is moved on the shelf, i.e., which row the hand enters and, potentially, where on each row products are touched or removed from.
[0061] Thus, multiple shelf rail controllers transmitting beacons form the basis for a relatively dense network of wireless beacons with known locations, i.e., a wireless positioning system. This system can be used to locate a portable wireless device up to the point where it enters a shelf level. Furthermore, the high density of shelf rail controllers allows the transmit power for transmitting the beacons to be kept relatively low, while still providing a sufficient number of beacons at each location among the multiple shelves for a wireless device to locate and ultimately locate the wireless device.
[0062] These and other aspects of the present invention are illustrated by the figures described below.
[0063] The invention will now be described in more detail again with reference to the accompanying drawings, which are based on non-limiting embodiments, in which the same components are designated by the same reference numerals in the different figures, in which: [Brief explanation of the drawings]
[0064] [Figure 1] This shows the shelving arrangement in a store with multiple shelves of different lengths when viewed from the ceiling to the floor. [Figure 2] The shelf arrangement is shown in side view along the longitudinal extension of the shelves. [Figure 3] 1 shows an aisle defined by two shelves to illustrate a second embodiment. [Figure 4] 10 shows a passage for explaining a third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0065] Figure 1 shows the layout of a store 1 with three shelves R1, R2, and R3. Each shelf R1, R2, and R3 has a specific length. All shelves R1-R3 have the same height and width. The side views of these shelves can be seen in Figure 2.
[0066] Each shelf R1-R3 has five shelf boards or surfaces E1-E5 arranged one above the other. In this case, the top fifth shelf surface E5 can be seen in the selected view (FIG. 1). In this embodiment, all shelves R1-R3 have shelf surfaces E1-E5 at the same height per plane. Naturally, the shelves may be configured in various ways.
[0067] Each of shelf surfaces E1-E5 has one shelf board 2 on the left and right sides. As a result, a total of 30 shelf boards 2 are provided. The outer side of each shelf board 2 is terminated by a shelf rail 3 that supports shelf rail controllers RC1-RC30 as shelf rail devices. These shelf rail controllers are configured and provided to manage shelf rail clients (not shown) installed or attached to the respective shelf rails 3. In the selected view, of the 30 shelf rail controllers RC1-RC30, only the shelf rail controllers with the codes RC9, RC10, RC19, RC20, RC29, and RC30 on the fifth shelf surface E5 can be seen.
[0068] Furthermore, two shelf rail device access points 4 (abbreviated as access points 4) are installed on the ceiling of store 1. These access points 4 are configured and provided for wireless technical management of shelf rail controllers RC1-RC30 using the applicant's time slot communication method described in a known publication. These access points 4 are wired to a server 5 in store 1 by LAN wiring. Management software runs on server 5 for shelf rail device management and logistics management. For simplicity, other commonly used network components such as switches are not shown. Using server 5, data can be supplied to or retrieved from shelf rail clients installed on each shelf rail 3 via the access points 4 to which groups of shelf rail controllers RC1-RC30 are respectively assigned and the shelf rail controllers RC1-RC30. The shelf rail clients are connected to electronic shelves. label If the image content of the individual displays can be determined, the state information is Electronic Shelf Labels can be derived from
[0069] Furthermore, six UWB radio devices 6 are installed on the ceiling of the store 1. The locations of these UWB radio devices 6 are known to the server 5. In this case, these UWB radio devices 6 are also connected to the store's server 5 by LAN wiring. However, these UWB radio devices 6 may also be connected to this server 5 wirelessly.
[0070] Each of the shelf rail controllers RC1-RC30 has two wireless modules (not shown in detail), where a first wireless module is configured and provided for wireless communication with the access point 4 and a second wireless module is configured and provided for wireless communication with the UWB wireless device 6.
[0071] Using UWB radio between UWB radio device 6 and shelf rail controller RC1-RC30, the location of shelf rail controller RC1-RC30 within store 1 is determined, with the constraint that only two coordinates in a plane are evaluated, i.e., the x and y coordinates of the Cartesian coordinate system shown in FIG. 1. This process is performed in a fully automated manner under the control of server 5. Server 5 controls shelf rail controller RC1-RC30 and UWB radio device 6 to perform the UWB radio communications necessary to determine location in a known manner and provide the resulting data to server 5 for further processing and location determination of shelf rail controller RC1-RC30 in the XY plane.
[0072] Combining Figures 1 and 2, we obtain for each controller RC1-RC30 a coordinate pair KP with X and Y coordinates, respectively, in the notation (Xi, Yi): -RC1, RC3, RC5, RC7, and RC9 are coordinate pairs (X1, Y1), -RC2, RC4, RC6, RC8, and RC10 are coordinate pairs (X2, Y1), -RC11, RC13, RC15, RC17, and RC19 are coordinate pairs (X3, Y2), -RC12, RC14, RC16, RC18, and RC20 are coordinate pairs (X4, Y2), -RC21, RC23, RC25, RC27, and RC29 are coordinate pairs (X5, Y3), -RC22, RC24, RC26, RC28, and RC30 are coordinate pairs (X6, Y3), respectively.
[0073] Naturally, the numerical values thus determined for what is essentially the same X or Y coordinate may have slight variations or deviations, but such variations or deviations do not in any way affect the sufficient accuracy and predictability of the numerical values obtained by UWB wireless communication, which are necessary for determining the position of the controllers RC1-RC30 within the plane.
[0074] The server 5 stores the coordinate pair (Xi, Yi) of the plane thus determined for each controller RC1-RC30 together with the respective identification data ID4 of said respective controller RC1-RC30. In another step, the coordinate pair (Xi, Yi) is extended or added by a third coordinate that is required for three-dimensional localization.
[0075] This is done at the server 5 by automatically incorporating additional pre-entered data stored in data structures at the server 5 .
[0076] According to the first embodiment, the data structure is configured by a portable information management device 7. In this case, the information management device 7 may be a personal digital assistant (PDA). The PDA 7 is operated by an employee of the store 1, Where the relevant product is present, In particular (not shown) The relevant Electronic shelves where products are fixed to shelf rails 3 label Used to logically link to
[0077] In this context, however, the PDA 7 is used to identify shelf surfaces E1, E2, E3, E4, or E5 for each shelf rail controller RC1-RC30. In this case, the PDA 7, which is capable of short-range wireless communication, is maintained near each shelf rail controller RC1-RC30, which is also capable of short-range wireless communication, and the respective identification data ID is retrieved from the shelf rail controller. The shelf surface on which the corresponding shelf rail controller RC1-RC30 is installed is then selected on the touchscreen of the PDA 7. This input is received by the PDA 7, compiled or converted into shelf surface data RED indicating the identified respective shelf surface E1-E5, and transmitted to the server 5 together with the respective identification data ID of the queried controller RC1-RC30.
[0078] This process is illustrated in FIGS. 1 and 2 by positioning PDA7 near the twentieth shelf rail controller RC20, and can be repeated for all shelf rail controllers RC1-RC30.
[0079] In the server 5, for each shelf rail controller RC1-RC30, by using a unique identification data ID that defines the relationship to that respective shelf rail controller RC1-RC30, the shelf surface E1, E2, E3, E4 or E5 grasped for that respective shelf rail controller RC1-RC30 is added to the pre-specified coordinate pair KP, thus completing three-dimensional position determination.
[0080] Therefore, in an excerpt, the three-dimensional position coordinates are obtained for each shelf rail controller RC1-RC30 as follows: - RC1 (X1,Y1,E1) as - RC2 (X2,Y1,E1) as - … - RC15 (X3,Y2,E3) - … - As RC30 (X6,Y3,E5).
[0081] 3, to illustrate a second embodiment of the data structure configuration, the passage between two shelves R2 and R3 is shown in perspective, where the shelves R2 and R3 are simplified to shelf rail 3.
[0082] According to this second embodiment, the data structure is automatically constructed. To this end, each shelf rail controller RC1-RC30 is equipped with an LED 8 (LED stands for light-emitting diode), and each shelf rail controller RC1-RC30 is configured to output its own optically encoded identification data ID as a blinking signal via the LED 8 in accordance with a control command from the server 5. A camera 9 photographing the corresponding shelf R2, R3 from diagonally above the shelf R2, R3 captures the blinking sequence of the LED 8 along with the shelf rail 3 arranged on the shelf surface E1-E5. The image capture areas of the two cameras 9 are indicated by dashed lines 10. These digital images are transmitted wirelessly, for example, via a WLAN network, or wired via a LAN network, to the server 5, where they are evaluated in a fully automatic manner based on software. As a result, a data structure is obtained, from which additional data for adding the third coordinate is automatically extracted or retrieved. Of course, when images are evaluated in this fully automatic manner, it is not necessary to construct a static data structure from which additional data can be extracted only after the data structure is created. Rather, each data set of additional data can be used to add the third coordinates "on the fly" immediately after it is created.
[0083] 3, in order to illustrate a third embodiment of the data structure configuration, Fig. 4 shows in perspective the passage between two shelves R2 and R3, which are again simplified to shelf rail 3.
[0084] In this third embodiment, the data structure is also automatically configured. In this case, each shelf rail controller has a camera 9 in addition to an LED 8, but the camera is energy-saving and compact. Multiple cameras 9 installed on opposing aisles capture or photograph the front of the opposing shelves, including multiple shelf rails 3. The multiple shelf rails 3 are equipped with multiple shelf rail controllers that output their own identification data ID by flashing signals under the control of the server 5. The digital image thus obtained is transmitted to the server 5 as described above and evaluated by the server 5 to generate additional data, thereby identifying the third coordinate.
[0085] These highly precisely located shelf rail controllers RC1-RC30 form the basis for other system functions.
[0086] This infrastructure includes associating other shelf rail objects with their location so that they can participate in the planogram. These shelf rail objects may include simple paper or synthetic resin labels that do not require electronic devices. The paper or synthetic resin labels can be logically assigned to one of multiple shelf rail controllers via the respective product information contained on the surface of the paper or synthetic resin label. However, these shelf rail objects also include electronic devices, i.e., shelf rail clients that access the system or server 5 through the respective shelf rail controllers RC1-RC30. To accurately locate these objects, knowledge of which shelf rail 3 among the multiple shelf rails 3 the electronic device or shelf rail client assigned to one of the multiple shelf rail controllers RC1-RC30 is installed can be utilized. In this case, naturally, each shelf rail client is also logically assigned to exactly one shelf rail controller RC1-RC30. This logical assignment is technically referred to as "binding." This association can be performed by image detection and evaluation of the shelf rail client's characteristic appearance or image content, as described above. Thus, the position of the shelf rail client along each shelf rail can be accurately recognized and identified. If the shelf rail client also has a unique LED for outputting a flashing signal, the three-dimensional position of the corresponding shelf rail client can be determined by searching for each flashing shelf rail client in the images or videos captured by the camera and assigning it to the corresponding shelf rail 3. If the shelf rail client is also configured to transmit unique identification data via the flashing signal, its identification, as well as its location, can be performed by image evaluation of the images or videos captured by the camera.
[0087] Furthermore, the highly accurate location of the shelf rail controllers RC1-RC30 enables highly accurate location or tracking of objects. Unlike a few UWB radio devices installed on the ceiling of store 1, the shelves R1-R3 on which the shelf rail controllers RC1-RC30 are installed are themselves anchor points for locating objects, or, in a mobile sense, for tracking objects. Because the anchor points are located, they enable highly accurate direct location of objects moved along the shelves R1-R3 that are equipped with UWB radio devices and form the "side walls" of the shelf aisles. Correspondingly, the transmission power for UWB wireless communications can be reduced because the mobile UWB radio devices are always located in close proximity to the UWB radio modules of the shelf rail controllers RC1-RC30, which are fixed to the "side walls" and whose positions are known. This contributes to energy-efficient use of this technology. Furthermore, to locate a movable UWB radio device, only a predetermined group of shelf rail controllers RC1-RC30 directly adjacent to the object (e.g., only 1-10 in the immediate vicinity of the object) need be used. This group of shelf rail controllers RC1-RC30 operating to locate and track the movable UWB radio device can be dynamically adapted to the current location of the movable UWB radio device or to changes in the position of the movable UWB radio device. Thus, activated shelf rail controllers of the group of shelf rail controllers RC1-RC30 used to locate the object can be adapted to continuously adapt to the object's movement, "following" or "accompanying" the object throughout the store. Shelf rail controllers RC1-RC30 located further away from the object to be tracked, i.e., shelf rail controllers RC1-RC30 not required to locate the object, can be shut down. This further reduces the system's energy demands, particularly the absolute energy required to locate the moving object. The moving object with the UWB radio device may for example be a PDA of an employee of the store 1 or a customer, or may be incorporated in a customer's mobile phone.Such UWB radio devices may also be integrated into the electronics of (smart) shopping carts. These devices can be used for highly accurate indoor navigation within a store.
[0088] Generally, all these means are used under the control and management of a higher-level management mechanism, such as a server 5 or cloud-based management software, which means that the respective management mechanism activates the above-mentioned location determination means by computer-based control of the respective system components or controls the execution of said location determination means.
[0089] It should further be noted that the shelf rail controller and shelf rail client, or electronic devices in general, comprise electronic circuits in which various functions are realized, as needed, by executing software. The electronic circuits may be implemented in a discrete or integrated electronic circuit, or a combination thereof. Microcomputers, microcontrollers, application specific integrated circuits (ASICs) may also be used in combination with analog or digital electronic peripherals as needed.
[0090] It should also be noted that the shelf arrangements shown in Figures 1-4 are, of course, for illustrative purposes only and are simplified for ease of understanding. The above approach can be readily adapted to much more complex arrangements of multiple shelves and multiple shelf rails, particularly daisy-chain structures of multiple shelves and multiple shelf rails.
[0091] Finally, it is pointed out again that the figures described in detail above are merely embodiments that can be modified in various ways by those skilled in the art without departing from the scope of the invention. For the sake of completeness, it is also pointed out that the use of the indefinite article "a" does not exclude the possibility of a plurality of the relevant features being present. The present application relates to the invention described in the claims, but may also include the following configurations as other aspects. 1. A method for identifying the position of a shelf rail device (RC1-RC30) whose position is unknown and installed on a shelf rail (3), comprising: The method comprises the following method steps: - automatically determining the position of the shelf rail device (RC1-RC30) within a plane by wireless communication between the shelf rail device (RC1-RC30) and a plurality of wireless devices (4; 6) whose positions are known; - automatically adding a third coordinate to the position in the plane by using additional data to identify the position of the shelf rail device (RC1-RC30) in space, the additional data indicating the third coordinate and associated with the shelf rail device (RC1-RC30). 2. 2. The method according to claim 1, wherein ultra-wideband wireless communication is used between the shelf rail device (RC1-RC30) and a plurality of ultra-wideband radio devices (6) whose positions are known, i.e., a plurality of access points equipped with the ultra-wideband radio devices (6) in particular, and which are installed at different locations whose positions are known and spaced apart from the shelf rail device (RC1-RC30), in order to automatically identify the position within the surface. 3. 3. The method according to claim 1 or 2, wherein the additional data is retrieved from a data structure stored in an electronic data bank, the data structure indicating on which shelf surface (E1-E5) of one shelf (R1-R3) the corresponding shelf rail device (RC1-RC30) is installed as the third coordinate. 4. The method described in claim 3, wherein the data structure is constructed by obtaining identification data of the shelf rail device (RC1-RC30) and assigning the identification data to the shelf surface (E1-E5) on which the shelf rail device (RC1-RC30) is located. 5. 5. The method according to claim 4, wherein the identification data is automatically read from the shelf rail device (RC1-RC30) by a portable information management device (7) in order to assign the identification data to the corresponding shelf surface (E1-E5), shelf surface data is generated in the information management device (7) by receiving an input for identifying the shelf surface (E1-E5), and the identification data is transmitted to the electronic data bank together with the shelf surface data, preferably by wireless communication, and stored in the electronic data bank. 6. 5. The method according to claim 4, wherein the shelf rail device (RC1-RC30) outputs a first signal that is optically detectable or mechanically processable in order to assign the identification data to the corresponding shelf surface (E1-E5), a digital image of the shelf (R1-R3) on which the corresponding shelf rail device (RC1-RC30) is located is created by a camera (9), and computer processing is performed to identify in the digital image the shelf surface (E1-E5) on which the shelf rail device (RC1-RC30) that transmits the optical signal is located by recognizing the optical signal, and the generated shelf surface data is transmitted to the electronic data bank, preferably by wireless communication, and stored in the electronic data bank. 7. The method according to claim 6, wherein the shelf rail device (RC1-RC30) outputs its own identification data by a first signal that can be optically sensed or mechanically processed, and the identification data is extracted from the digital image through computer processing and transmitted together with the shelf surface data. 8. The method according to claim 6 or 7, wherein the camera (9) is installed on the shelf rail (3) of the first shelf (R1-R3), and the camera (9) photographs the second shelf (R1-R3) on which the shelf rail device (RC1-RC30) that outputs an optically detectable or mechanically processable signal is installed, across the shelf aisle. 9. A method according to any one of 1 to 8 above, wherein the shelf rail device (RC1-RC30) is a shelf rail controller that supplies power, and preferably also communication technology, to at least one shelf rail client installed on its own shelf rail (3), and the position determination of the shelf rail controller is used to limit the position of the shelf rail client to a known range of the shelf rail (3). 10. 10. The method according to claim 9, wherein a digital image of the corresponding shelf rail (3) is created by a camera (9) and the position of the shelf rail client (RC1-RC30) along the corresponding shelf rail (3) is determined by computerized image evaluation. 11. 11. The method according to claim 10, wherein the shelf rail client outputs its own identification data by means of a second optically detectable or mechanically processable signal output from the shelf rail client, and upon evaluation of the computer-processed image, the identification data is extracted and the position of the corresponding shelf rail client along the shelf rail (3) is determined. 12. 12. The method according to any one of claims 1 to 11, wherein the shelf rail device, which is also configured as a shelf rail controller, is configured to transmit a beacon.
Claims
1. A method for locating a shelf rail device (RC1-RC30) that is installed on a shelf rail (3) at a location where a product is present and whose position associated with the product is unknown, comprising: The method comprises the following method steps: - automatically determining the position of the shelf rail device (RC1-RC30) in a plane by x- and y-coordinates through wireless communication between the shelf rail device (RC1-RC30) and a plurality of wireless devices (4; 6) whose positions are known; - automatically adding a third coordinate to the position in the plane in addition to the x-coordinate and the y-coordinate by using additional data to identify the position of the shelf rail device (RC1-RC30) in space, wherein the additional data indicates the third coordinate and is associated with the shelf rail device (RC1-RC30), The additional data is retrieved from a data structure stored in an electronic data bank, the data structure indicating on which shelf surface (E1-E5) of one shelf (R1-R3) the corresponding shelf rail device (RC1-RC30) is installed as the third coordinate.
2. 2. The method of claim 1, wherein ultra-wideband wireless communication is used between the shelf rail device (RC1-RC30) and a plurality of ultra-wideband wireless devices (6) whose positions are known, i.e., a plurality of access points equipped with the ultra-wideband wireless devices (6) in particular, and which are installed at different locations whose positions are known and spaced apart from the shelf rail device (RC1-RC30), in order to automatically identify the position within the surface.
3. 3. The method of claim 1 or 2, wherein the data structure is constructed by obtaining identification data of the shelf rail device (RC1-RC30) and assigning the identification data to the shelf surface (E1-E5) on which the shelf rail device (RC1-RC30) is located.
4. 4. The method according to claim 3, wherein the identification data is automatically read from the shelf rail device (RC1-RC30) by a portable information management device (7) to assign the identification data to a corresponding shelf surface (E1-E5), shelf surface data is generated in the information management device (7) by receiving an input for identifying the shelf surface (E1-E5), and the identification data is transmitted to the electronic data bank together with the shelf surface data by wireless communication and stored in the electronic data bank.
5. 4. The method according to claim 3, wherein, in order to assign the identification data to a corresponding shelf surface (E1-E5), the shelf rail device (RC1-RC30) outputs a first signal that is optically detectable or mechanically processable, a digital image of the shelf (R1-R3) on which the corresponding shelf rail device (RC1-RC30) is located is created by a camera (9), and computer processing is performed to identify, in the digital image, the shelf surface (E1-E5) on which the shelf rail device (RC1-RC30) that transmitted the first signal is located by recognizing the first signal, and the generated shelf surface data is transmitted to the electronic data bank by wireless communication and stored in the electronic data bank.
6. The method according to claim 5, wherein the shelf rail devices (RC1-RC30) output their own identification data by a first signal that can be optically sensed or mechanically processed, and the identification data is extracted from the digital image and processed by a computer, and transmitted together with the shelf surface data.
7. The method according to claim 5 or 6, wherein the camera (9) is installed on the shelf rail (3) of the first shelf (R1-R3), and the camera (9) photographs the second shelf (R1-R3) on which the shelf rail device (RC1-RC30) that outputs an optically detectable or mechanically processable signal is installed, across the shelf aisle.
8. The method according to any one of claims 1 to 7, wherein the shelf rail device (RC1-RC30) is a shelf rail controller that supplies power and communication technology to at least one shelf rail client installed on its own shelf rail (3), and the position determination of the shelf rail controller is used to limit the position of the shelf rail client to a known range of the shelf rail (3).
9. 9. The method of claim 8, wherein a digital image of the corresponding shelf rail (3) is created by a camera (9) and the position of the shelf rail client (RC1-RC30) along the corresponding shelf rail (3) is determined by computerized image evaluation.
10. 10. The method according to claim 9, wherein the shelf rail client outputs its own identification data by means of a second optically detectable or mechanically processable signal output from the shelf rail client, and during the computer-processed image evaluation, the identification data is extracted and the position of the corresponding shelf rail client along the shelf rail (3) is determined.
11. The method according to any one of claims 1 to 10, wherein the shelf rail device, in particular also configured as a shelf rail controller, is configured to transmit a beacon.
Citation Information
Patent Citations
Storage position memory and readout method for three-dimejjional warehouse
JP1989110402A
Position measuring system and article storing facility with the same
JP2014065566A
Personal behavior analysis device, personal behavior analysis system, personal behavior analysis method, and monitoring device
JP2015011649A
Product management system, product management method, and program
JP2021033463A
Camera based location commissioning of electronic shelf labels
US20180293593A1