Shelf-supported imaging device and shelving system having an imaging device

Abstract

The present invention relates to an imaging device for a shelf support, the shelf support having a storage portion configured to be installed on a shelf edge and to store an electronic label on the shelf support, the imaging device having a back side configured to be removably fitted into the storage portion, a front side opposite the back side, an optical sensor for acquiring images of a shelf facing the front side, an actuator configured to rotate the optical sensor around one or more rotation axes, a memory configured to store the images, and a processing unit configured to transmit the images to an image server.

Description

[Technical Field]

[0001] The present invention relates to the field of electronic imaging systems for shelves, and in particular to imaging systems for sales area shelves used to control the layout of electronic labels and items within the shelves.

[0002] The present invention relates to an imaging device adapted to be received within a shelf support, a shelving system having the imaging device, and an image acquisition method using the imaging device. [Background technology]

[0003] The shelves at a point of sale are typically organized into gondolas, each having multiple rows, each row having multiple shelf labels positioned adjacent to the items. The shelf labels are positioned along the edge of the shelf and display information about the items offered for sale, such as price, price per weight, and product name.

[0004] In order to update product information easily and quickly and reduce operational costs, it is widely known to use electronic shelf labels (hereinafter referred to as "ESL") on shelves. The product information displayed on the screen of an ESL is remotely controlled by radio frequency, whether it is low frequency, radio frequency, or ultra-high frequency.

[0005] The position of the products on the shelves may change over time, for example, when gondolas are reordered or in the case of seasonal products. In recent years, efforts have been made to create "realograms" that provide a realistic view of the facing of the gondolas. Realograms take into account any changes made to the allocation of shelf space to items or to the allocation of ESLs to items. A realogram database therefore represents a reliable and up-to-date representation of the actual shelves visible to customers in the sales area.

[0006] Providing a reliable and complete re-recording database allows for the development of multiple useful applications, such as specific promotional content that takes into account the customer's location in front of the shelf, or the geographic location of an item within a sales area, to speed up re-stocking and / or product picking by sales area personnel.

[0007] An imaging system may be installed in the sales area to monitor the layout of items in the shelves and complete a rearogram. The imaging system preferably provides a real-time view of the shelves in the sales area. Based on the images or video provided by the imaging system, image processing methods are performed for several applications, including automatic detection of empty shelf space, automatic detection of ESL, and verification of fit between the real facing and the expected facing of the items.

[0008] The most commonly used imaging systems are cameras fixed to the ceiling or other strategic locations in the sales area. Each camera is positioned so that its viewing direction is facing the gondola. To hide the cameras from customers, the cameras may be placed behind pillars in the sales area or in a false ceiling.

[0009] The use of conventional cameras suspended from the ceiling poses several problems.

[0010] Powering the camera requires specific wiring. This wiring is impractical and aesthetically unpleasing to customers. Hardwired connections are bulky and difficult to hide from customers. Additionally, additional electrical components may be required to ensure sufficient power to the camera.

[0011] Additionally, the images provided do not match the actual customer perception of the arrangement of items and ESLs on the shelves. When a customer selects a product to purchase, the customer faces the gondola. A suspended camera provides a view from above, which primarily shows items located on the ground or in the lower levels of the gondola. Images of items displayed in the lower levels of the gondola are more difficult to obtain. Therefore, a suspended camera does not provide an image that corresponds to the customer's actual viewing conditions.

[0012] Additionally, cameras, especially those suspended from the ceiling, are not easily accessible to sales floor personnel, and cameras cannot be easily replaced or relocated, further increasing installation and maintenance costs.

[0013] Furthermore, the hanging camera must connect to the server either via a hardwired or wireless connection. While some of the aforementioned problems can be addressed by using wirelessly connected cameras, wireless connections typically present challenges with regard to radio coverage of the camera's zone, especially when the camera is located on the ceiling. Summary of the Invention

[0014] In view of the above, there is a need for a sales area imaging device that can be positioned in a sales area aisle to more accurately reflect the customer's line of sight. In this way, the image or sequence of images provided represents what the customer actually sees. Items located on the lower levels of the gondola should be visible as needed.

[0015] Another need arises for imaging systems that can be more easily powered: additional wiring associated with imaging systems should be avoided, making the imaging system less costly and less detrimental to the general aesthetic quality of the sales area for customers.

[0016] Another need is for an imaging system that is easily accessible to operators, yet remains securely in place to avoid malicious activity. Imaging systems found to be easily replaceable and repositionable.

[0017] A further problem to be solved is to adapt the images acquired by the imaging system to the layout of the surrounding corridor, so that the images acquired show the particular elements that need to be specifically photographed.

[0018] It is also necessary to improve the method of acquiring images of the shelves in the sales area, especially the front side of the gondola.

[0019] Therefore, the first object of the present invention is to an imaging device for a shelf support, the shelf support comprising a receiving portion located on a shelf edge and configured to receive an electronic label on the shelf support; The imaging device is a backside configured to be removably fitted to the housing; a front side facing the back side; an optical sensor for capturing an image of the front side facing shelf; an actuator configured to rotate the optical sensor about one or more axes of rotation; a memory configured to store the image; a processing unit configured to transmit the image to an image server; The imaging device has:

[0020] Images of the products inside the gondola can be captured thanks to the imaging device being located on the edge of the shelf and a light sensor on the front side of the imaging device that can be adjusted to a direction and height relative to the floor that accurately reflects the line of sight of a person standing on the floor.

[0021] Furthermore, the imaging device is housed in a shelf support that is also suitable for housing an electronic shelf label (ESL). The power supply for the imaging device is advantageously similar to that of the electronic shelf label. No additional wiring is required for an external power supply to the imaging device. Existing protocols for data communication between the ESL and a central server in the sales area are also advantageously used to communicate with the imaging device.

[0022] The imaging device of the present invention has a backside configured to fit onto a shelf support that extends along the edge of a shelf. The imaging device is removable from the support so that it can be easily moved or replaced. This reduces the installation cost of the imaging device or devices installed in a sales area.

[0023] The imaging device of the present invention is a suitable replacement for cameras suspended above the ceiling, and for the reasons stated above, is less detrimental to the aesthetics of the sales area and is cheaper to install and maintain.

[0024] The above-described system may include the following advantageous and non-limiting features, taken alone or in any technically feasible combination: The imaging device further comprises a casing, the casing having the front side and the back side, the memory, the processing unit and the light sensor being arranged inside the casing. - the casing has a locking member movable between a retracted position and an extended position, the locking member being configured to releasably engage a locking element of the shelf support when in the extended position; the optical sensor has a no-influence position in which the viewing direction of the optical sensor is perpendicular to the front side. the imaging device further comprises an actuator configured to rotate the light sensor about one or more axes of rotation. the one or more rotation axes include a rotation axis parallel to the front side. the imaging device further comprises a wheel rotatably coupled to the optical sensor, the actuator being configured to rotate the wheel; The actuator is configured to rotate the wheel according to the angular position indication. - the imaging device further comprises a motion sensor configured to detect the movement of an object or person in front of the optical sensor. The imaging device further comprises a screen display arranged on the front side, and a screen controller configured to control the display of the item information on the screen display. - the processing unit has a communication interface configured to receive a startup command from a management server, the memory is configured to register a device identifier unique to the imaging device, and the processing unit is configured to recognize the device identifier in the received startup command. - the communication interface further comprises a radio frequency circuit configured to receive a radio frequency signal encoding the wake-up command, the radio frequency circuit preferably configured to receive a radio frequency signal in a frequency range of 700 megahertz to 1.00 gigahertz, or in a frequency range of 2.40 gigahertz to 5.0 gigahertz. - said processing unit is adapted to transmit said images to said image server via an image transmission signal in the frequency range of 2.40 GHz to 5.0 GHz; The processing unit is further configured to perform an identification of the optical code optically transmitted by the light indicator by image recognition based on a series of images in which the light indicator is visible.

[0025] A second object of the present invention is a shelf imaging system for a shelf, preferably for a shelf of a gondola in a sales area, comprising: a shelf support configured to extend along an edge of the shelf, the shelf support including a receiving portion configured to receive an electronic label on the shelf support; The imaging device, wherein a back side of the imaging device is configured to removably fit into the receiving portion of the shelf support; an image server configured to receive images transmitted by the imaging device; A shelf imaging system having:

[0026] The off-the-shelf imaging system advantageously and non-limitingly includes a management server, and the imaging device further includes a communication interface, the management server being configured to transmit activation commands to the communication interface, preferably via radio frequency signals.

[0027] A third object of the present invention is a method of image acquisition, performed by the imaging device described above, comprising: receiving an activation command to acquire an image or a series of images; capturing an image or a series of images with an optical sensor of the imaging device; transferring the captured image or series of images by a processing unit of the imaging device to an image server; The method includes:

[0028] The above method may include, alone or in any technically feasible combination, the following advantageous and non-limiting features: a device identifier unique to said imaging device is registered in a memory of said imaging device, said processing unit controlling the acquisition of an image or a series of images as a result of said device identifier being encoded in said activation command; the light sensor of the imaging device has a viewing direction, the imaging device further comprising an actuator configured to rotate the light sensor about one or more axes of rotation of the light sensor such that the viewing direction is displaced; The method comprises: and adjusting the viewing direction by movement of the actuator in response to wireless adjustment commands received from a mobile device. The acquired image or sequence of images is transmitted by the imaging device via an image transmission signal in the frequency range of 2.40 GHz to 5.0 GHz. [Brief explanation of the drawings]

[0029] Other features, objects and advantages of the present invention are set forth in the following detailed description, which is merely illustrative and non-limiting and should be read in conjunction with the accompanying drawings in which: [Figure 1] 1 shows a schematic of an on-shelf imaging system for a sales area. [Figure 2] 2 is a schematic front view of an imaging device according to a specific embodiment of the present invention included in the shelving system of FIG. 1. [Figure 3] 3 is a schematic side view of the imaging device of FIG. 2 taken along line AA shown in FIG. 2. [Figure 4] 2 is a schematic perspective view of a shelf support of the shelf imaging system of FIG. 1; [Figure 5] 3 illustrates steps of a method for image acquisition, according to one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0030] In the description below and in the accompanying drawings, like elements are associated with the same alphanumeric references. General Architecture of Off-the-Shelf Imaging Systems FIG. 1 illustrates an information display and shelf imaging system 2 intended to be placed within a sales area, according to one embodiment of the present invention.

[0031] The system includes a shelf support 20 configured to be placed in a sales area and including a receptacle 21 configured to receive a plurality of electronic shelf labels 4. While only two ESLs are shown in Figure 1 for clarity, depending on the length along the shelf, the shelf support can receive many more ESLs. There may be 10 or more electronic shelf labels 4 per linear meter of support 2, so it is possible to have thousands, or even tens of thousands, of electronic shelf labels in a single sales area.

[0032] The item information displayed on the screen display 44 of the ESL 4 typically includes the product name, price, price per kilo, etc. of the item that is uniquely associated with the Electronic Shelf Label 4. Other information may be stored and / or displayed by the ESL 4, such as inventory information.

[0033] A sales area's sales floor typically consists of several stacked shelves arranged in gondolas, on which products are placed, that delimit aisles forming passageways within the sales area. Each ESL is associated with an area of ​​the shelf intended to receive products corresponding to the same item reference. As described below, imaging system 2 provides an image and / or sequence of images that accurately represent what a customer actually sees within the shelf as they stand or move through the aisle.

[0034] The shelf support 20 is arranged on the shelf edge 30 of shelf 3 in the gondola facing the navigation aisle. The shelf edge 30 preferably faces the gondola of the sales area with other shelves equipped with ESLs.

[0035] Alternatively, shelf support 20 can be placed on a shelf that is attached directly to a wall, or in any type of shelf that has a shelf edge onto which the shelf support can be placed.

[0036] 1, shelf support 20 houses several ESLs 4 along with imaging device 1. In this embodiment, imaging device 1 also functions as an ESL. In other words, imaging device 1 is suitable for displaying item information because of its screen display 14. Alternatively, imaging device 1 can be provided without a screen display.

[0037] Of course, although only one imaging device 1 is shown for clarity, each shelf support in a sales area may be equipped with two or more such imaging devices. The compactness of the imaging device 1 described below makes it possible to accommodate, for example, multiple regularly spaced imaging devices within a shelf in a sales area.

[0038] As shown below, the imaging device 1 is configured to be removably and securely mounted in a receptacle 21 of a shelf support, the latter having a generally concave shape. In this example, the receptacle 21 extends between an upper edge 210 and a lower edge 211 of the shelf support 20. The shelf support 20 has a U-shaped cross section. The back side of the imaging device 1 is removably mounted in the receptacle 21. The ESLs 4 are also removably mounted in the receptacle 21 via the back sides of their respective casings.

[0039] Alternatively, the shelf support 20 may have a generally convex shape. For example, the back side of the imaging device 1 may have a concave shape adapted to cooperate with a convex edge of the shelf support 20.

[0040] Management of product information updates for ESLs 4 is handled in this example by a central server 6. The central server 6 comprises or has access to a product information database 61 containing unique associations between ESL 4 label identifiers and product references, and further containing product information for each product reference. The central server may be specific to a sales area or shared among multiple sales areas (typically sales areas of the same chain store with a cloud-like infrastructure). The central server 6 is the management server for the sales area.

[0041] The central server 6 is configured to send radio frequency commands to the ESLs 4, which then change their screen displays 41. The central server 6 controls the radio frequency components 60. For example, the radio frequency components 60 are high-frequency or ultra-high-frequency transmitters, otherwise known as "access points." Hereinafter, the radio frequency components 60 communicate with the ESLs 4 via ultra-high frequencies in the frequency range of 2.40 GHz to 5.0 GHz. Alternatively, or additionally, the radio frequency components 60 can emit in the frequency range of 700 MHz to 1.0 GHz. A sales area can include several radio frequency transmitters. The central server 6 can also be used to send firmware updates to the ESLs and / or imaging devices.

[0042] 1 further shows an image server 5 configured for two-way communication with the imaging device 1. The image server 5 is configured to receive images acquired by the imaging device 1. For this purpose, the image server 5 comprises or has access to an image database 51 for registering images. The image server 5 is optionally configured to perform image processing, for example, automatic recognition of ESLs and / or products and / or sky areas in gondola images. In addition, the image server 5 is preferably configured to send instructions to the processing unit of the imaging device 1 to control the acquisition of images.

[0043] The wireless communication between the image server 5 and the imaging device 1 is preferably via a wireless ultra-high frequency connection, for example in the frequency range of 2.40 GHz to 5.0 GHz. Alternatively, the communication uses high frequencies, for example in the range of 700 MHz to 1.0 GHz.

[0044] Advantageously, communication between the image server 5 and the imaging devices 1 is carried out via one or more radio frequency components 60 of the sales area. The image server 5 and the central server 6 may optionally be one and the same, which is advantageous in terms of reducing the cost and complexity of the sales area infrastructure.

[0045] Optionally, shelf edge 30 of shelf 3 includes an ESL management module (not shown) that includes a communications module. An example of an ESL management module is disclosed in U.S. Patent Application No. 2019 / 0080633A1 filed in the name of the applicant. In this document, the shelf is provided with an ESL management module, with conductive traces extending the length of the shelf edge behind the ESL housing.

[0046] This management module allows the reception of commands from the central server 6 to be centralized at the management module level. Updates of item information can be provided to each ESL via the management module. An advantage of the management module is that the electronic shelf label 4 does not need to have a wireless communication system with a range of more than 5 meters, and in some cases more than 1 meter.

[0047] The management module disclosed in U.S. Patent Application No. 2019 / 0080633A1 can also optionally handle power supply to the ESL 4 and imaging device 1 if a power supply module is included in the management module. A power line running the length of the shelf edge 30 connects the power supply module to an electrical connector on the ESL.

[0048] Optionally, but advantageously, the shelf imaging system is configured to interact via a wireless connection with a mobile device 7. The mobile device 7 is preferably a smartphone, tablet device or PDA used by a staff member in the sales area.

[0049] The mobile device 7 can preferably establish a connection with the imaging device 1 via short-range communication, for example, within a range of 1 to 10 centimeters, e.g., 5 centimeters. The imaging device 1 typically includes an NFC (near-field communication) component, and the communication path with the mobile device 7 is established via NFC. The frequency of NFC communication is 13.56 megahertz. The advantage of using NFC communication is the very short communication range, which improves the accuracy and security of communication with the mobile device 7. The NFC communication range between the mobile device and the imaging device is typically equal to 5 centimeters. The mobile device must be positioned at a distance lower than this range to initiate NFC communication with the imaging device. If the ESL 4 is also suitable for NFC communication, the NFC communication range between the mobile device and the ESL is preferably 1 to 10 centimeters.

[0050] As described in more detail below, the mobile device 7 can send wireless adjustment commands to the processing unit of the imaging device 1, which can result in an actuator included in the imaging device forcing the optical sensor of the imaging device to change its viewing direction.

[0051] Optionally, each of the ESLs 4 includes an NFC element, preferably a passive NFC chip, to enable the mobile device 7 and / or other mobile devices to obtain a label identifier via NFC and / or establish communication with the ESL 4. In each ESL, a label identifier uniquely associated with the ESL may be encoded within the NFC chip such that the mobile device 7 can read the label identifier when initiating NFC short-range communication with the ESL.

[0052] Furthermore, the mobile device 7 is optionally configured to geolocate the imaging device 1 and / or the ESL 4. For this purpose, the mobile device 7 advantageously has a geolocation module 70. For the geographical location of the imaging device and the ESL, a plurality of radio frequency beacons 8 are advantageously spread throughout the sales area. The radio frequency beacons 8 are configured to emit radio frequency signals. For example, the beacons are installed on the ceiling of the sales area. The beacons typically use UWB (short for "Ultra Wide Band") technology to emit signals in a frequency band above 500 megahertz.

[0053] Alternatively, a mobile device is not required to geolocate the imaging device 1 and / or ESL 4. A geolocation module can be embedded directly in the imaging device and / or label. In this case, the imaging device or ESL receives radio frequency signals from the beacons, and geolocation is performed directly through the beacon network.

[0054] The geolocation module is configured to process radio frequency signals coming from the radio frequency beacons 8 to determine geographic location data relating to the current location of the mobile device.

[0055] In one embodiment, the mobile device 7 may obtain an identifier of an ESL or an identifier of an imaging device (e.g., via NFC) at the time of collection when the mobile device 7 is sufficiently close to the ESL or device. The mobile device then obtains radio frequency signals from radio frequency beacons 8 at the time of collection via geolocation module 70. The mobile device then determines geolocation data for the ESL or device by itself or communicates the received radio frequency signals to a server (e.g., central server 6), which determines the geolocation data.

[0056] If the central server 6 manages a realogram representing the layout of items in the shelves of the sales area, the determined geolocation data is advantageously registered in the realogram in association with the corresponding ESL or imaging device.

[0057] Alternatively, or in combination with radio frequency beacons, lighting fixtures emitting light signals can be used for geolocation. Light fixtures typically incorporate VLC ("visible light communication") technology. In this case, the geolocation module of the mobile device 7 is a module for decoding the VLC light signals.

[0058] The geolocation module of the mobile device and the method of geolocation of the ESL are further disclosed in International Application WO2018 / 046701A1.

[0059] Alternatively, the geographical location of the imaging device 1 and / or the geographical location of the ESL 4 may be managed by another device separate from the mobile device 7 .

[0060] As already mentioned, the imaging system 2 is generally cost-free because it utilizes conventional electronic shelf labeling infrastructure. The infrastructure for data communication and power supply to the imaging device 1 can be largely interchangeable with the existing infrastructure for electronic shelf labels. Furthermore, the imaging system 2 is easily scalable and can be adapted to a desired aisle layout. Imaging device examples An example of an imaging device 1 that can be used as the imaging device shown in Fig. 1 is shown in a schematic front view in Fig. 2. A schematic cross-sectional view of the imaging device 1 taken along line AA in Fig. 2 is shown in Fig. 3.

[0061] The imaging device 1 is viewed from the front side 10 in Fig. 2. The front side 10 is located on the right side of Fig. 3, and a back side 11 opposite the front side 10 is also shown.

[0062] Imaging device 1 includes a processing unit 12 and a memory 13, and further includes a light sensor 15. The processing unit, memory, and light sensor are typically mounted on a printed circuit board (not shown) of imaging device 1.

[0063] The imaging device 1 preferably comprises a casing 18 having an overall parallelepiped shape, bounded by a front side 10, a back side 11, and four other, usually smaller, sides.

[0064] The casing 18 advantageously has dimensions close to those of conventional electronic shelf labels for the sales area. The depth L4 of the casing 18 is preferably comprised between 10 and 30 mm. The length L1 of the casing 18 is preferably comprised between 50 and 100 mm. The width L2 of the casing 18 is preferably comprised between 40 and 80 mm.

[0065] Because the imaging device 1 has small dimensions compared to a normal video camera and can be mounted on a shelf support in the center of another ESL, the imaging device 1 becomes nearly invisible to customers in the sales area. Therefore, the imaging device 1 does not detract from the aesthetic quality of the shelf. The customer experience is not hindered by the presence of the shelf imaging system. camera The image is captured by the optical sensor 15 of the imaging device.

[0066] The optical sensor 15 is typically a camera including an optical lens or a series of lenses. The focal length of the optical sensor 15 is preferably adjustable, in particular depending on the distance between the gondola on which the imaging device 1 is located and the opposite gondola. Needless to say, the imaging device 1 can also be equipped with several optical sensors, for example sensors targeting different heights or different gondola areas.

[0067] The optical sensor 15 has small dimensions so that it can be mounted on the front side 10 of the imaging device. This is especially important if the imaging device 1 also includes a screen display for displaying product or other information, as the screen display needs to be as wide as possible so that customers can easily read it from the aisle. Here, the optical sensor 15 is contained in a parallelepiped tube (not shown) that is less than one centimeter long and less than one centimeter wide. The optical sensor 15 is preferably integrated into the casing 18, which does not require significant modifications to the general shape of the casing 18 compared to the normal casing of the ESL.

[0068] The viewing direction D of the optical sensor 15 is by default substantially perpendicular to the front side of the other gondola facing the gondola in which the imaging device 1 is located. It is preferably perpendicular to the surface of the front side 10 of the imaging device. The images acquired via the optical sensor 15 typically show the items and / or shelf spaces and / or ESLs provided in the other gondola at substantially the same height as the shelf support housing the imaging device.

[0069] Therefore, the images and videos captured by the optical sensor 15 accurately reflect the line of sight of people walking down the aisles of the sales area.

[0070] Although the default position of the imaging device preferably corresponds to a person's line of sight, other items and / or shelf spaces and / or ESLs or other elements of the sales area that are not located along said line of sight may need to be visible in the captured image. Therefore, the viewing direction D of the light sensor 15 is preferably adjustable in order to target elements located at different heights relative to the floor.

[0071] In this regard, the light sensor 15 is preferably mounted on a movable support within the casing 18. Here, as shown in Figure 3, the light sensor 15 is fixed to a wheel 151. The wheel preferably has an axis of rotation R that is parallel to the surface of the front side 10 of the imaging device 1. The light sensor 15 is coupled to the wheel 151 so as to rotate.

[0072] Furthermore, an optical opening 152 is provided in the casing 18 to allow light to reach the optical sensor. Here, the optical opening 152 is provided on the front side 10 of the casing 18. When the wheel 151 rotates, the optical sensor 15 moves facing the optical opening.

[0073] An actuator 150 is provided here to rotate the wheel 151. The actuator 150 is controlled to move the wheel 151 according to an angular position command. The command is, for example, a numerical value of a desired angular deviation between the viewing direction D and a horizontal plane. Here, the processing unit 12 includes an actuator communication interface (not shown) for bidirectional communication with the actuator 150.

[0074] Alternatively, or in combination with the actuator 150, the casing 18 may be provided with a manual wheel adjuster mechanically linked to the wheel 151 so that the salesperson manually adjusts the viewing direction D of the optical sensor 15.

[0075] The imaging device advantageously comprises a second wheel (not visible in the drawings) which enables rotation of the light sensor 15 about a second axis of rotation which is preferably perpendicular to the axis R. The light sensor 15 is also mounted on this second wheel. Mechanics and engagement between the imaging device and the shelf support FIG. 4 is a schematic close-up view of a portion of shelf support 20 into which imaging device 1 is removably fitted.

[0076] The shelf support 20 includes at its front side an accommodation space 21 between an upper edge 210 and a lower edge 211, and at its rear side an element for mechanically coupling with the shelf edge 30 so that the shelf support is fixed to the shelf 3. Here, said element is a bracket 24 having a generally concave shape configured to grip the shelf edge. The rear side further comprises an abutment 22 which serves to receive, for example, an ESL management module.

[0077] For releasable engagement with the shelf support 20, the imaging device 1 preferably includes a locking element 110 movable between a retracted position and an extended position. In the example of FIG. 4 , the locking element 110 is a retractable pin protruding from the upper side of the casing 18 of the imaging device 1. In the retracted position of the locking element, the locking element 110 is at least partially fitted inside the casing, and the imaging device 1 can be removed from the storage space, whereas in the extended position, the locking element 110 can be fitted into a corresponding storage element of the shelf support. The imaging device 1 can no longer be removed until the locking element 110 is switched back to the retracted position. The corresponding element is, for example, an orifice having substantially the same dimensions as the locking element of the imaging device 1. The shelf support 20 can include several regularly spaced openings so that the possible positions of the imaging device 1 along the storage space 21 are predetermined.

[0078] In this case, the upper edge 210 and the lower edge 211 are preferably made of a material that has a certain degree of flexibility so that a member of the sales staff can push the imaging device 1 into the storage space in the position where it needs to be fixed.

[0079] Switching of locking element 110 between the retracted and extended positions is typically controllable only by a sales person to prevent other individuals from removing imaging device 1. For example, switching is controlled by a mobile device 7.

[0080] In the example of Fig. 4, the receiving space 21 is further provided with a separator plate 23, which forms the rear side of the receiving space. Power lines and / or data communication lines can be arranged behind said plate. Through holes 230 are provided on the back side of the imaging device to allow electrical contact with the power lines and / or data communication lines and an electrical connector (not shown). Other Components The processing unit 12 is housed in a casing 18. In this example, the imaging device 1 comprises a screen display 14, and the processing unit 12 is located in the area between the back side of the screen display 14 and the rear side 11.

[0081] Code instructions for operating the imaging device 1 are encoded in the processing unit 12 and control a light sensor 15 , an optional screen display 14 , a motion sensor 16 and a light indicator 17 .

[0082] In this example, the processing unit 12 includes a communication interface 120 for receiving instructions from other entities in the sales area. In particular, the communication interface 120 is configured to receive a wake-up command from the central server 6. Upon receiving this wake-up command, the light sensor 15 is activated and the processing unit 12 controls the acquisition of an image or a sequence of images by the light sensor 15 at the desired time.

[0083] The activation command received from the central server 6 may be an instruction to perform image capture immediately, or may be an instruction to capture an image or sequence of images after a predetermined period of time has elapsed, for example a period of time encoded in the activation command.

[0084] A device identifier that is unique and specific to the imaging device 1 is preferably stored in the imaging device's memory 13. Wake-up commands specifically targeted to the imaging device 1 encode said device identifier, and the processing unit 12 is able to recognise said device identifier in received wake-up commands.

[0085] Preferably, the imaging device 1 is switchable between a sleep mode, in which the light sensor 15 consumes less energy, and a wake-up mode, in which the light sensor 15 is active. In this way, less energy is consumed when there is no need to capture an image.

[0086] The communication interface 120 advantageously comprises a radio frequency circuit configured to receive radio frequency signals in the very high frequency range of 700 megahertz to 1.00 gigahertz, or in the high frequency range of 2.40 gigahertz to 5.0 gigahertz.

[0087] The communications interface 120 is also advantageously configured to transmit images or image sequences in digital form via a wireless connection to the image server 5. Transmission of the images or image sequences is preferably over a Wi-Fi connection, especially if the files are large in size, although the images can also be transmitted in the frequency range of 700 megahertz to 1.0 gigahertz.

[0088] As mentioned above, imaging device 1, due to its screen display, advantageously also functions as an electronic shelf label for displaying price and / or other portions of item information, thereby conserving space within shelf support 20 and allowing more ESLs or other components to be accommodated within the same storage space of the shelf support.

[0089] In this regard, the imaging device 1 optionally includes a screen display 14 disposed on the front side 10, as seen in Fig. 2, and a screen controller (not shown) configured to control the display of item information on the screen display 14. The screen display 14 is typically an electronic ink display and / or an LED display.

[0090] As mentioned above, the screen display 14 is as large as possible so that a customer can comfortably read the displayed information. The length and width of the screen are preferably equal to at least 50% of the total length and at least 50% of the total width, respectively, of the imaging device 1. In this example, the screen display 14 is between 30 and 60 millimeters long and between 15 and 30 millimeters wide.

[0091] As mentioned above, the imaging device 1 can be switched between sleep mode and wake-up mode, and if the imaging device has a screen display, the display remains lit even in sleep mode, so that the customer can read the product information even when no images are being captured by the imaging device.

[0092] If the imaging device 1 also functions as an electronic shelf label, the device identifier is typically the same as the label identifier that is uniquely associated with the item reference in the central database 61 of the sales area.

[0093] For purposes of receiving item information updates, the imaging device 1 includes radio frequency circuitry (not shown) configured to receive item information updates from the central server 6, typically the same radio frequency circuitry that receives wake-up commands for the light sensor 15.

[0094] In this example, the imaging device 1 further comprises a motion sensor 16 configured to detect the movement of an object or person in front of the light sensor 15. The motion sensor 16 is, for example, an infrared sensor. The motion sensor 16 can send a stop signal to the light sensor 15 and / or the image server 5 so that no images are captured when the field of view of the light sensor 15 is obstructed. Thus, further processing of captured gondola images that account for the obstruction of the field of view of the light sensor is avoided.

[0095] The motion sensor 16 is preferably located near the light sensor 15 and is preferably configured to detect obstacles (e.g., interactions with people) on an axis D' perpendicular to the surface of the front side 10 of the imaging device.

[0096] In this example, the imaging device 1 further comprises a light indicator 17. The indicator 17 is here provided in the upper left corner of the front side 10 of the imaging device 1. This light indicator enables the imaging device 1 to respond to a blinking command (e.g., a command from the central server 6) to make it more visible in the acquired image of the gondola in which the imaging device 1 is located. If the imaging device 1 is associated with a unique item reference, the indicator 17 is typically configured to blink as soon as it receives a command from the central server to blink all ESLs associated with said item reference.

[0097] Here, the imaging device 1 includes a battery 19, for example a lithium-ion rechargeable battery, housed, for example, in the lower end of the casing 18 below the light sensor 15. The battery 19 provides power to the light sensor 15, the screen display 14, the processing unit 12, and any other electronic components of the imaging device 1.

[0098] In another example, the imaging device 1 includes an electrical connector for connecting to the shelf support's power lines. In particular, if the shelf edge 30 of the shelf 3 is equipped with an ESL management module, conductive traces extending the length of the shelf edge can be provided to connect the ESL management module to the imaging device 1 (and optionally the ESL 4) to provide power to the imaging device 1. The imaging device 1 is thus wired to the power supply module via its electrical connector. The advantage is that the power supplies for the shelf support's ESL and imaging device are centralized at the management module level, leaving more space available within the casing 18 for the light sensor and, potentially, the screen.

[0099] If an adjustment command is provided for adjusting the angular position of the light sensor 15, the imaging device 1 is further configured to receive the adjustment command from an external entity. Advantageously, the external entity is a mobile device 7, and the adjustment command is sent via a short-range communication canal, such as an NFC canal. In this case, the imaging device 1 includes an NFC component (not shown), which is either a passive NFC chip or an NFC antenna, such as a loop antenna.

[0100] When the shelf imaging system includes a mobile device 7 configured to geographically locate the imaging device within a sales area, the memory of the NFC component of the imaging device 1 advantageously encodes a unique device identifier for the imaging device 1. In this manner, when the mobile device 7 moves within close proximity (typically 1 to 10 centimeters) of the imaging device 1, the mobile device 7 acquires the unique device identifier. The device identifier can then be associated with geographic location data determined via the mobile device 7 based on radio frequency or VLC signals acquired by the geolocation module 70 of the mobile device 7.

[0101] The NFC component of the imaging device 1 is also advantageously used to set up the imaging device 1. Once the imaging device 1 is attached to the shelf support, an easy set-up procedure is performed by NFC communication between the imaging device 1 and the mobile device 7. Positioning data of the imaging device 1 is advantageously obtained during the set-up procedure. How to acquire an image or series of images of a shelf 5 shows steps of a method 50 for acquiring shelf images according to an exemplary embodiment, the method being advantageously performed by the system of FIG.

[0102] In optional step 100, a trigger event occurs, requiring the capture of an image or sequence of images by the imaging device 1, typically requiring the capture of an image of the front side of the gondola opposite the gondola in which the imaging device 1 is located.

[0103] For example, a triggering event may be an item information update. The update may include a change in price information and / or a change in inventory information associated with the item reference information, which causes a change in information displayed on the screen display 44 of one or more ESLs 4 when a sales area checkout system notifies that one or more items corresponding to the item reference information have been purchased. The triggering event may also be a command sent to the ESL 4 to transmit a specific optical code via the light indicator 17 of the ESL 4. The optical code is typically a label identifier for the ESL 4.

[0104] Alternatively, the trigger event for image acquisition is a timer issued by the central server 6 or by another server, possibly a remote server connected to the central server 6 via a cloud network infrastructure.

[0105] Alternatively, the trigger event for image capture occurs simultaneously with the transmission of the wake-up command to the imaging device. For example, if the trigger event for image capture is an item information update sent to multiple ESLs 4, and if the wake-up command is sent to imaging device 1 by radio frequency transmitter 60 via the same radio frequency communication protocol (e.g., ultra-high frequency communication) as the item information update, the wake-up command and the item information update information can be sent simultaneously so that the captured image reflects the change in item information.

[0106] The method 50 optionally includes adjusting the viewing direction D of the optical sensor 15 before or during image acquisition. For example, the wheel 151 is controlled by the actuator 150 to rotate about the axis R, as shown in FIG. 3 , thereby changing the angular deviation between the viewing direction D and the horizontal plane. The adjustment command is received by the imaging device 1 via wireless communication, preferably via NFC short-range communication with the mobile device 7. The adjustment command encodes an angular position instruction. The instruction is transmitted to the actuator 150, which is actuated to rotate the wheel 151 according to the angular position instruction.

[0107] 5, method 50 includes a step 200 of receiving a wake-up command by imaging device 1. The wake-up command is transmitted to imaging device 1 by radio frequency transmitter 60, typically via wireless communication, advantageously in the frequency range between 700 megahertz and 1.00 gigahertz, or between 2.40 gigahertz and 5.0 gigahertz.

[0108] The advantage of high frequency or ultra high frequency communication is that the imaging device is highly responsive.

[0109] The acquisition of an image or a sequence of images by the imaging device 1 is then carried out in step 300. The image is preferably an image of a shelf or shelves of the opposite gondola. The image is advantageously registered in the memory 13 of the imaging device 1 in the form of a digital image.

[0110] In step 400, the acquired image or sequence or images are sent by the processing unit 12 to the image server 5 and registered in the image database 51. As mentioned above, the image server 5 and the central server 6 are optionally the same server.

[0111] The transmission of the image or sequence of images acquired in step 400 is advantageously carried out wirelessly in the Wi-Fi frequency range between 2.40 GHz and 5.0 GHz. Furthermore, the use of such ultra-high frequencies is advantageous when the acquired files are large. Wi-Fi communication is particularly useful when transmitting long image sequences or when the acquired images have a high resolution. Alternatively, the transmission of the collected image or sequence of images is carried out in a frequency range corresponding to the frequency of communication between the central server 6 and the ESL 4, typically between 700 MHz and 1.0 GHz.

[0112] Optionally, if the shelf imaging system 2 includes a mobile device 7 operated by a member of the sales staff, the captured images can be displayed in real time on the screen of the mobile device. In this way, the sales staff can control in real time what customers in the sales area can see when viewing the imaged gondolas. The sales staff can monitor updates to item information and / or available inventory of items on the shelves. In this case, the captured image or image sequence is retrieved by the mobile device 7 from the image database 51 or transmitted directly to the mobile device 7.

[0113] Method 50 has several advantages. Due to its position within shelf support 20 of shelf 3, imaging device 1 can acquire images with an orientation and height relative to the floor that accurately reflects the line of sight of a person standing in the aisle of the sales area. The use of the optical sensor of imaging device 1 is particularly advantageous for acquiring images of the front side of a gondola facing the imaging device, since the viewing direction of the imaging device can be approximately perpendicular to said front side. Furthermore, if a motion sensor 16 is provided in imaging device 1, image acquisition can be interrupted when the field of view of optical sensor 15 is obstructed, avoiding the unnecessary acquisition of unworkable images.

[0114] Furthermore, the imaging device 1 can be easily replaced, repaired, or replaced because it is removable from the shelf support 20. Image acquisition can be quickly repeated to confirm correct positioning of the imaging device with respect to the zone that needs to be imaged.

[0115] As mentioned above, it is advantageous to transmit activation commands for the imaging devices via the same radio frequency transmitter that transmits item information updates, for example, via "access points" in the sales area. In this way, synergy with the existing standard infrastructure for shelf-based ESLs is achieved. The mechanical infrastructure for positioning and powering the ESLs is reused for the imaging devices, as is the radio frequency protocol for data communication.

Claims

1. An imaging device, the imaging device comprising: A casing (18), the casing (18) comprising: a backside (11) configured to be removably fitted into a receiving portion (21) of a shelf support, the shelf support being configured to be installed on a shelf edge, the receiving portion being configured to receive an electronic label (4) and the imaging device thereon; and and a front side (10) opposite the back side (11), a casing (18); an optical sensor (15) configured to acquire an image of a shelf facing the front side (10); an actuator (150) configured to rotate the optical sensor (15) about one or more axes of rotation; a motion sensor configured to detect movement of an object or person in front of the optical sensor and to send a stop signal to the optical sensor to interrupt image capture when the field of view of the optical sensor is obstructed; a memory (13) configured to store said image; a processing unit (12) configured to transmit said image to an image server; Including, the memory, the processing unit, the motion sensor, and the light sensor are disposed inside the casing (18); Imaging device.

2. The imaging device of claim 1 , wherein the motion sensor is an infrared sensor.

3. 3. The imaging device of claim 1, wherein the motion sensor is configured to detect obstacles on an axis perpendicular to a surface of the front side.

4. 2. The imaging device of claim 1, wherein the casing (18) includes a locking member (110) movable between a retracted position and an extended position, and when the locking member is in the extended position, the locking member is configured to releasably engage with a locking element of the shelf support (20).

5. 5. The imaging device according to any one of claims 1 to 4, wherein the light sensor (15) has a no-impact position in which the viewing direction (D) of the light sensor is perpendicular to the front side (10).

6. 6. The imaging device of claim 1, wherein the one or more rotation axes include a rotation axis parallel to the front side (10).

7. 7. The imaging device of claim 1, further comprising a wheel (151) rotatably coupled to the optical sensor (15), the actuator configured to rotate the wheel (151).

8. a screen display (14) disposed on the front side (10); a screen controller configured to control the display of product information on the screen display (14); 8. The imaging device of claim 1, further comprising:

9. 9. The imaging device of claim 1, wherein the processing unit includes a communication interface configured to receive a startup command from a management server, the memory is configured to register a device identifier unique to the imaging device, and the processing unit is configured to recognize the device identifier in the received startup command.

10. 10. The imaging device of claim 9, wherein the communication interface further comprises a radio frequency circuit configured to receive a radio frequency signal encoding the wake-up command.

11. 11. The imaging device of claim 1, wherein the processing unit (12) is further configured to identify the optical code optically transmitted by the light indicator (17) by image recognition based on a sequence of images in which the light indicator (17) is visible.

12. 12. The imaging device according to any one of claims 1 to 11, wherein the processing unit (12) is configured to transmit the image to the image server via an image transmission signal in the frequency range of 2.40 GHz to 5.0 GHz.

13. 1. An on-shelf imaging system for a shelf, the on-shelf imaging system comprising: a shelf support (20) configured to extend along an edge (30) of the shelf, the shelf support including a receiving portion (21) configured to receive an electronic label (4) on the shelf support; 13. The imaging device (1) according to any one of claims 1 to 12, wherein the back side (11) of the imaging device (1) is configured to removably fit into the receiving portion (21) of the shelf support; an image server (5) configured to receive images transmitted by the imaging device; Including, Off-the-shelf imaging system.

14. 13. A method for image acquisition, the method being performed by an imaging device according to any one of claims 1 to 12, the method comprising the steps of: receiving (200) a trigger command to acquire an image or a series of images; acquiring (300) an image or a series of images by the optical sensor (15) of the imaging device; a step (400) of transferring the acquired image or series of images to an image server (5) by the processing unit (12) of the imaging device; Including, method.

15. 15. The method of claim 14, wherein a device identifier unique to the imaging device is registered in the memory (13) of the imaging device, and the processing unit (12) controls the light sensor (15) to acquire the image or series of images as a result of the device identifier being encoded in the activation command.

16. the optical sensor (15) of the imaging device has a viewing direction (D), and the imaging device further includes an actuator (150) configured to rotate the optical sensor (15) about one or more rotation axes of the optical sensor such that the viewing direction (D) is displaced; The method comprises:

16. The method according to claim 14 or 15, comprising adjusting the viewing direction (D) by movement of the actuator (150) according to wireless adjustment commands received from a mobile device (7).

Images