How to position playback content within the viewing area of ​​the video rack rail screen

Abstract

A method for positioning playback content within the display area of ​​a screen 9 of a video rack rail 2, in which a digital image DA of the screen 9 and / or product display areas PBA, PBB, PBC, PBD extending along the screen 9 is captured using a camera 12, a positioning indicator and its position are automatically detected in the digital image DA using an image processing device 16, this positioning indicator indicates or defines the location of a product to be displayed along the screen 9, positioning data PBA, PBB, PBC, PBD are generated using the image processing means 16 based on the detected position of the positioning indicator, this positioning data PBA, PBB, PBC, PBD defines the location where the playback content is to be played within the display area 8, and the video rack rail 2 plays the playback content within the display area 8 of the screen 9 based on the positioning data PBA, PBB, PBC, PBD.

Description

[Technical Field]

[0001] The present invention relates to a method for positioning playback content within the display area of ​​a screen on a video rack rail. [Background technology]

[0002] Today, in stores, product information and / or price information is displayed on electronic display units, particularly electronic shelf labels known in technical terms as "Electronic Shelf Labels" (ESLs). These physical ESLs are manually fixed to rack rails that form the front part of the rack base at positions corresponding to the products to be placed on the rack base, and typically use electrophoretic screens to display essentially static product information and / or price information. Furthermore, Patent Document 1 discloses so-called video rack rails, which use video screens that form the front part of the rack rails to display video information (videos or video clips) related to products, and embed virtual ESLs in these video clips to display them corresponding to the product positions. In this case, the virtual ESLs are manually positioned using a remote control, for example, a tablet computer.

[0003] In the case of physical ESLs, misalignment between the configuration of each ESL and the corresponding product can only be eliminated by manual intervention, i.e., by manually shifting the ESL. This can be successfully done by an employee walking around the rack aisle, visually inspecting the configuration and immediately intervening if said misalignment occurs. The employee can successfully do this in conjunction with, i.e., in parallel with, their primary task, e.g., restocking the racks with products.

[0004] In the case of a virtual ESL, the employee must always carry a remote control with them, perform tasks through menu items when operating the remote control, and perform ESL configuration tasks by operating the remote control's user interface, so adapting the configuration is not so easy to implement. However, this process significantly interferes with the employee's main tasks, such as stocking up on merchandise, which is undesirable in terms of workflow. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Patent Publication No. 2019 / 091566 Summary of the Invention [Problem to be solved by the invention]

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a method for overcoming the aforementioned drawbacks of using video rack rails. [Means for solving the problem]

[0007] This problem is solved by a method according to claim 1. The subject of the invention is therefore a method for positioning playback content within the display area of ​​a screen of a video rack rail, comprising: a camera is used to capture a digital image of the screen and / or a product display area extending along the screen; automatically detecting, using image processing equipment, a placement indicator and its position within the digital image, the placement indicator indicating or defining the location of the item to be displayed along the screen; generating, using the image processing device, placement data based on the detected position of the placement indicator, the placement data defining where within the display area to play the playback content; The video rack rail plays the playback content within the display area of ​​the screen according to the placement data. It is a method.

[0008] The measures according to the invention make it possible for the first time to automatically position the playback content by automatically determining the positioning data, in particular with the advantage that this is possible completely without the manual assistance of supermarket staff. The positioning data thus obtained can also be used for the automatic positioning in different ways, in particular for changing the position of the playback content in the display area following a previous positioning, as will be discussed further below.

[0009] The playback content can be dynamically changing content, such as videos or video clips, or essentially static content, such as product and / or price information typically displayed by electronic shelf labels. In this case, each type of playback content is represented by playback data processed by the screen electronics of the video rack rail, which then displays the content at a defined display area within its display area. The individual playback content pieces can be positioned at individual display area locations within the display area, visually overlapping or obscuring each other. By overlaying a larger playback content piece with a smaller one, a picture-in-picture effect can be created for the viewer. For example, a video rack rail can be used to display a video on the one hand and, on the other hand, to overlay this video within a partial area of ​​the display area using a virtual ESL. For example, for a single product, an emotive video can be displayed along the entire length of the display area, while objective product and / or price information can be displayed at a predetermined location—specifically, within the display area, i.e., within a section of the video—using a virtual ESL. Of course, the display area can also be divided along its length according to different products along which the display area extends, so that for n products, for example, n videos, each with an embedded virtual ESL associated with the product, can be played next to each other. Instead of the essentially static content of the virtual ESL, dynamic content can also be played there.

[0010] Further particularly advantageous embodiments and refinements of the invention emerge from the dependent claims and the following description.

[0011] The product display area of ​​a rack is an area where products are displayed to customers. This area is usually a rack base arranged next to each other or on top of each other in different configurations. In this case, the front end of such a rack base, facing the customer, is defined by a video rack rail. However, the product display area can also be understood as an area where products are displayed, for example, hung next to each other and / or hung in a group and overlapping each other in different configurations. Here, the video rack rail can be arranged, for example, below the hanging products, in a suspended form, or fixed to the structure of the rack, for example, the rear end wall, a side partition wall, or a support.

[0012] A digital image is represented by image data generated by a camera when capturing moving or still images of a scene within the camera's field of view, which means that a digital image can be defined by a digital still image, a sequence of digital still images (e.g., in JPG or GIF format), or a digital video (e.g., in MP4 or MOV format).

[0013] Fully automatically detected position indicators can have very different properties or characteristics, which are discussed in more detail below.

[0014] The invention considered here is primarily used in the context of an ESL system with video rack rails as previously described.

[0015] For information visualization purposes, each video rack rail is equipped with a video screen. The ESL system includes multiple wireless base stations, also called access points, each of which provides a group of video rack rails with dynamic and static playback content adapted to the merchandise displayed on the rack base plate defined by each video rack rail.

[0016] The wireless technical allocation is carried out by selecting a suitable wireless channel in the ISM band to be used by each access point and by registering the video rack rail with the access point that manages it. For wireless communication, basically standardized wireless protocols such as ZigBee, Bluetooth, WLAN networks, wired LAN networks, etc. can be used.

[0017] These access points are themselves typically connected by cable to a higher-level or central control device, such as a local server running a software application (e.g., shop management software) that manages and controls the ESL or defines the visually recognizable playback content of the virtual ESL, or a cloud-based software application that controls the supply of playback content to the video rack rails and, in some cases, covers other aspects of merchandise management as well.

[0018] The method begins with automatic detection of location indicators and their locations using computerized image content and / or pattern detection using software running on a processor that is optimized for finding each identifying location indicator in a digital image produced by a camera, possibly having identifying characteristics, particularly characteristics that may already be known a priori.

[0019] In this case, in one embodiment of the method, an optical signal, in particular an optical signal in a spectral band invisible to humans, is detected as the location indicator. This optical signal makes the location indicator extremely easy to detect, since the intensity or spectrum of the optical signal is easily highlighted or distinguished from the background and therefore easier to find during digital search in a digital image than if the object were not illuminated. In a special embodiment, this optical signal can also be shifted into a spectral band invisible to humans, so that customers remaining in the store cannot sense the optical signal and therefore will not be stimulated by it. Naturally, the camera is optimized for the respective wavelength or spectral band of the optical signal to be processed.

[0020] Particularly advantageously, the optical signal is constituted by a time- and / or spatially varying signal. This type of signal can, on the one hand, improve the possibility of detection in a digital image, since changes in image content are often easier to automatically detect than static image content. In addition to the position at which the optical signal is transmitted and the position at which it is detected in the image, the optical signal can also be used to provide, for example, other information that can be detected in the context of detecting the optical signal in the digital image. This other information can, for example, be associated with goods that are found at or near the position of the optical signal.

[0021] A time-varying optical signal can be understood to be, for example, a flashing light signal. This light signal can be, for example, emitted from a single light source. A spatially varying optical signal can be understood to be, for example, a combination of possibly flashing light signals emitted from different light sources or positions, i.e., light signals generated by different light sources. A spatially and temporally varying optical signal can be understood to be, for example, a cloud of time-varying light points displayed on a screen.

[0022] In one variant, this optical signal can be output from a screen. For this purpose, the screen can be equipped with light-emitting diodes or the like integrated into its housing or into a frame surrounding the display area. The display area of ​​the screen can be used, for example, to emit a simple static light signal at a predetermined location, a simple flashing light signal, or to display a temporally and / or spatially variable pattern. In this case, such a pattern is particularly suitable for providing additional information by means of a corresponding coding. The driving of the light-emitting diodes or screen for the purpose of emitting the optical signal is performed here by the electronics of the video rack rail. In particular, when using the screen of the video rack rail to output the optical signal, for example, the display area can be optically segmented along its longitudinal extension, so that corresponding display segments appear along the longitudinal extension of the rack base. This can be detected in a digital image of the display area by an image processing device and can be used, for example, to generate positioning data in the form of positioning virtual ESLs within the display area of ​​the screen of the video rack rail so as to coincide with the centers of each display segment.

[0023] In another embodiment, the optical signal is output from a rack separator located within the product display area. The rack separator is a generally plate-shaped object placed on the rack base, which spatially separates two products or product groups from one another by separating them on the left and right sides of the rack. This allows the playback content displayed using the video rack rail to be played back without being disturbed by the output of the optical signal. In this case, signal transmission by the optical signal is performed spatially separated from the video rack rail and therefore does not interfere with the customer's perception of the playback content. For this purpose, the rack separator has one or more light-emitting diodes on its front and / or upper housing side, or in the intersection area between these two housing sides, which are driven by the rack separator's electronics housed within the housing. The front housing side faces the area in front of the rack and is the side that generally faces the video rack rail. The upper housing side is the side opposite the rack base on which the products are displayed. Depending on the configuration of the rack separator used and the spatial context of the rack, the camera should be positioned so that it can detect one or more light emitting diodes of the rack separator installed within the rack.

[0024] In another implementation, the presence of products or product groups in the product display area is detected as a position indicator. This implementation has the advantage that no additional light sources or signaling by the screen itself is required. This reduces both the technical and investment burden on the side of the video rack rail and, possibly, on the side of optionally provided rack separators or the like. In this example, the computerized image content and / or pattern detection is directed to products or product groups that can be found in the rack by computerized image evaluation in order to arrive at the position data.

[0025] The following describes how the placement data is used to control the placement of playback information.

[0026] In a first implementation of the placement data processing, the placement data is output from the image processing device to a higher-level control device, which controls the placement of the playback content within the display area of ​​the screen of the video rack rail, particularly the video rack rail that detected the digital image, based on the placement data, particularly individually for a large number of such video rack rails.

[0027] This higher-level control device may be a server installed in a retailer's store that processes software that supplies playback data to each video rack rail. This playback data represents static and / or dynamic playback content to be displayed on each screen across its entire display area. That is, the higher-level control device embeds or "merges" various individual playback contents in advance, taking into account the placement data, and then outputs the generated playback data to the video rack rail, allowing the entire playback content represented thereby to be visualized on the screen.

[0028] However, this higher level control equipment can also be provided as a cloud-based software solution hosted on a server or using a server farm in a computing center and made available to retailers over the internet for the aforementioned purposes.

[0029] In this way, for example, a background video can be played that fills the entire display area, and virtual price labels can be overlaid in the display area on the background video, corresponding to or belonging to different products arranged next to each other in a rack. The arrangement of the virtual price labels representing the played information to be arranged in the display area is described here by arrangement data, which is used by the control device to arrange the price label / labels along the width of the display area.

[0030] The higher-level control device transmits the playback data determined for each video rack rail as a data stream to the video rack rail for real-time playback thereon. The higher-level control device can also transmit the playback data to the video rack rail in the form of a data packet to be transmitted once, where the data packet is stored and repeatedly played (i.e., the playback content defined thereby is repeatedly played, for example, as a locally stored video clip or video film).

[0031] Furthermore, for example, the aforementioned background video can also be spatially segmented along the longitudinal extension of the display area of ​​the screen of the video rack rail, with each video segment constituting a separate dynamic playback content for a specific product among the different products displayed next to each other in the rack. The arrangement of the individual video segments along the width of the display area is described here by arrangement data, which the control device uses to arrange the individual video sequences along the width of the display area. In this case, the display width of each individual video sequence can also be automatically set by the control device taking into account the arrangement data, so that, for example, the entirety of the video segments displayed next to each other fills the entire width of the display area. Dark or color-highlighted image areas can also be provided between the individual video sequences to better optically distinguish or visually separate these image areas along the width of the display area. In this example, virtual price labels can also be positioned along the display area, for example, centered within the sub-area of ​​the display area occupied by each video segment. In this example, the higher-level control device also uses the placement data directly to place the virtual price labels, or indirectly, i.e., after placing the video sequence, uses it to place the virtual price labels by referencing the placed video sequence.

[0032] In a second embodiment of the positioning data processing, the positioning data is output directly from the image processing device to the video rack rail that has detected a digital image of the screen or the product display area extending along the screen, and the video rack rail controls the positioning of the playback content within the display area of ​​the screen of the video rack rail based on the positioning data. In this case, the functions considered in the first embodiment of the positioning data processing can still be realized, but now these functions are realized directly by the electronics of each video rack rail. For this purpose, in any case, a background video, possibly a video sequence, and an appropriate number of virtual rack labels are transmitted digitally from the central control device to each video rack rail. In particular, the transmission of both the background video and the video sequences can be carried out from the control device to the video rack rail as a continuous video stream or as individual downloads, as described above. The transmission of each virtual rack label is realized as a download if the virtual rack label is content-static. This does not have to be the case, but transmission to the video rack rail can be advantageous even if the virtual rack label is content-dynamic. In this case, the second embodiment, in particular, has the advantage that the task of arranging each playback content is distributed to each video rack rail, i.e., there is no need to plan for the provision of large computing power in a central control device, and the data traffic between the control device and the video rack rail is limited to the provision / transmission of each playback content, and possibly only its initial arrangement. Since video rack rails already have the ability to play videos by definition, it is easy for the electronics integrated therein, and possibly also for the software used therein, to execute high-performance software that can perform both the dynamic playback content arrangement and the static playback content arrangement discussed above. In other words, the digital resources distributed among the video rack rails, such as memory and computing power, are optimally utilized not only for pure playback but also for performing automatic arrangement of playback content to be played.This significantly reduces the load on the upper central control equipment in large scale installations such as large supermarkets that may deploy thousands of video rack rails.

[0033] As already discussed generally, the placement data describes the placement of the video rack rails within the display area. In particular, the placement data may describe or represent the placement within the display area in at least one of the following formats: a) A single coordinate defining a position within the display area along one direction, e.g., describing the aforementioned arrangement along the length of the display area parallel to the longitudinal extension of the underlying rack base, i.e., figuratively describing the coordinates along the different products or product groups found along the longitudinal extension of the rack base. Such an arrangement definition starts from the assumption that all playback content is arranged, for example, at the bottom edge of the display area or at a fixed distance from it, or is divided into different groups (dynamic / static or video / label) at different distances from the display area below. b) A coordinate pair defining the position of a point within the display area. The use of this coordinate pair allows for complete flexibility in the placement relative to the periphery of the display area, whereby the playback content can be freely selected and placed within the display area. c) A line segment within the display area. The definition of a line segment also allows scaling of each display content, where the playback content can be scaled not only along this line segment, i.e., in one dimension, but also proportionally in the second dimension (orthogonal to this line segment). d) Plane within the display area. This definition allows the playback content to be freely selected and positioned within a given plane whose position within the display area is also defined, or to be restricted to an area. The playback content can also be scaled for display within this plane in at least one dimension, advantageously proportionally in two orthogonal dimensions, to fit the defined plane. e) A portion of the display area, in particular a portion corresponding to a product display area extending along the screen. This interpretation of the positioning data is particularly advantageous when positioning the aforementioned video sequences in different sections of the display area along its length.

[0034] The configuration data can in principle be generated at any time and can also be used persistently for configuration after its generation. However, it has proven particularly advantageous to use the configuration data only under the following conditions for configuring the playback information: a) the condition that the spatial change of the configuration defined by the configuration data compared to the currently existing configuration exceeds a predefined threshold, in particular a predefined fixed threshold or a threshold that changes dynamically over time; and / or b) the condition that the time span for taking into account the placement data exceeds a time threshold, in particular a time threshold defined by the typical dwell time of a customer in front of the video rack rail;

[0035] This aspect of the invention takes into account the situation where, as mentioned above, it is often not desirable at all to immediately implement configuration data generated directly by the video rack rail or similarly generated by a central control device, since even if the position of the reproduced content is often only slightly changed in location, it may still cause frequent changes, which may annoy viewers of the video rack rail. Therefore, it is advantageous to evaluate the new configuration of the reproduced content provided by the configuration data, and in this evaluation check whether the new configuration should be implemented at all.

[0036] For example, if the spatial differences compared to the previous arrangement are too small, the new arrangement can be postponed. The dimensions of the products or product groups along the video rack rail can play a role in assessing whether these spatial differences are noteworthy or not. For example, this can ensure that minimal spatial differences that are possible within the scope of the camera's capture, for example due to changes in lighting conditions or shadows, can be suppressed (i.e., not noted). On the other hand, larger spatial differences, such as those that may occur when placing or removing products already on the rack, or as a result of refilling the rack, are taken into consideration.

[0037] Furthermore, a time span can be incorporated into the evaluation of whether a difference is significant. This can be, for example, a fixed threshold value of several seconds to several minutes, in which case the identified location change is only considered after the time threshold has elapsed. Preferably, however, this time threshold is related to the customer's usual dwell time in front of the rack. This ensures that the location change of the arrangement is only realized when the customer has left the rack or the location in front of the rack. This measure can be very advantageous, for example, when multiple identical products are arranged next to each other and a virtual label is to be placed in the center of these products. If an item is removed from the end area of ​​the product group and the arrangement data is used to indicate a new arrangement of the virtual label for the remaining items, this new arrangement can wait until the customer has left the rack.

[0038] In principle, the cameras and image processing equipment can be designed separately from each other. This can be advantageous, for example, if the cheapest possible cameras are used and the digital images acquired with the cameras are transferred to a central image processing equipment for the group of cameras, for example, on a group-by-group basis, where the configuration data is generated. However, it is more advantageous if the cameras and image processing equipment are integrated into a single equipment, in particular if the image processing equipment is integrated into the cameras, and the configuration data is output wirelessly directly to the video rack rails or to a higher-level control equipment, which then drives many, in particular all, of the video rack rails in the store with the individual playback content, or both. While this measure does require a special camera configuration, it simultaneously results in an infrastructure that is extremely easy to install, since the number of components to be installed is reduced by the amount of additional image processing equipment or the connections of this equipment to the cameras that would otherwise be required.

[0039] As already mentioned, it is advantageous to apply the method in a manner that uses one camera for multiple playback contents determined for playback on one screen, i.e. it is possible to use a single camera to arrange different playback contents for each screen.

[0040] Furthermore, it is particularly advantageous to apply this method in a manner in which a single camera is used for multiple playback contents determined for playback on multiple screens installed on rack bases arranged side by side or on top of each other. This means that a single camera can be used to arrange different playback contents on multiple screens arranged adjacent to each other vertically and horizontally, i.e., a grouping of screens for a single camera can be obtained. As long as the rack is within the camera's viewing area, a single camera can also be used to control the arrangement of playback contents for an entire rack, or even for multiple racks in some cases.

[0041] The screens present in the shooting area can be uniquely identified to the camera or image processing equipment, for example by a visualized symbol, so that the allocation of playback content to these screens and the positioning data determined therefor are unique.

[0042] For example, during the initialization phase of the system or "on demand," i.e., when this is signaled "on demand" by the camera itself or a central server using a command to the video rack rail, the video rack rail can (especially for a short time) display a symbol for carrying out a calibration of the system or of each camera. This ensures that the camera can carry out an unambiguous assignment between the display area of ​​each screen and the localized surroundings adjacent to it, in particular within the rack, while of course also taking into account the respective field of view of each camera. In this case, the camera stores the position and extent of the display area of ​​each screen and incorporates this information during the processing of the digital images by the image processing device. The symbol displayed for this purpose can be, for example, a line displayed along the outer edge of the display area, i.e., a line indicating the extent of the available display area. Additionally, this can be done by an alphanumeric display in the form of a barcode or QR code or an unambiguous identification chart, which is photographed during initialization or calibration so that it can be accessed during subsequent operation.

[0043] Finally, it should be noted that, generally speaking, the electronic devices discussed herein naturally include electronic components. These electronic components may consist of discrete or integrated electronic components, or a combination of the two. Microcomputers, microcontrollers, and application-specific integrated circuits (ASICs) may also be used, sometimes in combination with analog or digital electronic peripheral modules. Software running on the electronic device's processor enables many of the aforementioned functions of these devices, sometimes in concert with hardware components. Devices configured for wireless communication typically include an antenna arrangement for transmitting and receiving wireless signals as part of a transceiver module. Furthermore, these electronic devices may include an internal power source, which may be implemented using a replaceable or rechargeable battery. These devices may also be powered in a wired configuration by an external power supply unit, using "Power over LAN" or by a power-transmitting wireless signal.

[0044] These and other aspects of the present invention will become apparent from the drawings discussed below.

[0045] The invention will now be described in more detail again by way of example with reference to the accompanying drawings, in which the invention is not limited to these examples, in which the same elements in the different drawings are given the same reference numerals. [Brief explanation of the drawings]

[0046] [Figure 1] Schematic partial view of an ESL system with a rack mounted video rack rail showing an initially deployed virtual ESL. [Figure 2] Schematic diagram of the camera used in the ESL system [Figure 3] FIG. 1 is a schematic diagram of a configuration for automatically changing the layout of a virtual ESL according to a first embodiment of the present invention; [Figure 4]Schematic diagram of another configuration that automatically changes the layout caused by product removal. [Figure 5] FIG. 10 is a schematic diagram of a configuration for automatically changing the layout of a virtual ESL according to another embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0047] 1 illustrates an electronic shelf label system 1, hereinafter referred to as "system 1" for short, that uses video rack rails 2. Such a system 1 may be based solely on video rack rails 2, or may comprise a mixed infrastructure consisting of video rack rails 2 that can display both dynamic playback content and virtual electronic shelf labels (virtual ESLs for short), and physical electronic shelf labels (physical ESLs for short), which typically can only display static playback content. The present invention focuses solely on the racks 3 in this system 1 and the equipment required for the operation of the video rack rails 2 attached thereto.

[0048] The system 1 includes a central server 4 that stores the store's planogram. This planogram is a data structure that represents or describes the locations of products and their associated virtual ESLs (as well as the physical ESL locations) that are logically associated with each product, and their three-dimensional locations within the store, specifically on racks and their attached rack bases. Each ESL is identifiable by a unique ESL code. The same is true for different products or product groups. In this example, the locations of the video rack rails are also listed in the planogram, and each video rack rail is also uniquely identifiable using a unique video rack rail code.

[0049] This server 4 provides both static and dynamic playback content for display using the video rack rail 2 and physical ESLs, although in this example only the video rack rail 2 will be discussed.

[0050] The playback data WD representing each playback content is transmitted from the server 4 to each video rack rail 2 by means of a wireless base station 5, called base station 5 for short, and stored there. The video rack rails 2 themselves each have a well-known wireless communication stage for video rack rails, not shown in detail, and are integrated into the wireless network of the base station 5 by means of this stage.

[0051] Although only a single base station 5 is shown in this example, in an actual installation, a plurality of such base stations 5 are naturally installed dispersedly throughout the store, and the video rack rails 2 are assigned to such base stations 5 in groups using wireless communication technology. In this case, different wireless channels in one frequency band are used by spatially adjacent base stations 5 to communicate with each group of video rack rails 2.

[0052] The server 4, knowing the allocation of the video rack rails 2 to the base stations 5, can therefore address each individual video rack rail 2 as intended and transmit to the video rack rail the playback content appropriate for the products 6A-6D displayed on each rack bottom 7 of the rack 3. In this case, to avoid over-decorating the drawing with product identification codes, not all products 6A-6D are labeled, but different products 6A-6D are uniquely identifiable by their special shapes. In this case, the server 4 also transmits initial placement data PDI, which the video rack rail 2 uses to position or arrange the playback content within the display area 8 of its (video) screen 9. The display area 8 is delimited by a dashed line, indicating that the screen 9 is surrounded by a thin (not overly noticeable) frame. Naturally, this frame can be very thin, or it can be omitted entirely.

[0053] In this example, it is assumed that a background video showing a panoramic landscape scene is transmitted as dynamic playback content to the video rack rail 2, and that the video rack rail plays this background video so as to fill the display area 8. Two product groups are displayed side by side on each of the two rack bases 7: products 6A and 6B are displayed side by side on the upper rack base 7, and products 6C and 6D are displayed side by side on the lower rack base 7. In this example, the upper rack base 7 displays hiking products, such as hiking socks 6B packaged in elongated, relatively flat packaging, and hiking shoes 6A packaged in a relatively three-dimensional package. Products 6C and 6D displayed on the lower rack base 7 also have different packaging shapes, at least for the purposes of this discussion.

[0054] Thus, in this example, virtual ESLs 11A-11D represent product information and / or price information for the corresponding products 6A-6D, and these virtual ESLs 11A-11D are transmitted as static playback content from the server 4 to each video rack rail 2 together with the initial placement data PDI. Thereafter, each video rack rail 2 displays the corresponding virtual ESL 11A-11D within the display area 8 based on the position given by the initial placement data PDI. In this example, the virtual ESLs 11A-11D are initially positioned at the left or right edge of the display area 8, respectively. In this case, each virtual ESL 11A-11D, which fills only a small portion of the display area, is displayed in front of the background video. In other words, each background video is partially obscured by the corresponding ESL 11A-11D.

[0055] The system 1 further comprises a camera 12 fixed to a structure 13, not described in further detail, which may be, for example, a wall, a ceiling, a pillar or another rack in a store, from which the rack 3 to be photographed by the camera 12 can be seen unobstructed.

[0056] As shown in FIG. 2, the camera 12 includes a lens 14, typically used for digital image capture, and associated camera electronics 14A. This electronics executes at least first software implementing an image capture stage 15, which creates a digital image DA of the rack 3 together with all objects present therein, i.e., the products 6A-6D and the screen 9 of the video rack rail 2. The camera electronics 14A also executes second software implementing an image processing device 16, which is used to detect the placement indicators and their positions in the digital image. The second software is therefore optimized for pattern recognition in the digital image. The camera also includes a well-known camera wireless communication stage, not shown. This stage allows the camera 12 to be integrated into the wireless network of the base station 5 and to communicate with both the server 4 and the video rack rail 2.

[0057] In this example, in the rack 3, the different products 6A-6D are directly detected by the image sensing device 16 based on their different packaging, their shape or dimensions, or their labels (or by a combination of evaluating these aspects) and a display area PBA, PBB, PBC, PBD for each group of products 6A-6D is identified by determining the respective areas they occupy in groups along the respective screens 2 or display areas 8. In a further step, the centres of each display area PBA, PBB, PBC, PBD are identified and their absolute positions along the longitudinal extension of the display area 8 (e.g. measured from the left edge of the display area) are generated using the individual positioning data PDA for the first virtual ESL 11A, the individual positioning data PDB for the second virtual ESL 11B, the individual positioning data PDC for the third virtual ESL 11C and the individual positioning data PDD for the fourth virtual ESL 11D.

[0058] Within the scope of the data processing of the image processing device 16, each virtual ESL 11A-11D is also automatically detected, so that the ESL 11A-11D in question is uniquely identified. This unique identification can be achieved by evaluating the product information and / or price information of each virtual ESL 11A-11D, by detecting a unique identification code displayed with each ESL 11A-11D, or by determining the position of each ESL 11A-11D within the display area 8 of each screen 8. Since the video rack rail 2 stores one or more of the product information and / or price information of the virtual ESL 11A-11D, the identification code of the ESL 11A-11D in question, and / or the position of the ESL 11A-11D that obscures the video in any instance, the video rack rail 2 in question knows at least one of the three parameters necessary for the unique identification of the virtual ESL 11A-11D in question in any case.

[0059] Subsequently, the positioning data PDA-PDD generated for each of the virtual ESLs 11A-11D is transmitted from the camera 12, which is also incorporated into the wireless network of the base station 5, to the corresponding video rack rail 2, where it is used to position each of the virtual ESLs 11A-11D. That is, by the control action of the positioning data PDA-PDD, the positions of the virtual ESLs 11A-11D are changed so that each of the virtual ESLs 11A-11D is positioned exactly at the center of each of the exhibition areas PBA-PBD.

[0060] It should also be noted here that the camera 12 can be configured to output, in addition to the position data PDA to PDD, data representing the digital image DA as such, i.e., raw data from the image detection unit or raw data that has already been preprocessed.

[0061] The new arrangement of the virtual ESLs 11A to 11D is illustrated in FIG. 3, where the arrows FA to FD indicate the positional deviation of each virtual ESL 11A to 11D along the longitudinal extension of the display area 8 of each video rack rail 2 or its screen 9 caused by each of the arrangement data PDA to PDD, compared to each of the initial positions, similar to that illustrated in FIG. 1.

[0062] Similarly, an automatic distribution of the available display width for four different background videos that make up the dynamic playback content can also be performed, taking again the situation according to FIG.

[0063] First, for example, four background videos are planned or displayed per rack bottom panel 7, distributed 50% / 50% along the display area. If the image processing device detects that a first product 6A occupies only 40% of the longitudinal extension of the screen 9 or its display area 8 on the upper rack bottom panel 7 and a second product 6B occupies 60% of the longitudinal extension, corresponding first and second positioning data PDA and PDB are generated on the upper video rack rail 2, defining a 40% playback width for the background video accompanying the first product 6A and a 60% playback width for the background video accompanying the second product 6B. These two background videos are scaled accordingly and displayed in a manner that fits the display areas PBA and PBB. To prevent unnatural distortions that may occur due to non-proportional scaling of the width and height of the video images, it is also possible to specify that the portion of the background video that fits each product display area PBA or PBB is displayed therein.

[0064] The same is true for the lower video rack rail 2, in which the third product 6C occupies approximately 70% of the longitudinal extent of the display area 8 and the fourth product 6D occupies approximately 30%. The lower video rack rail 2 correspondingly programs the image processing device 16 to display the third background video in 70% of the longitudinal extent of the display area 8 corresponding to the third display area PBC and to display the fourth background video in 30% of the longitudinal extent of the display area 8 corresponding to the fourth display area PBD.

[0065] 4, it can be assumed that the product display area PBA has changed due to the removal of a product, specifically, with respect to product 6A, the right-hand product 6A of the two products 6A-6B has been removed from the top rack bottom plate 7, causing the product display area PBA to be approximately halved in its longitudinal dimension along the display area 8 and shifted from its center toward the left. This change is detected by the image processing device 16 of the camera 12, which generates new positioning data PDA for the first virtual ESL 11A and transmits this positioning data to the top video rack rail 2, where it finally causes the first virtual ESL 11A to be newly centered relative to the remaining product 6A. This is represented by the arrow FA indicating the shift of the first virtual ESL 11A compared to its position shown in FIG. 3.

[0066] In another embodiment of the invention, the arrangement of the products 6A-6D, and possibly also the arrangement of the display areas PBA-PBD assigned to them, can be represented by so-called rack separators 17A-17D shown in Figure 5, which in this case constitute arrangement indicators that are automatically detected by the image processing device 16, in contrast to Figure 1 where the products 11A-11D themselves constitute arrangement indicators.

[0067] In this case, the rack separators 17A-17D can be identified in the digital image DA by the image processing device 16 on the basis of their special shape, which makes them clearly distinguishable from the products. However, advantageously, the rack separators also include rack separator electronics (not shown) configured for wireless communication over the wireless network of the base station 5. During such wireless communication, each rack separator 17A-17D transmits identification data that uniquely identifies the products 6A-6D arranged adjacent to it. The rack separator electronics also include optical fibers connected to LEDs 18A-18D visible from the outside through the front or top side of the housing or integrated into the housing. Using these LEDs 18A-18D, the rack separator electronics of each rack separator 17A-17D emits a varying (modulated or flashing) light signal, which also emits the unique identification data as information content. Using the individual optical signals, the individual rack separators 17A-17D are detected as placement indicators by the image processing device 16, and their positions are also detected.

[0068] By definition, the rack separators 17A-17D in this example are disposed to the right of each of the products 6A-6D, as shown in FIG. 5 . The first product display area PBA extends between adjacent rack separators 17A and 17B. The third product display area PBC extends between adjacent rack separators 17C and 17D. The second product display area PBB extends leftward from the second rack separator 17B to the end of the upper rack bottom plate 7 or the upper video rack rail 2. The fourth product display area PBD extends leftward from the fourth rack separator 17D to the end of the lower rack bottom plate 7 or the lower video rack rail 2. Of course, a terminal rack separator (not shown) that sends a neutral optical signal and is used solely to define the display areas PBB and PBD can also be provided on the left side of each rack bottom plate 7.

[0069] Based on this configuration, the image processing device 16 can generate placement data for the virtual ESLs 11A to 11D and transmit this data wirelessly to the video rack rail 2, where a new placement of the virtual ESLs 11A to 11D is performed in the same manner as in Figure 3.

[0070] The background video placement discussed previously can also be implemented using rack separators 17A-17D in a similar manner.

[0071] In many cases, actively light-emitting position indicators are easier to detect by the image processing device 16 than using the product itself as the position indicator. This reduces the error rate and significantly accelerates the detection or identification process. Therefore, other actively light-emitting objects may also be used as position indicators. These may only be suitable for designating or defining the location of products displayed along the screen.

[0072] Finally, it is pointed out once again that the figures described in detail above are merely examples which can be modified in various ways by those skilled in the art without departing from the scope of the invention. For the sake of completeness, it is also pointed out that the use of the indefinite article "ein" or "eine" does not exclude the possibility of a plurality of features in question. The present application relates to the invention described in the claims, but may also include the following configurations as other aspects. 1. A method for arranging playback content within a display area (8) of a screen (9) of a video rack rail (2), comprising: A digital image (DA) of the screen (9) and / or the product display area (PBA, PBB, PBC, PBD) extending along the screen (9) is taken using a camera (12); using image processing equipment (16) to automatically detect the location indicator and its position within the digital image (DA), the location indicator indicating or defining the location of the displayed item along the screen (9); generating, using the image processing device (16), location data (PDA, PDB, PDC, PDD) based on the detected position of the location indicator, the location data (PDA, PDB, PDC, PDD) defining where in the display area (8) the playback content is to be played; The method in which the video rack rail (2) plays the playback content within the display area (8) of the screen (9) based on the configuration data (PDA, PDB, PDC, PDD). 2. In the method according to item 1 above, The method wherein the automatic detection of the placement indicators is performed using computerized image content and / or pattern detection. 3. In the method according to 1 or 2 above, The method in which optical signals, particularly optical signals in spectral bands invisible to humans, are detected as position indicators. 4. In the method according to the above item 3, The method wherein said optical signal comprises a time- and / or spatially varying signal. 5. In the method according to 3 or 4 above, The method wherein the optical signal is output from a screen (9). 6. In the method according to 3 or 4 above, The method wherein the optical signal is output from rack separators (17A, 17B, 17C, 17D) located within the product display areas (PBA, PBB, PBC, PBD). 7. In the method according to 1 or 2 above, The method detects a product (6A, 6B, 6C, 6D) or a group of products within a product display area (PBA, PBB, PBC, PBD) as a placement indicator. 8. In the method according to any one of 1 to 7 above, The arrangement data (PDA, PDB, PDC, PDD) is output from the image processing device (16) to a higher-level control device, and this control device controls the arrangement of the playback content within the display area of ​​the screen (9) of the video rack rail (2) based on the arrangement data (PDA, PDB, PDC, PDD), particularly in this method for individually controlling a plurality of such video rack rails (2). 9. In the method according to any one of 1 to 8 above, The method includes outputting the placement data (PDA, PDB, PDC, PDD) directly from the image processing device (16) to the video rack rail (2) that has detected the digital image (DA), and the video rack rail (2) controls the placement of the content being played within the display area of ​​the screen (9) of the video rack rail (2) based on the placement data (PDA, PDB, PDC, PDD). 10. In the method according to 8 or 9 above, The above-mentioned location data (PDA, PDB, PDC, PDD) are in the following formats: A single coordinate defining a position within the display area along one direction, a pair of coordinates defining the position of a point within the display area, Lines in the display area, Surfaces within the viewing area, A part of the display area, in particular a part corresponding to the product display area (PBA, PBB, PBC, PBD) extending along the screen (9), The method for describing or expressing the arrangement form in the display area by at least one of the above. 11. In the method according to any one of 8 to 10 above, The above-mentioned location data (PDA, PDB, PDC, PDD) The condition that the spatial change of the configuration caused by the configuration data (PDA, PDB, PDC, PDD) in comparison with the currently existing configuration exceeds a predefined threshold, in particular a predefined fixed threshold or a threshold that changes dynamically over time; and / or the time span for taking into account the location data (PDA, PDB, PDC, PDD) exceeds a time threshold, in particular a time threshold defined by the typical dwell time of a customer in front of the video rack rail (2); The method used to place playback information only under 12. In the method according to any one of 1 to 11 above, The camera (12) and the image processing device (16) are integrated into one device, in particular, the image processing device (16) is integrated into the camera (12); The method in which the above-mentioned configuration data (PDA, PDB, PDC, PDD) is wirelessly output directly to the video rack rail (2) and / or to a higher-level control device, and this higher-level control device controls multiple, particularly all, of the video rack rails (2) in the store using individual playback content. 13. In the method according to any one of 1 to 12 above, The method is applied in a manner that uses one camera (12) for multiple playback contents determined for playback using one screen. 14. In the method according to any one of 1 to 13 above, This method is particularly applied in the form of using one camera (12) for multiple playback contents determined for playback using multiple screens (9) installed on rack bases arranged side by side or on top of each other.

Claims

1. A method for arranging playback content within a display area (8) of a screen (9) of a video rack rail (2), comprising: A digital image (DA) of the screen (9) and / or the product display area (PBA, PBB, PBC, PBD) extending along the screen (9) is taken using a camera (12); using image processing equipment (16) to automatically detect the location indicator and its position within the digital image (DA), the location indicator indicating or defining the location of the displayed item along the screen (9); Using the image processing device (16), location data (PDA, PDB, PDC, PDD) is generated based on the detected position of the location indicator, and the location data (PDA, PDB, PDC, PDD) defines where to play the playback content within the display area (8); The video rack rail (2) plays the playback content in the display area (8) of the screen (9) based on the configuration data (PDA, PDB, PDC, PDD), The above-mentioned placement data (PDA, PDB, PDC, PDD) The condition that the spatial change of the location of the playback content caused by the location data (PDA, PDB, PDC, PDD) compared to the currently existing location of the playback content exceeds a predefined threshold or a predefined fixed threshold or a threshold that dynamically changes over time, and / or the time span for taking into account said location data (PDA, PDB, PDC, PDD) exceeds a time threshold or a time threshold defined by the typical dwell time of a customer in front of the video rack rail (2); The method used to place playback information only under

2. 10. The method of claim 1, The method wherein the automatic detection of the placement indicators is performed using computerized image content and / or pattern detection.

3. 3. The method according to claim 1 or 2, The method wherein an optical signal or an optical signal in a spectral band invisible to humans is detected as the position indicator.

4. 4. The method of claim 3, The method wherein said optical signal comprises a time- and / or spatially varying signal.

5. 5. The method according to claim 3 or 4, The method wherein said optical signal is output from a screen (9).

6. 5. The method according to claim 3 or 4, The method wherein the optical signal is output from rack separators (17A, 17B, 17C, 17D) located within product display areas (PBA, PBB, PBC, PBD).

7. 3. The method according to claim 1 or 2, The method detects as placement indicators products (6A, 6B, 6C, 6D) or product groups present within product display areas (PBA, PBB, PBC, PBD).

8. The method according to any one of claims 1 to 7, The arrangement data (PDA, PDB, PDC, PDD) is output from the image processing device (16) to a higher-level control device, and the control device controls the arrangement of the playback content within the display area of ​​the screen (9) of the video rack rail (2) based on the arrangement data (PDA, PDB, PDC, PDD), or controls such multiple video rack rails (2) individually.

9. The method according to any one of claims 1 to 8, The method includes: an image processing device (16) directly outputting the placement data (PDA, PDB, PDC, PDD) to a video rack rail (2) that has detected a digital image (DA); and the video rack rail (2) controls the placement of the content being played within the display area of ​​the screen (9) of the video rack rail (2) based on the placement data (PDA, PDB, PDC, PDD).

10. 10. The method according to claim 8 or 9, The above-mentioned placement data (PDA, PDB, PDC, PDD) is in the following manner: A single coordinate defining a position within the display area along one direction, a pair of coordinates defining the position of a point within the display area, Lines in the display area, Surfaces within the viewing area, Part of the display area, or A portion corresponding to the product display area (PBA, PBB, PBC, PBD) extending along the screen (9), The method for describing or expressing the arrangement form in the display area by at least one of the above.

11. The method according to any one of claims 1 to 10, The camera (12) and the image processing device (16) are integrated into one device, or the image processing device (16) is integrated into the camera (12); The method involves wirelessly outputting the placement data (PDA, PDB, PDC, PDD) directly to the video rack rail (2) and / or to a higher-level control device, which then controls multiple or all of the video rack rails (2) in the store using the individual playback content.

12. The method according to any one of claims 1 to 11, The method is applied in a manner that uses one camera (12) for multiple playback contents determined for playback using one screen.

13. The method according to any one of claims 1 to 11, The method is applied in a form in which one camera (12) is used for multiple playback contents determined for playback using multiple screens (9) installed on a rack base plate arranged side by side or on top of each other.

Images