Interactive audio media system for advertising in supermarket freezers
The integration of touch sensors, voice interaction, and AI-enhanced consumer interaction with supermarket freezers addresses interactivity and sound interference, enabling real-time product information retrieval and accessibility for all consumers.
Patent Information
- Application Number
- PCT/BR2025/050065
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-21
- Filing Date
- 2025-02-20
- Publication Date
- 2025-08-28
AI Technical Summary
Existing supermarket freezer advertising systems lack interactivity and real-time information provision, and suffer from sound interference between multiple speakers.
Incorporation of touch sensors, open/closed door sensors, voice interaction devices, microphones, cameras with computer vision, barcode/QR code readers, and AI technology to enable consumer interaction and product information retrieval, along with sound reverberation through vibration speakers, and a communication bus to prevent sound interference.
Enhances consumer interaction and information accessibility, reduces sound interference, and provides real-time product information via audio, benefiting consumers with visual impairments or the elderly.
Smart Images

Figure BR2025050065_28082025_PF_FP_ABST
Abstract
Description
Descriptive Report of the Invention Patent for "Interactive audio media system for advertising in supermarket freezers". Field of Invention
[0001] This Interactive Media system was developed for supermarket advertising, that is, a device that allows advertising and publicity through audio in vertical and horizontal supermarket freezers, or shelves, where to produce the sound, it uses a vibration speaker (2) through the player (4) that contains and downloads the audios through the platform with signage software present on the Internet (5). As is known, these freezers can be single, with one door or with several doors, vertical and horizontal. Fundamentals of the Invention
[0002] The present invention aims at a more complete system of the following patents, BR 102018000339-9, which deals with a system composed of an electronic and electromechanical system (2) that, upon receiving a stimulus, generates an audio or sound through a vibration speaker (2), which reverberates the walls of the environment where it is fixed, thus generating sound. This Interactive Media system was developed for supermarket advertising, that is, a device that allows advertising and propaganda through audio in vertical and horizontal supermarket freezers, where to produce the sound, a vibration speaker (2) is used and through the player (4) that contains and downloads the audios, connected to the signage software present on the Internet (5). As is known, these freezers can be single, with one door or with several doors.
[0003] Patent BR 132023014546-8 is composed of one or several electromechanical electronic devices (2) that, upon receiving a stimulus, reproduce an audio or sound through one of the several vibration speakers (2) installed near the doors, which reverberate the walls of the environment where it is fixed, thus generating sound, which allows a single player (4) to reproduce the same or different messages on several doors, and have the control of not generating messages on neighboring doors when one is reproducing the sound, thus not causing sound interference, all of this connected to the internet (5) and with signage software providing the audios that must be downloaded by the player (4) to its specific port.
[0004] Patent BR 10 2023 023981 1 deals with the development of a solution to allow the incorporation of the vibration speaker (2) in a high humidity and low temperature environment such as the freezer, making it immune to corrosion and allowing its operation and constructed of material that, in contact with the speaker (2), reverberates due to vibration, generating the sound. Fundamentals of the Invention
[0005] The innovation of this patent, which is detailed below, is due to the incorporation, in addition to touch sensors (7), open or closed door sensors (3), of devices that allow consumers to interact via voice (6), allowing consumers to interact by presenting a product to a barcode or QR code reader (31), and to hear specific information about that product, such as price. Interactivity through a camera with computer vision software (9), which, when recognizing the object that the consumer is interacting with, provides more information, all through sound messages played by the speaker (2). It is also possible, using the same signage platform, to inform the status of the freezer, reading the temperature and energy consumption (32).
[0006] For this purpose, microphones (6) were added externally or internally to the freezer, presence sensors or cameras. (9), barcode and QR code readers ld / 2d (31) that through a NUC-PC (4) or player with greater processing capacity and with command control of the peripherals (10) (11) (12) (25) (32) (31) , with the Player (4) connected to the internet (5) thus allowing greater interactivity, not previously possible.
[0007] The microphones (6) will allow interactivity with the consumer, through AI technology, such as Talkio AI and ChatGPT, where questions can be asked by the consumer and through the speaker (2) receive more information about products, recipes, and other messages.
[0008] Through the camera(s) (9) with computer vision, or with computer vision software installed on the Player (9), recognize the image of products that the consumer is interacting with and, upon recognizing the object or product and also through AI, provide more information to the consumer via audio message.
[0009] Through the LD / 2D barcode and / or QR-code reader device (31), which is installed on the equipment and interconnected via ModBus or RS485, USB, the customer can obtain voice messages about the price and other information in an audible format when scanning the product.
[0010] This way, the solution not only allows for the reproduction of recorded messages using the signage platform, but also for real-time interactivity in various ways. For this to happen, the system must be connected to the Internet (5).
[0011] The ways to recognize the presence and interact with the consumer can be as described, with the opening of the freezer door (3) where when opening the freezer door the player (4) searches for the programmed message(s) for that door and selects speaker (2) and plays audio.
[0012] Also through presence sensors or cameras (9), in the case of presence sensors, more appropriate for freezers or shelves without doors, play messages through speakers (2) close to the consumer, and in the case of cameras, this being pre-programmed computer vision and identify through object recognition (AI), which objects the consumer is interacting with and play the message about the product through the speaker (2).
[0013] Also through the ld / 2d barcode and / or QR-code reader device (31), and with this interactivity the consumer can obtain more additional information at the time of purchase by presenting the product to the reader (31) and through the player (4) have the information vocalized by the speaker (2) close to the reader (31).
[0014] Also for the management of doors and sensors it was also improved, so that there is no interference in the reproduction of sounds in adjacent doors between several players (4) installed, through a communication bus, which can be RS485, One-wire, analog, or digital between players (13) (14) that informs if in any of the adjacent players (4) which doors were opened preventing the sound from being reproduced, that is, preventing adjacent doors even from different players (4) from causing sound interference.
[0015] The ease of interactivity via microphone (6), ld / 2d reader (31), camera / presence sensor (9) and port management via the bus (13) (14) between players (4) were not covered in the patents described previously.
[0016] FIG. 1 shows a type of freezer typically found in supermarkets with multiple doors or sections, in this case vertical ones.
[0017] FIG.2 shows the same freezer containing some of the parts subject to the patent installed, where it shows the Speakers (2) and where, as an example, the cameras (9), open-closed door sensors (3), microphones (6), ld / 2d barcode reader(s) (31) can be installed and all this connected to the Internet (5) through the Player / NUC-PC (4) that controls the entire system.
[0018] FIG. 3 shows an example of a vibration speaker (2) previously described as also described in patent US8213644. This type of speaker is preferred because it is installed attached to the glass wall or the body of the freezer, or external to the body of the freezer, causing the sound to reverberate through the walls and glass of the freezer, thus being invisible to the user and immune to the humidity and temperature normally critical in these freezers.
[0019] FIG. 4 shows a normal loudspeaker which, unlike the vibration loudspeaker (2), only generates sound is heard directly through the Speaker and is not suitable for this application.
[0019] FIG. 5 shows the block diagram of the system, containing the specially developed Player / NUC-PC (4), with control of all peripherals, being the management device that makes the connection to the Internet (5) via the network or Wi-Fi and with software that can store messages online or offline, connection with devices such as the signage platform, connection with the IA, capable of storing messages and allowing the transformation of voice content to be played on the speaker (2) selected by (16) amplified and converted from digital and analog (8), as well as identifying, selecting and controlling the status of various sensors and devices (3) (7) and cameras or presence sensor (9) and microphone (6), and ld / 2d reader (31) and selecting (16) which of the speakers (2) should be playing and interacting with the consumer;it also shows the door sensors (3) that can be of the magnetic or other type, controlled and selected through (4) through the Mux (11) selected (22) and obtain its status by (21); through touch sensors (7) installed for example in the freezer door, the consumer can also interact with the system, through the Mux (12) and selected by (19) and obtain its status (20); it shows the microphones (6) that through the Mux (10) and selected by (24) allow the consumer to talk to the; AI by (23); also shows presence sensors or cameras (9) through the Mux (25) and selected by (17) having the image or the result of the presence sensor obtained by (18); also shows the audio amplifier circuit (8), the selector (16) of which speaker through (15) must be active to reproduce the sound through the speaker (2); also shows a communication bus (13) (14) that can be analog, One-wire, RS485 or other, for interconnection and communication between Players (4), for example to know when two or more equipment installed in a large freezer, combined, determine when adjacent doors are opened that can inhibit the reproduction of the message so as not to cause interference of messages.
[0020] Fig. 6 shows the different ways of installing the vibration speakers (2) so that it is immune to humidity and temperature and gives the highest sound output and the impression that the freezer is talking to the consumer. One way is to install the speaker (2) fixed directly to the external plate (26) of the freezer structure shown in Fig. 6.1, another way is to have the speaker (2) fixed to a block of high-density type and material (28), for example high-density XPS and this fixed to the lower internal plate (27) of the freezer structure Fig. 6.2, another way is to install it crossing the two plates of the freezer structure (26) (27) and with the speaker (2) fixed to the high-density block density (28) and this fixed to a high density disc, with the disc being fixed or glued to the lower surface (27) of the structure Fig. 6.3.
[0021] An example of one of the ways in which the system operates is where the consumer, when opening the door (3), and the opening is recognized (21), through the NUC-PC (4), receives a stored voice message, and reproduced through the speaker (2) that is close to that door (3), inhibiting the adjacent speakers so that there is no sound interference, the message that was stored through the software installed in the NUC-PC (4) in communication with the signage platform, and allows with this patent that the consumer can additionally interact with the freezer through the microphone (6), asking questions and receiving answers through AI (Artificial Intelligence), as well as the freezer, when recognizing through the camera (9) the consumer picking up a product, recognizing the product and being able to talk about it and, when presenting the product to the ld / 2d reader (31), obtaining vocalized information related to the product.
[0022] Another device that was added was the ModBus / RS485 (32) or another that has the function of receiving and connected to the freezer temperature and energy consumption supervisor, obtaining information on temperature, energy consumption and freezer operation, which due to the system through the signage software, can report if any of the freezers is having a problem, that is, in the signage software itself, so the supermarket can know if the freezer is operating correctly on the same platform.
[0023] Along with the platform, in addition to the use of AI for object recognition, dialogue through microphones (6), the generation of messages through text to voice, AI helps in the low cost of advertising generation compared to video creation. Another important factor is that this system helps consumers with visual impairments or the elderly to have access to more information about the products.
[0024] In accordance with what is illustrated in the figures listed above, the "Interactive audio media system for advertising in supermarket freezers" in the form presented, can be built in several other ways, with all components and devices installed or partially, and can also not only be used for vertical and horizontal freezers but also for shelves with one or more doors, where the examples and figures cited and presented are by way of non-limiting example.
Claims
CLAIMS 1. Interactive audio media system for advertising in supermarket freezers characterized by being an invention composed of a set formed by one or more vibration speakers (2) installed in the body or glass of the Freezer (FIG.2) or shelves that reproduce the sound through the amplifier (8), selected by the Mux (16), having a NUC-PC player (4) with processing and control capacity of various sensors and peripherals, open-closed door (3), microphone (6), touch sensors (7), presence sensors or camera (9), LD / 2D code reader (31), freezer status sensors (32), connected to a signage platform, and AI software through the internet (5) and the platform, through a connection that can be wireless (5) or wired, downloading and storing the audio in memory, or SDCARD (26), or HD where through sensing, it converts from digital to analog and amplifies (8) and reproduces and interacts with the consumer through sound, with the speakers (2) preferably installed as shown in Fig. 6, in addition to the bus (13) (14) of interconnectivity between Players (4) in order to inhibit conflict of messages being generated by nearby speakers (2).
2. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized in that the presence sensor (9) that It can be of the PIR, ultrasonic, microwave, video or capacitive camera type that allows the consumer's presence to be perceived and, upon noticing, allows interaction with the consumer.
3. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized by the fact that the microphone (6) which may be electret, piezoelectric, dynamic, MEMs, thus allowing conversation and interactivity between the consumer and the AI platform.
4. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized by the fact that the ld / 2d reader (31) which may be of the laser, CCD type, image allowing the consumer to choose a product, point to the reader connected to the Player (4) and obtain price and product information through the speaker (2).
5. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized in that the freezer status reader (32) connected to the Player (4) can inform the signage platform of the temperature, humidity and electricity consumption.
6. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized in that the camera(s) (9) may be simple connected to the Player (4) with computer vision software, or a camera (9) with embedded software with computer vision, programmed to identify products and, upon recognizing them, be able to provide more information to the consumer.
7. Interactive audio media system for advertising in supermarket freezers according to claim 1, characterized by the fact that the Bus (13) (14) connected to the Player (4) can identify the information of which speaker (2) among several players (4) installed in a freezer or shelf is interacting with the consumer and thus being able, through the player (4), to inhibit adjacent or nearby speakers (2) from playing and thus removing the possibility of sound interference.
Citation Information
Patent Citations
Interactive audio media system for advertising in supermarket freezers.
BR102018000339A2
Interactive audio media system for advertising in supermarket freezers.
BR132023014546E2
Image recognition system that performs code detection and image recognition concurrently
US20170076270A1
Display case door with transparent LCD panel
US9504338B2
Method and system for presenting information through an interactive viewing unit
WO2001057741A1