Intelligent beverage shelf-based interaction method and device, equipment and medium

Abstract

The application relates to the technical field of data processing, and provides an interaction method and device based on an intelligent beverage shelf, equipment and a medium, the method of which is applied to the intelligent beverage shelf, the main body of the intelligent shelf and an ice cup freezer are concentrated together, and the time for consumers to search is reduced; when a target user enters an induction range is detected based on a store-wide intelligent AI super induction device, a starting signal is sent to a display screen, so that the customer waiting time is reduced by starting the display screen in advance; the beverage taken by the customer is accurately captured based on a trigger switch; candidate beverage making videos are extracted from a beverage making video database based on target beverage information, so that the beverage and the modulation video are quickly matched; a confirmation application of a video display mode is initiated to the target user based on a digital person, and the candidate beverage making video is played on the display screen according to the target video display mode, so that the beverage making video is accurately played through human-computer interaction, and the customer participation and satisfaction are improved through vivid video demonstration.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to an interactive method, device, equipment and medium based on a smart beverage shelf. Background Technology

[0002] Summer's hot weather makes iced drinks incredibly popular with consumers due to their refreshing taste. Many stores guide customers through the preparation of freshly made iced drinks using printed cardboard signs, but the instructions are often simplistic, lack vividness, and provide a poor user experience.

[0003] Furthermore, the traditional shelves in convenience stores are often scattered with goods, and consumers need to spend a lot of time searching for ingredients to make iced drinks.

[0004] Therefore, how to interact with customers efficiently and engagingly to assist them in making iced drinks has become an urgent problem to be solved. Summary of the Invention

[0005] In view of the above, it is necessary to provide an interactive method, device, equipment and medium based on a smart beverage shelf, which aims to solve the problem that customers cannot complete the preparation of iced drinks through interactive assistance.

[0006] An interactive method based on a smart beverage shelf is applied to the smart beverage shelf, which includes a smart shelf body, an ice cup freezer disposed on one side of the smart shelf body and connected to the smart shelf body, and a display screen integrating a digital human and a store-wide intelligent AI super-sensing device disposed on the smart shelf body; the smart shelf body includes multiple shelves for placing beverages, each shelf has a pushing device at one end to push the beverages on the shelf towards the retrieval side, and each shelf has a trigger switch below the retrieval side for detecting beverage retrieval actions and generating a retrieval signal; the interactive method based on the smart beverage shelf includes: When the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range, it sends a start signal to the display screen. When the trigger switch detects that the target user has performed a beverage-taking action, the target beverage information of the beverage being taken is extracted. Connect to a beverage making video database, and extract candidate beverage making videos from the beverage making video database based on the target beverage information; When there are multiple candidate beverage production videos, a confirmation request for the video display mode is initiated to the target user based on the digital human. The target video display mode is determined based on the feedback signal from the target user to the confirmation request, and the candidate beverage preparation video is played on the display screen according to the target video display mode.

[0007] An interactive device based on a smart beverage shelf, operating on the smart beverage shelf, the smart beverage shelf including a smart shelf body, an ice cup freezer disposed on one side of the smart shelf body and connected to the smart shelf body, and a display screen integrating a digital human and a store-wide smart AI super-sensing device disposed on the smart shelf body; the smart shelf body includes multiple shelves for placing beverages, each shelf having a pushing device at one end to push the beverages on the shelf towards the retrieval side, and a trigger switch below the retrieval side of each shelf for detecting beverage retrieval actions and generating a retrieval signal; the interactive device based on the smart beverage shelf includes: The sending unit is used to send a start signal to the display screen when the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range; The extraction unit is used to extract the target beverage information when the target user performs a beverage taking action based on the trigger switch. The extraction unit is also used to connect to a beverage making video database and extract candidate beverage making videos from the beverage making video database based on the target beverage information; The application unit is used to initiate a confirmation application for the video display mode to the target user based on the digital human when there are multiple candidate beverage production videos; The playback unit is used to determine the target video display mode based on the feedback signal from the target user to the confirmation request, and to play the candidate beverage preparation video on the display screen according to the target video display mode.

[0008] A computer device, the computer device comprising: A memory for storing at least one instruction; and a processor for executing the instructions stored in the memory to implement the interactive method based on the smart beverage shelf.

[0009] A computer-readable storage medium storing at least one instruction, which is executed by a processor in a computer device to implement the interactive method based on a smart beverage shelf.

[0010] As can be seen from the above technical solutions, this invention can be applied to intelligent beverage shelves. The main body of the intelligent shelf is integrated with the ice cup freezer, reducing the time consumers spend searching. When the store-wide intelligent AI super-sensing device detects a target user entering the sensing range, it sends a start signal to the display screen, reducing customer waiting time by activating the display screen in advance. It detects beverage picking actions based on trigger switches to accurately capture the beverage picked by the customer. Based on the target beverage information, it extracts candidate beverage preparation videos from the beverage preparation video database to achieve rapid matching between beverages and preparation videos. Based on the digital human, it initiates a confirmation request for the video display mode to the target user and plays the candidate beverage preparation video on the display screen according to the target video display mode. Thus, it accurately plays beverage preparation videos through human-computer interaction and enhances customer participation and satisfaction through vivid video demonstrations. Attached Figure Description

[0011] Figure 1 This is a flowchart of a preferred embodiment of the interactive method based on the intelligent beverage shelf of the present invention.

[0012] Figure 2 This is a structural schematic diagram of the intelligent beverage shelf of the present invention.

[0013] Figure 3 This is a schematic diagram of the structure of the layer plate of the present invention.

[0014] Figure 4 This is a functional block diagram of a preferred embodiment of the interactive device based on an intelligent beverage shelf according to the present invention.

[0015] Figure 5 This is a schematic diagram of the structure of a computer device that implements the interactive method based on an intelligent beverage shelf according to a preferred embodiment of the present invention. Detailed Implementation

[0016] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0017] like Figure 1 The diagram shown is a flowchart of a preferred embodiment of the interactive method for an intelligent beverage shelf according to the present invention. The order of the steps in this flowchart can be changed, and some steps can be omitted, depending on different requirements.

[0018] The interactive method based on the intelligent beverage shelf is applied to one or more computer devices. The computer device is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. Its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0019] The computer device can be any electronic product that can interact with the user, such as a personal computer, tablet computer, smartphone, personal digital assistant (PDA), game console, interactive network television (IPTV), smart wearable device, etc.

[0020] The computer equipment may also include network equipment and / or user equipment. The network equipment includes, but is not limited to, a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of hosts or network servers.

[0021] The server can be a standalone server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0022] Artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0023] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0024] The network in which the computer device is located includes, but is not limited to, the Internet, wide area network, metropolitan area network, local area network, and virtual private network (VPN).

[0025] This embodiment applies the interaction method of the smart beverage shelf to the smart beverage shelf. Please refer to [link / reference]. Figures 2-3 , Figure 2 This is a structural schematic diagram of the intelligent beverage shelf of the present invention. Figure 3 This is a schematic diagram of the shelf structure of the present invention. The intelligent beverage shelf includes an intelligent shelf body, an ice cup freezer disposed on one side of the intelligent shelf body and connected to the intelligent shelf body, and a display screen integrating a digital human and a store-wide intelligent AI super sensing device disposed on the intelligent shelf body; the intelligent shelf body includes multiple layers of shelves for placing beverages, each shelf has a pushing device at one end to push the beverages on the shelf towards the retrieval side, and each shelf has a trigger switch below the retrieval side for detecting beverage retrieval actions and generating a retrieval signal.

[0026] Each shelf is used to display boxed drinks, beverage companions, bottled drinks, and other freshly prepared iced beverage products.

[0027] The design of physically integrating the smart shelf with the ice cup freezer ensures a reasonable flow between the product display area and the cup retrieval area, reduces the number of times consumers need to go back and forth, solves the problem of scattered products in traditional convenience stores, shortens the time consumers spend looking for freshly made iced drinks, and improves shopping convenience.

[0028] The display screen is positioned in a prominent location on the main body of the smart shelf and is used to play beverage preparation videos and interact with users.

[0029] The display screen also has a touchpad with touch functionality.

[0030] The digital human is used to interact with the user via voice or the touchpad to obtain the user's needs in real time.

[0031] The shelf also displays beverage companions, which can be placed on the same shelf as boxed or bottled beverages.

[0032] The trigger switch can be a pressure sensor or an infrared sensor. The trigger switch is connected to the control module of the smart shelf through hardware circuitry to transmit the picking signal to the control module.

[0033] Specifically, the interaction method based on the smart beverage shelf includes: S10, when the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range, a start signal is sent to the display screen.

[0034] In this embodiment, the whole-store intelligent AI super sensing device is an intelligent sensing system for offline scenarios (such as convenience stores). Its core is to achieve accurate detection, behavior recognition and signal triggering of customers in a specific area through multi-sensor fusion and AI algorithms. It is the core sensing layer tool that connects customer actions and device linkage (such as video push).

[0035] For example, the store-wide intelligent AI super sensing device may include millimeter-wave radar, infrared or pressure-assisted sensors, visual sensors, etc.

[0036] In this embodiment, the sensing range may include a specific area centered on the smart beverage shelf.

[0037] In this embodiment, when a target user is detected to enter the sensing range, a start signal is sent to the display screen, which can trigger the initial conditions for video playback. By starting the display in advance, the smart freshly made iced beverage shelf attracts customers' attention and increases the exposure of the products.

[0038] S11, when the target user performs a beverage taking action based on the trigger switch, extract the target beverage information of the beverage being taken.

[0039] In this embodiment, the trigger switch may include a pressure sensor, an infrared sensor, etc., for accurately detecting whether a customer has taken a beverage from the corresponding shelf.

[0040] In this embodiment, extracting the target beverage information of the beverage being taken includes: The image acquisition device is used to identify the identification information of the beverage being taken as the target beverage information; and / or Obtain the shelf where the beverage to be taken is located, and determine the target beverage information based on the beverage configuration data on the shelf where the beverage to be taken is located.

[0041] The beverage configuration data is used to reflect the beverages displayed on each shelf.

[0042] The above embodiments can accurately capture customers' target beverages, providing a precise trigger for subsequent targeted video pushes and avoiding indiscriminate video playback.

[0043] S12, connect to the beverage making video database, and extract candidate beverage making videos from the beverage making video database based on the target beverage information.

[0044] In this embodiment, before connecting to the beverage making video database, the method further includes: Obtain the preparation video for each beverage; wherein, the preparation video includes voice narration, preparation action demonstration, and beverage pairing schemes with different beverage companions; Get beverage information for each type of drink; Establish the association between the beverage information of each beverage and the corresponding modulation video of each beverage; Based on the aforementioned association, the beverage information for each beverage and the corresponding preparation video for each beverage are stored in the beverage production video database; Each beverage's preparation video includes a flavor label; The beverage preparation video database is also used to store user preference data, which reflects the user and the preparation video adapted to each beverage based on the user's preferences.

[0045] The beverages mentioned may include boxed beverages, bottled beverages, and bottled beverages.

[0046] Among them, the pairing schemes of beverages with different beverage companions can include flavor characteristics, pairing ratios, etc.

[0047] Through the above embodiments, it is possible to accurately bind beverages with preparation videos, providing data support for rapid matching and push of subsequent videos, and laying the foundation for personalized recommendations for existing customers.

[0048] In this embodiment, the step of extracting candidate beverage preparation videos from the beverage preparation video database based on the target beverage information includes: Identify the identity information of the target user; When the target user's identity information shows that the target user is a new customer, the target beverage information is used to traverse the beverage making video database, and the modulated video that matches the target beverage information is used as the candidate beverage making video. When the target user's identity information shows that the target user is a regular customer, the modified video corresponding to the target beverage information and the target user's preference is obtained from the beverage preparation video database as the candidate beverage preparation video.

[0049] In the above embodiments, rapid matching of beverages and promotional videos can be achieved, ensuring that the video content is highly relevant to the products picked up by customers and improving the accuracy of information delivery. Simultaneously, targeted video retrieval based on the preferences of returning customers enables personalized video recommendations, reducing customer selection costs, improving response efficiency, and enhancing the continuity of the consumer experience.

[0050] In this embodiment, after extracting candidate beverage preparation videos from the beverage preparation video database based on the target beverage information, the method further includes: When there is only one candidate beverage preparation video, the candidate beverage preparation video is played directly on the display screen.

[0051] S13, when there are multiple candidate beverage preparation videos, a confirmation request for video display mode is initiated to the target user based on the digital human.

[0052] In this embodiment, the digital human can initiate a confirmation request for the video display mode to the target user via voice or touchpad.

[0053] S14, determine the target video display mode based on the feedback signal from the target user to the confirmation request, and play the candidate beverage preparation video on the display screen according to the target video display mode.

[0054] In this embodiment, the target video display mode may include a sequential playback mode and a jump playback mode.

[0055] The sequential playback mode refers to playing videos one by one in a certain order.

[0056] The jump playback mode refers to jumping to a different playback mode based on the user's selection.

[0057] Specifically, playing the candidate beverage preparation video on the display screen according to the target video display mode includes: When the target video display mode is a sequential playback mode, the complexity and liking of each candidate beverage making video are obtained; a first weight corresponding to the complexity and a second weight corresponding to the liking are obtained; a weighted calculation is performed based on the complexity and liking of each candidate beverage making video, the first weight, and the second weight to obtain a priority score for each candidate beverage making video; each candidate beverage making video is played sequentially according to the priority score from high to low; or When the target video display mode is the jump playback mode, the digital human is controlled to interact with the target user during each jump to select the video to be played in the current round from the candidate beverage making videos, and the video to be played is played on the display screen.

[0058] The first weight and the second weight can be configured according to the needs data in the actual scenario.

[0059] The step of controlling the digital human to interact with the target user during each round of navigation to select the video to be played in the current round from the candidate beverage making videos includes: The digital human can be controlled to ask the target user about their taste preferences via voice or the touch panel of the display screen; Based on the taste preferences reported by the target users, the flavor identifiers of each candidate beverage production video are iterated through; The candidate beverage preparation videos corresponding to the flavor identifiers that match the flavor preferences reported by the target users are selected as the videos to be played in the current round.

[0060] For example, digital shop assistants can proactively ask customers about their taste preferences via voice or touch panel, such as "Do you prefer sweet and sour or refreshing flavors?" After receiving customer feedback, the system can then filter the content based on user preferences to allow them to jump to a matching modulated video clip from the relevant long video resources.

[0061] In the above embodiments, the sequential playback mode can comprehensively showcase the various pairing possibilities of the beverage, helping new customers understand the product features and expanding their consumption choices. The jump playback mode, based on human-computer interaction, can accurately capture customers' immediate needs, enabling precise jumps in video content and improving customer engagement and satisfaction.

[0062] In this embodiment, the method further includes: Record the consumption behavior of the target users and update the beverage preparation video database based on the consumption behavior.

[0063] The consumption behavior may include, but is not limited to, the beverages taken by the target user, the selected pairings, and the videos watched.

[0064] In the above embodiments, the historical consumption data and preference mapping relationship of the customer are updated according to the consumption behavior of the target user, and the old customer preference database is improved. This enables dynamic iteration of customer preference data and ensures that the accuracy and efficiency of video recommendations continue to improve when the old customer makes another purchase.

[0065] In this embodiment, after a customer takes a beverage that can be combined with multiple flavors, if the customer does not consult a digital salesperson and is not identified as a returning customer, they can choose to package all the preparation videos corresponding to that beverage into a collection and play them continuously on the display screen. During the playback, the customer can switch the playback order of the videos via the touch screen, thereby providing a more flexible way to watch the videos to meet the viewing habits of different customers, while ensuring the complete transmission of information on multiple flavors.

[0066] In this embodiment, after detecting that the target user has taken a beverage, it also supports directly stating the specific flavor requirements or beverage companion name (such as "I want to pair it with lemon flavor companion") through the voice interaction function of the digital store clerk. The digital store clerk converts the voice command into text information and transmits it to the underlying control module, which then directly retrieves the corresponding modulated video for playback, thereby simplifying the customer interaction process, improving the efficiency of video retrieval, and enhancing the convenience of human-computer interaction.

[0067] As can be seen from the above technical solutions, this invention can be applied to intelligent beverage shelves. The main body of the intelligent shelf is integrated with the ice cup freezer, reducing the time consumers spend searching. When the store-wide intelligent AI super-sensing device detects a target user entering the sensing range, it sends a start signal to the display screen, reducing customer waiting time by activating the display screen in advance. It detects beverage picking actions based on trigger switches to accurately capture the beverage picked by the customer. Based on the target beverage information, it extracts candidate beverage preparation videos from the beverage preparation video database to achieve rapid matching between beverages and preparation videos. Based on the digital human, it initiates a confirmation request for the video display mode to the target user and plays the candidate beverage preparation video on the display screen according to the target video display mode. Thus, it accurately plays beverage preparation videos through human-computer interaction and enhances customer participation and satisfaction through vivid video demonstrations.

[0068] like Figure 4 The diagram shown is a functional block diagram of a preferred embodiment of the interactive device based on an intelligent beverage shelf according to the present invention. The interactive device 11 based on the intelligent beverage shelf operates on the intelligent beverage shelf, which includes an intelligent shelf body, an ice cup freezer disposed on one side of the intelligent shelf body and connected to it, and a display screen integrating a digital human and a store-wide intelligent AI super-sensing device disposed on the intelligent shelf body. The intelligent shelf body includes multiple shelves for placing beverages, with a pushing device at one end of each shelf to push the beverages on the shelf towards the retrieval side, and a trigger switch below the retrieval side of each shelf for detecting beverage retrieval actions and generating a retrieval signal. The interactive device 11 based on the intelligent beverage shelf includes a sending unit 110, a retrieval unit 111, an application unit 112, and a playback unit 113. The module / unit referred to in this invention refers to a series of computer program segments that can be executed by a processor and perform a fixed function, stored in a memory. In this embodiment, the functions of each module / unit will be described in detail in subsequent embodiments.

[0069] The sending unit 110 is used to send a start signal to the display screen when the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range. The extraction unit 111 is used to extract the target beverage information when the target user performs a beverage taking action based on the trigger switch. The extraction unit 111 is also used to connect to the beverage making video database and extract candidate beverage making videos from the beverage making video database based on the target beverage information. The application unit 112 is used to initiate a video display mode confirmation application to the target user based on the digital human when there are multiple candidate beverage production videos. The playback unit 113 is used to determine the target video display mode based on the feedback signal from the target user to the confirmation request, and to play the candidate beverage preparation video on the display screen according to the target video display mode.

[0070] As can be seen from the above technical solutions, this invention can be applied to intelligent beverage shelves. The main body of the intelligent shelf is integrated with the ice cup freezer, reducing the time consumers spend searching. When the store-wide intelligent AI super-sensing device detects a target user entering the sensing range, it sends a start signal to the display screen, reducing customer waiting time by activating the display screen in advance. It detects beverage picking actions based on trigger switches to accurately capture the beverage picked by the customer. Based on the target beverage information, it extracts candidate beverage preparation videos from the beverage preparation video database to achieve rapid matching between beverages and preparation videos. Based on the digital human, it initiates a confirmation request for the video display mode to the target user and plays the candidate beverage preparation video on the display screen according to the target video display mode. Thus, it accurately plays beverage preparation videos through human-computer interaction and enhances customer participation and satisfaction through vivid video demonstrations.

[0071] like Figure 5 The diagram shown is a schematic representation of the computer device used to implement the interactive method based on an intelligent beverage shelf according to a preferred embodiment of the present invention.

[0072] The computer device 1 may include a memory 12, a processor 13, and a bus (the arrow in the figure represents the bus), and may also include a computer program stored in the memory 12 and executable on the processor 13, such as an interactive program based on a smart beverage shelf.

[0073] Those skilled in the art will understand that the schematic diagram is merely an example of computer device 1 and does not constitute a limitation on computer device 1. Computer device 1 can be either a bus topology or a star topology. Computer device 1 may also include more or fewer other hardware or software than shown in the diagram, or different component arrangements. For example, computer device 1 may also include input / output devices, network access devices, etc.

[0074] It should be noted that the computer device 1 described is merely an example. Other existing or future electronic products that are adaptable to this invention should also be included within the scope of protection of this invention and are incorporated herein by reference.

[0075] The memory 12 includes at least one type of readable storage medium, such as flash memory, portable hard drive, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 12 can be an internal storage unit of the computer device 1, such as a portable hard drive of the computer device 1. In other embodiments, the memory 12 can be an external storage device of the computer device 1, such as a plug-in portable hard drive, smart media card (SMC), secure digital card (SD), flash card, etc., equipped on the computer device 1. Furthermore, the memory 12 can include both internal and external storage units of the computer device 1. The memory 12 can be used not only to store application software and various types of data installed on the computer device 1, such as the code of an interactive program based on a smart beverage shelf, but also to temporarily store data that has been output or will be output.

[0076] In some embodiments, the processor 13 may be composed of integrated circuits, such as a single packaged integrated circuit or multiple integrated circuits packaged with the same or different functions, including combinations of one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and various control chips. The processor 13 is the control unit of the computer device 1, connecting various components of the computer device 1 via various interfaces and lines. It executes programs or modules stored in the memory 12 (e.g., executing interactive programs based on smart beverage shelves) and calls data stored in the memory 12 to perform various functions of the computer device 1 and process data.

[0077] The processor 13 executes the operating system of the computer device 1 and various installed applications. The processor 13 executes the applications to implement the steps in the various interactive method embodiments based on the smart beverage shelf described above, for example... Figure 1 The steps are shown.

[0078] For example, the computer program may be divided into one or more modules / units, which are stored in the memory 12 and executed by the processor 13 to complete the present invention. The one or more modules / units may be a series of computer-readable instruction segments capable of performing a specific function, which describe the execution process of the computer program in the computer device 1. For example, the computer program may be divided into a sending unit 110, a retrieving unit 111, an requesting unit 112, and a playback unit 113.

[0079] The integrated unit, implemented as a software functional module, can be stored in a computer-readable storage medium. This software functional module, stored in a storage medium, includes several instructions to cause a computer device (which may be a personal computer, computer equipment, or network device, etc.) or processor to execute portions of the interactive method based on the intelligent beverage shelf described in the various embodiments of the present invention.

[0080] If the modules / units integrated in the computer device 1 are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of the present invention can also be implemented by a computer program instructing related hardware devices. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above.

[0081] The computer program includes computer program code, which may be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory, etc.

[0082] Furthermore, the computer-readable storage medium may primarily include a stored program area and a stored data area, wherein the stored program area may store the operating system, an application program required for at least one function, etc.; and the stored data area may store data created based on the use of blockchain nodes, etc.

[0083] The blockchain referred to in this invention is a novel application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Essentially, a blockchain is a decentralized database, a chain of data blocks linked together using cryptographic methods. Each data block contains information about a batch of network transactions, used to verify the validity of the information (anti-counterfeiting) and generate the next block. A blockchain can include an underlying blockchain platform, a platform product service layer, and an application service layer.

[0084] The bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, in... Figure 5 The bus is represented by only one straight line, but this does not mean that there is only one bus or one type of bus. The bus is configured to enable communication between the memory 12 and at least one processor 13, etc.

[0085] Although not shown, the computer device 1 may also include a power supply (such as a battery) to power various components. Preferably, the power supply can be logically connected to the at least one processor 13 through a power management device, thereby enabling functions such as charging management, discharging management, and power consumption management. The power supply may also include one or more DC or AC power supplies, recharging devices, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components. The computer device 1 may also include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be described in detail here.

[0086] Furthermore, the computer device 1 may also include a network interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a Wi-Fi interface, a Bluetooth interface, etc.), which is typically used to establish communication connections between the computer device 1 and other computer devices.

[0087] Optionally, the computer device 1 may further include a user interface, which may be a display, an input unit (such as a keyboard), and optionally, a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen, etc. The display may also be appropriately referred to as a screen or display unit, used to display information processed in the computer device 1 and to display a visual user interface.

[0088] It should be understood that the embodiments described are for illustrative purposes only and are not limited to this structure in the scope of the patent application.

[0089] It will be understood by those skilled in the art that Figure 5 The structure shown does not constitute a limitation on the computer device 1, and may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0090] Combination Figure 1 The memory 12 in the computer device 1 stores multiple instructions to implement an interactive method based on a smart beverage shelf, and the processor 13 can execute the multiple instructions to achieve the following: When the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range, it sends a start signal to the display screen. When the trigger switch detects that the target user has performed a beverage-taking action, the target beverage information of the beverage being taken is extracted. Connect to a beverage making video database, and extract candidate beverage making videos from the beverage making video database based on the target beverage information; When there are multiple candidate beverage production videos, a confirmation request for the video display mode is initiated to the target user based on the digital human. The target video display mode is determined based on the feedback signal from the target user to the confirmation request, and the candidate beverage preparation video is played on the display screen according to the target video display mode.

[0091] Specifically, the processor 13's implementation method for the above instructions can be found in [reference needed]. Figure 1 The descriptions of the relevant steps in the corresponding embodiments are not repeated here.

[0092] It should be noted that all data involved in this case was legally obtained. Software tools or components not belonging to this company that appear in the embodiments of this application are merely illustrative examples and do not represent actual use.

[0093] In the several embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and other division methods may be used in actual implementation.

[0094] This invention can be used in a wide variety of general-purpose or special-purpose computer system environments or configurations. Examples include: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices. This invention can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This invention can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0095] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0096] Furthermore, the functional modules in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional modules.

[0097] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0098] Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be embraced within the invention. No appended diagram markings in the claims should be construed as limiting the scope of the claims.

[0099] Furthermore, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices described in this invention can also be implemented by a single unit or device through software or hardware. Terms such as "first," "second," etc., are used to indicate names and do not indicate any specific order.

[0100] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. An interactive method based on a smart beverage shelf, characterized in that, This invention relates to a smart beverage shelf, comprising a smart shelf body, an ice cup freezer located on one side of the smart shelf body and connected to it, and a display screen integrating a digital human and a store-wide smart AI super-sensing device located on the smart shelf body. The smart shelf body includes multiple shelves for placing beverages, with a pushing device at one end of each shelf to push the beverages on the shelf toward the retrieval side, and a trigger switch located below the retrieval side of each shelf to detect beverage retrieval actions and generate a retrieval signal. The interactive method based on the smart beverage shelf includes: When the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range, it sends a start signal to the display screen. When the trigger switch detects that the target user has performed a beverage-taking action, the target beverage information of the beverage being taken is extracted. Connect to a beverage making video database, and extract candidate beverage making videos from the beverage making video database based on the target beverage information; When there are multiple candidate beverage production videos, a confirmation request for the video display mode is initiated to the target user based on the digital human. The target video display mode is determined based on the feedback signal from the target user to the confirmation request, and the candidate beverage preparation video is played on the display screen according to the target video display mode.

2. The interactive method based on a smart beverage shelf as described in claim 1, characterized in that, The target beverage information for extracting the beverage being taken includes: The image acquisition device is used to identify the identification information of the beverage being taken as the target beverage information; and / or Obtain the shelf where the beverage to be taken is located, and determine the target beverage information based on the beverage configuration data on the shelf where the beverage to be taken is located.

3. The interactive method based on a smart beverage shelf as described in claim 1, characterized in that, Before connecting to the beverage making video database, the method further includes: Obtain the preparation video for each beverage; wherein, the preparation video includes voice narration, preparation action demonstration, and beverage pairing schemes with different beverage companions; Get beverage information for each type of drink; Establish the association between the beverage information of each beverage and the corresponding modulation video of each beverage; Based on the aforementioned association, the beverage information for each beverage and the corresponding preparation video for each beverage are stored in the beverage production video database; Each beverage's preparation video includes a flavor label; The beverage preparation video database is also used to store user preference data, which reflects the user and the preparation video adapted to each beverage based on the user's preferences.

4. The interactive method based on a smart beverage shelf as described in claim 1, characterized in that, The step of extracting candidate beverage preparation videos from the beverage preparation video database based on the target beverage information includes: Identify the identity information of the target user; When the target user's identity information shows that the target user is a new customer, the target beverage information is used to traverse the beverage making video database, and the modulated video that matches the target beverage information is used as the candidate beverage making video. When the target user's identity information shows that the target user is a regular customer, the modified video corresponding to the target beverage information and the target user's preference is obtained from the beverage preparation video database as the candidate beverage preparation video.

5. The interactive method based on a smart beverage shelf as described in claim 1, characterized in that, After extracting candidate beverage preparation videos from the beverage preparation video database based on the target beverage information, the method further includes: When there is only one candidate beverage preparation video, the candidate beverage preparation video is played directly on the display screen.

6. The interactive method based on a smart beverage shelf as described in claim 1, characterized in that, Playing the candidate beverage preparation video on the display screen according to the target video display mode includes: When the target video display mode is a sequential playback mode, the complexity and liking of each candidate beverage making video are obtained; a first weight corresponding to the complexity and a second weight corresponding to the liking are obtained; a weighted calculation is performed based on the complexity and liking of each candidate beverage making video, the first weight, and the second weight to obtain a priority score for each candidate beverage making video; each candidate beverage making video is played sequentially according to the priority score from high to low; or When the target video display mode is the jump playback mode, the digital human is controlled to interact with the target user during each jump to select the video to be played in the current round from the candidate beverage making videos, and the video to be played is played on the display screen.

7. The interactive method based on a smart beverage shelf as described in claim 6, characterized in that, The step of controlling the digital human to interact with the target user during each round of transitions to select the video to be played in the current round from the candidate beverage making videos includes: The digital human can be controlled to ask the target user about their taste preferences via voice or the touch panel of the display screen; Based on the taste preferences reported by the target users, the flavor identifiers of each candidate beverage production video are iterated through; The candidate beverage preparation videos corresponding to the flavor identifiers that match the flavor preferences reported by the target users are selected as the videos to be played in the current round.

8. An interactive device based on a smart beverage shelf, characterized in that, The system operates on a smart beverage shelf, which includes a smart shelf body, an ice cup freezer located on one side of the smart shelf body and connected to it, and a display screen integrating a digital human and a store-wide smart AI super-sensing device located on the smart shelf body. The smart shelf body includes multiple shelves for placing beverages, with a pushing device at one end of each shelf to push the beverages on the shelf toward the retrieval side, and a trigger switch located below the retrieval side of each shelf to detect beverage retrieval actions and generate a retrieval signal. The interactive device based on the smart beverage shelf includes: The sending unit is used to send a start signal to the display screen when the store-wide intelligent AI super sensing device detects that a target user has entered the sensing range; The extraction unit is used to extract the target beverage information when the target user performs a beverage taking action based on the trigger switch. The extraction unit is also used to connect to a beverage making video database and extract candidate beverage making videos from the beverage making video database based on the target beverage information; The application unit is used to initiate a confirmation application for the video display mode to the target user based on the digital human when there are multiple candidate beverage production videos; The playback unit is used to determine the target video display mode based on the feedback signal from the target user to the confirmation request, and to play the candidate beverage preparation video on the display screen according to the target video display mode.

9. A computer device, characterized in that, The computer device includes: A memory for storing at least one instruction; and a processor for executing the instructions stored in the memory to implement the interactive method based on a smart beverage shelf as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction, which is executed by a processor in a computer device to implement the interactive method based on a smart beverage shelf as described in any one of claims 1 to 7.

Images