Sight voice interaction automatic cigarette vending machine

A technology of voice interaction and line of sight, applied in voice analysis, voice recognition, input/output of user/computer interaction, etc., can solve problems such as inconvenient operation, affecting consumer experience, hidden touch screen, etc., and achieve the goal of improving product purchase rate Effect

Inactive Publication Date: 2020-08-07

深圳爱莫科技有限公司

6 Cites 0 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0003] At present, the traditional shopping methods of line-of-sight and voice-interactive vending machines mainly include the following: (1) Cash-based: The disadvantage of this method is that consumers are required to prepare banknotes or coins with specific denomination requirements, which is inconvenient to use, especially When using banknotes, the single shopping time is long, and the rejection rate of cash recognition and receiving equipment is high, which affects the consumer experience; (2) Based on mobile phone payment: the disadvantage is that consumers need to have a mobile phone with payment function; (3) Based on face Payment, this method also needs to be bound to the mobile phone of the consumer in advance, and each time must be connected to the cloud of the WAN in real time, and the corresponding account in the cloud must h...

Abstract

The invention relates to the technical field of self-service vending machines, and discloses a sight voice interaction automatic cigarette vending machine which comprises a cigarette vending machine body, and an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, a display module, a voice module, a man-machine interaction module and an identity verification module are arranged in the cigarette vending machine body. The man-machine interaction module, the identity verification module, the voice module and the input module are connected with the edge computing processor, the edge computing processor is connected with the central control system, the central control system is connected with the cloud server through the communication module, and the central control system is connected with the controller. The man-machine interaction module is used for receiving an instruction and identifying the instruction; the identityverification module is used for verifying whether a purchaser is 18 years old or not; the sight voice interaction automatic cigarette vending machine is high in intelligent degree and less in contact, reduces sanitary risks, and meanwhile, avoids selling cigarettes to juveniles under 18 years old through identity verification.

Application Domain

Input/output for user-computer interactionCoin-freed apparatus details +6

Technology Topic

Embedded systemEngineering +8

Image

Examples

Experimental program(2)

Example Embodiment

[0033] Embodiment one:

[0034] like figure 1 , figure 2 The sight-voice interactive automatic cigarette vending machine shown in this embodiment includes a cigarette vending machine body, and the inside of the cigarette vending machine body includes an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, Display module, voice module, man-machine interaction module and identity verification module; the man-machine interaction module, identity verification module, voice module and input module are respectively connected with the edge computing processor, and the edge computing processor is connected with the central control system , the central control system is connected to the cloud server through a communication module, and the central control system is connected to the controller; the display module is a display screen, and the voice module includes a microphone and a loudspeaker;

[0035] The human-computer interaction module is used to receive instructions and identify instructions;

[0036] The identity verification module is used to verify whether the purchaser is over 18 years old.

[0037] In this embodiment, the human-computer interaction module is a sight interaction module, and the sight interaction module judges the shopping needs of shoppers according to eye sight; the sight interaction module includes a camera, a face database, and a convolutional neural network model.

[0038] The interaction method of the line of sight interaction module in this embodiment includes:

[0039] Step 1: Establishment of the face database; under different lighting, different time, and different position conditions, data collection is performed on the process of multiple individuals gazing at randomly appearing fixation points on the display screen, and face detection and human eye detection are performed on the collected images , obtain the human eye area image, establish the human eye database and screen the human eye image;

[0040] Step 2: Divide the human eye image into a training set and a verification set, as the input of the convolutional neural network model, divide the display screen into blocks according to the actual application requirements, and regard the human eye images that look at the same block of the display screen as one category. Classify human eye images and train convolutional neural network models;

[0041] Step 3: When performing line-of-sight estimation, input the human eye image to be classified into the trained convolutional neural network model to determine its category, and correspondingly obtain the corresponding gaze position block of the display screen, thereby estimating the line-of-sight direction; The edge computing processor transmits the result to the central control system, and outputs the sight recognition result through the speaker and plays the next operation guide;

[0042] Step 4: The central control system changes the display screen page according to the sight recognition results, and completes the selection, payment, and purchase of tobacco products one by one.

[0043] The operation steps of the line-of-sight and voice-interactive cigarette vending machine include:

[0044] 1. The camera detects face data and wakes up the device when the consumer is in front of the sight-voice interactive cigarette vending machine;

[0045] 2. The central control system broadcasts a voice through the loudspeaker to remind consumers to put the ID card in the designated area;

[0046]3. Perform authentication comparison through the identity verification module. If it is confirmed that it meets the age group for purchase, the display screen or speaker will prompt that the verification is successful, and enter the consumption program for purchase and payment. If it is confirmed that it does not meet the age group for purchase, the display screen or The speaker prompts that the verification failed;

[0047] 4. After the consumer receives the prompt of successful verification, follow the operation guideline and look at the name of the product to be purchased on the display screen. The sight information is intelligently recognized by the edge computing processor and uploaded to the cloud server by the central control system through the communication module;

[0048] 5. The central control system controls the changes of the display screen page. After consumers see the content changes on the display screen interface, they complete follow-up operations according to the guidelines. The sight-voice interactive vending machine products are shipped according to the inventory database in the cloud server and updated at the same time Inventory database and consumption database related information in the cloud server.

[0049] In this embodiment, the identity verification module includes:

[0050] A face collection unit for collecting face information of buyers;

[0051] A face recognition unit is used to obtain the buyer's identity information from the database;

[0052] Certificate type selection unit, the default ID card is the preferred certificate, and other ID card types can be manually selected through the input module;

[0053] A certificate collection unit, configured to collect image information of the certificate;

[0054] An identity information interception unit, configured to intercept the face area and date of birth in the document image information area;

[0055] A preprocessing unit is used to process the image information of the certificate to obtain machine-readable code information that can be recognized by the OCR unit;

[0056] The OCR unit is used to identify machine-readable code information to obtain identity information;

[0057] The identity verification unit is used to verify whether the identity information is over 18 years old, and whether the identity document and the purchaser are the same person;

[0058] The database is used to store the buyer's identity information. If the face recognition unit obtains the buyer's information from the database, and the buyer is over 18 years old, no subsequent identity verification is required.

[0059] In this embodiment, the cigarette vending machine body also includes a box body and a box door, the box body and the box door are opened and closed by a hidden door lock, the box door is provided with a light box and an outlet, and the box The body is provided with a power module, a storage shelf, a cargo lane and a delivery warehouse, and the storage shelf adopts a magazine cargo lane, and the magazine cargo lane is controlled by a controller.

Example Embodiment

[0060] Embodiment two:

[0061] like figure 1 , image 3 The shown embodiment two, compared with embodiment one, differs in that the line of sight interaction module becomes a voice interaction module, and the interaction method of the voice interaction module includes:

[0062] Step 1: input a voice signal through a microphone, and obtain a voice recognition result signal after noise reduction processing by a voice recognition noise reduction device;

[0063] Step 2: The speech recognition result signal is uploaded to the speech recognition server of the cloud server through the communication module, and the speech recognition server analyzes the speech recognition result signal to obtain an online speech recognition result;

[0064] Step 3: The cloud server transmits the online speech recognition result to the edge computing processor through the wireless module;

[0065] Step 4: The edge computing processor transmits the result to the central control system, and outputs the speech recognition result through the speaker and plays the next operation guide;

[0066] Step 5: The central control system changes the screen display page according to the voice recognition result, and completes the selection, payment and purchase of tobacco products one by one.

[0067] The operation steps of the line-of-sight and voice-interactive cigarette vending machine include:

[0068] 1. Consumers wake up the device by voice before the vending machine interacts with sight and voice;

[0069] 2. The edge computing processor synthesizes a voice message based on the specific information and the voice lexicon and transmits it to the central control system. The central control system broadcasts the voice through the loudspeaker to prompt the consumer to put the ID card in the designated area;

[0070] 3. Perform authentication comparison through the identity verification module. If it is confirmed that it meets the age group for purchase, the display screen or speaker will prompt that the verification is successful, and enter the consumption program for purchase and payment. If it is confirmed that it does not meet the age group for purchase, the display screen or The speaker prompts that the verification failed;

[0071] 4. After hearing the voice broadcast by the speaker of the automatic vending equipment, the consumer speaks out the name of the product to be purchased. The voice information is intelligently recognized by the edge computing processor and uploaded to the cloud server by the central control system through the communication module;

[0072] 5. The edge computing processor recognizes specific product name keywords by extracting voice features, finds the corresponding product name pictures, prices, and the inventory information of the product (whether it is in stock), the edge computing processor uses the specific information and the voice word The library synthesizes a voice message and transmits it to the central control system, and the central control system sends the picture information and price information of the product to the display screen;

[0073] 6. The display screen of the line-of-sight voice interaction vending machine receives product picture information, product name, and price information, and the speaker plays voice information at the same time;

[0074] 7. The consumer sees the content displayed on the monitor and answers "yes" or "no" after hearing the voice played by the speaker; the microphone collects the consumer's voice and uploads it to the cloud server;

[0075] 8. If the collected voice is confirmed as "yes", then the goods will be shipped according to the line-of-sight and voice-interactive vending machine products and the inventory database in the cloud server, and the inventory database and consumption database in the cloud server will be updated at the same time.

PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.