[0033] Embodiment one:
[0034] like figure 1 , figure 2 The sight-voice interactive automatic cigarette vending machine shown in this embodiment includes a cigarette vending machine body, and the inside of the cigarette vending machine body includes an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, Display module, voice module, man-machine interaction module and identity verification module; the man-machine interaction module, identity verification module, voice module and input module are respectively connected with the edge computing processor, and the edge computing processor is connected with the central control system , the central control system is connected to the cloud server through a communication module, and the central control system is connected to the controller; the display module is a display screen, and the voice module includes a microphone and a loudspeaker;
[0035] The human-computer interaction module is used to receive instructions and identify instructions;
[0036] The identity verification module is used to verify whether the purchaser is over 18 years old.
[0037] In this embodiment, the human-computer interaction module is a sight interaction module, and the sight interaction module judges the shopping needs of shoppers according to eye sight; the sight interaction module includes a camera, a face database, and a convolutional neural network model.
[0038] The interaction method of the line of sight interaction module in this embodiment includes:
[0039] Step 1: Establishment of the face database; under different lighting, different time, and different position conditions, data collection is performed on the process of multiple individuals gazing at randomly appearing fixation points on the display screen, and face detection and human eye detection are performed on the collected images , obtain the human eye area image, establish the human eye database and screen the human eye image;
[0040] Step 2: Divide the human eye image into a training set and a verification set, as the input of the convolutional neural network model, divide the display screen into blocks according to the actual application requirements, and regard the human eye images that look at the same block of the display screen as one category. Classify human eye images and train convolutional neural network models;
[0041] Step 3: When performing line-of-sight estimation, input the human eye image to be classified into the trained convolutional neural network model to determine its category, and correspondingly obtain the corresponding gaze position block of the display screen, thereby estimating the line-of-sight direction; The edge computing processor transmits the result to the central control system, and outputs the sight recognition result through the speaker and plays the next operation guide;
[0042] Step 4: The central control system changes the display screen page according to the sight recognition results, and completes the selection, payment, and purchase of tobacco products one by one.
[0043] The operation steps of the line-of-sight and voice-interactive cigarette vending machine include:
[0044] 1. The camera detects face data and wakes up the device when the consumer is in front of the sight-voice interactive cigarette vending machine;
[0045] 2. The central control system broadcasts a voice through the loudspeaker to remind consumers to put the ID card in the designated area;
[0046]3. Perform authentication comparison through the identity verification module. If it is confirmed that it meets the age group for purchase, the display screen or speaker will prompt that the verification is successful, and enter the consumption program for purchase and payment. If it is confirmed that it does not meet the age group for purchase, the display screen or The speaker prompts that the verification failed;
[0047] 4. After the consumer receives the prompt of successful verification, follow the operation guideline and look at the name of the product to be purchased on the display screen. The sight information is intelligently recognized by the edge computing processor and uploaded to the cloud server by the central control system through the communication module;
[0048] 5. The central control system controls the changes of the display screen page. After consumers see the content changes on the display screen interface, they complete follow-up operations according to the guidelines. The sight-voice interactive vending machine products are shipped according to the inventory database in the cloud server and updated at the same time Inventory database and consumption database related information in the cloud server.
[0049] In this embodiment, the identity verification module includes:
[0050] A face collection unit for collecting face information of buyers;
[0051] A face recognition unit is used to obtain the buyer's identity information from the database;
[0052] Certificate type selection unit, the default ID card is the preferred certificate, and other ID card types can be manually selected through the input module;
[0053] A certificate collection unit, configured to collect image information of the certificate;
[0054] An identity information interception unit, configured to intercept the face area and date of birth in the document image information area;
[0055] A preprocessing unit is used to process the image information of the certificate to obtain machine-readable code information that can be recognized by the OCR unit;
[0056] The OCR unit is used to identify machine-readable code information to obtain identity information;
[0057] The identity verification unit is used to verify whether the identity information is over 18 years old, and whether the identity document and the purchaser are the same person;
[0058] The database is used to store the buyer's identity information. If the face recognition unit obtains the buyer's information from the database, and the buyer is over 18 years old, no subsequent identity verification is required.
[0059] In this embodiment, the cigarette vending machine body also includes a box body and a box door, the box body and the box door are opened and closed by a hidden door lock, the box door is provided with a light box and an outlet, and the box The body is provided with a power module, a storage shelf, a cargo lane and a delivery warehouse, and the storage shelf adopts a magazine cargo lane, and the magazine cargo lane is controlled by a controller.