A shopping method and system based on the collaboration between door locks and unmanned supermarkets

Abstract

This invention discloses a shopping method and system based on the collaboration between door locks and unmanned supermarkets. The method includes: generating an improved multicast join message based on the shopping list information entered by the homeowner on the smart door lock, and sending it to a preset multicast address to complete multicast registration; based on the event triggered by the authorized user's facial recognition upon arrival at the unmanned supermarket, the supermarket door lock generates a verification request message and sends it via multicast to complete identity verification and unlock the supermarket door; based on the payment request triggered after the authorized user selects goods, the payment machine generates a payment confirmation message and sends it via multicast to trigger the homeowner's confirmation interface; based on the homeowner's payment confirmation, the door lock collects the payment QR code and sends it to the payment machine; after payment is completed, the door lock sends a multicast leave message to end the shopping process. Using this invention, flexible collaboration between door locks and supermarket systems can be achieved, solving the problems of convenient shopping and security management in offline scenarios.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of intelligent shopping, and particularly relates to a shopping method and system based on cooperation of a door lock and an unmanned supermarket. BACKGROUND

[0002] With the popularity of unmanned supermarkets in communities, the mode of relying on mobile phone code scanning to open the door and payment exists a use obstacle for minors without mobile phones. When parents entrust minors to go shopping, the minors often cannot complete the shopping due to lack of operation equipment, and are prone to miss the shopping list or over-consume, resulting in interruption of the shopping process.

[0003] In the prior art, the identity verification and payment of the unmanned supermarket excessively rely on mobile terminals, and no adaptive solution is designed for minors; parents are difficult to remotely preset shopping restrictions and real-time control, and there is a risk of out-of-control consumption. At the same time, the communication addresses of multiple types of unmanned facilities in the community dynamically change, and the traditional fixed communication mode is difficult to realize flexible cooperation of the door lock and the supermarket system, affecting the cross-device interaction efficiency. SUMMARY

[0004] The purpose of the present application is to provide a shopping method and system based on cooperation of a door lock and an unmanned supermarket, to solve the problems in the prior art, and to realize flexible cooperation of the door lock and the supermarket system, and to solve the problems of convenient shopping and safe control in an offline scene.

[0005] One embodiment of the present application provides a shopping method based on cooperation of a door lock and an unmanned supermarket, which comprises the following steps:

[0006] Shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message containing the commodity details, the upper limit of the amount and the authorized user biological characteristics is generated, and is sent to the preset multicast address, to complete the multicast registration;

[0007] Face recognition entry into the supermarket verification: according to the event triggered by the face recognition of the authorized user after arriving at the unmanned supermarket, the supermarket door lock generates a verification request message containing the user biological characteristics and sends it through multicast, and the router compares the biological characteristics in the multicast forwarding table and then directionally forwards it to the owner's door lock, to complete the identity verification and open the supermarket door lock;

[0008] Payment confirmation and parent authorization: according to the payment request triggered after the authorized user selects and purchases commodities, the payment machine generates a payment confirmation message containing the commodity details and the total amount and sends it through multicast, and the router compares the commodity information and the upper limit of the amount and then directionally forwards it to the owner's door lock, to trigger the owner's confirmation interface;

[0009] Payment execution and process end: according to the operation of the owner confirming the payment, the door lock collects the payment two-dimensional code and sends it to the payment machine, and after the payment is completed, the door lock sends a multicast leaving message to end the shopping process.

[0010] Optionally, the shopping list setting and multicast registration comprises:

[0011] Shopping information input: according to the operation of the owner on the door lock APP or the door lock display screen, input the product name, brand, quantity and shopping amount upper limit information to be purchased;

[0012] Biological feature binding: according to the authorized user face feature vector stored locally by the door lock, it is associated and bound with the shopping information;

[0013] Multicast message generation: according to the preset improved IGMP / PIM message format, the shopping information and the bound face feature vector are encapsulated into multicast join message;

[0014] Multicast registration completion: according to the preset multicast address, the multicast join message is sent, and after the router receives it, the shopping information and the face feature vector are stored in the corresponding out interface of the multicast forwarding table.

[0015] Optionally, the face recognition entering supermarket verification comprises:

[0016] Supermarket face recognition trigger: according to the face recognition operation of the authorized user in front of the door lock of the unmanned supermarket, the door lock of the supermarket collects the face feature vector of the current user;

[0017] Verification message multicast: according to the collected face feature vector, a verification request message with a preset multicast address as the destination address is generated and multicast;

[0018] Router feature comparison: according to the verification request message received by the router, the face feature vector therein is extracted and matched with the features stored in each out interface of the multicast forwarding table;

[0019] Directional forwarding and door opening: according to the matching result of successful comparison, the router forwards the verification request message from the corresponding out interface to the owner's door lock, and the owner's door lock sends an open door instruction to the supermarket door lock after verification.

[0020] Optionally, the payment confirmation and parent authorization comprises:

[0021] Payment information generation: according to the result of the payment machine scanning the selected goods of the user, payment information containing the product name, brand, quantity and total amount is generated;

[0022] Payment confirmation message multicast: according to the payment information and the user face feature vector, a payment confirmation message is generated and sent through multicast;

[0023] Router comprehensive comparison: according to the payment confirmation message received by the router, face feature matching, product name matching, brand matching, quantity matching and amount upper limit verification are performed in turn;

[0024] Owner confirmation trigger: according to the result that all comparison items are successful, the router forwards the payment confirmation message to the owner lock, and the lock pops up a shopping list confirmation interface on the local display screen and the APP after receiving the message.

[0025] Optionally, the payment execution and process end include:

[0026] Payment authorization and two-dimensional code collection: according to the operation of the owner agreeing to pay on the confirmation interface, the lock prompts the owner to present the payment two-dimensional code, and collects the two-dimensional code image through the camera;

[0027] Payment execution: according to the payment two-dimensional code image collected, the lock encapsulates it with this payment number into a payment request message, and unicasts it to the unmanned supermarket payment machine;

[0028] Payment completion notification: according to the successful payment processing of the payment machine, the payment success notification is unicast to the lock;

[0029] Process end: according to the received payment success notification, the lock sends an IGMP leave message to the multicast address, and notifies the router to clear the multicast forwarding table item of this shopping.

[0030] Optionally, the method further includes abnormal situation processing:

[0031] Abnormality detection and message caching: according to the situation that the multicast forwarding table item is lost due to the restart of the router, the router cannot forward the payment confirmation message, and the destination address of the payment confirmation message is a preset multicast address, the router caches the payment confirmation message; wherein the payment confirmation message contains the face feature vector of the authorized user, and the message caching result is obtained;

[0032] Broadcast query trigger: according to the caching state, the router generates and broadcasts a query message carrying the face feature vector; wherein the query message is used to request the lock associated with the face feature vector to re-register multicast, and the broadcast query trigger result is obtained;

[0033] Multicast table item reconstruction: according to the fact that the owner lock receives the query message and compares the locally stored face feature vector, if the matching is successful, the lock immediately sends an IGMP registration message containing the face feature vector to the router; wherein the router receives the IGMP registration message, reconstructs the multicast forwarding table item, and stores the face feature vector and the corresponding outgoing interface, and obtains the table item reconstruction result;

[0034] Cache message forwarding and process recovery: according to the multicast forwarding table item reconstruction is completed, the router will cache payment confirmation message according to the forwarding table item after reconstruction Directional forwarding; wherein, the owner door lock receives the message and continues to execute the payment confirmation and parent authorization process, guarantee the continuity of the payment process, get the abnormal processing result.

[0035] Yet another embodiment of the application provides a shopping system based on the cooperation of door lock and unmanned supermarket, the system comprises:

[0036] The registration module is used for shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message containing the commodity details, the upper limit of the amount and the authorized user biological characteristics is generated, and is sent to the preset multicast address, completing the multicast registration;

[0037] The verification module is used for face recognition to enter the supermarket verification: according to the event triggered by the face recognition of the authorized user after reaching the unmanned supermarket, the supermarket door lock generates a verification request message containing the user biological characteristics and sends it through multicast, which is forwarded to the owner door lock by the router after comparing the biological characteristics in the multicast forwarding table, completing the identity verification and opening the supermarket door lock;

[0038] The authorization module is used for payment confirmation and parent authorization: according to the payment request triggered by the authorized user after selecting and purchasing goods, the payment machine generates a payment confirmation message containing the commodity details and the total amount and sends it through multicast, which is forwarded to the owner door lock by the router after comparing the commodity information and the upper limit of the amount, triggering the owner confirmation interface;

[0039] The payment module is used for payment execution and process end: according to the operation of the owner confirming payment, the door lock collects the payment two-dimensional code and sends it to the payment machine, and after completing the payment, the door lock sends a multicast leave message, ending the shopping process.

[0040] Yet another embodiment of the application provides a storage medium, the storage medium stores a computer program, wherein the computer program is set to execute the method described in any of the above embodiments when running.

[0041] Yet another embodiment of the application provides an electronic device comprising a memory and a processor, the memory stores a computer program, and the processor is set to run the computer program to execute the method described in any of the above embodiments.

[0042] Compared with existing technologies, this invention provides a shopping method based on the collaboration between door locks and unmanned supermarkets. Based on the shopping list information entered by the homeowner on the smart door lock, an improved multicast join message is generated and sent to a preset multicast address to complete multicast registration. Upon the authorized user's arrival at the unmanned supermarket and the event triggered by facial recognition, the supermarket door lock generates a verification request message and sends it via multicast to complete identity verification and unlock the door. Based on the payment request triggered after the authorized user selects goods, the payment terminal generates a payment confirmation message and sends it via multicast to trigger the homeowner's confirmation interface. Upon the homeowner's payment confirmation, the door lock collects the payment QR code and sends it to the payment terminal. After payment is completed, the door lock sends a multicast leave message to end the shopping process. This enables flexible collaboration between the door lock and the supermarket system, solving the problems of convenient shopping and security management in offline scenarios. Attached Figure Description

[0043] Figure 1 A hardware structure block diagram of a computer terminal for a shopping method based on the collaboration between a door lock and an unmanned supermarket, provided in an embodiment of the present invention;

[0044] Figure 2 A schematic flowchart illustrating a shopping method based on the collaboration between a door lock and an unmanned supermarket, provided as an embodiment of the present invention;

[0045] Figure 3 This is a schematic diagram of a shopping system based on the collaboration between door locks and unmanned supermarkets, provided as an embodiment of the present invention. Detailed Implementation

[0046] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0047] With the rapid development of AI technology, unmanned shopping has quietly emerged, and many residential communities now have unmanned supermarkets. When residents shop at these supermarkets, they typically need to use their mobile phones to scan a code to open the door, select items, and pay. However, if children are shopping (e.g., children sent by their parents to buy ingredients and seasonings), they may not be able to complete the shopping process due to not having a phone or improper operation, and they may also forget items on their parents' shopping lists.

[0048] This invention first provides a shopping method based on the collaboration between door locks and unmanned supermarkets. This method can be applied to electronic devices, such as computer terminals, specifically ordinary computers.

[0049] The following detailed explanation uses a computer terminal as an example. Figure 1 This is a hardware structure block diagram of a computer terminal for a shopping method based on the collaboration between a door lock and an unmanned supermarket, provided as an embodiment of the present invention.Figure 1 As shown in the figure, the computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory can include a non-volatile storage medium and an internal memory.

[0050] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions which, when executed, can cause the processor to perform any one of the shopping methods based on the cooperation of the door lock and the unmanned supermarket.

[0051] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0052] The internal memory provides an environment for the running of the computer program in the non-volatile storage medium, which, when executed by the processor, can cause the processor to perform any one of the shopping methods based on the cooperation of the door lock and the unmanned supermarket.

[0053] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that, Figure 1 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0054] It should be understood that the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0055] Referring to Figure 2 The embodiments of the present application provide a shopping method based on the cooperation of the door lock and the unmanned supermarket, which can include the following steps:

[0056] S201, shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message containing the commodity details, the upper limit of the amount and the authorized user biometric features is generated, and is sent to the preset multicast address, and the multicast registration is completed; specifically, the shopping list setting and multicast registration comprises:

[0057] Shopping information input: according to the operation of the owner on the door lock APP or the door lock display screen, the commodity name, brand, quantity and shopping amount upper limit information are input;

[0058] Biometric feature binding: according to the authorized user face feature vector stored locally by the door lock, it is associated and bound with the shopping information;

[0059] Multicast message generation: according to the preset improved IGMP / PIM message format, the shopping information and the bound face feature vector are encapsulated into a multicast join message;

[0060] Multicast registration completion: according to the preset multicast address, the multicast join message is sent, and after the router receives it, the shopping information and the face feature vector are stored in the corresponding out interface of the multicast forwarding table of the router.

[0061] S202, face recognition to enter the supermarket verification: according to the event triggered by the authorized user's face recognition after reaching the unmanned supermarket, the supermarket door lock generates a verification request message containing the user biometric features and sends it through multicast, which is forwarded to the owner's door lock by the router after comparing the biometric features in the multicast forwarding table, completes the identity verification and opens the supermarket door lock; specifically, the face recognition to enter the supermarket verification comprises:

[0062] Supermarket face recognition trigger: according to the face recognition operation of the authorized user in front of the unmanned supermarket door lock, the supermarket door lock collects the face feature vector of the current user;

[0063] Verification message multicast: according to the collected face feature vector, a verification request message with a preset multicast address as the destination address is generated and multicast is performed;

[0064] Router feature comparison: according to the verification request message received by the router, the face feature vector therein is extracted and matched with the features stored in each out interface of the multicast forwarding table;

[0065] Directional forwarding and door opening: according to the matching successful comparison result, the router forwards the verification request message from the corresponding out interface to the owner's door lock, and the owner's door lock sends an open door instruction to the supermarket door lock after verification.

[0066] S203, payment confirmation and parent authorization: according to the payment request triggered by the authorized user selecting the goods, the payment machine generates a payment confirmation message containing the details of the goods and the total amount and sends it through multicast, and the router compares the goods information and the upper limit of the amount and then forwards it to the owner's lock in a targeted manner to trigger the owner's confirmation interface; specifically, the payment confirmation and parent authorization comprises:

[0067] Payment information generation: according to the result of the payment machine scanning the selected goods of the user, generate payment information containing the name, brand, quantity and total amount of the goods;

[0068] Payment confirmation message multicast: according to the payment information and the user's face feature vector, generate a payment confirmation message and send it through multicast;

[0069] Router comprehensive comparison: according to the payment confirmation message received by the router, perform face feature matching, product name matching, brand matching, quantity matching and upper limit of amount verification in turn;

[0070] Owner confirmation trigger: according to the result that all comparison items are successful, the router forwards the payment confirmation message to the owner's lock, and the lock pops up a shopping list confirmation interface on the local display screen and APP after receiving it.

[0071] S204, payment execution and process end: according to the operation of the owner confirming payment, the lock collects the payment QR code and sends it to the payment machine, and after completing the payment, the lock sends a multicast leave message to end the shopping process. Specifically, the payment execution and process end comprises:

[0072] Payment authorization and QR code collection: according to the operation of the owner agreeing to pay on the confirmation interface, the lock prompts the owner to show the payment QR code, and collects the QR code image through the camera;

[0073] Payment execution: according to the collected payment QR code image, the lock encapsulates it with this payment number into a payment request message and sends it to the unmanned supermarket payment machine through unicast;

[0074] Payment completion notification: according to the successful payment processing of the payment machine, send a payment success notification to the lock through unicast;

[0075] Process end: according to the received payment success notification, the lock sends an IGMP leave message to the multicast address to notify the router to clear the multicast forwarding table item of this shopping.

[0076] Further, the method further comprises abnormal situation processing:

[0077] Abnormality detection and message buffering: according to the situation that the multicast forwarding table items are lost due to the router restart, the router cannot forward the payment confirmation message, and the router detects that the destination address of the payment confirmation message is a preset multicast address, so the payment confirmation message is buffered; wherein the payment confirmation message contains the face feature vector of the authorized user, and the message buffering result is obtained;

[0078] Broadcast query triggering: according to the buffering state, the router generates and broadcasts a query message carrying the face feature vector; wherein the query message is used to request the door lock associated with the face feature vector to re-register multicast, and the broadcast query triggering result is obtained;

[0079] Multicast table item reconstruction: according to the fact that the owner's door lock receives the query message, compares the locally stored face feature vector, and if the matching is successful, immediately sends an IGMP registration message containing the face feature vector to the router; wherein the router receives the IGMP registration message, reconstructs the multicast forwarding table item, and stores the face feature vector and the corresponding outgoing interface, and the table item reconstruction result is obtained;

[0080] Buffered message forwarding and process recovery: according to the completion of the multicast forwarding table item reconstruction, the router forwards the buffered payment confirmation message according to the reconstructed forwarding table item; wherein the owner's door lock receives the message and continues to execute the payment confirmation and parent authorization process, ensuring the continuity of the payment process, and the abnormality processing completion result is obtained.

[0081] In practical application, the application provides a method and system for coordinating the community owner door lock and the unmanned supermarket related system, and the owner issues a shopping list and an upper limit amount at the door lock, and the minor children are delegated to complete shopping at the unmanned supermarket without a mobile phone.

[0082] Solution:

[0083] I. Precondition:

[0084] The intelligent door lock is installed in the owner's home in the community, has a camera that can extract the face feature vector of the owner's family, the door lock of the unmanned supermarket and the door lock of the community owner can communicate with each other (the unmanned stores such as the unmanned supermarket, the unmanned gym and the unmanned bookstore in the community are uniformly decorated according to the key infrastructure of the community property management), the owner's door lock has an electronic display screen that can input cooperative information (such as a shopping list, a shopping amount, etc.). The payment machine of the unmanned supermarket supports face payment, and the shopping system of the unmanned supermarket has an AI engine to assist the daily management of the unmanned supermarket and can interpret the data transmitted by the owner's door lock.

[0085] II. Scheme steps:

[0086] 1. The owner inputs shopping information at the door lock of his own house, and assigns his children to go to the unmanned supermarket to do shopping:

[0087] (1) When the owner (such as owner A) is doing daily housework (such as cooking), he needs to do instant shopping, but he cannot stop doing the housework. In general, he will assign his children to go to the nearby supermarket or convenience store to quickly do shopping. If the children are not yet of legal age (such as children who have just started school), they do not have their own mobile phones and cannot independently complete the shopping process. Owner A can select supermarket shopping on the door lock APP, and select or fill in the required item name (such as selecting soy sauce, and if the option cannot be found, it can be filled in by hand), item brand (such as selecting A soy sauce, and if the option cannot be found, it can be filled in by hand, and if there is no requirement for the brand, select "any brand"), item quantity, and shopping amount upper limit according to the program format requirements.

[0088] (2) The door lock APP sends the shopping information (item name, item brand, item quantity, and shopping amount upper limit) to the door lock of his own house (door lock A). The door lock reads the face feature vectors of all residents (members allowed to open the door lock, such as parents, elders, and children) saved locally, and sends an IGMP message with the destination address of 227.11.11.1 (a unified multicast address agreed upon by the owner's door lock and the door lock of the unmanned supermarket and the unmanned supermarket shopping system for shopping communication) to join the "supermarket shopping" multicast group. The purpose of joining the multicast group is that the door locks of unmanned stores such as unmanned supermarkets, unmanned gyms, and unmanned bookstores have multiple and non-fixed addresses, and the owner's door lock cannot pre-store the addresses and update them in a timely manner after the addresses change. Therefore, temporary communication is carried out by joining the agreed multicast group address.

[0089] (3) The IGMP message sent by door lock A is improved to carry the 5 data items of "item name, item brand, item quantity, and shopping amount upper limit, and face feature vector". At the same time, in order to realize the forwarding of multicast messages between routers, the PIM join message is also improved: based on the original PIM join message structure, the 5 data items of "item name, item brand, item quantity, and shopping amount upper limit, and face feature vector" are added. The router is responsible for storing and processing the improved IGMP message and PIM join message, and storing "item name, item brand, item quantity, and shopping amount upper limit, and face feature vector" in the out-interface of the multicast forwarding table. The improved IGMP / PIM join message is sent when the owner fills in the shopping information, and will not age.

[0090] (4) Owner A tells his children the item name, item brand, item quantity, and purchase amount upper limit that needs to be purchased. If the children have their own purchase requirements, they can meet their individual needs within the amount limit.

[0091] 2. The child arrives at the unmanned supermarket, brushes his face to enter and completes the selection of goods:

[0092] (1) After the child arrives at the unmanned supermarket, the face verification is carried out at the supermarket door lock. The supermarket door lock collects the child's face feature vector through the camera, sends the "shopping face verification" multicast message with the destination address of 227.11.11.1, and carries the child's face feature vector in the message.

[0093] (2) The router queries the multicast forwarding table with the group address of 227.11.11.1, finds the member out interface, compares whether the face feature vector data stored on the out interface is consistent, and if it matches, the router transmits the multicast message from the out interface. The door lock A can receive the "shopping face verification" multicast message (other door locks will not receive it to avoid face feature privacy leakage), and by comparing the locally stored face feature vector, it is found that it is a family member, and the face verification is matched. In turn, the unmanned supermarket door lock is unicast to reply the verification through message. The message content includes the source IP of the door lock A, the face feature vector of the child, and the face verification pass tag is set to 1.

[0094] (3) After the unmanned supermarket door lock receives the verification through message fed back by the door lock A, the door lock of the supermarket is opened, and the child can enter the supermarket to shop.

[0095] (4) If the "shopping face verification" multicast message does not find the out interface carrying the same face feature vector in the multicast forwarding table of the router (such as a stranger curious about brushing his face at the unmanned supermarket door lock), the router discards the multicast message.

[0096] 3. The child completes the shopping and completes the face scanning at the payment machine:

[0097] (1) Children in the supermarket according to the parents to complete the selection of goods, to the payment machine ready to pay, the payment machine first of all to select the goods code scanning, record the name of the goods, goods brand, the number of goods and calculate the total amount. Next payment link, children in the payment machine screen to choose to pay face, and complete the face recognition, payment machine to extract the child's face feature vector, send the destination address is 227.11.11.1 "payment confirmation" multicast message, the message carries the name of the goods, goods brand, the number of goods and total amount, router query multicast forwarding table, through the comparison of the interface of the name of the goods, goods brand, the number of goods and total amount, for the following conditions are met "payment confirmation" message forwarding: face feature vector matching, goods name matching (if it is a fine classification of the name, the AI of the unmanned supermarket shopping system will automatically give the upper level classification, to avoid overfitting can not match the non-standard name input by the owner. Such as the user input is cooking oil, but the child's name of the goods purchased olive oil, AI will be the upper level classification of olive oil cooking oil also join "payment confirmation" message), goods brand matching (if the owner chooses any brand when purchasing on the door lock APP, the default matching is successful), the number of goods matching (when the total amount does not exceed the purchase amount limit, "payment confirmation" message in the number of goods is greater than the router forwarding table interface of the number of goods is also equal to match), the total amount is not greater than the purchase amount limit.

[0098] (2) Router query forwarding table found that the face feature vector matching forwarding table interface is the interface connecting the door lock A, and the other content (name of goods, goods brand, the number of goods, total amount) are checked by matching, to the interface forwarding "payment confirmation" message, the door lock A received the message, the message carrying the shopping content (name of goods, goods brand, the number of goods, total amount) on the door lock display screen, and voice broadcast "dear owner, you have a shopping list from X supermarket need to confirm, please check the list content as soon as possible, if confirmed, please click agree button, if the list content does not meet the requirements, please click the refuse button, and feedback the refusal opinion." The owner's door lock APP also pop up the same content of the dialog box message, reminding the owner to handle the payment process.

[0099] (3) The owner checks the shopping list and finds that the shopping content is correct, and clicks the agree button. The door lock A display screen or the door lock APP continues to pop up a prompt: "Please show the WeChat or Alipay payment QR code and click the payment button. The system will help you take a photo and transfer it to the X supermarket payment machine to complete the payment." After the owner shows the payment QR code and clicks the payment, the door lock camera or the mobile phone camera (when using the mobile phone APP) automatically takes a photo of the payment QR code and unicast transmits it to the unmanned supermarket payment machine (it needs to be noted that the "payment confirmation" message sent by the payment machine and the payment QR code photo message transmitted by the door lock both need to carry the same payment number. This number is not displayed on the door lock display screen or mobile phone, and is used to ensure the consistency of the payment steps.) After receiving the payment QR code, the payment machine automatically scans the code to complete the payment and unicast replies "payment completed" message to the door lock A: this payment has been completed, the total payment amount is XX yuan, and I wish you a pleasant shopping experience. After receiving the "payment completed" message, the door lock A sends an IGMP leave message to end the shopping process.

[0100] (4) Compared with section 2 of this chapter, the router receives the "payment confirmation" message and checks the multicast forwarding table out interface. It is found that the face feature vector matching out interface is the interface connected to the door lock A, but the other shopping content (item name, item brand, item quantity, total amount) carried by the out interface does not pass the matching check or part of it does not pass the matching check, then discard the "payment confirmation" message and reply "reject payment" to the unmanned supermarket payment machine. The "reject payment" message carries the shopping content (item name, item brand, item quantity, total amount) stored in the out interface connected to the door lock A. After receiving the message, the payment machine of the unmanned supermarket retrieves the AI engine to interpret the data content in the message and compares it with the shopping data in the "payment confirmation" message. The mismatched content is generated in text and broadcasted by the payment machine in voice, such as: "Dear customer, the items you purchased do not include A brand soy sauce, which is placed at position 2 of cabinet 3, please go to select and purchase" or "The total amount of the items you purchased exceeds the upper limit of the shopping amount by 20 yuan. You have an additional item, XX, which is worth 30 yuan. It is recommended that you do not purchase this item this time, please put it back at position 3 of cabinet 2." Through voice, prompt the underage children to adjust the shopping content and complete the shopping requirements, and then re-scan the face to pay.

[0101] (5) Compared with the third part of this chapter, the owner checks the shopping list and finds that the shopping content does not meet the requirements, such as the brand of the item. When the owner chooses any brand at the time of purchase, the owner thinks that the brand in the shopping list is not suitable and needs to be adjusted. At this time, the owner clicks the reject button and feeds back the rejection opinion as "2 bottles of B brand soy sauce need to be purchased" on the door lock display screen or mobile phone APP. The door lock A feeds back the rejection opinion to the payment machine of the unmanned supermarket at the same time, re-sends the IGMP join message, and carries the modified item name as soy sauce, item brand as B, quantity as 2, and updates the multicast forwarding table of the router. After receiving the rejection opinion of the door lock A, the payment machine of the unmanned supermarket compares the currently selected items by the AI engine and optimizes the opinion content, and makes a voice broadcast: "Dear customer, the 2 bottles of A soy sauce you purchased need to be replaced with 2 bottles of B soy sauce. Please put the A soy sauce back to position 2 of cabinet No. 3 and go to position 3 of cabinet No. 3 to select and purchase B soy sauce". The minor child adjusts the shopping content according to the voice prompt and completes the shopping requirement and re-scans the face to pay.

[0102] 4. Abnormal situation processing:

[0103] (1) Abnormal situation: when the router restarts, the multicast forwarding table item disappears, at this time, the "payment confirmation" message cannot be forwarded. However, the router finds that it is the "payment confirmation" message, there must be historical IGMP registration table items, so the router first caches the message, only carries the face feature vector of the daughter-in-law, and broadcasts it. After receiving this broadcast message, the door lock A compares the face feature vector stored in itself, and after matching, it will immediately feed back the IGMP registration message carrying the face feature vector of the daughter-in-law, and re-maintain the multicast forwarding table. After the door lock A completes the above behavior, the router forwards the complete "payment confirmation" message again. When there are multiple owners shopping in the unmanned supermarket through the door lock, this processing method can alleviate the impact of IGMP message on the router, avoid multiple door locks sending IGMP join message to respond to the multicast query message after the router restarts, and give priority to processing the "payment confirmation" message at this moment. The payment, and other payment links that have not arrived at the time of payment are processed in the same way, reducing the pressure on the router.

[0104] Beneficial effects: This scheme dynamically connects the door lock and the supermarket shopping equipment based on multicast communication (IGMP / PIM improvement), without pre-storing or maintaining fixed equipment addresses, and automatically rebuilds the multicast table item when the router restarts, ensuring the continuity of the payment process. It realizes that minors can complete the supermarket entering, commodity selection and payment whole process by face recognition, without relying on mobile phone operation; parents can avoid children missing or excessive consumption by pre-setting the shopping list and upper limit of the amount on the door lock; the AI engine compares the shopping list with the actual selected goods in real time, and prompts the child to adjust (such as brand inconsistency, amount exceeding limit) by voice; the door lock screen display and voice broadcast synchronously display the shopping information in real time, and the parents can remotely confirm / reject payment, which is convenient to operate.

[0105] Protection points: 1, the intelligent door lock and the unmanned supermarket door lock and shopping system interact through improved IGMP / PIM multicast messages (carrying 5 data such as face features and shopping list) 2, the router multicasts and forwards "shopping face verification" messages and "payment confirmation" messages, and realizes accurate forwarding of multicast messages by matching the face features and commodity information carried by the forwarding performance. 3, it realizes the whole process of cooperative shopping that parents set shopping requirements on the door lock APP, children reach the unmanned supermarket to verify the face and enter the store, the payment machine sends the payment confirmation, the parents remotely confirm and provide the payment QR code through the door lock screen display or APP, and the parents can adjust the shopping list when the store does not match, the AI analyzes the difference and generates adjustment instructions, and the child adjusts the voice guidance. 4, when the router fails to restart, the router carries the face feature message through broadcast, and the related door lock actively rebuilds the multicast forwarding table item to ensure the continuity of the payment process.

[0106] As can be seen, according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message is generated and sent to the preset multicast address to complete multicast registration; according to the event triggered by the authorized user brushing the face after reaching the unmanned supermarket, the supermarket door lock generates a verification request message and sends it through multicast to complete identity verification and open the supermarket door lock; according to the payment request triggered by the authorized user selecting and purchasing goods, the payment machine generates a payment confirmation message and sends it through multicast to trigger the owner confirmation interface; according to the owner's payment confirmation operation, the door lock collects the payment QR code and sends it to the payment machine, and after payment, the door lock sends a multicast leave message to end the shopping process, so as to realize flexible cooperation between the door lock and the supermarket system, and solve the problems of convenient shopping and safe management in offline scenarios.

[0107] Another embodiment of the present application provides a shopping system based on cooperation of door lock and unmanned supermarket, referring to Figure 3 , the system can include:

[0108] The registration module 301 is used for shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message containing commodity details, an upper limit of an amount and an authorized user biological feature is generated, and is sent to a preset multicast address, and the multicast registration is completed;

[0109] The verification module 302 is used for face recognition entering supermarket verification: according to an event triggered by face recognition of the authorized user after arriving at the unmanned supermarket, the supermarket door lock generates a verification request message containing the user biological feature and sends the verification request message through multicast, and the router compares the biological feature in the multicast forwarding table and then directionally forwards to the owner door lock, the identity verification is completed, and the supermarket door lock is opened;

[0110] The authorization module 303 is used for payment confirmation and parent authorization: according to a payment request triggered after the authorized user selects and purchases commodities, the payment machine generates a payment confirmation message containing commodity details and a total amount and sends the payment confirmation message through multicast, and the router compares the commodity information and the upper limit of the amount and then directionally forwards to the owner door lock, and the owner confirmation interface is triggered;

[0111] The payment module 304 is used for payment execution and process end: according to the operation of the owner confirming payment, the door lock collects a payment two-dimensional code and sends the payment two-dimensional code to the payment machine, after the payment is completed, the door lock sends a multicast leaving message, and the shopping process is ended.

[0112] The embodiment of the application further provides a storage medium, and the storage medium stores a computer program, and the computer program is set to execute the steps in any one of the method embodiments.

[0113] The embodiment of the application further provides an electronic device, which comprises a memory and a processor, the memory stores a computer program, and the processor is set to execute the computer program to execute the steps in any one of the method embodiments.

[0114] Specifically, the electronic device can further comprise a transmission device and an input and output device, wherein the transmission device is connected with the processor, and the input and output device is connected with the processor.

[0115] The above embodiment according to the drawings illustrates the structure, features and effects of the application, and the above description is only a preferred embodiment of the application, but the application is not limited by the drawings, any change or modification made according to the idea of the application, or equivalent embodiments with equivalent changes, still within the protection scope of the specification and drawings.

Claims

1. A shopping method based on the cooperation of a door lock and an unmanned supermarket, characterized in that, The method comprises: Shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent door lock, an improved multicast join message containing the commodity details, the upper limit of the amount and the authorized user biometric features is generated and sent to the preset multicast address, and the multicast registration is completed; Face recognition to enter the supermarket verification: according to the event triggered by the face recognition of the authorized user after arriving at the unmanned supermarket, the supermarket door lock generates a verification request message containing the user biometric features and sends it through multicast, and the router compares the biometric features in the multicast forwarding table and then forwards it to the owner's door lock, completes the identity verification and opens the supermarket door lock; Payment confirmation and parent authorization: according to the payment request triggered by the authorized user after selecting and purchasing the goods, the payment machine generates a payment confirmation message containing the commodity details and the total amount and sends it through multicast, and the router compares the commodity information and the upper limit of the amount and then forwards it to the owner's door lock, triggering the owner's confirmation interface; Payment execution and process end: according to the owner's payment confirmation operation, the door lock collects the payment two-dimensional code and sends it to the payment machine, and after the payment is completed, the door lock sends a multicast leave message to end the shopping process.

2. The method of claim 1, wherein, The shopping list setting and multicast registration comprises: Shopping information input: according to the operation of the owner on the door lock APP or the door lock display screen, input the commodity name, brand, quantity and shopping amount upper limit information to be purchased; Biometric feature binding: according to the authorized user face feature vector stored locally by the door lock, associate and bind it with the shopping information; Multicast message generation: according to the preset improved IGMP / PIM message format, encapsulate the shopping information and the bound face feature vector into a multicast join message; Multicast registration completion: according to the preset multicast address, send the multicast join message, and the router stores the shopping information and the face feature vector in the corresponding out-interface of the multicast forwarding table after receiving it.

3. The method of claim 2, wherein, The face recognition to enter the supermarket verification comprises: Supermarket face recognition trigger: according to the face recognition operation of the authorized user in front of the unmanned supermarket door lock, the supermarket door lock collects the face feature vector of the current user; Verification message multicast: according to the collected face feature vector, generate a verification request message with the preset multicast address as the destination address and multicast it; Router feature comparison: according to the verification request message received by the router, extract the face feature vector therein and match it with the features stored in each out-interface of the multicast forwarding table; Directional forwarding and door opening: according to the matching successful comparison result, the router forwards the verification request message from the corresponding out-interface to the owner's door lock, and the owner's door lock sends an open door instruction to the supermarket door lock after verification.

4. The method of claim 3, wherein, The payment confirmation and parent authorization comprises: Payment information generation: according to the result of the payment machine scanning the code of the user's selected goods, generate payment information containing the commodity name, brand, quantity and total amount; Payment confirmation message multicast: according to the payment information and the user face feature vector, generate a payment confirmation message and send it through multicast; Router comprehensive comparison: according to the payment confirmation message received by the router, perform face feature matching, commodity name matching, brand matching, quantity matching and upper limit amount verification in sequence; The owner confirmation trigger: according to the result that all the comparison items are successful, the router forwards the payment confirmation message to the owner lock, and the lock pops up a shopping list confirmation interface on the local display screen and the APP after receiving the message.

5. The method of claim 4, wherein, The payment execution and process end include: Payment authorization and two-dimensional code collection: according to the operation of the owner agreeing to pay on the confirmation interface, the lock prompts the owner to show the payment two-dimensional code, and collects the two-dimensional code image through the camera; Payment execution: according to the payment two-dimensional code image collected, the lock encapsulates it with the payment number of this time into a payment request message, and unicast sends it to the unmanned supermarket payment machine; Payment completion notification: according to the successful payment processing of the payment machine, the payment success notification is unicast sent to the lock; Process end: according to the received payment success notification, the lock sends IGMP leave message to the multicast address, and notifies the router to clear the multicast forwarding table item of this shopping.

6. The method of claim 5, wherein, The method also includes abnormal situation processing: Abnormal detection and message caching: according to the situation that the multicast forwarding table item is lost due to the restart of the router, the router cannot forward the payment confirmation message, and the destination address of the payment confirmation message is the preset multicast address, the payment confirmation message is cached; wherein the payment confirmation message contains the face feature vector of the authorized user, and the message caching result is obtained; Broadcast query trigger: according to the caching state, the router generates and broadcasts a query message carrying the face feature vector; wherein the query message is used to request the lock associated with the face feature vector to re-register multicast, and the broadcast query trigger result is obtained; Multicast table item reconstruction: according to the fact that the owner lock receives the query message and compares the locally stored face feature vector, if the matching is successful, the IGMP registration message containing the face feature vector is immediately sent to the router; wherein the router receives the IGMP registration message, reconstructs the multicast forwarding table item, and stores the face feature vector and the corresponding interface, and the table item reconstruction result is obtained; Caching message forwarding and process recovery: according to the completion of the multicast forwarding table item reconstruction, the router forwards the cached payment confirmation message according to the reconstructed forwarding table item; wherein the owner lock receives the message and continues to execute the payment confirmation and parent authorization process, which guarantees the continuity of the payment process, and the abnormal processing completion result is obtained.

7. A shopping system based on the cooperation of a door lock and an unmanned supermarket, characterized in that, The system includes: Registration module for shopping list setting and multicast registration: according to the shopping list information input by the owner on the intelligent lock, an improved multicast join message containing the commodity details, the upper limit of the amount and the biological characteristics of the authorized user is generated, and is sent to the preset multicast address, and the multicast registration is completed; Verification module for face recognition to enter the supermarket verification: according to the event triggered by the face recognition of the authorized user arriving at the unmanned supermarket, the supermarket lock generates a verification request message containing the user's biological characteristics and sends it through multicast, which is forwarded to the owner lock by the router after comparing the biological characteristics in the multicast forwarding table, completes the identity verification and opens the supermarket lock; The authorization module is used for payment confirmation and parent authorization: according to the payment request triggered after the authorized user selects and purchases the goods, the payment machine generates a payment confirmation message containing the details of the goods and the total amount and sends it through multicast, and the router compares the goods information and the upper limit of the amount and then forwards it to the owner lock in a targeted manner to trigger the owner confirmation interface; The payment module is used for payment execution and process end: according to the operation of the owner confirming payment, the lock collects the payment two-dimensional code and sends it to the payment machine, and after the payment is completed, the lock sends a multicast exit message to end the shopping process.

8. The system of claim 7, wherein, The registration module is specifically used for: Shopping information input: according to the operation of the owner on the lock APP or the lock display screen, input the name, brand, quantity and shopping upper limit information of the goods to be purchased; Biological feature binding: according to the face feature vector of the authorized user stored locally by the lock, the face feature vector is associated and bound with the shopping information; Multicast message generation: according to the preset improved IGMP / PIM message format, the shopping information and the bound face feature vector are encapsulated into a multicast join message; Multicast registration completion: according to the preset multicast address, the multicast join message is sent, and after the router receives it, the shopping information and the face feature vector are stored in the corresponding out-interface of the multicast forwarding table of the router.

9. A storage medium, characterized by The storage medium stores a computer program, wherein the computer program is configured to execute the method of any one of claims 1-6 when running.

10. An electronic device comprising a memory and a processor, characterized in that, The storage medium stores a computer program, wherein the computer program is configured to execute the method of any one of claims 1-6 when running.

Images