Shopping method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention discloses a shopping method and device, a storage medium and electronic equipment, and the method comprises the steps: capturing a video stream in the visual field of a user through a camera of intelligent glasses, and carrying out the eye movement tracking of the video stream, and obtaining a current fixation point of the user; and if the staying information of the current fixation point on the graphic code of the target commodity satisfies a first preset condition, identifying the graphic code in the video stream to obtain graphic code information corresponding to the graphic code, so that commodity information corresponding to the graphic code information is added to a virtual shopping cart of the user.

Description

Technical Field

[0001] This invention relates to computer technology, and more particularly to a method, apparatus, storage medium, and electronic device for shopping. Background Technology

[0002] In traditional supermarkets and shopping malls, the checkout counter is one of the least efficient parts of the entire shopping process. During peak hours, consumers have to spend a lot of time queuing to pay, which not only affects the shopping experience but also increases retailers' labor costs and investment in checkout equipment.

[0003] With the rapid development of the retail industry and the growing demand from consumers for convenient shopping experiences, traditional checkout methods have exposed numerous problems such as inefficiency, high labor costs, and long customer queues. Although self-checkout devices and some mobile payment solutions have been introduced, these solutions still require users to perform manual operations (such as picking up the goods, pointing the barcode scanner, and confirming payment), which essentially does not eliminate the cumbersome nature of the checkout process and cannot achieve a truly seamless and smooth experience. Summary of the Invention

[0004] The purpose of the embodiments in this specification is to provide a method, apparatus, storage medium, and electronic device for shopping.

[0005] This specification provides a shopping method that utilizes the AI ​​visual recognition and eye-tracking capabilities of smart glasses to deeply integrate AI visual recognition and eye-tracking technology. This creates a novel, hands-free automatic product identification and inventory management mode. Users do not need to perform any manual operations, eliminating the tedious steps of queuing for self-checkout machines and manually scanning each item. This significantly improves the efficiency and smoothness of the shopping process, eliminates the pain points of queuing and manual product scanning, and significantly enhances the user experience. It also greatly reduces investment in self-checkout equipment, transforming asset-heavy, high-cost checkout infrastructure (e.g., self-checkout machines) into asset-light, low-cost personal devices (smart glasses). This provides a more universal and replicable solution for the retail industry. The method includes: The smart glasses capture a video stream in the user's field of vision using their camera, and obtain the user's current gaze point by performing eye tracking on the video stream. If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, the graphic code in the video stream is identified to obtain the graphic code information corresponding to the graphic code, so that the product information corresponding to the graphic code information is added to the user's virtual shopping cart.

[0006] Furthermore, the method also includes: Product information for at least one item in the virtual shopping cart is displayed on the screen of the smart glasses.

[0007] Furthermore, the method also includes: The smart glasses are used to determine the first selected item in the virtual shopping cart. The user's updated information regarding the first product is obtained through the smart glasses, causing the virtual shopping cart to be updated based on the updated information.

[0008] Further, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: The smart glasses obtain the first quantity information selected by the user for the first product, so that the virtual shopping cart is updated based on the first quantity information.

[0009] Further, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: The smart glasses receive a deletion command from the user for the first product, causing the virtual shopping cart to be updated based on the deletion command.

[0010] Furthermore, the method also includes: The display screen of the smart glasses presents product information of a second product that meets a preset similarity condition to the first product, wherein the second product is located in the same store as the first product, and the price of the second product is lower than or equal to the price of the first product.

[0011] Furthermore, the method also includes: The smart glasses receive the user's "add to cart" instruction for the second product. The second item is added to the virtual shopping cart based on the "Add to Cart" instruction.

[0012] Furthermore, the method also includes: The checkout instruction corresponding to the virtual shopping cart is obtained through the smart glasses; In response to the checkout instruction, a payment operation for the virtual shopping cart is completed based on the user's linked payment account.

[0013] Furthermore, obtaining the checkout instruction corresponding to the virtual shopping cart through the smart glasses includes: In response to the smart glasses leaving the specific location area corresponding to the virtual shopping cart, a checkout instruction corresponding to the virtual shopping cart is obtained.

[0014] Furthermore, the method also includes: In response to a successful payment to the virtual shopping cart, the user is provided with a payment success notification via the smart glasses.

[0015] Furthermore, the method also includes: The smart glasses display shows navigation information from the user's current location to the pickup location corresponding to the virtual shopping cart.

[0016] Furthermore, the stay information includes the stay duration, and the first preset condition includes a stay duration greater than or equal to a preset duration threshold.

[0017] Furthermore, the dwell information includes the number of dwell times, and the first preset condition includes the number of dwell times being greater than or equal to a preset threshold number of dwell times.

[0018] Further, if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, the identification of the graphic code in the video stream includes: If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the user is identified from the video stream as performing a preset operation on the target product, the graphic code in the video stream is identified.

[0019] Further, if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, the identification of the graphic code in the video stream includes: If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the target product is determined to match the user's purchase intention based on the user's historical purchase behavior, the graphic code in the video stream is identified.

[0020] This specification also provides an embodiment of a smart glasses device for shopping, comprising: An eye-tracking module is used to capture video streams in the user's field of vision through the camera of smart glasses, and to obtain the user's current gaze point by performing eye tracking on the video stream; The graphic code recognition module is used to recognize the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, thereby obtaining the graphic code information corresponding to the graphic code, and adding the product information corresponding to the graphic code information to the user's virtual shopping cart.

[0021] This specification also provides a storage medium storing a computer program adapted to be loaded by a processor and to execute the steps of the method described above.

[0022] This specification also provides an electronic device, including a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to execute the steps of the method described above.

[0023] This specification also provides a computer program product that stores at least one instruction, characterized in that the at least one instruction, when executed by a processor, implements the steps of the above-described method.

[0024] According to the embodiments of this specification, by utilizing the AI ​​visual recognition and eye-tracking capabilities of smart glasses, a new automatic product recognition and inventory management mode that replaces manual operation with the use of eyes is created. Users do not need to perform any manual operation, which can save users from queuing to use self-checkout equipment and manually scanning each product one by one. This can significantly improve the efficiency and smoothness of the shopping process, eliminate the pain points of queuing and manually scanning products, significantly improve the user experience, and greatly reduce the investment in self-checkout equipment. It can transform the asset-heavy, high-cost checkout infrastructure (e.g., self-checkout equipment) into asset-light, low-cost personal devices (smart glasses), and provide a more universal and replicable solution for the retail industry. Attached Figure Description

[0025] Figure 1 A flowchart illustrating a shopping method provided in an embodiment of this specification; Figure 2 A flowchart illustrating a shopping method provided in an embodiment of this specification; Figure 3 A flowchart illustrating a shopping method provided in an embodiment of this specification; Figure 4 A schematic diagram of the structure of a smart glasses device for shopping provided in the embodiments of this specification; Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of this specification clearer, the technical solutions of this specification will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this specification, and not all of them. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this specification.

[0027] Please see Figure 1 This is a flowchart illustrating a shopping method provided in an embodiment of this specification. In this embodiment, the shopping method is applied to smart glasses (hereinafter referred to as "shopping smart glasses") described in this embodiment. The following will focus on... Figure 1 The process shown will be explained in detail. The method for shopping may specifically include the following steps: S102, the user's current gaze point is obtained by capturing the video stream in the user's field of vision through the camera of the smart glasses and performing eye tracking on the video stream.

[0028] In some embodiments, smart glasses refer to wearable glasses that integrate a camera, an eye-tracking module, an AR (Augmented Reality) display, and a computing unit. In some embodiments, eye tracking is a technology that determines a user's gaze focus by capturing and analyzing the trajectory of human eye movements. In some embodiments, the eye-tracking module is a core component for human-computer interaction using eye-tracking technology, typically composed of hardware sensors, algorithms, and software, capable of real-time monitoring of data such as the user's gaze direction, gaze point, and pupil changes. In some embodiments, the AR display is one of the core components of smart glasses; it is responsible for overlaying and blending virtual information with the real world and presenting it clearly to the user.

[0029] In some embodiments, a user (i.e. a consumer) enters a store wearing smart glasses. The camera of the smart glasses continuously captures a real-time video stream in the user's current field of vision. The eye-tracking module of the smart glasses tracks the real-time video stream to obtain the user's current gaze point. The current gaze point refers to the position in the real world where the user's eyes are pointing and focused at the same moment. In other words, the current gaze point is used to characterize where the user is currently looking.

[0030] S104, if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, the graphic code in the video stream is identified to obtain the graphic code information corresponding to the graphic code, so that the product information corresponding to the graphic code information is added to the user's virtual shopping cart.

[0031] In some embodiments, the graphic code of the target product includes, but is not limited to, barcodes, QR codes, etc., and this example embodiment does not impose any special limitations on this. In some embodiments, if the user's current gaze point lingers on the graphic code of the target product and meets a first preset condition, the AI ​​visual recognition module in the smart glasses is triggered. The lingering information includes, but is not limited to, lingering duration and lingering frequency. This example embodiment does not impose any special limitations on this. The first preset condition includes a lingering duration greater than or equal to a preset duration threshold, or a lingering frequency greater than or equal to a preset frequency threshold, or a lingering duration greater than or equal to a preset duration threshold and / or a lingering frequency greater than or equal to a preset frequency threshold. In some embodiments, the AI ​​visual recognition module in the smart glasses performs AI visual recognition on the graphic code of the target product in the video stream to obtain the graphic code information corresponding to the graphic code (e.g., a string or a piece of text information). AI visual recognition refers to the technology of automatically recognizing and understanding objects, barcodes, QR codes, etc., using AI (Artificial Intelligence) algorithms through image or video data.

[0032] In some embodiments, the smart glasses send the identified graphic code information to the corresponding cloud service platform located in the backend. The cloud service platform searches the product database based on the graphic code information to obtain the product information corresponding to the graphic code information (i.e., the product information of the target product). Then, the product information is automatically added to the user's virtual shopping cart. The virtual shopping cart is a digital tool used to temporarily store and manage the products that the user intends to purchase. The product information includes, but is not limited to, product price, product name, product style, and product description. This example embodiment does not impose any special limitations on this.

[0033] According to the embodiments of this specification, by utilizing the AI ​​visual recognition and eye-tracking capabilities of smart glasses, a new automatic product recognition and inventory management mode that replaces manual operation with the use of eyes is created. Users do not need to perform any manual operation, which can save users from queuing to use self-checkout equipment and manually scanning each product one by one. This can significantly improve the efficiency and smoothness of the shopping process, eliminate the pain points of queuing and manually scanning products, significantly improve the user experience, and greatly reduce the investment in self-checkout equipment. It can transform the asset-heavy, high-cost checkout infrastructure (e.g., self-checkout equipment) into asset-light, low-cost personal devices (smart glasses), and provide a more universal and replicable solution for the retail industry.

[0034] In some embodiments, the method further includes: displaying product information of at least one item in the virtual shopping cart on the display screen of the smart glasses. In some embodiments, during the user's shopping process, the AR display screen of the smart glasses will display product information of at least one item in the virtual shopping cart in real time, that is, the product information of at least one item will be overlaid on the user's real field of vision through the AR display screen, providing the user with immediate shopping information feedback, for example, in the form of a product list, or for example, the total price corresponding to the at least one item will also be displayed.

[0035] In some embodiments, the method further includes: determining the currently selected first item in the virtual shopping cart via the smart glasses; obtaining the user's updated information regarding the first item via the smart glasses, causing the virtual shopping cart to be updated based on the updated information. In some embodiments, the smart glasses may obtain the user's voice information via a microphone module, then perform semantic recognition on the voice information to obtain corresponding user instructions, and then determine the currently selected first item from at least one item in the virtual shopping cart based on the user instructions; alternatively, the smart glasses may also recognize user gestures in a real-time video stream, and then determine the currently selected first item from at least one item in the virtual shopping cart based on the user gestures. In some embodiments, if the first item is the item most recently added to the virtual shopping cart among the at least one items, the first item is selected by default. In some embodiments, user voice information is obtained through a microphone module, and then semantic recognition is performed on the voice information to obtain corresponding user commands. Based on these user commands, updated information regarding the first product is obtained. Alternatively, user gestures in a real-time video stream are recognized, and updated information regarding the first product is obtained based on these gestures. The updated information includes, but is not limited to, the first quantity information selected by the user for the first product, or a deletion command initiated by the user for the first product. This example embodiment does not impose any specific limitations on these aspects. In some embodiments, the smart glasses send the updated information of the first product to a corresponding cloud service platform located in the backend. The cloud service platform updates the virtual shopping cart based on this updated information and then displays the updated product information in the virtual shopping cart on the smart glasses' display screen.

[0036] In some embodiments, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: obtaining first quantity information selected by the user for the first product through the smart glasses, and updating the virtual shopping cart based on the first quantity information. In some embodiments, user voice information is obtained through a microphone module, and then semantic recognition is performed on the voice information to obtain corresponding user instructions. Then, the first quantity information selected by the user for the first product (i.e., the purchase quantity of the first product) is obtained based on the user instructions. Alternatively, user gestures in a real-time video stream are recognized, and then, based on a preset mapping relationship between user gestures and quantities, the quantity mapped by the user gestures is taken as the first quantity selected by the user for the first product.

[0037] In some embodiments, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: obtaining a deletion instruction initiated by the user for the first product through the smart glasses, and updating the virtual shopping cart based on the deletion instruction. In some embodiments, user voice information is obtained through a microphone module, and then semantic recognition is performed on the voice information to obtain the corresponding user instruction. Then, a deletion instruction initiated by the user for the first product (i.e., deleting the first product from the virtual shopping cart) is obtained based on the user instruction. Alternatively, user gestures in a real-time video stream are recognized, and if the similarity between the user gesture and a preset deletion gesture is less than or equal to a preset threshold, a deletion instruction initiated by the user for the first product is obtained.

[0038] In some embodiments, the method further includes: displaying product information of a second product that meets a preset similarity condition to the first product on the display screen of the smart glasses, wherein the second product is located in the same store as the first product, and the price of the second product is lower than or equal to the price of the first product. In some embodiments, if the first product is deleted from the virtual shopping cart based on a user's deletion instruction, the cloud service platform obtains product information of a second product that meets a preset similarity condition to the first product (e.g., the similarity between the first product and the second product is less than or equal to a preset threshold) from the product database, wherein the price of the second product is lower than or equal to the price of the first product, and then displays the product information of the second product on the display screen of the smart glasses. In some embodiments, navigation information from the user's current location to the placement location of the second product in the store (e.g., a directional arrow, or, for example, first displaying a store map and then overlaying the corresponding walking route on the map) is also displayed on the display screen of the smart glasses, so that the user can walk to the placement location of the second product based on the navigation information.

[0039] In some embodiments, the method further includes: obtaining a user's "add to cart" instruction for the second product through the smart glasses; and adding the second product to the virtual shopping cart based on the "add to cart" instruction. In some embodiments, user voice information is obtained through a microphone module, and then semantic recognition is performed on the voice information to obtain a corresponding user instruction. Based on this user instruction, a "add to cart" instruction for the second product (i.e., adding the second product to the virtual shopping cart) is obtained. Alternatively, user gestures in a real-time video stream are recognized, and if the similarity between the user gesture and a preset "add to cart" gesture is less than or equal to a preset threshold, a "add to cart" instruction for the second product is obtained. In some embodiments, the smart glasses send the "add to cart" instruction to a corresponding cloud service platform located in the backend. The cloud service platform updates the virtual shopping cart based on the "add to cart" instruction, i.e., adding the second product to the virtual shopping cart, and then displays the updated product information in the virtual shopping cart on the smart glasses' display screen.

[0040] In some embodiments, the method further includes: obtaining a checkout instruction corresponding to the virtual shopping cart through the smart glasses; and, in response to the checkout instruction, completing a payment operation for the virtual shopping cart based on the user's linked payment account. In some embodiments, user voice information is obtained through a microphone module, and then semantic recognition is performed on the voice information to obtain a corresponding user instruction. Then, a user checkout instruction for the virtual shopping cart is obtained based on the user instruction. Alternatively, user gestures in a real-time video stream are recognized, and if the similarity between the user gesture and a preset checkout instruction is less than or equal to a preset threshold, the user checkout instruction for the virtual shopping cart is obtained. In some embodiments, in response to the checkout instruction, the smart glasses complete a payment operation for the virtual shopping cart through the user's pre-linked payment account.

[0041] In some embodiments, obtaining the checkout instruction corresponding to the virtual shopping cart through the smart glasses includes: obtaining the checkout instruction corresponding to the virtual shopping cart in response to the smart glasses leaving the specific location area corresponding to the virtual shopping cart. In some embodiments, the smart glasses can determine whether they have left the specific location area corresponding to the virtual shopping cart (i.e., the specific location area of ​​the store) based on their current real-time location. If so, in response to the smart glasses leaving the specific location area, the user's checkout instruction for the virtual shopping cart is obtained, and the corresponding payment process is automatically triggered to achieve seamless payment. That is, the user (consumer) does not need to perform any active scanning or payment operations during the shopping process, creating a new automated checkout mode that does not require cashiers or counters. This can significantly improve the user's shopping efficiency, greatly reduce the investment in cashiers and checkout equipment, and lower operating costs. The solutions in the embodiments of this specification construct a complete end-to-end seamless checkout system, covering the entire process from product recognition, virtual shopping cart management, AR information feedback to seamless payment, providing users with an unprecedentedly smooth and seamless shopping experience.

[0042] In some embodiments, the method further includes: in response to successful payment for the virtual shopping cart, providing the user with a payment success notification message corresponding to the virtual shopping cart via the smart glasses. In some embodiments, in response to successful payment for the virtual shopping cart, the user is provided with a corresponding payment success notification message via the smart glasses; for example, the smart glasses announce the payment success notification message via voice, or display the payment success notification message on the smart glasses' screen. In some embodiments, the cloud service platform also sends a detailed electronic bill to the user's pre-bound mobile phone or email address.

[0043] In some embodiments, the method further includes: displaying navigation information on the smart glasses' display screen from the user's current location to the pickup location corresponding to the virtual shopping cart. In some embodiments, in response to successful payment for the virtual shopping cart, a store employee or robot packages at least one item from the virtual shopping cart and delivers it to the specific pickup location. Additionally, navigation information (e.g., a directional arrow, or, for example, displaying a store map with corresponding walking routes overlaid on it) is displayed on the smart glasses' display screen, allowing the user to navigate to the pickup location based on the navigation information to retrieve the at least one item from the virtual shopping cart.

[0044] In some embodiments, the dwell information includes dwell duration, and the first preset condition includes a dwell duration greater than or equal to a preset duration threshold. In some embodiments, the first preset condition may include a dwell duration on the graphic code of the target product that is greater than or equal to the preset duration threshold.

[0045] In some embodiments, the dwell information includes the number of dwell times, and the first preset condition includes the number of dwell times being greater than or equal to a preset number of dwell times threshold. In some embodiments, the first preset condition may include the number of times the user's current gaze point dwells on the graphic code of the target product being greater than or equal to a preset number of dwell times threshold. In some embodiments, the first preset condition may also simultaneously include the user's current gaze point dwelling time on the graphic code of the target product being greater than or equal to a preset duration threshold and the dwell time being greater than or equal to a preset duration threshold.

[0046] In some embodiments, identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition includes: identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition and the user is identified from the video stream as performing a preset operation on the target product. In some embodiments, the identification of the graphic code of the target product in the real-time video stream is triggered only if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition and the user is identified from the real-time video stream as performing a preset operation on the target product (e.g., picking up the product). For example, by identifying user actions in the real-time video stream, if the similarity between the user action and the preset operation is less than or equal to a preset threshold, it is determined that the user has performed a preset operation on the target product. Another example is by inputting the real-time video stream into a trained model to obtain the model's output indication result information indicating whether the user has performed a preset operation on the target product.

[0047] In some embodiments, identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition includes: identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the target product is determined to match the user's purchase intention based on the user's historical purchase behavior. In some embodiments, the identification of the graphic code of the target product in the real-time video stream is triggered only if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the target product is determined to match the user's purchase intention based on the user's historical purchase behavior. For example, a tag representing the user's shopping preferences or habits can be added to the user based on their historical purchase behavior. Based on the tag and the product information of the target product, it can be determined whether the target product matches the user's purchase intention. For example, the matching degree between the product information of the target product and the tag information can be obtained first, and then the matching degree can be used to determine whether the target product matches the user's purchase intention. If the matching degree is greater than or equal to a preset threshold, the target product is determined to match the user's purchase intention; otherwise, if the matching degree is less than the preset threshold, the target product is determined not to match the user's purchase intention.

[0048] Figure 2 This is a flowchart illustrating a shopping method provided in an embodiment of this specification.

[0049] like Figure 2 As shown, the user wears AI glasses (smart glasses), which capture a real-time video stream in the user's field of vision through the glasses' camera. The eye-tracking module in the glasses tracks the real-time video stream to obtain the user's gaze data. The AI ​​processing unit in the glasses identifies the barcode / QR code on the product the user is looking at and matches it with the product database. The matched product information is added to a virtual shopping cart, and the AR information corresponding to the virtual shopping cart is rendered on the AR display screen of the glasses. The glasses respond to the user's payment request for the virtual shopping cart, make the payment through the payment platform, and update the virtual shopping cart based on the payment success feedback.

[0050] Figure 3 This is a flowchart illustrating a shopping method provided in an embodiment of this specification.

[0051] like Figure 3As shown, when a user enters a store and puts on AI glasses (smart glasses), the glasses' camera works continuously. The glasses' eye-tracking module locks onto the user's gaze point, and the glasses' AI recognition module processes the user's gaze area. If the barcode / QR code of the product the user is looking at is detected, the corresponding barcode / QR code information is sent to the corresponding backend system for retrieval to obtain the corresponding product information. The backend system adds the product information to the user's virtual shopping cart, and the glasses' AR display screen updates the shopping cart content in real time. In response to the user selecting products and leaving the store, the system triggers an automatic payment process and notifies the user after successful payment. The glasses' AR display screen displays the corresponding payment completion information.

[0052] Figure 4 This is a schematic diagram of a smart glasses device for shopping provided in an embodiment of this specification. The smart glasses device for shopping (hereinafter referred to as "shopping smart glasses 1") can be implemented as all or part of an electronic device through software, hardware, or a combination of both. According to some embodiments, the shopping smart glasses 1 includes an eye-tracking module 11 and a graphic code recognition module 12.

[0053] The eye-tracking module 11 is used to capture the video stream in the user's field of vision through the camera of the smart glasses, and to obtain the user's current gaze point by performing eye tracking on the video stream; The graphic code recognition module 12 is used to recognize the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, thereby obtaining the graphic code information corresponding to the graphic code, and adding the product information corresponding to the graphic code information to the user's virtual shopping cart.

[0054] In some embodiments, the smart shopping glasses 1 are further configured to: display product information of at least one item in the virtual shopping cart on the display screen of the smart glasses.

[0055] In some embodiments, the smart shopping glasses 1 are further configured to determine the first selected item in the virtual shopping cart via the smart glasses; obtain the user's updated information regarding the first item via the smart glasses, and update the virtual shopping cart based on the updated information.

[0056] In some embodiments, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: obtaining first quantity information selected by the user for the first product through the smart glasses, and updating the virtual shopping cart based on the first quantity information.

[0057] In some embodiments, obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: obtaining a deletion instruction initiated by the user for the first product through the smart glasses, and updating the virtual shopping cart based on the deletion instruction.

[0058] In some embodiments, the smart shopping glasses 1 are further configured to: present product information of a second product that meets a preset similarity condition to the first product on the display screen of the smart glasses, wherein the second product is located in the same store as the first product, and the price of the second product is lower than or equal to the price of the first product.

[0059] In some embodiments, the smart glasses 1 are further configured to: obtain an add-to-cart instruction initiated by the user for the second product through the smart glasses; and add the second product to the virtual shopping cart based on the add-to-cart instruction.

[0060] In some embodiments, the smart glasses 1 are further configured to: obtain a checkout instruction corresponding to the virtual shopping cart through the smart glasses; and, in response to the checkout instruction, complete a payment operation for the virtual shopping cart based on the user's linked payment account.

[0061] In some embodiments, obtaining the checkout instruction corresponding to the virtual shopping cart through the smart glasses includes: obtaining the checkout instruction corresponding to the virtual shopping cart in response to the smart glasses leaving a specific location area corresponding to the virtual shopping cart.

[0062] In some embodiments, the smart shopping glasses 1 are further configured to: in response to successful payment for the virtual shopping cart, provide the user with a payment success notification message corresponding to the virtual shopping cart through the smart glasses.

[0063] In some embodiments, the smart shopping glasses 1 are further configured to: display navigation information on the display screen of the smart glasses from the user's current location to the pickup location corresponding to the virtual shopping cart.

[0064] In some embodiments, the stay information includes stay duration, and the first preset condition includes a stay duration greater than or equal to a preset duration threshold.

[0065] In some embodiments, the dwell information includes the number of dwell times, and the first preset condition includes the number of dwell times being greater than or equal to a preset number threshold.

[0066] In some embodiments, the step of identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition includes: if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the user is identified from the video stream as performing a preset operation on the target product, the graphic code in the video stream is identified.

[0067] In some embodiments, the step of identifying the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition includes: if the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the target product is determined to match the user's purchase intention based on the user's historical purchase behavior, then the graphic code in the video stream is identified.

[0068] The above-described apparatus embodiments correspond to the aforementioned method embodiments. For detailed descriptions, please refer to the description in the method embodiments section; further details will not be repeated here. The apparatus embodiments are derived from the corresponding method embodiments and have the same technical effects. For detailed descriptions, please refer to the corresponding method embodiments.

[0069] This specification also provides a computer storage medium storing a computer program thereon, which, when executed by a processor, implements the method described in this specification.

[0070] This specification also provides a computer program product that stores at least one instruction, which is loaded by the processor and executes the method described in this specification embodiment.

[0071] This specification also provides an electronic device, including a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and execute the method described in the embodiments of this specification.

[0072] The embodiments in this specification also provide Figure 5 The diagram shows the structure of the electronic device. Figure 5 At the hardware level, the electronic device includes a processor, internal bus, network interface, memory, and non-volatile memory, and may also include other hardware required for business operations. The processor reads the corresponding computer program from the non-volatile memory into memory and then runs it to implement the above method.

[0073] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0074] Those skilled in the art will understand that embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this specification may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0075] This specification is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0076] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0077] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0078] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0079] This specification can be described in the general context of computer-executable instructions that are executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This specification can also be practiced in distributed computing environments, where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0080] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0081] The above description is merely an embodiment of this specification and is not intended to limit this specification. Various modifications and variations can be made to this specification by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this specification should be included within the scope of the claims of this specification.

Claims

1. A method for shopping, characterized in that, include: The smart glasses capture a video stream in the user's field of vision using their camera, and obtain the user's current gaze point by performing eye tracking on the video stream. If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, the graphic code in the video stream is identified to obtain the graphic code information corresponding to the graphic code, so that the product information corresponding to the graphic code information is added to the user's virtual shopping cart.

2. The method according to claim 1, characterized in that, Also includes: Product information for at least one item in the virtual shopping cart is displayed on the screen of the smart glasses.

3. The method according to claim 2, characterized in that, Also includes: The smart glasses are used to determine the first selected item in the virtual shopping cart. The user's updated information regarding the first product is obtained through the smart glasses, causing the virtual shopping cart to be updated based on the updated information.

4. The method according to claim 3, characterized in that, The step of obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: The smart glasses obtain the first quantity information selected by the user for the first product, so that the virtual shopping cart is updated based on the first quantity information.

5. The method according to claim 3, characterized in that, The step of obtaining updated information corresponding to the first product through the smart glasses, and updating the virtual shopping cart based on the updated information, includes: The smart glasses receive a deletion command from the user for the first product, causing the virtual shopping cart to be updated based on the deletion command.

6. The method according to claim 5, characterized in that, Also includes: The display screen of the smart glasses presents product information of a second product that meets a preset similarity condition to the first product, wherein the second product is located in the same store as the first product, and the price of the second product is lower than or equal to the price of the first product.

7. The method according to claim 6, characterized in that, Also includes: The smart glasses receive the user's "add to cart" instruction for the second product. The second item is added to the virtual shopping cart based on the "Add to Cart" instruction.

8. The method according to claim 1 or 2, characterized in that, Also includes: The checkout instruction corresponding to the virtual shopping cart is obtained through the smart glasses; In response to the checkout instruction, a payment operation for the virtual shopping cart is completed based on the user's linked payment account.

9. The method according to claim 8, characterized in that, The step of obtaining the checkout instruction corresponding to the virtual shopping cart through the smart glasses includes: In response to the smart glasses leaving the specific location area corresponding to the virtual shopping cart, a checkout instruction corresponding to the virtual shopping cart is obtained.

10. The method according to claim 8, characterized in that, Also includes: In response to a successful payment to the virtual shopping cart, the user is provided with a payment success notification via the smart glasses.

11. The method according to claim 10, characterized in that, Also includes: The smart glasses display shows navigation information from the user's current location to the pickup location corresponding to the virtual shopping cart.

12. The method according to claim 1, characterized in that, The stay information includes the stay duration, and the first preset condition includes a stay duration greater than or equal to a preset duration threshold.

13. The method according to claim 1, characterized in that, The dwell information includes the number of dwell times, and the first preset condition includes the number of dwell times being greater than or equal to a preset threshold number of dwell times.

14. The method according to claim 1, characterized in that, If the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, the graphic code in the video stream is identified, including: If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the user is identified from the video stream to perform a preset operation on the target product, the graphic code in the video stream is identified.

15. The method according to claim 1, characterized in that, If the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, the graphic code in the video stream is identified, including: If the current gaze point's dwell information on the graphic code of the target product meets the first preset condition, and the target product is determined to match the user's purchase intention based on the user's historical purchase behavior, the graphic code in the video stream is identified.

16. A smart glasses device for shopping, characterized in that, include: An eye-tracking module is used to capture video streams in the user's field of vision through the camera of smart glasses, and to obtain the user's current gaze point by performing eye tracking on the video stream; The graphic code recognition module is used to recognize the graphic code in the video stream if the current gaze point's dwell information on the graphic code of the target product meets a first preset condition, thereby obtaining the graphic code information corresponding to the graphic code, and adding the product information corresponding to the graphic code information to the user's virtual shopping cart.

17. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 15.

18. An electronic device, characterized in that, include: A processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to execute the steps of the method as claimed in any one of claims 1 to 15.

19. A computer program product having at least one instruction stored thereon, characterized in that, When the at least one instruction is executed by the processor, it implements the steps of the method according to any one of claims 1 to 15.

Images