Commodity shopping guide method, device and equipment and readable storage medium

Abstract

The invention is applicable to the technical field of computers, and provides a commodity shopping guide method, device and equipment and a readable storage medium, the method is applied to wearable equipment, and the method comprises the following steps: acquiring a user identifier of a first user; in response to the first operation, displaying first commodity information according to a historical shopping condition and / or a historical search condition of the first user; wherein the first operation comprises a voice input operation of recommending a first commodity type by the first user, the historical shopping condition comprises a shopping record of the first user corresponding to the user identifier in the current shopping place before the current moment, and the historical search condition comprises the content of searching by the first user in the wearable device before the current moment; the first commodity information comprises commodity information corresponding to commodities related to historical shopping conditions and / or historical search conditions in the first commodity type. Therefore, the user can be helped to more efficiently find the commodity according to the intention of the user as much as possible.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and in particular relates to a product shopping guide method, device, equipment and a readable storage medium. Background Art

[0002] With the improvement of living standards and the enhancement of consumption concepts, the consumption needs of various types of users are constantly increasing, and the types of consumption are also increasing.

[0003] Currently, if users want to shop, they need to go to supermarkets or shopping malls. During the shopping process, users need to ask shopping guides or look for items themselves. However, the above traditional shopping methods may face the problem that shopping guides find it difficult to accurately determine users' shopping needs and accurately recommend the products users want to find, resulting in low shopping efficiency for users. Summary of the Invention

[0004] The embodiments of the present application provide a product shopping guide method, apparatus, device, and readable storage medium, which can help users find products more efficiently according to the user's intention as much as possible.

[0005] In a first aspect, an embodiment of the present application provides a product shopping guide method, which is applied to a wearable device, and the method includes:

[0006] Obtain a user identifier of a first user; in response to a first operation, display first product information based on the first user's historical shopping history and / or historical search history; wherein the first operation is a voice operation in which the first user requests a recommendation for a product of the first product type, the historical shopping history includes the shopping records of the first user corresponding to the user identifier at the current shopping place before the current moment, the historical search history includes the content searched for by the first user in the wearable device before the current moment, and the first product information includes product information corresponding to products of the first product type that are related to the historical shopping history and / or historical search history.

[0007] In a second aspect, an embodiment of the present application provides a product shopping guide device, comprising:

[0008] An acquisition module, configured to acquire a user identifier of a first user;

[0009] A processing module is used to display first product information in response to a first operation based on the first user's historical shopping situation; wherein the first operation is a voice operation in which the first user requests a recommendation of a product of the first product type, the historical shopping situation includes the shopping records of the first user corresponding to the user identifier at the current shopping place before the current moment, the historical search situation includes the content searched by the first user in the wearable device before the current moment, and the first product information includes product information corresponding to products in the first product type that are related to the historical shopping situation and / or historical search situation.

[0010] In a third aspect, an embodiment of the present application provides a wearable device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the product shopping guide method described in any one of the first aspects above when executing the computer program.

[0011] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and is characterized in that when the computer program is executed by a processor, it implements the product shopping guide method described in any one of the first aspects above.

[0012] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the product shopping guide method described in any one of the above-mentioned first aspects.

[0013] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0014] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0015] Before recommending products through the wearable device, the wearable device can obtain the user identification of the first user. When receiving a recommendation instruction about products of the first product type, it can display product information corresponding to products in the first product type that are related to the user's historical shopping history and / or historical search history. In this way, it can achieve more accurate and rapid recommendation of products to the user according to the user's intention, thereby improving the user's shopping efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0017] Figure 1 This is a schematic diagram of a product shopping guide scenario provided by an embodiment of the present application;

[0018] Figure 2 is a schematic structural diagram of a wearable device provided in one embodiment of the present application;

[0019] Figure 3 This is a flowchart of a product shopping guide method provided by an embodiment of the present application;

[0020] Figure 4 This is a flowchart of a product shopping guide method provided by another embodiment of the present application;

[0021] Figure 5 It is a structural diagram of the product shopping guide device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0023] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0024] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0025] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0026] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0027] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0028] The present application proposes a product shopping guide method, apparatus, wearable device and computer-readable storage medium. In this method, the product information of the user's purchased products can be recorded each time the user shops. Before recommending products through the wearable device, the user identification can be obtained. When the user's recommendation instruction for a certain type of product is received, the product information corresponding to the products of the type that are related to the user's historical shopping situation and / or historical search situation can be displayed based on the user's historical shopping situation and / or historical search situation. In this way, it is possible to recommend products to the user more accurately and quickly according to the user's intention, thereby improving the user's shopping efficiency.

[0029] like Figure 1 As shown, the product shopping guide method provided in the embodiment of the present application can be applied to wearable devices. For details, please refer to the description of the operations performed by the wearable device below. The product shopping guide method provided in the embodiment of the present application can be implemented by the artificial intelligence (AI) shopping guide system of the wearable device (the AI ​​shopping guide system can also be called an AI shopping guide system based on a multimodal visual large model), and is applied to smart shopping guide scenarios such as supermarkets and shopping malls. Specifically, both shopping users and management users can interact with the wearable device, and the wearable device performs related operations such as search and analysis with the help of the AI ​​shopping guide system, so that the wearable device can respond to the user's needs through direct display or voice notification.

[0030] In addition, if Figure 1 As shown, the product shopping guide method provided in the embodiment of the present application can also be applied to the display device of the shopping cart. For details, please refer to the description of the operations performed by the display device below.

[0031] As an example and not a limitation, the wearable device can also be a general term for the intelligent design and development of wearable devices for daily wear using wearable technology, such as glasses, gloves, watches, clothing and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. In a broad sense, wearable smart devices include those that are full-featured, large in size, and can achieve full or partial functions without relying on smartphones, such as smart watches or smart glasses, as well as those that only focus on a certain type of application function.

[0032] Take wearable devices such as smart glasses as an example. Figure 2 FIG2 is a block diagram showing a partial structure of the smart glasses provided by an embodiment of the present application. Figure 2 , smart glasses include: microphone, air conduction open sound field, camera and other devices. Those skilled in the art will understand that, Figure 2 The structure of the smart glasses shown in the figure does not constitute a limitation to the smart glasses. The smart glasses may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0033] In addition, the wearable device can also be connected to a terminal device for communication, and the terminal device can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The embodiments of the present application do not impose any restrictions on the specific type of the terminal device.

[0034] In addition, the wearable device can also be communicatively connected to a display device of the shopping cart, and the wearable device can also be communicatively connected to another wearable device, which can be a headset.

[0035] Figure 3 A schematic flowchart of the product shopping guide method provided in this application is shown. As an example but not a limitation, the method can be applied to the above-mentioned smart glasses.

[0036] In some embodiments, the wearable device is smart glasses. The following embodiments will take the wearable device as smart glasses as an example to illustrate the product shopping guide method provided in the embodiments of the present application.

[0037] like Figure 3 As shown, the product shopping guide method provided by this application may include:

[0038] S101: Obtain a user ID of a first user.

[0039] The user identifier is used to uniquely identify the first user. The user identifier may include but is not limited to at least one parameter such as a mobile phone number, a user identity number (ID), an account name, and an email address.

[0040] The user ID may include but is not limited to an ID number. The account name may include but is not limited to a user name, for example, a user name may include characters, letters, binary numbers, etc.

[0041] In some embodiments, obtaining the user identification of the first user includes: receiving the user identification of the first user from an access device, where the user identification is sent by the access device to the wearable device when the first user takes the wearable device from the access device.

[0042] The access device is a device for storing wearable devices.

[0043] In one possible implementation, the access device may include a storage area, an identity authentication module, and a door control module. The storage area is used to store wearable devices, the identity authentication module is used to trigger the identification of user identity and perform permission verification, and the door control module is used to open the door of the storage area when the verification is passed.

[0044] In some embodiments, the identity authentication module is a near field communication (NFC) or radio frequency identification (RFID) sensing area, which supports a touch function. When the sensing area receives a signal from the terminal device of the first user, the sensing area can send a verification request to the terminal device. When the terminal device receives the verification request, it can display a verification interface. The verification interface includes reminder content and a confirmation control. The reminder content is used to remind the user whether to take the wearable device. The confirmation control is used to confirm the taking of the wearable device. When the operation of the confirmation control is received, the door control module opens the door of the storage area, and the first user can take away the wearable device. In addition, when the operation of the confirmation control is received, the access device can send the user identification of the first user to the wearable device.

[0045] In other embodiments, the identity authentication module is a QR code module of the access device. When the terminal device of the first user scans the QR code generated by the QR code module, a verification interface is displayed. The verification interface includes reminder content and a confirmation control. The reminder content is used to remind the user whether to take the wearable device. The confirmation control is used to confirm the taking of the wearable device. When the operation of the confirmation control is received, the door control module opens the door of the storage area, and the user can take away the wearable device. In addition, when the operation of the confirmation control is received, the access device can send the user identification of the first user to the wearable device.

[0046] It should be understood that the above-mentioned identity authentication module is exemplified by NFC, RFID, and QR code modules; the identity authentication module can also be in other forms, and this application does not impose any limitation on the specific implementation method of the identity authentication module.

[0047] In another possible implementation, the access device may include a storage area, a display module, and a door control module. The storage area is used to store the wearable device, the display module is used to receive the user identification of the first user, and the door control module is used to open the door of the storage area when the verification is passed.

[0048] In some embodiments, the display module can display an identification input interface, and the first user can enter a user identification in the identification input interface. When the user identification is received, the door control module opens the door of the storage area, and the user can take away the wearable device. In addition, when the user identification is received, the access device can send the user identification of the first user to the wearable device.

[0049] It should be understood that the above examples are exemplified by the access device including a storage area, an identity authentication module and a door control module, or the access device including a storage area, a display module and a door control module; the access device can also be in other forms, and this application does not impose any limitation on the specific implementation method of the access device, and this application does not impose any limitation on the specific implementation method of taking the wearable device through the access device.

[0050] S102: In response to the first operation, display first product information based on the first user's historical shopping and / or historical search history.

[0051] The first operation is a voice operation in which the first user requests a recommendation for a product of the first product type.

[0052] For example, the first product type is weight loss type, and the first operation is the first user's voice input "I want to make some weight loss meals, do you have any recommendations?"

[0053] For another example, the first product type is Mapo Tofu, and the first operation is the first user's voice input of "I want to make some Mapo Tofu, what ingredients do I need to buy?"

[0054] It should be understood that the above description uses the first product type as a weight loss type or a mapo tofu type as an example, and this application does not specifically limit the first product type. Furthermore, this application does not limit the specific content of the first operation.

[0055] In some embodiments, the wearable device includes a microphone, and the first user can perform the first operation through the microphone.

[0056] In other embodiments, the wearable device is communicatively connected to the earphones belonging to the first user, and the first user can perform the first operation through the earphones.

[0057] This application does not specifically limit the manner in which the first user performs the first operation.

[0058] The historical shopping history includes the shopping records of the first user corresponding to the user ID at the current shopping location before the current moment. The historical shopping history is obtained by the AI ​​shopping guide system in the wearable device through user behavior analysis of the historical shopping records.

[0059] For example, if the user's shopping history includes buying eggs 10 times, blueberries 8 times, oats 8 times, watermelons 10 times, lychees 8 times, and spinach 5 times, the wearable device can determine that the user prefers eggs, blueberries, and oats.

[0060] The historical search results include the content that the first user searched for on the wearable device before the current moment. The historical search results are obtained by the AI ​​shopping guide system in the wearable device through user behavior analysis of the historical search content.

[0061] For example, historical search scenarios include a user inputting into a wearable device voice: "I am 165cm tall and weigh 120kg. If I want to make three diet meals, what should I buy and how much should I buy?" The wearable device can determine the user's height, weight, and possible preference (weight loss).

[0062] For example, historical search scenarios include users inputting into a wearable device voice input such as "What medicine do I need to buy for chronic gastritis?" The wearable device can determine the user's physical condition and avoid recommending products that are not suitable for the user based on the user's physical condition.

[0063] Among them, the first product information includes product information corresponding to the product related to the historical shopping situation and / or historical search situation in the first product type. In some embodiments, the AI ​​shopping guide system in the wearable device can call the model context protocol (MCP) service to obtain the first product information based on the historical shopping situation and / or historical search situation. Among them, the AI ​​shopping guide system includes a large language model, and the AI ​​shopping guide system can reply (that is, display) the first product information to the user through the large language model. MCP is used to connect the wearable device and the MCP server, so as to obtain local data from the wearable device (local data in the first database mentioned later, such as price), and obtain network data from the MCP server (such as product icons, pictures, origin, etc.).

[0064] Product information may include product identification, product price and other introductory information. This application does not limit the specific type of product information. Product identification can be an icon or picture of the product. This application does not limit the specific type of product identification.

[0065] For example, the first product type is a diet meal. In the first product type, products related to historical shopping situations include eggs, blueberries, and oatmeal porridge. The product information included in the first product information may include product identifiers and prices of eggs, blueberries, and oatmeal porridge.

[0066] For example, the historical search situation includes that the first user searched for content related to chronic gastritis one day ago. It can be inferred that the first user has been digesting meals slowly recently. Combined with the products corresponding to the above historical shopping situation and the user's physical condition corresponding to the historical search situation, eggs may not be recommended. The product information included in the first product information may include the product logo and product price of blueberries and oatmeal porridge.

[0067] Based on the above description, historical shopping situations can indicate the shopping habits of the first user, and historical search situations can indicate the user's preferences, such as consumption level, taste preferences, and brand preferences. Based on historical shopping situations and / or historical search situations, the wearable device can determine the first user's shopping intentions or shopping preferences, thereby recommending to the first user products in the first product type that are in line with the first user's shopping habits.

[0068] In a specific scenario, the wearable device is smart glasses. After the user puts on the smart glasses, the following conversation may occur:

[0069] First user: I want to make some diet meals, do you have any recommendations?

[0070] Smart glasses: Based on your shopping habits and physical condition, we recommend the following set meal (oatmeal porridge + boiled egg + blueberries). These ingredients can be purchased here. The product information of oatmeal porridge + boiled egg + blueberries is displayed in the smart glasses and can be seen by the first user.

[0071] Based on the above description, in some embodiments, the method further includes: in response to the first operation, sending a third message to the display device based on the first user's historical shopping situation, the third message including the first product information, and the third message being used to notify the display device to display the first product information.

[0072] Based on this, the display device may receive the third message, and upon receiving the third message, may display the first product information.

[0073] In an embodiment of the present application, before recommending products through the wearable device, the wearable device can obtain the user identification of the first user. When receiving a recommendation instruction about a product of the first product type, it can display the product information corresponding to the products in the first product type that are related to the historical shopping situation and / or historical search situation based on the user's historical shopping situation and / or historical search situation. In this way, it is possible to recommend products to the user more accurately and quickly according to the user's intention, so as to meet the user's needs and improve the user's shopping efficiency. In addition, this recommendation method can provide users with one-to-one personalized services, which is better than a shopping guide in understanding user needs and is more intelligent, thereby ensuring users a full range of service experience. In addition, this recommendation method can also save the number of management personnel for current shopping places.

[0074] based on Figure 3 As described in S102, after the first product information is displayed, the first user can select at least one product corresponding to the first product information based on the first product information. In this way, when the wearable device receives the operation of selecting at least one product corresponding to the first product information from the first user, the wearable device can guide the first user to the location of the selected product.

[0075] See also Figure 4 , Figure 4 A flow chart of a product shopping guide method provided in one embodiment of the present application is shown.

[0076] like Figure 4 As shown, the product shopping guide method provided by this application may include:

[0077] S201: Obtain a user ID of a first user.

[0078] S202: In response to the first operation, display first product information based on the first user's shopping history.

[0079] Among them, S201 and S202 are respectively Figure 3 The implementation of S101 and S102 in the illustrated embodiment is similar and will not be described in detail here.

[0080] S203: In response to the second operation on the first product, display the first navigation information or notify the first navigation information by voice.

[0081] The first product information includes product information of the first product. The first product information may correspond to one or more products; based on this, the first product may be one or more products.

[0082] For example, the first commodity information includes commodity information including commodity identifications and commodity prices of eggs, blueberries, and oatmeal. The first commodity can be any one or more of eggs, blueberries, and oats.

[0083] The second operation is a voice selection operation for the first product.

[0084] For example, the first product is eggs, and the second operation is “I want eggs” input by the first user's voice.

[0085] For another example, the first product is eggs and oats, and the second operation is the first user's voice input of "I want eggs and oats".

[0086] It should be understood that the above description uses the example of the first commodity including eggs, or eggs and oats; this application does not limit the specific implementation method of the first commodity. Furthermore, this application does not limit the specific content of the second operation.

[0087] In some embodiments, the wearable device includes a microphone, and the first user can perform the second operation through the microphone.

[0088] In other embodiments, the wearable device is communicatively connected to the earphones belonging to the first user, and the first user can perform the second operation through the earphones.

[0089] This application does not specifically limit the manner in which the first user performs the second operation.

[0090] The first navigation information is used to guide the first user from a current location to a target location, where the target location is the location of the first product in the current shopping place.

[0091] That is, the first navigation information includes a route from the current location to the target location, so that the first user can find the first product based on the route.

[0092] For example, if the first commodity is eggs, then the first navigation information is navigation information from the current location to the location of the eggs in the current shopping place.

[0093] For another example, if the first product includes eggs and oats, then the first navigation information may include three situations:

[0094] Case 1: The first navigation information may include navigation information from the current location to the location of eggs in the current shopping place, and navigation information from the current location to the location of oats in the current shopping place.

[0095] Case 2: The first navigation information may include navigation information from the current location to the location of eggs in the current shopping place, and navigation information from the location of eggs to the location of oats in the current shopping place.

[0096] Case 3: The first navigation information may include navigation information from the current location to the location of oats in the current shopping place, and navigation information from the location of oats to the location of eggs in the current shopping place.

[0097] Thus, the wearable device can display the navigation information corresponding to any of the above three situations in full screen based on the selection operation of any of the above three situations input by the first user's voice, so as to facilitate the first user to shop through the navigation information.

[0098] Based on the above description, in a specific scenario, the wearable device is smart glasses. The products corresponding to the first product information include eggs, blueberries, and oatmeal in that order. After the user puts on the smart glasses, the following conversation may occur:

[0099] First user: The first one.

[0100] Smart glasses: Voice notification of navigation information from the current location to the location of eggs in the current shopping place, or display of navigation information from the current location to the location of oats in the current shopping place.

[0101] In addition, based on the description of S102, the display device may receive the third message, and upon receiving the third message, may display the first product information, and the first user may select the first product on the display device.

[0102] In some embodiments, the method further includes: in response to the third operation, the wearable device sends a fourth message to the display device, the third operation is the first user's selection operation of the first product in the display device, the fourth message includes the first navigation information, and the fourth message is used to notify the display device to display the first navigation information.

[0103] Based on this, the display device in the shopping cart can receive the fourth message, and when receiving the fourth message, the display device can display the first navigation information, so that the first user can go from the current location to the location of the first product based on the first navigation information on the display device.

[0104] S204: Receive settlement instructions.

[0105] In some embodiments, the settlement instruction is a voice instruction. For example, the settlement instruction is a voice input from the first user: "I've made my selection. Let's settle." Another example is a voice input from the first user: "Please settle." This application does not limit the specific implementation of the settlement instruction.

[0106] S205: Scan target commodities, where the target commodities include commodities that the first user needs to purchase in the current shopping place.

[0107] For example, target products include eggs, blueberries, oats, tomatoes, and beef.

[0108] When receiving the settlement instruction, the wearable device can enter the settlement procedure. At this time, if the first user places the target product in a position where the wearable device can scan, the wearable device can scan the target product, thereby facilitating the wearable device to obtain the product information of the target product that the first user needs to purchase in the current shopping place.

[0109] S206. When the scanning is finished, the name of the target product is recorded, and the shopping history is updated according to the product information of the target product corresponding to the name of the target product.

[0110] For example, the target products include eggs, blueberries, chicken breast, oats, tomatoes, and beef. The wearable device can obtain the product names of eggs, blueberries, chicken breast, oats, tomatoes, and beef and record them.

[0111] The product information here may include type, total number of purchases, etc. This application does not limit the specific implementation method of the product information here.

[0112] For example, historical shopping information includes the type and total number of purchases of each item: eggs, blueberries, oats, and chicken breast belong to the weight loss category, tomatoes belong to the vegetable category, and beef belongs to the meat category. The total number of eggs purchased is 10 times, the total number of blueberries purchased is 11 times, the total number of chicken breast purchased is 8 times, the total number of oats purchased is 6 times, the total number of tomatoes purchased is 6 times, and the total number of beef purchased is 5 times.

[0113] In some embodiments, the number of purchases of each product can be calculated by a counter, and each time any product is settled, the value of the counter corresponding to the product is increased by 1. This application does not specifically limit the method for calculating the total number of purchases of each product.

[0114] In an embodiment of the present application, when the first user selects the first product among the products corresponding to the first product information, the wearable device can display the first navigation information from the current location to the location of the first product, or voice notify the first navigation information from the current location to the location of the first product, thereby improving the efficiency of the user in finding the products he wants to buy, saving the user's shopping time, and improving the user's shopping experience.

[0115] In addition, when receiving the settlement instruction, the wearable device can scan the target product. At the end of the scan, the historical shopping history can be updated, so that the wearable device can provide historical data for recommending products to the first user when the first user shops next time. That is to say, the first user can recommend more accurate product information to the first user based on the new historical shopping history during the next shopping.

[0116] Among them, in the embodiment of the present application, at the end of the scan, the wearable device can display the total price of the target product to the first user in a variety of ways, so that the first user can settle the purchase of the target product.

[0117] In some embodiments, when the scan ends, a first message is sent to the terminal device of the first user corresponding to the user identifier, the first message including the total price of the target product, and the first message is used to notify the first user to settle the target product based on the total price of the target product.

[0118] Based on this, when the terminal device receives the first message, it can display the total price of the target product and the settlement control. In response to the first user's operation on the settlement control, the terminal device can settle the target product.

[0119] In other embodiments, at the end of the scan, a second message is sent to the display device of the shopping cart, the second message including the total price of the target product, and the second message is used to notify the display device to generate a price code based on the total price of the target product, the price code including a QR code or a barcode.

[0120] Based on this, when the display device receives the second message, it can display the total price of the target product and the price code. When the terminal device scans the price code, it can display the total price of the target product and the settlement control. In response to the first user's operation of the settlement control, the terminal device can settle the target product.

[0121] Based on the above description, this application can provide a settlement entrance for the first user in a variety of ways, so that one-to-one humanized settlement can be achieved and the efficiency of the first user in settling goods can be improved.

[0122] In some embodiments, the method further includes: displaying information about the second product when it is detected that the first user is holding the second product or pointing at the second product; wherein the second product information includes introduction information of the second product, and the introduction information includes at least one of product attributes, product sales, user reviews, competitor product prices, and comparisons with similar products, and the first user is a shopping user; the wearable device includes a first database, and the first database includes introduction information of each product among all products in the current shopping place.

[0123] The wearable device includes a camera that can capture images in real time and detect whether the first user is holding or pointing at a product. Furthermore, the wearable device includes a first database that includes product description information for all products in the current shopping location. Thus, if the first user is detected holding or pointing at a second product, the wearable device can query the first database for the product description information and display the product description information, i.e., the product information.

[0124] In some embodiments, the AI ​​shopping guide system in the wearable device can detect whether the first user is holding or pointing at a product based on images captured by a camera. The AI ​​shopping guide system includes a multimodal large model, and the AI ​​shopping guide system can use the multimodal large model to detect whether the user is holding or pointing at a product in the image. The multimodal large model can be pre-trained and can be trained using images that include sample users holding or pointing at products.

[0125] Among them, product attributes may include but are not limited to material, function, size, color, origin, etc.

[0126] For example, the second product is eggs, and the product attributes include the size of the eggs, the color of the eggs, and the origin of the eggs.

[0127] Among them, the comparison of similar products may include but is not limited to comparison of product attributes, comparison of product prices, comparison of user reviews, and comparison of sales volume. Product attribute comparison may include comparison of specification parameters (such as size, weight, capacity, etc.) and functional characteristics (such as performance, material, etc.) of the second product with other products of the same type. Product price comparison may include comparison of market pricing of the second product with other products of the same type and comparison of prices during promotional activities. User review comparison may include comparison of comprehensive scores of the second product with other products of the same type. Sales volume comparison may include sales data of the second product with other products of the same type (such as ranking, monthly sales, etc.) and consumers' perception of the popularity of the product.

[0128] Based on the above description, in an embodiment of the present application, when it is detected that the first user is holding the second product or pointing at the second product, the introduction information of the second product, that is, the second product information, is displayed. This can provide the first user (shopping user) with introduction information about the product he wants to purchase, ensuring that the first user can quickly understand the product he wants to purchase, thereby improving the user's shopping experience.

[0129] In some embodiments, the method further comprises:

[0130] When it is detected that the first user is holding the third product or pointing at the third product, the third product information is displayed; wherein, the third product information includes the operation information of the third product, and the operation information includes at least one of the product inventory, sales information, display quantity, item code information and user feedback and comment summary. The first user is the management user of the current shopping place. When the first user is the management user, the user ID is the user ID of the management user; the first database also includes the operation information of each product among all the products in the current shopping place.

[0131] The wearable device includes a camera that can capture images in real time and detect whether the first user is holding or pointing at a product. Furthermore, the wearable device includes a first database that includes operational information for each product in the current shopping location. Thus, if the first user is detected holding or pointing at a third product, the wearable device can query the first database for operational information about the third product and display the operational information, i.e., the third product information, for the third product.

[0132] In some embodiments, the AI ​​shopping guide system in the wearable device can detect whether the first user is holding or pointing at a product based on images captured by a camera. The AI ​​shopping guide system includes a multimodal large model, and the AI ​​shopping guide system can use the multimodal large model to detect whether the user is holding or pointing at a product in the image. The multimodal large model can be pre-trained and can be trained using images that include sample users holding or pointing at products.

[0133] Among them, product inventory is used to reflect the current storage status of the third-party product, that is, the quantity. Sales volume information is used to reflect the popularity of the third-party product in the current shopping location, which helps to assess market response. Display quantity is used to reflect the layout of the third-party product on the shelf or display area (display quantity). The item code information is used to indicate the corresponding item code of the third-party product in the current shopping location. The user feedback review summary is used to indicate the user's actual experience and satisfaction.

[0134] Based on the above description, in an embodiment of the present application, when it is detected that the first user is holding the third product or pointing at the third product, the operation information of the third product, that is, the third product information, is displayed, which can be used to display relevant operation information to the management user, thereby ensuring that the management personnel of the current shopping place can quickly understand the operation status of each product, and facilitate the management user to adjust the various products in the current shopping place from an operational perspective, thereby improving the management efficiency of the management user over the current shopping place.

[0135] Among them, wearable devices can also have external search functions.

[0136] In some embodiments, the method further includes: displaying second content or voice notifying the second content in response to a search instruction corresponding to the first content, where the second content is a reply result to the first content; and updating the historical search status according to the first content.

[0137] That is to say, in the embodiment of the present application, the wearable device can also realize the search function. Even if the goods, events, and content are not related to the current shopping place, the wearable device can search and display them to the user, thereby further improving the first user's experience of using the wearable device.

[0138] Based on the above description, in a specific scenario, the wearable device is smart glasses. After the user puts on the smart glasses, the following conversation may occur:

[0139] First user: What are the hot news today?

[0140] Smart glasses: Celebrity A attended event A today.

[0141] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0142] Corresponding to the commodity shopping guide method of the above embodiment, Figure 5 A structural block diagram of a product shopping guide device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0143] Reference Figure 5 , the device comprises:

[0144] The acquisition module 301 is configured to acquire a user identifier of a first user.

[0145] The processing module 302 is used to display the first product information in response to the first operation based on the first user's historical shopping situation and / or historical search situation; wherein the first operation is a voice operation in which the first user requests a recommendation of a product of the first product type, the historical shopping situation includes the shopping record of the first user corresponding to the user identifier at the current shopping place before the current moment, the historical search situation includes the content searched by the first user in the wearable device before the current moment, and the first product information includes product information corresponding to products in the first product type that are related to the historical shopping situation and / or historical search situation.

[0146] In some embodiments, the processing module 302 is specifically configured to:

[0147] In response to a second operation on the first product, the first navigation information is displayed, or the first navigation information is notified by voice; wherein the first product information includes product information of the first product, the second operation is a voice selection operation on the first product, and the first navigation information is used to guide the first user from the current location to the target location, and the target location is the location of the first product in the current shopping place.

[0148] In some embodiments, the processing module 302 is specifically configured to:

[0149] Receive a settlement instruction; scan the target product, which includes the product that the first user needs to purchase in the current shopping place; when the scanning is completed, record the name of the target product, and update the historical shopping situation according to the product information of the target product corresponding to the name of the target product.

[0150] In some embodiments, the processing module 302 is specifically configured to:

[0151] At the end of the scan, a first message is sent to a terminal device of a first user corresponding to the user identifier, the first message including the total price of the target product, and the first message is used to notify the first user to settle the target product based on the total price of the target product;

[0152] Alternatively, at the end of the scan, a second message is sent to the display device of the shopping cart, the second message including the total price of the target product, and the second message is used to notify the display device to generate a price code based on the total price of the target product, the price code including a QR code or a barcode.

[0153] In some embodiments, the processing module 302 is specifically configured to:

[0154] In response to the first operation, a third message is sent to the display device based on the first user's historical shopping situation, the third message includes the first product information, and the third message is used to notify the display device to display the first product information; in response to the third operation, a fourth message is sent to the display device, the third operation is the first user's selection operation of the first product in the display device, the fourth message includes the first navigation information, and the fourth message is used to notify the display device to display the first navigation information.

[0155] In some embodiments, the acquisition module 301 is specifically configured to:

[0156] A user identification of the first user is received from the access device, where the user identification is sent by the access device to the wearable device when the first user takes the wearable device from the access device.

[0157] In some embodiments, the processing module 302 is specifically configured to:

[0158] When it is detected that the first user is holding the second product or pointing at the second product, the second product information is displayed; wherein the second product information includes introduction information of the second product, and the introduction information includes at least one of product attributes, product sales, user reviews, competitor product prices and comparisons with similar products, and the first user is a shopping user; the wearable device includes a first database, and the first database includes introduction information of each product among all products in the current shopping place.

[0159] In some embodiments, the processing module 302 is specifically configured to:

[0160] When it is detected that the first user is holding the third product or pointing at the third product, the third product information is displayed; wherein, the third product information includes the operation information of the third product, and the operation information includes at least one of the product inventory, sales information, display quantity, item code information and user feedback and comment summary. The first user is the management user of the current shopping place. When the first user is the management user, the user ID is the user ID of the management user; the first database also includes the operation information of each product among all the products in the current shopping place.

[0161] In some embodiments, the processing module 302 is specifically configured to:

[0162] In response to the search instruction corresponding to the first content, the second content is displayed, or the second content is notified by voice, and the second content is a reply result to the first content; according to the first content, the historical search situation is updated.

[0163] In some embodiments, the wearable device is smart glasses.

[0164] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0165] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0166] An embodiment of the present application also provides a wearable device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.

[0167] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0168] An embodiment of the present application provides a computer program product. When the computer program product is run on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned various method embodiments when executing the computer program product.

[0169] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process of the above-mentioned method embodiment by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium can at least include: any entity or device capable of carrying computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, mobile hard drive, magnetic disk, or optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals or telecommunication signals.

[0170] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0171] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0172] In the embodiments provided in this application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0173] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0174] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A commodity shopping guide method, characterized in that: Applied to a wearable device, the method includes: Obtaining a user ID of a first user; In response to the first operation, displaying first product information based on the first user's historical shopping and / or historical search history; Among them, the first operation is a voice operation in which the first user requests to recommend a product of the first product type, the historical shopping situation includes the shopping records of the first user corresponding to the user identifier at the current shopping place before the current moment, the historical search situation includes the content searched by the first user in the wearable device before the current moment, and the first product information includes product information corresponding to products in the first product type that are related to the historical shopping situation and / or historical search situation.

2. The method according to claim 1, wherein After displaying the first product information in response to the first operation and based on the first user's shopping history, the method further includes: In response to the second operation on the first product, displaying the first navigation information or announcing the first navigation information by voice; Among them, the first product information includes product information of the first product, the second operation is a voice selection operation for the first product, and the first navigation information is used to guide the first user from the current location to the target location, and the target location is the location of the first product in the current shopping place.

3. The method according to claim 2, wherein The method further comprises: Receive settlement instructions; Scanning target commodities, where the target commodities include commodities that the first user needs to purchase in the current shopping place; When the scanning is finished, the name of the target product is recorded, and the historical shopping situation is updated according to the product information of the target product corresponding to the name of the target product.

4. The method according to claim 3, wherein The method further comprises: At the end of the scan, a first message is sent to a terminal device to which the first user corresponding to the user identifier belongs, the first message including the total price of the target product, and the first message is used to notify the first user to settle the purchase of the target product based on the total price of the target product; Alternatively, at the end of the scan, a second message is sent to the display device of the shopping cart, wherein the second message includes the total price of the target product. The second message is used to notify the display device to generate a price code based on the total price of the target product, wherein the price code includes a QR code or a barcode.

5. The method according to claim 4, wherein The method further comprises: In response to the first operation, sending a third message to the display device based on the first user's shopping history, the third message including the first product information, and the third message being used to notify the display device to display the first product information; In response to a third operation on the first product, a fourth message is sent to the display device, the third operation being a selection operation of the first user on the first product in the display device, the fourth message including the first navigation information, and the fourth message being used to notify the display device to display the first navigation information.

6. The method according to any one of claims 1 to 5, characterized in that The obtaining of the user identifier of the first user includes: The user identification of the first user is received from an access device, where the user identification is sent by the access device to the wearable device when the first user takes the wearable device from the access device.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When it is detected that the first user is holding a second product or pointing at the second product, displaying information about the second product; The second product is any product in the current shopping place, the second product information includes introduction information of the second product, and the introduction information includes at least one of product attributes, product sales, user reviews, competitor product prices, and comparisons with similar products, and the first user is a shopping user; The wearable device includes a first database, which includes the introduction information of each commodity in all commodities in the current shopping place.

8. The method according to claim 7, wherein The method further comprises: When it is detected that the first user is holding a third product or pointing at the third product, displaying information about the third product; The third product is any product in the current shopping place, the third product information includes operation information of the third product, the operation information includes at least one of product inventory, sales information, display quantity, item code information, and user feedback and comment summary, the first user is an administrative user of the current shopping place, and when the first user is the administrative user, the user identifier is the user identifier of the administrative user; The first database also includes the operation information of each commodity in all commodities in the current shopping place.

9. The method according to any one of claims 1 to 5, characterized in that The method further comprises: In response to a search instruction corresponding to the first content, display a second content, or notify the second content by voice, where the second content is a reply result to the first content; The historical search situation is updated according to the first content.

10. The method according to any one of claims 1 to 5, characterized in that The wearable device is smart glasses.

11. A product shopping guide device, characterized in that: include: An acquisition module, configured to acquire a user identifier of a first user; a processing module, configured to display first product information based on the first user's shopping history in response to a first operation; Among them, the first operation is a voice operation in which the first user requests to recommend a product of the first product type, the historical shopping situation includes the shopping records of the first user corresponding to the user identifier at the current shopping place before the current moment, the historical search situation includes the content searched by the first user in the wearable device before the current moment, and the first product information includes product information corresponding to products in the first product type that are related to the historical shopping situation and / or historical search situation.

12. A wearable device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 10 is implemented.

13. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images