Method and system for providing commodity information and AR glasses

Abstract

The embodiment of the invention discloses a method and system for providing commodity information and AR glasses. The method can be applied to AR glasses provided by a physical store, and the store is spatially divided into a display area, a storage area and a delivery area. The method comprises the following steps: when a user browses a commodity sample placed in a display area through AR glasses, a first client determines a target sample from an image collected by the AR glasses and displays commodity information of the target sample through the AR glasses; receiving an order placing request initiated by a user through AR glasses, and submitting the order placing request to a server side, so that after the server side determines that an order associated with the user completes settlement operation, the server side issues order information to a first operator so as to carry out sorting and packaging processing in a storage area and put a packaged package into a target delivery box of a delivery area; and receiving the identification information of the target delivery box provided by the server, and displaying the identification information through AR glasses to prompt a user to pick up goods from the target delivery box. The shopping experience of the user can be optimized, and the transaction conversion rate of shop commodities can be improved.

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a method and system for providing product information and AR glasses. Background Art

[0002] Under the impact of the digital wave, the offline retail industry is facing unprecedented challenges. The convenience and price advantages of e-commerce platforms have made consumers more and more inclined to shop online, resulting in a continuous decline in the customer flow of physical stores. In such a market environment, offline retailers need to continue to innovate and optimize, and only by providing high-quality products and services, improving customer experience, and increasing the conversion rate of goods transactions can they gain a firm foothold in the fierce market competition. Therefore, how to reduce store costs and increase the conversion rate of goods transactions has become the key to the survival and development of offline retailers. Summary of the invention

[0003] The present application provides a method, system and AR glasses for providing product information, which can reduce the cost of offline physical stores, especially supermarkets, realize the digitization of the offline shopping process, help optimize the user shopping experience, and thus improve the transaction conversion rate of store products.

[0004] This application provides the following solutions:

[0005] A system for providing commodity information, comprising:

[0006] A first client, a second client, and a server;

[0007] The first client is applied to the augmented reality (AR) glasses provided by a physical store, wherein the physical store is spatially divided into a display area, a storage area, and a delivery area, wherein commodity samples for viewing are placed in the display area; the first client is used to determine the target sample that the consumer user is interested in from the image captured by the AR glasses when the consumer user browses the commodity samples placed in the display area through the AR glasses, and to display the commodity information of the target sample in an augmented reality manner through the AR glasses, and to submit the order request to the server when receiving an order request initiated by the consumer user through the AR glasses;

[0008] The server is used to send the order information associated with the consumer user to the second client associated with the first operator of the physical store when the settlement operation is completed; the order information includes the relevant information of the commodity to be purchased determined by the consumer user from the viewed target sample;

[0009] The second client is used to display the order information so that the first operator can sort and pack the parcels in the storage area and put the parcels into the target delivery box in the delivery area;

[0010] The server is further configured to provide the identification information of the target delivery box to the first client so as to display it in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0011] A method for providing product information is applied to augmented reality glasses provided by a physical store, wherein the physical store is spatially divided into a display area, a storage area, and a delivery area, and the display area is provided with product samples for viewing, and the method comprises:

[0012] When a consumer user browses the commodity samples displayed in the display area through the AR glasses, the first client determines the target sample that the consumer user is interested in from the image captured by the AR glasses, and displays the commodity information of the target sample in an augmented reality manner through the AR glasses;

[0013] When receiving an order request initiated by the consumer user through the AR glasses, the order request is submitted to the server, so that after the server determines that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area, and puts the packaged packages into the target delivery box located in the delivery area; the order information includes relevant information of the goods to be purchased determined by the consumer user from the viewed target samples;

[0014] The identification information of the target delivery box provided by the service end is received, and the identification information is displayed in an augmented reality manner through the AR glasses to prompt the consumer user to pick up the goods from the target delivery box.

[0015] After the consumer user picks up the goods from the target delivery box, the method further includes:

[0016] When a replacement request for the problematic product in the package is received from the consumer user through the AR glasses, the replacement request is submitted to the server so that the server can send the information of the problematic product to the third client associated with the second operator of the physical store, and the second operator will perform the replacement process.

[0017] Wherein, the method further comprises:

[0018] When receiving a product query request initiated by the consumer user through the AR glasses, submitting the product query request to the server, so that the server can determine the display location information of the product searched by the consumer user;

[0019] The display location information provided by the server is received, and displayed in an augmented reality manner through the AR glasses to guide the consumer user to the display location to browse the searched product.

[0020] Wherein, the method further comprises:

[0021] When receiving a product query request initiated by the consumer user through the AR glasses, submitting the product query request to the server, so that the server obtains product information of the product searched by the consumer user;

[0022] The product information provided by the server for the product searched by the consumer user is received, and displayed in an augmented reality manner through the AR glasses, and then it is determined whether to determine the searched product as a product to be purchased according to the operation of the consumer user.

[0023] Wherein, the method further comprises:

[0024] When receiving a recommendation request for a product recommendation for a currently viewed target sample initiated by the consumer user through the AR glasses, submitting the recommendation request to the server, so that the server can determine other products that can be matched with the target sample from the products provided by the physical store;

[0025] Receive the product information of the other products provided by the server, and display it in an augmented reality manner through the AR glasses, and then determine whether to determine the other products as products to be purchased according to the operation of the consumer user.

[0026] Among them, by detecting the gestures performed by the consumer user within the visible range of the AR glasses, the operation request of the consumer user is determined, and the operation request includes: at least one of: an order request, an exchange request, a product query request, a recommendation request, an add-to-purchase request, and a settlement request.

[0027] Among them, the product information is generated by an artificial intelligence AI model based on the information included in the product sample image, and the product sample image is collected from the graphic printing area of ​​the outer packaging of the product sample.

[0028] Among them, the first operator is an intelligent robot used to perform sorting and packaging tasks, and the second client is deployed in the intelligent robot.

[0029] A method for providing product information is applied to a server, wherein the server interacts with augmented reality (AR) glasses provided by a physical store to provide shopping services to consumer users wearing the AR glasses. The physical store is spatially divided into a display area, a storage area, and a delivery area. The display area is provided with product samples for viewing. The method comprises:

[0030] When receiving an order request initiated by the consumer user through the AR glasses, determining an order associated with the consumer user; the order includes the commodity to be purchased determined by the consumer user from the viewed target samples, and the target samples are commodity samples displayed in the display area when the consumer user browses through the AR glasses, and the commodity information of the target samples is determined from the image captured by the AR glasses and displayed to the consumer user through the AR glasses in an augmented reality manner;

[0031] If the settlement operation of the order associated with the consumer user is completed, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area and puts the packaged parcel into the target delivery box located in the delivery area;

[0032] When the identification information of the target delivery box submitted by the second client is received, it is provided to the AR glasses so as to be displayed in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0033] Wherein, the method further comprises:

[0034] Obtaining association information of different commodity samples in the physical store, wherein the association information includes: display locations of different commodity samples in the display area, and / or commodity information of different commodity samples;

[0035] When receiving a question submitted by the consumer user through the AR glasses, calling the AI ​​model, taking the question and corresponding associated information as inputs of the AI ​​model, and having the AI ​​model generate content to obtain an answer corresponding to the question, the consumer user submits the question in the form of a product query request and / or a product recommendation request;

[0036] The answer corresponding to the question is provided to the AR glasses and displayed in an augmented reality manner through the AR glasses.

[0037] A device for providing product information is applied to a first client, the first client is deployed in an augmented reality (AR) glasses provided by a physical store, the physical store is spatially divided into a display area, a storage area, and a delivery area, the display area is provided with product samples for viewing, the device comprises:

[0038] a commodity information display unit, configured to determine a target sample that the consumer user is interested in from an image captured by the AR glasses when the consumer user browses the commodity samples placed in the display area through the AR glasses, and to display the commodity information of the target sample in an augmented reality manner through the AR glasses;

[0039] An order request receiving unit is used to submit the order request to the server when receiving the order request initiated by the consumer user through the AR glasses, so that after the server determines that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area and puts the packaged packages into the target delivery box located in the delivery area; the order information includes relevant information of the goods to be purchased determined by the consumer user from the viewed target samples;

[0040] The delivery box information receiving unit is used to receive the identification information of the target delivery box provided by the server, and display it in an augmented reality manner through the AR glasses to prompt the consumer user to pick up the goods from the target delivery box.

[0041] A device for providing product information is applied to a server, the server interacts with augmented reality (AR) glasses provided by a physical store, and provides shopping services to consumer users wearing the AR glasses. The physical store is spatially divided into a display area, a storage area, and a delivery area. The display area is provided with product samples for viewing. The device includes:

[0042] an order request receiving unit, configured to determine an order associated with the consumer user upon receiving an order request initiated by the consumer user through the AR glasses; the order includes a commodity to be purchased determined by the consumer user from a target sample viewed, wherein the target sample is a commodity sample displayed in the display area when the consumer user browses the sample through the AR glasses, and the commodity information of the target sample is determined from an image captured by the AR glasses and displayed to the consumer user through the AR glasses in an augmented reality manner;

[0043] An order information sending unit, configured to send the order information to a second client associated with a first operator of the physical store when the settlement operation of the order associated with the consumer user is completed, so that the first operator can sort and pack the parcels in the storage area and put the packed parcels into a target delivery box located in the delivery area;

[0044] The delivery box information providing unit is used to provide the identification information of the target delivery box submitted by the second client to the AR glasses when the identification information is received, so as to display it in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0045] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any of the methods described above.

[0046] A pair of AR glasses, comprising:

[0047] one or more processors; and

[0048] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of any of the aforementioned methods.

[0049] A computer program product comprises a computer program / computer executable instructions, wherein the computer program / computer executable instructions, when executed by a processor in an AR glasses, implement the steps of any of the aforementioned methods.

[0050] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0051] In the embodiment of the present application, by transforming the spatial layout of the physical store, the store is divided into: a display area for placing a small number of commodity samples, a storage area for storing a large number of physical commodities corresponding to the commodity samples, and a delivery area for picking up goods.

[0052] Among them, the commodity samples placed in the display area are only for consumers to browse and view, and are not taken away by consumers as purchasable commodities. Therefore, only a small number of commodity samples can be displayed on the shelf, and even only one commodity sample can be placed for each type of commodity, which can greatly reduce the requirements for shelf specifications, the requirements for stores to be equipped with shopping carts, the requirements for the distance between adjacent shelves, etc. Compared with the space layout scheme of existing stores, the embodiment scheme of this application can place more shelves and display more types of commodities in the same space area. It is helpful to reduce store costs and improve store space utilization.

[0053] In addition, placing a small number of product samples in the display area and sorting and packaging them in the storage area can also avoid store operators from frequently and massively performing operations such as shelving, out-of-stock checks, and replenishment operations. This can not only save labor costs, but also simplify store operating procedures and help reduce cargo damage. For example, fruits and fragile goods are easily damaged during the shelving and replenishment process.

[0054] Based on the above-mentioned spatial layout scheme, the embodiment of the present application can also provide a shopping process that integrates offline and online capabilities. Specifically, consumer users wearing AR glasses can "shop around" and browse product samples in the display area, and view the product information of the target samples of interest, and submit online orders for the selected products from the target samples through AR glasses; after the store operator obtains the information of the online order, it can sort and pack the goods included in the order in the storage area, and put the packaged packages into the target delivery box in the delivery area. Correspondingly, consumer users can move from the display area to the delivery area, pick up the goods from the target delivery box according to the identification information of the target delivery box prompted by the AR glasses, and obtain the purchased goods. In this way, the digitization of the "shop around" and shopping process in physical stores can be realized, which helps to improve the shopping experience of consumer users and thus improve the transaction conversion rate of store goods.

[0055] Of course, any product implementing the present application does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0057] Figure 1 is a schematic diagram of a system for providing commodity information provided in an embodiment of the present application;

[0058] Figures 2 to 4 is a flow chart of a method for providing product information provided in an embodiment of the present application;

[0059] Figure 5 , Figure 6 It is a schematic diagram of a device for providing commodity information provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0061] In current physical stores, especially offline supermarkets, in order to create a good shopping experience for consumers who come to the store and avoid affecting the conversion rate of goods due to out-of-stock shelves, enough goods are usually placed on the shelves for multiple consumers to purchase at the same time, resulting in higher store costs: on the one hand, there are high requirements for the space area of ​​the product display area. A single shelf needs to occupy a larger space to display more types and quantities of goods, and the blank space between adjacent shelves must at least accommodate two shopping carts passing in parallel; on the other hand, there is a need for enough operators to perform operations such as shelving, out-of-stock checks, and replenishment operations, which leads to increased labor costs.

[0062] Correspondingly, the embodiments of the present application can re-divide the space of a physical store and provide a new merchandise display solution.

[0063] Specifically, the physical store can be divided into a display area, a storage area, and a delivery area. The display area is mainly used to display product samples that can be viewed by consumers, and the product samples are not considered as purchased products and can be taken away by consumers; the storage area is used to store the products that enter the physical store, and provides an operation area for the first operator to sort and pack the products; the delivery area can provide multiple delivery boxes for storing the packages packed by the first operator, so that consumers can pick up the purchased products from the corresponding delivery boxes.

[0064] In this scheme, the display area is only used to place product samples for consumers to view, not for product selection. Therefore, only a small number of product samples can be displayed on the shelf. For example, only one product sample of each type of product is placed, which can greatly reduce the requirements for shelf specifications and does not require operators to frequently perform large-scale operations such as shelving operations, out-of-stock checks, and replenishment operations. At the same time, when consumers browse product samples in the display area, they do not need to carry the purchased products with them all the time, so there is no need to use a shopping cart. It can also save the cost of equipping the store with shopping carts and reduce the requirements for the distance between adjacent shelves for the passage of shopping carts. More shelves can be placed in the same space area to display more types of products.

[0065] Based on the above-mentioned store space division scheme, the embodiment of the present application can provide a new offline shopping model. After entering the offline physical store, the consumer user can wear the AR (Augmented Reality) glasses provided by the store and "shop" offline in the display area. For the selected goods to be purchased, the online order can be submitted through the AR glasses, and then the first operator in the storage area will perform offline picking and packaging operations for the online order, and finally deliver the package to the consumer user through the delivery area.

[0066] From the perspective of system architecture, see Figure 1 The system for providing product information according to an embodiment of the present application may include: a server, at least one first client, and at least one second client.

[0067] Among them, the first client can be deployed in the AR glasses provided by the physical store, and the product information of the target sample currently being viewed can be displayed to the consumer user in an augmented reality manner, so that the user can make a shopping decision and decide whether to determine the target sample as a product to be purchased. In other words, the consumer user can see both the real scene of the physical store and the AR content rendered based on the product information through the AR glasses they wear. Among them, the real scene of the store can be the background, and the AR content is transparently superimposed on the real scene of the store to ensure the visual experience of the consumer user wearing AR glasses.

[0068] When the consumer user has a shopping intention, the first client can also receive an order request initiated by the consumer user for the product to be purchased through the AR glasses, and submit the order request to the server for subsequent processing.

[0069] In actual applications, after viewing the product information of the target sample, the consumer user can directly perform an order settlement operation for the target sample; or, the consumer user can first perform an add-to-purchase operation for the target sample, add it to a collection of products to be settled (commonly known as a "shopping cart", etc.), and then perform an order settlement operation for the products in the shopping cart. The embodiment of the present application does not limit the way in which the consumer user initiates an order request, and the first client can receive the order request and submit it to the server.

[0070] In the embodiment of the present application, the server can be privately deployed in a physical store according to usage requirements, that is, deployed in a server in a physical store, interacting with the AR glasses provided by the physical store, and providing services to consumers wearing AR glasses in the store. Alternatively, the server can be publicly owned by multiple physical stores, that is, deployed in a cloud server, interacting with the AR glasses provided by different physical stores, and providing services to consumers wearing AR glasses in multiple stores.

[0071] Specifically, after receiving the order request submitted by the first client, the server can first determine the order associated with the consumer user. If the order has completed the settlement operation, subsequent processing can be performed, so the order information can be sent to the second client associated with the first operator of the physical store. The order information includes relevant information of the goods to be purchased determined by the consumer user from the viewed target sample, such as identification information of the goods to be purchased, purchase quantity, etc., which can be determined according to usage requirements.

[0072] The second client can be deployed in the terminal device associated with the first operator, receive and display the order information issued by the server for the first operator to view, so that the first operator can perform sorting and packaging operations in the storage area according to the order information, and put the packaged packages into the target delivery box located in the delivery area.

[0073] Correspondingly, the first operator can also submit the identification information of the target delivery box to the server through the second client, so as to provide it to the first client via the server, and display it to the consumer user in an augmented reality manner through AR glasses, prompting the consumer user to pick up the goods at the target delivery box and complete the shopping process.

[0074] The implementation process of the method for providing product information provided in the embodiment of the present application is explained below with reference to specific examples. Figure 2 The flowchart shown may include:

[0075] S201: When a consumer user browses the commodity samples displayed in the display area through the AR glasses, the first client determines the target sample that the consumer user is interested in from the image captured by the AR glasses, and displays the commodity information of the target sample in an augmented reality manner through the AR glasses.

[0076] In one example, the processes of identifying the target sample and querying the commodity information of the target sample can be implemented on the first client side. Correspondingly, the first client can obtain a commodity information library, which stores the identity feature information and commodity information associated with each of the multiple commodity samples displayed in the physical store.

[0077] In this way, after the first client obtains the image captured by the AR glasses, it can match the corresponding target sample in the information database based on the identity feature information extracted from the image, and after identifying the target sample, query to obtain the product information of the target sample, and render it into augmented reality content through the AR glasses to display it to consumer users for viewing.

[0078] In another example, the process of identifying the target sample and querying the commodity information of the target sample can be implemented on the server side. Correspondingly, the server can obtain a commodity information library, which stores the identity feature information and commodity information associated with each of the multiple commodity samples displayed in the physical store.

[0079] In this way, after the first client obtains the image captured by the AR glasses, it can submit it to the server. The server will match the corresponding target sample in the information database based on the identity feature information extracted from the image, and after identifying the target sample, query to obtain the product information of the target sample, send it to the first client, and then display it to the consumer user through the AR glasses.

[0080] In another example, the processes of identifying the target sample, querying the commodity information of the target sample, etc. can be implemented by the first client and the server in cooperation.

[0081] For example, a hierarchical cache setting can be performed between the first client and the server, and the first client can obtain the identity feature information and product information associated with the popular products. In this way, after the first client obtains the image captured by the AR glasses, it can preferentially perform the processing steps of target sample identification and product information query locally. If the target sample is not matched, the image is sent to the server for corresponding processing.

[0082] For another example, the processing steps of target sample identification and commodity information query can be split into the first client and the server for implementation respectively. For example, the first client performs target sample identification and the server performs commodity information query, or the server performs target sample identification and the first client performs commodity information query, etc. The embodiments of the present application do not limit the functions implemented by the first client and the server respectively.

[0083] In the embodiment of the present application, the identity characteristic information of the commodity sample can be the barcode information of the commodity, or can be the characteristic information of the pattern, outline, color, etc. of the commodity itself, as long as the commodity sample can be uniquely identified. Correspondingly, the target sample can be identified by barcode decoding, image recognition, feature vector extraction, etc. The embodiment of the present application does not specifically limit the identification process.

[0084] In the embodiment of the present application, the product information of the product sample can be information that the product itself has and is related to the user's shopping decision. Still taking the offline supermarket as an example, the product information can include at least one of the following information according to the usage requirements: the product's ingredient list information, shelf life information, origin information, processing technology information, usage scenario information, etc. For example, for vegetable products, its usage scenario information can be reflected in the recipes available for the vegetable, the corresponding other ingredients that can be matched, etc.

[0085] In actual applications, the commodity samples placed in the display area can preferably be selected from the incoming commodities, that is, the commodity samples belong to the same batch of physical commodities as the incoming commodities, so as to ensure the accuracy of the commodity information associated with the commodity samples. In other words, the packaging and specifications of the same commodity in different batches may be different, and the production date and shelf life of the commodity may also be different. Determining a commodity sample from the incoming commodities and obtaining more accurate commodity information can also ensure the consistency between the sample viewed by the consumer user and the actual commodity picked up, which helps to improve the user shopping experience.

[0086] In the embodiments of the present application, the commodity information of the commodity sample can be obtained in different ways, which are illustrated below with examples.

[0087] In one implementation, the commodity information associated with the commodity sample may be obtained by manual entry.

[0088] For example, when a store operator is warehousing goods in a storage area, he can randomly select a product sample and manually enter the product information of the product sample through the associated fourth client. For another example, when a warehouse distributes goods to a store, a warehouse operator can randomly select a product sample from the outbound goods and manually enter the product information of the product sample through the associated fourth client.

[0089] In another implementation mode, the product information associated with the product sample can be automatically generated by an AI (Artificial Intelligence) model.

[0090] That is to say, the commodity information in the embodiment of the present application can be generated by the AI ​​model according to the information included in the commodity sample image. Among them, the commodity sample image is mainly collected from the graphic printing area of ​​the commodity sample outer packaging.

[0091] Specifically, the AI ​​model can be deployed in the terminal device associated with the fifth client. After the fifth client obtains the commodity sample image collected by the terminal device, it can call the AI ​​model, use the commodity sample image as the model input, and extract the graphic information included in the image by the AI ​​model, and generate text based on the extracted graphic information to obtain the corresponding commodity information.

[0092] Alternatively, the AI ​​model can be deployed in a server associated with the server. After the fifth client obtains the sample image of the product collected by the terminal device, it can be submitted to the server so that the server can call the AI ​​model, and the AI ​​model generates text based on the graphic information extracted from the image to obtain the corresponding product information.

[0093] Similarly, the terminal device associated with the fifth client may be owned by a store operator or a warehouse operator. When goods are put into storage at the store or taken out of storage at the warehouse, a product sample is selected, an image of the product sample is captured through the terminal device, and the AI ​​model is called to generate corresponding product information.

[0094] Understandably, whether the product information is obtained by manual entry or model generation, it is concise and easy to read. The complicated information on the product packaging can be simplified and screened for consumers to view, which is convenient for consumers to quickly understand the information they are concerned about, and helps to improve the user's information viewing experience. In addition, providing consumers with information that is not on the product packaging, such as the usage scenario information mentioned above, can also help increase consumers' interest in the product, thereby increasing the transaction conversion rate of the product; in addition, if the product information also includes other products that can be sold with the product, it can also bring exposure to other products, thereby increasing the transaction conversion rate of other products.

[0095] S202: When the first client receives the order request initiated by the consumer user through the AR glasses, the first client submits the order request to the server.

[0096] S203: When the server receives the order request initiated by the consumer user through the AR glasses, if it is determined that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area, and then puts the packaged parcel into the target delivery box located in the delivery area.

[0097] After the server receives the order request submitted by the first client, it can determine the order for which the order request is directed and obtain the latest status of the order. If the order status indicates that the settlement operation of the order has been completed, the order information can be sent to the first operator in the storage area, triggering the subsequent sorting and packaging processing flow, and determining one of the idle delivery boxes in the delivery area as the target delivery box, and storing the packaged package in the target delivery box.

[0098] As an example, the first operator can be embodied as an intelligent robot that can perform sorting and packing tasks, and the second client is deployed in the intelligent robot to automate the shopping process, which helps to further reduce labor costs.

[0099] S204: When the server receives the identification information of the target delivery box submitted by the first operator through the second client, it provides it to the first client to display it in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0100] After placing the packaged parcel in the target delivery box, the first operator can submit the identification information of the target delivery box to the server through the second client, which is then sent to the first client through the server, and then the identification information of the target delivery box is displayed to the consumer user through the AR glasses, prompting the user to pick up the goods.

[0101] In actual applications, when a consumer user enters a physical store and wears AR glasses, the user and the AR glasses can be bound. Furthermore, after the target delivery box is determined, the consumer user currently wearing the AR glasses can be bound to the target delivery box. In this way, when the consumer user goes to the target delivery box to pick up the goods, he can scan the identity code associated with the target delivery box through the AR glasses to submit an identity authentication request to the server. After the server determines that the identity authentication is passed based on the binding relationship, it can open the door of the target delivery box and let the consumer user take the package out of it.

[0102] To summarize, the embodiment of the present application transforms the spatial layout of a physical store and divides the store into: a display area for placing a small number of commodity samples, a storage area for storing a large number of physical commodities corresponding to the commodity samples, and a delivery area for picking up selected commodities.

[0103] Among them, the commodity samples placed in the display area are only for consumers to browse and view, and are not taken away by consumers as purchasable commodities. Therefore, only a small number of commodity samples can be displayed on the shelf, and even only one commodity sample can be placed for each type of commodity, which can greatly reduce the requirements for shelf specifications, the requirements for stores to be equipped with shopping carts, the requirements for the distance between adjacent shelves, etc. Compared with the space layout scheme of existing stores, the embodiment scheme of this application can place more shelves and display more types of commodities in the same space area. It is helpful to reduce store costs and improve store space utilization.

[0104] In addition, placing a small number of product samples in the display area and sorting and packaging them in the storage area can also avoid store operators from frequently performing large-scale operations such as shelving, out-of-stock checks, and replenishment operations. This can not only save labor costs, but also simplify store operating procedures and help reduce cargo damage. For example, fruits and fragile goods are easily damaged during the shelving process.

[0105] Based on the above-mentioned spatial layout scheme, the embodiment of the present application can also provide a shopping process that integrates offline and online capabilities. Specifically, consumer users wearing AR glasses can "shop around" and browse product samples in the display area, and view the product information of the target samples of interest, and submit online orders for the selected products from the target samples through AR glasses; after the store operator obtains the information of the online order, it can sort and pack the goods included in the order in the storage area, and put the packaged packages into the target delivery box in the delivery area. Correspondingly, consumer users can move from the display area to the delivery area, pick up the goods from the target delivery box according to the identification information of the target delivery box prompted by the AR glasses, and obtain the purchased goods. In this way, the digitization of the "shop around" and shopping process in physical stores can be realized, which helps to improve the shopping experience of consumer users and thus improve the transaction conversion rate of store goods.

[0106] Optionally, the embodiments of the present application also provide the following preferred solutions according to usage requirements, which are illustrated below with examples.

[0107] Preferred option 1 is the option related to product exchange service.

[0108] That is to say, after consumers pick up the goods from the target delivery box, they can check the goods to determine whether there are any problem goods such as out-of-stock goods, damaged goods, or stale goods. If there are no problem goods, the shopping process can be ended; if there are problem goods, the exchange process can be initiated through AR glasses.

[0109] Specifically, when the first client receives an exchange request initiated by a consumer user through AR glasses for a problematic product in a package, the exchange request can be submitted to the server so that the server can send the information of the problematic product to the third client associated with the second operator of the physical store, and the second operator will process the exchange.

[0110] Among them, the information of the problematic product can be reflected in the identification information of the exchanged product, the exchange quantity information, etc. The second operator can replace the new product accordingly and determine a new delivery box, and prompt the consumer user to store the exchanged product in the new delivery box and take the new product from the new delivery box through AR glasses. Of course, considering that there are fewer exchanges and the labor cost requirements are not high, the second operator can also go to the delivery area to directly provide the new product to the consumer user and collect the exchanged product in person.

[0111] Preferred option 2 is the option related to product query service.

[0112] That is to say, after consumers wear AR glasses, they can use them to query relevant information about the products they are interested in.

[0113] For commodities that the consumer user has a clear intention to purchase, when the commodity placement is unclear, a query request for the commodity can be initiated through AR glasses. Specifically, when the first client receives a commodity query request initiated by the consumer user through AR glasses, the commodity query request can be submitted to the server, so that the server can determine the display location information of the commodity searched by the consumer user, provide it to the first client, and display the display location information through AR glasses to guide the consumer user to browse the searched commodity at the display location.

[0114] In addition, if the location of the product is unclear, the product information of the product can be directly viewed through a query request. Specifically, when the first client receives a product query request initiated by a consumer user through AR glasses, the product query request can be submitted to the server, so that the server obtains the product information of the product queried by the consumer user, provides it to the first client, and displays the product information through AR glasses, and then determines whether to determine the queried product as a product to be purchased based on the operation of the consumer user. In other words, even if the consumer user does not move to the shelf where the product sample is displayed, the product information of the product can be obtained through a product query request.

[0115] It can be understood that if the display location information and product information of the goods are stored on the AR glasses side, after the first client receives the query request, it can also obtain the information required by the consumer user through local query and display it through the AR glasses.

[0116] Preferred option three is an option related to product recommendation service.

[0117] That is to say, when a consumer user views a target sample through the AR glasses they are wearing, they can also request the server to make product recommendations for the target sample.

[0118] Specifically, when the first client receives a recommendation request initiated by a consumer user through AR glasses to recommend products for a currently viewed target sample, the recommendation request can be submitted to the server so that the server can determine other products that can be matched with the target sample from the products provided by the physical store, provide them to the first client, and display the product information of other products through AR glasses, and then determine whether to identify other products as products to be purchased based on the consumer user's operation.

[0119] As an example, the display location information, other commodities that can be sold together, etc. in the above-mentioned preferred scheme can be obtained based on the capabilities of the AI ​​model, and a corresponding question-and-answer service based on the AI ​​model can be provided.

[0120] Specifically, the query requests and recommendation requests initiated by consumers through AR glasses can be regarded as questions submitted by consumers. After the server obtains the question, it can call the AI ​​model, take the related information of the product samples in the physical store and the question raised by the user as the input of the model, and generate the answer corresponding to the question with the help of the AI ​​model's own multimodal information content understanding and content production capabilities.

[0121] For product query services, the associated information of product samples in physical stores can be reflected as the display locations of different product samples in the display area, and the answer generated based on this is the display location information of the product that the user is searching for. For example, the display location information can be reflected as the logo of the shelf where the product is located, the corresponding navigation route, etc.

[0122] For product recommendation services, the associated information of product samples in physical stores can be reflected as product information of different product samples, and the answer generated based on this is the matching information of the target sample. For example, the matching information can be reflected in other products that can be sold together with the target sample in the physical store, the matching usage scenarios of the target sample and other products, etc.

[0123] Understandably, when generating matching information, the AI ​​model can also search for some relevant content from the public network, combine it with store-related information, and use them as materials to generate matching information.

[0124] In addition, it should be noted that the shopping process provided in the embodiment of the present application involves the submission and response of multiple operation requests, such as at least one of an order request, a replacement request, a product query request, a recommendation request, an add-on request, and a settlement request. Correspondingly, the request submitted by the consumer user through the AR glasses can be obtained in multiple ways, and examples are given below.

[0125] In one way, the image acquisition capability of the AR glasses can be used to obtain the operation request of the consumer user. In other words, the consumer user can submit the request through gestures. Correspondingly, the first client determines the operation request of the consumer user by detecting the gestures performed by the consumer user within the visible range of the AR glasses.

[0126] In another way, the voice interaction capability of AR glasses can be used to obtain the operation request of the consumer user. In other words, the consumer user can submit the request by voice input. Correspondingly, the first client determines the operation request of the consumer user by identifying the voice data input by the consumer user collected by the AR glasses.

[0127] In addition, in actual applications, there are often scenarios where consumer users "go shopping" with their companions. In this scenario, consumer users may also need to put the goods they have purchased together for settlement and other needs. In response to the above needs, corresponding support can also be provided in the optional implementation mode of the present application. Specifically, the first client in the AR glasses can also determine other consumer users who have a peer relationship with the consumer user, and provide a service for sharing a collection of goods to be settled between the consumer user and the other consumer users. In other words, for different consumer users with a peer relationship, the goods to be purchased that each chooses to add to the shopping cart can appear in the shopping carts of other users in the same peer group. Correspondingly, any one of the consumer users can submit an order request for the goods to be purchased in the shared shopping cart through the AR glasses they are wearing.

[0128] Correspondingly, the embodiment of the present application can also provide a method for providing product information applied to the first client, see Figure 3 As shown in the flow chart, the method may include:

[0129] S301: When a consumer user browses the commodity samples placed in the display area through the AR glasses, the first client determines the target sample that the consumer user is interested in from the image captured by the AR glasses, and displays the commodity information of the target sample in an augmented reality manner through the AR glasses;

[0130] S302: upon receiving an order request initiated by the consumer user through the AR glasses, submitting the order request to the server, so that after the server determines that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area, and puts the packaged packages into the target delivery box located in the delivery area; the order information includes relevant information of the goods to be purchased determined by the consumer user from the viewed target samples;

[0131] S303: Receive identification information of the target delivery box provided by the server, and display it in an augmented reality manner through the AR glasses to prompt the consumer user to pick up the goods from the target delivery box.

[0132] Correspondingly, the embodiment of the present application can also provide a method for providing product information applied to the server, see Figure 4 As shown in the flow chart, the method may include:

[0133] S401: upon receiving an order request initiated by the consumer user through the AR glasses, determining an order associated with the consumer user; the order includes a commodity to be purchased determined by the consumer user from the viewed target samples, wherein the target sample is a commodity sample displayed in the display area when the consumer user browses the display area through the AR glasses, and the commodity information of the target sample is determined from an image captured by the AR glasses and displayed to the consumer user through the AR glasses in an augmented reality manner;

[0134] S402: If the settlement operation of the order associated with the consumer user is completed, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area and puts the packaged parcel into the target delivery box located in the delivery area;

[0135] S403: When the identification information of the target delivery box submitted by the second client is received, the identification information is provided to the AR glasses so as to be displayed in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0136] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0137] Corresponding to the above method embodiment, the embodiment of the present application also provides a device for providing product information, which is applied to a first client, and the first client is deployed in an augmented reality AR glasses provided by a physical store. The physical store is spatially divided into a display area, a storage area, and a delivery area, and the display area is provided with product samples for viewing. Figure 5 , the device may include:

[0138] The commodity information display unit 501 is used to determine the target sample that the consumer user is interested in from the image captured by the AR glasses when the consumer user browses the commodity samples placed in the display area through the AR glasses, and display the commodity information of the target sample in an augmented reality manner through the AR glasses;

[0139] The order request receiving unit 502 is used to submit the order request to the server when receiving the order request initiated by the consumer user through the AR glasses, so that after the server determines that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area and puts the packaged packages into the target delivery box located in the delivery area; the order information includes the relevant information of the goods to be purchased determined by the consumer user from the viewed target samples;

[0140] The delivery box information receiving unit 503 is used to receive the identification information of the target delivery box provided by the server, and display it in an augmented reality manner through the AR glasses to prompt the consumer user to pick up the goods from the target delivery box.

[0141] After the consumer user picks up the goods from the target delivery box, the device further includes:

[0142] The exchange request receiving unit is used to submit the exchange request to the server when receiving the exchange request initiated by the consumer user through the AR glasses for exchanging the problematic product in the package, so that the server can send the information of the problematic product to the third client associated with the second operator of the physical store, and the second operator will perform the exchange process.

[0143] Wherein, the device further comprises:

[0144] a query request receiving unit, configured to, upon receiving a product query request initiated by the consumer user through the AR glasses, submit the product query request to the server, so that the server can determine the display location information of the product queried by the consumer user;

[0145] The location information receiving unit is used to receive the display location information provided by the server, and display it in an augmented reality manner through the AR glasses to guide the consumer user to the display location to browse the searched goods.

[0146] Wherein, the device further comprises:

[0147] a query request receiving unit, configured to, upon receiving a product query request initiated by the consumer user through the AR glasses, submit the product query request to the server, so that the server obtains product information of the product searched by the consumer user;

[0148] The product information receiving unit is used to receive the product information provided by the server for the product searched by the consumer user, and display it in an augmented reality manner through the AR glasses, and then determine whether to determine the searched product as a product to be purchased based on the operation of the consumer user.

[0149] Wherein, the device further comprises:

[0150] a recommendation request receiving unit, configured to, upon receiving a recommendation request initiated by the consumer user through the AR glasses for recommending a product for the currently viewed target sample, submit the recommendation request to the server, so that the server can determine other products that can be matched with the target sample from the products provided by the physical store;

[0151] A product information receiving unit is used to receive the product information of the other products provided by the server, and display the product information in an augmented reality manner through the AR glasses, and then determine whether to determine the other products as products to be purchased according to the operation of the consumer user.

[0152] Wherein, the device further comprises:

[0153] An operation request determination unit is used to determine the operation request of the consumer user by detecting a gesture performed by the consumer user within the visual range of the AR glasses, and the operation request includes: at least one of an order request, an exchange request, a product query request, a recommendation request, an add-to-purchase request, and a settlement request.

[0154] Among them, the product information is generated by an artificial intelligence AI model based on the information included in the product sample image, and the product sample image is collected from the graphic printing area of ​​the outer packaging of the product sample.

[0155] Among them, the first operator is an intelligent robot used to perform sorting and packaging tasks, and the second client is deployed in the intelligent robot.

[0156] Corresponding to the aforementioned method embodiment, the embodiment of the present application also provides a device for providing product information, which is applied to a server, and the server can interact with the augmented reality AR glasses provided by a physical store to provide shopping services to consumer users wearing AR glasses. The physical store is spatially divided into a display area, a storage area, and a delivery area, and the display area is provided with product samples for viewing. Figure 6 , the device may include:

[0157] The order request receiving unit 601 is used to determine the order associated with the consumer user when receiving the order request initiated by the consumer user through the AR glasses; the order includes the to-be-purchased commodity determined by the consumer user from the viewed target samples, and the target samples are commodity samples displayed in the display area when the consumer user browses the display area through the AR glasses, and the commodity information of the target samples is determined from the image captured by the AR glasses and displayed to the consumer user through the AR glasses in an augmented reality manner;

[0158] The order information sending unit 602 is used to send the order information to the second client associated with the first operator of the physical store when the settlement operation of the order associated with the consumer user is completed, and the first operator performs sorting and packaging in the storage area and puts the packaged parcel into the target delivery box located in the delivery area;

[0159] The delivery box information providing unit 603 is used to provide the identification information of the target delivery box submitted by the second client to the AR glasses when receiving the identification information of the target delivery box, so as to display it in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

[0160] Wherein, the device further comprises:

[0161] A correlation information obtaining unit, configured to obtain correlation information of different commodity samples in the physical store, wherein the correlation information includes: display locations of different commodity samples in the display area, and / or commodity information of different commodity samples;

[0162] A model calling unit, configured to call an AI model upon receiving a question submitted by the consumer user through the AR glasses, and use the question and corresponding associated information as inputs of the AI ​​model, so that the AI ​​model generates content to obtain an answer corresponding to the question, wherein the consumer user submits the question in the form of a product query request and / or a product recommendation request;

[0163] An answer providing unit is used to provide the answer corresponding to the question to the AR glasses, and display it in an augmented reality manner through the AR glasses.

[0164] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0165] And an AR glasses, comprising:

[0166] one or more processors; and

[0167] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the aforementioned method embodiments.

[0168] In addition, an embodiment of the present application also provides a computer program product, including a computer program / computer executable instructions, which, when executed by a processor in the AR glasses, implement the steps of any one of the methods described in the aforementioned method embodiments.

[0169] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0170] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

[0171] The above is a detailed introduction to the scheme provided by the present application. The principles and implementation methods of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A system for providing commodity information, characterized in that: include: A first client, a second client, and a server; The first client is applied to the augmented reality (AR) glasses provided by a physical store, wherein the physical store is spatially divided into a display area, a storage area, and a delivery area, wherein commodity samples for viewing are placed in the display area; the first client is used to determine the target sample that the consumer user is interested in from the image captured by the AR glasses when the consumer user browses the commodity samples placed in the display area through the AR glasses, and to display the commodity information of the target sample in an augmented reality manner through the AR glasses, and to submit the order request to the server when receiving an order request initiated by the consumer user through the AR glasses; The server is used to send the order information to the second client associated with the first operator of the physical store when the settlement operation of the order associated with the consumer user is completed; The order information includes relevant information of the commodity to be purchased determined by the consumer user from the viewed target sample; The second client is used to display the order information so that the first operator can sort and pack the parcels in the storage area and put the parcels into the target delivery box in the delivery area; The server is further configured to provide the identification information of the target delivery box to the first client so as to display it in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

2. A method for providing product information, characterized in that: Applied to augmented reality (AR) glasses provided by a physical store, the physical store is spatially divided into a display area, a storage area, and a delivery area, and the display area is provided with commodity samples for viewing, and the method includes: When a consumer user browses the commodity samples displayed in the display area through the AR glasses, the first client determines the target sample that the consumer user is interested in from the image captured by the AR glasses, and displays the commodity information of the target sample in an augmented reality manner through the AR glasses; When receiving an order request initiated by the consumer user through the AR glasses, the order request is submitted to the server, so that after the server determines that the order associated with the consumer user has completed the settlement operation, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area, and puts the packaged packages into the target delivery box located in the delivery area; the order information includes relevant information of the goods to be purchased determined by the consumer user from the viewed target samples; The identification information of the target delivery box provided by the service end is received, and the identification information is displayed in an augmented reality manner through the AR glasses to prompt the consumer user to pick up the goods from the target delivery box.

3. The method according to claim 2, characterized in that After the consumer user picks up the goods from the target delivery box, the method further includes: When a replacement request for the problematic product in the package is received from the consumer user through the AR glasses, the replacement request is submitted to the server so that the server can send the information of the problematic product to the third client associated with the second operator of the physical store, and the second operator will perform the replacement process.

4. The method according to claim 2, characterized in that: The method further comprises: When receiving a product query request initiated by the consumer user through the AR glasses, submitting the product query request to the server, so that the server can determine the display location information of the product searched by the consumer user; The display location information provided by the server is received, and displayed in an augmented reality manner through the AR glasses to guide the consumer user to the display location to browse the searched product.

5. The method according to claim 2, characterized in that: The method further comprises: When receiving a product query request initiated by the consumer user through the AR glasses, submitting the product query request to the server, so that the server obtains product information of the product searched by the consumer user; The product information provided by the server for the product searched by the consumer user is received, and displayed in an augmented reality manner through the AR glasses, and then it is determined whether to determine the searched product as a product to be purchased according to the operation of the consumer user.

6. The method according to claim 2, characterized in that The method further comprises: When receiving a recommendation request for a product recommendation for a currently viewed target sample initiated by the consumer user through the AR glasses, submitting the recommendation request to the server, so that the server can determine other products that can be matched with the target sample from the products provided by the physical store; Receive the product information of the other products provided by the server, and display it in an augmented reality manner through the AR glasses, and then determine whether to determine the other products as products to be purchased according to the operation of the consumer user.

7. The method according to claim 2, characterized in that By detecting the gestures performed by the consumer user within the visible range of the AR glasses, the operation request of the consumer user is determined, and the operation request includes: at least one of: an order request, an exchange request, a product query request, a recommendation request, an additional purchase request, and a settlement request.

8. The method according to any one of claims 2 to 7, characterized in that: The commodity information is generated by an artificial intelligence (AI) model based on information included in a commodity sample image, and the commodity sample image is collected from a graphic printing area on the outer packaging of the commodity sample.

9. The method according to any one of claims 2 to 7, characterized in that: The first operator is an intelligent robot used to perform sorting and packaging tasks, and the second client is deployed in the intelligent robot.

10. A method for providing product information, characterized in that: Applied to a server, the server interacts with augmented reality (AR) glasses provided by a physical store to provide shopping services to consumer users wearing the AR glasses. The physical store is spatially divided into a display area, a storage area, and a delivery area. The display area is provided with commodity samples for viewing. The method includes: When receiving an order request initiated by the consumer user through the AR glasses, determining an order associated with the consumer user; the order includes the commodity to be purchased determined by the consumer user from the viewed target samples, and the target samples are commodity samples displayed in the display area when the consumer user browses through the AR glasses, and the commodity information of the target samples is determined from the image captured by the AR glasses and displayed to the consumer user through the AR glasses in an augmented reality manner; If the settlement operation of the order associated with the consumer user is completed, the order information is sent to the second client associated with the first operator of the physical store, and the first operator performs sorting and packaging in the storage area and puts the packaged parcel into the target delivery box located in the delivery area; When the identification information of the target delivery box submitted by the second client is received, it is provided to the AR glasses so as to be displayed in an augmented reality manner through the AR glasses, prompting the consumer user to pick up the goods from the target delivery box.

11. The method according to claim 10, characterized in that The method further comprises: Obtaining association information of different commodity samples in the physical store, wherein the association information includes: display locations of different commodity samples in the display area, and / or commodity information of different commodity samples; When receiving a question submitted by the consumer user through the AR glasses, calling the AI ​​model, taking the question and corresponding associated information as inputs of the AI ​​model, and having the AI ​​model generate content to obtain an answer corresponding to the question, the consumer user submits the question in the form of a product query request and / or a product recommendation request; The answer corresponding to the question is provided to the AR glasses and displayed in an augmented reality manner through the AR glasses.

12. An AR glasses, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein when the program instructions are read and executed by the one or more processors, the steps of the method according to any one of claims 2 to 9 are executed.

Images