AR-based marketing activity promotion method and device, medium and computer equipment
Patent Information
- Application Number
- CN202410995913.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
这种应用方式限制了消费者体验到更加沉浸式的购物场景
[0038] To sum up, the present invention has the following beneficial effects: an AR-based marketing activity promotion method, including: determining the user's location based on the positioning module, and using the camera module when the user reaches a predetermined activity area Photograph the shopping basket screen; use the display module to display the shopping basket screen; in response to the user's product selection signal input, the display module displays the shopping basket screen and the product selection signal. The marketing activity information of the product corresponding to the product selection signal; using the method of the present invention, when the user reaches the marketing area where the product is located, the corresponding product marketing activity information can be automatically provided to the user, and the participation in AR-based marketing activities can be reduced Threshold can also provide users with corresponding preferential information through marketing activities, which can increase user participation and attraction and improve the effectiveness of marketing activities.
Smart Images

Figure CN118941333A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of creative marketing technology, and more specifically, to an AR-based marketing activity promotion method, device, medium and computer equipment. Background Art
[0002] In the field of supermarket shopping experience, with the continuous development of science and technology, some emerging technologies are being used to improve shopping experience and enhance consumer satisfaction. Among them, augmented reality (AR) technology, as a technology that combines virtuality and reality, provides new possibilities for improving supermarket shopping experience. AR technology can superimpose virtual information on the real environment, presenting consumers with richer and more vivid shopping scenes and providing an immersive shopping experience.
[0003] Relevant technical documents retrieved show that some AR applications have appeared in the field of supermarket shopping experience. However, these existing technologies have some problems and shortcomings, which limit their wide application in supermarket shopping experience. The following are the main problems and shortcomings of the existing technologies:
[0004] 1. Limited shopping scenarios: Some current AR shopping experience applications are limited to providing simple AR displays, such as virtual logos or advertising displays on product labels. This application method limits consumers from experiencing more immersive shopping scenarios.
[0005] 2. Lack of personalized recommendations: Existing AR shopping experience technology does not fully utilize consumers’ personal preferences and shopping history data, and fails to provide personalized product recommendations, resulting in limited personalization of the shopping experience.
[0006] 3. Complex technical interactions: Some existing AR shopping experience technologies have certain complexities in interactive operations, requiring users to learn and adapt, thus affecting the smoothness and convenience of shopping.
[0007] 4. Lack of real-time information updates: Some existing AR shopping experience applications have a certain lag in updating product information and cannot reflect changes in product inventory and prices in a timely manner.
[0008] 5. Hardware device dependence: Some current AR shopping experience technologies require consumers to carry specific hardware devices, such as AR glasses or handheld devices, which increases the threshold for shopping and limits the popularity of applications.
[0009] In view of the above problems and shortcomings, a method for applying AR immersive shopping experience in supermarkets is designed to solve the limitations faced by existing technologies. Summary of the invention
[0010] In view of the shortcomings of the prior art, the purpose of the present invention is to provide an AR-based marketing activity promotion method, device, medium and computer equipment to overcome the shortcomings of the existing technology that the application scope of AR technology is limited.
[0011] The above technical objectives of the present invention are achieved through the following technical solutions: A marketing activity promotion method based on AR, comprising: applying to a smart shopping cart, the smart shopping cart is provided with a positioning module, a display module and a camera module; the promotion method comprises:
[0012] Determine the user's location based on the positioning module, and use the camera module to capture a shopping basket image when the user reaches a predetermined activity area;
[0013] Using the display module to display the shopping basket screen;
[0014] In response to a commodity selection signal input by a user, the display module displays marketing activity information of the commodity corresponding to the commodity selection signal.
[0015] In one embodiment, in response to the user's commodity selection signal input, the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, specifically including:
[0016] Based on the touch signal generated by the user clicking the display module, the category of the commodity selected by the user is correspondingly determined;
[0017] Based on the commodity category, marketing activity information corresponding to the commodity is displayed on the display module.
[0018] In one embodiment, the touch signal generated by the user clicking the display module corresponds to determining the category of the product selected by the user, specifically including:
[0019] Identify the shopping cart screen and obtain all product information on the shopping cart screen; the product information includes product category and product coordinates;
[0020] Based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping with the touch coordinates are determined, and the commodity category corresponding to the commodity coordinates is used as the commodity category selected by the user.
[0021] In one embodiment, the shopping cart screen is identified to obtain all product information on the shopping cart screen; the product information includes product categories and product coordinates, specifically including:
[0022] Use the target detection model to identify all products on the shopping cart screen, generate target boxes and classification results;
[0023] Determine the product category based on the classification result;
[0024] The coordinates of the product are determined based on the coordinates and size of the target frame.
[0025] In one embodiment, the determining, based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping the touch coordinates, and using the commodity category corresponding to the commodity coordinates as the commodity category selected by the user, specifically includes:
[0026] It is determined whether the touch coordinates are located inside any target frame, and if so, it is determined that the commodity category corresponding to the target frame where the touch coordinates are located is the commodity category selected by the user.
[0027] In one embodiment, displaying marketing activity information corresponding to the commodity on the display module based on the commodity category specifically includes:
[0028] Based on the commodity category and commodity coordinates, displaying a preset display screen on the display module;
[0029] Based on the coordinates and size of the target frame, the size and position of the display screen are adjusted so that the display screen overlaps the product.
[0030] In one embodiment, the promotion method further comprises:
[0031] After the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, the preferential information of the corresponding commodity is provided.
[0032] A marketing activity promotion device based on AR, the marketing activity promotion device based on AR comprising:
[0033] an activity area determination unit, the activity area determination unit being used to determine the user's location based on the positioning module, and to use the camera module to capture a shopping basket image when the user reaches a predetermined activity area;
[0034] A screen display unit, wherein the screen display unit is used by the display module to display the shopping cart screen;
[0035] The activity information display unit is used to respond to the commodity selection signal input by the user, and the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal.
[0036] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.
[0037] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.
[0038] In summary, the present invention has the following beneficial effects: a marketing activity promotion method based on AR, comprising: determining the user's position based on the positioning module, and when the user reaches a predetermined activity area, using the camera module to shoot a shopping basket screen; using the display module to display the shopping basket screen; in response to the user's product selection signal input, the display module displays the marketing activity information of the product corresponding to the product selection signal; using the method of the present invention, when the user reaches the marketing area where the product is located, the corresponding product marketing activity information can be automatically provided to the user, which can lower the participation threshold of AR-based marketing activities, and can also provide users with corresponding preferential information through marketing activities, which can increase user participation and attractiveness and improve the effectiveness of marketing activities. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 A flowchart of a marketing activity promotion method based on AR of the present invention;
[0040] Figure 2 is a structural diagram of an AR-based marketing activity promotion device in an embodiment of the present invention;
[0041] Figure 3 is an internal structure diagram of a computer device in an embodiment of the present invention;
[0042] In the figure, 1. Activity area judgment unit; 2. Picture display unit; 3. Activity information display unit. DETAILED DESCRIPTION
[0043] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings. Several embodiments of the present invention are shown in the accompanying drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein.
[0044] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances. The terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.
[0045] In the present invention, unless otherwise clearly specified and limited, the first feature being "above" or "below" the second feature may include the first and second features being in direct contact, or may include the first and second features being in contact not directly but through another feature between them. Moreover, the first feature being "above", "above" and "above" the second feature includes the first feature being directly above and obliquely above the second feature, or simply indicates that the first feature is higher in level than the second feature. The first feature being "below", "below" and "below" the second feature includes the first feature being directly below and obliquely below the second feature, or simply indicates that the first feature is lower in level than the second feature. The terms "vertical", "horizontal", "left", "right", "above", "below" and similar expressions are for illustrative purposes only, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.
[0046] The present invention is described in detail below in conjunction with the accompanying drawings and embodiments.
[0047] Embodiment 1
[0048] In order to solve the above problems, the present invention provides a marketing activity promotion method based on AR, such as Figure 1 As shown, it is applied to a smart shopping cart, and the smart shopping cart is provided with a positioning module, a display module and a camera module; the promotion method includes:
[0049] S1. Determine the user's location based on the positioning module, and use the camera module to capture a shopping basket image when the user reaches a predetermined activity area;
[0050] S2, using the display module to display the shopping basket screen;
[0051] S3. In response to a commodity selection signal input by the user, the display module displays marketing activity information of the commodity corresponding to the commodity selection signal.
[0052] Specifically, traditional AR technology usually relies on mobile devices such as mobile phones. When participating in AR activities, users usually need to take out their mobile phones, use their mobile phones to call related applications or access related links to participate in related activities. Such a complicated process will affect the enthusiasm of users to participate in activities. The applicant found that in the operation of the supermarket, the shopping cart is an indispensable tool, and because of its convenience and strong load-bearing capacity, it is widely used by people. Therefore, the relevant identification equipment can be installed on the shopping cart. While increasing the function of the shopping cart, it reduces the difficulty of participating in marketing activities, and effectively improves the enthusiasm of users to participate in activities. In this embodiment, in order to create an immersive shopping experience, it is necessary to first improve the hardware and software structure of the shopping cart: the hardware structure improvement includes: a Bluetooth positioning module, which is used to realize the real-time location tracking of the shopping cart, communicate with the Bluetooth positioning base station inside the supermarket, and obtain the precise location of the shopping cart. Display screen. The display screen is installed in front of the shopping cart handle to facilitate user viewing without affecting the push of the shopping cart. The screen size of the display screen is moderate, supports multi-touch, and is convenient for user operation. Camera: The camera is located behind the display screen of the shopping cart. A camera is installed in a fixed direction (usually in front or in the shopping basket) to ensure the stability of the camera's viewing angle. The camera is used to capture product images and cooperate with AI to identify products and display AR content. The power module is installed at the bottom or frame of the shopping cart. It is equipped with a large-capacity lithium battery to support long-term use and power components such as the Bluetooth positioning module, display screen, and camera. It supports wireless charging or replaceable battery design. Software improvement: Specifically including: The software structure of the shopping cart needs to be seamlessly integrated with the supermarket's backend system and AR content management platform, including: Positioning and navigation module: The function of the positioning and navigation module is to receive the location information transmitted by the Bluetooth positioning module to achieve real-time positioning and path navigation of the shopping cart. Display: Display the location and navigation information of the shopping cart on the screen in real time to guide users to the target area or product. AR content management module: Function: Manage and display AR marketing activity content, including 3D models, animations, videos, etc.; Display: When the shopping cart reaches a specific area, it automatically triggers the corresponding AR content to be presented on the display screen. Product recognition module: Function: Capture product images through the camera, use AI technology to identify products, and associate corresponding AR content; Display: Display the 3D animation, description and recommendation information of the product on the screen, and users can interact through the touch screen. User interaction module: Function: Support users to perform touch operations on the screen, participate in AR interactive games and view product information. Display: Provide a smooth user interface and interactive experience to increase user participation and shopping fun.When the user is shopping, the user is asked to use the above shopping cart to shop. The specific usage is as follows: the user's location is determined by the positioning module. When the user enters a specific area (such as a promotion area or a new product display area), the Bluetooth positioning module will detect the location change and trigger the corresponding AR marketing activities through the background system. AR content related to the current area will automatically pop up on the display screen, such as new product introductions, promotional information or brand stories. The camera module can capture the goods in the shopping cart basket and identify the goods. When the customer puts the goods into the shopping cart, a relevant prompt will pop up on the display. When the customer clicks on the relevant goods on the display, the AR interactive function can be triggered. For example, when the user walks to the chocolate shelf area, the positioning module and the pre-set electronic fence will trigger a prompt message to remind the user that there is a promotion activity for the nearby goods. When the user selects a chocolate and puts it in the shopping cart, or puts the chocolate in a position that the camera can capture, the system can automatically identify the category of the chocolate and pop up relevant prompt information. When the user clicks on the prompt information, the AR activity process can be triggered, and the captured shopping basket picture and the animation rendered by the system are superimposed on each other to form an AR dynamic effect displayed on the display module. The AR dynamic effect specifically includes the 3D model, detailed information, dynamic effect or promotional game of the product. Users can participate in AR interactive games and obtain coupons or rewards by completing tasks, which increases the fun and participation of shopping.
[0053] In summary, the present application provides a marketing activity promotion method based on AR, which improves the existing shopping cart and locates the shopping cart. When the shopping cart arrives at a specific area of the supermarket, it guides the user to participate in related activities. The user does not need to use his or her own device to participate in the marketing activities. This solves the problem of existing AR shopping experience technology in terms of interaction complexity, can increase the user's enthusiasm for participating in activities, and lower the participation threshold.
[0054] In one embodiment, in response to the user's product selection signal input, the display module displays the marketing activity information of the product corresponding to the product selection signal, specifically including: judging the product category selected by the user based on the touch signal generated by the user clicking the display module; and displaying the marketing activity information corresponding to the product on the display module based on the product category.
[0055] In the process of obtaining the display information of the product, since there may be multiple products in the shopping cart, the picture captured by the camera module usually contains multiple products. Therefore, it is difficult to directly determine which product the user wants to know the marketing information of. Therefore, the user needs to manually select the corresponding product. On the one hand, the user can click on the corresponding product on the display to understand the relevant information, or pick up one of the products and bring it close to the camera so that the image of the product occupies most of the camera screen, so that the software automatically identifies the product and displays the information of the product.
[0056] In one embodiment, the touch signal generated based on the user clicking the display module corresponds to judging the product category selected by the user, specifically including: identifying the shopping basket screen to obtain all product information on the shopping basket screen; the product information includes product category and product coordinates; based on the touch coordinates of the touch signal, determining the product coordinates overlapping with the touch coordinates, and using the product category corresponding to the product coordinates as the product category selected by the user.
[0057] In actual use, the category of the product in the picture can be obtained by using a pre-trained target detection neural network model. The target detection neural network model can detect the location and category of the product in the picture, and by calculating which product the user clicks on and the location of the product overlaps, it can determine the product that the user wants to click. This method can accurately identify the products that the user wants to know about, and improve the accuracy of marketing activity recommendations.
[0058] In one embodiment, the shopping basket screen is identified to obtain all product information on the shopping basket screen; the product information includes product categories and product coordinates, specifically including: using a target detection model to identify all products on the shopping basket screen, generating a target frame and classification results; determining the product category based on the classification results; determining the product coordinates based on the coordinates and size of the target frame. In this application, the target detection model uses the YOLO model. By training the target detection model, the target detection model can recognize the products on the photo, and determine the category of each product based on the training set, and determine the product category based on the final classification results. The model will also output the target frame coordinates,
[0059]
[0060] Where N represents the number of detected products; c i represents the category of the i-th commodity; (x i1 ,y i1 ,x i2 ,y i2 ) represents the target frame coordinates of the i-th product, where (x i1,y i1 ) is the coordinate of the upper left corner, (x i2 ,y i2 ) is the coordinate of the lower right corner; s i Represents the confidence score of the i-th item.
[0061] Furthermore, the present application also provides a model training process, which specifically includes:
[0062] Data collection and labeling: Collect a dataset of shelf photos containing different categories of goods. Use the Labelbox tool to label the dataset, select a target box for each product and mark the category. Data preprocessing: Preprocess the images, including scaling and normalization. Perform data enhancement to improve the robustness of the model, including rotation, cropping, and color adjustment. Model selection and training: Use the labeled dataset to train the YOLO model to ensure that the YOLO model can recognize and locate goods of different categories. Model optimization: Adjust the hyperparameters of the YOLO model, learning rate, and batch size to obtain the best performance. Use the validation set to evaluate the model performance and optimize it based on the evaluation results. Model deployment: Deploy the trained model on the server or edge device, and choose the appropriate deployment method based on the actual application requirements. Write the inference code, load the trained model, and perform product recognition and target box drawing on the input shelf photos. Output product coordinates: Parse the output results of the model to obtain the category and target box coordinates of each product. Output the recognition results in JSON format or other suitable data formats, including product category and target box coordinates.
[0063] In one embodiment, the touch coordinates based on the touch signal determine the coordinates of the product overlapping with the touch coordinates, and use the product category corresponding to the product coordinates as the product category selected by the user, specifically including: determining whether the touch coordinates are located inside any target frame, and if so, determining that the product category corresponding to the target frame where the touch coordinates are located is the product category selected by the user. Specifically, when a user selects a product through a touch display device, it is necessary to determine the information of the product selected by the user. The area touched by the user can be identified and determined, and then the product selected by the user can be determined based on the user's touch coordinates and the overlapping relationship with the target frame. Then, according to the product selected by the user, relevant marketing information is displayed accordingly. The marketing information can include product display animations and product information introductions.
[0064] In one embodiment, the marketing activity information corresponding to the commodity is displayed on the display module based on the commodity category, specifically including: based on the commodity category and the commodity coordinates, displaying a pre-set display screen on the display module; based on the coordinates and size of the target frame, adjusting the size and position of the display screen so that the display screen overlaps the commodity.
[0065] The specific steps include:
[0066] Object detection and tracking: Use computer vision technology to detect and track target objects (such as Oreo cookies) in real time. Object detection and tracking: Use object detection algorithms (such as YOLO, SSD, Faster R-CNN) to detect target objects in real time and obtain the bounding box coordinates of the target objects.
[0067]
[0068] Where N represents the number of detected products; c i represents the category of the i-th commodity; (x i1 ,y i1 ,x i2 ,y i2 ) represents the target frame coordinates of the i-th product, where (x i1 ,y i1 ) is the coordinate of the upper left corner, (x i2 ,y i2 ) is the coordinate of the lower right corner; s i Represents the confidence score of the i-th item.
[0069] 3D model rendering: Use computer graphics technology to render 3D animations (such as jumping figures) on the target object. First, you need to load the 3D model and set its initial position, posture and animation.
[0070] 3D Model={Vertices,Faces,Texture,Animation}
[0071] Among them, Vertices represents the vertices of the 3D model; Faces represents the faces of the 3D model; Texture represents the texture of the 3D model; Animation represents the animation parameters of the 3D model;
[0072] Coordinate conversion: Convert the 2D image coordinates captured by the camera into 3D space coordinates to correctly position the 3D animation. In this application, homogeneous coordinates are used to represent 2D and 3D coordinates.
[0073] 2D Coordinates = (x, y);
[0074] 3D Coordinates = (X, Y, Z, 1);
[0075] The camera's intrinsic parameter matrix K and extrinsic parameter matrix (R|t) are used to convert 3D coordinates into 2D coordinates:
[0076]
[0077] (R|t) = (R t);
[0078] The 2D image coordinates can be calculated from the 3D space coordinates using the following formula:
[0079]
[0080] Real-time display: Use computer graphics libraries (such as OpenGL, DirectX, Unity3D) to render 3D models on the target object and display the image in real time.
[0081] In one embodiment, the promotion method further comprises: after the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, providing preferential information of the corresponding commodity.
[0082] After users participate in marketing activities, relevant discount information can be provided to users to increase their interest in participating in related marketing activities.
[0083] Embodiment 2
[0084] See also Figure 2 , a marketing activity promotion device based on AR, the marketing activity promotion device based on AR comprising:
[0085] An activity area determination unit 1, the activity area determination unit 1 is used to determine the user's position based on the positioning module, and use the camera module to capture a shopping basket image when the user reaches a predetermined activity area;
[0086] A screen display unit 2, wherein the screen display unit 2 is used for displaying the shopping cart screen on the display module;
[0087] The activity information display unit 3 is used to respond to the commodity selection signal input by the user, and the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal.
[0088] For the specific definition of the AR-based marketing activity promotion device, please refer to the definition of the AR-based marketing activity promotion method above, which will not be repeated here. Each module in the above-mentioned AR-based marketing activity promotion device can be implemented in whole or in part through software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0089] Those skilled in the art will understand that Figure 2 The structure shown in the figure is only a block diagram of a part of the structure related to the present application scheme, and does not constitute a limitation of the present application scheme. The specific AR-based marketing activity promotion device may include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.
[0090] Embodiment 3
[0091] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the AR-based marketing activity promotion method as described in Example 1.
[0092] Embodiment 4
[0093] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 3 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. When the computer program is executed by the processor, a marketing activity promotion method based on AR is implemented.
[0094] Those skilled in the art will understand that Figure 3 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0095] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the following steps when executing the computer program: including: applying to a smart shopping cart, wherein the smart shopping cart is provided with a positioning module, a display module, and a camera module; the promotion method includes:
[0096] Determine the user's location based on the positioning module, and use the camera module to capture a shopping basket image when the user reaches a predetermined activity area;
[0097] Using the display module to display the shopping basket screen;
[0098] In response to a commodity selection signal input by a user, the display module displays marketing activity information of the commodity corresponding to the commodity selection signal.
[0099] In one embodiment, in response to the user's commodity selection signal input, the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, specifically including:
[0100] Based on the touch signal generated by the user clicking the display module, the category of the commodity selected by the user is correspondingly determined;
[0101] Based on the commodity category, marketing activity information corresponding to the commodity is displayed on the display module.
[0102] In one embodiment, the touch signal generated by the user clicking the display module corresponds to determining the category of the product selected by the user, specifically including:
[0103] Identify the shopping cart screen and obtain all product information on the shopping cart screen; the product information includes product category and product coordinates;
[0104] Based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping with the touch coordinates are determined, and the commodity category corresponding to the commodity coordinates is used as the commodity category selected by the user.
[0105] In one embodiment, the shopping cart screen is identified to obtain all product information on the shopping cart screen; the product information includes product categories and product coordinates, specifically including:
[0106] Use the target detection model to identify all products on the shopping cart screen, generate target boxes and classification results;
[0107] Determine the product category based on the classification result;
[0108] The coordinates of the product are determined based on the coordinates and size of the target frame.
[0109] In one embodiment, the determining, based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping the touch coordinates, and using the commodity category corresponding to the commodity coordinates as the commodity category selected by the user, specifically includes:
[0110] It is determined whether the touch coordinates are located inside any target frame, and if so, it is determined that the commodity category corresponding to the target frame where the touch coordinates are located is the commodity category selected by the user.
[0111] In one embodiment, displaying marketing activity information corresponding to the commodity on the display module based on the commodity category specifically includes:
[0112] Based on the commodity category and commodity coordinates, displaying a preset display screen on the display module;
[0113] Based on the coordinates and size of the target frame, the size and position of the display screen are adjusted so that the display screen overlaps the product.
[0114] In one embodiment, the promotion method further comprises:
[0115] After the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, the preferential information of the corresponding commodity is provided.
[0116] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0117] Embodiment 5
[0118] Furthermore, the present application also provides an interactive method between an AR screen and a user, as follows: in the snack area, the user can hold the front of the Oreo product facing the camera. When the camera recognizes the image of the front of the Oreo, through the image recognition and tracking capabilities of ar.js, an Oreo model will be superimposed on the Oreo box under the camera. At this time, the user can tear open the Oreo box (this is an automatically played model animation) and see an Oreo dancing inside the box. After the dance, Oreo gives out a coupon, indicating that the coupon has been successfully received.
[0119] In the seafood area, users see that the shopping cart under the camera turns into an ocean with various fish swimming in it. There is a fishing button on the right. Users can fish the fish by continuously clicking it. The fish caught this time is tilapia. Tilapia-related cooking methods and dish recommendations appear on the interface, and there may even be a coupon redemption button. Users can collect coupons and click on the dish navigation for navigation.
[0120] In the fresh food area, users see a pig model on a tablet. They can swipe left and right to see the pig in different directions. By clicking on a part of the pig, dishes that can be made from the meat in that part will appear, as well as dish recommendations. Users can click on the dish navigation to navigate to the product location.
[0121] Embodiment 6
[0122] In addition to shopping carts, supermarket spaces can also be combined with users' personal mobile phones to provide an immersive experience.
[0123] The main steps are as follows:
[0124] S1. Use a professional camera to record and collect spatial data; S2. Analyze the video through algorithms and build a digital model; S3. Import the digital model of the space through 3D production tools; S4. Place the interactive model in the specific space; S5. Realize the interaction of the interactive model; S6. Package the scene into the APP; S7. When the user uses the APP to recognize that he is in the space, the interactive model will be displayed; S8. After the user completes the interactive action of the interactive model, coupons and other rewards will be issued.
[0125] An example is as follows: When a user sees a stand with an NFC interactive tag or a QR code in a supermarket, the user can directly use the NFC tag to access the relevant APP link, or use the device to scan the QR code to access the relevant link, and then open the AR exploration activity. After scanning the surrounding environment, an AR scene will appear. For example, a cute kitten will appear on the ground, and the interface will prompt that approaching it can trigger the cat-stroking action. After completing the action, the system will issue a coupon.
[0126] The present invention is a method for applying AR immersive shopping experience in supermarkets, which brings many beneficial effects compared with the previous technologies, including:
[0127] Improve shopping experience: By deploying Bluetooth positioning devices in supermarkets, shopping carts can obtain their current location in real time, and users can receive AR marketing activity reminders in specific areas according to platform configuration, making users feel immersive in the digital space and enhancing the fun and interactivity of shopping.
[0128] Promote interaction and social interaction: Introduce AR interactive games, combine AI to identify products and start AR games, so that users can participate in fun and realistic games during the shopping process, improve users' sense of participation and social experience, and enhance the interactive relationship between customers and supermarkets.
[0129] Improve sales conversion rate: Through AR marketing activity reminders, guide users to browse products in specific areas and stimulate their desire to buy, thereby improving sales conversion rate and increasing supermarket sales revenue.
[0130] Promote product sales: In the AR scene layout, simulate the shopping cart basket to create a scene to increase the exposure and attractiveness of the products, thereby promoting product sales.
[0131] Real-time positioning and reminders: By deploying Bluetooth positioning devices, the shopping cart can obtain the current location in real time and remind users of AR marketing activities in specific areas according to the platform configuration, realizing the functions of real-time positioning and reminders.
[0132] AI product identification: Combining AI technology to achieve product identification and start AR interactive games, presenting users with fun and real game experiences related to the products.
[0133] Reasoning explanation: This technical solution can solve the problems faced by existing technologies in supermarket shopping experience. First, through Bluetooth positioning devices, or through other positioning methods, such as electronic fences, ZIGBEE communication technology or WIFI positioning technology, the real-time positioning of the shopping cart can be achieved, which can effectively remind users of AR marketing activities in specific areas, solving the problem of limited shopping scenarios in existing AR shopping experience technologies. Secondly, through AI identification of products and combining with AR interactive games, product packaging is used as a carrier of AR content to guide users to participate in the interaction in the game, solving the problem of the lack of personalized recommendations and user participation in existing AR shopping experience technologies. In addition, the design of AR scenes simulates shopping-related environments, allowing users to feel that the content seen on the screen is superimposed on the real physical world, solving the problem of interaction complexity in existing AR shopping experience technologies.
[0134] In summary, the method of the present invention applied to supermarket AR immersive shopping experience brings many beneficial effects compared with previous technologies, improves the shopping experience from social, economic and technical levels, increases sales revenue, realizes technical effects such as real-time positioning and reminders, AI recognition of goods, and effectively solves the problems existing in the prior art.
[0135] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0136] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.
Claims
1. A marketing activity promotion method based on AR, characterized in that: Applied to a smart shopping cart, the smart shopping cart is provided with a positioning module, a display module and a camera module; the promotion method comprises: Determine the user's location based on the positioning module, and use the camera module to capture a shopping basket image when the user reaches a predetermined activity area; Using the display module to display the shopping basket screen; In response to a commodity selection signal input by a user, the display module displays marketing activity information of the commodity corresponding to the commodity selection signal.
2. The marketing activity promotion method based on AR according to claim 1, characterized in that: In response to the user's commodity selection signal input, the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, specifically including: Based on the touch signal generated by the user clicking the display module, the category of the commodity selected by the user is correspondingly determined; Based on the commodity category, marketing activity information corresponding to the commodity is displayed on the display module.
3. The marketing activity promotion method based on AR according to claim 2, characterized in that: The touch signal generated by the user clicking the display module corresponds to determining the category of the product selected by the user, specifically including: Identify the shopping cart screen and obtain all product information on the shopping cart screen; the product information includes product category and product coordinates; Based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping with the touch coordinates are determined, and the commodity category corresponding to the commodity coordinates is used as the commodity category selected by the user.
4. The marketing activity promotion method based on AR according to claim 3, characterized in that: The shopping cart screen is identified to obtain all product information on the shopping cart screen; The product information includes product category and product coordinates, specifically including: Use the target detection model to identify all products on the shopping cart screen, generate target boxes and classification results; Determine the product category based on the classification result; The coordinates of the product are determined based on the coordinates and size of the target frame.
5. The marketing activity promotion method based on AR according to claim 4, characterized in that: The determining, based on the touch coordinates of the touch signal, the coordinates of the commodity overlapping the touch coordinates, and using the commodity category corresponding to the commodity coordinates as the commodity category selected by the user, specifically includes: It is determined whether the touch coordinates are located inside any target frame, and if so, it is determined that the commodity category corresponding to the target frame where the touch coordinates are located is the commodity category selected by the user.
6. The AR-based marketing promotion method according to claim 5, characterized in that: The step of displaying marketing activity information corresponding to the commodity on the display module based on the commodity category specifically includes: Based on the commodity category and commodity coordinates, displaying a preset display screen on the display module; Based on the coordinates and size of the target frame, the size and position of the display screen are adjusted so that the display screen overlaps the product.
7. The AR-based marketing promotion method according to claim 1, characterized in that: The promotion method also includes: After the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal, the preferential information of the corresponding commodity is provided.
8. A marketing activity promotion device based on AR, characterized in that: The AR-based marketing activity promotion device includes: an activity area determination unit, the activity area determination unit being used to determine the user's location based on the positioning module, and to use the camera module to capture a shopping basket image when the user reaches a predetermined activity area; A screen display unit, wherein the screen display unit is used by the display module to display the shopping cart screen; The activity information display unit is used to respond to the commodity selection signal input by the user, and the display module displays the marketing activity information of the commodity corresponding to the commodity selection signal.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the AR-based marketing activity promotion method as described in any one of claims 1 to 7 is implemented.
10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the AR-based marketing activity promotion method as described in any one of claims 1 to 7 is implemented.
