Offline shopping guide and online shopping system based on MR / AR / VR mixed reality

Abstract

The invention discloses an offline shopping guide and online shopping system based on MR / AR / VR mixed reality, and the system comprises a configuration module which is used for deploying an AR identifier in an offline store and providing mobile phone AR equipment, VR equipment and MR equipment for consumers; the interaction module comprises a virtual shopping guide unit and an instant purchase unit; the virtual shopping guide unit is used for pushing explanation animation and disassembly demonstration of the 3D commodity model to consumers through the MR equipment and the VR equipment; the instant purchase unit is used for responding to a touch instruction of a consumer on the AR equipment or the MR equipment and skipping to the VR equipment or the MR equipment to display commodities; the data interconnection module is used for synchronously displaying the online inventory information of the commodities in the MR equipment and the VR equipment, and is linked with the platform database in real time; and the authority management module is used for distributing the operation authority of the shop assistant and the consumer to the MR equipment. According to the invention, a complete closed loop from scene experience to order transaction is realized, and retail service efficiency, user experience and commercial conversion rate are improved.

Description

Technical Field

[0001] The present invention relates to the field of e-commerce technology, and in particular to an offline shopping guide and online shopping system based on MR / AR / VR mixed reality. Background Art

[0002] With the deep integration of internet technology and immersive interactive technologies, the retail industry is undergoing a transformation from a traditional model to a digital and intelligent one. The maturity of augmented reality (AR), virtual reality (VR), and mixed reality (MR) technologies has injected new vitality into offline retail. Consumers' demand for a shopping experience has evolved from a simple commodity transaction to a full-process interaction encompassing immersive experiences, personalized services, and data integration. In this context, integrating AR / VR / MR mixed reality technologies with offline shopping guides and online shopping systems has become a key direction for enhancing the competitiveness of the retail industry. By deploying intelligent interactive devices in physical stores and building an integrated online and offline shopping ecosystem, this approach preserves the authentic touch and instant experience of offline shopping while leveraging the data integration and convenient transaction advantages of online platforms. This provides consumers with a new shopping model that "blends the virtual and the real," driving the retail industry towards efficiency and intelligence.

[0003] However, existing retail shopping systems still have significant flaws. Traditional offline shopping guides rely on verbal explanations and physical demonstrations by store staff. Limited by spatial dimensions and information carrying capacity, they struggle to fully present product structural principles, functional details, and usage scenarios. Furthermore, service quality varies significantly depending on staff skill level, failing to meet consumers' demand for in-depth understanding of complex products (such as consumer electronics and home building materials). While online shopping can provide rich information through images, text, and videos, it lacks physical interaction and spatial perception, making it difficult for consumers to intuitively assess physical attributes such as product size and material. This leads to prolonged purchase decision cycles and high return and exchange rates. Furthermore, significant data barriers exist between online and offline scenarios: When offline shelves are out of stock, online inventory information cannot be synchronized in real time, leading to customer churn. Consumer behavioral data (such as browsing preferences and interaction habits) is not effectively integrated, making it difficult to implement targeted marketing and personalized recommendations. Existing AR / VR applications are mostly single-function modules (such as standalone VR displays or AR try-ons). They lack a complete closed loop from "shopping guide-experience-purchase-after-sales service." This fragmented interaction process prevents the full synergy of mixed reality technology, hindering the digital upgrade of retail scenarios. Summary of the Invention

[0004] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract and title of this application to avoid obscuring the purpose of this section, the abstract and the title of the invention, and such simplifications or omissions should not be used to limit the scope of the present invention.

[0005] In light of the above-mentioned existing problems, the present invention proposes an offline shopping guide and online shopping system based on MR / AR / VR mixed reality to solve the problems of incomplete offline shopping guide information display, insufficient online shopping experience, disconnected online and offline scenarios, and inefficient data linkage.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0007] In a first aspect, the present invention provides an offline shopping guide and online shopping system based on MR / AR / VR mixed reality, comprising:

[0008] A configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices, and MR devices; the MR devices are touch-enabled interactive terminals that communicate with the platform database;

[0009] The interactive module includes a virtual shopping guide unit and an instant purchase unit; the virtual shopping guide unit is used to push explanation animations and disassembly demonstrations of 3D product models to consumers through the MR device or VR device; the instant purchase unit is used to respond to touch commands of consumers on the AR device or MR device, jump to the VR device or MR device to display the product, and receive voice or touch commands to complete shopping cart addition and order placement operations;

[0010] The data interconnection module is used to synchronously display the online inventory information of goods in MR devices and VR devices, and to interact with the platform database in real time.

[0011] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, it also includes:

[0012] The permission management module is used to assign store staff and consumers the right to operate MR devices, including the right to edit 3D manuals, push explanation animations, and query product information;

[0013] The authority management module verifies the identity of the store clerk through biometric identification and authorizes the clerk to execute advanced operation instructions through the MR device.

[0014] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, the configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices and MR devices, including:

[0015] The configuration module includes an AR identification deployment unit and a device pairing unit;

[0016] AR identification deployment unit, used to set QR code identification on the surface of products and deploy UWB positioning beacons in stores to locate the real-time location of consumers and MR devices;

[0017] The device pairing unit is used to connect mobile AR devices, VR devices, and MR devices to the store server via Bluetooth or Wi-Fi to synchronize user accounts and platform data.

[0018] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, the interactive module includes:

[0019] The virtual shopping guide unit generates interactive 3D models based on the product CAD data and receives editing instructions from the store clerk through the touch interface of the MR device;

[0020] The instant purchase unit supports multimodal interaction, including touch commands, voice commands and eye tracking of MR devices, and analyzes shopping intentions through a natural language processing engine.

[0021] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, the virtual shopping guide unit is used to push the explanation animation and disassembly demonstration of the 3D product model to consumers through the MR device and VR device, including:

[0022] Consumers scan the product QR code with their mobile AR device, triggering the MR or VR device to display the 3D instruction manual;

[0023] The clerk sends animation control instructions to the consumer's VR device or MR device through the touch interface or gesture recognition of the MR device.

[0024] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, the instant purchase unit is used to respond to the consumer's touch command on the AR device or MR device, jump to the VR device or MR device to display the product, and receive voice or touch commands to complete the shopping cart addition and order placement operations, including:

[0025] Consumers click the "Virtual Experience" button on the MR device touch interface, triggering the scene to switch to the product display interface of the VR device or MR device, showing multi-angle views and function animations;

[0026] The system extracts product identifiers and quantity information through touch input or voice commands of the MR device, and synchronizes them to the platform database to complete the order.

[0027] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality described in the present invention, the data interconnection module includes an inventory monitoring unit, an information synchronization unit, a data analysis unit and a purchase prediction unit;

[0028] The inventory monitoring unit detects offline inventory through shelf sensors and displays online inventory reminders through MR devices when the inventory falls below the threshold;

[0029] The information synchronization unit generates a semi-transparent inventory layer in MR and VR devices, displaying online inventory quantity and delivery time information, and synchronizes with the e-commerce server in real time;

[0030] Data analysis unit, which collects consumer interaction data in AR / VR / MR devices;

[0031] The purchase prediction unit generates personalized recommendations based on interaction data, pushes product lists through the touch interface of the MR device or VR scene, and links the real-time price and inventory of the platform database.

[0032] As a preferred solution of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality of the present invention, the data analysis unit includes:

[0033] The data analysis unit constructs a multi-dimensional user experience model based on the consumer's interaction data in the MR / AR / VR device and the environmental data collected by the environmental perception module integrated in the MR device;

[0034] By using machine learning algorithms to analyze the correlation between different environmental parameters and user interaction behaviors, the display order of products on the MR device touch interface is dynamically adjusted according to the depth of user interaction with the product model, high-profile products are displayed at the top, and their touch hot zone area is expanded in the interface layout.

[0035] In a second aspect, the present invention provides a computing device, comprising:

[0036] memory and processor;

[0037] The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality are implemented.

[0038] In a third aspect, the present invention provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality.

[0039] Compared with the existing technology, the beneficial effects of the present invention are as follows: by integrating AR / VR / MR mixed reality technology, offline shopping guides and online shopping are deeply integrated, and MR devices, AR devices and VR devices are used to realize product 3D model display, disassembly animation demonstration and multimodal interaction (voice, touch, eye movement instructions), which solves the problems of single information transmission and insufficient online experience of traditional shopping guides; through UWB positioning beacons, inventory monitoring units and information synchronization units, offline location tracking and online and offline inventory data are linked in real time to break the scene separation; with the help of data analysis units and purchase prediction units, personalized recommendations are generated based on consumer interaction data, the display logic and interface layout are optimized, and the efficiency of shopping decisions is improved. In addition, the authority management module realizes the classification of operation permissions through biometric recognition to ensure system security. The overall solution builds a complete closed loop from scene experience to order transaction, improves retail service efficiency, user experience and business conversion rate, and provides an innovative technical solution for the digital upgrade of the industry. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be derived from these drawings without inventive effort. Among them:

[0041] Figure 1 This is a schematic diagram of an offline shopping guide and online shopping system based on MR / AR / VR mixed reality according to an embodiment of the present invention. DETAILED DESCRIPTION

[0042] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the following detailed description of the specific embodiments of the present invention is given in conjunction with the accompanying drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in this field without creative work should fall within the scope of protection of the present invention.

[0043] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0044] Secondly, the term "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in various places throughout this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive of other embodiments.

[0045] The present invention is described in detail with reference to schematic diagrams. For ease of illustration, cross-sectional views of device structures may be partially enlarged and not to scale when describing embodiments of the present invention. Furthermore, the schematic diagrams are merely illustrative and should not limit the scope of the present invention. Furthermore, in actual production, the three-dimensional dimensions of length, width, and depth should be included.

[0046] Furthermore, in the description of the present invention, it should be noted that the terms "upper, lower, inner, and outer" and other references to orientations or positional relationships are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate and simplify the description of the present invention. They are not intended to indicate or imply that the systems or components referred to must have, be constructed, or operate in a specific orientation, and therefore should not be construed as limitations on the present invention. Furthermore, the terms "first, second, or third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0047] In this disclosure, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be interpreted broadly. For example, they may refer to fixed, removable, or integral connections. They may also refer to mechanical, electrical, or direct connections, indirect connections through an intermediary, or internal communication between two components. Those skilled in the art will understand the specific meanings of these terms in this disclosure.

[0048] Example 1

[0049] Reference Figure 1 , which is an embodiment of the present invention, provides an offline shopping guide and online shopping system based on MR / AR / VR mixed reality, including:

[0050] A configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices, and MR devices; the MR devices are touch-enabled interactive terminals that communicate with the platform database;

[0051] The interactive module includes a virtual shopping guide unit and an instant purchase unit; the virtual shopping guide unit is used to push explanation animations and disassembly demonstrations of 3D product models to consumers through the MR device or VR device; the instant purchase unit is used to respond to touch commands of consumers on the AR device or MR device, jump to the VR device or MR device to display the product, and receive voice or touch commands to complete shopping cart addition and order placement operations;

[0052] The data interconnection module is used to synchronously display the online inventory information of products on MR devices and VR devices, and to connect with the platform database in real time;

[0053] The permission management module is used to assign store staff and consumers the operating permissions of MR devices, including the permission to edit 3D manuals, push explanation animations, and query product information.

[0054] Preferably, the configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices, and MR devices, including:

[0055] The configuration module includes an AR identification deployment unit and a device pairing unit;

[0056] AR identification deployment unit, used to set QR code identification on the surface of products and deploy UWB positioning beacons in stores to locate the real-time location of consumers and MR devices;

[0057] The device pairing unit is used to connect mobile AR devices, VR devices, and MR devices to the store server via Bluetooth or Wi-Fi to synchronize user accounts and platform data.

[0058] Preferably, the interaction module includes:

[0059] The virtual shopping guide unit generates interactive 3D models based on the product CAD data and receives editing instructions from the store clerk through the touch interface of the MR device;

[0060] The instant purchase unit supports multimodal interaction, including touch commands, voice commands and eye tracking of MR devices, and analyzes shopping intentions through a natural language processing engine.

[0061] Specifically, the virtual shopping guide unit uses a lightweight 3D modeling engine to convert product CAD data into interactive low-polygon models. This allows store associates to edit these models in real time on the MR device's touch interface, allowing them to drag parts to mark functional areas, adjust animation speeds, and add text annotations. These edits are then synchronized to all consumers' VR or AR devices. The instant purchase unit integrates multimodal interaction sensors. The MR device's capacitive touch interface supports ten-point touch, recognizing gestures such as swipe, zoom, and long press. Voice commands are captured using far-field voice recognition technology and combined with a natural language processing engine to parse key information such as product name, specifications, and quantity (e.g., "Add the top-of-the-line red model to your cart"). The eye tracking module uses an infrared camera to track the consumer's gaze in real time. If the gaze remains on a product model for more than three seconds, the display automatically zooms in and the price tag pops up, enabling contactless "gaze-to-select" interaction. The three interaction modes are mutually redundant, allowing consumers to flexibly choose according to their needs, such as prioritizing touch control in noisy environments or using voice commands when holding items with both hands, improving interaction efficiency and convenience.

[0062] Preferably, the virtual shopping guide unit is used to push the explanation animation and disassembly demonstration of the 3D product model to consumers through the MR device or VR device, including:

[0063] Consumers scan the product QR code with their mobile AR device, triggering the MR or VR device to display the 3D instruction manual;

[0064] The clerk sends animation control instructions to the consumer's VR device or MR device through the touch interface or gesture recognition of the MR device.

[0065] Preferably, the instant purchase unit is used to respond to the consumer's touch command on the AR device or MR device, jump to the VR device or MR device to display the product, and receive voice or touch commands to complete the shopping cart addition and ordering operations, including:

[0066] Consumers click the "Virtual Experience" button on the MR device touch interface, triggering the scene to switch to the product display interface of the VR device or MR device, showing multi-angle views and function animations;

[0067] The system extracts product identifiers and quantity information through touch input or voice commands of the MR device, and synchronizes them to the platform database to complete the order.

[0068] Preferably, the data interconnection module includes an inventory monitoring unit, an information synchronization unit, a data analysis unit and a purchase forecasting unit;

[0069] The inventory monitoring unit detects offline inventory through shelf sensors and displays online inventory reminders through MR devices when the inventory falls below the threshold;

[0070] The information synchronization unit generates a semi-transparent inventory layer in MR and VR devices, displaying information such as online inventory quantity and delivery time, and synchronizes with the e-commerce server in real time;

[0071] Data analysis unit, which collects consumer interaction data in AR / VR / MR devices;

[0072] The purchase prediction unit generates personalized recommendations based on interaction data, pushes product lists through the touch interface of the MR device or VR scene, and links the real-time price and inventory of the platform database.

[0073] Furthermore, the data analysis unit includes:

[0074] The data analysis unit constructs a multi-dimensional user experience model based on the consumer's interaction data in the MR / AR / VR device and the environmental data collected by the environmental perception module integrated in the MR device;

[0075] By using machine learning algorithms to analyze the correlation between different environmental parameters and user interaction behaviors, the display order of products on the MR device touch interface is dynamically adjusted according to the depth of user interaction with the product model, high-profile products are displayed at the top, and their touch hot zone area is expanded in the interface layout.

[0076] Preferably, the authority management module verifies the identity of the store clerk through biometric identification and authorizes the clerk to execute advanced operation instructions through the MR device;

[0077] Specifically, the permissions management module incorporates a high-precision facial recognition algorithm. It uses the MR device's camera to collect facial features, texture features, and other biometric data from store employees, comparing it to pre-stored authorization information. It also supports liveness detection (such as blinking and head rotation recognition) to prevent counterfeit attacks. After verification, the system assigns corresponding operational permissions based on the employee's role level (e.g., general salesperson, senior salesperson, or administrator). General salespersons can only view 3D manuals and push pre-set explanation animations to customers through the MR device. Senior salespersons also have simple editing permissions, allowing them to adjust the 3D model's display angle and highlight key functional areas on the MR device's touch interface. Administrators have full access, including the ability to modify product information, review and publish customized explanation animations, and monitor the operation logs of all MR devices. When a store employee performs advanced operations (such as editing a 3D manual) through the MR device, the system automatically records the operation time, content, and account information, creating an unalterable audit trail to ensure compliance and data security. If an abnormal operation is detected (such as accessing across permissions or multiple consecutive verification failures), the MR device will automatically lock and send an alert to the store management.

[0078] It should be noted that by integrating AR / VR / MR mixed reality technology, offline shopping guides and online shopping are deeply integrated, and MR devices, AR devices and VR devices are used to display product 3D models, disassembly animation demonstrations and multimodal interactions (voice, touch, eye movement commands), solving the problems of traditional shopping guides with single information transmission and insufficient online experience; through UWB positioning beacons, inventory monitoring units and information synchronization units, offline location tracking and online and offline inventory data are linked in real time, breaking the scene separation; with the help of data analysis units and purchase prediction units, personalized recommendations are generated based on consumer interaction data, and the display logic and interface layout are optimized to improve shopping decision-making efficiency. In addition, the permission management module uses biometric recognition to achieve hierarchical operation permissions to ensure system security. The overall solution builds a complete closed loop from scene experience to order transaction, improving retail service efficiency, user experience and business conversion rate, and providing innovative technical solutions for the industry's digital upgrade.

[0079] For example, in a car 4S store, after entering the store, consumers can use their mobile AR devices to scan the QR code next to the real car to trigger the AR function. At this time, the car's appearance details, color change effects, personalized configuration options and other information are superimposed on the real vehicle in the form of a virtual model, and consumers can intuitively see the effects of different wheel styles and body color combinations. At the same time, the UWB positioning beacon deployed in the store tracks the consumer's location in real time, and the MR glasses worn by the store clerks simultaneously obtain this information. When the consumer stops at a certain model, the clerk can use the MR glasses to call up the corresponding vehicle's 3D manual, and push the vehicle's core parameters and special features to the consumer's mobile AR device or MR device through gesture operation. An animation explaining the vehicle's core parameters and special features.

[0080] If consumers want to gain a deeper understanding of how the engine works, they can click the "VR / MR Deep Experience" button on the AR interface or the MR device touch interface to switch to the VR device or MR device. In the VR / MR scene, the engine is presented as a fully disassembled dynamic model. Consumers can control the rotation and enlargement of the model through voice commands or MR device touch operations to observe detailed demonstrations of processes such as piston movement, fuel injection, and ignition. When consumers give the "add to cart" command through voice or complete the touch order operation on the MR device, the system automatically synchronizes the selected model configuration information to the online car purchase platform. If the model is not available in the offline showroom, the VR / MR scene will automatically highlight the online inventory quantity, estimated pick-up time and other information to guide consumers to complete the online reservation, achieving a seamless transition from offline experience to online purchase.

[0081] This embodiment further provides a computing device suitable for offline shopping guides and online shopping based on MR / AR / VR mixed reality, including:

[0082] Memory and processor; the memory is used to store computer-executable instructions, and the processor is used to execute computer-executable instructions to implement the offline shopping guide and online shopping system based on MR / AR / VR mixed reality as proposed in the above embodiment.

[0083] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, it implements the offline shopping guide and online shopping system based on MR / AR / VR mixed reality as proposed in the above embodiment.

[0084] The storage medium proposed in this embodiment and the offline shopping guide and online shopping system based on MR / AR / VR mixed reality proposed in the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0085] Through the above description of the implementation methods, those skilled in the art can clearly understand that the present invention can be implemented with the help of software and necessary general-purpose hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer's floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention.

[0086] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. Offline shopping guide and online shopping system based on MR / AR / VR mixed reality, characterized by: include: A configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices, and MR devices; the MR devices are touch-enabled interactive terminals that communicate with the platform database; The interactive module includes a virtual shopping guide unit and an instant purchase unit; the virtual shopping guide unit is used to push explanation animations and disassembly demonstrations of 3D product models to consumers through the MR device or VR device; the instant purchase unit is used to respond to touch commands of consumers on the AR device or MR device, jump to the VR device or MR device to display the product, and receive voice or touch commands to complete shopping cart addition and order placement operations; The data interconnection module is used to synchronously display the online inventory information of goods in MR devices and VR devices, and to interact with the platform database in real time.

2. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality as claimed in claim 1, characterized in that: Also includes: The permission management module is used to assign store staff and consumers the right to operate MR devices, including the right to edit 3D manuals, push explanation animations, and query product information; The authority management module verifies the identity of the store clerk through biometric identification and authorizes the clerk to execute advanced operation instructions through the MR device.

3. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality according to claim 1 or 2, characterized in that: The configuration module is used to deploy AR signs in offline stores and provide consumers with mobile AR devices, VR devices, and MR devices, including: The configuration module includes an AR identification deployment unit and a device pairing unit; AR identification deployment unit, used to set QR code identification on the surface of products and deploy UWB positioning beacons in stores to locate the real-time location of consumers and MR devices; The device pairing unit is used to connect mobile AR devices, VR devices, and MR devices to the store server via Bluetooth or Wi-Fi to synchronize user accounts and platform data.

4. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality as claimed in claim 3, characterized in that: Interaction modules include: The virtual shopping guide unit generates interactive 3D models based on the product CAD data and receives editing instructions from the store clerk through the touch interface of the MR device; The instant purchase unit supports multimodal interaction, including touch commands, voice commands and eye tracking of MR devices, and analyzes shopping intentions through a natural language processing engine.

5. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality as claimed in claim 4, characterized in that: The virtual shopping guide unit is used to push the explanation animation and disassembly demonstration of the 3D product model to consumers through the MR device and VR device, including: Consumers scan the product QR code with their mobile AR device, triggering the MR or VR device to display the 3D instruction manual; The clerk sends animation control instructions to the consumer's VR device or MR device through the touch interface or gesture recognition of the MR device.

6. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality according to claim 5, characterized in that: The instant purchase unit is used to respond to the consumer's touch commands on the AR or MR device, jump to the VR or MR device to display the product, and receive voice or touch commands to complete the shopping cart addition and ordering operations, including: When consumers click the "Virtual Experience" button on the MR device's touch screen, the scene switches to the product display interface of the VR or MR device, displaying multi-angle views and functional animations. The system extracts product identifiers and quantity information through touch input or voice commands of the MR device, and synchronizes them to the platform database to complete the order.

7. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality according to claim 6, characterized in that: The data interconnection module includes an inventory monitoring unit, an information synchronization unit, a data analysis unit, and a purchase forecasting unit; The inventory monitoring unit detects offline inventory through shelf sensors and displays online inventory reminders through MR devices when the inventory falls below the threshold; The information synchronization unit generates a semi-transparent inventory layer in MR and VR devices, displaying online inventory quantity and delivery time information, and synchronizes with the e-commerce server in real time; Data analysis unit, which collects consumer interaction data in AR / VR / MR devices; The purchase prediction unit generates personalized recommendations based on interaction data, pushes product lists through the touch interface of the MR device or VR scene, and links the real-time price and inventory of the platform database.

8. The offline shopping guide and online shopping system based on MR / AR / VR mixed reality according to claim 7, characterized in that: The data analysis unit includes: The data analysis unit constructs a multi-dimensional user experience model based on the consumer's interaction data in the MR / AR / VR device and the environmental data collected by the environmental perception module integrated in the MR device; By using machine learning algorithms to analyze the correlation between different environmental parameters and user interaction behaviors, the display order of products on the MR device touch interface is dynamically adjusted according to the depth of user interaction with the product model, high-profile products are displayed at the top, and their touch hot zone area is expanded in the interface layout.

9. An electronic device comprising: memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality as described in any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the offline shopping guide and online shopping system based on MR / AR / VR mixed reality as described in any one of claims 1 to 8.

Images