Multi-person offline interaction system and method based on MR spatial positioning with car-machine interaction

Abstract

The application relates to the technical field of mixed reality, in particular to a multi-person offline interaction system and method based on MR space positioning and kart interaction, wherein the multi-person offline interaction system based on MR space positioning and kart interaction comprises independent PCs, a plurality of MR integrated machines and a plurality of karts; the MR integrated machine is a head-mounted device, the MR integrated machine is configured with MR kart client software, and the MR kart client software is used for direct interaction with a user; the independent PC is configured with an interaction server, the interaction server is used for providing data exchange and synchronization services for the plurality of MR integrated machines in a local area network; the kart is installed with a control mainboard, the control mainboard is configured with a vehicle-machine control system, and the vehicle-machine control system is used for receiving instructions from the interaction server and the MR kart client software, so as to control the operation of the kart.

Description

Technical Field

[0001] This invention relates to the field of mixed reality technology, and in particular to a multi-person offline interactive system and method based on MR spatial positioning with vehicle-machine interaction. Background Technology

[0002] With the development of virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies, spatial positioning-based interaction methods have been widely used in entertainment, education, and many other fields. However, since most traditional virtual reality or augmented reality technologies focus their research on visual expression and immersive interaction, only a small portion combine augmented reality technology with traditional crafts.

[0003] Currently, the market lacks applications in areas such as augmented reality (MR) and multi-person interaction, as well as MR and hardware device interaction. Existing technologies lack effective integration between MR devices and go-kart equipment, resulting in limitations in user experience during multi-person offline interactions. Summary of the Invention

[0004] To address the problems mentioned in the background section, the present invention provides the following technical solution:

[0005] A multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction, comprising an independent PC, several MR all-in-one machines and several go-karts;

[0006] The MR all-in-one machine is a head-mounted display device, and the MR all-in-one machine is equipped with MR go-kart client software, which is used to interact directly with the user.

[0007] The independent PC is equipped with an interactive server, which is used to provide data exchange and synchronization services to several MR all-in-one machines in the local area network.

[0008] The go-kart is equipped with a control motherboard, which is configured with a vehicle control system. The vehicle control system is used to receive instructions from the interactive server and the MR go-kart client software, thereby controlling the operation of the go-kart.

[0009] In some embodiments, the system also includes off-site interactive software configured on a cloud server. This off-site interactive software is developed on mini-programs and apps to record users' play information and enable off-site users to interact with on-site users.

[0010] In some embodiments, at least one MR all-in-one device is also equipped with map editor software. The map editor software is used to edit and draw the augmented reality go-kart map using the positioning information of the MR all-in-one device, and import it into the interactive server of an independent PC in the form of a map file. The interactive server is also used to uniformly distribute the map file to each MR go-kart client software added to the interactive server, thereby synchronizing the overall map information.

[0011] In some embodiments, the MR all-in-one machine is a PICO or QUEST device; the MR go-kart client software is developed based on Unreal Engine and runs as a client on the MR all-in-one machine;

[0012] The MR go-kart client software and the interaction server establish a two-way communication architecture based on remote procedure calls, which enables the interaction server to synchronize map information and real-time events to each MR go-kart client software, and the MR go-kart client software to send local operations to the interaction server.

[0013] In some embodiments, the MR all-in-one machine is connected to the control motherboard of the go-kart via a Type-C-USB cable. The control motherboard is connected to the power system of the go-kart, and communication with the go-kart is achieved through the MR go-kart client software.

[0014] Based on USB HID hardware communication, the MR all-in-one machine can control the go-kart and at the same time feed back relevant information about the go-kart to the MR all-in-one machine.

[0015] In some embodiments, the go-kart's steering wheel is equipped with several buttons, each of which is directly connected to the go-kart's control motherboard. The buttons are used for real-time interactive triggering by the user and the triggering results are fed back to the MR all-in-one machine.

[0016] In some embodiments, when the system is in use, the absolute coordinates of the go-kart are calibrated by a 6DOF TRACKER locator fixed to the go-kart, and the relative coordinates of the user on the go-kart are marked by a 6DOF handle that comes with the MR all-in-one machine. Both the absolute coordinates and the relative coordinates are uploaded to the interactive server in real time.

[0017] Another aspect of the present invention provides a multi-person offline interaction method based on MR spatial positioning and vehicle-to-machine interaction, which adopts the above-mentioned multi-person offline interaction system based on MR spatial positioning and vehicle-to-machine interaction, and includes the following steps:

[0018] S1. Using map editor software, the augmented reality go-kart map is edited and drawn, and then imported into the interactive server of a standalone PC as a map file.

[0019] S2. The interactive server distributes map files to all MR go-kart client software that have joined the interactive server, thereby synchronizing the overall map information.

[0020] S3. Several users in the venue ride in go-karts and wear MR all-in-one devices;

[0021] S4, MR Karting client software starts running, and the karts begin to operate;

[0022] S5. While operating the go-karts, users in the field can interact with other users in the field based on the MR go-kart client software and the interaction server.

[0023] Furthermore, in step S1, when editing and drawing the map file, the administrator pre-places virtual question mark boxes in the map file for users in the venue to pick up virtual props;

[0024] In step S5, users in the field can use virtual props via buttons on the go-kart's steering wheel.

[0025] Furthermore, in step S5, off-site users can interact with on-site users through off-site interactive software on the mini-program and APP.

[0026] Compared with the prior art, the beneficial effects of the present invention are:

[0027] The present invention provides a multi-person offline interactive system and method based on MR spatial positioning and vehicle-machine interaction, which effectively combines MR technology with traditional go-karting, and is conducive to enriching and making offline go-karting operation scenarios more competitive, meeting the needs of digital sports development and entertainment event operation. Specifically, it effectively combines the software program of the MR all-in-one head-mounted display device with the go-karting hardware, while retaining the speed and drifting experience of traditional go-karting, and realizes the interaction between vehicles and vehicle-machine feedback based on high-precision positioning technology, enhancing the entertainment of multi-person interaction and the fairness of competition, while providing a new form of offline entertainment gameplay. Attached Figure Description

[0028] Figure 1 A schematic diagram of a multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction provided by the present invention;

[0029] Figures 2a-2k This is the circuit diagram of the go-kart control motherboard. Detailed Implementation

[0030] To make the technical means, creative features, objectives and effects of this invention easier to understand, the following description, in conjunction with the accompanying drawings and specific embodiments, further explains how this invention is implemented.

[0031] Reference Figure 1 As shown, this invention provides a multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction, including an independent PC 1, several MR all-in-one machines 2, and several go-karts 3; the MR all-in-one machine 2 is a head-mounted display device, and the MR all-in-one machine 2 is equipped with MR go-kart client software 20, which is used to interact directly with the user; the independent PC 1 is equipped with an interaction server 10, which is used to provide data exchange and synchronization services to several MR all-in-one machines 2 within the local area network; the go-karts 3 are equipped with a control motherboard, and the control motherboard is equipped with a vehicle-machine control system 30, which is used to receive instructions from the interaction server 10 and the MR go-kart client software 20, thereby controlling the operation of the go-karts 3, including the motor power output ratio, braking, lights, steering, inner and outer wheel speed difference, vibration, etc. of the go-karts 3.

[0032] Preferably, the multi-person offline interactive system based on MR spatial positioning with vehicle-machine interaction also includes off-site interactive software 40 configured on cloud server 4. The off-site interactive software 40 is developed on mini-programs and APPs to record users' play information. For example, it can provide functions such as speeding up race results, play time, and ladder ranking to enhance the play experience and user stickiness; and enable off-site users to interact with on-site users through mobile phones or tablets.

[0033] Preferably, at least one MR all-in-one machine 2 is also equipped with map editor software 21. The map editor software 21 is used to edit and draw the augmented reality go-kart 3 map using the positioning information of the MR all-in-one machine 2, and import it into the interactive server 10 of the independent PC 1 in the form of map file. The interactive server 10 is also used to uniformly distribute the map file to each MR go-kart client software 20 added to the interactive server 10, thereby synchronizing the overall map information.

[0034] In one specific embodiment, the map editor software 21 is a standalone software installed on the MR all-in-one machine 2. This embodiment defines a custom file storage specification for saving map information drawn by the map editor software 21, and this specification is saved in a JSON file.

[0035] A map file is a JSON file used to describe all predetermined objects within a space. It marks information for all "Items" (entities) within a real-world location. All entity elements form an array called "Items," stored in the root node of the JSON object. Each "Item" is an independent entity with two attributes: "Type" and "Info." "Type" is a string describing the entity's type; its value allows for quick identification of the category and retrieval of the corresponding entity. "Info" contains detailed information about the entity, including different data payloads for different entity types. For example, "Transform" describes the entity's "Location," "Rotation," and "Scale" in 3D space. Some entities with special logic may also include runtime logic-related information payloads.

[0036] Here is an example of a JSON map file:

[0037] {

[0038] "Items": [

[0039] {

[0040] Type: "Track",

[0041] "Info":

[0042] {

[0043] "trackPointDataArray": [

[0044] {

[0045] "trackNums": 0,

[0046] "trackPointDataArray": [

[0047] {

[0048] "uUId": "202412261639408133B286DB51D71441AB58437C56D3A097D",

[0049] "pointLocation":

[0050] {

[0051] "x": -63.786182403564453,

[0052] "y": -1069.4791259765625,

[0053] "z": 0

[0054] },

[0055] "point_Tangent_Value":

[0056] {

[0057] "x": 199.97077941894531,

[0058] "y": 3.4185791015625,

[0059] "z": 0

[0060] },

[0061] "trackPointSize": 0.78415673971176147,

[0062] "trackNums": 0,

[0063] "frontPointArray": "20241226163945178C1590CC80EEC4856B946420E5BC2A607",

[0064] "backPointArray": "20241226164928812023F3D2362C48D3B2DC3A9DD4B8DE03"

[0065] }, ......

[0067] ],

[0068] "itemsDataArray": [

[0069] {

[0070] "x": -520.7061767578125,

[0071] "y": 118.30275726318359,

[0072] "z": 0

[0073] }, ......

[0075] ],

[0076] "specialPointArray": [

[0077] {

[0078] "uUId": "202412261648219641CC784A1DB6C4EB8975A576A1A518435",

[0079] "frontPointArray": [],

[0080] "backPointArray": []

[0081] },

[0082] {

[0083] "uUId": "20241226165018978EB505C0549AC4C968E50B734A1E7BAB3",

[0084] "frontPointArray": [

[0085] "202412261639408133B286DB51D71441AB58437C56D3A097D"

[0086] ],

[0087] "backPointArray": []

[0088] } ]

[0090] }

[0091] },

[0092] {

[0093] "Type": "Wall",

[0094] "Info":

[0095] {

[0096] "WallData": [

[0097] {

[0098] "LocationX": 388.54495239257812, ......

[0100] }, ...... ]

[0103] }

[0104] } ...... ]

[0107] }

[0108] Within the map editor software 21, all marked and placed entities are visually edited and saved as a map JSON file, which is then copied to the corresponding directory on the interactive server 10. The PC client parses this map JSON file using the same rules, deserializes it into the corresponding entities, displays it on the interactive server 10, and synchronizes the map information with all MR kart racing client software 20 connected to the interactive server 10 via network synchronization. After synchronization, through large-scale unified coordinate mapping, all clients can see the same map structure as the server and generate identical entities.

[0109] In one specific embodiment, the MR all-in-one machine 2 is a PICO or QUEST device; the MR kart client software 20 is developed based on Unreal Engine (UE) and runs as a game client on the MR all-in-one machine 2; the MR kart client software 20 and the interaction server 10 establish a bidirectional communication architecture based on Remote Procedure Call (RPC), so that the interaction server 10 can synchronize map information and real-time events to each MR kart client software 20, and the MR kart client software 20 can send local operations to the interaction server 10, including but not limited to location coordinate synchronization, button input operation synchronization, vehicle information synchronization, map and prop synchronization, etc.

[0110] Video Seethrough (VST) technology breaks the completely enclosed virtual environment provided by VR headsets. This technology uses cameras on the headset to capture a real-time view of the surrounding environment, then uses image processing algorithms to display the real-world scene on the headset screen, giving users the feeling of directly browsing the real-world scene through the headset screen. Ultimately, the seethrough view can be integrated with the virtual scene within the application, presenting a mixed reality effect.

[0111] Therefore, in this embodiment, to achieve the occlusion effect of the MR real environment on the MR all-in-one machine 2 that supports VST function, it is necessary to place a model that overlaps with the real scene one-to-one in the program, and the material of the model needs to write the corresponding value to the Alphapass of the rendering pipeline in Unreal Engine, where 0 is completely transparent and 1 is completely opaque. Finally, the rendering data will be blended with the virtual and real images through the XR compositing layer, and the final image will be presented in the MR all-in-one machine 2.

[0112] The client network synchronization architecture and large-space multi-target positioning system based on the Unreal Engine interactive server 10 synchronize globally unified large-space coordinate information (Location and Rotation) between the server and client via RPC. This achieves a unified coordinate system between the interactive server 10 (hereinafter referred to as the server) and the MR go-kart client software 20 (hereinafter referred to as the client), ensuring complete synchronization between virtual and real positions. The synchronization process is as follows: First, the client obtains its own large-space location information; then, the client remotely sends it to the server via RPC. The server processes the location information and then multicasts it to all clients via RPC. After receiving the data, the clients synchronize the location information of other clients and apply the information to the corresponding game entities.

[0113] In addition, the steering wheel of Karting 3 is equipped with several buttons, each of which is directly connected to the control motherboard of Karting 3. The buttons are used for real-time interactive triggering by the user and the triggering results are fed back to the MR all-in-one machine 2.

[0114] In this embodiment, the MR all-in-one machine 2 is connected to the control board of the go-kart 3 via a Type-C-USB cable. The control board is connected to the power system of the go-kart 3, and communication with the go-kart 3 is achieved through the MR go-kart client software 20. Based on USB HID hardware communication, the MR all-in-one machine 2 controls the go-kart 3, and at the same time, relevant information of the go-kart 3 is fed back to the MR all-in-one machine 2. Specifically, in Unreal Engine, a control board communication plugin can be used, which allows for easy acquisition of go-kart information and control of the go-kart's engine power parameters using blueprint nodes.

[0115] In this embodiment, the data communication protocol format for HID is as follows:

[0116]

[0117] Frame header: fixed at 0xA5

[0118] Protocol version number: The default starts from 0x01. Higher version protocols are compatible with lower version protocols.

[0119] Serial Number: The serial number for the head-mounted display is 0-99, incrementing cyclically.

[0120] The vehicle-mounted terminal serial number is 100-199, increasing cyclically.

[0121] Status: 1 byte, default 0x00

[0122] Reserved: 1 byte, default 0x00

[0123] Main command: Defines the command type, 1 byte

[0124] Main command content length: 2 bytes, indicating the length of the main command content in big-endian format. For example, if the length is 512 (0x200) bytes, then 2 bytes would be 0x02 0x00.

[0125] Main command content:

[0126]

[0127] The command summary table for the MR all-in-one machine and the go-kart vehicle's infotainment system is as follows:

[0128]

[0129]

[0130] CRC8 calculation range: All data from the protocol version number to the end of the subcommand content.

[0131] CRC8 calculation method:

[0132] static unsigned char crc8(unsigned char *pdata, int len)

[0133] {

[0134] unsigned char crc = 0;

[0135] unsigned char crcbuff;

[0136] unsigned char i;

[0137] while(len--)

[0138] {

[0139] crcbuff = *pdata ++;

[0140] for(i = 0; i< 8; i++)

[0141] {

[0142] if( (crc ^ crcbuff) & 0x01 )

[0143] {

[0144] crc ^= 0x18;

[0145] crc>>= 1;

[0146] crc |= 0x80;

[0147] }

[0148] else

[0149] {

[0150] crc>>= 1;

[0151] }

[0152] crcbuff>>= 1;

[0153] }

[0154] }

[0155] return crc;

[0156] }

[0157] In this embodiment, when the system is in use, the absolute coordinates of the vehicle are calibrated by a 6DOF TRACKER locator fixed on the go-kart 3, and the relative coordinates of the user on the go-kart 3 are marked by a 6DOF handle that comes with the MR all-in-one machine 2. Both the absolute coordinates and the relative coordinates are uploaded to the interactive server 10 in real time.

[0158] Furthermore, in this embodiment, the self-developed control motherboard of the go-kart 3 can be adapted to most electric go-karts on the market, solving the problem of seamless upgrade from traditional go-karts to MR go-karts.

[0159] Specifically, the power supply circuit controlling the motherboard, such as Figure 2a As shown, the 12V battery pack is used as the main power source. The voltage is reduced from 12V to 5V through the DC-DC circuit below. The JW5352 chip U67 is used in conjunction with external resistors, inductors and capacitors to achieve the voltage reduction function.

[0160] USB interface communication circuit, such as Figure 2b As shown, communication is conducted via a USB interface, and the collected throttle and brake signals are uploaded.

[0161] Key detection circuit such as Figure 2c As shown, four buttons are reserved. When a button is pressed, the microcontroller's I / O ports (K1, K2, K3, K4) are connected to ground, and the voltage level is low. Normally, when there is no operation, the I / O ports are pulled up to 3.3V, and the voltage level is high. The microcontroller can determine whether a button is pressed by detecting the voltage changes of the I / O ports.

[0162] Accelerator and brake acquisition circuits, such as Figure 2dAs shown, the accelerator and brake signal levels range from 0-5V, while the microcontroller system voltage is 3.3V. Therefore, the signals need to be divided, and the acquired level is half of the original level. The microcontroller acquires the level via an ADC, converts the analog signal into a digital signal, and then uploads it to a PC or other device via a USB interface.

[0163] Accelerator and brake signal output circuits, such as Figure 2e As shown, the acquired throttle and brake signals need to be processed and then re-output as throttle and brake signals. The microcontroller system can control the throttle and brake outputs. PWM_DAC1 and PWM_DAC2 are the microcontroller's PWM output I / O ports, which can adjust the output level through high-frequency PWM. After filtering by a simple low-pass filter (R123 and C129, R111 and C150), the PWM is converted into a constant level signal. The microcontroller's maximum PWM output level is 3.3V, so the output level needs to be amplified to reach 5V. This circuit uses a positive proportional amplifier (based on LM358DR) to amplify the level, with a magnification factor of approximately 5 / 3.3.

[0164] Three-way motor control circuit, such as Figure 2f As shown, three DC motors are controlled by three MOSFETs. PWM speed control is used. The power supply is 12V. F1-F3 are surface-mount fuses, providing protection in case of short circuits or other abnormal conditions. D1-D3 are follow-through diodes, providing a follow-through path for the motor current when the MOSFETs are suddenly turned off. PWM1-PWM3 are PWM control pins; the microcontroller outputs a PWM wave to control the motor speed.

[0165] In addition to uploading data to PCs and other devices via USB, the control motherboard can also transmit data wirelessly via Bluetooth or a proprietary 2.4G module. The wireless communication module uses serial communication to communicate with the microcontroller. The Bluetooth module circuitry is as follows... Figure 2g As shown; the 2.4G module circuit is as follows Figure 2h As shown.

[0166] Both the Bluetooth module and the 2.4G module are powered by 3.3V, and their power supply circuits are as follows: Figure 2i As shown, the power supply of the 2.4G module and the Bluetooth module are controlled by P-MOS (U5 and U4) respectively.

[0167] microcontroller circuits such as Figure 2j As shown, the GD32F303CBT6 microcontroller chip is used. The main peripherals of the microcontroller are crystal oscillator circuit, reset circuit, etc.

[0168] The microcontroller is powered by 3.3V, and its power supply circuit is as follows: Figure 2kAs shown, the 5V power supply is regulated to 3.3V through LD0 to power the microcontroller system.

[0169] Another aspect of the present invention provides a multi-person offline interaction method based on MR spatial positioning and vehicle-to-machine interaction, which adopts the above-mentioned multi-person offline interaction system based on MR spatial positioning and vehicle-to-machine interaction, and includes the following steps:

[0170] S1. Based on map editor software 21, the augmented reality go-kart 3 map is edited and drawn, and imported into the interactive server 10 of independent PC 1 as a map file;

[0171] S2. The interactive server 10 distributes the map files to each MR go-kart client software 20 that has been added to the interactive server 10, thereby synchronizing the overall map information.

[0172] S3, Several users in the venue ride in go-karts 3 and wear MR all-in-one machines 2;

[0173] S4 and MR Karting client software 20 started running, and Karting 3 started operating;

[0174] S5. While operating the go-kart 3, users in the field can interact with other users in the field based on the MR go-kart client software 20 and the interaction server 10.

[0175] Preferably, in step S1, when editing and drawing the map file, the administrator pre-places virtual question mark boxes in the map file for users in the field to pick up virtual props; in step S5, users in the field can use virtual props through the buttons configured on the steering wheel of the go-kart 3.

[0176] In addition, in step S1, based on the map editor software 21, functions such as track editing, start and finish line layout, speed bump / speed bump layout, setting of various modes such as coins, capture the flag, and AI, and setting of invisible walls can also be completed.

[0177] Preferably, in step S5, off-site users can interact with on-site users through off-site interaction software 40 on mini-programs and apps.

[0178] In one specific embodiment, the multi-player offline interactive system and method based on MR spatial positioning with vehicle-machine interaction provided by this invention are adopted. When users are playing in the kart, they trigger real-time interaction via two buttons installed on the kart's steering wheel. Button A is responsible for switching the item bar acquired by the user during the kart game; each user can store a maximum of two items. Button B is responsible for releasing the currently pinned item. The main feedback logic is as follows: releasing an item or being hit by another player's item will cause a buff or debuff effect on the user, such as instantaneous acceleration, stalling, braking, or eye obstruction.

[0179] Users can randomly obtain items by picking up question mark boxes during gameplay. These question mark boxes are pre-placed by the administrator in the map editor. After a user picks up a question mark box, a new one will regenerate at the same location after 5 seconds. After picking up a question mark box, users can select it using button A and release it using button B. The items and functions obtainable from the question mark boxes are as follows:

[0180] Missile: Launches a homing missile at the player in the direction the user is looking. The homing missile prioritizes the nearest target in the direction the user is looking and automatically tracks it. The player hit will be slowed down for 3 seconds.

[0181] Shield: Grants immunity to all negative effects from attacks for 10 seconds after use.

[0182] Water mine: After being released, a water mine is placed behind the user and remains in the field. Other users who collide with it will be slowed down by 30%.

[0183] Nitrogen boost: After use, the power output becomes 100%, and the throttle power increases.

[0184] UFO: In race mode, the first-place user will be slowed down; in entertainment racing mode, a target will be randomly selected to be slowed down.

[0185] Invincible Wings: Grants invincibility for a period of time, unaffected by any items.

[0186] Thundercloud: Places a thundercloud in place, which lasts for a period of time. Users hit by it will stop accelerating.

[0187] Landmine: A landmine is placed behind the user, causing the user to stop the accelerator when it is detonated.

[0188] Bomber: Place a bomber, which will find the nearest user, walk over and explode, causing the user to stop the engine.

[0189] Darts: The user aims with their eye and presses the button to fire. The darts fly in a straight line and can be fired three times. If hit, the user stops the throttle.

[0190] Easter Egg Gun: Randomly sprays paint onto the target screen, obstructing the user's view.

[0191] Additionally, three game modes are available: multiplayer races, coin collection, and casual racing. All three modes share the same items and interaction methods. Each game mode must be configured on the interaction server 10 beforehand. Once the service is activated, the corresponding client user will play in that mode. The specific modes are as follows:

[0192] Multiplayer race mode: Users start from the same starting line and race simultaneously according to the number of laps set on the server. The user who reaches the finish line first wins.

[0193] Coin Collection Mode: Users start from a level starting line, collect coins on the track, and are scored based on the number of coins they have collected after a set number of laps. The user with the highest score wins.

[0194] Entertainment Racing Mode: Entertainment mode is an on-the-go mode where users can join the race at any time and compete for the fastest lap time based on their best single-lap time.

[0195] In summary, the multi-person offline interactive system and method based on MR spatial positioning and vehicle-machine interaction provided by this invention effectively combines MR technology with traditional go-karting, which is conducive to enriching and enhancing the offline go-karting operation scenarios and meeting the needs of digital sports development and entertainment event operation. Specifically, it effectively combines the software program of the MR all-in-one head-mounted display device with the go-karting hardware, while retaining the speed and drifting experience of traditional go-karting, and realizes the interaction and feedback between vehicles and vehicle-machine interaction based on high-precision positioning technology, which enhances the entertainment of multi-person interaction and the fairness of competition, and at the same time provides a new form of offline entertainment gameplay.

[0196] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A multi-user offline interactive system based on MR spatial positioning with vehicle-to-machine interaction, characterized in that, Includes a standalone PC (1), several MR all-in-one machines (2) and several go-karts (3); The MR all-in-one machine (2) is a head-mounted display device. The MR all-in-one machine (2) is equipped with MR go-kart client software (20), which is used to interact directly with the user. The independent PC (1) is equipped with an interactive server (10), which is used to provide data exchange and synchronization services to several MR all-in-one machines (2) in the local area network. The go-kart (3) is equipped with a control motherboard, which is equipped with a vehicle control system (30). The vehicle control system (30) is used to receive instructions from the interactive server (10) and the MR go-kart client software (20) to control the operation of the go-kart (3). At least one MR all-in-one machine (2) is also equipped with map editor software (21). The map editor software (21) is used to edit and draw the augmented reality go-kart (3) map through the positioning information of the MR all-in-one machine (2) and import it into the interactive server (10) of the independent PC (1) in the form of map file. The interactive server (10) is also used to uniformly distribute the map file to each MR go-kart client software (20) added to the interactive server (10) to synchronize the overall map information. The steering wheel of the go-kart (3) is equipped with several buttons. Each button is directly connected to the control motherboard of the go-kart (3). The buttons are used for real-time interactive triggering by the user and the triggering result is fed back to the MR all-in-one machine (2). In the power supply circuit of the control motherboard, the 12V battery pack is used as the main power supply. After passing through the DC-DC circuit, the voltage is reduced from 12V to 5V. The JW5352 chip is used in conjunction with external resistors, inductors and capacitors to achieve the voltage reduction function.

2. The multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction according to claim 1, characterized in that, It also includes off-site interactive software (40) configured on cloud server (4), which is developed on mini-programs and APPs to record users’ play information and enable off-site users to interact with on-site users.

3. The multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction according to claim 2, characterized in that, The MR all-in-one machine (2) is a PICO or QUEST device; the MR go-kart client software (20) is developed based on Unreal Engine and runs as a client on the MR all-in-one machine (2); The MR kart client software (20) and the interaction server (10) establish a two-way communication architecture based on remote procedure calls, so that the interaction server (10) can synchronize map information and real-time events to each MR kart client software (20), and the MR kart client software (20) can send local operations to the interaction server (10).

4. The multi-user offline interactive system based on MR spatial positioning with vehicle-to-machine interaction according to claim 3, characterized in that, The MR all-in-one machine (2) is connected to the control motherboard of the go-kart (3) via a Type C-Usb cable. The control motherboard is connected to the power system of the go-kart (3) and communicates with the go-kart (3) through the MR go-kart client software (20). Based on USB HID hardware communication, the MR all-in-one machine (2) controls the go-kart (3) and feeds back the relevant information of the go-kart (3) to the MR all-in-one machine (2).

5. The multi-user offline interactive system based on MR spatial positioning with vehicle-machine interaction according to claim 4, characterized in that, When the system is in use, the absolute coordinates of the vehicle are calibrated by the 6DOF TRACKER locator fixed on the go-kart (3), and the relative coordinates of the user on the go-kart (3) are marked by the 6DOF handle of the MR all-in-one machine (2). Both the absolute coordinates and the relative coordinates are uploaded to the interactive server (10) in real time.

6. A multi-user offline interaction method based on MR spatial positioning with vehicle-to-machine interaction, characterized in that, The system employs the multi-user offline interactive system based on MR spatial positioning with vehicle-to-machine interaction as described in any one of claims 2-5, and includes the following steps: S1. Based on the map editor software (21), the augmented reality go-kart (3) map is edited and drawn, and imported into the interactive server (10) of the independent PC (1) in the form of a map file. S2. The interactive server (10) distributes the map files to each MR go-kart client software (20) that has been added to the interactive server (10), thereby synchronizing the overall map information. S3, Several users in the venue ride in go-karts (3) and wear MR all-in-one machines (2); S4, MR Karting client software (20) starts running, and karting (3) starts operating; S5. While operating the go-kart (3), users in the field can interact with other users in the field based on the MR go-kart client software (20) and the interaction server (10).

7. The multi-person offline interaction method based on MR spatial positioning with vehicle-machine interaction according to claim 6, characterized in that, In step S1, when editing and drawing the map file, the administrator pre-places virtual question mark boxes in the map file for users in the venue to pick up virtual props; In step S5, users in the field can use virtual props by using the buttons configured on the steering wheel of the go-kart (3).

8. The multi-person offline interaction method based on MR spatial positioning with vehicle-machine interaction according to claim 6, characterized in that, In step S5, off-site users can interact with on-site users through off-site interaction software (40) on the mini-program and APP.

Images