Multi-person offline interaction system and method with vehicle-machine interaction based on MR space positioning
By designing a multi-person offline interaction system based on MR spatial positioning, combining MR technology and traditional karting, the problem of insufficient integration of MR equipment and karting equipment in the existing technology has been solved, and rich offline karting operation scenarios and entertainment and fairness of multi-person interaction have been achieved.
Patent Information
- Application Number
- CN202510119737.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-25
- Publication Date
- 2025-06-13
- Estimated Expiration
- 2045-01-25
AI Technical Summary
In the prior art, MR equipment and kart equipment lack effective integration, resulting in limitations in user experience during offline interaction between multiple people.
A multi-person offline interaction system based on MR spatial positioning with vehicle-machine interaction is designed, including independent PCs, MR all-in-one machines and karts. Data exchange and synchronization are performed with the interactive server through the MR kart client software to realize high-precision positioning and interactive control of karts.
Effectively combine MR technology and traditional karting to enrich and race-based offline karting operation scenarios, enhance the entertainment and event-based fairness of multi-person interaction, and provide a new form of offline entertainment gameplay.
Smart Images

Figure CN120143966A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of mixed reality, and in particular to a multi-person offline interaction system and method based on MR spatial positioning with in-vehicle interaction. Background Art
[0002] New forms of offline entertainment and culture and tourism are issues that the state focuses on supporting and continuously paying attention to. In recent years, the state has issued documents many times to encourage the integration of virtual reality technology and industry, and has adopted a number of special policies for the development of the metaverse industry. With the development of virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies, interaction methods based on spatial positioning have been widely used in many fields such as entertainment and education. However, since most traditional virtual reality or augmented reality technologies focus on visual expression and immersive interaction, only a small part combines augmented reality technology with traditional crafts.
[0003] At present, the fields of augmented reality and multi-person interaction, augmented reality and hardware device interaction, etc. are still blank in the market. In the prior art, there is a lack of effective integration between MR devices and karting devices, resulting in certain limitations in the user experience during multi-person offline interaction. Summary of the Invention
[0004] To solve the problems raised in the above background art, the technical solution adopted by the present invention is as follows:
[0005] A multi-person offline interaction system based on MR spatial positioning with in-vehicle interaction, including an independent PC, several MR all-in-one machines, and several karts;
[0006] The MR all-in-one machine is a head-mounted device, and an MR kart client software is configured on the MR all-in-one machine, and the MR kart client software is used for direct interaction with users;
[0007] An interaction server is configured on the independent PC, and the interaction server is used to provide data exchange and synchronization services for several MR all-in-one machines within a local area network;
[0008] A control mainboard is installed on the kart, and a vehicle control system is configured on the control mainboard, and the vehicle control system is used to receive instructions sent from the interaction server and the MR kart client software, so as to control the operation of the kart.
[0009] In some embodiments, it further includes an off-site interaction software configured on a cloud server, and the off-site interaction software is developed on a small program and an APP, and is used to record the play information of users, and enable off-site users to interact with on-site users.
[0010] In some embodiments, at least one MR all-in-one device is also configured with a map editor software, which is used to edit and draw the augmented reality kart map through the positioning information of the MR all-in-one device, and import it into the interactive server of the independent PC in the form of a map file. The interactive server is also used to distribute the map file to each MR kart client software added to the interactive server, thereby synchronizing the overall map information.
[0011] In some embodiments, the MR all-in-one device is a PICO or QUEST device; the MR kart client software is developed based on the Unreal Engine and runs as a client on the MR all-in-one device;
[0012] A two-way communication architecture is established between the MR kart client software and the interactive server based on remote procedure calls, so that the interactive server can synchronize map information and real-time events to each MR kart client software, and the MR kart client software can send local operations to the interactive server.
[0013] In some embodiments, the MR all-in-one device is connected to the control motherboard of the kart via a TypeC-USB cable, the control motherboard is connected to the power system of the kart, and communication with the kart is achieved through the MR kart client software;
[0014] Based on USB HID hardware communication, the MR all-in-one machine controls the kart and feeds back the relevant information of the kart to the MR all-in-one machine.
[0015] In some embodiments, the steering wheel of the kart is provided with a plurality of buttons, each of which is directly connected to the control mainboard of the kart. The buttons are used for real-time interactive triggering by the user, and the triggering results are fed back to the MR all-in-one device.
[0016] In some embodiments, when the system is used, the absolute coordinates of the vehicle body are calibrated by a 6DOFTRACKER locator fixed on the kart, and the relative coordinates of the user on the kart are marked by the 6DOF handle of the MR all-in-one machine. Both the absolute coordinates and the relative coordinates are uploaded to the interactive server in real time.
[0017] Another aspect of the present invention provides a multi-person offline interaction method based on MR spatial positioning with vehicle-machine interaction, which adopts the above-mentioned multi-person offline interaction system based on MR spatial positioning with vehicle-machine interaction and includes the following steps:
[0018] S1. Based on the map editor software, the augmented reality kart map is edited and drawn, and imported into the interactive server of the independent PC in the form of a map file;
[0019] S2. The interactive server uniformly distributes the map file to each MR karting client software that joins the interactive server, thereby synchronizing the overall map information;
[0020] S3. Several on-site users ride on the karts and wear the MR all-in-one machines;
[0021] S4. The MR karting client software starts running, and the kart starts to operate;
[0022] S5. While operating the kart, the on-site users achieve interaction with other on-site users based on the MR karting client software and the interactive server.
[0023] Further, in step S1, when editing and drawing the map file, the administrator pre-arranges virtual question mark boxes in the map file for on-site users to pick up virtual props;
[0024] In step S5, on-site users can use virtual props by pressing the buttons configured on the steering wheel of the kart.
[0025] Further, in step S5, off-site users can achieve interactive interaction with on-site users through the off-site interaction software on the mini-program and APP.
[0026] Compared with the prior art, the beneficial effects of the present invention are:
[0027] The multi-person offline interaction system and method based on MR spatial positioning with vehicle-mounted computer interaction provided by the present invention effectively combines MR technology and traditional karting, which is beneficial to the enrichment and eventization of the offline karting operation scenario, and meets the development needs of digital sports and entertainment event management; specifically, the software program of the MR all-in-one head-mounted device is effectively combined with the kart hardware. While retaining the speed and drift experience of traditional karting, it realizes interactive interaction between vehicles and vehicle-mounted computer feedback based on high-precision positioning technology, enhances the entertainment of multi-person interaction and the fairness of eventization, and at the same time provides a new form of offline entertainment gameplay. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 It is a schematic diagram of the multi-person offline interaction system based on MR spatial positioning with vehicle-mounted computer interaction provided by the present invention;
[0029] Figure 2a - Figure 2k It is the circuit schematic diagram of the kart control main board. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0030] To make the technical means, creative features, achieved purposes and functions of the present invention easy to understand, the following further elaborates how the present invention is implemented in combination with the drawings and specific embodiments.
[0031] Reference Figure 1 As shown, the present invention provides a multi-person offline interaction system based on MR spatial positioning with in-vehicle computer interaction, including an independent PC 1, several MR all-in-one machines 2, and several go-karts 3; the MR all-in-one machine 2 is a head-mounted device, and an MR go-kart client software 20 is configured on the MR all-in-one machine 2, and the MR go-kart client software 20 is used for direct interaction with users; an interaction server 10 is configured on the independent PC 1, and the interaction server 10 is used to provide data exchange and synchronization services for several MR all-in-one machines 2 within the local area network; a control main board is installed on the go-kart 3, and a vehicle computer control system 30 is configured on the control main board, and the vehicle computer control system 30 is used to receive instructions issued by the interaction server 10 and the MR go-kart client software 20, so as to control the operation of the go-kart 3, including the motor power output ratio, braking, lighting, rotational speed difference between the inner and outer wheels of steering, vibration, etc. of the go-kart 3.
[0032] Preferably, the multi-person offline interaction system based on MR spatial positioning with in-vehicle computer interaction further includes an off-site interaction software 40 configured on a cloud server 4. The off-site interaction software 40 is developed on a small program and an APP, and is used to record the playing information of users. For example, it can provide functions such as speed-up race results, playing time, and ladder ranking, enhancing the playing experience and user stickiness; and enabling off-site users to interact with on-site users through a mobile phone or a tablet.
[0033] Preferably, a map editor software 21 is further configured on at least one MR all-in-one machine 2. The map editor software 21 is used to edit and draw an augmented reality go-kart 3 map through the positioning information of the MR all-in-one machine 2, and import it into the interaction server 10 of the independent PC 1 in the form of a map file. The interaction server 10 is also used to uniformly distribute the map file to each MR go-kart client software 20 joined to the interaction server 10, so as to synchronize the overall map information.
[0034] In a specific embodiment, the map editor software 21 is an independent running software installed on the MR all-in-one machine 2. In this embodiment, a file storage specification is customized to save the map information drawn by the map editor software 21, and this specification is saved in a Json file.
[0035] The map file is a Json file used to describe all the predefined objects within a space. In a real venue, the information of all "Items" (entities) is marked, and all entity elements form an array "Items", which is stored at the root node of the Json object. Each "Item" is an independent entity with two attributes: "Type" and "Info". Among them, "Type" is a string describing the type of the entity. Based on the value of "Type", the category can be quickly determined, and the corresponding entity can be found. "Info" is the detailed information describing the entity, and different data payloads are included for different entity types inside. For example, "Transform" is used to describe the "Location" (position), "Rotation" (rotation), and "Scale" (scaling) of the entity in three-dimensional space. Some entities with special logic may also contain information payloads related to the running logic.
[0036] The following is an example of a Json map file:
[0037]
[0038]
[0039]
[0040] Through visual editing in the map editor software 21, all the marked and placed entities are saved as a map Json file, and placed in the corresponding directory of the interactive server 10 by means of file copying. The PC side parses the map Json file according to the same rules, deserializes it into the corresponding entities, displays them in the interactive server 10, and synchronizes the map information to all MR kart client software 20 connected to the interactive server 10 through the network synchronization between the interactive server 10 side and the MR kart client software 20. After the synchronization is completed, through the unified coordinate mapping of the large space, all clients can see the same map structure as the server side and generate exactly the same entities.
[0041] In a specific embodiment, the MR all-in-one machine 2 is a PICO or QUEST device; the MR karting client software 20 is developed based on the Unreal Engine (UE) and runs as a game client on the MR all-in-one machine 2; a two-way communication architecture is established between the MR karting client software 20 and the interaction server 10 based on Remote Procedure Call (RPC), so that the interaction server 10 can synchronize map information and real-time events to each MR karting client software 20, and the MR karting client software 20 can send local operations to the interaction server 10, including but not limited to location coordinate synchronization, button input operation synchronization, vehicle information synchronization, map and prop synchronization, etc.
[0042] Video Seethrough (VST) technology can break the fully enclosed virtual environment provided by VR headsets. This technology can collect real-time views of the surrounding environment through a camera on the headset, and then present the real scene image on the headset screen through image processing algorithms, giving users a feeling that they can directly view the real scene through the headset screen. Finally, the perspective image can be merged with the virtual scene in the application to present a mixed reality effect.
[0043] Therefore, in this embodiment, to achieve the MR real environment occlusion effect on the MR all-in-one machine 2 that supports the VST function, it is necessary to place a model that overlaps with the real scene one-to-one in the program, and the material of the model needs to write corresponding values to the Alpha pass of the rendering pipeline in Unreal Engine. 0 means completely transparent, and 1 means completely opaque. The final rendered data will fuse the virtual and real images through the XR synthesis layer and present the final image in the MR all-in-one machine 2.
[0044] Based on the client network synchronization architecture and large space multi-target positioning system function of the interaction server 10 based on Unreal Engine, the coordinate information (Location and Rotation) based on the globally unified large space is synchronized between the server and the client through RPC, realizing the unified coordinate system of the interaction server 10 side (hereinafter referred to as the server side) and the MR karting client software 20 (hereinafter referred to as the client side), and making the virtual and real positions fully synchronized. The synchronization process is as follows: First, the client obtains its own large space position information; then, the client remotely sends it to the server through RPC, the server processes the position information, and then multicasts it to all clients through RPC. After receiving the data, the client synchronizes the position information of other clients and applies the information to the corresponding game entities.
[0045] In addition, several buttons are configured on the steering wheel of the kart 3, and each button is directly connected to the control main board of the kart 3. The buttons are used for users to trigger real-time interaction and feedback the trigger results to the MR all-in-one machine 2.
[0046] In this embodiment, the MR all-in-one machine 2 is connected to the control main board of the kart 3 through a TypeC-Usb cable. The control main board is connected to the power system of the kart 3, and the communication with the kart 3 is realized through the MR kart client software 20; based on the USB HID hardware communication, the control of the kart 3 by the MR all-in-one machine 2 is realized, and at the same time, the relevant information of the kart 3 is fed back to the MR all-in-one machine 2. Specifically, in the Unreal Engine, a control board communication plug-in can be used, and then the information of the kart can be simply obtained using blueprint nodes and the engine energy supply parameters of the kart can be controlled.
[0047] In this embodiment, the data communication protocol format of HID is as follows:
[0048]
[0049] Frame header: Fixed as 0xA5
[0050] Protocol version number: Default starts from 0x01, and high-version protocols are compatible with low-version protocols
[0051] Serial number: The serial number at the headset end is 0-99, increasing cyclically
[0052] The serial number at the vehicle computer end is 100-199, increasing cyclically
[0053] Status: 1 byte, default 0x00
[0054] Reserved: 1 byte, default 0x00
[0055] Main command: Defines the command type, 1 byte
[0056] Main command content length: 2 bytes, indicating the length of the main command content, big-endian format. For example, if the length is 512 (0x200) bytes, then the 2 bytes are 0x02 0x00
[0057] Main command content:
[0058]
[0059] The command summary table of the MR all-in-one machine and the kart vehicle computer device end is as follows:
[0060]
[0061]
[0062] CRC8 calculation range: All data from the protocol version number to the end of the sub-command content.
[0063] CRC8 calculation method:
[0064]
[0065]
[0066]
[0067] In this embodiment, when the system is used, the absolute coordinates of the vehicle body are calibrated by the 6DOF TRACKER locator fixed on the kart 3, and the relative coordinates of the user on the kart 3 are marked by the 6DOF handle built into the MR all-in-one machine 2. Both the absolute coordinates and the relative coordinates are uploaded to the interaction server 10 in real time.
[0068] In addition, in this embodiment, through the independently developed control main board of the kart 3, it can be adapted to most of the electric karts on the market, solving the problem of seamless upgrade of traditional karts to MR karts.
[0069] Specifically, the power supply circuit of the control main board is as Figure 2a shown. The 12V power supply from the battery pack is used as the main power supply. After passing through the following DC-DC circuit, the voltage is reduced from 12V to 5V. The JW5352 chip U67 is used in cooperation with peripheral resistors, inductors, and capacitors to achieve the voltage reduction function.
[0070] The USB interface communication circuit is as Figure 2b shown. Communication is carried out through the USB interface to upload signals such as the throttle and brake collected.
[0071] The key detection circuit is as Figure 2c shown. Four keys are reserved. When a key is pressed, the IO ports (K1, K2, K3, K4) of the single-chip microcomputer are connected to the ground, and the level is low at this time. When there is no operation, the pull-up resistor of the IO port is connected to 3.3V, and the level is high at this time. The single-chip microcomputer can know whether a key is pressed by detecting the level change of the IO port.
[0072] The throttle and brake acquisition circuit is as Figure 2d shown. The signal level range of the throttle and brake is 0 - 5V, and the system voltage of the single-chip microcomputer is 3.3V. Therefore, the signal needs to be divided in voltage, and the acquired level is 1 / 2 of the original level. The single-chip microcomputer converts the analog signal into a digital signal by collecting the level through the ADC, and then uploads it to devices such as a PC through the USB interface.
[0073] The throttle and brake signal output circuit is as Figure 2eAs shown in the figure, the collected throttle signal and brake signal need to be processed and then the throttle and brake signals are output again. The single-chip microcomputer system can control the output of the throttle and brake. PWM_DAC1 and PWM_DAC2 are the PWM output IO ports of the single chip, and the output level size can be adjusted by high-frequency PWM. After filtering through simple low-pass filters (R123 and C129, R111 and C150), the PWM is converted into a constant level signal. The maximum level output of the PWM of the single-chip microcomputer is 3.3V, so the output level needs to be amplified to reach 5V output. This circuit uses a positive proportional amplifier (based on LM358DR) to amplify the level, and the amplification factor is about 5 / 3.3.
[0074] The three-way motor control circuit is as Figure 2f shown in the figure. Three MOSs are used to control three DC motors. PWM speed regulation is adopted. The power supply is 12V. F1 - F3 are SMD fuses, which play a protective role when abnormal conditions such as short circuits occur in the motors. D1 - D3 are freewheeling diodes, which provide a freewheeling circuit for the motor current when the MOS tubes are suddenly turned off. PWM1 - PWM3 are PWM control pins, and the single-chip microcomputer outputs PWM waves to control the speed of the motors.
[0075] In addition to uploading data to devices such as PCs through USB, the control main board can also transmit data wirelessly through a 2.4G module with Bluetooth or a private protocol. The wireless communication module communicates with the single-chip microcomputer in a serial communication manner. Among them, the Bluetooth module circuit is as Figure 2g shown in the figure; the 2.4G module circuit is as Figure 2h shown in the figure.
[0076] The power supplies of the Bluetooth module and the 2.4G module are both 3.3V. Their power supply circuits are as Figure 2i shown in the figure, and the power supplies of the 2.4G module and the Bluetooth module are controlled by P-MOS (U5 and U4) respectively.
[0077] The single-chip microcomputer circuit is as Figure 2j shown in the figure. The GD32F303CBT6 microcontroller chip is adopted, and the peripherals of the single-chip microcomputer are mainly crystal oscillator circuits, reset circuits, etc.
[0078] The power supply of the single-chip microcomputer is 3.3V. Its power supply circuit is as Figure 2k shown in the figure. The 5V power supply is regulated to 3.3V by LD0 to supply power to the single-chip microcomputer system.
[0079] On the other hand, the present invention provides a multi-person offline interaction method based on MR spatial positioning with vehicle machine interaction. The above multi-person offline interaction system based on MR spatial positioning with vehicle machine interaction is adopted, and it includes the following steps:
[0080] S1. Based on the map editor software 21, edit and draw the augmented reality karting map 3, and import it into the interaction server 10 of the independent PC1 in the form of a map file;
[0081] S2. The interaction server 10 uniformly distributes the map file to each MR karting client software 20 joined to the interaction server 10, so as to synchronize the overall map information;
[0082] S3. Several on-site users ride on the kart 3 and wear the MR all-in-one machine 2;
[0083] S4. The MR karting client software 20 starts to run, and the kart 3 starts to operate;
[0084] S5. While operating the kart 3, the on-site users realize interaction with other on-site users based on the MR karting client software 20 and the interaction server 10.
[0085] Preferably, in step S1, when editing and drawing the map file, the administrator pre-arranges virtual question mark boxes in the map file for on-site users to pick up virtual props; in step S5, the on-site users can use virtual props through the buttons configured on the steering wheel of the kart 3.
[0086] In addition, in step S1, based on the map editor software 21, functions such as track editing, starting and ending point arrangement, acceleration belt / deceleration belt arrangement, setting of various modes such as gold coins, flag capture, and AI, and air wall arrangement can also be completed.
[0087] Preferably, in step S5, off-site users can interact with on-site users through the off-site interaction software 40 on the small program and APP.
[0088] In a specific embodiment, using the multi-person offline interaction system and method based on MR spatial positioning and vehicle machine interaction provided by the present invention, when on-site users play, real-time interaction is triggered through two buttons installed on the steering wheel of the kart 3. Button A is responsible for switching the prop bar obtained by the user during the karting process, and each user can store a maximum of two props. Button B is responsible for releasing the currently top-mounted prop. The main feedback logic is as follows: When a user releases a prop or is hit by a prop of other players, it will have a beneficial or detrimental impact on the user himself, such as instantaneous acceleration, stalling, braking, eye occlusion, etc.
[0089] Users randomly obtain props by picking up question mark boxes during driving. The question mark boxes are pre-arranged by the administrator in the map editor. When a certain question mark box is picked up by a user, a new one will be regenerated at the original position after an interval of 5 seconds. After picking up the question mark box, it can be selected through button A and released through button B. The specific props and functions that can be obtained in the question mark box are as follows:
[0090] Missile: A tracking missile is launched at the player in the direction the user is looking at. The tracking missile will prioritize the nearest target in the direction the user is looking at and automatically track it. The player who is hit will stall for 3 seconds.
[0091] Shield: After use, you can be immune to the negative effects of being attacked for 10 seconds.
[0092] Water Mine: After release, a water mine will be placed behind the user, which will always be on the field. Other users will be slowed down by 30% when they are equipped with it.
[0093] Nitrogen acceleration: After use, the power output becomes 100% and the throttle power increases.
[0094] UFO: The competition mode will slow down the first user, and the entertainment racing mode will randomly select a target to slow down.
[0095] Invincible Wings: Invincible for a period of time, not affected by any props.
[0096] Thundercloud: Place a thundercloud at the location, which lasts for a period of time. If hit, the user stops throttle.
[0097] Mine: Place a mine behind the user, and the user who is hit will stop the accelerator.
[0098] Bomb Soldier: Place a bomb soldier, which will find the user closest to it and walk over to explode, forcing the user to stop the accelerator.
[0099] Darts: The user aims with the crosshairs, presses the button and the dart flies in a straight line. Three darts can be fired. The user stops the throttle when the dart is hit.
[0100] Easter Egg Gun: Randomly sprays the target screen with paint to block the user's field of view.
[0101] In addition, three game modes can be selected, including multiplayer competition, coin collection, and entertainment racing. The three game modes share the same props and interaction methods. The game mode must be set on the interactive server 10 first, and after the service is turned on, the corresponding client user will play in this mode.
[0102] The specific mode is as follows:
[0103] Multiplayer race mode: requires users to start at the same starting line and start at the same time according to the number of laps set on the server. The user who reaches the finish line the fastest wins.
[0104] Gold coin collection mode: Users start at a unified starting line and obtain gold coins on the field. After running a specified number of laps, they are scored based on the number of gold coins they have obtained. The one with the highest score wins.
[0105] Entertainment Racing Mode: The entertainment mode is a drop-in-and-drop-out mode. Users can join the race at any time. The scores are evaluated based on the best single-lap time, and the user with the fastest single lap is determined.
[0106] In summary, the multi-person offline interaction system and method based on MR spatial positioning and in-vehicle interaction provided by the present invention effectively combines MR technology with traditional karting, which is beneficial to the enrichment and eventization of the offline karting operation scenario, and meets the needs of the development of digital sports and the operation of entertainment events. Specifically, the software program of the MR all-in-one headset device is effectively combined with the kart hardware. While retaining the speed and drift experience of traditional karting, vehicle-to-vehicle interaction and in-vehicle feedback are realized based on high-precision positioning technology, enhancing the entertainment of multi-person interaction and the fairness of the event, and at the same time providing a new form of offline entertainment gameplay.
[0107] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered within the scope of the claims of the present invention.
Claims
1. A multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction, characterized in that: It includes an independent PC (1), several MR all-in-one machines (2) and several karts (3); The MR all-in-one machine (2) is a head-mounted display device, and the MR all-in-one machine (2) is configured with MR kart client software (20), and the MR kart client software (20) is used to directly interact with the user; The independent PC (1) is provided with an interactive server (10), and the interactive server (10) is used to provide data exchange and synchronization services for a plurality of MR all-in-one machines (2) in the local area network; The kart (3) is equipped with a control mainboard, and the control mainboard is equipped with a vehicle control system (30). The vehicle control system (30) is used to receive instructions from an interactive server (10) and an MR kart client software (20), thereby controlling the operation of the kart (3).
2. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 1 is characterized in that: It also includes off-site interactive software (40) configured on the cloud server (4), wherein the off-site interactive software (40) is developed on the mini-program and the APP, and is used to record the user's game information and enable off-site users to interact with on-site users.
3. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 2 is characterized in that: At least one MR all-in-one device (2) is also equipped with a map editor software (21), which is used to edit and draw an augmented reality kart (3) map based on the positioning information of the MR all-in-one device (2), and import the map into an interactive server (10) of an independent PC (1) in the form of a map file. The interactive server (10) is also used to uniformly distribute the map file to each MR kart client software (20) added to the interactive server (10), thereby synchronizing the overall map information.
4. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 3 is characterized in that: The MR all-in-one machine (2) is a PICO or QUEST device; the MR kart client software (20) is developed based on the Unreal Engine and runs on the MR all-in-one machine (2) as a client; A two-way communication architecture is established between the MR kart client software (20) and the interactive server (10) based on remote procedure calls, so that the interactive server (10) can synchronize map information and real-time events to each MR kart client software (20), and the MR kart client software (20) can send local operations to the interactive server (10).
5. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 4 is characterized in that: The MR all-in-one device (2) is connected to the control mainboard of the kart (3) via a TypeC-USB cable, the control mainboard is connected to the power system of the kart (3), and communication with the kart (3) is achieved via the MR kart client software (20); Based on USB HID hardware communication, the MR all-in-one device (2) controls the go-kart (3), and at the same time, the relevant information of the go-kart (3) is fed back to the MR all-in-one device (2).
6. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 5 is characterized in that: The steering wheel of the go-kart (3) is provided with a plurality of buttons, each of which is directly connected to the control mainboard of the go-kart (3). The buttons are used for users to perform real-time interactive triggering and feed back the triggering results to the MR all-in-one machine (2).
7. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 4 is characterized in that: When the system is used, the absolute coordinates of the vehicle body are calibrated by a 6DOF TRACKER locator fixed on the kart (3), and the relative coordinates of the user on the kart (3) are marked by a 6DOF handle provided by the MR all-in-one device (2), and both the absolute coordinates and the relative coordinates are uploaded to an interactive server (10) in real time.
8. A multi-person offline interaction method based on MR spatial positioning and vehicle-machine interaction, characterized in that: The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to any one of claims 3 to 7 is adopted, and comprises the following steps: S1, based on the map editor software (21), the augmented reality kart (3) map is edited and drawn, and imported into the interactive server (10) of the independent PC (1) in the form of a map file; S2, the interactive server (10) uniformly distributes the map file to each MR kart client software (20) added to the interactive server (10), thereby synchronizing the overall map information; S3. Several users in the venue ride on the kart (3) and wear the MR all-in-one device (2); S4, the MR kart client software (20) starts running, and the kart (3) starts operating; S5. While operating the kart (3), the user in the venue can interact with other users in the venue based on the MR kart client software (20) and the interactive server (10).
9. The multi-person offline interaction method based on MR spatial positioning and vehicle-machine interaction according to claim 8 is characterized in that: In step S1, when editing and drawing a map file, the administrator pre-arranges a virtual question mark box in the map file for users in the field to pick up virtual props; In step S5, users in the venue can use virtual props through buttons configured on the steering wheel of the kart (3).
10. The multi-person offline interactive system based on MR spatial positioning and vehicle-machine interaction according to claim 8, characterized in that: In step S5, off-site users can interact with on-site users through the off-site interactive software (40) on the mini-program and APP.
Citation Information
Patent Citations
An information exchange method and device based on a virtual space scene
CN109426333A
Server mainboard and step-down power supply circuit
CN113641236A
Intelligent cabin system based on multimode interaction and virtual reality technology
CN115195637A
Mixed reality bumper car amusement system
CN116850602A
Sealing apparatus
KR102699598B1