Vehicle-mounted virtual reality synchronization system

Abstract

The invention provides a vehicle-mounted virtual reality synchronization system, which can solve the problem of motion sickness caused by mismatching of vehicle dynamic motion and visual perception in a vehicle-mounted environment of traditional VR. The system collects the acceleration, angular velocity and GPS position information of a vehicle through the sensor module, and the data analysis module maps the information to a virtual camera coordinate system in real time. The virtual camera motion control module ensures that the motion of the virtual camera is synchronized with the actual motion of the vehicle. And the dynamic scene response module adjusts the virtual scene according to the vehicle state to enhance the immersion. Finally, the virtual reality equipment provides a dynamic VR picture synchronous with the vehicle motion, the motion sickness symptom is reduced, and the user experience is improved. Furthermore, the system has the design of light weight and low power consumption, is suitable for various vehicles, and has a wide application prospect.

Description

Technical Field

[0001] The present invention relates to virtual reality (VR) technology and vehicle-mounted equipment, and in particular to a vehicle-mounted virtual reality synchronization system. Background Art

[0002] With the development of autonomous driving and intelligent vehicle technology, more and more in-vehicle entertainment systems have begun to introduce virtual reality (VR) technology to provide passengers with an immersive visual experience. In the in-vehicle scene, virtual reality can be applied not only to entertainment and games, but also to immersive work, reading, virtual tourism, etc., so that passengers can have a richer experience during the journey. However, due to the dynamic characteristics of the in-vehicle environment, traditional VR systems face many technical challenges when used in the car. The dynamic movements of the vehicle, such as acceleration, deceleration, and turning, often do not match the visual perception of the passengers, which can easily cause motion sickness.

[0003] Motion sickness is a physiological reaction caused by a perceptual conflict between the visual and vestibular systems, usually manifested as dizziness, nausea, vomiting, sweating, etc. In a mobile environment, the passenger's vestibular system will perceive the movement of the vehicle, but if the VR image fails to update synchronously, the passenger's visual perception will be inconsistent with the actual movement. This sensory conflict will confuse the brain, thereby exacerbating the symptoms of motion sickness.

[0004] In existing in-vehicle VR systems, image delays, update lags, or visual feedback that does not match actual movement exacerbates this conflict. This not only affects the comfort of the VR experience, but may also cause more severe motion sickness, especially when used for a long time. Therefore, in order to ensure the comfort of passengers when using VR devices in the car, how to keep the VR image highly synchronized with the vehicle movement has become a key issue that needs to be solved.

[0005] Traditional in-vehicle VR systems are large in size, complex to install, and have data transmission delays, making it difficult to achieve high-quality dynamic synchronization. The specific shortcomings are as follows:

[0006] 1. Complex installation and use

[0007] Existing solutions often require complex wired connections, including the connection between sensors and computers, and the connection between computers and VR devices, which makes the system installation in the car cumbersome and the user experience poor.

[0008] 2. Strong equipment dependence

[0009] The system relies on high-performance computing devices for data processing, which makes the in-vehicle VR system not portable and unable to adapt to the flexible application of various types of vehicles, limiting the popularity of the system.

[0010] 3. High latency screen updates

[0011] Due to the long data transmission path and the lack of synchronization of sensor data, the VR screen has a large delay, making it difficult to achieve real-time updates. There is a clear lack of synchronization with the movement of the vehicle, which can easily cause dizziness and other discomfort.

[0012] 4. High power consumption and insufficient battery life

[0013] High-performance computing devices and sensor modules consume large amounts of power and are difficult to use for long periods of time. They place high demands on vehicle power and battery life, which is not conducive to convenient user use.

[0014] It should be noted that the information disclosed in the above background technology section is only used for understanding the background of the present application, and therefore may include information that does not constitute prior art known to ordinary technicians in the field. Summary of the invention

[0015] The main purpose of the present invention is to overcome the defects existing in the above-mentioned background technology and provide a vehicle-mounted virtual reality synchronization system.

[0016] To achieve the above object, the present invention adopts the following technical solutions:

[0017] A vehicle-mounted virtual reality synchronization system, comprising:

[0018] The sensor module is used to collect the vehicle's acceleration, angular velocity and satellite navigation positioning information;

[0019] A data analysis module, used to analyze and process the data received from the sensor module, and convert and map the acceleration, angular velocity and satellite navigation positioning position information in the data into the coordinate system of the virtual camera;

[0020] A virtual camera motion control module is used to adjust the rotation, movement and other parameters of the virtual camera in real time based on the acceleration, angular velocity and satellite navigation positioning data processed by the data analysis module to maintain the consistency of the movement of the virtual camera with the actual movement of the vehicle, wherein when the vehicle accelerates, the virtual camera angle of view is adjusted to tilt forward, and when the vehicle turns, the virtual camera is rotated smoothly to maintain synchronization of the user's angle of view;

[0021] Dynamic scene response module, used to trigger different scene changes or visual effects according to the vehicle's motion state to enhance the immersiveness of the virtual reality experience;

[0022] Virtual reality equipment is used to update the virtual scene in real time according to the motion parameters of the virtual camera, and provide dynamic VR images synchronized with the movement of the vehicle to reduce the user's motion sickness and provide an immersive experience.

[0023] Furthermore, the sensor module includes an inertial measurement unit (IMU) for collecting three-axis acceleration and angular velocity of the vehicle in real time.

[0024] Furthermore, a low-power microcontroller with Wi-Fi communication function is used to establish an independent Wi-Fi network through access point AP mode to achieve wireless transmission of data.

[0025] Furthermore, data transmission uses the WebSocket protocol for data communication, ensuring that applications in VR devices can obtain and parse data in real time.

[0026] Furthermore, the virtual reality device has a high-resolution display and a motion sensing module to ensure real-time display of scene changes.

[0027] Furthermore, it includes a power management module having an overload protection and a low power management module to provide a stable power supply.

[0028] Furthermore, the software design includes:

[0029] The data acquisition and packaging module communicates with the IMU and GPS modules through the I2C or SPI interface to collect three-axis acceleration, angular velocity, speed and position information, and pre-processes the data through filtering algorithms;

[0030] Data transmission module, used to create an AP network so that VR devices can be directly connected to the ESP32 microcontroller network to achieve data transmission;

[0031] The receiving and synchronization module of the Unity application is used to receive data in JSON format from the ESP32 microcontroller, parse various sensor data in real time, and drive the changes in the viewing angle and position of the virtual camera.

[0032] Furthermore, the dynamic scene response module triggers different scene changes or visual effects according to the vehicle's motion state, including simulating the sense of speed when the vehicle accelerates and the change in depth of field when the vehicle turns.

[0033] Furthermore, the sensor module includes a global positioning system (GPS) module for acquiring satellite navigation positioning position information of the vehicle.

[0034] Furthermore, the sensor module obtains data such as vehicle speed and engine speed through the OBD-II interface.

[0035] The present invention has the following beneficial effects:

[0036] The in-vehicle virtual reality synchronization system of the present invention provides a lightweight and highly expandable solution for the dynamic characteristics in the in-vehicle environment to cope with the technical challenges of the traditional VR system when used in the car. The system collects the acceleration, angular velocity and satellite navigation positioning position information of the vehicle in real time through the sensor module, ensuring the accurate capture of the vehicle dynamics. The data analysis module further converts and maps these data into the coordinate system of the virtual camera in real time, achieving a high degree of consistency between the virtual camera movement and the actual movement of the vehicle. The virtual camera motion control module adjusts the parameters of the virtual camera in real time according to the dynamic data of the vehicle, effectively reducing the conflict between visual and vestibular perception, and alleviating the symptoms of motion sickness. The dynamic scene response module intelligently adjusts the virtual scene according to the motion state of the vehicle, especially simulating the sense of speed during acceleration and the change in depth of field during turning, enhancing the immersion of the virtual reality experience and the adaptability to the changes in vehicle state. The virtual reality device can update the virtual scene in real time according to the motion parameters of the virtual camera, provide a dynamic VR picture synchronized with the vehicle movement, enhance the immersive experience of passengers, and significantly reduce the motion sickness symptoms caused by the conflict between visual and vestibular perception, ensuring the comfort and safety under long-term use. The technical solution of the present invention optimizes the VR experience of passengers through highly synchronized VR images and vehicle movements, while reducing the impact of motion sickness, and provides an innovative solution for applying virtual reality technology in a vehicle environment. In addition, the system's lightweight, low-power design, and independent wireless AP network function make it suitable for a variety of vehicle types, providing a new solution for the promotion and popularization of vehicle-mounted VR applications, with high practical value and good application prospects.

[0037] Other beneficial effects of the embodiments of the present invention will be further described below. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 Schematic diagram of the structure of the vehicle-mounted virtual reality synchronization system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following is a detailed description of the embodiments of the present invention. It should be emphasized that the following description is only exemplary and is not intended to limit the scope and application of the present invention.

[0040] It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it can be directly on the other element or indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element. In addition, connection can be used for fixing as well as for coupling or communication.

[0041] It should be understood that the orientation or position relationship indicated by terms such as "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

[0042] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0043] See also Figure 1 The embodiment of the present invention provides a vehicle-mounted virtual reality synchronization system, including a sensor module, a data analysis module, a virtual camera motion control module, a dynamic scene response module and a virtual reality device. The sensor module is used to collect the acceleration, angular velocity and satellite navigation positioning position information of the vehicle. The data analysis module is used to analyze and process the data received from the sensor module, and convert and map the acceleration, angular velocity and satellite navigation positioning position information in the data into the coordinate system of the virtual camera. The virtual camera motion control module is used to adjust the rotation, movement and other parameters of the virtual camera in real time based on the acceleration, angular velocity and satellite navigation positioning data processed by the data analysis module to maintain the consistency of the movement of the virtual camera with the actual movement of the vehicle, wherein when the vehicle accelerates, the virtual camera angle of view is adjusted to tilt forward, and when the vehicle turns, the virtual camera is rotated smoothly to maintain the synchronization of the user's angle of view. The dynamic scene response module is used to trigger different scene changes or visual effects according to the movement state of the vehicle, including simulating the speed sense when the vehicle accelerates and the depth of field change when the vehicle turns, so as to enhance the immersion of the virtual reality experience. Among them, the functions of the data analysis module, the virtual camera motion control module and the dynamic scene response module can be implemented by a microcontroller and / or a processor. In a preferred embodiment, functions such as data analysis, virtual camera motion control and dynamic scene response are implemented in the Unity environment. The virtual reality device includes a VR head display, which is used to update the virtual scene in real time according to the motion parameters of the virtual camera, and provide a dynamic VR picture synchronized with the vehicle movement to reduce the user's motion sickness symptoms and provide an immersive experience.

[0044] The vehicle-mounted virtual reality synchronization system of the present invention synchronously collects the dynamic data of the vehicle, including acceleration, angular velocity and satellite navigation positioning information, and uses the data analysis module to convert and map these data in real time to the coordinate system of the virtual camera, thereby achieving a high degree of consistency between the virtual camera movement and the actual movement of the vehicle. The system intelligently adjusts the virtual scene according to the vehicle's motion state through the dynamic scene response module, effectively simulating the sense of speed during acceleration and the change in depth of field during turning, thereby enhancing the immersiveness of the virtual reality experience. In addition, the virtual reality device can update the virtual scene in real time according to the motion parameters of the virtual camera, and provide a dynamic VR picture synchronized with the vehicle movement, which not only enhances the immersive experience of the passengers, but also significantly reduces the motion sickness symptoms caused by the conflict between vision and vestibular perception, ensuring comfort and safety under long-term use. Overall, the technical solution of the present invention optimizes the VR experience of passengers through highly synchronized VR pictures and vehicle movements, while reducing the impact of motion sickness, and provides an innovative solution for applying virtual reality technology in a vehicle-mounted environment. In addition, the dynamic scene response module triggers different scene changes or visual effects according to the vehicle's motion state, including simulating the sense of speed when the vehicle accelerates and the change of depth of field when the vehicle turns. It also enhances the user's visual experience and adaptability to changes in vehicle status, and makes the virtual reality environment more realistic and intuitive.

[0045] The real-time scene adaptability of the present invention not only improves the immersion of VR content, but also helps reduce the motion sickness symptoms caused by the inconsistency between vision and vestibular sensation, providing a more comfortable and natural in-vehicle virtual reality experience. Through the above scheme, the system of the present invention can better adapt to the user's perception needs, making the application of virtual reality in a dynamic vehicle environment more feasible and popular, with high practical value and good application prospects.

[0046] In some embodiments, the sensor module includes an inertial measurement unit (IMU) for real-time acquisition of the vehicle's three-axis acceleration and angular velocity. Further, the sensor module includes a global positioning system (GPS) module for obtaining satellite navigation positioning information of the vehicle. Further, the sensor module obtains data such as vehicle speed and engine speed through an OBD-II interface. The virtual reality device has a high-resolution display and a motion sensing module to ensure real-time display of scene changes.

[0047] In some embodiments, a low-power microcontroller is used, which has a Wi-Fi communication function, and an independent Wi-Fi network is established through the access point AP mode to realize wireless data transmission. Data transmission uses the WebSocket protocol for data communication to ensure that the application in the VR device can obtain and parse data in real time. The power management module has an overload protection and a low-power management module to provide a stable power supply. The software design includes: a data acquisition and packaging module, which communicates with the IMU and GPS modules through the I2C or SPI interface to collect three-axis acceleration, angular velocity, speed and position information, and pre-processes the data through a filtering algorithm; a data transmission module, which is used to create an AP network so that the VR device can be directly connected to the network of the ESP32 microcontroller to realize data transmission; the receiving and synchronization module of the Unity application is used to receive data in JSON format from the ESP32 microcontroller, and parse various sensor data in real time to drive the perspective and position changes of the virtual camera.

[0048] Therefore, the embodiment of the present invention proposes a lightweight, low-power wireless vehicle-mounted VR synchronization system to meet the requirements of portability, synchronization and low power consumption in the vehicle environment. The system realizes the collection and wireless transmission of vehicle motion data through a low-power single-chip microcomputer and a variety of sensors, eliminates the dependence on external high-performance computing devices and wired connections, and realizes a simpler and more flexible vehicle-mounted VR application. The system of the present invention is not only suitable for common VR head displays (such as Oculus Quest3, etc.), but also supports a flexible combination of multiple sensors (such as IMU, GPS, OBD-II interface, etc.), which can realize real-time collection of data such as vehicle acceleration, speed and direction, and realize low-latency transmission through the WebSocket protocol. The independent wireless AP network function of the system ensures the stability of data transmission, enables the VR screen to be highly synchronized with the vehicle movement, and enhances the immersion and comfort of the VR experience. In addition, the modular and low-power design of the system makes it suitable for a variety of vehicle types, providing a new solution for the promotion and popularization of vehicle-mounted VR applications.

[0049] Examples

[0050] 1. Hardware Composition

[0051] 1. Virtual Reality Devices: Compatible with a variety of VR devices (such as Oculus Quest 3 or other compatible devices), with high-resolution displays and motion sensing capabilities to ensure real-time display of scene changes.

[0052] 2. Sensor module: The system has a variety of sensor modules to fully obtain the real-time motion status of the vehicle, including but not limited to:

[0053] Inertial measurement unit (IMU): such as MPU6050, MPU9250, etc., which can collect the vehicle's three-axis acceleration and angular velocity in real time.

[0054] GPS module: obtains geographic location information and speed data to achieve location synchronization.

[0055] OBD-II interface: Connect to the vehicle's OBD-II interface to obtain accurate vehicle speed, engine speed and other data to further enhance the synchronization effect of vehicle movement.

[0056] 3. Data transmission module: Using low-power microcontrollers such as ESP32, it has Wi-Fi communication function and can establish an independent Wi-Fi network through AP (access point) mode, so as to realize data transmission without relying on external networks, ensuring data privacy and transmission stability.

[0057] 4. Power management module: Provide an independent power management module to provide stable power supply to support long-term VR experience. The power module can be a lithium battery or a vehicle power supply interface, and has overload protection and low power management functions.

[0058] 2. System Software Design

[0059] 1. Data collection and packaging module: ESP32 realizes data collection and processing through programming. It communicates with the IMU and GPS modules through the I2C or SPI interface to collect three-axis acceleration, angular velocity, speed and position information, and collects other vehicle dynamic data through the OBD-II interface. It uses filtering algorithms (such as Kalman filtering or low-pass filtering) to pre-process the data to reduce sensor noise and improve data stability. The data collection frequency can be adjusted according to the real-time requirements of the VR scene, and the data is packaged in JSON format to ensure universality and cross-platform compatibility.

[0060] 2. Data transmission module: ESP32 acts as a Wi-Fi server to create an AP network, allowing VR devices to directly connect to the ESP32 network, thereby achieving data transmission without relying on an external Wi-Fi network. Data transmission uses the WebSocket protocol, which can achieve two-way, low-latency data communication, ensuring that applications in VR devices can obtain and parse data in real time.

[0061] 3. Unity application receiving and synchronization module: Use Unity as a WebSocket client to receive data in JSON format from ESP32 and parse various sensor data in real time. Unity uses this data to drive the perspective and position changes of the virtual camera to achieve synchronization between vehicle movement and VR scene.

[0062] 3. Control Process

[0063] Data parsing: Parse the incoming JSON data through C# script in Unity, and map information such as acceleration, angular velocity, and GPS to the coordinate system of the virtual camera.

[0064] Virtual camera motion: Based on IMU and GPS data, the Unity application adjusts the rotation, movement and other parameters of the virtual camera in real time to maintain consistency with the vehicle's motion. For example, when the vehicle accelerates, the virtual camera's perspective tilts forward; when the vehicle turns, the camera rotates smoothly, allowing the user to always maintain the correct perspective synchronization.

[0065] Dynamic scene response: triggers different scene changes or visual effects based on the vehicle's motion state, such as simulating the sense of speed during acceleration and the change in depth of field during cornering, to enhance the immersiveness of the VR experience.

[0066] 4. System Implementation

[0067] 1. System parameters

[0068] After experimental verification, the system parameter configuration implemented by the present invention includes an Oculus Quest 3 virtual reality device with a resolution of 2064×2208 (per eye), a field of view of 110 degrees, a screen refresh rate of 90Hz, running on a Qualcomm Snapdragon XR2 processor, with a built-in 512GB storage space, an operating system of Android 10, and supports direct loading and running of APK applications. In terms of the software environment, the development platform uses Unity3D 2021.3.6f1 version and is equipped with the OpenXR Plugin plug-in to realize data interaction and scene rendering of VR devices, and uses the WebSocket protocol to receive sensor data transmitted by ESP32 through the network module in Unity3D. The sensor module includes an MPU6050 inertial measurement unit (IMU) and an ATGM336H-5N GPS module, which respectively collect acceleration, angular velocity and position information, with data sampling frequencies of 100Hz and 1Hz, respectively, and an error range of ±2%. The OBD-II interface uses an ELM327 Bluetooth adapter with a sampling frequency of 5Hz, which can obtain vehicle data such as vehicle speed, rotation speed and throttle position. The system uses an ESP32 DevKitC microcontroller with an operating frequency of 240MHz. It is connected to the OculusQuest 3 through an independent Wi-Fi AP mode with a data transmission delay of less than 10ms. The WebSocket protocol is used for real-time sensor data transmission in JSON format.

[0069] 2. System operation process

[0070] 1) Hardware configuration and data collection

[0071] Connect the IMU, GPS module, and OBD-II interface to ESP32 and start collecting the vehicle's motion, speed, and location data.

[0072] 2) Data transmission settings

[0073] ESP32 creates an AP network, connects the VR device to the network, and sends data to the network client in Unity via WebSocket.

[0074] 3) Data reception and synchronization in Unity

[0075] Parse JSON data in Unity and use acceleration, angular velocity, and GPS information to synchronize updates of virtual cameras and scene elements.

[0076] 4) Scene dynamic response and feedback

[0077] In Unity, according to the real-time status of the vehicle, the visual elements in the camera and scene are adjusted to achieve dynamic synchronization of VR images.

[0078] 5) System calibration and performance optimization

[0079] By adjusting the sensor data collection frequency, data transmission interval and Unity rendering performance, the smoothness and stability of the system are ensured.

[0080] V. Effects and advantages:

[0081] Wireless data transmission, improving portability and flexibility

[0082] The system uses the ESP32 microcontroller to create an AP (access point) network via Wi-Fi, and sends sensor data directly to the VR headset through the wireless network, thus achieving seamless data transmission. It eliminates the reliance on computers and the constraints of cables, making it easy to install and portable, and also avoids the risk of cable entanglement or breakage.

[0083] Lightweight, low power design

[0084] The system uses ESP32 as a microcontroller and wireless transmission module, which has the characteristics of low power consumption and light weight, and is suitable for long-term operation in a vehicle environment. ESP32 itself is small and easy to install, which greatly reduces the volume requirement of the equipment and improves the flexibility of the system.

[0085] Work independently and reduce equipment dependence

[0086] By directly processing sensor data through a microcontroller, the system is freed from the reliance on high-performance computers, allowing it to operate independently. The system only requires power support and can adapt to various vehicle environments. It no longer requires a dedicated computer for data processing and image streaming, greatly improving the applicability of the system.

[0087] Reduce data delay and achieve high real-time synchronization

[0088] The WebSocket protocol is used to achieve low-latency communication between ESP32 and the VR headset, and the sensor data is sent to the VR headset in real time, which greatly reduces the delay. The data is directly processed and analyzed in the Unity application, and the VR scene is adjusted in real time to ensure that the VR picture is synchronized with the vehicle movement, effectively reducing the user's dizziness.

[0089] Modularity and scalability

[0090] This system is designed with high modularity and expandability, and can be adapted to different models of IMU, GPS modules and other sensors, or obtain vehicle speed and other data through the OBD-II interface. Each module can work independently or be used in combination according to needs, so that the system can adapt to different vehicles and user needs, and has a wider range of applications.

[0091] The present invention provides a lightweight, highly expandable in-vehicle VR system, which realizes real-time synchronization of VR images and vehicle movement in an in-vehicle environment. The system collects vehicle movement and position information, and combines VR equipment to provide users with real-time and smooth virtual reality experience, and updates virtual scenes in real time according to actual vehicle movement, thereby reducing users' motion sickness symptoms and enhancing the immersion and stability of the VR experience. Moreover, the system's lightweight, low-power design, as well as independent wireless AP network functions, meet the requirements for portability, synchronization, and low power consumption in an in-vehicle environment, and realize a simpler and more flexible in-vehicle VR application. These advantages also make the present invention applicable to a variety of vehicle types, providing a new solution for the promotion and popularization of in-vehicle VR applications, and having high practical value and good application prospects.

[0092] The above content is a further detailed description of the present invention in combination with specific / preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, without departing from the concept of the present invention, it can also make several substitutions or modifications to these described embodiments, and these substitutions or modifications should be regarded as belonging to the protection scope of the present invention. In the description of this specification, the description of the reference terms "an embodiment", "some embodiments", "preferred embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in combination with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily target the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In the absence of mutual contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples. Although the embodiments of the present invention and their advantages have been described in detail, it should be understood that various changes, substitutions and modifications can be made herein without departing from the scope of protection of the patent application.

Claims

1. A vehicle-mounted virtual reality synchronization system, characterized in that: include: Sensor module, used to collect vehicle acceleration, angular velocity and satellite navigation positioning information; A data analysis module, used to analyze and process the data received from the sensor module, and convert and map the acceleration, angular velocity and satellite navigation positioning position information in the data into the coordinate system of the virtual camera; A virtual camera motion control module, which is used to adjust the rotation and movement parameters of the virtual camera in real time based on the acceleration, angular velocity and satellite navigation positioning data processed by the data analysis module to keep the movement of the virtual camera consistent with the actual movement of the vehicle, wherein when the vehicle accelerates, the virtual camera's perspective is adjusted to tilt forward, and when the vehicle turns, the virtual camera is rotated smoothly to maintain synchronization with the user's perspective; Dynamic scene response module, used to trigger different scene changes or visual effects according to the vehicle's motion state to enhance the immersiveness of the virtual reality experience; Virtual reality equipment is used to update the virtual scene in real time according to the motion parameters of the virtual camera, and provide dynamic VR images synchronized with the movement of the vehicle to reduce the user's motion sickness and provide an immersive experience.

2. The vehicle-mounted virtual reality synchronization system according to claim 1, characterized in that: The sensor module includes an inertial measurement unit (IMU) for collecting the three-axis acceleration and angular velocity of the vehicle in real time.

3. The vehicle-mounted virtual reality synchronization system according to claim 1 or 2, characterized in that: Using a low-power microcontroller with Wi-Fi communication function, an independent Wi-Fi network is established through the access point AP mode to achieve wireless data transmission.

4. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 3, characterized in that: Data transmission uses the WebSocket protocol for data communication, ensuring that applications in VR devices can obtain and parse data in real time.

5. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 4, characterized in that: The virtual reality device has a high-resolution display and a motion sensing module to ensure real-time display of scene changes.

6. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 5, characterized in that: Includes a power management module with overload protection and a low power management module to provide a stable power supply.

7. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 6, characterized in that: Software design includes: The data acquisition and packaging module communicates with the IMU and GPS modules through the I2C or SPI interface to collect three-axis acceleration, angular velocity, speed and position information, and pre-processes the data through filtering algorithms; Data transmission module, used to create an AP network so that VR devices can be directly connected to the ESP32 microcontroller network to achieve data transmission; The receiving and synchronization module of the Unity application is used to receive data in JSON format from the ESP32 microcontroller, parse various sensor data in real time, and drive the changes in the viewing angle and position of the virtual camera.

8. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 7, characterized in that: The dynamic scene response module triggers different scene changes or visual effects according to the vehicle's motion state, including simulating the sense of speed when the vehicle accelerates and the change in depth of field when the vehicle turns.

9. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 8, characterized in that: The sensor module includes a global positioning system (GPS) module for acquiring satellite navigation positioning position information of the vehicle.

10. The vehicle-mounted virtual reality synchronization system according to any one of claims 1 to 9, characterized in that: The sensor module obtains data such as vehicle speed and engine speed through the OBD-II interface.

Images