Immersive driving control system and method based on dynamic scene reconstruction and vehicle

Abstract

The invention relates to an immersive driving control system and method based on dynamic scene reconstruction and a vehicle. The immersive driving control system comprises a data acquisition module, a data storage module, a scene control module and a multi-mode interaction display module. The data acquisition module is used for acquiring a control signal, vehicle driving data and driver operation data; the output end of the data acquisition module is connected with the scene control module; a configuration database of the immersive driving mode is stored in the data storage module, configuration parameters included in the configuration database comprise interface display parameters, dynamic effect parameters, sound effect and light parameters and user-defined parameters, and the data storage module is connected with the scene control module; the scene control module is used for receiving the data acquired by the data acquisition module, calling the configuration parameters of the data storage module and realizing dynamic reconstruction of the driving scene; and the multi-mode interactive display module is connected with the scene control module and is used for presenting the dynamic reconstruction scene and receiving user operation. According to the invention, immersive driving experience can be created for the user.

Description

Technical Field

[0001] This invention belongs to the field of driving mode technology, specifically relating to an immersive driving control system, method, and vehicle based on dynamic scene reconstruction. Background Technology

[0002] With the continuous development of automotive intelligence technology, users' demands for the driving experience and immersion are increasing. They are no longer satisfied with basic driving functions but are pursuing higher performance and more personalized driving experiences. However, traditional driving modes have significant shortcomings in terms of interactive experience and functional adaptability. For example, the mode switching methods are relatively simple, and the linkage between driving scenarios and in-vehicle interactions is poor, making it difficult to meet the current users' upgraded driving experience needs. Therefore, developing a driving mode system and corresponding control methods with dynamic scene reconstruction capabilities, adaptability to multiple scenarios, and the ability to provide a strong sense of interactive immersion has become an important development direction in the field of automotive intelligence and is of great necessity. In the existing technology, one technical solution proposes that after a vehicle enters a specific driving mode, it will run a corresponding driving atmosphere. This driving atmosphere may include one or more of visual parameters, auditory parameters, olfactory parameters, and tactile parameters. However, this solution is more inclined to provide different hardware feedback to the vehicle at different speeds, and fails to achieve real-time linkage between vehicle status and interface animation, resulting in a lack of immersive presentation. Another technical solution points out that after the vehicle enters the preset driving mode, the target attributes of the target effect can respond in real time to the dynamic changes of the vehicle's driving status data, thereby making the rendering of the vehicle's driving atmosphere more personalized. However, this solution does not clearly explain the specific conditions for triggering the driving mode and the detailed rendering method of the target effect, which limits its operability and adaptability in practical applications and makes it difficult to fully meet users' needs for a diverse and high-quality driving experience.

[0003] Therefore, it is necessary to develop a new immersive driving control system, method, and vehicle based on dynamic scene reconstruction. Summary of the Invention

[0004] The purpose of this invention is to provide an immersive driving control system, method, and vehicle based on dynamic scene reconstruction, which can create an immersive driving experience for users.

[0005] To achieve the above objectives, the technical solution adopted by the present invention is as follows: In a first aspect, the present invention provides an immersive driving system based on dynamic scene reconstruction, which includes a data acquisition module, a data storage module, a scene control module, and a multimodal interactive display module. The data acquisition module is used to acquire control signals, vehicle driving data, and driver operation data; the output of the data acquisition module is connected to the scene control module. The data storage module stores a configuration database for the immersive driving mode. The configuration database includes configuration parameters such as interface display parameters, dynamic effect parameters, sound and lighting parameters, and user-defined parameters. The data storage module is connected to the scene control module. The scene control module is used to receive data collected by the data acquisition module and call the configuration parameters of the data storage module to realize dynamic reconstruction of the driving scene; The multimodal interactive display module is connected to the scene control module and is used to present dynamically reconstructed scenes and receive user operations.

[0006] In one possible implementation, the control signal includes at least one of acceleration, steering wheel angle signal, motor speed signal, and lane-level positioning data; The vehicle driving data includes at least one of vehicle speed, motor power, and suspension status; The driver operation data includes at least one of the following: accelerator pedal opening, brake pedal travel, and steering wheel rotation angle. This clarifies the specific content of the control signals, vehicle driving data, and driver operation data acquired by the data acquisition module, enabling the system to more accurately collect key information related to the driving scenario. This provides a rich and accurate data foundation for subsequent scenario control and dynamic reconstruction, ensuring that the system can make more precise responses and adjustments based on actual driving conditions.

[0007] One possible implementation is that the interface display parameters include at least one of full-screen layout rules, card layout rules, and status bar display content; The dynamic effect parameters include at least one of the trigger thresholds for depth of field, jet spray, and wheel hub imprint effects; The sound and lighting parameters include the mapping relationship between the background music volume level and the ambient light color; The full-screen layout rule requires the driver's information display screen and the central control touchscreen to display the vehicle's 3D model, the top status bar, the bottom dock, and the motor power. The card-style layout rule requires that only the vehicle's 3D model and the current motor speed be displayed on the left side of the screen. The document details the specific content of the interface display parameters, dynamic effect parameters, and sound and lighting parameters in the configuration database, providing a more detailed parameter configuration basis for achieving immersive driving scenarios. By setting and adjusting these parameters, the display effect of the interface, the presentation of dynamic effects, and the coordination of sound and lighting can be optimized, thereby enhancing the user's immersive driving experience.

[0008] In one possible implementation, the scene control module adjusts the interface animation effects synchronously based on vehicle driving data and driver operation data. The adjustment of the interface animation effects requires calling the depth of field, jet, and wheel imprint effect trigger thresholds in the dynamic effect parameters. At the same time, it controls the sound effects and ambient lights in a coordinated manner. The coordinated control of the sound effects and ambient lights requires calling the mapping relationship between the background music volume level and the ambient light color in the sound effect and lighting parameters. The scene control module also responds to user mode switching commands and allows users to customize the activation status of the rear wing and suspension effects, as well as the volume level of the engine sound, through the multimodal interactive display module. The adjusted parameters are synchronously stored in the user-defined parameters of the data storage module. Specifically, the functions of the scene control module are described, including adjusting interface animations based on data, controlling sound effects and ambient lighting in conjunction with the system, responding to user mode switching commands, and supporting user-defined adjustments. This enables the system to dynamically adjust interface effects, sound effects, and lighting based on real-time driving data and user operations, achieving a multimodal interactive experience while meeting personalized user needs, further enhancing the system's flexibility and the richness of the user experience.

[0009] One possible implementation is that the multimodal interactive display module includes a driver information display screen, a central control touchscreen, and an ambient lighting component. The driver information display screen and the central control touchscreen are connected to the scene control module. The ambient lighting component is linked to the scene control module, gradually brightening during the mode loading phase, maintaining a fixed color during normal operation, and synchronously flashing rapidly in a breathing pattern when a jet effect is triggered. This clarifies the specific components of the multimodal interactive display module—the driver information display screen, the central control touchscreen, and the ambient lighting component—and their connection and linkage with the scene control module. This facilitates multi-dimensional information display and interaction, providing the driver with more comprehensive and intuitive driving information and a more immersive driving atmosphere through different display devices and lighting effects.

[0010] Secondly, the immersive driving control method based on dynamic scene reconstruction described in this invention employs the immersive driving system based on dynamic scene reconstruction as described in this invention, and the method includes the following steps: S1. The data acquisition module acquires control signals, vehicle driving data, and driver operation data in real time. S2. The scene control module receives the trigger command and judges the current vehicle status. If it is in the reversing state, it will not start for the time being. If it is in the normal driving or parking state, it will start the immersive driving mode. S3. The scene control module loads the corresponding scene configuration parameters according to the trigger command and real-time collected data, performs driving mode rendering, and drives the multimodal interactive display module to present the dynamic scene. S4, The scene control module dynamically adjusts the scene effects based on real-time data; S5. When a trigger exit command is received, the immersive driving mode ends.

[0011] One possible implementation is that the driving mode rendering in S3 includes three parts: interface rendering, sound effect control, and lighting linkage, as detailed below: Interface rendering: Except for the reverse forced interface, all other interfaces display the immersive driving mode rendering effect. The default is to enter full screen mode. Full screen mode and card mode can be switched by button. Both interfaces show the vehicle in a stationary or moving state. Sound effects control: After the initial sound effect playback ends, the background music continues to play. The background music priority is the same as the music player. The background music pauses when the music player starts and resumes when paused. It also supports turning off the background music directly. The driving sound is enabled by default. The intensity of the driving sound matches the accelerator pedal opening. It provides three volume levels (high, medium, and low) and an option to turn it off. The driving sound and background music can be muted with one click. Lighting Synchronization: During the mode loading phase, the ambient lights gradually brighten from their current brightness; during normal operation, the ambient lights maintain their default color or a user-defined color; if the user has previously customized the ambient light color, the color settings corresponding to the user-defined parameters in the data storage module are loaded. This details the interface rendering, sound effect control, and lighting synchronization. This allows for a more standardized and immersive presentation of the driving scenario when activating the immersive driving mode, including the interface layout, sound effect playback, and lighting changes, creating a more realistic and comfortable driving environment for the user.

[0012] One possible implementation, wherein the dynamic adjustment of scene effects in S4 includes the following: Depth of field effect adjustment: When the accelerator pedal is pressed, the depth of field expands with the pedal travel; when the vehicle speed reaches the preset high speed range, the vehicle 3D model triggers an airflow effect; when the brake pedal is pressed or kinetic energy recovery is activated, the depth of field narrows, and the vehicle 3D model illuminates the brake lights; when the steering wheel is turned, the depth of field angle changes synchronously with the steering direction. Jet effect adjustment: The jet effect is triggered when the accelerator pedal is pressed to a preset opening degree within a preset time, and the jet effect disappears when the pedal opening degree is retracted beyond the preset range; Wheel imprint effect adjustment: The wheel imprint effect is triggered when the vehicle speed is in a preset medium-high speed range, the steering wheel angle is greater than a first preset angle, and the brake is applied. The wheel imprint effect disappears when the vehicle speed drops to a preset low speed range or the steering wheel angle is less than a second preset angle, where the second preset angle is less than the first preset angle. The scene control module dynamically adjusts the specific rules of the scene effect based on real-time data, including the triggering and disappearance conditions of effects such as depth of field, airflow, jets, and wheel imprints under different driving operations such as acceleration, braking, and steering. This allows the system to adjust the scene effect in real time and accurately according to the driver's actual operation and the vehicle's driving status, enhancing the immersion and realism of driving.

[0013] One possible implementation, S5 specifically includes: When exiting immersive driving mode, the multimodal interaction display module reverts to the interface and sound effects state before the mode was activated, and the scene control module saves the user-defined parameters used this time, making it easy to directly recall them upon the next startup. This ensures that users can return to a familiar interface and sound environment after exiting the mode, and also allows users to directly use their previous personalized settings upon the next startup, improving the convenience and consistency of the user experience.

[0014] Thirdly, the vehicle described in this invention employs an immersive driving control system based on dynamic scene reconstruction as described in this invention.

[0015] The present invention has the following beneficial effects: (1) Solving the problems of poor interactive experience and weak linkage in traditional driving modes: This invention acquires control signals, vehicle driving data and driver operation data in real time through the data acquisition module, and links the scene control module with the multimodal interactive display module to achieve deep binding between vehicle status and interface animation. For example, when the accelerator pedal is pressed, the depth of field increases with the travel distance, the air flow effect is triggered when the vehicle speed reaches the high speed range, and the depth of field angle changes synchronously when the steering wheel is turned. This completely changes the status quo of "disconnect between scene and interaction" in traditional mode, and allows driving operation and in-vehicle scene feedback to form a real-time closed loop, which significantly improves the continuity and immersion of interaction. (2) Overcoming the shortcomings of existing technologies in terms of "single hardware feedback and lack of interface linkage": Compared with existing solutions that only focus on hardware feedback at different speeds, this invention constructs a scene in multiple dimensions of vision, hearing, and touch. For example, the interface rendering supports switching between full-screen and card modes. The full-screen mode displays core data such as the vehicle's 3D model and motor power, while the card mode focuses on key information. In terms of sound effects, the intensity of the driving sound matches the opening of the accelerator pedal. In terms of lighting, the ambient lights gradually brighten during the mode loading stage and flash synchronously when the jet effect is triggered. Through the multimodal linkage of "vision + hearing + lighting", the immersive experience far exceeds that of single hardware feedback, filling the gap in the richness of existing technologies in terms of scene. (3) Overcoming the application limitations of existing technologies such as "vague triggering conditions and unclear rendering methods": This invention clarifies the triggering and rendering logic of driving modes. For example, after the scene control module receives the triggering command, it will first determine the vehicle status and start the mode only in normal driving or parking mode, and not in reversing mode. This invention also further refines the dynamic effect rendering threshold. For example, the jet effect is triggered when the accelerator pedal is pressed to a preset opening degree in a short time, and the wheel hub imprint effect is triggered when the vehicle speed is at medium to high speed and the steering angle exceeds the first preset angle. At the same time, it supports users to customize the rear wing dynamic effect, sound gear, etc. through the multimodal interactive display module and store the parameters in the data storage module. This not only solves the problem of "poor operability" of existing technologies, but also meets the personalized needs of users and adapts to diverse driving scenarios. (4) Breaking through the bottleneck of "low functional adaptability and single switching" in the traditional mode: The data storage module of this invention has a built-in configuration database containing interface display, dynamic effects, sound effects, lighting and user-defined parameters. The scene control module can load the corresponding parameters according to real-time data to achieve flexible adaptation of "one vehicle and multiple scenes". For example, the interface rendering supports immersive effects except for the reverse forced interface. In terms of sound effects, the background music and music player can be switched intelligently, and the driving sound provides multiple gear selection. Users can switch the interface layout and customize scene parameters through buttons, which completely changes the limitation of "fixed function and single switching" in the traditional mode and meets the user's pursuit of high performance and personalized driving experience.

[0016] In summary, this invention combines driving pleasure with intelligent interaction through multi-dimensional sensory feedback and real-time data-driven interface design, creating an immersive driving experience for users. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of the immersive driving system based on dynamic scene reconstruction in the embodiments of this application; Figure 2 This is a flowchart of the immersive driving method based on dynamic scene reconstruction in the embodiments of this application; Figure 3 This is a logic diagram illustrating the implementation of the depth-of-field effect in the embodiments of this application; Figure 4 This is a logic diagram illustrating the jet effect implementation in the embodiments of this application; Figure 5 This is a logic diagram illustrating the implementation of the wheel hub print effect in the embodiments of this application; In the diagram: 1. Data acquisition module, 2. Data storage module, 3. Scene control module, 4. Multimodal interactive display module. Detailed Implementation

[0018] The embodiments of the present invention will be described below with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention and not for limiting the scope of protection of the present invention.

[0019] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner to facilitate understanding.

[0020] In the embodiments of this application, at least one can also be described as one or more, and multiple can be two, three, four or more, and this application does not impose any restrictions.

[0021] like Figure 1 As shown in the embodiment of this application, an immersive driving system based on dynamic scene reconstruction includes a data acquisition module 1, a data storage module 2, a scene control module 3, and a multimodal interactive display module 4. The data acquisition module 1 is used to acquire control signals, vehicle driving data, and driver operation data. The output of the data acquisition module 1 is connected to the scene control module 3. The data storage module 2 stores a configuration database for the immersive driving mode. The configuration database includes configuration parameters such as interface display parameters, dynamic effect parameters, sound and lighting parameters, and user-defined parameters. The data storage module 2 is connected to the scene control module 3. The scene control module 3 is used to receive data acquired by the data acquisition module and call the configuration parameters of the data storage module 2 to achieve dynamic reconstruction of the driving scene. The multimodal interactive display module 4 is connected to the scene control module 3 and is used to present the dynamically reconstructed scene and receive user operations.

[0022] This system is compatible with vehicles equipped with intelligent vehicle infotainment systems (supporting multi-screen display and sensor data interaction), and must meet the following hardware configuration requirements: 1. Computing and rendering capabilities: Equipped with a high-performance chip, it can support real-time data processing (such as millisecond-level processing of data such as vehicle speed and pedal opening) and graphics rendering (such as smooth presentation of vehicle 3D model animation and depth of field changes), avoiding animation delays or stuttering.

[0023] 2. Sensor Configuration: Equipped with multi-functional sensors, including vehicle speed sensor, steering wheel angle sensor, accelerator pedal opening sensor, brake pedal opening sensor, and motor speed sensor. Some models can be additionally equipped with lane positioning sensor and suspension status sensor to ensure that the data acquisition module 1 can accurately acquire control signals, vehicle driving data and driver operation data.

[0024] 3. Display and interaction devices: The system should be equipped with a driver information display screen (such as a full LCD instrument panel) and a central control touch screen, and support multi-screen data synchronization; it should also be equipped with ambient lighting components (such as in-vehicle ambient lighting) to meet the linkage requirements of the multimodal interactive display module 4.

[0025] In one possible embodiment, the control signal includes at least one of acceleration, steering wheel angle signal, motor speed signal, and lane-level positioning data. Vehicle driving data includes at least one of vehicle speed, motor power, and suspension status. Driver operation data includes at least one of accelerator pedal opening, brake pedal travel, and steering wheel rotation angle. By clarifying the specific content of the control signals, vehicle driving data, and driver operation data acquired by the data acquisition module 1, the system can more accurately collect key information related to the driving scenario, providing a rich and accurate data foundation for subsequent scenario control and dynamic reconstruction, ensuring that the system can make more precise responses and adjustments based on actual driving conditions.

[0026] In one possible embodiment, the interface display parameters include at least one of full-screen layout rules, card-style layout rules, and status bar display content. Dynamic effect parameters include at least one of the trigger thresholds for depth of field, jet effects, and wheel imprint effects. Sound and lighting parameters include the mapping relationship between background music volume levels and ambient light colors. The full-screen layout rules require the driver's information display screen and the central control touchscreen to display a 3D model of the vehicle, a status bar at the top, and a dock bar and motor power at the bottom. The card-style layout rules require that only the 3D model of the vehicle and the current motor speed be displayed on the left side of the screen. The specific contents of the interface display parameters, dynamic effect parameters, and sound and lighting parameters in the configuration database are detailed, providing a more detailed parameter configuration basis for achieving immersive driving scenarios. By setting and adjusting these parameters, the display effect of the interface, the presentation of dynamic effects, and the coordination of sound and lighting can be optimized, thereby enhancing the user's immersive driving experience.

[0027] In one possible embodiment, the scene control module 3 adjusts the interface animation effects synchronously based on vehicle driving data and driver operation data. Adjusting the interface animation effects requires calling the trigger thresholds for depth of field, jet propulsion, and wheel imprint effects in the dynamic effect parameters. Simultaneously, it controls the sound effects and ambient lighting in conjunction with these effects, using the mapping relationship between background music volume level and ambient light color in the sound and lighting parameters. The scene control module 3 also responds to user mode switching commands and allows users to customize the activation status of the rear wing and suspension effects, as well as the volume level of the engine sound, through the multimodal interactive display module 4. The adjusted parameters are synchronously stored in the user-defined parameters of the data storage module 2. Specifically, the functions of the scene control module 3 are described, including adjusting interface animation effects based on data, controlling sound effects and ambient lighting in conjunction with these effects, responding to user mode switching commands, and supporting user-defined adjustments. This enables the system to dynamically adjust interface effects, sound effects, and lighting based on real-time driving data and user operations, achieving a multimodal interactive experience while meeting personalized user needs, further enhancing the system's flexibility and the richness of the user experience.

[0028] In one possible embodiment, the multimodal interactive display module 4 includes a driver information display screen, a central control touchscreen, and an ambient lighting component. The driver information display screen and the central control touchscreen are connected to the scene control module 3. The ambient lighting component is linked with the scene control module 3, gradually brightening during the mode loading phase, maintaining a fixed color during normal operation, and synchronously flashing rapidly in a breathing pattern when the jet effect is triggered. This clarifies the specific components of the multimodal interactive display module 4, namely the driver information display screen, the central control touchscreen, and the ambient lighting component, as well as their connection and linkage with the scene control module 3. This facilitates multi-dimensional display and interaction of information, providing the driver with more comprehensive and intuitive driving information and a more immersive driving atmosphere through different display devices and lighting effects.

[0029] For example, when entering immersive driving mode, the display area of ​​the driver's information display screen is merged, and only the speed display and special background display are retained. This can be done by referring to zoom blur + line perspective to simulate the visual effect of "rapid movement and the background zooming out and disappearing into the distance" to enhance the dynamic sense of speed and spatial depth.

[0030] like Figure 2 As shown in the embodiments of this application, an immersive driving control method based on dynamic scene reconstruction employs an immersive driving system based on dynamic scene reconstruction as described in the embodiments of this application. The method includes the following steps: S1, Data Acquisition Module 1 acquires control signals, vehicle driving data and driver operation data in real time.

[0031] S2, Scene Control Module 3 receives the trigger command and judges the current vehicle status. If it is in reversing mode, it will not start temporarily. If it is in normal driving or parking mode, it will start the immersive driving mode.

[0032] S3, the scene control module 3 loads the corresponding scene configuration parameters according to the trigger command and real-time collected data, performs driving mode rendering, and drives the multimodal interactive display module 4 to present the dynamic scene.

[0033] S4, Scene Control Module 3 dynamically adjusts scene effects based on real-time data.

[0034] S5. When a trigger exit command is received, the immersive driving mode ends.

[0035] In one possible embodiment, in S1, the data acquisition module 1 acquires control signals (such as steering wheel angle signal and motor speed signal), vehicle driving data (such as current vehicle speed and motor power), and driver operation data (such as accelerator pedal opening, brake pedal travel and steering wheel rotation angle) in real time and caches them in a temporary data area.

[0036] In one possible embodiment, in S2, a trigger command can be issued via a virtual switch, voice command, or physical button.

[0037] Virtual switch triggering: The virtual switch is integrated into the vehicle's infotainment system interface, including but not limited to the following locations: 1. Small floating window on the vehicle control homepage; 2. Navigation interface start button; 3. Drop-down menu button.

[0038] Voice command triggering: Only voice command recognition is supported in the driver's voice zone (to avoid accidental triggering by the passenger or rear passengers). The driver speaks a preset command (such as "turn on immersive driving mode"). After receiving the command, the vehicle's voice module transmits the trigger signal to the scene control module 3.

[0039] Physical button trigger: Dedicated physical buttons (such as physical buttons with the "immersive" logo) are set on the vehicle's steering wheel or center console. Pressing the button will directly generate a trigger command and play a "start-up sound effect" at a fixed volume for 1 second (the volume does not follow the media volume and cannot be adjusted by the volume buttons).

[0040] When the immersive driving mode is activated, the interface animation will have a brief loading process. During this loading process, the ambient light will gradually brighten as it turns on.

[0041] After the scene control module 3 receives the trigger command, it first determines the current vehicle status (such as whether it is in a reversing, parking or other special state): if it is in a reversing state, the immersive driving mode will not be activated for the time being, and will be activated again after the reversing is completed; if it is in a normal driving or parking state, the immersive driving mode will be activated immediately.

[0042] In one possible embodiment, the driving mode rendering in S3 includes three parts: interface rendering, sound effect control, and lighting linkage, as detailed below: Interface Rendering: After the immersive driving mode is activated, except for mandatory interfaces such as reversing, all other interfaces display the rendering effect of this immersive driving mode. There are two interface effects: full-screen mode and card mode. During interface rendering, the driver information display screen and the central control touch screen enter full-screen mode, displaying the vehicle 3D model (stationary or moving), the status bar at the top (containing battery or fuel level), the Dock bar at the bottom (a taskbar for storing shortcuts to frequently used applications and folders), and the motor power. Full-screen mode and card mode can be switched between each other via a button. Card mode is only displayed on the left side of the screen and does not occupy the original desktop status bar and Dock bar. In addition to the vehicle 3D model, it displays the current motor speed.

[0043] Sound Effect Control: After the initial sound effect finishes playing, background music continues to play. The background music has the same priority as the music player; if the music player starts, the background music pauses, and if the music player pauses, the background music resumes. The driving sound is enabled by default (its intensity matches the current accelerator pedal position). For example, when entering Immersive Driving Mode by pressing a physical button, the system can activate a sound effect, with a duration limited to 1 second. This sound effect has a fixed volume, independent of media volume, and cannot be controlled by volume up or down. After the physical button sound effect ends, the background music resumes. During this process, if music is played using the music player, the current background music can be overwritten; if the music player pauses, the background music resumes. Alternatively, the background music can be turned off directly. Additionally, the driving sound volume is fixed and offers high, medium, and low options. The driving sound can be turned off or its volume adjusted, but it does not follow media volume and cannot be controlled by volume up or down. One-click mute is supported for both background music and driving sound.

[0044] Lighting Synchronization: During the mode loading phase, the ambient light enters a "gradual brightening" phase (lasting 2-3 seconds), gradually changing from the current brightness to the default brightness while maintaining the default color; if the user has previously customized the ambient light color, the color settings in the user-defined parameters will be loaded. It will also rapidly breathe and flash synchronously when the jet effect is triggered.

[0045] For example, when immersive driving mode is activated, the interface animations undergo a brief loading process. During this loading, the ambient lighting gradually brightens. When entering immersive driving mode, the ambient lighting displays a fixed color, which can correspond to the animation mode. Users can also change the ambient lighting color and disable the ambient lighting effect. When a jet effect is triggered, the ambient lighting receives the trigger signal and displays a rapid breathing flashing effect. After disabling the ambient lighting effect in immersive driving mode or exiting immersive driving mode, the ambient lighting reverts to the original vehicle settings.

[0046] In one possible embodiment, in S4, the scene control module 3, based on the data transmitted in real time by the data acquisition module 1, calls the dynamic effect parameters and sound and lighting parameters to achieve synchronous adjustment of the interface animation, sound, and lighting. The specific implementation is as follows: 1. Depth of field adjustment: Accelerated scenarios: such as Figure 3 As shown, when the driver presses the accelerator pedal, the data acquisition module 1 transmits the pedal travel data in real time, and the scene control module 3 synchronously expands the depth of field according to the change in pedal travel (the greater the pedal travel, the greater the expansion of the depth of field); at the same time, the vehicle speed data is judged, and when the vehicle speed reaches the preset high speed range (the default is above 100km / h), the vehicle 3D model triggers the air flow effect (the streamlined air trajectory is rendered around the vehicle 3D model to enhance the sense of dynamism).

[0047] Deceleration scenarios: such as Figure 3 As shown, when the driver presses the brake pedal (transmitting brake pedal travel data) or the kinetic energy recovery function is activated, the scene control module 3 synchronously zooms in on the depth of field and simultaneously controls the vehicle 3D model to illuminate the brake lights (regardless of braking or kinetic energy recovery, the brake lights remain illuminated to remind the driver to slow down). Steering scenario: When the driver turns the steering wheel (transmitting steering wheel rotation angle data), the depth angle changes synchronously with the steering direction (e.g., when turning left, the depth shifts to the left, simulating the change in real driving perspective).

[0048] 2. Jet effect adjustment: If the accelerator pedal is pressed down to the preset opening degree within a preset time, the jet effect will be triggered; when the pedal opening degree is significantly reduced, the jet effect will disappear.

[0049] Triggering conditions for jet effect adjustment: such as Figure 4 As shown, when the data acquisition module 1 detects that the accelerator pedal opening value exceeds 30% within 0.5 seconds, the scene control module 3 immediately triggers the jet effect (rendering jet-like air waves at the rear of the vehicle's 3D model). The jet effect is continuously displayed as the throttle opening continues to increase or remain.

[0050] Conditions for the jet effect to disappear: such as Figure 4 As shown, if the accelerator pedal opening value begins to recover, the jet effect continues until the throttle opening value recovers to more than 20%, at which point the scene control module 3 controls the jet effect to disappear.

[0051] Wheel imprint effect adjustment: When the vehicle speed is in the preset medium-high speed range, the steering wheel angle is greater than the first preset angle, and the brake pedal is pressed at the same time, the wheel imprint effect is triggered; when the vehicle speed drops to the preset low speed range, or the steering wheel angle decreases to the second preset angle, the wheel imprint effect disappears. The second preset angle is smaller than the first preset angle.

[0052] The triggering conditions for the wheel rim imprint effect are as follows: Figure 5 As shown, the data acquisition module 1 simultaneously detects three conditions: the vehicle speed is in the "preset medium-high speed range" (default above 60km / h), the steering wheel angle is greater than the "first preset angle" (default 30 degrees), and the brake pedal is pressed (the travel data is greater than 0). The scene control module 3 triggers the wheel hub imprint effect (the tire friction marks are rendered below the vehicle 3D model). Conditions for the wheel rim mark effect to disappear: such as Figure 5 As shown, when the vehicle speed drops to the preset low speed range (below 30km / h by default), or the steering wheel angle decreases to the second preset angle (below 20 degrees by default), the wheel hub imprint effect disappears regardless of whether the brake is still applied (it is only displayed in full-screen mode and not in card mode).

[0053] In one possible embodiment, when the vehicle is in motion, real-time driving data is displayed on the interface, including but not limited to vehicle speed, acceleration and deceleration, motor speed and steering wheel rotation angle, and when the suspension is adaptively adjusted, corresponding dynamic effects appear on the interface.

[0054] In one possible embodiment, S4 also includes the implementation of supporting functions, specifically: Rear view streaming media warning pop-up: For vehicles equipped with rear sensors (such as reversing radar and rearview camera), scene control module 3 receives rear environmental data in real time. When a vehicle is detected approaching from behind (directly behind or to the side) (within 5m), a "Rear View Warning Pop-up" will be displayed in the center of the top of the driver's information display screen (real-time transmission of the rear camera image). Users can adjust the pop-up window's status to: "On" (always displayed), "Off" (always closed), and "Auto" (default, only displayed when a vehicle approaches).

[0055] Synchronized Suspension Motion Effects: If the vehicle is equipped with adaptive suspension (such as magnetorheological suspension), the data acquisition module 1 acquires suspension status data (soft, medium, hard), and the scene control module 3 drives the 3D vehicle model on the driver's information display screen to synchronously present the suspension motion effects. When the suspension is set to "Hard" mode, the model's suspension is displayed as "Retracted"; when set to "Soft" mode, the vehicle's 3D model's suspension is displayed as "Extended"; simultaneously, the interface displays the text labels "Suspension - Hard" and "Suspension - Soft". One possible implementation, in S5: When exiting the immersive driving mode, the multimodal interaction display module 4 restores the interface and sound effects to their state before the mode was activated, and the scene control module 3 saves the user-defined parameters used in this session for easy recall upon next startup. This ensures that users can return to a familiar interface and sound environment after exiting the mode, while also allowing them to directly use their previous personalized settings upon next startup, thus improving the convenience and consistency of the user experience.

[0056] For example, the way to exit immersive driving mode corresponds to the way it is activated, and three ways to exit immersive driving mode are supported: 1. Physical button trigger: Press the dedicated physical button when starting up to generate an exit command and play an exit sound effect at a fixed volume for 1 second.

[0057] 2. Voice command trigger: The driver speaks a preset command (such as "Turn off immersive driving mode"), and the voice module transmits an exit signal to the scene control module 3.

[0058] 3. Virtual button trigger: Click the "Close" button in the immersive interface (such as the "×" icon in the upper right corner of the full-screen mode), or select "Close Immersive Driving" from the drop-down menu.

[0059] Status restoration and parameter saving after exit: 1. State Restoration: After receiving the exit command, the scene control module 3 drives the multimodal interactive display module 4 to restore the state before the mode was started. Interface restoration: The driver's information display screen and the central control touch screen exit full-screen / card mode and return to the interface before startup (such as the vehicle control home page, navigation interface); the driver's information display screen restores its original layout (displaying complete information such as RPM, fuel level, and coolant temperature).

[0060] Sound effect restoration: Background music and driving sounds stop playing and are restored to the media state before startup (e.g., if music was playing before startup, it will continue to play after exiting; if there was no media playing before startup, it will remain silent after exiting).

[0061] Lighting restoration: The ambient light turns off "breathing flash" (if it was previously on), and restores its color and brightness to what it was before startup (e.g., if it was warm yellow before startup, it will switch back to warm yellow after exiting).

[0062] 2. Parameter saving: Scene control module 3 will synchronously store the custom parameters used in this mode (such as ambient light color, driving sound gear, rear wing or suspension dynamic effect settings) to the "user-defined parameters" of data storage module 2. The parameters will be loaded directly the next time the mode is started, without the need to set them again.

[0063] In this embodiment, the scene control module 3 allows users to customize and adjust motion effects and sound effects through the multimodal interactive display module 4. The specific operation is as follows: (a) Adjusting the inlet In immersive driving mode, two function buttons are always present on the left edge of the central control touchscreen: 1. Adjustment button: Clicking it will bring up a "Dynamic Effect Adjustment Pop-up Window", which includes four adjustment options: tail wing, magnetorheological suspension, jet effect, and wheel effect; 2. Sound Effects Button: Clicking it will bring up a "Sound Effects Adjustment Pop-up" which includes three adjustment options: driving sound, background music, and special sound effects.

[0064] (II) Specific adjustment operations 1. Motion Effect Adjustment: Rear Wing Adjustment: Click "Rear Wing Adjustment" and the vehicle 3D model will automatically switch to the rear view. The interface will display "Infinitely Adjustable Slider". Drag the slider to adjust the opening angle of the model's rear wing in real time (0-100%). The adjusted parameters will be saved to the user-defined parameters. Suspension Adjustment: Click "Suspension Adjustment" and the vehicle 3D model becomes semi-transparent, highlighting the suspension structure. The interface provides three options: "Soft," "Medium," and "Hard." Click the corresponding option, and the vehicle 3D model's suspension will simultaneously display the corresponding state. At the same time, the actual vehicle's suspension (if supported) will also be adjusted synchronously.

[0065] Jet effect adjustment: Click the switch for "Jet effect" to control the trigger permission of the corresponding animation (if turned off, the animation will not be displayed even if the trigger conditions are met).

[0066] Wheel effect adjustment: Click the switch for "Wheel effect" to control the triggering permission of the corresponding animation (when turned off, the animation will not be displayed even if the triggering conditions are met).

[0067] 2. Sound Effects Adjustment: Driving sound: Offers "On and Off" options and "High, Medium, Low" levels. Clicking "High" increases the sound intensity, while clicking "Off" stops the sound output.

[0068] Background music: Only "On and Off" options are available. If "Off" is selected, the background music will stop playing.

[0069] Special sound effects: Provides "on and off" options. If "off" is selected, the start and exit sound effects and jet sound effects will not be played.

[0070] All adjustments take effect in real time, and the adjusted parameters are synchronized to the data storage module 2 through the scene control module 3 to ensure that the custom settings are used on the next startup.

[0071] In this embodiment of the application, a vehicle employs an immersive driving control system based on dynamic scene reconstruction as described in this embodiment of the application.

[0072] The above embodiments are merely illustrative of specific application scenarios of the present invention. Any equivalent modifications or extensions made within the architectural design and methodological logic of the present invention should be included within the protection scope of the present invention.

[0073] The above embodiments are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above embodiments. Any changes, modifications, substitutions, combinations, or simplifications made without departing from the spirit and principle of the present invention shall be considered equivalent substitutions and shall be included within the protection scope of the present invention.

Claims

1. An immersive driving system based on dynamic scene reconstruction, characterized by: It includes data acquisition module (1), data storage module (2), scene control module (3) and multi-modal interactive display module (4); The data acquisition module (1) is used for acquiring control signals, vehicle driving data and driver operation data; the output end of the data acquisition module (1) is connected with the scene control module (3); The data storage module (2) stores a configuration database of the immersive driving mode, the configuration parameters of the configuration database include interface display parameters, dynamic effect parameters, sound and light parameters and user-defined parameters, and the data storage module (2) is connected with the scene control module (3); The scene control module (3) is used for receiving the data collected by the data acquisition module (1), calling the configuration parameters of the data storage module (2), and realizing dynamic reconstruction of the driving scene; The multi-modal interactive display module (4) is connected with the scene control module (3) and is used for presenting the dynamically reconstructed scene and receiving user operations.

2. The immersive driving system based on dynamic scene reconstruction of claim 1, wherein: The control signals include at least one of acceleration, steering wheel angle signal, motor speed signal and lane level positioning data; The vehicle driving data include at least one of vehicle speed, motor power and suspension state; The driver operation data include at least one of accelerator pedal opening, brake pedal stroke and steering wheel rotation angle.

3. The immersive driving system based on dynamic scene reconstruction of claim 2, wherein: The interface display parameters include at least one of full screen state layout rule, card state layout rule and status bar display content; The dynamic effect parameters include at least one of depth of field, jet and hub print effect trigger threshold; The sound and light parameters include the mapping relationship between background music volume gear and atmosphere lamp color.

4. The immersive driving system based on dynamic scene reconstruction of claim 3, wherein: The scene control module (3) synchronously adjusts interface dynamic effect based on vehicle driving data and driver operation data, the adjustment of the interface dynamic effect needs to call the depth of field, jet, hub print effect trigger threshold in the dynamic effect parameters; meanwhile, sound effect and atmosphere lamp are linked and controlled, the linkage and control of the sound effect and atmosphere lamp need to call the mapping relationship between background music volume gear and atmosphere lamp color in the sound and light parameters; The scene control module (3) also responds to user mode switching instructions, supports user self-defined adjustment of the dynamic effect opening state of the tail wing and suspension and the volume gear of the sound wave through the multi-modal interactive display module (4), and the adjusted parameters need to be synchronously stored in the user-defined parameters of the data storage module (2).

5. The immersive driving system based on dynamic scene reconstruction of claim 1, wherein: The multi-modal interactive display module (4) includes a main driver information display screen, a central control touch screen and an atmosphere lamp assembly, the main driver information display screen and the central control touch screen are connected with the scene control module (3); the atmosphere lamp assembly is linked with the scene control module (3), gradually brightens in the mode loading stage, keeps a fixed color in normal operation, and synchronously flashes rapidly when the jet effect is triggered.

6. An immersive driving control method based on dynamic scene reconstruction, characterized in that: The method of the immersive driving system based on dynamic scene reconstruction as claimed in any one of claims 1 to 5 comprises the following steps: S1, the data acquisition module (1) acquires control signals, vehicle driving data and driver operation data in real time; S2, the scene control module (3) receives a trigger instruction, judges the current vehicle state, and if it is in the reverse state, it does not start temporarily, and if it is in the normal driving or parking state, it starts the immersive driving mode; S3, the scene control module (3) loads the corresponding scene configuration parameters according to the trigger instruction and real-time data collection, renders the driving mode, and drives the multi-modal interactive display module (4) to present a dynamic scene; S4, the scene control module (3) dynamically adjusts the scene effect based on real-time data; S5, when receiving a trigger exit instruction, end the immersive driving mode.

7. The immersive driving control method based on dynamic scene reconstruction according to claim 6, characterized in that: The driving mode rendering in S3 includes interface rendering, sound effect control, and light linkage, which are as follows: Interface rendering: Except for the reverse forced interface, the rest of the interface displays the immersive driving mode rendering effect, and by default, it enters the full-screen state. The full-screen state and the card state are switched by a key. Both interfaces display the vehicle static or motion state. Sound effect control: After starting the sound effect playback, the background music is continuously played. The priority of the background music is consistent with that of the music player. When the music player is started, the background music is paused, and when it is paused, it is restored. The background music can be directly turned off. By default, the driving sound is turned on. The driving sound intensity matches the accelerator pedal opening degree, providing high, medium, and low volume and off options. The driving sound and the background music support one-key mute. Light linkage: During the mode loading stage, the atmosphere light gradually brightens from the current brightness. During normal operation, the atmosphere light maintains the default color or the user-defined color. If the user has previously defined the atmosphere light color, the color setting corresponding to the user-defined parameter in the loading data storage module (2) is set.

8. The immersive driving control method based on dynamic scene reconstruction of claim 6, wherein: The dynamic adjustment of the scene effect in S4 includes the following contents: Depth of field effect adjustment: When the accelerator pedal is depressed, the depth of field is pulled away with the pedal travel. When the vehicle speed reaches the preset high-speed interval, the vehicle 3D model triggers the air flow effect. When the brake pedal is depressed or the kinetic energy recovery is started, the depth of field is pulled in, and the vehicle 3D model is lit up. When the steering wheel is turned, the depth of field angle changes synchronously with the steering direction. Jet effect adjustment: When the accelerator pedal is depressed to a preset opening degree within a preset short time, the jet effect is triggered. When the pedal opening degree recovers by more than a preset amplitude, the jet effect disappears. Hub print effect adjustment: When the vehicle speed is in a preset medium-high speed interval, the steering wheel steering angle is greater than a first preset angle, and the brake is depressed, the hub print effect is triggered. When the vehicle speed drops to a preset low speed interval or the steering wheel steering angle is less than a second preset angle, the hub print effect disappears. The second preset angle is less than the first preset angle.

9. The immersive driving control method based on dynamic scene reconstruction of claim 6, wherein: S5 is as follows: When exiting the immersive driving mode, the multi-modal interactive display module (4) restores to the interface and sound effect state before the mode is started, and the scene control module (3) saves the user-defined parameters used this time for direct calling next time.

10. A vehicle characterized by: An immersive driving control system based on dynamic scene reconstruction is adopted.

Images