Vehicle control method, display device, vehicle, and in-vehicle interaction system
By detecting the virtual driving status of the vehicle through in-vehicle display devices and controlling the vehicle to perform body posture adjustments, the problem of insufficient immersion of in-vehicle display devices is solved, realizing a fully immersive virtual reality experience and improving the user experience.
Patent Information
- Application Number
- PCT/CN2026/083479
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-09
- Filing Date
- 2026-03-13
- Publication Date
- 2026-11-12
AI Technical Summary
Current in-vehicle display devices primarily rely on visual and auditory immersion, lacking body motion feedback, tactile interaction, and environmental simulation, resulting in insufficient immersion and making it difficult for users to truly 'place' themselves in the virtual world.
The virtual driving status of the vehicle is detected by the display device, and the vehicle is controlled to perform corresponding body posture adjustment actions to match the vehicle's body posture with the vehicle's posture, including the actions of the suspension system, seat tilt and roll mechanism, to achieve synchronous matching of vision, hearing, touch and vestibular sense.
Enhance the user's immersive experience with display devices by providing a fully immersive virtual reality experience, thereby increasing user satisfaction and realism.
Smart Images

Figure CN2026083479_12112026_PF_FP_ABST
Abstract
Description
Vehicle control methods, display devices, vehicle and in-vehicle interaction systems
[0001] This application claims priority to Chinese patent application No. 202510603517.8, filed on May 9, 2025, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This disclosure relates to the field of vehicle technology, and more particularly to a vehicle control method, a display device, a vehicle, and an in-vehicle interactive system. Background Technology
[0003] With the development of intelligent and entertaining vehicles, in-vehicle display devices are gradually becoming an important tool for enhancing the passenger experience. Users can experience virtual reality content (such as 3D movies, virtual travel, games, etc.) through display devices whether the vehicle is moving or stationary, thereby enriching their travel experience. Summary of the Invention
[0004] This disclosure provides a vehicle control method, a display device, a vehicle, and an in-vehicle interactive system.
[0005] Firstly, a vehicle control method is provided, applied to a display device. The control method includes: when the display content of the display device includes a vehicle, controlling the vehicle to which the display device belongs to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle, so as to match the body posture of the vehicle with the vehicle posture of the vehicle.
[0006] The vehicle control method provided in some embodiments of this disclosure, when the content displayed on the display device includes a vehicle, controls the vehicle to which the display device belongs to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle, so that the vehicle adjusts its own body posture to match the vehicle posture of the virtual character in the display content. In other words, when a user uses the display device in a vehicle, the posture of the user's own vehicle matches the vehicle posture of the virtual character in the display content, allowing the user to personally experience the body posture felt by the virtual character, thereby enabling a more immersive experience of the display content and improving the user's experience with the display device.
[0007] In a second aspect, a display device is provided, including a processor and a memory, the processor being connected to the memory, the memory storing computer instructions that, when executed on the display device, cause the display device to perform the method provided in the first aspect and its possible implementations.
[0008] Thirdly, a vehicle is provided, including a processor and a memory, the processor being connected to the memory, the memory storing computer instructions that, when executed on the vehicle, cause the vehicle to perform the methods provided in the first aspect and its possible implementations.
[0009] Fourthly, a computer-readable storage medium is provided, which stores computer-executable instructions that, when executed on a computer, cause the computer to perform the methods provided in the first aspect and its possible implementations.
[0010] Fifthly, an in-vehicle interactive system is provided, including the display device provided in the second aspect and / or the vehicle provided in the third aspect.
[0011] Sixthly, a computer program product is provided, comprising instructions, wherein when the instructions are executed on a computer, the computer performs the method provided by the first aspect and its possible implementations. The technical effects of any implementation of the second to sixth aspects are similar to those of the corresponding implementations of the first aspect, and will not be repeated here. Attached Figure Description
[0012] To more clearly illustrate the technical solutions of some embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0013] Figure 1 is a structural diagram of an in-vehicle interactive system according to some embodiments;
[0014] Figure 2 is a flowchart illustrating the interaction between a display device and a vehicle according to some embodiments;
[0015] Figure 3 is a processing flowchart of a domain controller middleware according to some embodiments;
[0016] Figure 4 is a flowchart of a vehicle control method according to some embodiments;
[0017] Figure 5 is a schematic diagram of attitude control commands for a vehicle in a constant speed state according to some embodiments;
[0018] Figure 6 is a second method flowchart of a vehicle control method according to some embodiments;
[0019] Figure 7 is a schematic diagram of attitude control commands for a vehicle in a variable speed state according to some embodiments;
[0020] Figure 8 is a flowchart of a vehicle control method according to some embodiments;
[0021] Figure 9 is a schematic diagram of attitude control commands for a vehicle in a turning state according to some embodiments;
[0022] Figure 10 is a schematic diagram of attitude control commands for a vehicle in a bumpy state according to some embodiments;
[0023] Figure 11 is a schematic diagram of attitude control commands for a vehicle in an impact state according to some embodiments;
[0024] Figure 12 is a schematic diagram of attitude control commands for a vehicle in a leaping state according to some embodiments;
[0025] Figure 13 is a schematic diagram of a method for determining a speed amplification factor according to some embodiments;
[0026] Figure 14 is a flowchart of using a display device according to some embodiments;
[0027] Figure 15 is a block diagram of an electronic device according to some embodiments;
[0028] Figure 16 is a block diagram of a display device according to some embodiments;
[0029] Figure 17 is a block diagram of a vehicle according to some embodiments;
[0030] Figure 18A is a block diagram of an in-vehicle interactive system according to some embodiments;
[0031] Figure 18B is a block diagram of another in-vehicle interactive system according to some embodiments;
[0032] Figure 18C is a block diagram of yet another in-vehicle interactive system according to some embodiments. Detailed Implementation
[0033] The technical solutions in some embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments provided in this disclosure are within the scope of protection of this disclosure.
[0034] In some embodiments of this disclosure, the terms “center,” “upper,” “lower,” “front,” “rear,” “left,” “right,” “vertical,” “horizontal,” “top,” “bottom,” “inner,” and “outer,” etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing some embodiments of this disclosure and simplifying the description, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on some embodiments of this disclosure.
[0035] In some embodiments of this disclosure, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of some embodiments of this disclosure, unless otherwise stated, "a plurality of" means two or more.
[0036] In some embodiments of this disclosure, the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus.
[0037] In the absence of further restrictions, an element defined by the phrase "including one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0038] "A and / or B" includes the following three combinations: A only, B only, and a combination of A and B.
[0039] With the rapid development of automotive intelligence and entertainment, in-vehicle virtual reality (VR) devices are gradually becoming an important tool for enhancing the passenger travel experience. Users can experience diverse virtual reality content, such as realistic 3D movies, immersive virtual travel, and interactive games, whether the vehicle is moving or stationary, through lightweight display devices. This transforms the traditionally monotonous car ride into a fun and personalized entertainment space. This innovative application not only alleviates fatigue during long journeys but also adds a sense of technology and novelty to family trips, business transportation, and other scenarios.
[0040] However, current in-vehicle display devices primarily provide users with a sense of visual and auditory immersion through high-resolution displays, head tracking, and stereo sound technology, such as realistic 3D scenes and surround sound effects. However, this experience is still limited to eye viewing and head movement, lacking body motion feedback, tactile interaction, and environmental simulation, resulting in insufficient immersion and making it difficult for users to truly "be in" the virtual world.
[0041] Based on this, some embodiments of this disclosure provide a vehicle control method. When the content displayed on the display device includes a vehicle, based on the virtual driving state of the vehicle, the method controls the vehicle to which the display device belongs to perform corresponding body posture adjustment actions, so that the vehicle adjusts its own body posture to match the vehicle posture of the virtual character in the display content. In other words, when a user uses the display device, the vehicle the user is riding in matches the vehicle posture of the virtual character in the display content, allowing the user to personally experience the body posture felt by the virtual character. This enables the user to have a more immersive experience of the display content and improves the user experience of the display device.
[0042] As can be seen, the solutions provided in some embodiments of this disclosure control the vehicle to perform corresponding body posture adjustment actions (such as vibration, tilting, acceleration or deceleration simulation) in real time according to virtual content, so that the passenger's vision, hearing, touch and vestibular sense (balance) are synchronized and matched, thereby achieving a full-body immersive experience and improving the user's experience of using the display device.
[0043] The vehicle control methods provided by some embodiments of this disclosure are described below with reference to the accompanying drawings.
[0044] The vehicle control methods provided in some embodiments of this disclosure can be applied to the in-vehicle interactive system shown in FIG1. Referring to FIG1, the in-vehicle interactive system includes a vehicle 100 and a display device 200. The vehicle and the display device can communicate with each other in various ways, and this disclosure does not limit this.
[0045] It should be understood that this disclosure does not limit the types of display devices, which include head-mounted displays (HMDs), terminal devices (such as smartphones and smartwatches), and vehicle central control screens. Users can view displayed content inside or on the vehicle through these display devices.
[0046] In some embodiments, head-mounted displays (HUDs) offer a wider field of view and 3D stereoscopic display, allowing users to be fully immersed in virtual or augmented reality environments, making them suitable for scenarios such as games, movies, and simulation training. Furthermore, in confined spaces such as inside a vehicle, HUDs are more flexible than fixed central control screens or handheld devices, providing a stable visual experience and reducing motion sickness or visual fatigue. Therefore, as a feasible implementation method, the display device is a head-mounted display.
[0047] As one feasible implementation method, when the display device is a head-mounted display device, the head-mounted display device can be a virtual reality (VR), an augmented reality (AR), or a mixed reality (MR) head-mounted display device, and this disclosure does not limit it.
[0048] In some embodiments of this disclosure, when the display device is in operation, it can detect whether the content of the screen it displays includes a vehicle, that is, whether the virtual character corresponding to the user is riding in a vehicle. If so, the display device can determine the virtual driving state of the vehicle based on the virtual state information of the vehicle.
[0049] In some embodiments, the virtual driving state can be divided into at least one of the following based on the driving parameters and road conditions corresponding to the virtual vehicle: constant speed state, variable speed state, turning state, bumpy state, impact state, or jump state. Then, different vehicle posture adjustment actions (or posture control commands) are set for each virtual driving state to achieve different vehicle posture control.
[0050] As a feasible approach, the display device can send the detected virtual driving state to the vehicle controller, enabling the vehicle controller to perform vehicle posture adjustment actions based on the virtual driving state.
[0051] As another feasible approach, the display device can generate corresponding status control commands based on the virtual driving state and send the status control commands to the vehicle to control the vehicle to perform corresponding body posture adjustment actions so that the vehicle's body posture matches the vehicle's vehicle posture.
[0052] In some embodiments, the display device can send attitude control commands to the vehicle, including pitch and roll angles for adjustment. After receiving the attitude control commands, the vehicle controller can adjust its own pitch and roll angles based on the attitude control commands to perform vehicle attitude adjustment actions to achieve the purpose of matching the vehicle attitude of the virtual vehicle.
[0053] In some embodiments, the vehicle's domain controller middleware is a core software layer in the vehicle's electronic architecture, located between the application layer (such as autonomous driving and cockpit entertainment systems) and the hardware layer (such as sensors and actuators). The domain controller middleware is responsible for coordination, management, and communication to ensure efficient data flow between different domains (such as the powertrain domain, body domain, and cockpit domain).
[0054] Therefore, as one implementation method, the connection between the display device and the vehicle controller requires a domain control middleware, which forwards the signals sent by the display device to the controller. In another implementation method, the domain control middleware can authenticate and parse the control commands and signals sent by the display device before forwarding them to the controller.
[0055] When a display device attempts to establish a connection with the vehicle controller, the domain controller middleware first performs rigorous network authentication. This includes verifying the display device's identity, authenticating its legitimacy, and checking whether it has the necessary permissions to access the vehicle control system. This step effectively prevents unauthorized devices from accessing the system, ensuring the security of the vehicle system.
[0056] Once the display device is authenticated, the domain control middleware begins receiving and parsing the control commands and signals it sends. These commands may include state values that the vehicle needs to adjust, such as the target roll angle. The domain control middleware needs to have efficient data parsing capabilities to accurately understand and process these commands, ensuring that they are correctly forwarded to the vehicle's controller.
[0057] In some embodiments, as shown in Figure 2, the display device is connected to the vehicle controller via wired or wireless means. Signals emitted by the display device require network authentication and parsing by a domain control middleware before being forwarded to the vehicle controller, which then controls the active suspension system to perform actions. After determining the content displayed on the device, the user needs to generate attitude control commands based on the virtual driving state of the vehicle within the displayed content, enabling the vehicle's active suspension system to adjust its vehicle posture according to these commands.
[0058] In some embodiments, please refer to Figure 3, which shows that when the device establishes a connection with the vehicle controller, the vehicle performs the following steps b1-b8.
[0059] b1. Start the domain controller middleware.
[0060] b2. Initialize the linkage module.
[0061] b3. Determine whether the linkage module initialization was successful. If yes, execute b4; otherwise, execute b31.
[0062] b31. Initialization failed. Execute b2 again.
[0063] b4. Determine whether network authentication is required. If yes, proceed to b5; otherwise, proceed to b41.
[0064] b41. Authentication failed.
[0065] b5. Enter the ready state.
[0066] b6. Receive and parse attitude control commands.
[0067] b7. Send to the suspension system.
[0068] b8. Determine if the instruction was sent successfully. If yes, execute b6 again; otherwise, execute b81.
[0069] b81, Fault Information.
[0070] That is, output fault information.
[0071] First, the domain control middleware needs to be started. The middleware initializes the linkage modules (such as network modules and Controller Area Network (CAN) transceiver modules), and then determines whether the initialization was successful. If initialization is successful, the middleware performs network authentication on the display device. After successful network authentication, it enters a ready state, waiting for the display device to send attitude control commands. If initialization or network authentication fails, the middleware needs to output corresponding prompts to the host computer, such as "Initialization failed" or "Authentication failed".
[0072] Once the vehicle enters the ready state, the display device can send corresponding attitude control commands to the domain control middleware based on the vehicle's virtual driving status. Referring to Figure 3, the domain control middleware receives and parses the attitude control commands, sends them to the suspension system, and determines whether the commands were sent successfully. If the transmission is successful, it can continue to receive new attitude control commands; if the transmission fails, it can output fault information via voice or other means and resend the unsuccessful fault message to the suspension system.
[0073] Understandably, to enhance user experience, domain control middleware can introduce a real-time feedback mechanism. When the display device sends a control command, the vehicle controller, while performing the corresponding operation, can feed back the operation result or status information to the domain control middleware, which then forwards it back to the display device. In this way, the user can see the operation result on the display device in real time, improving the intuitiveness and satisfaction of the interaction. This disclosure does not limit the control process of the domain control middleware. It should be noted that the structure shown in Figure 1 does not constitute a limitation on the in-vehicle interaction system. This in-vehicle interaction system may include fewer or more components than shown, or combine certain components, or have different component arrangements; this disclosure does not impose any limitations in this regard.
[0074] The vehicle control method provided in some embodiments of this disclosure can be applied to the display device shown in FIG1, such as in the controller of the display device; it can also be applied to the vehicle shown in FIG1, such as in the vehicle's on-board controller, and this disclosure does not limit it. For ease of description, some embodiments of this disclosure are illustrated by taking the application of the vehicle control method to the display device shown in FIG1 as an example.
[0075] Please refer to Figure 4, which is a flowchart of a vehicle control method according to some embodiments. As shown in Figure 4, the vehicle control method includes:
[0076] S101. When the content displayed on the display device includes a vehicle, the vehicle to which the display device belongs is controlled to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle, so that the body posture of the vehicle matches the vehicle posture of the vehicle.
[0077] It is understandable that the content displayed on a device can be categorized into pre-loaded content and real-time rendered content. Pre-loaded content refers to complete 3D scenes, models, and animations that developers store in advance on the device or in the cloud, which are then loaded directly when the user launches the application. Real-time rendered content refers to content that is dynamically generated or adjusted based on user actions or environmental changes. This disclosure does not impose any limitations on this.
[0078] During the development phase of the content displayed on a display device, developers typically assign a unique identifier or add metadata tags (such as "vehicle" or "building") to each virtual object. Therefore, as one implementation method, the display device can determine whether a vehicle exists in the scene by parsing the data tags corresponding to the displayed content.
[0079] As another approach, for other display content, such as dynamically generated game content or playing movies, the display device can analyze the geometry and motion patterns in the scene in real time. If it detects objects with features such as wheels or cockpits, or identifies objects that conform to the motion patterns of vehicles (such as translation or rotation), it can determine that the display content includes vehicles.
[0080] When the content displayed on the display device includes vehicles, it can be determined that the user's corresponding virtual character is riding in a vehicle. To improve the user experience of the display device, it is necessary to first determine the virtual driving state of the vehicle. It should be understood that this disclosure does not limit the method of determining the virtual driving state of the vehicle. The display device can obtain virtual state information through content engine data extraction, physical simulation calculation, and real-time sensor feedback, and then determine the virtual driving state based on the virtual state information.
[0081] As one implementation method, the engine in the display device calculates the physical state (speed, acceleration, suspension force, etc.) of the virtual vehicle in real time when rendering it. Therefore, the controller can directly obtain the virtual state information through the application programming interface (API).
[0082] As another feasible approach, computer vision analysis of the rendered image can be used, such as optical flow, which is used to track pixel displacement and estimate the motion direction and acceleration of the virtual vehicle; semantic segmentation, which is used to identify the vehicle and road surface type (such as flat or bumpy) in the image, and infer the virtual driving state of the vehicle by combining the vehicle's motion trajectory.
[0083] As a feasible implementation method, the virtual driving state includes at least one of the following: constant speed state, variable speed state, turning state, bumpy state, impact state, or leaping state.
[0084] As one implementation method, it can be determined that the vehicle is in a uniform speed state when the vehicle speed is constant (the absolute value of the acceleration is less than a preset threshold), or when the scene flow rate is stable with no pixel changes, or when the vehicle travels in a straight line without external interference.
[0085] As one implementation method, it is possible to determine that the vehicle is in a speed change state when the vehicle's rate of change of speed (acceleration) is not zero, or when the vehicle adjusts its speed according to the player's operation (such as throttle or brake).
[0086] One approach is to monitor the vehicle's steering angle or virtual steering wheel input to determine if the vehicle is turning when its direction of travel changes, its angular velocity is not zero, or the curvature of its travel path exceeds a certain threshold.
[0087] One approach is to determine whether the vehicle has passed through an uneven area (such as a vehicle traveling on a rugged mountain road or off-road terrain) based on collision detection between the vehicle and the terrain. In this case, the vehicle is in a bumpy state.
[0088] As one implementation method, it is possible to determine that a vehicle is in an impact state when it collides with objects such as walls, obstacles, or other vehicles.
[0089] As one implementation method, it is possible to determine whether a vehicle has left the ground by terrain height or collision detection. If the vehicle has left the ground and is in the air, it is determined that the vehicle is in a flying state.
[0090] After obtaining the virtual driving state of the vehicle, the vehicle to which the display device belongs can be controlled to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle, so that the body posture of the vehicle matches the vehicle posture of the vehicle.
[0091] As one implementation method, the display device can generate corresponding attitude control commands based on the virtual driving state, and then send the attitude control commands to the vehicle's on-board controller, so that the on-board controller can control the vehicle to perform corresponding body attitude adjustment actions based on the attitude control commands, so as to achieve the purpose of matching the vehicle's body attitude with the vehicle's vehicle attitude.
[0092] It is understandable that attitude control commands are not simple on / off signals, but precise control parameters calculated through complex algorithms. For example, when a vehicle makes a high-speed turn in a virtual environment, the system calculates the required pitch and roll angle changes based on factors such as the turning radius and vehicle speed.
[0093] As a feasible implementation method, when it is necessary to control changes in the vehicle's pitch angle, the attitude control command can include "_P", such as "_Pf" for nodding and "_Pb" for pitching. As another feasible implementation method, when it is necessary to control changes in the vehicle's pitch angle, the attitude control command can include a preset pitch angle ∠α and a speed amplification factor, allowing the vehicle to adjust ∠α according to the speed amplification factor. It should be understood that the speed amplification factor can be determined based on the vehicle speed, and the determination method can be found in the following embodiments.
[0094] As a feasible approach, when it is necessary to control changes in the vehicle's roll angle, the attitude control commands can include "_R". For example, the command to swing left first is "_Rl", and the command to swing right first is "_Rr".
[0095] As a feasible approach, when it is necessary to control changes in the vehicle's roll angle, the attitude control command may include a preset roll angle ∠β and a speed amplification factor, so that the vehicle adjusts ∠β according to the speed amplification factor.
[0096] The display device then sends the attitude control commands it receives to the actual vehicle in real time. Upon receiving the attitude control commands, the vehicle's control unit responds quickly, precisely adjusting various vehicle systems. For example, based on the attitude control commands, the suspension system can adjust the height of the front, rear, left, and right suspensions separately, maintaining a stable tilt angle so that the user can experience changes in the vehicle's state. In this way, the vehicle's body posture, including attitude and driving stability, can be highly matched to the vehicle's body posture in the virtual environment, as if the vehicle were actually driving in a simulated driving scenario.
[0097] As another feasible approach, the display device can send the virtual driving status of the vehicle to the vehicle's onboard controller. The onboard controller then controls the suspension system and other components to perform corresponding body posture adjustments based on the virtual driving status of the vehicle, thereby achieving the goal of matching the vehicle's body posture with the vehicle's posture.
[0098] It is understood that the purpose of vehicle body attitude adjustment is to match the vehicle's body attitude with the vehicle's attitude, and this disclosure does not limit the specific actions taken for vehicle body attitude adjustment. As one feasible method, vehicle body attitude adjustment is used to adjust the vehicle's roll angle and / or pitch angle, causing the vehicle body to tilt to a specific angle. As another feasible method, vehicle body attitude adjustment is a suspension jump action; the suspension jump action is used to achieve an instantaneous increase in vehicle height, causing the vehicle body to rise instantly.
[0099] As another feasible implementation method, the vehicle body posture adjustment action includes at least one of the following: adjusting the height of multiple suspensions in the vehicle suspension system; controlling the tilt angle of the vehicle seat; and controlling the vehicle roll mechanism to generate a corresponding roll angle.
[0100] Understandably, by using adjustable components in the suspension system (such as air springs and hydraulic cylinders), the height of multiple suspension components can be precisely controlled, thereby changing the vehicle's position and angle in the vertical direction. By adjusting the suspension height, the vehicle's height can be matched with the posture height set by the virtual vehicle. For example, when the virtual vehicle is in an off-road posture, the suspension can be raised to simulate the height and ground clearance during off-road driving; when the virtual vehicle is in a high-speed driving posture, the suspension height can be lowered to match the low and stable posture of the virtual vehicle at high speeds, enhancing the realism of the virtual experience.
[0101] By adjusting the seat's tilt angle using electric or manual mechanisms, the passenger's posture and body position can be influenced. This allows users to better experience the content displayed on the device. From the perspective of matching the posture of a virtual vehicle, controlling the seat tilt angle allows the passenger's body posture to coordinate with the posture environment created by the virtual vehicle. For example, when a virtual vehicle simulates a racing car posture, adjusting the seat tilt angle to a posture more consistent with racing car driving allows passengers to better immerse themselves in the virtual racing scene both visually and physically, enhancing the sense of immersion.
[0102] Roll mechanisms (such as active anti-roll bars and hydraulic roll control systems) are used to actively and precisely control the roll angle of the vehicle body during cornering or specific postures. In virtual vehicle posture simulation, when the virtual vehicle is in a cornering or tilting posture, the roll mechanism is controlled to generate a corresponding roll angle, allowing the vehicle body posture to perfectly match the roll posture of the virtual vehicle. For example, when a virtual vehicle simulates an aircraft tilting in flight, the vehicle body also tilts accordingly, allowing passengers to experience the same posture changes as the virtual aircraft, further enhancing the realism and enjoyment of the virtual experience.
[0103] As a feasible implementation method, vehicle body posture adjustment is used to synchronize or match the vehicle's body posture with the vehicle's posture. It should be understood that the aforementioned "synchronization or consistency" does not refer to complete and identical consistency in a real physical sense, but rather synchronization and consistency in a simulated sense. Since the vehicle is a real entity, while the vehicle's posture may be virtual and simulated, the vehicle body posture adjustment uses various technical means (such as adjusting suspension height, seat angle, roll angle, etc.) to make the real vehicle's body posture as close as possible to the posture set by the virtual vehicle. Therefore, this is a synchronization and consistency in a simulated sense, not a complete match in physical form or structure. Furthermore, from a functional perspective, this "synchronization or consistency" is to meet specific needs, such as providing a more realistic driving experience or conducting simulation training. As long as the vehicle body posture adjustment achieves the effect of making the user feel that the vehicle posture matches the vehicle posture, synchronization or consistency can be considered achieved, without requiring strict correspondence in all details. Therefore, the "synchronization or consistency" in some embodiments of this disclosure is more of a relative consistency based on specific purposes and experience requirements, rather than absolute real consistency.
[0104] As can be seen, the vehicle control method provided in some embodiments of this disclosure, when the displayed content includes a vehicle, controls the vehicle to which the display device belongs to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle, so that the vehicle adjusts its own body posture to match the vehicle posture of the vehicle. In other words, when a user uses the display device, the vehicle the user is riding in matches the vehicle posture of the virtual character's vehicle in the displayed content, allowing the user to personally experience the body posture felt by the virtual character. This enables the user to have a more immersive experience of the displayed content and enhances the user experience of the display device.
[0105] In some embodiments, the vehicle needs to be controlled to adjust to different body postures under different virtual driving states. When the virtual vehicle is driving smoothly, in order to improve the user's perception experience, the vehicle posture can be adjusted to simulate the road feel of the vehicle driving.
[0106] As a feasible implementation method, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including: when the virtual driving state is at a constant speed, controlling the vehicle to adjust the roll angle within a preset roll angle range, and adjusting the pitch angle within a preset pitch angle range.
[0107] Understandably, even when a vehicle is traveling at a constant speed, its body is not always stable. Various vehicle-related or road surface conditions can cause it to sway back and forth or side to side. For example, the springs and shock absorbers in the suspension system constantly compress and rebound while the vehicle is in motion. When the vehicle passes over small bumps in the road, the springs are compressed to store energy, and then release that energy, causing the body to rebound and resulting in up-and-down swaying. Tires deform during driving, especially when tire pressure is low or tire wear is uneven. Tire deformation causes the vehicle to sway side to side while driving. Furthermore, potholes, cracks, bulges, and other uneven surfaces on the road can impact the vehicle's suspension system, causing the body to sway.
[0108] Therefore, as a feasible approach, in order to better control the characteristics of the vehicle's movement when simulating a virtual vehicle, the vehicle can be controlled to continuously adjust its roll angle within a preset roll angle range and its pitch angle within a preset pitch angle range when the vehicle's virtual driving state is at a constant speed, thereby enhancing the user's sense of realism in driving the virtual vehicle.
[0109] It should be understood that the preset pitch angle range and preset roll angle range are pre-set and can be determined according to the type of vehicle and usage requirements in actual application. As a feasible implementation method, the preset pitch angle range can be [-3°, +3°]; the preset roll angle range can be [-5°, +5°].
[0110] It should be noted that the first attitude control command can also include the frequency and speed at which the vehicle adjusts its pitch and roll angles. For example, a roll angle variation curve can be generated using a sine wave function with a frequency range of 0.1Hz to 0.5Hz. This means the vehicle can complete a full roll cycle at preset intervals to enhance the realism of the driving experience.
[0111] As a feasible implementation method, when the virtual driving state is at a constant speed, the display device can send a first attitude control command to the vehicle. Here, the first control command is used to instruct the vehicle to continuously adjust the roll angle within a preset roll angle range, and to continuously adjust the pitch angle within a preset pitch angle range.
[0112] In some embodiments, referring to Figure 5, when the virtual driving state of the vehicle is at a constant speed, the first attitude control command sent by the display device to the vehicle is x_J. Upon receiving this command, the domain control middleware determines that the swaying caused by the vehicle's movement at a constant speed is generally unrelated to the vehicle speed, and therefore can directly determine that the speed increase factor is 1. Furthermore, the domain control middleware can send 1x_J to the controller, which indicates that the controller continuously adjusts the vehicle's pitch angle between [+∠α, -∠α] and the vehicle's roll angle between [+∠β, -∠β]. Here, ∠α represents the preset pitch angle, and ∠β represents the preset roll angle. Since the road feel of the vehicle needs to be simulated when it is present in the scene, the first attitude control command is continuously sent.
[0113] As can be seen, the solutions provided in some embodiments of this disclosure, when the vehicle is traveling at a constant speed, control the vehicle to adjust the roll angle within a preset roll angle range and the pitch angle within a preset pitch angle range, so that the vehicle can simulate the changes in roll angle and pitch angle of a virtual vehicle traveling at a constant speed, thereby enabling users of display devices to experience a more realistic driving experience, as if they were in the driving environment of a virtual vehicle.
[0114] In some embodiments, during actual driving, due to the vehicle's inertia and the dynamic response of the suspension system, the vehicle's acceleration or deceleration can cause significant changes in the vehicle's pitch angle. Therefore, the vehicle's pitch angle can be adjusted when the virtual vehicle is in a gear-changing state, so that the vehicle can accurately simulate the gear-changing situation of the virtual vehicle.
[0115] As a feasible implementation method, please refer to Figure 6. The above-mentioned control of the vehicle to which the display device belongs to perform corresponding vehicle body posture adjustment actions based on the virtual driving state of the vehicle can be implemented as follows: steps S601-S602.
[0116] S601. When the virtual driving state is in a variable speed state, determine the target pitch angle of the vehicle based on the vehicle's acceleration.
[0117] It should be understood that the virtual driving state is a variable-speed state, meaning the vehicle's acceleration is not zero, and the vehicle may be in an acceleration or braking state. In actual driving, when a vehicle accelerates or brakes, the vehicle body will tend to tilt forward or backward due to inertia. For example, during acceleration, the inertial force pulls the vehicle body backward, causing the front of the vehicle to lift up (increased pitch angle). During braking, the inertial force pushes the vehicle body forward, causing the front of the vehicle to drop down (decreased pitch angle).
[0118] Since there is a direct physical relationship between a vehicle's acceleration and its attitude (such as pitch angle), the target pitch angle can be determined based on the vehicle's acceleration. As a feasible implementation, the target pitch angle can be determined to be positive when the vehicle's acceleration is greater than 0 (vehicle acceleration) (taking the vehicle coordinate system as an example); and negative when the vehicle's acceleration is less than 0 (vehicle deceleration). In some embodiments, a preset pitch angle of 5° can be set; when the vehicle's acceleration is greater than 0, the target pitch angle is determined to be 5°; and when the vehicle's acceleration is less than 0, the target pitch angle is determined to be -5°.
[0119] As another feasible approach, since the change in pitch angle is positively correlated with acceleration, the target pitch angle can be determined based on the vehicle's acceleration and a preset proportional relationship. It's understandable that higher vehicle speeds result in greater inertial forces during acceleration or deceleration, leading to more significant pitch angle changes. Therefore, the vehicle's speed can be considered when determining the target pitch angle.
[0120] Therefore, as a feasible approach, determining the target pitch angle of a vehicle based on its acceleration can be achieved by: determining the target pitch angle based on the vehicle's speed and acceleration. Here, vehicle speed and target pitch angle are positively correlated. As vehicle speed increases, inertial force pulls the vehicle body backward, causing the front of the vehicle to lift more; as vehicle speed decreases, inertial force pushes the vehicle body forward, causing the front of the vehicle to drop more. Therefore, the target pitch angle of a vehicle can be determined based on its speed.
[0121] As a feasible approach, the target pitch angle of the vehicle can be determined based on the vehicle's speed and acceleration, which can be achieved through the following steps S6011 to S6013.
[0122] S6011. Determine the initial pitch angle of the vehicle based on the vehicle's acceleration.
[0123] As a feasible approach, the initial pitch angle can be determined based on the vehicle's acceleration. In other words, if the vehicle's acceleration is greater than 0, the initial pitch angle can be determined to be positive; if the vehicle's acceleration is less than 0, the target pitch angle can be determined to be negative.
[0124] S6012. Determine the speed amplification factor based on the vehicle speed.
[0125] Since the vehicle's speed is positively correlated with the target's pitch angle, the speed amplification factor can be determined based on the vehicle's speed. As a feasible implementation method, the speed amplification factor can be determined as 1 when the vehicle speed is between 0 km / h and 30 km / h; as 2 when the vehicle speed is between 30 km / h and 60 km / h; as 3 when the vehicle speed is between 60 km / h and 90 km / h; and as 4 when the vehicle speed is above 90 km / h.
[0126] S6013. Adjust the initial pitch angle according to the speed increase factor to obtain the target pitch angle.
[0127] One approach is to multiply the speed increase factor by the initial pitch angle to obtain the target pitch angle.
[0128] S602, Control the vehicle to adjust the pitch angle to the target pitch angle.
[0129] In this way, the vehicle's pitch angle is adjusted to the target pitch angle, enabling the vehicle to simulate the body posture of a vehicle during gear shifting.
[0130] As one feasible implementation, S602 can be implemented as follows: the display device generates a second attitude control command based on the target pitch angle and sends the second attitude control command to the vehicle. Here, the second attitude control command is used to instruct the vehicle to adjust the pitch angle to the target pitch angle.
[0131] It should be noted that, as a feasible implementation method, the second attitude control command can be: Nx_Pf / Nx_Pb. Here, Nx_Pf indicates that the vehicle needs to perform a pitching motion, that is, the front suspension needs to raise its height; Nx_Pb indicates that the vehicle needs to perform a nodding motion, that is, the rear suspension needs to raise its height; N is used to represent the speed amplification factor mentioned above.
[0132] In other words, when the second attitude control command is Nx_Pf, the vehicle needs to control the height of the front suspension to achieve a pitch angle of N*∠α; when the second attitude control command is Nx_Pb, the vehicle needs to control the height of the rear suspension to achieve a pitch angle of -N*∠α. It should be understood that ∠α is the preset pitch angle.
[0133] As a feasible implementation method, S602 can be implemented by controlling the vehicle to adjust the pitch angle to the target pitch angle during the duration corresponding to the gear shift state.
[0134] The duration corresponding to the gear shift state is used to indicate the running time of the vehicle in a specific gear shift mode (such as acceleration and deceleration). In order to better achieve the user's immersive experience, the vehicle can be controlled to maintain the target pitch angle during the duration corresponding to the gear shift state, so as to improve the user's experience.
[0135] In some embodiments, referring to Figure 7, when the vehicle's virtual driving state is in a shifting state, it is necessary to determine the vehicle's initial speed when the vehicle speed changes, and then determine the speed increase factor N based on the initial speed. Then, a second attitude control command Nx_Pf / Nx_Pb is sent to the controller, which indicates adjusting the vehicle's pitch angle to N*∠α or -N*∠α. Since the vehicle's state change in the shifting state is not repeated, the second attitude control command only needs to be executed once.
[0136] As can be seen, the solutions provided in some embodiments of this disclosure determine the target pitch angle of the vehicle based on the acceleration of the virtual vehicle when the virtual vehicle is in a variable speed state, so that the vehicle can adjust the pitch angle to the target pitch angle. That is, adjusting the angle of the vehicle's front tilt, making the driving experience of the user driving the virtual vehicle using the display device more realistic and more like a real vehicle, and enhancing the user's immersion when using the display device.
[0137] In some embodiments, when a vehicle turns, the vehicle body will tilt outwards due to centrifugal force. When a virtual vehicle displayed on a display device turns, the vehicle will also tilt left and right. In order to better simulate the tilt state of the vehicle when turning and the centrifugal feeling when turning, the vehicle's roll angle can be adjusted.
[0138] As a feasible implementation method, please refer to Figure 8. Based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including the following steps S801 to S802.
[0139] S801. When the virtual driving state is a turning state, determine the target roll angle of the vehicle based on the preset roll angle.
[0140] It is understood that some embodiments of this disclosure do not limit the method of determining the virtual driving state as a turning state. For example, the virtual driving state of the vehicle can be determined as a turning state when the coordinate point of the vehicle in the next frame forms an angle with the current orientation (e.g., >5°), or when the wheels of the vehicle model visually deflect (e.g., the front wheels deflect >10°), or when the vehicle model exhibits a tilt animation (e.g., the tilt angle is >5°).
[0141] When a vehicle is turning, in order to better simulate the vehicle's posture when turning, the vehicle can be controlled to produce a certain tilt angle.
[0142] As a feasible approach, since the roll angle of a vehicle when turning is related to parameters such as centrifugal force and lateral acceleration, the lateral acceleration of the vehicle and the curvature of the road surface can be considered when determining the target roll angle. This disclosure does not impose any restrictions on this.
[0143] As a feasible approach, determining the target roll angle of the vehicle based on a preset roll angle includes: determining the target roll angle of the vehicle based on the vehicle speed and the preset roll angle. Here, the vehicle speed and the target roll angle are positively correlated.
[0144] Since higher vehicle speeds result in higher inertia, the vehicle speed can be used to determine the target roll angle.
[0145] As a feasible approach, the target roll angle of the vehicle is determined based on the vehicle's speed and roll angle, including: determining the speed amplification factor based on the vehicle's speed; the vehicle speed and the speed amplification factor are positively correlated; and adjusting the preset roll angle according to the speed amplification factor to obtain the target roll angle.
[0146] It should be understood that the method for determining the speed amplification factor can refer to the above embodiments, and will not be repeated here. After obtaining the speed amplification factor, the speed amplification factor can be multiplied by a preset roll angle to obtain the target roll angle.
[0147] S802, Control the vehicle to adjust the roll angle to the target roll angle.
[0148] It should be understood that when a vehicle performs a turning maneuver, it is divided into turning left and turning right, which requires the vehicle to tilt in different directions, that is, to adjust the vehicle's roll angle.
[0149] As one feasible implementation, S802 can be implemented as follows: the display device generates a third attitude control command based on the target roll angle and sends the third attitude control command to the vehicle. Here, the third attitude control command is used to instruct the vehicle to adjust the roll angle to the target roll angle.
[0150] Therefore, as a feasible implementation method, the third attitude control command can be: Nx_Rl / Nx_Rr. Here, Nx_Rl indicates that the vehicle needs to tilt to the left, that is, the right suspension needs to be raised; Nx_Rr indicates that the vehicle needs to tilt to the right, that is, the left suspension needs to be raised; N is used to represent the speed amplification factor mentioned above.
[0151] In other words, when the third attitude control command is Nx_Rl, the vehicle needs to control the right suspension to raise its height so that the vehicle's roll angle reaches N*∠β; when the third attitude control command is Nx_Rr, the vehicle needs to control the left suspension to raise its height so that the vehicle's roll angle reaches -N*∠β. It should be understood that ∠β is the preset roll angle.
[0152] In some embodiments, referring to Figure 9, when the vehicle's virtual driving state is a turning state, it is necessary to determine the vehicle's initial speed when the vehicle changes direction, and then determine the speed amplification factor N based on the initial speed. Then, a third attitude control command Nx_Rl / Nx_Rr is sent to the controller, which indicates adjusting the vehicle's roll angle to N*∠β or -N*∠β. Since the vehicle's state change in the turning state is not repeated, the third attitude control command only needs to be executed once.
[0153] As a feasible implementation method, controlling the vehicle to adjust the roll angle to the target roll angle includes: adjusting the roll angle to the target roll angle during the duration corresponding to the turning state.
[0154] To better achieve an immersive user experience, the vehicle can be controlled to maintain a target roll angle during the duration of the turning phase, thus enhancing the user's experience.
[0155] As can be seen, the solutions provided in some embodiments of this disclosure adjust the vehicle's roll angle to a target roll angle when the virtual vehicle is turning. That is, they adjust the left and right tilt angles of the vehicle, making the driving experience of the virtual vehicle using the display device more realistic and more like a real vehicle, thus enhancing the user's immersion in the display device.
[0156] In some embodiments, when a vehicle experiences bumps or impacts, the uneven forces cause the vehicle body to rotate around different axes, resulting in changes in the vehicle's pitch and roll angles. For example, when driving on uneven surfaces (such as speed bumps or potholes), the front of the vehicle rises when the front wheels encounter an obstacle, and the rear of the vehicle rises when the rear wheels pass over it, creating an overall "wave-like" effect. When one wheel is suspended in the air or there is a height difference between the left and right sides (such as one tire passing over an obstacle), the vehicle body will tilt to the lower side, similar to a "seesaw effect." Therefore, to simulate the vehicle's posture under bumpy and impact conditions, the vehicle's pitch and roll angles can be continuously adjusted.
[0157] As a feasible implementation method, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including: when the virtual driving state is a bumpy state or an impact state, during the duration of the bumpy state or impact state, controlling the vehicle to adjust the roll angle within the target roll angle range, and adjusting the pitch angle within the target pitch angle range.
[0158] It should be understood that this disclosure does not limit the method of determining whether a vehicle is in a bumpy or impacted state. As one implementation method, it is possible to determine whether a vehicle is in a bumpy or impacted state when the displayed screen is briefly blurred or shaken, or when the vehicle's wheels bounce up and down.
[0159] Since bumpy or impact-prone conditions are typically continuous, and the vehicle will generally sway constantly during this duration, it's possible to continuously adjust the roll angle within a target roll angle range and the pitch angle within a target pitch angle range during the duration of the bumpy or impact-prone condition. This allows the user to experience the vehicle swaying from side to side, similar to driving in waves.
[0160] In other words, the vehicle's left and right tilt angles repeatedly change within the target roll angle range. For example: tilt left → straighten → tilt right → straighten, creating a "swaying" effect. Furthermore, the vehicle's front or rear tilt angles repeatedly change within the target pitch angle range. For example: front rise → straighten → front drop → straighten, creating a "nodding" effect. This allows the user to feel the rise and fall of the front or rear of the vehicle, similar to driving on a rough road.
[0161] When the vehicle's roll and pitch angles are adjusted simultaneously, complex attitude changes can be created. For example: tilting left + hood rising → straightening + hood falling → tilting right + hood rising → straightening + hood falling. The vehicle's posture will appear "distorted" or "irregularly moving" to simulate the vehicle's bumpy or impact-prone state.
[0162] Understandably, the amplitude of vehicle swaying under bumpy conditions is indeed closely related to vehicle speed. At lower speeds, the swaying amplitude is relatively smaller; at higher speeds, the swaying amplitude increases significantly. Therefore, the target roll angle range and / or target pitch angle range can be determined based on the vehicle's speed.
[0163] As a feasible approach, when the virtual driving state is a bumpy state, the upper and / or lower limits of the target roll angle range are determined based on the vehicle speed and the preset roll angle.
[0164] In some embodiments, the speed amplification factor can be determined first based on the vehicle speed, and then the upper limit of the target roll angle range can be determined as N*∠β, and the lower limit as -N*∠β.
[0165] As a feasible implementation method, when the virtual driving state is a bumpy state, the upper and / or lower limits of the target pitch angle range are determined based on the vehicle speed and the preset pitch angle.
[0166] In some embodiments, the speed amplification factor can be determined first based on the vehicle speed, and then the upper limit of the target pitch angle range can be determined as N*∠α, and the lower limit as -N*∠α.
[0167] Understandably, in the event of a collision, the vehicle experiences forces in both the frontal and rearward directions (such as in a frontal or rear-end collision), causing it to decelerate rapidly. Therefore, determining the amplification factor under impact conditions based solely on vehicle speed is not feasible.
[0168] Based on this, as a feasible implementation method, when the virtual driving state is an impact state, the upper and / or lower limits of the target roll angle range are determined based on the target impact amplitude and the preset roll angle.
[0169] As a feasible implementation method, when the virtual driving state is a collision state, the upper and / or lower limits of the target pitch angle range are determined based on the target impact amplitude and the preset pitch angle.
[0170] Here, the target impact amplitude is set by the user before watching a movie on the display device; or, the target impact amplitude is a preset value.
[0171] In other words, the target impact amplitude is preset by the system or the user, and the user can set it according to the impact sensation they want to experience; this disclosure does not impose any restrictions on this. It is understood that the user needs to set the target impact amplitude before viewing the movie on the display device, setting the target impact amplitude n to the multiple level desired by the player.
[0172] As a feasible implementation method, the display device can continuously send fourth attitude control commands to the vehicle when the vehicle is in a bumpy or impacted state. Here, the fourth attitude control commands are used to instruct the vehicle to continuously adjust the roll angle within the target roll angle range, and to continuously adjust the pitch angle within the target pitch angle range.
[0173] In some embodiments, when the virtual driving state is a bumpy state, the fourth attitude control command can be Nx_J. Here, N represents the speed amplification factor. When the virtual driving state is an impact state, the fourth attitude control command can be nx_J. Here, n represents the target impact magnitude.
[0174] In some embodiments, referring to Figure 10, when the virtual driving state of the vehicle is a bumpy state, it is necessary to determine the initial vehicle speed when the vehicle is bumpy, and then determine the speed amplification factor N based on the initial vehicle speed. Then, a fourth attitude control command Nx_J is sent to the controller, which indicates that the controller continuously adjusts the vehicle's pitch angle between [+N*∠α, -N*∠α] and the vehicle's roll angle between [+N*∠β, -N*∠β]. Since the vehicle's state changes under bumpy conditions need to be repeatedly executed, the fourth attitude control command needs to be sent cyclically during the vehicle's bumpy state.
[0175] In some embodiments, referring to Figure 11, when the vehicle's virtual driving state is in an impact state, the speed amplification factor n at the time of impact is preset. A fourth attitude control command nx_J is then sent to the controller, indicating that the controller continuously adjusts the vehicle's pitch angle between [+n*∠α, -n*∠α] and the vehicle's roll angle between [+n*∠β, -n*∠β]. Since the vehicle's state changes in the impact state need to be repeatedly executed, the fourth attitude control command is sent to the vehicle controller based on the number of impacts.
[0176] As can be seen, the solutions provided in some embodiments of this disclosure control the vehicle to adjust the pitch and roll angles when the vehicle's virtual driving state is a bumpy or impacted state. This causes the vehicle's body posture to sway left and right and back and forth, appearing "distorted" or "irregularly moving," in order to accurately simulate the vehicle's virtual driving state. This allows users riding in the vehicle and using display devices to have a more immersive experience of the content displayed on the display devices.
[0177] In some embodiments, users find it difficult to experience a vehicle leaping in real-world driving, a limitation that has made games and movies important mediums for realizing such scenarios. Users typically experience a vehicle leaping in a virtual environment provided by a display device to achieve sufficient visual impact and excitement. To better provide users with an immersive viewing experience, the vehicle can be controlled to perform a suspension jump maneuver while its virtual driving state is in a leaping state.
[0178] As a feasible implementation method, when the virtual driving state is a leap state, the vehicle body posture adjustment action is a suspension jump action, which is used to achieve an instantaneous height jump of the vehicle body.
[0179] It should be understood that this disclosure does not limit the method of determining the virtual driving state of a vehicle as a leap state. In some embodiments, the virtual driving state of a vehicle can be determined as a leap state when the vehicle's trajectory presents a parabola rather than planar movement.
[0180] When a vehicle is in a flying state, it will have a visual effect of "leaping off the ground". In order to simulate this "flying" state for real vehicles, the vehicle body can be briefly lifted off the ground by the suspension jumping action.
[0181] Understandably, vehicle suspension jump maneuvers typically rely on active suspension technology. By utilizing the suspension's extension and retraction capabilities (such as air suspension inflation or electric motor-driven suspension lifting), the vehicle height can be changed in a very short time (usually <1 second) to simulate a "leap" posture. This allows the vehicle body to rise rapidly in a short period, achieving the effect of "lifting off the ground." It should be understood that suspension jump maneuvers require a powerful suspension system (such as fully active suspension or air suspension) and a high-power power source (such as an electric motor or air compressor) to provide lifting force. In practical applications, the vehicle can determine whether to execute the fifth attitude control command based on its own configuration, which will not be elaborated upon in this disclosure.
[0182] As a feasible implementation method, when the display device determines that the vehicle is in a jumping state, it can obtain the vehicle's takeoff parameters (such as height, angle, and speed) from the virtual scene, and then generate control parameters for the vehicle's suspension system (such as takeoff height). This allows the vehicle to control the suspension system to adjust its body posture to match the virtual state of the vehicle.
[0183] As a feasible approach, when the virtual driving state is in a jump state, the display device can send a fifth attitude control command to the vehicle. Here, the fifth attitude control command is used to control the vehicle to perform a suspension jump action.
[0184] In some embodiments, please refer to Figure 12. When the virtual driving state of the vehicle is in a jump state, a fifth attitude control command 1x_T can be sent to the controller, which is used to indicate that the controller controls the vehicle to perform a suspension jump action, which only needs to be executed once.
[0185] As can be seen, the solutions provided in some embodiments of this disclosure control the vehicle to perform a suspension jump action when the vehicle's virtual driving state is a leap state, allowing users to personally experience the thrill of "leaping" and bringing the excitement of the virtual scene into reality.
[0186] In some embodiments, as vehicle speed increases, the physical forces such as centrifugal force and inertial force acting on the vehicle increase significantly, resulting in greater amplitude of roll and pitch movements. In other words, the higher the vehicle speed, the more pronounced the vehicle's movements. Therefore, to better simulate the posture of a virtual vehicle, the vehicle's posture can be controlled based on the virtual vehicle's speed.
[0187] As a feasible implementation method, when the vehicle body posture adjustment action is used to adjust the vehicle's roll angle and / or pitch angle, based on the vehicle's virtual driving state, the vehicle to which the display device belongs is controlled to perform the corresponding vehicle body posture adjustment action, including the following steps S1011 to S1012.
[0188] S1011. Determine the attitude adjustment parameters based on the virtual driving state of the vehicle, and determine the speed amplification factor based on the vehicle speed.
[0189] Here, attitude adjustment parameters include the initial roll angle and / or the initial pitch angle.
[0190] In other words, the attitude adjustment parameters are determined based on which vehicle parameters need to be adjusted according to the vehicle's virtual driving state. For example, when the vehicle is in a shifting state, only the vehicle's pitch angle needs to be adjusted, and the attitude adjustment parameters include the initial pitch angle.
[0191] As vehicle speed increases, the amplitude of vehicle tilting and pitching movements will also increase. As a means of implementation, the vehicle speed is positively correlated with the speed amplification factor. The vehicle speed can be converted into a speed amplification factor through a preset conversion relationship, and this disclosure does not limit the conversion method.
[0192] As another feasible approach, each speed range can be assigned a speed amplification factor. As shown in Figure 13, the speed amplification factor is 1 for speeds between 0 km / h and 30 km / h; 2 for speeds between 30 km / h and 60 km / h; 3 for speeds between 60 km / h and 90 km / h; and 4 for speeds above 90 km / h.
[0193] S1012. Correct the attitude adjustment parameters based on the speed increase factor, and control the vehicle to adjust the roll angle and / or pitch angle based on the corrected attitude adjustment parameters.
[0194] It should be understood that the method of correcting the attitude adjustment parameters based on the speed amplification factor can refer to the above embodiments, and will not be repeated here. As one implementation, after obtaining the speed amplification factor, the speed amplification factor can be multiplied by the initial roll angle to obtain the target roll angle, and then the vehicle can be controlled to adjust the roll angle to the target roll angle.
[0195] As can be seen, the solutions provided in some embodiments of this disclosure adjust the range of motion of the vehicle when performing body posture adjustment actions based on the vehicle speed. By adjusting the body posture range of the real vehicle in real time, it can accurately match the dynamic state of the virtual vehicle, eliminate the "sense of separation" between virtual and reality, and improve the immersive experience and training effect.
[0196] In some embodiments, the vehicle's posture changes when the display device is linked to the vehicle's movement. If the vehicle's posture changes while in motion, it poses a safety hazard. Therefore, the vehicle needs to be stationary to enhance the viewing experience.
[0197] As one feasible implementation method, some embodiments of this disclosure provide a vehicle control method that further includes: in response to the activation of a movie-watching or game mode, outputting a first prompt message when the vehicle is in a parked state. Here, the first prompt message is used to prompt the user whether to activate the first movie-watching or game mode. The first movie-watching or game mode supports the display device sending attitude control commands to the vehicle during movie-watching or game playback.
[0198] When users enable movie or game mode on their display devices, to enhance the immersive viewing experience, the vehicle's body can be linked to change its posture in the displayed content. However, changes in vehicle posture can manifest as bumping, tilting, swaying, or loss of control, posing a threat to driving safety. For example, if a vehicle tilts excessively while traveling at high speed or turning, it may roll over, causing a serious accident.
[0199] Therefore, it is necessary to check whether the vehicle is in a parked state. If the vehicle is in a parked state, it indicates that adjusting the vehicle's posture will not pose a danger.
[0200] It should be understood that the display device can communicate and interact with the vehicle to obtain the vehicle's gear position, and thus determine the vehicle's state as parked if the gear is in the parking position. For example, for an automatic transmission vehicle, the gear should be in "P" (parking). For a manual transmission vehicle, the gear should be in neutral (N) and the handbrake should be engaged. This disclosure does not limit the way the first prompt information is displayed; the first prompt information can be displayed in one or more forms such as text, voice, and animation, and this disclosure does not impose any restrictions on this.
[0201] When the vehicle is parked, in order to enhance the user's immersive viewing experience, the display device can prompt the user to activate the first viewing or game mode, that is, whether to coordinate with the vehicle to change the body posture during the viewing process.
[0202] Since multiple passengers typically travel in a vehicle, and changes in the vehicle's posture are perceived by all passengers simultaneously, a primary prompt message needs to be displayed when the vehicle is parked, allowing users of the display device to choose whether to activate the primary viewing mode. This disclosure does not restrict the method by which users activate the primary viewing or game mode.
[0203] As one implementation method, the first prompt message may also include a selection control corresponding to the first movie or game mode, which the user can trigger to enable the first movie or game mode.
[0204] As another implementation method, users can speak voice control commands related to "starting the first movie or game mode", and the display device can activate the first movie or game mode after receiving the voice control command.
[0205] As one implementation method, the above-mentioned control of the vehicle to which the display device belongs to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle includes: when the display device is in the first movie or game mode, controlling the vehicle to which the display device belongs to perform corresponding body posture adjustment actions based on the virtual driving state of the vehicle.
[0206] When the display device is in its primary viewing or gaming mode, the vehicle is confirmed to be parked. To enhance the immersive viewing experience, the user needs to interact with the vehicle control system. Based on the virtual driving state of the vehicle, the display device can control the vehicle associated with it to perform corresponding body posture adjustments, ensuring that the vehicle's posture matches the posture of the vehicle displayed on the screen. This allows users to enjoy high-quality viewing and gaming content in a safer and more stable environment.
[0207] As another implementation, some embodiments of this disclosure provide a control method that further includes enabling a second viewing or gaming mode when the vehicle is in a non-parked state. Here, the second viewing or gaming mode does not support the display device controlling the vehicle to perform body posture adjustment actions during viewing or gaming.
[0208] When the vehicle is not parked, to ensure driving safety, the second viewing or gaming mode is activated directly. This means that the vehicle's posture is not adjusted while the display device is in use, thus ensuring driving safety.
[0209] It should be noted that, in some embodiments, the first viewing or gaming mode described above may also be referred to as a 5D viewing or gaming mode, and the second viewing or gaming mode described above may also be referred to as a normal viewing or gaming mode. This disclosure does not impose any limitations on this.
[0210] As a feasible implementation method, the control method also includes: outputting a second prompt message when the vehicle is in a non-parked state. Here, the second prompt message is used to remind the user that the first movie-watching or game mode can only be enabled when the vehicle is parked.
[0211] Since the first standard viewing or gaming mode offers a superior user experience, users can be prompted to use it for an immersive experience once the vehicle is parked, even when it is not in a parked state. This demonstrates the system's consideration and care for user safety, helping to enhance user trust in the vehicle's intelligent system. In some embodiments, reasonable prompts and guidance can be used to encourage users to try and use the first viewing or gaming mode, thereby increasing user trust in the vehicle and display device.
[0212] As can be seen from the above embodiments, the solutions provided in some embodiments of this disclosure allow the first viewing or gaming mode to be activated only when the vehicle is parked, enabling users to enjoy high-quality viewing and gaming content in a safer and more stable environment, thereby significantly improving the user experience. When the vehicle is not parked, to ensure user safety, only the second viewing or gaming mode is activated, and the user is prompted that the first viewing or gaming mode can only be activated when the vehicle is parked. This demonstrates the system's consideration and care for user safety, helping to enhance user trust in the vehicle's intelligent system.
[0213] In some embodiments, since a portion of the content displayed on the display device is pre-set, such as movies, the setting of all elements such as scenes, characters, and actions is completed during the production stage. Here, the driving status of the vehicle, including speed, direction, acceleration, etc., is pre-planned to ensure the coherence of the story and the visual effects.
[0214] Game content is typically pre-defined, but different game types vary in the degree of pre-defined features and the level of dynamism. However, all game content must be pre-designed by developers; only the degree of pre-defined features varies by genre. Furthermore, even dynamically generated vehicle behavior must be based on pre-defined physics models and rules. The "freedom" and "immersion" experienced by players depend on the balance between pre-defined content and dynamic interactions.
[0215] Therefore, in order to ensure the real-time linkage between the display device and the vehicle, multiple time points that need to be linked and corresponding attitude control commands can be determined in advance based on the display content.
[0216] As a feasible implementation method, some embodiments of this disclosure provide a vehicle control method that further includes the following steps S11 to S12.
[0217] S11. Analyze the visual elements in the displayed content to determine whether there is a vehicle in the displayed content.
[0218] Visual analysis of the displayed content aims to identify various elements in the image, such as vehicles, people, objects, and backgrounds. Some embodiments of this disclosure primarily focus on the element of "vehicles," which can be any mobile means of transportation, such as cars, airplanes, or ships.
[0219] The characteristics of a vehicle can be identified through pattern recognition, image recognition, or machine learning algorithms, and it can be distinguished from other elements in the image to determine whether a vehicle exists in the displayed content.
[0220] S12. In the presence of a vehicle, determine the virtual driving state of the vehicle at each time point.
[0221] If the content being displayed does indeed contain a vehicle, it's necessary to determine the vehicle's motion state within the frame. This requires locating the vehicle's position in each frame of the video or animation and calculating its motion parameters such as speed and direction. This, in turn, constructs the vehicle's "virtual driving state" at each point in time—that is, the vehicle's trajectory and state in the virtual world.
[0222] As a feasible implementation method, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including: sending posture control commands to the vehicle based on the virtual driving state of the vehicle at the current time point. Here, the posture control commands are used to cause the vehicle to perform body posture adjustment actions.
[0223] Understandably, by accurately determining the virtual driving state of the vehicle at each point in time, the display device can more accurately generate the attitude control commands corresponding to the current point in time, making the changes in the vehicle's body posture more consistent with the changes in the vehicle's state, and allowing users to experience a more realistic driving experience.
[0224] As a feasible approach, the time interval can be dynamically adjusted based on the driving status data of the virtual vehicle, and the sampling frequency can be increased when the vehicle status changes drastically.
[0225] In some embodiments, when a user is using a display device to experience a racing game, when the speed of the virtual vehicle exceeds a threshold (e.g., 120 km / h) or the steering wheel angle exceeds 30 degrees, the display device can automatically increase the density of time nodes to ensure accurate calculation of the vehicle's attitude during sharp turns.
[0226] As can be seen, the chain logic of "real-time calculation - command issuance - execution response" requires waiting for the virtual vehicle's state to change before triggering the execution mechanism layer by layer, resulting in cumulative delays (such as virtual state calculation time + communication delay + suspension action response). However, the solution provided in some embodiments of this disclosure, by pre-determining the virtual driving state corresponding to each time node, adjusts the control logic to a "state prediction - command pre-caching - actuator standby" mechanism. This sends the attitude control command to the vehicle before the virtual vehicle's driving state changes, reducing delays and making the generation and transmission of attitude control commands more accurate. Consequently, the time it takes for the vehicle to adjust its body posture is more closely matched to the time it takes for the vehicle's posture to change. Users experience complete synchronization between the vehicle's response and the displayed content as the vehicle changes, as if directly controlling a physical vehicle, significantly enhancing the user's immersive experience.
[0227] In some embodiments, please refer to FIG14. The vehicle control method provided by some embodiments of this disclosure can be implemented by the following steps a1-a7 when a user uses a display device while riding in a vehicle.
[0228] a1. The display device establishes a communication connection with the vehicle.
[0229] It should be understood that the display device and the vehicle can communicate via Bluetooth, WiFi or wiring harness, and this disclosure does not impose any restrictions on this.
[0230] a2. Users can select to start either movie viewing or game mode on the display device.
[0231] Users can enable movie or game modes by using buttons or display controls on the device.
[0232] a3. Check if the vehicle is currently parked. If yes, proceed to step a31; otherwise, proceed to step a32.
[0233] a31. Activate 5D movie or game mode.
[0234] a32. Activate normal movie or game mode.
[0235] a33. Prompt the user to select the movie or game they want to watch.
[0236] a34. Shielding linkage function.
[0237] a35. Play the displayed content.
[0238] If the vehicle is parked, the display device can activate the 5D movie or game mode; if the vehicle is not parked, the display device needs to activate the normal movie or game mode. The display device will then show which mode is being activated and indicate that the 5D movie or game mode can only be activated when the vehicle is parked, and that any interactive functions must be disabled to directly start playing the user-selected content.
[0239] It should be understood that when the 5D movie / game mode is activated, the vehicle's fully active suspension system can respond according to the movie or game content. When the normal movie / game mode is activated, the vehicle's active suspension system will not be activated.
[0240] a4. Prompt the user to select the movie or game they want to watch.
[0241] a5. Display content loading and interact with environmental devices (suspension).
[0242] It should be understood that in 5D movie or game mode, the display content needs to be loaded and interact with the environmental equipment (the vehicle's fully active suspension system) based on the display content; in normal movie or game mode, the interactive function needs to be disabled and the user-selected display content should be played directly.
[0243] a6. The progress bar displays in real time whether loading and interaction are complete. If yes, proceed to step a61; otherwise, proceed to step a4 again.
[0244] a61. Send attitude control commands to the vehicle based on the displayed content.
[0245] If loading and interaction are successful, you can experience the video or game and need to send attitude control commands to the vehicle based on the displayed content; if loading and interaction fail, you need to select the video or game again to load and interact.
[0246] a7. After the movie, the user should remove the display device and disconnect it from the vehicle.
[0247] In some embodiments, to enhance the all-scenario driving experience, the vehicle can employ a four-wheel independent suspension architecture, achieving complete isolation of the motion trajectory of each wheel through physical decoupling. Based on this wheel trajectory isolation, actuators such as air springs, solenoid valves, or hydraulic pumps can dynamically adjust the ground clearance (height) of each wheel, enabling active control of the vehicle's attitude. This means that the height of each suspension system can be independently adjusted, allowing the vehicle to more accurately perform body attitude adjustment actions.
[0248] As a feasible implementation method, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including: when the roll angle of the vehicle is determined based on the virtual driving state, adjusting the suspension height of the left and / or right suspension of the vehicle's active suspension system based on the virtual driving state.
[0249] Adjusting the vehicle's roll angle means adjusting the height difference between the left and right suspensions, creating an angular difference between the left and right suspensions and the horizontal. If the roll angle indicates a leftward tilt, the right suspension can be raised and the left suspension lowered. If the roll angle indicates a rightward tilt, the left suspension can be raised and the right suspension lowered.
[0250] As a feasible implementation method, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs performs corresponding body posture adjustment actions, including: when the pitch angle of the vehicle is determined based on the virtual driving state, adjusting the suspension height of the front suspension and / or rear suspension of the vehicle's active suspension system based on the virtual driving state.
[0251] Adjusting the vehicle's pitch angle means adjusting the height difference between the front and rear suspensions, creating a certain angular difference between the front and rear suspensions and the horizontal plane. If the pitch angle is used to indicate lowering the front of the vehicle, the rear suspension can be raised and the front suspension lowered. If the roll angle is used to indicate lowering the rear of the vehicle, the front suspension can be raised and the rear suspension lowered.
[0252] It should be understood that in practical applications, vehicles can change the suspension length by pushing the piston through the oil pump in the hydraulic system, or directly drive the suspension joint with electromagnetic force to achieve the purpose of adjusting the suspension height. This disclosure does not limit the way the vehicle adjusts the suspension height.
[0253] Some embodiments of this disclosure can divide a vehicle control device or electronic device into functional modules according to the above method. For example, the vehicle control device or electronic device may include functional modules corresponding to each functional division, or two or more functions may be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in some embodiments of this disclosure is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.
[0254] Some embodiments of this disclosure also provide a vehicle control device, which is disposed in a display device. The vehicle control device includes a control module, which is used to control the vehicle to which the display device belongs to perform corresponding vehicle body posture adjustment actions based on the virtual driving state of the vehicle when the display content of the display device includes a vehicle.
[0255] In some embodiments, the virtual driving state includes at least one of the following: constant speed state, variable speed state, turning state, bumpy state, impact state, or leaping state.
[0256] In some embodiments, the vehicle attitude adjustment action is used to adjust the roll angle and / or pitch angle of the vehicle; or, the vehicle attitude adjustment action is a suspension jump action; the suspension jump action is used to achieve an instantaneous increase in vehicle height.
[0257] In some embodiments, when the vehicle attitude adjustment action is used to adjust the vehicle's roll angle and / or pitch angle, the control module is configured to determine attitude adjustment parameters based on the vehicle's virtual driving state and determine a speed amplification factor based on the vehicle's speed; the attitude adjustment parameters include an initial roll angle and / or an initial pitch angle; the attitude adjustment parameters are corrected based on the speed amplification factor, and the vehicle is controlled to adjust the roll angle and / or pitch angle based on the corrected attitude adjustment parameters.
[0258] In some embodiments, the vehicle posture adjustment action includes at least one of the following: adjusting the height of multiple suspensions in the vehicle suspension system; controlling the tilt angle of the vehicle seat; and controlling the vehicle roll mechanism to generate a corresponding roll angle.
[0259] In some embodiments, the vehicle body posture adjustment action is used to synchronize or match the vehicle body posture with the vehicle posture of the vehicle body.
[0260] In some embodiments, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs is controlled to perform corresponding body posture adjustment actions, including: when the virtual driving state is a constant speed state, controlling the vehicle to adjust the roll angle within a preset roll angle range, and adjusting the pitch angle within a preset pitch angle range.
[0261] In some embodiments, the control module is configured to determine the target pitch angle of the vehicle based on the vehicle's acceleration when the virtual driving state is a variable speed state; and control the vehicle to adjust the pitch angle to the target pitch angle.
[0262] In some embodiments, the control module is configured to determine the target pitch angle of the vehicle based on the vehicle's speed and acceleration, wherein the vehicle speed is positively correlated with the target pitch angle.
[0263] In some embodiments, the control module is configured to determine the initial pitch angle of the vehicle based on the vehicle's acceleration; determine the speed amplification factor based on the vehicle's speed; and adjust the initial pitch angle according to the speed amplification factor to obtain the target pitch angle.
[0264] In some embodiments, the control module is configured to control the vehicle to adjust the pitch angle to a target pitch angle during the duration corresponding to the gear shift state.
[0265] In some embodiments, the control module is configured to determine the target roll angle of the vehicle based on a preset roll angle when the virtual driving state is a turning state; and control the vehicle to adjust the roll angle to the target roll angle.
[0266] In some embodiments, the control module is configured to determine a target roll angle for the vehicle based on the vehicle speed and a preset roll angle, wherein the vehicle speed is positively correlated with the target roll angle.
[0267] In some embodiments, the control module is configured to determine a speed amplification factor based on the vehicle speed; the vehicle speed is positively correlated with the speed amplification factor; and adjust a preset roll angle according to the speed amplification factor to obtain a target roll angle.
[0268] In some embodiments, the control module is configured to adjust the roll angle to a target roll angle during the duration corresponding to the turning state.
[0269] In some embodiments, the control module is configured to, when the virtual driving state is a bumpy state or an impact state, control the vehicle to adjust the roll angle within a target roll angle range and the pitch angle within a target pitch angle range during the duration of the bumpy state or impact state.
[0270] In some embodiments, when the virtual driving state is a bumpy state, the upper and / or lower limits of the target roll angle range are determined based on the vehicle speed and the preset roll angle.
[0271] In some embodiments, when the virtual driving state is a bumpy state, the upper and / or lower limits of the target pitch angle range are determined based on the vehicle speed and the preset pitch angle.
[0272] In some embodiments, when the virtual driving state is an impact state, the upper and / or lower limits of the target roll angle range are determined based on the target impact amplitude and the preset roll angle.
[0273] In some embodiments, when the virtual driving state is an impact state, the upper and / or lower limits of the target pitch angle range are determined based on the target impact amplitude and the preset pitch angle.
[0274] In some embodiments, the target impact amplitude is set by the user before watching a movie using the display device; or, the target impact amplitude is a preset value.
[0275] In some embodiments, when the virtual driving state is a leap state, the vehicle posture adjustment action is a suspension jump action, which is used to achieve an instantaneous height jump of the vehicle body.
[0276] In some embodiments, the control device further includes: an output module configured to output a first prompt message in response to the activation of a movie or game mode, when the vehicle is in a parked state; the first prompt message is used to prompt the user whether to activate the first movie or game mode; the first movie or game mode supports the display device to control the vehicle to perform body posture adjustment actions during movie or game viewing.
[0277] In some embodiments, the control module is configured to, when the display device enables a first viewing or game mode, control the vehicle to which the display device belongs to perform corresponding vehicle body posture adjustment actions based on the virtual driving state of the vehicle.
[0278] In some embodiments, the control device further includes: an activation module configured to enable a second movie-watching or game mode when the vehicle is in a non-parked state; the second movie-watching or game mode does not support the display device controlling the vehicle to perform body posture adjustment actions during movie-watching or game playback.
[0279] In some embodiments, the control device further includes an output module configured to output a second prompt message when the vehicle is in a non-parked state, the second prompt message being used to prompt the user that the first movie or game mode can only be enabled when the vehicle is parked.
[0280] In some embodiments, the control device further includes: a determining module configured to parse screen elements in the displayed content to determine whether a vehicle exists in the displayed content; and, if a vehicle exists, to determine the virtual driving state of the vehicle at each time point.
[0281] In some embodiments, the control module is configured to send attitude control commands to the vehicle based on the vehicle's virtual driving state at the current time point. The attitude control commands are used to cause the vehicle to perform body attitude adjustment actions.
[0282] In some embodiments, the control module is configured to adjust the suspension height of the left and / or right suspension of the vehicle's active suspension system based on the virtual driving state, when the roll angle of the vehicle is determined based on the virtual driving state.
[0283] In some embodiments, the control module is configured to adjust the suspension height of the front and / or rear suspension of the vehicle's active suspension system based on the virtual driving state, whereby the vehicle's pitch angle is determined based on the virtual driving state.
[0284] Figure 15 is a block diagram of an electronic device according to some embodiments. As shown in Figure 15, the electronic device 130 includes, but is not limited to, a processor 1301 and a memory 1302. The memory 1302 is used to store executable instructions of the processor 1301. It is understood that the processor 1301 is configured to execute instructions to implement the vehicle control method or the active suspension system control method in the above embodiments. That is, the electronic device 130 can be a display device or a vehicle, and this disclosure does not limit it. When the electronic device 130 is a display device 200, as shown in Figure 16, the display device 200 includes the processor 210 and the memory 220; when the electronic device 130 is a vehicle 100, as shown in Figure 17, the vehicle 100 includes a processor 110 and a memory 120.
[0285] Processor 1301 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in memory 1302, and by calling data stored in memory 1302, it performs various functions and processes data, thereby controlling the electronic device as a whole. Processor 1301 may include one or more processing modules. In some embodiments, processor 1301 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into processor 1301.
[0286] The memory 1302 can be used to store software programs and various data. The memory 1302 may primarily include a program storage area and a data storage area. The program storage area may store the operating system and application programs required by at least one functional module (such as an acquisition unit, a determination module, a processing unit, etc.). Furthermore, the memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0287] Some embodiments of this disclosure also provide a vehicle 100, which includes the above-described electronic device 130 or vehicle control device 140.
[0288] Some embodiments of this disclosure also provide a display device 200, which includes the electronic device 130 described above or the vehicle control device 140.
[0289] Some embodiments of this disclosure also provide an in-vehicle interactive system 1000, as shown in Figures 18A-18C, which includes the vehicle 100 and / or display device 200 described above.
[0290] In some embodiments, this disclosure also provides a computer program product including a computer program that, when executed by a device, causes the device to perform the methods described above.
[0291] In this way, the computer program in the computer program product can be customized according to the needs and operating conditions of the equipment, realizing personalized control methods and improving the adaptability and flexibility of equipment control.
[0292] In addition, computer program products can be executed on different devices or systems, achieving cross-platform applicability, providing a unified control method for different types of devices, and improving system integration and interoperability.
[0293] Although this disclosure has been described in conjunction with exemplary features and embodiments, it will be apparent that various modifications and combinations can be made therein without departing from the spirit and scope of this disclosure. Accordingly, this specification and drawings are merely exemplary illustrations of the disclosure as defined by the appended claims and are to be considered as covering any and all modifications, variations, combinations, or equivalents within the scope of this disclosure. It is obvious that those skilled in the art can make various alterations and modifications to this disclosure without departing from its spirit and scope. Thus, this disclosure is also intended to include any such modifications and modifications that fall within the scope of the claims of this disclosure and their equivalents.
[0294] The above are merely specific embodiments of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.
Claims
1. A vehicle control method, comprising: When the content displayed on the display device includes a vehicle, based on the virtual driving state of the vehicle, the vehicle to which the display device belongs is controlled to perform corresponding body posture adjustment actions so that the body posture of the vehicle matches the vehicle posture of the vehicle.
2. The control method according to claim 1, wherein, The virtual driving state includes at least one of the following: constant speed state, variable speed state, turning state, bumpy state, impact state, or leaping state.
3. The control method according to claim 1 or 2, wherein, The vehicle attitude adjustment action is used to adjust the roll angle and / or pitch angle of the vehicle; Alternatively, the vehicle body posture adjustment action is a suspension jump action; the suspension jump action is used to achieve an instantaneous increase in vehicle body height.
4. The control method according to claim 3, wherein, When the vehicle body attitude adjustment action is used to adjust the roll angle and / or pitch angle of the vehicle, the step of controlling the vehicle to which the display device belongs to perform the corresponding vehicle body attitude adjustment action based on the virtual driving state of the vehicle includes: The attitude adjustment parameters are determined based on the virtual driving state of the vehicle, and the speed amplification factor is determined based on the vehicle speed; the attitude adjustment parameters include the initial roll angle and / or the initial pitch angle. The attitude adjustment parameters are corrected based on the speed increase factor, and the vehicle is controlled to adjust the roll angle and / or pitch angle based on the corrected attitude adjustment parameters.
5. The control method according to any one of claims 1 to 4, wherein, The vehicle body posture adjustment action includes at least one of the following: Adjust the height of multiple suspension components in the vehicle's suspension system; Control the tilt angle of the vehicle seat; The vehicle tilt mechanism controls the roll angle to produce the corresponding roll angle.
6. The control method according to any one of claims 1 to 5, wherein, The vehicle body posture adjustment action is used to keep the vehicle body posture synchronized or consistent with the vehicle posture of the vehicle body.
7. The control method according to claim 2, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the virtual driving state is the constant speed state, the vehicle is controlled to adjust the roll angle within a preset roll angle range and the pitch angle within a preset pitch angle range.
8. The control method according to claim 2, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the virtual driving state is the shift state, the target pitch angle of the vehicle is determined based on the vehicle's acceleration; Control the vehicle to adjust its pitch angle to the target pitch angle.
9. The control method according to claim 8, wherein, Determining the target pitch angle of the vehicle based on the vehicle's acceleration includes: Based on the vehicle's speed and acceleration, the target pitch angle corresponding to the vehicle is determined, and the vehicle speed is positively correlated with the target pitch angle.
10. The control method according to claim 9, wherein, Determining the target pitch angle of the vehicle based on its speed and acceleration includes: Based on the vehicle's acceleration, determine the vehicle's initial pitch angle; The speed amplification factor is determined based on the vehicle's speed; The initial pitch angle is adjusted according to the speed amplification factor to obtain the target pitch angle.
11. The control method according to any one of claims 8 to 10, wherein, The control of the vehicle to adjust its pitch angle to the target pitch angle includes: The vehicle is controlled to adjust its pitch angle to the target pitch angle during the duration corresponding to the gear shift state.
12. The control method according to claim 2, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the virtual driving state is the turning state, the target roll angle of the vehicle is determined based on the preset roll angle; Control the vehicle to adjust its roll angle to the target roll angle.
13. The control method according to claim 12, wherein, Determining the target roll angle of the vehicle based on a preset roll angle includes: Based on the vehicle speed and the preset roll angle, the target roll angle corresponding to the vehicle is determined, wherein the vehicle speed is positively correlated with the target roll angle.
14. The control method according to claim 13, wherein, Determining the target roll angle of the vehicle based on the vehicle speed and the preset roll angle includes: The speed amplification factor is determined based on the vehicle speed; the vehicle speed is positively correlated with the speed amplification factor; the preset roll angle is adjusted according to the speed amplification factor to obtain the target roll angle.
15. The control method according to any one of claims 12 to 14, wherein, The control of the vehicle to adjust the roll angle to the target roll angle includes: adjusting the roll angle to the target roll angle during the duration corresponding to the turning state.
16. The control method according to claim 2, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the virtual driving state is the bumpy state or the impact state, during the duration of the bumpy state or the impact state, the vehicle is controlled to adjust the roll angle within the target roll angle range and the pitch angle within the target pitch angle range.
17. The control method according to claim 16, wherein, When the virtual driving state is the bumpy state, the upper and / or lower limits of the target roll angle range are determined based on the vehicle speed and the preset roll angle.
18. The control method according to claim 16, wherein, When the virtual driving state is the bumpy state, the upper and / or lower limits of the target pitch angle range are determined based on the vehicle speed and the preset pitch angle.
19. The control method according to claim 16, wherein, When the virtual driving state is the impact state, the upper and / or lower limits of the target roll angle range are determined based on the target impact amplitude and the preset roll angle.
20. The control method according to claim 16, wherein, When the virtual driving state is the impact state, the upper and / or lower limits of the target pitch angle range are determined based on the target impact amplitude and the preset pitch angle.
21. The control method according to claim 19 or 20, wherein, The target impact amplitude is set by the user before watching a movie using the display device; or, the target impact amplitude is a preset value.
22. The control method according to claim 2, wherein, When the virtual driving state is the leap state, the vehicle body attitude adjustment action is the suspension jump action, which is used to achieve an instantaneous height jump of the vehicle body.
23. The control method according to any one of claims 1 to 22, further comprising: In response to the activation of the movie-watching or game mode, when the vehicle is in a parked state, a first prompt message is output. The first prompt message is used to prompt the user whether to activate the first movie-watching or game mode. The first movie-watching or game mode supports the display device to control the vehicle to perform body posture adjustment actions during movie-watching or game playback.
24. The control method according to claim 23, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the display device is in the first movie or game mode, the vehicle to which the display device belongs is controlled to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle.
25. The control method according to claim 23 or 24, further comprising: When the vehicle is not parked, the second viewing or gaming mode is activated; the second viewing or gaming mode does not support the display device controlling the vehicle to perform body posture adjustment actions during viewing or gaming.
26. The control method according to any one of claims 23 to 25, further comprising: When the vehicle is in an unparked state, a second prompt message is output, which is used to remind the user that the first movie or game mode can only be enabled when the vehicle is parked.
27. The control method according to any one of claims 1 to 26, further comprising: Analyze the visual elements in the displayed content to determine whether a vehicle exists in the displayed content; In the presence of the vehicle, determine the virtual driving state of the vehicle at each time point.
28. The control method according to claim 27, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: Based on the vehicle's virtual driving state at the current time point, an attitude control command is sent to the vehicle, which is used to cause the vehicle to perform the body attitude adjustment action.
29. The control method according to any one of claims 1 to 28, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the roll angle of the vehicle is adjusted based on the virtual driving state, the suspension height of the left and / or right suspension of the vehicle's active suspension system is adjusted based on the virtual driving state.
30. The control method according to any one of claims 1 to 28, wherein, The step of controlling the vehicle to which the display device belongs to perform corresponding vehicle posture adjustment actions based on the virtual driving state of the vehicle includes: When the vehicle pitch angle is adjusted based on the virtual driving state, the suspension height of the front and / or rear suspension of the vehicle's active suspension system is adjusted based on the virtual driving state.
31. A display device (200), wherein, It includes a processor (210) and a memory (220), the processor (210) being connected to the memory (220), the memory (220) storing computer instructions that, when executed on the display device (200), cause the display device (200) to perform the method according to any one of claims 1 to 30.
32. A vehicle (100), wherein, It includes a processor (110) and a memory (120), the processor (110) being connected to the memory (120), the memory (120) storing computer instructions that, when executed on the vehicle (100), cause the vehicle (100) to perform the method according to any one of claims 1 to 30.
33. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer-executable instructions that, when executed on a computer, cause the computer to perform the method according to any one of claims 1 to 30.
34. An in-vehicle interactive system (1000), wherein, Includes the display device (200) of claim 31 and / or the vehicle (100) of claim 32.
35. A computer program product comprising instructions, wherein, when the instructions are executed on a computer, the computer performs the method according to any one of claims 1 to 30.
