Vehicle, vehicle control method, electronic device, computer storage medium, and computer program product

Abstract

A vehicle, a vehicle control method, an electronic device, a computer storage medium, and a computer program product. The invention discloses a vehicle which comprises a cabin subsystem, and the cabin subsystem is provided with film and television playing equipment. And the suspension subsystem is connected with the cabin subsystem, and the suspension subsystem is configured to perform height adjustment according to the movie information played by the movie playing module. The suspension subsystem can be controlled to operate in real time according to the film information obtained by the cabin subsystem through linkage of the cabin subsystem and the suspension subsystem, and when a user watches a film in a vehicle, the suspension is regulated and controlled along with the film content, so that the user can experience the immersive feeling more truly.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a vehicle, a vehicle control method, an electronic device, a computer storage medium, and a computer program product. Background Art

[0002] At present, the electrification and intelligence of vehicles are undergoing unprecedented changes. In-vehicle entertainment systems are developing rapidly towards intelligence, interconnection, and personalization. In the relevant existing technologies, in-vehicle 5D viewing can be achieved, usually by linking dynamic seats, audio, and ambient lights to achieve 5D effects, but the 5D viewing experience brought by dynamic seats is limited, and users cannot experience a more realistic immersive feeling when watching movies in the car. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, one object of the present invention is to provide a vehicle, which can realize the linkage between the in-vehicle viewing and the suspension subsystem, so that the user can experience a more realistic immersive feeling when watching movies in the car.

[0004] A second objective of the present invention is to provide a vehicle control method.

[0005] A third objective of the present invention is to provide an electronic device.

[0006] A fourth objective of the present invention is to provide a computer storage medium.

[0007] A fifth object of the present invention is to provide a computer program product.

[0008] In order to solve the above problems, an embodiment of the first aspect of the present invention proposes a vehicle, comprising: a cockpit subsystem, the cockpit subsystem having a video playback device; a suspension subsystem connected to the cockpit subsystem, the suspension subsystem being configured to perform height adjustment according to the film information played by the video playback module.

[0009] According to the vehicle of the embodiment of the present invention, the cockpit subsystem and the suspension subsystem are linked, and the operation of the suspension subsystem is controlled in real time according to the movie information obtained by the cockpit subsystem. When the user watches a movie in the car, the suspension is adjusted according to the movie content, allowing the user to experience a more realistic immersive feeling.

[0010] In some embodiments, the cockpit subsystem includes a movie data processing module, and the movie data processing module is used to generate a scenario type according to the movie information, and the suspension subsystem performs height adjustment according to the scenario type.

[0011] In some embodiments, the film data processing module is used to generate a situation type according to the film information, including: the film data processing module obtains elements of the film information, and the elements include one or more of visual features, actions, directions, dialogue content, character emotions, and environmental scenes; the film data processing module inputs the real-time situation correspondingly generated based on the elements into an artificial convolutional neural network model to obtain the situation type, and classifies the situation type; wherein, the situation type includes at least two of a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type.

[0012] In some embodiments, the suspension subsystem adjusts its height according to the situation type, including: the cockpit subsystem matches a suspension control mode according to the situation type; the suspension subsystem adjusts its height based on the suspension control mode, and the suspension control mode includes at least two of a vibration mode, a lifting mode, a pitching mode, a rolling mode, and a bouncing mode.

[0013] In some embodiments, the method further includes: the cockpit subsystem generates target control parameters for the suspension subsystem according to the suspension control mode; the suspension subsystem adjusts its height according to the target control parameters, and the target control parameters include one or more of a roll angular velocity, a four-wheel vertical lifting speed, a suspension adjustment duration, and a suspension vibration frequency.

[0014] In some embodiments, the suspension subsystem includes a suspension control unit and a suspension execution unit. The suspension control unit generates a suspension control strategy according to the target control parameters, and the suspension execution unit is used to adjust the height according to the suspension control strategy. The suspension control strategy includes one or more of the rotational speed, level, and current of the shock absorber motor.

[0015] In some embodiments, the cockpit subsystem further includes a film data storage module. The film data storage module is connected to the film data processing module. The film data storage module is used to load a film and transmit the film to the film data processing module. The film data processing module receives the film and generates a situation type according to the film information, and the suspension subsystem adjusts its height according to the situation type.

[0016] In some embodiments, the cockpit subsystem further includes an occupant data processing module. The occupant data processing module is used to output an analysis result according to the occupant data of the occupant during movie watching, and the suspension subsystem adjusts its height according to the analysis result.

[0017] In some embodiments, the occupant data includes physiological data and behavioral data.

[0018] In some embodiments, the occupant data processing module is configured to classify the analysis results, and the classified analysis results include at least two of a high-immersion state, a critical state, and a dangerous state; the suspension subsystem adjusts the height according to the classified analysis results.

[0019] In some embodiments, the cockpit subsystem further includes a film data processing module and an occupant data processing module. The film data processing module is configured to generate a situation type, and the occupant data processing module is configured to output an analysis result; the suspension subsystem adjusts the height according to the situation type and the analysis result.

[0020] In some embodiments, the suspension subsystem includes an active hydraulic shock absorber.

[0021] A second aspect embodiment of the present invention provides a vehicle control method, including: adjusting the suspension height according to the film information.

[0022] In some embodiments, the method further includes: generating a situation type according to the film information; adjusting the suspension height according to the situation type.

[0023] In some embodiments, the method further includes: obtaining elements of the film information, where the elements include one or more of visual features, actions, directions, dialogue content, character emotions, and environmental scenes; obtaining the situation type based on the real-time situation generated corresponding to the elements; classifying the situation type, and the situation type includes at least two of a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type.

[0024] In some embodiments, the method further includes: matching a suspension control mode according to the situation type; adjusting the suspension height based on the suspension control mode, and the suspension control mode includes at least two of a vibration mode, a lifting mode, a pitching mode, a rolling mode, and a bouncing mode.

[0025] In some embodiments, the method further includes: generating target control parameters of the suspension according to the suspension control mode; adjusting the suspension height according to the target control parameters, and the target control parameters include one or more of a roll angular velocity, a vertical lifting speed of four wheels, a suspension adjustment duration, and a suspension vibration frequency.

[0026] In some embodiments, the method further includes: generating a suspension control strategy according to the target control parameters; adjusting the suspension height according to the suspension control strategy, and the suspension control strategy includes one or more of the rotational speed, level, and current of a shock absorber motor.

[0027] In some embodiments, before generating the scenario type according to the film information, the method further includes: obtaining a film; and preprocessing the film.

[0028] In some embodiments, the method further includes: obtaining occupant data of an occupant during movie viewing; outputting an analysis result according to the occupant data; and adjusting the suspension height according to the analysis result.

[0029] In some embodiments, the occupant data includes physiological data and behavioral data.

[0030] In some embodiments, the method further includes: adjusting the suspension height according to the scenario type of the film information and the analysis result of the occupant data of the occupant during movie viewing.

[0031] In some embodiments, the method further includes: obtaining a movie viewing instruction; when the gear of the vehicle is in the P gear, controlling the vehicle to enter a movie viewing mode and adjusting the suspension height according to the film information; and when the gear of the vehicle is not in the P gear, prohibiting the vehicle from entering the movie viewing mode.

[0032] An embodiment of the third aspect of the present invention provides an electronic device, including: at least one processor; and a memory communicatively connected to at least one of the processors; wherein, the memory stores a computer program executable by at least one of the processors, and when at least one of the processors executes the computer program, the vehicle control method described in the above embodiments is implemented.

[0033] An embodiment of the fourth aspect of the present invention provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the vehicle control method described in the above embodiments is implemented.

[0034] An embodiment of the fifth aspect of the present invention provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, the steps of the vehicle control method described in the above embodiments are implemented.

[0035] The additional aspects and advantages of the present invention will be partially given in the following description, partially become apparent from the following description, or be understood through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The above and / or additional aspects and advantages of the present invention will become apparent and be readily understood from the description of the embodiments in conjunction with the following drawings, wherein:

[0037] Figure 1 is a system structure block diagram of a vehicle according to an embodiment of the present invention;

[0038] Figure 2 is a flowchart of a vehicle control method according to an embodiment of the present invention.

[0039] Reference Numerals:

[0040] 1 - Vehicle; 11 - Cockpit Subsystem; 111 - Video Data Processing Module; 112 - Video Data Storage Module; 113 - Occupant Data Processing Module; 12 - Suspension Subsystem; 121 - Suspension Control Unit; 122 - Suspension Actuator Unit; 1221 - Active Hydraulic Shock Absorber. Detailed Implementation Manner

[0041] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0042] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "upper", "lower", "left", "right", "front", "rear", "inner", "outer", etc. is the orientation or relative positional relationship based on the orientation shown in the accompanying drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation to the present invention. Without special instructions, in the case of satisfying the relative positional relationship shown in the accompanying drawings, the above-described orientation description can be flexibly set during the actual application process.

[0043] The terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the present invention, unless otherwise stated, the meaning of "plurality" is two or more.

[0044] In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, the terms "installed", "connected", "connected", and "communicated" should be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or an integral connection. It may be directly connected, or indirectly connected through an intermediate medium, and may be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0045] In the embodiments of the present invention, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, article or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, article or device comprising such element.

[0046] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being more preferred or having more advantages than other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0047] In the description of this specification, specific features, structures, materials or characteristics may be combined in a suitable manner in any one or more embodiments or examples.

[0048] In-vehicle entertainment systems are developing rapidly towards intelligence, connectivity and personalization. In related prior art, the in-vehicle 5D movie-watching form can be realized, usually by linking a motion seat, a sound system and an ambient light, etc. to achieve the 5D effect. However, the 5D movie-watching experience brought by the motion seat is limited and cannot enable users to more truly experience the immersive feeling when watching movies in the vehicle.

[0049] To solve the above problems, an embodiment of the first aspect of the present invention proposes a vehicle. This system can realize the linkage between in-vehicle movie-watching and the suspension subsystem, enabling users to more truly experience the immersive feeling when watching movies in the vehicle.

[0050] Next, refer to Figure 1 Describe vehicle 1 according to an embodiment of the present invention, as Figure 1 shown, vehicle 1 includes a cockpit subsystem 11 and a suspension subsystem 12.

[0051] Among them, the cockpit subsystem 11 has a video playback device, such as a multimedia device, etc.; the suspension subsystem 12 is used to realize the control of the chassis of vehicle 1. The suspension subsystem 12 is connected to the cockpit subsystem 11, and the suspension subsystem 12 can be adjusted in height according to the movie information played by the video playback module.

[0052] Specifically, if the occupant attempts to achieve a more immersive 15D vehicle viewing experience based on the movie information played during the movie, not only the seat needs to be linked, but also the linkage control of the suspension needs to be achieved. Therefore, in the present invention, the suspension subsystem 12 is electrically connected to the cockpit subsystem 11, and the height of the suspension is adjusted in real time according to the movie information played by the movie playback device in the cockpit subsystem 11. The present invention links the suspension subsystem 12 and the cockpit subsystem 11. When the user watches a movie in the vehicle, the suspension is adjusted according to the movie content, so that the user can more truly experience the immersive feeling. Adjusting the suspension height according to the movie information can give the occupant a leading experience of 5D viewing in the vehicle and create a sense of technology.

[0053] In some embodiments, as Figure 1 shown, the cockpit subsystem 11 includes a movie data processing module 111. The movie data processing module 111 is used to generate a situation type according to the movie information, and the suspension subsystem 12 adjusts the height according to the situation type.

[0054] Specifically, the data processing module can analyze the imported movie. The data processing module calls the AI large model constructed and pre-trained based on the deep learning framework to process the visual and audio content of the video frames in the movie, including:

[0055] Feature extraction of the movie: The elements of the movie information are identified through a model based on an artificial convolutional neural network (CNN), including (1) Visual features: Specifically, such as vehicle 1, human body, action form, etc.; (2) Actions: Specifically, data such as running, jumping, fighting, etc. that need to understand the sequence are captured through structures such as a recurrent neural network (RNN) or a long short-term memory network (LSTM) to capture the changes and persistence of the actions; (3) Directions: Specifically refer to movements in different directions; (4) Dialogue content: The dialogue in the movie is analyzed using natural language processing technology (NLP) to identify the dialogue content of the characters and associate the context, and understand the emotions and intentions behind the dialogue; (5) Character emotions: The visual and audio content in the movie is analyzed to identify possible emotional elements, specifically emotions such as tension, excitement, fear, etc.; (6) Environmental scenes: Specific visual elements are identified, such as race tracks, buildings, etc. The vehicle of the present invention can realize the real-time adjustment of the suspension according to the movie information, expanding the joint application of the suspension subsystem 12 and the cockpit subsystem 11 and enhancing the in-vehicle viewing experience.

[0056] In some embodiments, the video data processing module 111 obtains elements of video information, where the elements include one or more of visual features, actions, directions, dialogue content, character emotions, and environmental scenes; the video data processing module 111 inputs the real-time situation generated based on the elements into an artificial convolutional neural network model to obtain a situation type, and classifies the situation type; among them, the situation type includes at least two of a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type.

[0057] Specifically, an AI large model constructed and pre-trained based on a deep learning framework is called to fuse the above-mentioned elements extracted from the video to form a more complete situation model; further, the obtained situation model is classified. Specifically, visual features are extracted in real time from the video frame content through computer vision technology, and emotions and intentions are understood from the video dialogue content through natural language processing technology to generate the real-time situation corresponding to the video content. After the real-time situation is input into the artificial convolutional neural network model, the situation type is obtained. The typical situation data set is labeled based on the shot movement, subject actions, environmental special effects, and emotional and rhythmic mood types, rhythm speed, and physical logic gravity changes and spatial displacements of the visual features. When there are significant changes in the combination of visual elements or sudden changes in the emotional tone, it is divided into a new real-time situation, and the artificial neural network model is trained to realize the automatic classification of the video situation. The situation model includes a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type. The natural environment type includes sub-situations such as mountain / muddy road, muddy / swamp, and snow / ice; the action scene type includes sub-situations such as rapid acceleration / rapid braking, high-speed cornering, collision / explosion, and jump / fall; the emotional atmosphere type includes sub-situations such as tension / suspense and horror / thriller; the special effect type includes sub-situations such as flight / float. The present invention uses an AI model to generate different sub-situations based on video information and classify the video frames of the video, which can more accurately match the suspension control mode.

[0058] In an embodiment of the present invention, the cockpit subsystem 11 matches the suspension control mode according to the situation type; the suspension subsystem 12 adjusts the height based on the suspension control mode, and the suspension control mode includes at least two of a vibration mode, a lifting mode, a pitching mode, a rolling mode, and a bouncing mode.

[0059] Specifically, each situation type matches a corresponding suspension control mode.

[0060] Among them, the suspension control mode matched by the mountain / gravel road sub - scenario is high - frequency small - amplitude vibration, controlling the suspension vibration frequency within 5HZ - 10HZ, which can simulate the experience of alternating bumps of the left and right wheels in the film; the suspension control mode matched by the muddy / swamp sub - scenario is low - frequency large - amplitude vibration, controlling the suspension vibration frequency within 2HZ - 5HZ, which can simulate the sense of the body rising and falling; the suspension control mode matched by the snow / ice surface is single - side suspension pulsed vibration, which can simulate the sense of roll offset caused by road surface skidding during steering.

[0061] Among them, the suspension control mode matched by the hard acceleration / hard braking sub - scenario is the pitch mode. Specifically, the front suspension rises and the rear suspension drops, increasing the support force on the occupant's back to simulate the sense of being pushed back during hard acceleration, or the rear suspension rises and the front suspension drops, increasing the pressure on the occupant's abdomen to simulate the experience of hard braking; the suspension control mode matched by the high - speed cornering sub - scenario is the roll mode. Specifically, one - side suspension gradually rises, and low - frequency vibration can also be maintained simultaneously; the suspension control mode matched by the collision / explosion sub - scenario is severe suspension impact vibration, controlling the suspension vibration frequency within 10HZ - 20HZ and vibrating continuously for 0.5 seconds; the suspension control mode matched by the jump / fall sub - scenario is the bounce mode. Specifically, using the full - active body control system, the suspension is quickly compressed or extended, and then an upward force is generated on the vehicle 1 to achieve the bounce action. When in the air, the suspension is completely released, and when landing, the full - suspension sudden shock is aggravated with a rebound effect.

[0062] Among them, the suspension control mode matched by the tense / suspense sub - scenario is periodic low - frequency vibration, controlling the suspension vibration frequency within 1HZ - 2HZ, and the suspension control mode matched by the horror / thriller sub - scenario is instant pulsed vibration, controlling the suspension vibration frequency within 20HZ - 30HZ and maintaining vibration for 0.2 seconds.

[0063] Among them, the suspension control mode matched by the flight / float sub - scenario is that the suspension is completely relaxed, controlling the body to shake slightly horizontally.

[0064] The present invention matches different suspension control modes according to different sub - scenarios, bringing different movie - watching experiences to the occupants and enhancing the technological sense of the whole vehicle.

[0065] In some embodiments, the cockpit subsystem 11 generates the target control parameters of the suspension subsystem 12 according to the suspension control mode;

[0066] The suspension system 12 adjusts its height according to target control parameters, which include one or more of roll rate, vertical lift speed of the four wheels, suspension adjustment duration, and suspension vibration frequency. The suspension system 12 includes a suspension control unit 121 and a suspension execution unit 122. The suspension control unit 121 generates a suspension control strategy based on the target control parameters, and the suspension execution unit 122 is used to adjust the height according to the suspension control strategy. The suspension control strategy includes one or more of the rotational speed, electrical level, and current of the shock absorber motor.

[0067] Specifically, when the weight of vehicle 1 is 2.5 tons - 3 tons, in the mountain / gravel road sub-scenario, the matched suspension vibration frequency is 5HZ - 10HZ, the suspension lift speed is 150mm / s, the logic level is 1, the shock absorber current is 500mA, and the rotational speed of the shock absorber motor is between -300 revolutions per minute and 300 revolutions per minute. It can be understood that the adjustment of the suspension lift speed also includes the adjustment of acceleration.

[0068] Specifically, when the weight of vehicle 1 is 2.5 tons - 3 tons, in the tense / suspense sub-scenario, the matched suspension vibration frequency is 3HZ - 8HZ, the suspension lift speed is 200 - 300mm / s, the logic level is 1, the shock absorber current is 1200mA, and the rotational speed of the shock absorber motor is between -1500 revolutions per minute and 1500 revolutions per minute. It can be understood that the adjustment of the suspension lift speed also includes the adjustment of acceleration.

[0069] Specifically, when the weight of vehicle 1 is 2.5 tons - 3 tons, in the high-speed cornering sub-scenario, the matched suspension vibration frequency is 20HZ, the roll rate of the suspension is 5° / s, the logic level is 1, the shock absorber current is 750mA, and the rotational speed of the shock absorber motor is between -500 revolutions per minute and 500 revolutions per minute. It can be understood that the adjustment of the suspension lift speed also includes the adjustment of acceleration.

[0070] Specifically, when the weight of vehicle 1 is 2.5 tons - 3 tons, in the flying / floating sub-scenario, the matched suspension vibration frequency is 4HZ - 8HZ, the suspension lift speed is 100 - 120mm / s, the logic level is 1, the shock absorber current is 500mA, and the rotational speed of the shock absorber motor is between -200 revolutions per minute and 200 revolutions per minute. It can be understood that the adjustment of the suspension lift speed also includes the adjustment of acceleration.

[0071] In some embodiments, such as Figure 1As shown in the figure, the cockpit subsystem 11 further includes a film data storage module 112. The film data storage module 112 is connected to the film data processing module 111. The film data storage module 112 is used to load a film and transmit the film to the film data processing module 111. The film data processing module 111 receives the film and generates a scenario type according to the film information. The suspension subsystem 12 adjusts the height according to the scenario type.

[0072] Specifically, the film data storage module 112 is arranged in the cockpit subsystem 11. In the present invention, the film data storage module 112 is connected to the film data processing module 111. The connection method can be any one of CAN bus, LIN bus, FlexRay bus or Ethernet. After receiving a film playing instruction, the vehicle 1 caches the film to be played in advance in the film data storage module, and inputs the cached content into the film data processing module 111 and the multimedia device. The film data processing module 111 calls an AI large model constructed and pre-trained based on a deep learning framework, fuses the above elements extracted from the film to form a more complete scenario model, and the suspension subsystem 12 adjusts the height according to a certain scenario type. The film data storage module 112 of the present invention can extract the film to be watched from the cloud or the vehicle-end database and store it. Further, it is transmitted to the film data processing module 111 for real-time model analysis, without pre-annotating the time nodes in a certain number of films and then storing the annotated films in the cloud or the database, greatly enriching the range of films that passengers can watch.

[0073] In some embodiments, as Figure 1 shown in the figure, the cockpit subsystem 11 further includes an occupant data processing module 113. The occupant data processing module 113 is used to output an analysis result according to the occupant data of the occupant during movie watching. The suspension subsystem 12 adjusts the height according to the analysis result. The occupant data includes physiological data and behavioral data. The occupant data processing module 113 is used to classify the analysis result. The classified analysis results include at least two of a high-immersion state, a critical state, and a dangerous state; the suspension subsystem 12 adjusts the height according to the classified analysis result.

[0074] Specifically, the present invention also embeds an occupant data processing module 113 in the cockpit subsystem 11. The passenger data processing module classifies facial expression and behavior data, and uses a multi-modal fusion model to combine the facial expression and behavior data into passenger state tags. Different passenger state tags match different optimized amplitudes of suspension expected control data values. Among them, facial expressions include the curvature of the mouth corners, the contraction of the orbicularis oculi muscle, and the pupil size, which are divided into four categories: calm, interested, tense, and uncomfortable. Behavior data includes head posture, limb movements, and gaze direction, which are divided into four categories: focused, distracted, actively interacting, and avoiding. The passenger state tags combined by facial expression and behavior data are divided into three types: high-immersion state, critical state, and dangerous state. The present invention can construct a personalized in-vehicle cinema that distinguishes the 5D movie restoration style through the passenger's face, uses the existing DMS fatigue monitoring camera in the vehicle to real-time monitor the passenger's expression during movie watching, and adjusts the movie restoration effect personalized according to the facial emotion recognition result to reduce the discomfort during movie watching.

[0075] In some embodiments, the cockpit subsystem 11 further includes a movie data processing module 111 and an occupant data processing module 113. The movie data processing module 111 is used to generate a scenario type, and the occupant data processing module 113 is used to output an analysis result. The suspension subsystem 12 adjusts the height according to the scenario type and the analysis result.

[0076] Specifically, the present invention uses an AI model to generate a scenario type for suspension height control. However, adjusting the suspension height only according to the movie information is not sufficient to fully restore the real feeling in the movie. Therefore, in order to optimize the suspension control strategy, the present invention combines the scenario type with the analysis structure of passenger data, and then optimizes the suspension control strategy. Specifically, the passenger data processing module classifies facial expression and behavior data, and uses a multi-modal fusion model to combine the facial expression and behavior data into passenger state tags. Different passenger state tags match different optimized amplitudes of suspension expected control data values. Among them, facial expressions include the curvature of the mouth corners, the contraction of the orbicularis oculi muscle, and the pupil size, which are divided into four categories: calm, interested, tense, and uncomfortable. Behavior data includes head posture, limb movements, and gaze direction, which are divided into four categories: focused, distracted, actively interacting, and avoiding. The passenger state tags combined by facial expression and behavior data are divided into three types: high-immersion state, critical state, and dangerous state. Among them, the optimized amplitude of the suspension target control parameter matched by the high-immersion state is increased by 20%, the optimized amplitude of the suspension target control parameter matched by the critical state is decreased by 20%, and the optimized amplitude of the suspension target control parameter matched by the dangerous state is to immediately terminate the suspension dynamic effect.

[0077] In some embodiments, as Figure 1 shown, the suspension subsystem 12 includes an active hydraulic shock absorber 1221.

[0078] Specifically, since the performance requirements for the suspension in 5D viewing are extremely high, the present invention selects an active hydraulic shock absorber 1221. The electronic control system of the active hydraulic shock absorber 1221 includes various sensors, an electronic control unit (ECU), and an actuator. The sensors are responsible for collecting various operating parameters of the vehicle 1, such as a body height sensor, an acceleration sensor, a vehicle speed sensor, etc., and transmitting this information to the suspension control unit 121. The suspension control unit 121 processes and analyzes the data transmitted by the sensors, calculates the damping force required for the corresponding sub - situation according to the aforementioned suspension control strategy, and issues an instruction to the suspension actuator unit 122 to precisely control the opening degree of the valve in the hydraulic system, realizing real - time adjustment of the damping force and stiffness of the shock absorber.

[0079] An embodiment of the second aspect of the present invention proposes a vehicle control method, as Figure 2 shown. The vehicle control method includes steps S1 - step S11, and the specific steps are as follows.

[0080] Step S1, obtain a viewing instruction.

[0081] Specifically, an occupant issues a viewing instruction to the ECU of the vehicle, and judges whether the vehicle state is suitable for entering the viewing mode.

[0082] Step S2, judge the gear of the vehicle, control the vehicle to enter the viewing mode, or prohibit the vehicle from entering the viewing mode.

[0083] Specifically, to ensure driving safety, the present invention must first judge whether the vehicle is in a parked state: if so, it can enter the viewing mode according to the viewing instruction, match the suspension control strategy according to the film information, and then adjust the suspension height; if not, the vehicle is prohibited from entering the viewing mode.

[0084] Step S3, obtain the film; pre - process the film.

[0085] Specifically, select the film to be watched in the film library, and call the real - time stream processing technology to pre - process the high - speed video stream, including denoising, grayscale conversion, and normalization, to improve the recognition effect of the image recognition model.

[0086] Step S4, generate a situation type according to the film information.

[0087] Specifically, analyze the imported film, and call the AI large - model constructed and pre - trained based on the deep learning framework to process the visual and audio content of the video frames in the film, including:

[0088] Feature extraction of the video: Identify the elements of the video information through a model based on an artificial convolutional neural network (CNN), including (1) Visual features: such as vehicles, humans, action forms, etc.; (2) Actions: such as running, jumping, fighting, etc. Data that requires understanding sequences is captured by structures such as recurrent neural networks (RNNs) or long short-term memory networks (LSTMs) to capture the changes and persistence of actions; (3) Directions: specifically refer to movements in different directions; (4) Dialogue content: Use natural language processing technology (NLP) to analyze the dialogue in the video, identify the dialogue content of the characters and associate the context, and understand the emotions and intentions behind the dialogue; (5) Character emotions: Analyze the visual and audio content in the video to identify possible emotional elements, such as emotions like tension, excitement, fear, etc.; (6) Environmental scenes: Identify specific visual elements, such as race tracks, buildings, etc.

[0089] Call the AI large model constructed and pre-trained based on the deep learning framework, fuse the above elements extracted from the video to form a more complete situation model; further, classify the obtained situation model. Specifically, real-time visual features are extracted from the video frame content through computer vision technology, and emotions and intentions are understood from the video dialogue content through natural language processing technology to generate the real-time situation corresponding to the video content. After inputting the real-time situation into the artificial convolutional neural network model, the situation type is obtained. Label the typical situation data set based on the shot movement, subject actions, environmental special effects, and emotional and rhythmic emotion types, rhythm speed, and physical logic gravity changes and spatial displacements of visual features. When significant changes occur in the combination of visual elements or the emotional tone mutates, it is classified as a new real-time situation, and the artificial neural network model is trained to achieve automatic classification of video situations. The situation model includes natural environment types, action scene types, emotional atmosphere types, and special special effects types. Natural environment types such as mountain / gravel road sub-situations, muddy / swampy sub-situations, snow / ice sub-situations; action scene types such as sharp acceleration / sharp braking sub-situations, high-speed cornering sub-situations, collision / explosion sub-situations, jump / fall sub-situations; emotional atmosphere types such as tense / suspense sub-situations, horror / thriller sub-situations; special special effects types such as flight / float sub-situations.

[0090] Perform linkage control on the suspension subsystem 12 according to the control method that matches the situation type.

[0091] Step S5, match the suspension control mode according to the situation type.

[0092] Specifically, the suspension control mode matched with the mountain / gravel road sub - scenario is high - frequency and small - amplitude vibration. The suspension vibration frequency is controlled within 5HZ - 10HZ, which can simulate the experience of the left and right wheels bumping alternately in the movie; the suspension control mode matched with the muddy / swamp sub - scenario is low - frequency and large - amplitude vibration. The suspension vibration frequency is controlled within 2HZ - 5HZ, which can simulate the sense of the body rising and falling; the suspension control mode matched with the snow / ice surface is one - side suspension pulsed vibration, which can simulate the sense of roll and offset caused by road surface skidding during steering.

[0093] Specifically, the suspension control mode matched with the hard acceleration / hard braking vehicle sub - scenario is the pitch mode. Specifically, the front suspension rises and the rear suspension drops, increasing the support force on the occupant's back to simulate the sense of being pushed back during hard acceleration, or the rear suspension rises and the front suspension drops, increasing the pressure on the occupant's abdomen to simulate the experience of hard braking; the suspension control mode matched with the high - speed cornering sub - scenario is the roll mode. Specifically, one - side suspension gradually rises, and low - frequency vibration can also be maintained simultaneously; the suspension control mode matched with the collision / explosion sub - scenario is severe shock vibration of the suspension. The suspension vibration frequency is controlled within 10HZ - 20HZ, and the continuous vibration lasts for 0.5 seconds; the suspension control mode matched with the jump / fall sub - scenario is the bounce mode. Specifically, using the full - active body control system, the suspension is quickly compressed or extended, thereby generating an upward force on the vehicle to achieve the bounce action. When in the air, the suspension is completely released, and when landing, the shock of the full suspension is aggravated with a stronger rebound effect.

[0094] Specifically, the suspension control mode matched with the tense / suspense sub - scenario is periodic low - frequency vibration. The suspension vibration frequency is controlled within 1HZ - 2HZ, and the suspension control mode matched with the horror / thriller sub - scenario is instant pulsed vibration. The suspension vibration frequency is controlled within 20HZ - 30HZ, and the vibration lasts for 0.2 seconds.

[0095] Specifically, the suspension control mode matched with the flight / float sub - scenario is that the suspension is completely relaxed, controlling the body to sway slightly horizontally.

[0096] Step S6: Generate the target control parameters of the suspension according to the suspension control mode.

[0097] Specifically, the target control parameters include roll angular velocity, vertical lifting and lowering speeds of the four wheels, suspension adjustment duration, and suspension vibration frequency.

[0098] Specifically, when the vehicle weight is 2.5 tons - 3 tons, in the mountain / gravel road sub - scenario, the matched suspension vibration frequency is 5HZ - 10HZ, and the lifting and lowering speed of the suspension is 150mm / s.

[0099] Specifically, when the vehicle weight is 2.5 tons - 3 tons, in the tense / suspense sub - scenario, the matched suspension vibration frequency is 3HZ - 8HZ, and the lifting and lowering speed of the suspension is 200 - 300mm / s.

[0100] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the high-speed cornering scenario, the matched suspension vibration frequency is 20 HZ, and the roll angular velocity of the suspension is 5° / s.

[0101] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the flight / floating scenario, the matched suspension vibration frequency is between 4 HZ and 8 HZ, and the lifting speed of the suspension is 100 - 120 mm / s.

[0102] Step S7, generate a suspension control strategy according to the target control parameters.

[0103] Specifically, the suspension control strategy includes the rotational speed, level, and current of the shock absorber motor.

[0104] Step S8, adjust the suspension height according to the suspension control strategy.

[0105] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the mountain / gravel road scenario, the logic level is 1, the shock absorber current is 500 mA, and the rotational speed of the shock absorber motor is between -300 revolutions per minute and 300 revolutions per minute.

[0106] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the tense / suspense scenario, the logic level is 1, the shock absorber current is 1200 mA, and the rotational speed of the shock absorber motor is between -1500 revolutions per minute and 1500 revolutions per minute.

[0107] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the high-speed cornering scenario, the logic level is 1, the shock absorber current is 750 mA, and the rotational speed of the shock absorber motor is between -500 revolutions per minute and 500 revolutions per minute.

[0108] Specifically, when the vehicle weight is between 2.5 tons and 3 tons, in the flight / floating scenario, the logic level is 1, the shock absorber current is 500 mA, and the rotational speed of the shock absorber motor is between -200 revolutions per minute and 200 revolutions per minute.

[0109] Step S9, obtain the occupant data of the occupant during movie viewing.

[0110] Specifically, real-time collect the physiological data of the occupant during movie viewing, such as heart rate, body temperature, etc., and the behavior data, such as shaking the head, laughing, etc.

[0111] Step S10, output the analysis result according to the occupant data.

[0112] Specifically, the occupant data is input into the AI large model constructed and pre-trained based on the deep learning framework for analysis, and the analysis results are output. The passenger data processing module classifies the facial expressions and behavior data, and uses a multi-modal fusion model to combine the facial expressions and behavior data into passenger status tags. Different passenger status tags match different suspension expected control data numerical optimization amplitudes. Among them, the facial expressions include the curvature of the corners of the mouth, the contraction of the orbicularis oculi muscle, and the pupil size, which are divided into four categories: calm, interested, tense, and uncomfortable. The behavior data includes head posture, limb movements, and gaze direction, which are divided into four categories: focused, distracted, active interaction, and avoidance. The passenger status tags combined by the facial expressions and behavior data are divided into three types: high immersion state, critical state, and dangerous state.

[0113] Specifically, the present invention also designs to use the AI fusion model to fuse the situation type with the analysis structure of the passenger data, and optimize the suspension control strategy through the fused results.

[0114] Step S11, adjust the suspension height according to the analysis results.

[0115] Specifically, the analysis results are transmitted to the suspension subsystem 12 for optimizing the control strategy. Among them, the optimization amplitude of the suspension target control parameters matched by the high immersion state is increased by 20%, the optimization amplitude of the suspension target control parameters matched by the critical state is decreased by 20%, and the optimization amplitude of the suspension target control parameters matched by the dangerous state is to immediately terminate the suspension dynamic effect.

[0116] An embodiment of the third aspect of the present invention provides an electronic device, including: at least one processor; a memory communicatively connected to the at least one processor; wherein, the memory stores a computer program executable by the at least one processor, and when the at least one processor executes the computer program, the vehicle control method of the above embodiment is implemented.

[0117] An embodiment of the fourth aspect of the present invention provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the vehicle control method of the above embodiment is implemented.

[0118] An embodiment of the fifth aspect of the present invention provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, the steps of the vehicle control method of the above embodiment are implemented.

[0119] In the description of this specification, the descriptions with reference to the terms "one embodiment", "some embodiments", "schematic embodiments", "examples", "specific examples", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

[0120] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the claims and their equivalents.

Claims

1. A vehicle (1), characterized in that, Including: A cockpit subsystem (11), the cockpit subsystem (11) having a video playback device; A suspension subsystem (12), connected to the cockpit subsystem (11), the suspension subsystem (12) being configured to adjust the height according to the film information played by the video playback module.

2. The vehicle (1) according to claim 1, characterized in that, The cockpit subsystem (11) includes a film data processing module (111), the film data processing module (111) being used to generate a scenario type according to the film information, and the suspension subsystem (12) adjusting the height according to the scenario type.

3. The vehicle (1) according to claim 2, characterized in that, The film data processing module (111) being used to generate a scenario type according to the film information includes: The film data processing module (111) obtains the elements of the film information, the elements including one or more of visual features, actions, directions, dialogue content, character emotions, and environmental scenes; The film data processing module (111) inputs the real-time scenario generated corresponding to the elements into an artificial convolutional neural network model to obtain the scenario type, and classifies the scenario type; wherein, the scenario type includes at least two of a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type.

4. The vehicle (1) according to claim 2, characterized in that, The suspension subsystem (12) adjusting the height according to the scenario type includes: The cockpit subsystem (11) matches a suspension control mode according to the scenario type; The suspension subsystem (12) adjusts the height based on the suspension control mode, the suspension control mode including at least two of a vibration mode, a lifting mode, a pitching mode, a rolling mode, and a bouncing mode.

5. The vehicle (1) according to claim 4, characterized in that, The method further includes: The cockpit subsystem (11) generates target control parameters for the suspension subsystem (12) according to the suspension control mode; The suspension subsystem (12) adjusts the height according to the target control parameters, the target control parameters including one or more of a roll angular velocity, a four-wheel vertical lifting speed, a suspension adjustment duration, and a suspension vibration frequency.

6. The vehicle (1) according to claim 5, characterized in that, The suspension subsystem (12) includes a suspension control unit (121) and a suspension execution unit (122), the suspension control unit (121) generating a suspension control strategy according to the target control parameters, and the suspension execution unit (122) being used to adjust the height according to the suspension control strategy, the suspension control strategy including one or more of the rotational speed, level, and current of a shock absorber motor.

7. The vehicle (1) according to claim 1, characterized in that, The cockpit subsystem (11) further includes a film data storage module (112), the film data storage module (112) being connected to the film data processing module (111), the film data storage module (112) being used to load a film and transmit the film to the film data processing module (111), the film data processing module (111) receiving the film and generating a scenario type according to the film information, and the suspension subsystem (12) adjusting the height according to the scenario type.

8. The vehicle (1) according to claim 1, characterized in that, The cockpit subsystem (11) further includes an occupant data processing module (113), and the occupant data processing module (113) is configured to output an analysis result according to the occupant data during movie viewing, and the suspension subsystem (12) adjusts the height according to the analysis result.

9. The vehicle (1) according to claim 8, characterized in that, The occupant data includes physiological data and behavioral data.

10. The vehicle (1) according to claim 8, characterized in that, The occupant data processing module (113) is configured to classify the analysis result, and the classified analysis result includes at least two of a high-immersion state, a critical state, and a dangerous state; the suspension subsystem (12) adjusts the height according to the classified analysis result.

11. The vehicle (1) according to any one of claims 2-10, characterized in that, The cockpit subsystem (11) further includes a movie data processing module (111) and an occupant data processing module (113), the movie data processing module (111) is configured to generate a scenario type, and the occupant data processing module (113) is configured to output an analysis result; the suspension subsystem (12) adjusts the height according to the scenario type and the analysis result.

12. The vehicle (1) according to claim 1, characterized in that, The suspension subsystem (12) includes an active hydraulic shock absorber (1221).

13. A vehicle control method, characterized in that, The method includes: Adjusting the suspension height according to the movie information.

14. The vehicle control method according to claim 13, wherein The method further includes: Generating a scenario type according to the movie information; Adjusting the suspension height according to the scenario type.

15. The vehicle control method according to claim 14, wherein, The method further includes: Obtaining elements of the movie information, where the elements include one or more of visual features, actions, directions, dialogue content, character emotions, and environmental scenes; Obtaining the scenario type based on the real-time scenario generated corresponding to the elements; Classifying the scenario type, and the scenario type includes at least two of a natural environment type, an action scene type, an emotional atmosphere type, and a special effect type.

16. The vehicle control method according to claim 15, wherein The method further includes: Matching a suspension control mode according to the scenario type; Adjusting the suspension height based on the suspension control mode, and the suspension control mode includes at least two of a vibration mode, a lifting mode, a pitching mode, a roll mode, and a bouncing mode.

17. The vehicle control method according to claim 16, wherein The method further includes: Generating target control parameters for the suspension according to the suspension control mode; Adjusting the suspension height according to the target control parameters, and the target control parameters include one or more of a roll angular velocity, a vertical lifting speed of four wheels, a suspension adjustment duration, and a suspension vibration frequency.

18. The vehicle control method according to claim 17, wherein, The method further includes: Generating a suspension control strategy according to the target control parameters; Adjusting the suspension height according to the suspension control strategy, and the suspension control strategy includes one or more of the rotational speed, level, and current of a shock absorber motor.

19. The vehicle control method according to claim 14, wherein Before generating the scenario type according to the movie information, the method further includes: Obtaining a movie; Preprocessing the movie.

20. The vehicle control method according to claim 13, characterized in that The method further includes: Obtaining occupant data of an occupant during movie viewing; Outputting an analysis result according to the occupant data; Adjusting the suspension height according to the analysis result.

21. The vehicle control method according to claim 20, characterized in that, The occupant data includes physiological data and behavioral data.

22. The vehicle control method according to any one of claims 13-21, characterized in that, The method further includes: Adjusting the suspension height according to the scenario type of the movie information and the analysis result of the occupant data of the occupant during movie viewing.

23. The vehicle control method according to any one of claims 13-22, characterized in that, The method further includes: Obtaining a movie viewing instruction; When the vehicle is in the P gear position, control the vehicle to enter the viewing mode and adjust the suspension height according to the film information; When the vehicle is not in the P gear position, prohibit the vehicle from entering the viewing mode.

24. An electronic device, characterized in that, Comprising: At least one processor; A memory communicatively connected to at least one of the processors; Wherein, the memory stores a computer program executable by at least one of the processors, and when at least one of the processors executes the computer program, the vehicle control method according to any one of claims 13-23 is implemented.

25. A computer storage medium, on which a computer program is stored, characterized in that, When the computer program is executed by the processor, the vehicle control method according to any one of claims 13-23 is implemented.

26. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the steps of the vehicle control method according to any one of claims 13-23 are implemented.

Images