Vehicle control method and device and vehicle

Abstract

The embodiment of the invention relates to the technical field of vehicles, and discloses a vehicle control method and device and a vehicle. The vehicle control method comprises the steps that under the condition that a vehicle-mounted entertainment mode is started, a target image is obtained; the target image is an entertainment image displayed on a vehicle-mounted entertainment display screen; determining environmental parameters in the target image; the environment parameters comprise a space area, temperature, sound, smell and light intensity; determining a control instruction of target equipment in the vehicle based on the environment parameters; the target equipment is used for representing equipment for improving entertainment experience in a vehicle-mounted entertainment mode; and controlling the target device based on the control instruction. According to the technical scheme, the environment parameters of the target image can be converted into the control instruction of the target equipment in the vehicle, so that the experience feeling of a user in a vehicle entertainment mode is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a vehicle control method, device and vehicle. BACKGROUND

[0002] With the rapid development of the automobile industry, automobiles have been fully popularized and have become an essential means of transportation for the public in their daily lives. As the second living space for users, in addition to meeting basic traffic needs, automobiles are also endowed with multiple attributes such as socializing, resting and entertainment. On the basis of traditional audio-visual entertainment functions, vehicle games further enrich the leisure experience dimension of automobiles and have extremely broad development prospects.

[0003] A related technology discloses that when a vehicle determines that it is in a static scene, a second entering signal is generated according to a first entering signal and an entering confirmation signal of a game mode, and then the steering wheel is controlled to be decoupled, torque output is prohibited and / or the gear is locked. Another related technology discloses that after detecting a vehicle game mode opening instruction, the steering column and the steering gear are first controlled to be decoupled, then the angle of the connected steering wheel is obtained, the steering gear feedback force is determined in combination with the target parameters of the game mode, and then the feedback resistance corresponding to the target angle of the steering wheel output is controlled. As can be seen, the prior art generally only supports the vehicle to access a vehicle racing game in a non-driving state, and the game control is completed relying on the steering wheel angle information. However, such a scheme can only realize interactive control through a single dimension of the steering wheel angle, and the control mode is poor, which is difficult to meet the diversified operation needs of users and seriously restricts the experience quality and immersion effect of vehicle games. SUMMARY

[0004] In view of the above deficiencies of the prior art, the purpose of the present application is to provide a vehicle control method, device and vehicle, which aims to improve the entertainment experience of users in a vehicle entertainment mode.

[0005] In a first aspect, an embodiment of the present application provides a vehicle control method, comprising: acquiring a target image in a case where a vehicle entertainment mode is opened; the target image being an entertainment image displayed on a vehicle entertainment display screen; determining an environment parameter in the target image; the environment parameter comprising: a space region, a temperature, a sound, an odor and a light intensity; determining a control instruction of a target device in the vehicle based on the environment parameter; the target device being a device for representing an improvement in the entertainment experience in the vehicle entertainment mode; and controlling the target device based on the control instruction.

[0006] Based on the aforementioned technical means, when the in-vehicle entertainment mode is activated, the target image on the in-vehicle entertainment display screen is acquired, and then the matching environmental parameters are accurately determined based on the target image. The environmental parameters are then converted into control commands for the vehicle's target devices. With the coordinated linkage and precise response of each target device, the scene features in the target image are visualized into a real physical and sensory experience inside the vehicle. This comprehensively enriches the immersive experience of in-vehicle entertainment, significantly improves the user's sense of immersion and driving comfort during gameplay, and ultimately achieves a significant optimization of the overall experience of the in-vehicle entertainment mode.

[0007] In one possible embodiment, determining environmental parameters in a target image includes: extracting global image features from the target image; the global image features include: image scale and image color; obtaining entertainment scene modeling information corresponding to the entertainment progress of the target image; and determining environmental parameters based on the global image features and the entertainment scene modeling information.

[0008] Based on the aforementioned technical means, by accurately extracting global image features such as image scale and image color from the target image, and combining them with entertainment scene modeling information that matches the entertainment progress of the target image to carry out feature fusion and comprehensive analysis, the determined environmental parameters can be deeply adapted to the visual features of the in-vehicle entertainment screen and the current entertainment scene, effectively ensuring the scientific nature and accurate matching of environmental parameters, thereby greatly improving the fit and effectiveness of target device control in the in-vehicle entertainment scene.

[0009] In one embodiment, the image color includes the color values ​​of multiple cells divided into target images; environmental parameters are determined based on global image features and entertainment scene modeling information, including: determining multiple target cells whose color values ​​match the entertainment scene modeling information; reconstructing a virtual entertainment space based on the color values ​​of the multiple target cells, the image scale, and the entertainment scene modeling information; and determining environmental parameters based on the virtual entertainment space.

[0010] Based on the aforementioned technical means, the color values ​​of each cell are precisely filtered through entertainment scene modeling information, ensuring that the selected target cells all meet the visual matching requirements of the current entertainment scene. Thus, relying on the color values ​​of the target cells, image scale, and entertainment scene modeling information, a virtual entertainment space can be reconstructed more accurately and in line with the scene. Furthermore, based on this virtual entertainment space, environmental parameters can be derived and determined, effectively ensuring the adaptability and consistency of environmental parameters with the current in-vehicle entertainment scene, and significantly improving the accuracy of cabin environment control and the immersive experience.

[0011] In some embodiments, the entertainment scene modeling information includes: preset entertainment sounds and preset entertainment smells; reconstructing the virtual entertainment space based on the color values ​​of multiple target cells, image scale, and entertainment scene modeling information includes: constructing a three-dimensional grid map based on the color values ​​of multiple target cells; and reconstructing the virtual entertainment space based on the three-dimensional grid map, preset entertainment sounds, preset entertainment smells, and image scale.

[0012] Based on the aforementioned technical means, a three-dimensional grid map with three-dimensional spatial characteristics and color distribution attributes can be accurately and efficiently constructed using the color values ​​of the target cells. Furthermore, by combining preset entertainment sounds, preset entertainment smells, and image scales to carry out multi-dimensional fusion modeling, an immersive virtual entertainment space can be reconstructed more closely to the original scene, effectively improving the scene fidelity and sensory richness of the virtual entertainment space.

[0013] In an exemplary embodiment, the target device includes: an air conditioner, an audio device, a fragrance device, and a lighting device.

[0014] Based on the aforementioned technical means, air conditioning, audio equipment, fragrance devices, and lighting equipment are included in the scope of control targets for in-vehicle entertainment mode. Targeted and precise control can be carried out on the dimensions of cabin temperature, sound, odor, and light intensity, achieving coordinated adaptation of the cabin environment across multiple sensory dimensions. This can concretize the scene characteristics of virtual entertainment space into a realistic physical and sensory experience within the cabin, comprehensively enriching the immersive atmosphere of in-vehicle entertainment and allowing users to obtain a multi-dimensional immersive experience of sight, sound, smell, and touch, significantly enhancing the gaming experience in in-vehicle entertainment mode.

[0015] In an exemplary embodiment, the control commands for target devices in the vehicle are determined based on environmental parameters, including generating control commands for the air conditioning, audio equipment, fragrance equipment, and lighting equipment, so that the vehicle cabin can simulate the temperature, sound, odor, and light intensity in the environmental parameters.

[0016] Based on the aforementioned technical means, control commands are generated for the air conditioning, audio equipment, fragrance equipment, and lighting equipment, thereby enabling the vehicle cabin to more accurately simulate environmental parameters such as temperature, sound, smell, and light intensity. This allows for a comprehensive recreation of the current entertainment scene's atmosphere, deeply enhancing the immersive sensory experience of in-vehicle entertainment and significantly improving the user's sense of immersion and comfort while playing in the cabin.

[0017] In an exemplary embodiment, the target device further includes: a seat and a suspension; determining control commands for the target device in the vehicle based on environmental parameters, including: generating control commands corresponding to the seat and the suspension respectively, so that the occupant on the seat simulates the movement of an entertainment character in a spatial area.

[0018] Based on the aforementioned technical means, precise control commands corresponding to the seats and suspensions are generated, allowing occupants in the seats to truly perceive the dynamic changes of the entertainment characters within the virtual space area. This can visualize the spatial motion sensation of the game and convey it to the user, breaking through the limitations of pure audiovisual experience and achieving deep linkage between cabin sensation and entertainment scene. This significantly enhances the immersion and interactive experience of in-vehicle entertainment and significantly improves the user's sense of immersion in the game.

[0019] In an exemplary embodiment, the conditions for enabling the in-vehicle entertainment mode include: the vehicle's brake pedal is not triggered, the vehicle is in a park position, and the remaining charge of the vehicle's power battery is greater than or equal to a preset charge level.

[0020] Based on the aforementioned technical means, by setting the conditions for enabling the in-vehicle entertainment mode through the brake pedal, the vehicle being in a park position, and the remaining power of the power battery, a dual guarantee can be formed from the dimensions of driving safety and vehicle energy consumption. This not only avoids the safety hazards caused by turning on the in-vehicle entertainment mode while the vehicle is in motion, but also prevents the power battery from being depleted and affecting the normal operation of the vehicle, thus ensuring the safety, compliance, and reliability of turning on the in-vehicle entertainment mode.

[0021] In an exemplary embodiment, the in-vehicle entertainment display screen is a first target display screen among a plurality of in-vehicle display screens, and the vehicle control method further includes: switching the target image to the second target display screen in response to an activation operation of the second target display screen; the second target display screen is any in-vehicle display screen other than the first target display screen among the plurality of in-vehicle display screens.

[0022] Based on the aforementioned technical means, when the second target display screen is activated, the target image can be switched from the first target display screen to the second target display screen for display. This can flexibly adapt to the diverse viewing needs of users, create a more comfortable entertainment field of view for users, optimize the multi-screen interactive experience, and further enhance the ease of operation and user experience in the in-vehicle entertainment mode.

[0023] In an exemplary embodiment, the vehicle control method further includes uploading entertainment data generated in the in-vehicle entertainment mode to the cloud when the in-vehicle entertainment mode is activated.

[0024] Based on the aforementioned technical means, when the in-vehicle entertainment mode is enabled, the entertainment data generated in the in-vehicle entertainment mode will be uploaded to the cloud, which can break the limitations of in-vehicle entertainment scenarios and devices, realize the cloud-synchronized retention of game progress, and greatly improve the user's gaming flexibility and experience.

[0025] Secondly, embodiments of this application provide a vehicle control device, including: an acquisition module, a determination module, and a control module; the acquisition module is used to acquire a target image when the in-vehicle entertainment mode is activated; the target image is an entertainment image displayed on the in-vehicle entertainment display screen; the determination module is used to determine environmental parameters in the target image; the environmental parameters include: spatial area, temperature, sound, odor, and light intensity; based on the environmental parameters, control commands for a target device in the vehicle are determined; the target device is used to characterize a device that enhances the entertainment experience in the in-vehicle entertainment mode; the control module is used to control the target device based on the control commands.

[0026] In one possible embodiment, the determining module is specifically used to extract global image features from the target image; the global image features include: image scale and image color; obtain entertainment scene modeling information corresponding to the entertainment progress of the target image; and determine environmental parameters based on the global image features and the entertainment scene modeling information.

[0027] In one embodiment, the image color includes the color values ​​of multiple cells divided into target images; the determination module is specifically used to determine multiple target cells whose color values ​​match the entertainment scene modeling information; based on the color values ​​of the multiple target cells, the image scale, and the entertainment scene modeling information, the virtual entertainment space is reconstructed; and based on the virtual entertainment space, environmental parameters are determined.

[0028] In some embodiments, the entertainment scene modeling information includes: preset entertainment sounds and preset entertainment smells; a determination module, specifically used to construct a three-dimensional grid map based on the color values ​​of multiple target cells; and to reconstruct a virtual entertainment space based on the three-dimensional grid map, preset entertainment sounds, preset entertainment smells, and image scale.

[0029] In an exemplary embodiment, the target device includes: an air conditioner, an audio device, a fragrance device, and a lighting device.

[0030] In the exemplary embodiment, the determining module is specifically used to generate control commands corresponding to the air conditioning, audio equipment, fragrance equipment and lighting equipment, so as to simulate the temperature, sound, smell and light intensity in the vehicle cabin environment parameters.

[0031] In an exemplary embodiment, the target device further includes a seat and a suspension; the determining module is specifically used to generate control commands corresponding to the seat and the suspension respectively, so that the occupant on the seat simulates the movement of an entertainment character in the spatial area.

[0032] In an exemplary embodiment, the conditions for enabling the in-vehicle entertainment mode include: the vehicle's brake pedal is not triggered, the vehicle is in a park position, and the remaining charge of the vehicle's power battery is greater than or equal to a preset charge level.

[0033] In an exemplary embodiment, the in-vehicle entertainment display screen is a first target display screen among a plurality of in-vehicle display screens, and the vehicle control device further includes: a switching module; the switching module is used to switch the target image to the second target display screen in response to an activation operation of the second target display screen; the second target display screen is any in-vehicle display screen other than the first target display screen among the plurality of in-vehicle display screens.

[0034] In an exemplary embodiment, the vehicle control device further includes an upload module; the upload module is used to upload entertainment data generated in the in-vehicle entertainment mode to the cloud when the in-vehicle entertainment mode is enabled.

[0035] Thirdly, embodiments of this application provide a vehicle, including: a vehicle body, a target device, an in-vehicle entertainment display screen, and a vehicle control device as described in the second aspect above.

[0036] Fourthly, this application provides an electronic device comprising: a processor and a memory; the memory storing instructions executable by the processor. When the processor is configured to execute the instructions, the electronic device implements the vehicle control method of the first aspect described above.

[0037] Fifthly, this application provides a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the vehicle control method of the first aspect described above.

[0038] In a sixth aspect, this application provides a computer program product including computer program instructions that, when executed by a processor, implement the vehicle control method of the first aspect described above.

[0039] It should be noted that the technical effects of any of the implementation methods in aspects two through six can be found in the technical effects of the corresponding implementation methods in aspect one, and will not be repeated here.

[0040] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application will be described below.

[0042] Figure 1 This is a schematic diagram of the structure of a vehicle disclosed in an embodiment of this application; Figure 2 This is an interactive diagram of another vehicle control device disclosed in the embodiments of this application; Figure 3This is a product schematic diagram of an in-vehicle interactive software disclosed in an embodiment of this application; Figure 4 This is a schematic diagram of a virtual controller disclosed in an embodiment of this application; Figure 5 This is a product illustration of a game mode disclosed in an embodiment of this application; Figure 6 This is a product schematic diagram of a function setting interface disclosed in an embodiment of this application; Figure 7 This is a schematic diagram of a vehicle-to-everything (V2X) communication product disclosed in an embodiment of this application; Figure 8 This is a schematic diagram of the functional architecture of a vehicle control device disclosed in an embodiment of this application; Figure 9 This is a schematic flowchart of a vehicle control method disclosed in an embodiment of this application; Figure 10 This is a schematic diagram of the structure of a vehicle-mounted display screen disclosed in an embodiment of this application; Figure 11 This is a flowchart of a vehicle control method disclosed in an embodiment of this application; Figure 12 This is a schematic flowchart of another vehicle control method disclosed in an embodiment of this application; Figure 13 This is a schematic flowchart of another vehicle control method disclosed in an embodiment of this application; Figure 14 This is a schematic flowchart of another vehicle control method disclosed in an embodiment of this application; Figure 15 This is a schematic flowchart of another vehicle control method disclosed in an embodiment of this application; Figure 16 This is a schematic flowchart of another vehicle control method disclosed in an embodiment of this application; Figure 17 This is a flowchart illustrating a screen switching operation as disclosed in an embodiment of this application; Figure 18 This is a flowchart illustrating a data transmission process for uploading to the cloud, as disclosed in an embodiment of this application. Figure 19 This is an architecture diagram of a local area network disclosed in an embodiment of this application; Figure 20 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. Detailed Implementation

[0043] The terms “first,” “second,” etc., are used for descriptive purposes only and have no sequential or technical meaning, nor should they be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0044] The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

[0045] Please refer to Figure 1 , Figure 1 , which is a schematic structural diagram of a vehicle disclosed in an embodiment of the present application. The vehicle 100 can be, but is not limited to, a pure electric vehicle (Pure Electric Vehicle / Battery Electric Vehicle, PEV / BEV), a hybrid electric vehicle (Hybrid Electric Vehicle, HEV), a range-extended electric vehicle (Range Extended Electric Vehicle, REEV), a plug-in hybrid electric vehicle (Plug-in Hybrid Electric Vehicle, PHEV), a new energy vehicle (New Energy Vehicle), etc.

[0046] In an embodiment of the present application, the vehicle 100 includes a vehicle body 101, a target device 102, an in-vehicle entertainment display screen 103, and a vehicle control device 104. The target device 102, the in-vehicle entertainment display screen 103, and the vehicle control device 104 are disposed on the vehicle body 101, and the vehicle control device 104 is respectively connected to the target device 102 and the in-vehicle entertainment display screen 103. The vehicle control device 104 is configured to obtain a target image in the in-vehicle entertainment display screen 103 and determine environmental parameters in the target image when the in-vehicle entertainment mode is turned on, and determine the environmental parameters in the target image as a control instruction for the target device 102, and control the target device 102 through the control instruction.

[0047] Among them, the target image is an entertainment image displayed on the in-vehicle entertainment display screen 103.

[0048] The target device 102 may include: an air conditioner, an audio device, an aroma device, a lighting device, a seat, a suspension.

[0049] As a feasible implementation manner, as Figure 2 shown, the vehicle control device can be connected to the terminal device through in-vehicle Bluetooth. The user relies on the terminal device to establish a Bluetooth communication link with the vehicle control device, and transmits game operation instructions and related interaction information on the terminal device to the vehicle control device through Bluetooth. The vehicle control device then performs linkage control on the target device based on the target image presented on the in-vehicle entertainment display screen, so that the target device provides a more comfortable cockpit environment for the user. This method can enrich the interaction form in the in-vehicle entertainment mode and effectively improve the user's entertainment experience and operation immersion.

[0050] Specifically, the in-vehicle Bluetooth module can establish one-to-one or one-to-many Bluetooth pairing connections with user terminal devices, receive game operation information uploaded by the terminal devices, and after data parsing and processing, forward the valid information to the vehicle control device, ensuring the timeliness and accuracy of command transmission. The terminal device must be a mobile terminal pre-installed with the corresponding in-vehicle interactive software to achieve compatible communication and functional interaction with the vehicle.

[0051] In an exemplary embodiment, such as Figure 3 As shown, Figure 3 As shown, users can open the in-vehicle interactive software on their terminal device, select the virtual gamepad function under the in-vehicle gaming function within the software, and then control the game using this virtual gamepad. The corresponding game operation information is then uploaded to the vehicle's Bluetooth module in real time via Bluetooth communication. This virtual gamepad integrates a rich set of control buttons, including: HOME button, screenshot button (Print Sc), left joystick (D-pad), right joystick (Enter), ABXY function buttons, back button (Esc), pause / start button, character display area (PLAYER X), and "+" and "-" adjustment buttons.

[0052] For example, such as Figure 4 As shown, the functions of each button are defined as follows: HOME button: Clicking this button quickly returns to the main interface of the in-vehicle interactive software; Screenshot button (Print Sc): Clicking this button allows the user to take a screenshot of the target image displayed on the in-vehicle entertainment screen; Left joystick (dashpad): Primarily used to control the movement direction of the in-game entertainment character, and also supports various entertainment function operations. Pressing down on the joystick is equivalent to using a direction confirmation button; Right joystick (Enter): Used to control the movement direction of the entertainment character and supports triggering various entertainment functions. Pressing down on the joystick is equivalent to using an operation confirmation button; ABXY function keys: Used to trigger specified functions in the game, mainly applicable to scenarios such as skill release of game characters and selection of game menu options; Back button (Esc): Clicking this button directly returns to the previous level interface; Pause / Start button: Used to pause and resume the game process; Character display area (PLAYER) The "X" key is used to clearly distinguish the game character corresponding to the current terminal device, enabling accurate recognition of multi-character control; the "+" and "-" adjustment keys are used to adjust the volume, screen brightness, game multiplier, character parameters, and other settings in the game to meet the user's personalized game settings needs.

[0053] In an exemplary embodiment, such as Figure 5 As shown, the in-vehicle interactive software can also be configured with a dedicated function settings interface for game mode. Users can enter the function settings interface from the settings of the game mode interface according to their own needs, and make personalized adjustments to various target devices in the function settings interface.

[0054] like Figure 6 As shown, the function settings interface includes a wealth of adjustment options, including window settings, air conditioning settings, suspension settings, sound settings, display settings, lighting settings, alarm clock settings, and fragrance settings.

[0055] Among them, the window settings support precise adjustment of the window opening, and users can freely select within the range of 0% to 100%, for example, adjusting the window opening to 10%; the air conditioning settings allow for multi-dimensional adjustment of air volume, air temperature, air direction, and air mode. The air volume can be selected within the range of 0 to 10, such as selecting level 3 air volume; the air temperature can be selected within the temperature control range of LO to HI, such as adjusting to 25℃; the air direction can be selected as needed to blow on the face, feet, or face and feet; the air mode can be switched to ventilation, cooling, or heating; the suspension settings support the opening and closing adjustment of the suspension function, and users can choose to close or open the suspension adjustment as needed.

[0056] The sound settings allow adjustment of game volume and sound effect modes. Game volume can be precisely set within the range of 0dB to 100dB. For example, if 20dB is selected, the sound effect settings can be off, dynamic, cartoon, mechanical, magical, horror, or retro. The display settings support switching between multiple display media for the game screen. Users can choose the central control screen, passenger screen, rear screen, augmented reality head-up display (ARHUD), vehicle body projection, or headlight projection as the display media for the target image. The lighting settings include four adjustment options: ambient light switch settings, ambient light effects, ambient light brightness, and roof light settings. The ambient light switch settings can be set to off, front seats on, rear seats on, or all vehicles on. The ambient light effects can be switched to static, breathing, gradient, or rhythmic. The ambient light brightness can be selected within the range of 1% to 100%. For example, if adjusted to 20%, the roof light settings can be set to turn on the front roof light, left rear roof light, or right rear roof light as needed.

[0057] The alarm clock settings support timed reminders in game scenarios, allowing users to choose to turn off reminders or set reminder durations of 30 minutes, 1 hour, or 2 hours. The fragrance settings include fragrance concentration and fragrance type selection. Fragrance concentration can be set to high, medium, or low, and fragrance type can be selected as unscented, fragrance type I, fragrance type II, or fragrance type III.

[0058] It should be noted that each function setting must clearly define three core configurations: option range, factory default value, and function activation conditions. Taking the window opening setting as an example, the option range can be defined as independent adjustment of the opening of the four windows, with an opening range of 0%-100% and an adjustment scale of 10%, for a total of 11 selectable levels; when the vehicle leaves the factory, the default value of the opening of the four windows is uniformly set to 10%; the function activation judgment condition can be defined as follows: the window opening adjustment function can only be activated when the rainfall intensity signal collected by the vehicle is rainless and the outside temperature signal meets 10℃≤t≤30℃.

[0059] It is understood that the above function settings interface is only an exemplary implementation method. In actual applications, the configuration content of the function settings interface can be flexibly adjusted and optimized according to specific usage requirements.

[0060] As a feasible implementation method, such as Figure 7 As shown, when the vehicle control device establishes a connection with multiple terminal devices through the in-vehicle Bluetooth module, it can extract the corresponding mobile device address from the Bluetooth connection requests of each terminal device and enter the device identifier of each Bluetooth central device into the parallel connection list, thus achieving accurate identification and independent differentiation of multiple terminal device identifiers. Simultaneously, it assigns character numbers according to the order of Bluetooth connection, marking the first successfully paired virtual controller as PLAYER 1, the second as PLAYER 2, and subsequent terminal devices sequentially. The vehicle-side Bluetooth module can categorize and forward the operation information uploaded by each terminal device, corresponding to different entertainment characters, and synchronously transmit it to the vehicle control device, ultimately enabling simultaneous control of multiple game characters in the in-vehicle game, meeting the user's needs for multiplayer online games.

[0061] Please see Figure 8 , Figure 8 This is a functional architecture diagram of a vehicle control device disclosed in an embodiment of this application. The vehicle control device 104 includes: an acquisition module 801, a determination module 802, and a control module 803; the acquisition module 801 is used to acquire a target image when the in-vehicle entertainment mode is activated; the target image is an entertainment image displayed on the in-vehicle entertainment display screen; the determination module 802 is used to determine environmental parameters in the target image; the environmental parameters include: spatial area, temperature, sound, odor, and light intensity; based on the environmental parameters, control commands for a target device in the vehicle are determined; the target device is used to characterize a device that enhances the entertainment experience in the in-vehicle entertainment mode; the control module 803 is used to control the target device based on the control commands.

[0062] In one possible embodiment, the determining module 802 is specifically used to extract global image features from the target image; the global image features include: image scale and image color; obtain entertainment scene modeling information corresponding to the entertainment progress of the target image; and determine environmental parameters based on the global image features and the entertainment scene modeling information.

[0063] In one embodiment, the image color includes the color values ​​of multiple cells divided into target images; the determining module 802 is specifically used to determine multiple target cells whose color values ​​match the entertainment scene modeling information; based on the color values ​​of the multiple target cells, the image scale, and the entertainment scene modeling information, the virtual entertainment space is reconstructed; and based on the virtual entertainment space, environmental parameters are determined.

[0064] In some embodiments, the entertainment scene modeling information includes: preset entertainment sounds and preset entertainment smells; the determination module 802 is specifically used to construct a three-dimensional grid map based on the color values ​​of multiple target cells; and to reconstruct the virtual entertainment space based on the three-dimensional grid map, preset entertainment sounds, preset entertainment smells, and image scale.

[0065] In an exemplary embodiment, the target device includes: a vehicle window, an air conditioner, a chassis, an audio system, a fragrance device, and a lighting device.

[0066] In the exemplary embodiment, the determining module 802 is specifically used to generate control commands corresponding to the air conditioner, audio equipment, fragrance equipment and lighting equipment, so as to simulate the temperature, sound, smell and light intensity in the vehicle cabin environment parameters.

[0067] In an exemplary embodiment, the target device further includes a seat and a suspension; the determining module 802 is specifically used to generate control commands corresponding to the seat and the suspension respectively, so that the occupant on the seat can simulate the movement of an entertainment character in a spatial area.

[0068] In an exemplary embodiment, the conditions for enabling the in-vehicle entertainment mode include: the vehicle's brake pedal is not triggered, the vehicle is in a park position, and the remaining charge of the vehicle's power battery is greater than or equal to a preset charge level.

[0069] In an exemplary embodiment, the in-vehicle entertainment display screen is a first target display screen among a plurality of in-vehicle display screens, and the vehicle control device 800 further includes: a switching module 804; the switching module 804 is used to switch the target image to the second target display screen in response to an activation operation of the second target display screen; the second target display screen is any in-vehicle display screen other than the first target display screen among the plurality of in-vehicle display screens.

[0070] In an exemplary embodiment, the vehicle control device 800 further includes an upload module 805; the upload module 805 is used to upload entertainment data generated in the in-vehicle entertainment mode to the cloud when the in-vehicle entertainment mode is enabled.

[0071] It should be understood that the vehicle control device in the embodiments of this application can be any device or equipment with the ability to control the target device, such as a vehicle controller or a domain controller, and there is no specific limitation in this regard.

[0072] Please see Figure 9 , Figure 9 This is a schematic flowchart of a vehicle control method disclosed in an embodiment of this application.

[0073] In some embodiments, the vehicle control method includes the following steps: S901. Acquire the target image when the in-vehicle entertainment mode is enabled.

[0074] The target image is the entertainment image displayed on the in-vehicle entertainment screen.

[0075] The in-vehicle entertainment display is the primary target display among multiple in-vehicle displays.

[0076] In an exemplary embodiment, such as Figure 10 As shown, in-vehicle displays may include: rear screens, Digital Light Processing (DLP) headlight projection, Head-Up Display (HUD) projection, vehicle body projection, and central control / passenger / connected screens, etc.

[0077] The in-vehicle entertainment mode indicates that the vehicle is currently in operation with entertainment functions centered on audio-visual playback, casual interaction, and scenario-based entertainment experiences. In-vehicle entertainment mode can include various games, such as action-adventure, racing, platforming, third-person shooters, role-playing, sports, sandbox simulation, and multiplayer party games.

[0078] As a feasible implementation method, after the vehicle terminal receives the signal to start the vehicle entertainment mode, it immediately triggers the start process of the vehicle entertainment mode. After the entertainment mode is successfully started and the screen of the vehicle entertainment display is loaded, the target image presented on the vehicle entertainment display is acquired in real time, and the entertainment image content of the display is continuously synchronized.

[0079] S902. Determine the environmental parameters in the target image.

[0080] The environmental parameters include: spatial area, temperature, sound, odor, and light intensity. This creates an immersive environment for users that is compatible with the in-car entertainment scenario.

[0081] As a feasible approach, corresponding environmental parameter templates are pre-set for different types of in-vehicle entertainment scenarios (such as racing, adventure, and leisure). When the in-vehicle entertainment mode is turned on and the current entertainment scenario type is identified based on the target image, the matching parameter template is directly called to automatically adjust the spatial area division (such as seat posture and privacy partition control), temperature, sound (sound effects and volume), smell (fragrance type), and light intensity (ambient light brightness and light and shadow mode) in the vehicle, quickly building an environmental atmosphere that adapts to the scenario.

[0082] As another feasible approach, global image features are extracted from the target image. These global image features include image scale and image color. Entertainment scene modeling information corresponding to the entertainment progress of the target image is obtained. Based on the global image features and entertainment scene modeling information, environmental parameters are determined.

[0083] S903, Determine the control commands for the target equipment in the vehicle based on environmental parameters.

[0084] The target device is used to characterize devices that enhance the entertainment experience in in-vehicle entertainment mode.

[0085] The target equipment includes: air conditioning, audio equipment, fragrance equipment, lighting equipment, seats, and suspension.

[0086] As a feasible approach, a standardized mapping relationship between game environment parameters and target device control commands is pre-established. Spatial parameters are translated into control commands for seat position adjustment and suspension height adjustment; temperature parameters are translated into control commands for air conditioning outlet temperature and airflow; sound parameters are translated into control commands for speaker volume adjustment, sound effect switching, and playback position adjustment; odor parameters are translated into control commands for fragrance system scent switching and concentration adjustment; and light intensity parameters are translated into control commands for in-vehicle lighting system brightness adjustment and lighting effect switching. After obtaining the environmental parameters suitable for the in-vehicle entertainment scenario, the pre-set mapping relationship is directly retrieved, and control commands corresponding to each target device are generated and sent to the corresponding devices for execution, thereby providing users with an immersive entertainment experience.

[0087] As another feasible approach, based on real-time acquired environmental parameters, dynamic adaptation and optimization of these parameters are performed in conjunction with the actual needs of the current in-vehicle entertainment scenario. Differentiated control commands are generated for different types of target devices: precise adjustment of seat position and suspension height based on spatial parameters; intelligent adjustment of air conditioning operation mode and airflow parameters based on temperature parameters; adaptation and adjustment of audio equipment volume, sound effects, and playback sound field based on sound parameters; switching control of fragrance type and concentration for fragrance devices based on odor parameters; and dynamic adjustment of lighting equipment brightness and lighting effects based on light intensity parameters. Simultaneously, the linkage and adaptation of control commands for each target device are supported, ensuring that the operating status of each device is deeply integrated with the entertainment scenario, further enhancing the user's immersive experience.

[0088] Specifically, basic parameter optimization templates are pre-built for various mainstream in-vehicle entertainment scenarios. The templates contain baseline optimization values ​​for space, temperature, sound, smell, and light intensity for the corresponding scenarios. During actual entertainment, the basic template matching the scenario is first retrieved, and then the baseline parameters in the template are dynamically fine-tuned in combination with the real-time recognition of the scenario stage, user preferences, and device status. Adaptive optimization parameters are quickly generated, balancing optimization efficiency and accuracy, and are applicable to most common in-vehicle entertainment scenarios.

[0089] As a feasible implementation method, such as Figure 11 As shown, the target image is preprocessed (pooling and noise reduction). Based on the preprocessed image data and entertainment scene modeling information (i.e. game storyline) obtained from the cloud, environmental parameters are determined, the environmental parameters are mapped and processed into control commands, and the control commands are sent to the target device.

[0090] S904, Control the target device based on control commands.

[0091] As a feasible implementation method, after generating control commands for each target device, the vehicle control device sends the control commands to the corresponding target devices such as air conditioning, audio, seats, and lights in real time through the vehicle bus. After receiving the command, each target device first verifies the validity of the control command and its own executable range. If the command is valid and within the adjustable range, it executes the corresponding operation (such as adjusting the temperature of the air conditioning or adjusting the position of the seat), and at the same time feeds back the operation completion status to the vehicle control device through the bus to ensure control accuracy.

[0092] It should be understood that when the in-vehicle entertainment mode is activated, the system acquires the target image on the in-vehicle entertainment display screen, and then accurately determines the matching environmental parameters based on the target image. The environmental parameters are then converted into control commands for the vehicle's target devices. With the coordinated linkage and precise response of each target device, the scene features in the target image are visualized into a real physical and sensory experience within the vehicle. This comprehensively enriches the immersive experience of in-vehicle entertainment, significantly enhances the user's sense of immersion and driving comfort during gameplay, and ultimately achieves a significant optimization of the overall experience of the in-vehicle entertainment mode.

[0093] In some embodiments, the conditions for enabling the in-vehicle entertainment mode include: the vehicle's brake pedal is not triggered, the vehicle is in a parked position, and the remaining charge of the vehicle's power battery is greater than or equal to a preset charge level.

[0094] The preset charge level is used to indicate the minimum charge level that the power battery can support the stable operation of the in-vehicle entertainment mode.

[0095] As a feasible approach, the fact that the vehicle's brake pedal is not triggered indicates that the vehicle currently has no braking operation requirement and is in a stationary state without preparation for driving. At this time, activating the in-vehicle entertainment mode can avoid conflicts between the operation of the entertainment function and the vehicle's braking operation, thus ensuring the basic safety of activating the in-vehicle entertainment mode.

[0096] When a vehicle is in the parking position, it indicates that the vehicle's power transmission system is disconnected and the vehicle is in a parked state. There is no risk of the vehicle moving or shifting, and the static operating environment requirements for the in-vehicle entertainment mode are met. The mode can be safely activated to start the entertainment experience.

[0097] With the remaining power of the power battery greater than or equal to the preset power, the vehicle has sufficient power reserves to provide continuous power for the operation of various target devices such as air conditioning, audio, lights, and projectors in the in-vehicle entertainment mode, avoiding interruption of the mode due to insufficient power, and preventing the power battery from being depleted and affecting the normal driving of the vehicle.

[0098] In an exemplary embodiment, such as Figure 12As shown, the logic for enabling the in-vehicle entertainment mode is pre-programmed into the vehicle control unit. Upon receiving a trigger signal from the user (either via voice or manual activation), the vehicle control unit simultaneously collects data on the brake pedal status, vehicle gear position, and remaining battery power to determine if the conditions for enabling the in-vehicle entertainment mode are met. If any condition is not met, a message indicating that the in-vehicle entertainment mode cannot be enabled will be sent to the user via the in-vehicle entertainment display screen or voice announcement. If all conditions are met, the vehicle control unit will issue a mode activation command to officially activate the in-vehicle entertainment mode. It will also acquire the target image on the in-vehicle entertainment display screen in real time and, based on this image, issue corresponding control commands to various target devices such as window opening adjustment devices, suspension, alarm clock, sound equipment, screen display devices, air conditioning, and fragrance devices. Optionally, the screen display device will also continuously receive game operation information uploaded from multiple terminal devices to achieve synchronous reception and response to entertainment control commands, ensuring a smooth user entertainment experience.

[0099] As a feasible approach, various operating statuses are monitored in real time during vehicle operation, and the in-vehicle entertainment mode is automatically turned off when preset shutdown conditions are met.

[0100] The preset shutdown conditions include at least one of the following: the vehicle's brake pedal is triggered, the vehicle is not in a park position, or the remaining charge of the vehicle's power battery is less than the preset charge.

[0101] When the vehicle's brake pedal is activated, it indicates that the user intends to start the vehicle and prepare to drive. At this time, turning off the in-vehicle entertainment mode can prevent entertainment screens and sounds from distracting the user's driving attention and ensure driving safety.

[0102] If the vehicle is not in park, it means that the vehicle's powertrain is ready to drive and the vehicle is ready to move. You should immediately turn off the in-vehicle entertainment mode to eliminate any interference from the entertainment function and ensure that the vehicle can enter normal driving mode at any time.

[0103] If the remaining charge of the power battery is less than the preset charge, it means that the vehicle's power reserves are insufficient to support the continuous operation of the in-vehicle entertainment mode. Continuing to discharge will cause the power battery to run out of power, affecting the vehicle's subsequent starting and driving. At this time, turning off the in-vehicle entertainment mode can stop the power consumption of the entertainment device and ensure the basic power reserve of the power battery.

[0104] In an exemplary embodiment, such as Figure 13As shown, the vehicle control unit continuously monitors the brake pedal status, vehicle gear signal, and remaining battery power in real time. When any of the following conditions are detected: brake pedal activation, vehicle shifting to a non-parking gear, or battery power falling below a preset level, the unit determines whether the preset shutdown conditions are met. If the preset conditions are not met, monitoring and judgment continue. If the preset shutdown conditions are met, a command to shut down the in-vehicle entertainment mode is immediately issued (the in-vehicle entertainment mode shutdown operation will also be executed simultaneously upon receiving a user-initiated voice or manual exit command). After triggering the exit of the in-vehicle entertainment mode, the vehicle control unit will quickly control the vehicle to exit the in-vehicle entertainment mode, simultaneously turning off sound playback, stopping the screen display, and restoring all target devices such as the air conditioner, seats, suspension, lights, and fragrance system to their initial states before the in-vehicle entertainment mode was activated, ensuring the vehicle returns to normal operating conditions.

[0105] Optionally, users can access the "Alarm Settings" option in the in-vehicle interactive software's function settings interface to independently select the timed reminder duration. During a complete cycle of the in-vehicle entertainment mode from activation to operation, the vehicle control device will keep a real-time timer. When the user-preset reminder time is reached, a preset alarm tone will be automatically played to remind the user to exit the in-vehicle entertainment mode in time, reasonably control the entertainment time, and turn their attention to other work or travel arrangements.

[0106] In some embodiments, to obtain accurate environmental parameters, entertainment scene modeling information corresponding to the target image can be obtained.

[0107] As a feasible implementation method, combined with Figure 9 ,like Figure 14 As shown, step S902 above can be specifically implemented as follows: S1401. Extract global image features from the target image.

[0108] Global image features include image scale and image color. These features are used to characterize the overall visual attributes and spatial features of the target image.

[0109] Image scale: The overall spatial scale and proportion of the target image reflect the spatial openness and dimensional ratio of the scene presented in the image.

[0110] Graphical color refers to the color values ​​of multiple cells in a target image. It is used to characterize the overall color tone, color distribution patterns, and local color features of the target image.

[0111] In an exemplary embodiment, the determination of global image features includes: performing pooling and noise reduction operations on the target image to obtain preprocessed image data; performing edge detection and region segmentation processing on the preprocessed image data to uniformly divide the target image into several small cells, and calculating the gradient direction and gradient magnitude for each cell; performing feature extraction on the image data after cell division based on a CNN convolutional neural network, on the one hand extracting the overall pixel ratio and size ratio features of the image to determine the image scale of the target image, and on the other hand extracting the color values ​​corresponding to each cell to integrate them into the image color features of the target image; finally summarizing the two types of features, image scale and image color, to obtain complete global image features.

[0112] Specifically, pooling and denoising operations refer to preprocessing techniques performed on target images. Pooling (such as max pooling and average pooling) preserves key image features and compresses image size, while denoising (such as Gaussian filtering and median filtering) eliminates noise interference in the image. This reduces image resolution and improves signal-to-noise ratio while maintaining the core features of the image, ultimately reducing the computational load of subsequent data processing and simplifying the complexity of the algorithm network.

[0113] Edge detection and region segmentation refers to accurately identifying the pixel edge contours and feature region boundaries of a target image using edge detection algorithms, and then dividing the target image into several independent micro cells using region segmentation technology. Simultaneously, the gradient direction and gradient magnitude of each cell are calculated to provide a regularized image data foundation for subsequent global image feature extraction, while enhancing the distinguishability of local image features and ensuring the accuracy of feature extraction.

[0114] S1402. Obtain the entertainment scene modeling information corresponding to the entertainment progress of the target image.

[0115] Among them, entertainment modeling scene information is used to represent scene feature information that matches the current in-vehicle entertainment progress and can support dynamic adaptation of in-vehicle environmental parameters, and can accurately reflect the environmental atmosphere and sensory experience requirements of the corresponding entertainment scene.

[0116] The entertainment scene modeling information includes: preset entertainment sounds and preset entertainment smells.

[0117] Entertainment scene modeling information can be pre-stored in the local database of the vehicle control device, or it can be retrieved from the cloud server in real time according to actual entertainment needs.

[0118] As a feasible implementation method, the vehicle control device is equipped with a pre-set reinforcement learning (RL) model. This model is pre-trained with a large amount of in-vehicle entertainment scene data and has the core capabilities of scene data parsing, process matching and feature extraction. After the in-vehicle entertainment mode is activated, the model drives the vehicle control device to establish a stable communication link with the cloud server and obtain the complete story scene data package of the currently running game online (including basic information such as environmental features, plot nodes and sensory adaptation parameters of the entire process scene).

[0119] The RL reinforcement learning model captures real-time entertainment progress data of the current game, including key progress information such as game levels, plot nodes, and character status, and simultaneously collects target image screen data on the local in-vehicle entertainment display screen. The model uses "accurate matching of progress information and high fit of screen features" as the reward objective. It breaks down the complete story scene data obtained from the cloud into process nodes and compares and matches them frame by frame with the target image screen data collected in real time locally. It dynamically adjusts the matching weight to ensure that the cloud scene data and the screen content of the current entertainment progress are accurately matched.

[0120] Based on the matching results, the RL reinforcement learning model further completes the registration and alignment operations of the image scene representation. By correcting the image scale deviation and calibrating the viewpoint, it ensures that the scene spatial dimension and visual presentation style in the cloud scene data are consistent with the local target image.

[0121] The RL reinforcement learning model extracts entertainment scene modeling information (including preset entertainment sounds, preset entertainment smells, preset space / temperature / light intensity parameters, etc.) that are highly consistent with the current entertainment progress from the matched and aligned cloud scene data, and outputs it to the instruction generation module of the vehicle control device. Throughout the process, the dynamic iterative optimization of the RL algorithm ensures the real-time synchronization and adaptation accuracy between scene feature information and actual entertainment content.

[0122] S1403. Determine environmental parameters based on global image features and entertainment scene modeling information.

[0123] As a feasible approach, the extracted global image features (image scale, image color) are fused and matched with the entertainment scene modeling information obtained from the cloud: the scene spatial scale is calibrated with the image scale, and the preset sensory parameters (such as preset sound, smell, and light intensity style) in the scene modeling information are matched with the atmospheric tone corresponding to the image color. The scene atmosphere adaptation algorithm generates environmental parameters such as space, temperature, sound, smell, and light intensity that match both, ensuring that the environmental parameters are deeply adapted to the current entertainment scene.

[0124] As another feasible approach, multiple target cells are identified that match color values ​​with entertainment scene modeling information; based on the color values ​​of the multiple target cells, image scale, and entertainment scene modeling information, the virtual entertainment space is reconstructed; and based on the virtual entertainment space, environmental parameters are determined.

[0125] By accurately extracting global image features such as image scale and color from the target image, and combining them with entertainment scene modeling information that matches the entertainment progress of the target image, feature fusion and comprehensive analysis can be carried out. This allows the determined environmental parameters to be deeply adapted to the visual features of the in-vehicle entertainment screen and the current entertainment scene, effectively ensuring the scientific nature and accuracy of the environmental parameters, and thus significantly improving the fit and effectiveness of target device control in in-vehicle entertainment scenarios.

[0126] In some embodiments, virtual entertainment spaces can be reconstructed using global image features and entertainment scene modeling information, enabling the direct extraction of environmental parameters from the virtual entertainment space.

[0127] As a feasible implementation method, combined with Figure 14 ,like Figure 15 As shown, step S1403 can be specifically implemented as follows: S1501, Determine multiple target cells that match color values ​​with entertainment scene modeling information.

[0128] As a feasible approach, cell color values ​​are extracted from the target image after region segmentation. The color values ​​of each cell are compared one by one with the baseline color features in the entertainment scene modeling information. Cells with matching color attributes are selected and identified as target cells.

[0129] It should be understood that selecting cells that match the entertainment scene modeling information is to lock onto the core areas in the target image that can accurately reflect the visual characteristics of the current entertainment scene, thereby extracting effective color data, avoiding irrelevant color information from interfering with the subsequent reconstruction of the virtual entertainment space and determination of environmental parameters, and ensuring the accuracy of the adaptation of environmental parameters to the current entertainment scene.

[0130] In the exemplary embodiment, cells whose color values ​​do not match the entertainment scene modeling information are determined to be invalid image areas, and the color data corresponding to such cells are removed and not included in the data source range for subsequent virtual entertainment space reconstruction and environmental parameter calculation; at the same time, the core data such as color values, gradient directions and amplitudes of all target cells in the target image are retained for subsequent processes.

[0131] S1502. Based on the color values, image scale, and entertainment scene modeling information of multiple target cells, reconstruct the virtual entertainment space.

[0132] Among them, the virtual entertainment space is used to represent a digital scene space model that fits the current in-vehicle entertainment progress and integrates image visual features and cloud scene features. It can accurately restore the spatial scale, color atmosphere and scene attributes of the corresponding entertainment scene, and provide an intuitive and accurate spatial reference for determining environmental parameters.

[0133] As a feasible approach, color values ​​reflect the color tone and distribution characteristics of the core area in the target image, representing the visual atmosphere of the current entertainment scene; image scale reflects the overall spatial scale and proportion of the target image, representing the spatial openness and dimensional ratio of the current entertainment scene; and entertainment scene modeling information reflects the real spatial attributes, scene style, and sensory adaptation benchmarks of the game story scene obtained from the cloud and matched with the current entertainment progress. The combination of these three elements enables multi-dimensional fusion of visual features, spatial scale, and scene attributes. Therefore, based on the color values, image scale, and entertainment scene modeling information of multiple target cells, a virtual entertainment space highly consistent with the current entertainment scene can be reconstructed.

[0134] In the exemplary embodiment, the color values ​​of all target cells are first integrated to restore the core color distribution and atmosphere of the current entertainment scene; then, the spatial dimension of the color distribution is scaled and calibrated based on the image scale to match the real spatial scale in the cloud entertainment scene modeling information; finally, the scene style and spatial structure features in the entertainment scene modeling information are combined to perform spatial modeling on the image data after color and scale fusion, and a virtual entertainment space with both visual atmosphere and spatial attributes is constructed to completely replicate the scene features under the current entertainment progress.

[0135] S1503. Determine environmental parameters based on the virtual entertainment space.

[0136] As a feasible approach, the built-in spatial sensory parameters, temperature parameters, sound parameters, odor parameters, and light intensity parameters are directly extracted from the reconstructed virtual entertainment space. These extracted parameters are then used as the adaptability environmental parameters for the target vehicle device, thus completing the determination of the environmental parameters.

[0137] It should be understood that the virtual entertainment space is a digital scene model reconstructed by integrating the visual features of the target image, the spatial scale of the image, and the cloud-based entertainment scene modeling information. It has completely replicated the spatial attributes, atmospheric characteristics, and various sensory adaptation requirements of the current in-vehicle entertainment scene. Its built-in parameters can directly correspond to the control requirements of target devices such as air conditioning, seats, audio, lighting, and fragrance in the vehicle. Therefore, it is possible to accurately determine the suitable environmental parameters based on the virtual entertainment space, ensuring a high degree of fit between the environmental parameters and the current entertainment scene.

[0138] In an exemplary embodiment, parameters representing the openness of the scene are extracted from the virtual entertainment space as the basis for adjusting the suspension height and seat position; parameters representing the warm or cold atmosphere of the scene are extracted as the basis for adjusting the air conditioning temperature and airflow; parameters representing the sound effect style of the scene are extracted as the basis for adjusting the audio volume and sound effects; parameters representing the odor characteristics of the scene are extracted as the basis for adjusting the fragrance type and concentration; and parameters representing the light brightness of the scene are extracted as the basis for adjusting the light brightness and lighting effects, thereby quickly determining all-dimensional environmental parameters.

[0139] By precisely filtering the color values ​​of each cell using entertainment scene modeling information, the selected target cells all meet the visual matching requirements of the current entertainment scene. Based on the color values ​​of the target cells, image scale, and entertainment scene modeling information, a virtual entertainment space can be reconstructed more accurately and in line with the scene. Then, based on this virtual entertainment space, environmental parameters can be derived and determined, which can effectively ensure the adaptability and consistency of environmental parameters with the current in-vehicle entertainment scene, and greatly improve the accuracy of cabin environment control and immersive experience.

[0140] In some embodiments, a three-dimensional mesh map can be constructed first, and then a virtual entertainment space can be constructed using the three-dimensional mesh map.

[0141] As a feasible implementation method, combined with Figure 15 ,like Figure 16 As shown, step S1502 above can be specifically implemented as follows: S1601. Construct a 3D grid map based on the color values ​​of multiple target cells.

[0142] Among them, a three-dimensional grid map refers to a digital grid model with color attributes and a three-dimensional spatial structure, which is formed by using the target cell as the basic grid unit and relying on the color value of each cell to complete the spatial dimension mapping and layered modeling. It can intuitively present the color distribution, spatial hierarchy and three-dimensional arrangement characteristics of the core area of ​​the target image.

[0143] It should be understood that color values ​​can accurately reflect the visual characteristics and scene attribute differences corresponding to the target cell. Constructing a three-dimensional grid map based on color values ​​can transform the two-dimensional color information of a planar image into three-dimensional feature data, breaking through the dimensional limitations of planar images and clearly restoring the spatial distribution pattern and hierarchical relationship of colors in the target image.

[0144] In an exemplary embodiment, all the selected target cells are first arranged into a two-dimensional grid according to their planar positions in the target image; then, based on the color value of each target cell, each cell is assigned a corresponding spatial height value and color weight value, with color feature differences corresponding to hierarchical differences in the grid space; finally, based on the planar arrangement, height value, and color weight value of the cells, the grid units are stereoscopically stitched together and spatially modeled to generate a three-dimensional grid map that combines planar color distribution and stereoscopic spatial hierarchy.

[0145] S1602. Based on a 3D grid map, preset entertainment sounds, preset entertainment smells, and image scale, a virtual entertainment space is reconstructed.

[0146] It should be understood that the image scale accurately reflects the spatial scale and regional proportion of the target image, providing a benchmark for the spatial dimension calibration of the virtual entertainment space; the 3D mesh map already carries the three-dimensional spatial structure and color distribution characteristics of the core area of ​​the target image, constituting the visual and spatial foundation of the virtual entertainment space; and the preset entertainment sounds and preset entertainment smells (both derived from cloud-based entertainment scene modeling information matched with the current entertainment progress) are the core representations of the sensory atmosphere of the current entertainment scene. These four elements, from the four key dimensions of spatial scale, stereoscopic vision, hearing, and smell, fully cover the core elements of the scene required for the virtual entertainment space, and are all deeply adapted to the current in-vehicle entertainment progress. Therefore, by fusing and modeling these four types of elements, a virtual entertainment space that fits the current entertainment scene can be accurately reconstructed.

[0147] In an exemplary embodiment, the spatial scale of the three-dimensional grid map is first calibrated according to the image scale to match the real spatial scale of the current entertainment scene; then, the sound field parameters corresponding to the preset entertainment sound and the diffusion range parameters corresponding to the preset entertainment smell are mapped to the corresponding spatial areas of the calibrated three-dimensional grid map; finally, the visual spatial features of the three-dimensional grid map are deeply fused with the sound and olfactory parameters through a scene fusion algorithm to generate a virtual entertainment space that combines stereoscopic vision, immersive sound field and matching odor atmosphere.

[0148] By using the color values ​​of target cells, a three-dimensional grid map with spatial characteristics and color distribution attributes can be accurately and efficiently constructed. Furthermore, by combining preset entertainment sounds, preset entertainment smells, and image scales to carry out multi-dimensional fusion modeling, an immersive virtual entertainment space can be reconstructed more closely to the original scene, effectively improving the scene fidelity and sensory richness of the virtual entertainment space.

[0149] In some embodiments, after determining the environmental parameters, control commands corresponding to each target device can be determined.

[0150] As a feasible implementation method, the above step S903 can be implemented as follows: generating control commands corresponding to the air conditioning, audio equipment, fragrance equipment and lighting equipment respectively, so as to simulate the temperature, sound, smell and light intensity in the vehicle cabin environment parameters.

[0151] In the exemplary embodiment, the determined environmental parameters are broken down into temperature control parameters, sound control parameters, odor control parameters, and light intensity control parameters according to the target device type. Based on each type of parameter, control commands related to the air outlet temperature, air volume, and air outlet mode for the air conditioner, control commands related to the volume, sound effect style, and sound field distribution for the audio equipment, control commands related to the fragrance type and release concentration for the fragrance device, and control commands related to the brightness, lighting effect mode, and color for the lighting device are generated. Each type of control command is then sent to the corresponding target device to complete the control command generation and sending process.

[0152] It should be understood that generating dedicated control commands for air conditioning, audio equipment, fragrance devices, and lighting equipment enables each target device to accurately respond to the adjustment requirements of environmental parameters, and to specifically simulate the temperature, sound, smell, and light intensity in the cabin. This achieves collaborative linkage of multiple target devices, transforming the scene characteristics of the virtual entertainment space into a real physical and sensory experience in the vehicle cabin, ultimately creating an immersive cabin environment for users that is highly consistent with the current in-vehicle entertainment scenario.

[0153] As another feasible implementation method, step S903 above can also be implemented as: generating control commands corresponding to the seat and suspension respectively, so that the occupant on the seat can simulate the movement of the entertainment character in the space area.

[0154] In the exemplary embodiment, motion characteristic parameters such as the motion trajectory, acceleration, and turbulence amplitude of the entertainment character are extracted from the virtual entertainment space. Based on these parameters, adjustment commands corresponding to the seat (such as backrest angle, seat cushion height adjustment, and lateral support adjustment) and damping adjustment commands corresponding to the suspension are generated. The commands are synchronously sent to the seat control module and the suspension control module. Through the coordinated adjustment of seat posture and dynamic changes in suspension damping, the motion state of the entertainment character is simulated.

[0155] It should be understood that control commands are generated for the seat and suspension respectively, enabling occupants to simulate the movement of entertainment characters within a spatial area. This breaks away from the limitations of traditional in-vehicle entertainment, which is confined to audiovisual experiences. Through the coordinated control of the seat and suspension, it provides occupants with tangible tactile and bodily feedback. This allows occupants to intuitively perceive the movement changes of entertainment characters in virtual space (such as steering, acceleration, and bumps), deeply binding virtual entertainment scenes with real-world bodily sensations. This significantly enhances the immersion and interactive experience of in-vehicle entertainment, strengthening the user's sense of involvement in the entertainment scenario.

[0156] In some embodiments, to better enable multi-screen interaction and provide players with a more comfortable gaming view, the in-vehicle entertainment display can flexibly switch screen displays according to user needs.

[0157] As a feasible implementation, in response to the activation operation of the second target display screen, the target image is switched to the second target display screen.

[0158] The second target display screen is any vehicle display screen other than the first target display screen among the multiple vehicle display screens.

[0159] As a feasible implementation method, activation operations can include: screen-sensing trigger, voice command trigger, preset option trigger, etc.

[0160] In an exemplary embodiment, such as Figure 17 As shown, when the first target display screen senses the user's three-finger long press trigger operation, the processor automatically activates the screen switching program and pops up a list of selectable playback interfaces (including all in-vehicle display screen icons) on the current screen. The user can control the second target display screen to light up and activate by dragging the current screen to the second target display screen icon in the list or by directly clicking the target icon. At the same time, the target image of the first target display screen is completely transferred to the second target display screen for display, thus completing the cross-screen switching.

[0161] In another exemplary embodiment, the user can directly input a preset screen switching voice command (such as "switch the screen to the rear screen" or "move the game screen to the central control screen"). After the voice recognition module of the vehicle control device recognizes and verifies the validity of the command, it automatically starts the cross-screen program and switches the target image to the second target display screen specified by the command.

[0162] In another exemplary embodiment, the user can find the "Screen display position setting" option in the in-vehicle entertainment function settings interface in advance and preset the default playback display screen of the game screen (i.e. the second target display screen). When the in-vehicle entertainment mode is turned on, the user-preset second target display screen will be directly lit up and activated, and the target image will be displayed synchronously on the screen without the need for additional switching operations.

[0163] It should be understood that promptly switching the target image to the second target display screen after receiving the activation operation not only enhances the collaborative linkage capability of multi-screen devices, but also effectively broadens the game's field of view, reduces the limitations of single-screen display, and further improves the comfort and user experience of in-vehicle entertainment.

[0164] In some embodiments, entertainment data for each instance is stored to facilitate user viewing of entertainment data.

[0165] As a feasible approach, when the in-vehicle entertainment mode is enabled, the entertainment data generated in that mode will be uploaded to the cloud.

[0166] In an exemplary embodiment, such as Figure 18 As shown, the vehicle establishes a stable data transmission channel with the cloud through in-vehicle network communication equipment (such as an in-vehicle Ethernet module or a 5G communication module). During the operation of the in-vehicle entertainment mode, entertainment data such as real-time game frames and audio data streams are encrypted and uploaded to the cloud server at a preset frequency. Users need to download and install the corresponding in-vehicle entertainment linkage APP in advance on their smart device terminals (mobile phones, tablets, computers, smart TVs, etc.). After logging in to the account and binding the vehicle through the APP, a dedicated information transmission channel can be established with the cloud. The game audio and video data uploaded by the vehicle can be obtained from the cloud in real time and simultaneously rendered and displayed on the APP interface of the smart device terminal. At the same time, users can input control commands through the game controller (including virtual controllers and physical controllers) associated with the APP. The game control data will be uploaded to the cloud platform through the APP and quickly forwarded to the vehicle control device by the cloud platform. The vehicle responds to the game operation based on the received control data.

[0167] Optionally, when a user is playing a game in a car and needs to leave the vehicle due to travel requirements, there is no need to terminate the current game process: the car will continuously upload game progress data and real-time audio and video data to the cloud. After leaving the vehicle, the user can open the mobile app they are carrying to obtain the current game progress and audio and video data from the cloud, and continue to control the game through the controller connected to the mobile phone. The control data is transmitted back to the car in real time through the cloud to ensure seamless game process and meet the user's need to continue playing in different locations.

[0168] It should be understood that when the in-vehicle entertainment mode is enabled, the entertainment data generated in the in-vehicle entertainment mode will be uploaded to the cloud, which can break the restriction that the game process is strongly bound to the vehicle, allowing users to continue their game progress in scenarios away from the vehicle, and improving the continuity of the entertainment experience.

[0169] In some embodiments, the vehicle control device provided in this application can also construct a distributed network by coordinating network connections between different vehicles or network devices to achieve multi-device computing power sharing, thereby enabling collaborative operation of large-scale multiplayer online games; at the same time, relying on the "master brain" to coordinate and collaboratively compute, it can assign exclusive game perspectives to different players and display them on corresponding devices, ultimately achieving the goal of multiple players collaboratively completing game tasks in their respective different scenarios, which not only breaks through the computing power limitations of a single device and ensures smooth and stable game operation, but also enhances the player's immersion and interactive experience.

[0170] As a feasible implementation method, a "master brain" device with overall coordination capabilities initiates a network invitation. After other vehicles or network devices (such as computers, TVs, mobile phones, etc.) agree to join the network, a stable local area network is built. Based on a distributed networking architecture, each device shares its own computing power, hardware resources, and game-related information. The "master brain" optimizes resource allocation based on the performance differences of each device, fully integrating the computing power of the entire network to support the operation of large-scale games. Subsequently, a global information map of the game environment is built through multi-device collaborative computing. The "master brain" combines the game character attributes of different players and accurately distributes the corresponding screen information to each networked device. Finally, each device independently renders and displays the game perspective of its respective player, synchronously transmitting player control data to realize multi-player cross-device collaborative gaming.

[0171] In an exemplary embodiment, a high-performance vehicle host is selected as the "main brain." The "main brain" sends network invitations to two surrounding vehicles, one home computer, and one projection device via a 5G / Wi-Fi 6 module. After users of each device confirm their agreement through their respective terminal interfaces, a local distributed network is successfully established. After the network is established, each device automatically reports its own computing power, storage, and other resource information to the "main brain." The "main brain" assigns heavy-load tasks such as game physics engine calculations and screen rendering to the high-performance vehicle host and the home computer, and assigns light-load tasks such as data synchronization and control command transmission to other devices. Subsequently, multiple devices collaboratively calculate and generate a global information map of the game. The "main brain" assigns exclusive perspective data to different devices based on the positioning of each player's selected role (such as output, support, reconnaissance). The two vehicle terminals display a first-person combat perspective, the home computer displays a global tactical map perspective, and the projection device displays a scene close-up perspective. During game operation, each device synchronizes player control data and character status in real time, enabling multiple players to collaboratively advance game tasks in different scenarios.

[0172] For example, such as Figure 19 As shown, a local area network is constructed between the lead vehicle, secondary vehicles 1 and 2, and terminal devices (including computers, TVs, mobile phones, projectors, and other networked devices), with the lead vehicle acting as the "brain". Based on the positioning differences of the game characters selected by each player, the lead vehicle accurately allocates screen information, independently presenting the display screen adapted to the corresponding character on the lead vehicle's display screen 1, secondary vehicle 1's display screen 2, secondary vehicle 2's display screen 3, and each terminal device's display screen N, achieving differentiated and synchronized display of screens across multiple devices.

[0173] Please see Figure 20 , Figure 20This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. The electronic device 2000 may include a processor 2001 and a memory 2002. The processor 2001 and the memory 2002 are communicatively connected. The memory 2002 is used to store programs, and the processor 2001 is used to execute the programs, specifically performing the relevant steps described above in the vehicle control method embodiment.

[0174] Specifically, the program may include program code, which includes computer-executable instructions. Memory 2002 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device. Processor 2001 may be a central processing unit (CPU), a microcontroller unit (MCU), or an application-specific integrated circuit (ASIC).

[0175] This application also provides a computer-readable storage medium storing at least one executable instruction that, when executed on a vehicle control device, causes the vehicle control device to perform the vehicle control method in any of the above method embodiments.

[0176] This application provides a computer program product that can be executed by the processor 2001 of an electronic device 2000 to perform the vehicle control method in the above embodiments.

[0177] It should be understood that the application of this application is not limited to the examples above. Those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims. Those skilled in the art can understand that implementing all or part of the processes of the above embodiments and making equivalent changes according to the claims of this application still fall within the scope of this application.

Claims

1. A vehicle control method, characterized in that, The vehicle control method includes: With the in-vehicle entertainment mode enabled, acquire the target image; the target image is the entertainment image displayed on the in-vehicle entertainment screen. Determine the environmental parameters in the target image; the environmental parameters include: spatial region, temperature, sound, odor, and light intensity; The control commands for the target device in the vehicle are determined based on the environmental parameters; the target device is used to characterize a device that enhances the entertainment experience in the in-vehicle entertainment mode. The target device is controlled based on the control commands.

2. The vehicle control method according to claim 1, characterized in that, Determining the environmental parameters in the target image includes: Extract global image features from the target image; the global image features include: image scale and image color; Obtain entertainment scene modeling information corresponding to the entertainment progress of the target image; The environmental parameters are determined based on the global image features and the entertainment scene modeling information.

3. The vehicle control method according to claim 2, characterized in that, The image color includes the color values ​​of multiple cells divided from the target image; determining the environmental parameters based on the global image features and the entertainment scene modeling information includes: Identify multiple target cells that match the color value with the entertainment scene modeling information; Based on the color values ​​of the multiple target cells, the image scale, and the entertainment scene modeling information, the virtual entertainment space is reconstructed; Based on the virtual entertainment space, the environmental parameters are determined.

4. The vehicle control method according to claim 3, characterized in that, The entertainment scene modeling information includes: preset entertainment sounds and preset entertainment smells; The process of reconstructing the virtual entertainment space based on the color values ​​of the multiple target cells, the image scale, and the entertainment scene modeling information includes: A 3D grid map is constructed based on the color values ​​of the multiple target cells; The virtual entertainment space is reconstructed based on the three-dimensional grid map, the preset entertainment sounds, the preset entertainment smells, and the image scale.

5. The vehicle control method according to claim 1, characterized in that, The target equipment includes: air conditioning, audio equipment, fragrance equipment, and lighting equipment.

6. The vehicle control method according to claim 5, characterized in that, The control commands for determining the target device in the vehicle based on the environmental parameters include: Generate control commands for the air conditioning, audio equipment, fragrance equipment, and lighting equipment respectively, so that the vehicle cabin can simulate the temperature, sound, smell, and light intensity in the environmental parameters.

7. The vehicle control method according to claim 5, characterized in that, The target device further includes: a seat and a suspension; the control commands for determining the target device in the vehicle based on the environmental parameters include: Control commands are generated for the seat and the suspension respectively, so that the occupant in the seat can simulate the movement of an entertainment character in the space area.

8. The vehicle control method according to claim 1, characterized in that, The conditions under which the in-vehicle entertainment mode can be enabled include: The vehicle's brake pedal is not activated, the vehicle is in park, and the remaining charge of the vehicle's power battery is greater than or equal to a preset charge level.

9. The vehicle control method according to claim 1, characterized in that, The in-vehicle entertainment display screen is the first target display screen among a plurality of in-vehicle display screens, and the vehicle control method further includes: In response to the activation operation of the second target display screen, the target image is switched to the second target display screen; the second target display screen is any of the plurality of vehicle display screens other than the first target display screen.

10. The vehicle control method according to claim 1, characterized in that, The vehicle control method further includes: When the in-vehicle entertainment mode is enabled, the entertainment data generated in the in-vehicle entertainment mode will be uploaded to the cloud.

11. A vehicle control device, characterized in that, The vehicle control device includes: an acquisition module, a determination module, and a control module; The acquisition module is used to acquire a target image when the in-vehicle entertainment mode is enabled; the target image is an entertainment image displayed on the in-vehicle entertainment screen. The determining module is used to determine environmental parameters in the target image; the environmental parameters include: spatial region, temperature, sound, odor, and light intensity; based on the environmental parameters, it determines control commands for a target device in the vehicle; the target device is used to characterize a device that enhances the entertainment experience in the in-vehicle entertainment mode; The control module is used to control the target device based on the control commands.

12. A vehicle, characterized in that, The vehicle includes: a body, a target device, an in-vehicle entertainment display screen, and a vehicle control device as described in claim 11.

Images