Cabin atmosphere control method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a cockpit atmosphere control method and device, electronic equipment and a storage medium, and the method comprises the steps: determining a target user needing to use a cockpit atmosphere adjustment function through responding to a starting operation of the cockpit atmosphere adjustment function; a voice instruction sent by the target user is obtained, and multimedia content is generated according to the voice instruction; the multimedia content is generated according to the user instruction, and linkage control of the air conditioning system, the fragrance system and the lighting system is carried out according to the generated multimedia content in a mode of controlling and adjusting one or more of the air conditioning system, the fragrance system and the lighting system in the cabin according to the multimedia content; according to the method, the corresponding multimedia content can be generated according to the real-time instruction of the user without a preset scheme or depending on active setting of the user, so that self-adaptive adjustment of the atmosphere in the vehicle is realized, the immersive experience of the user in the cabin is improved, and the real-time emotion demand of the user for using the cabin atmosphere adjustment function is fully met.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle cabin control, and in particular to a cabin atmosphere control method and device, electronic equipment, and storage medium. Background Art

[0002] With the rapid development of economy, people's living standards have been greatly improved, and the in-car entertainment system in cars has attracted more and more attention from users. Therefore, related fields are gradually beginning to pay attention to the immersive experience of in-car entertainment systems to meet the further needs of users.

[0003] The in-car immersive experience design in related technologies generally enhances the user's driving experience through sensory stimulation such as lighting, sound effects, smell, and touch, aiming to enhance the user's comfort and emotional connection. For example, the in-car ambient light provides users with different visual atmospheres by adjusting the color and brightness, and the in-car audio system provides users with an immersive acoustic experience by optimizing the sound effects.

[0004] However, these traditional design solutions have obvious limitations in terms of personalization, dynamic adaptability and intelligence. For example, the changes in ambient lighting and sound effect modes in traditional solutions are usually preset or actively set by the user, and are difficult to adjust according to the user's real-time needs or emotional state; they lack real-time emotional feedback and adaptive capabilities. Summary of the invention

[0005] In view of the above problems, a method and device for controlling cabin atmosphere, an electronic device, and a storage medium are proposed to overcome the above problems or at least partially solve the above problems, including:

[0006] A method for controlling a cabin atmosphere, the method comprising:

[0007] In response to a start-up operation of the cabin atmosphere adjustment function, determining a target user who needs to use the cabin atmosphere adjustment function;

[0008] Acquiring a voice command issued by the target user, and generating multimedia content according to the voice command;

[0009] According to the multimedia content, one or more of the air conditioning system, the fragrance system and the lighting system in the cabin are controlled and adjusted.

[0010] Optionally, generating multimedia content according to the voice instruction includes:

[0011] The voice instruction is converted to generate a text instruction, and the multimedia content is generated according to the text instruction.

[0012] Optionally, generating the multimedia content according to the text instruction includes:

[0013] Performing semantic analysis on the text instruction to determine the multimedia type of the multimedia content to be generated;

[0014] The multimedia content is generated according to the multimedia type and the text instruction.

[0015] Optionally, the multimedia type includes at least one or more of a picture type, a video type and an audio type.

[0016] Optionally, controlling and adjusting one or more of an air conditioning system, a fragrance system, and a lighting system in the cabin according to the multimedia content includes:

[0017] In the case where the multimedia type includes the picture type and / or the video type, controlling and adjusting the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content of the picture type and / or the video type;

[0018] In a case where the multimedia type includes the audio type, the lighting system in the cockpit is controlled and adjusted according to the multimedia content of the audio type.

[0019] Optionally, determining a target user who needs to use the cabin atmosphere adjustment function includes:

[0020] The gesture information of the user in the cockpit is determined, and the user who makes the preset gesture is determined as the target user.

[0021] Optionally, before controlling and adjusting one or more of the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content, the method further includes:

[0022] The multimedia content is displayed and / or played to the target user.

[0023] A cabin atmosphere control device, the device comprising:

[0024] a target user determination module, configured to determine a target user who needs to use the cabin atmosphere adjustment function in response to a start-up operation of the cabin atmosphere adjustment function;

[0025] A multimedia content generation module, used to obtain the voice command issued by the target user and generate multimedia content according to the voice command;

[0026] The cabin adjustment module is used to control and adjust one or more of the air conditioning system, the fragrance system and the lighting system in the cabin according to the multimedia content.

[0027] An electronic device comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the cabin atmosphere control method as described above when executed by the processor.

[0028] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the cockpit atmosphere control method as described above is implemented.

[0029] The embodiments of the present invention have the following advantages:

[0030] In an embodiment of the present invention, a cabin atmosphere control method is provided, which determines a target user who needs to use the cabin atmosphere adjustment function by responding to a start-up operation of the cabin atmosphere adjustment function; thereby obtaining a voice command issued by the target user, and generating multimedia content according to the voice command; and then controlling and adjusting one or more of the air-conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content, thereby realizing the generation of multimedia content according to user instructions and the linkage control of the air-conditioning system, the fragrance system, and the lighting system according to the generated multimedia content; without the need for a preset plan or relying on the user's active setting, the corresponding multimedia content can be generated according to the user's real-time instructions to achieve adaptive adjustment of the in-vehicle atmosphere, thereby enhancing the user's immersive experience in the cabin and fully meeting the user's real-time emotional needs when using the cabin atmosphere adjustment function. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0032] Figure 1 is a flowchart of the steps of a cabin atmosphere control method provided by some embodiments of the present invention;

[0033] Figure 2 It is a schematic diagram of an overall execution flow of the present invention provided by some embodiments of the present invention;

[0034] Figure 3 It is a structural schematic diagram of a cabin atmosphere control device provided by some embodiments of the present invention. DETAILED DESCRIPTION

[0035] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0036] With the rapid development of economy, people's living standards have been greatly improved, and the in-car entertainment system in cars has attracted more and more attention from users. Therefore, related fields are gradually beginning to pay attention to the immersive experience of in-car entertainment systems to meet the further needs of users.

[0037] The in-car immersive experience design in related technologies generally enhances the user's driving experience through sensory stimulation such as lighting, sound effects, smell, and touch, aiming to enhance the user's comfort and emotional connection. For example, the in-car ambient light provides users with different visual atmospheres by adjusting the color and brightness, and the in-car audio system provides users with an immersive acoustic experience by optimizing the sound effects.

[0038] However, these traditional design solutions have obvious limitations in terms of personalization, dynamic adaptability and intelligence. For example, the changes in ambient lighting and sound effect modes in traditional solutions are usually preset or actively set by the user, and it is difficult to adjust according to the user's real-time needs or emotional state; there is a lack of real-time emotional feedback and adaptive capabilities. In addition, traditional solutions rely more on single sensory stimulation, lack the interactivity of multi-sensory integration, and lack the ability to dynamically generate and create new content, making it difficult to meet the personalized and diverse real-time needs of users.

[0039] In the embodiment of the present invention, based on the core technical concept of generating corresponding multimedia content according to the user's real-time instructions to achieve adaptive adjustment of the in-car atmosphere, the cabin atmosphere control method in the related art is improved and applied to the smart cockpit, which can achieve intelligent control of the smart cockpit and enhance the riding experience of the passengers in the car. The present invention will be described in detail below with reference to the accompanying drawings:

[0040] Reference Figure 1 , shows a flowchart of a cabin atmosphere control method provided by some embodiments of the present invention, which may specifically include the following steps:

[0041] Step 101, in response to a start-up operation of a cabin atmosphere adjustment function, determining a target user who needs to use the cabin atmosphere adjustment function;

[0042] In a specific implementation, the user can trigger the atmosphere adjustment function in the cabin by means of air gestures. For example, the user can use dynamic gestures to click on the function button of the cabin atmosphere adjustment on the cabin ceiling screen or the front car screen to trigger the atmosphere adjustment function of the cabin ceiling screen or the front car screen. Since the user can trigger the atmosphere adjustment function in the car without contact, the user's operation convenience and driving safety can be improved. Among them, a 3D camera or a depth-sensing camera can be used to capture gesture movements in the car, and a real-time gesture recognition algorithm, such as a convolutional neural network (CNN) model based on deep learning, can be used to recognize the user's gesture movements.

[0043] Furthermore, the IVI (In-Vehicle Infotainment) system can be used to ask the user whether to turn on the cabin atmosphere adjustment function and identify whether any user has made a preset gesture, so that the user who has made the preset gesture can be confirmed as the target user who needs to use the cabin atmosphere adjustment function. For example, if a user makes a static gesture of OK, the in-vehicle infotainment system can lock the user as the target user.

[0044] In some embodiments of the present invention, determining a target user who needs to use the cabin atmosphere adjustment function includes:

[0045] The gesture information of the user in the cockpit is determined, and the user who makes the preset gesture is determined as the target user.

[0046] In a specific implementation, after the user triggers the start-up operation of the cabin atmosphere adjustment function, the user can be asked through IVI whether to turn on the cabin atmosphere adjustment function, and it can be identified whether any user makes a preset gesture, so that the user who makes the preset gesture can be confirmed as the target user who needs to use the cabin atmosphere adjustment function. For example, if a user makes a static gesture of OK, the in-vehicle infotainment system can lock the user as the target user.

[0047] Step 102, obtaining a voice command issued by the target user, and generating multimedia content according to the voice command;

[0048] In a specific implementation, after the target user is determined, the voice command (Prompt) issued by the target user can be obtained, and a corresponding module can be pre-set to convert the user's voice command into a corresponding text command;

[0049] Furthermore, a generative AI module may be pre-set to generate multimedia content according to the user's voice command; the generative AI module may be composed of a Vincent image module, a Vincent video module, and a Vincent music module. The Vincent image module may be used to generate picture-type multimedia content as car wallpaper, the Vincent video module may be used to generate video-type multimedia content of a certain length as an immersive experience theme video, and the Vincent music module may be used to generate audio-type multimedia content corresponding to the user prompt as immersive experience theme music.

[0050] Furthermore, the tool calling platform built by the LLM (Large Language Model) after fine-tuning of the cockpit vertical domain related data can be used as a generative AI agent, and the generative AI agent can be used to perform semantic analysis on the user's text instructions to determine the multimedia type of the multimedia content to be generated, that is, to determine which specific modules in the generative AI module need to be called to generate the multimedia content; for example, if the user says: "I want to lie on the beach and look at the blue sea", the generative AI agent at this time can call the Vincent picture module, Vincent video module and Vincent music module according to the text instructions converted from the user's words to generate wallpapers, theme videos and theme audios that match the scene respectively; and if the user semantics emphasizes that he wants to enjoy a more peaceful scene, the Vincent music module can be omitted after semantic analysis, so as to fully meet the user's actual needs.

[0051] In addition, after determining the specific module to be called (i.e., determining the multimedia type to generate multimedia content), the generative AI agent can enrich and process the text prompt before actually using the corresponding module to generate specific multimedia content, and generate the final text prompt to input into the corresponding module as the input content of the multimedia generation process. For example, for the Vincent music module, the generative AI agent can process the text prompt and generate the corresponding song name that matches the user's current mood, and then generate the theme music that matches the song name through Vincent music.

[0052] In some embodiments of the present invention, generating multimedia content according to the voice instruction includes:

[0053] The voice instruction is converted to generate a text instruction, and the multimedia content is generated according to the text instruction.

[0054] In a specific implementation, after the target user is determined, the voice commands issued by the target user can be obtained, and the corresponding module can be pre-set to convert the user's voice commands into corresponding text commands, so as to facilitate subsequent processes such as multimedia generation as input text of generative AI.

[0055] In some embodiments of the present invention, generating the multimedia content according to the text instruction includes:

[0056] Performing semantic analysis on the text instruction to determine the multimedia type of the multimedia content to be generated;

[0057] The multimedia content is generated according to the multimedia type and the text instruction.

[0058] In actual applications, a generative AI module can be pre-set to generate multimedia content according to the user's voice command; the generative AI module can be composed of a Vincent image module, a Vincent video module, and a Vincent music module. The Vincent image module can be used to generate picture-type multimedia content as car wallpaper, the Vincent video module can be used to generate video-type multimedia content of a certain length as an immersive experience theme video, and the Vincent music module can be used to generate audio-type multimedia content corresponding to the user prompt as immersive experience theme music.

[0059] Furthermore, the tool calling platform built by the LLM after fine-tuning of the cockpit vertical domain related data can be used as a generative AI agent, and the generative AI agent can be used to perform semantic analysis on the user's text instructions to determine the multimedia type of the multimedia content to be generated, that is, to determine which specific modules in the generative AI module need to be called to generate the multimedia content; for example, if the user says: "I want to lie on the beach and look at the blue sea", the generative AIagent at this time can call one or more of the Vincent picture module, Vincent video module and Vincent music module according to the text instructions converted from the user's words.

[0060] In addition, after determining the specific module to be called (i.e., determining the multimedia type to generate multimedia content), the generative AI agent can enrich and process the text prompt before actually using the corresponding module to generate specific multimedia content, and generate the final text prompt to input into the corresponding module as the input content of the multimedia generation process. For example, for the Vincent music module, the generative AI agent can process the text prompt and generate the corresponding song name that matches the user's current mood, and then generate the theme music that matches the song name through Vincent music.

[0061] In some embodiments of the present invention, the multimedia type includes at least one or more of a picture type, a video type, and an audio type.

[0062] In practical applications, multimedia types may include at least one or more of picture types, video types, and audio types, so as to make full use of all media playback devices in the cabin, and facilitate the subsequent use of different types of multimedia content through multi-sensory fusion to enhance the interactivity of the cabin atmosphere adjustment process; specifically, a generative AI module may be pre-set to generate multimedia content according to the user's voice commands; the generative AI module may be composed of a Vincent picture module, a Vincent video module, and a Vincent music module. The Vincent picture module can be used to generate picture-type multimedia content as car wallpaper, the Vincent video module can be used to generate video-type multimedia content of a certain length as an immersive experience theme video, and the Vincent music module can be used to generate audio-type multimedia content corresponding to the user prompt as immersive experience theme music.

[0063] Step 103 , controlling and adjusting one or more of the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content.

[0064] In a specific implementation, one or more of the air conditioning system, fragrance system and lighting system in the cabin can be controlled and adjusted according to the generated multimedia content; for example, the color of the ambient light in the in-car lighting system can be controlled by extracting the main color tone of the video frame in the video type multimedia content; the air volume and / or temperature of the scene in the generated video and the type of fragrance release can be determined through the video scene classification deep learning network, and then the air conditioning system and fragrance system can be controlled; the brightness and flashing frequency of the ambient light can also be adjusted by analyzing the audio signal of the generated music. Ultimately, the user is given an immersive cabin experience.

[0065] In one example, in order to control the color of the ambient light in the in-vehicle lighting system by extracting the main color tone of a video frame in video-type multimedia content, the video frame can be analyzed by adopting a corresponding color tone extraction technology, and the colors in the frame can be clustered using a color analysis algorithm such as a k-means clustering analysis algorithm to find out the dominant color; thereby, the color of the ambient light can be further adjusted through the control system in the car based on the extracted main color tone, for example, this can be achieved by controlling an RGB LED light through a PWM (pulse width modulation) signal to accurately match the color of the video theme.

[0066] In one example, the air volume and / or temperature of the scene in which the generated video is located and the type of fragrance release are determined by a video scene classification deep learning network, and then the air conditioning system and the fragrance system are controlled; a video scene classification model can be trained using a deep learning framework, and the video stream (the video generated according to text instructions) can be processed in real time through the video scene classification model, that is, the trained video scene classification model is used to identify the characteristics of the current scene (such as beach, forest, city, etc.). Therefore, according to the scene classification results, the air volume of the air conditioner and the fragrance release effect are automatically adjusted through the vehicle system interface. For example, the beach scene can be adjusted to warm wind and sea breeze fragrance, while the forest scene can be adjusted to cool wind and pine fragrance.

[0067] In one example, the brightness and flickering frequency of the ambient light can be adjusted by analyzing the audio signal of the generated music; the audio processing library can be used to analyze the spectral characteristics of the generated music or ambient sound being played. Thus, the key features of the audio signal, such as rhythm, intensity, and pitch, can be extracted. Then, the brightness and flickering frequency of the light can be adjusted according to the audio features. For example, the faster the music rhythm, the faster the light flickers; the higher the volume, the higher the light brightness.

[0068] In some embodiments of the present invention, controlling and adjusting one or more of an air conditioning system, a fragrance system, and a lighting system in the cabin according to the multimedia content includes:

[0069] In the case where the multimedia type includes the picture type and / or the video type, controlling and adjusting the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content of the picture type and / or the video type;

[0070] In a case where the multimedia type includes the audio type, the lighting system in the cockpit is controlled and adjusted according to the multimedia content of the audio type.

[0071] In practical applications, multimedia content such as pictures, videos, and music may not be generated based on user voice commands at the same time, depending on actual user needs or the vehicle's own hardware limitations. Therefore, different cabin atmosphere adjustment plans can be adopted for different multimedia types, or different cabin atmosphere adjustment plans for different multimedia types can be combined and applied.

[0072] For example, the color of the ambient light in the in-car lighting system can be controlled by extracting the main color tone from the multimedia content of the picture type; the color of the ambient light in the in-car lighting system can also be dynamically controlled by extracting the main color tone of the video frame from the multimedia content of the video type; the air volume and / or temperature of the scene in the generated video and the type of fragrance release can be determined through the video scene classification deep learning network and / or the picture scene classification deep learning network, thereby controlling the air conditioning system and the fragrance system; the brightness and flashing frequency of the ambient light can also be adjusted by analyzing the audio signal of the generated music. Ultimately, the user is given an immersive cabin experience.

[0073] In one example, for controlling the color of the ambient light in the in-car lighting system by extracting the main color tone in the multimedia content of the picture type, image processing technology can be used to identify the main color tone in the picture. This can be achieved by analyzing the color distribution in the picture, for example, using the k-means clustering algorithm to identify the main color set. And according to the extracted color data, the LED lights in the car can be adjusted to match the main color tone of the picture to create an atmosphere that matches the picture.

[0074] In one example, the deep learning network for image scene classification is used to determine the air volume and / or temperature of the scene in the generated video, as well as the type of fragrance release, and then control the air conditioning system and the fragrance system; deep learning technology can be used for image content recognition and classification. Specifically, a pre-trained image recognition model can be used to analyze the image and identify its content (such as natural scenery, city scenery, etc.). And according to the recognized content, the air volume and fragrance release of the air conditioning in the cabin can be automatically adjusted. For example, if the picture shows a snow scene, it can be adjusted to cool air and fresh fragrance accordingly.

[0075] In one example, in order to control the color of the ambient light in the in-vehicle lighting system by extracting the main color tone of a video frame in video-type multimedia content, the video frame can be analyzed by adopting a corresponding color tone extraction technology, and the colors in the frame can be clustered using a color analysis algorithm such as a k-means clustering analysis algorithm to find out the dominant color; thereby, the color of the ambient light can be further adjusted through the control system in the car based on the extracted main color tone, for example, this can be achieved by controlling an RGB LED light through a PWM (pulse width modulation) signal to accurately match the color of the video theme.

[0076] In one example, the air volume and / or temperature of the scene in which the generated video is located and the type of fragrance release are determined by a video scene classification deep learning network, and then the air conditioning system and the fragrance system are controlled; a video scene classification model can be trained using a deep learning framework, and the video stream (the video generated according to text instructions) can be processed in real time through the video scene classification model, that is, the trained video scene classification model is used to identify the characteristics of the current scene (such as beach, forest, city, etc.). Therefore, according to the scene classification results, the air volume of the air conditioner and the fragrance release effect are automatically adjusted through the vehicle system interface. For example, the beach scene can be adjusted to warm wind and sea breeze fragrance, while the forest scene can be adjusted to cool wind and pine fragrance.

[0077] In one example, the brightness and flickering frequency of the ambient light can be adjusted by analyzing the audio signal of the generated music; the audio processing library can be used to analyze the spectral characteristics of the generated music or ambient sound being played. Thus, the key features of the audio signal, such as rhythm, intensity, and pitch, can be extracted. Then, the brightness and flickering frequency of the light can be adjusted according to the audio features. For example, the faster the music rhythm, the faster the light flickers; the higher the volume, the higher the light brightness.

[0078] In some embodiments of the present invention, before controlling and adjusting one or more of the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content, the method further includes:

[0079] The multimedia content is displayed and / or played to the target user.

[0080] In a specific implementation, after generating multimedia content, in addition to controlling and adjusting one or more of the air-conditioning system, fragrance system and lighting system in the cabin according to the multimedia content, the multimedia content can also be displayed and / or played to the target user. For example, the generated picture-type multimedia file can be set as the car wallpaper through the main screen of the car to show it to the target user; the generated video-type multimedia file can also be played through the car's secondary screen and other screens at the same time; and the generated audio-type multimedia file can be played through the cabin audio system to enrich the user's audio-visual experience and enhance the immersion of the cabin atmosphere adjustment.

[0081] The following combination Figure 2 The embodiments of the present invention are exemplarily described as follows:

[0082] Depend on Figure 2 It can be seen from the content that an overall execution process of the present invention when performing cabin atmosphere control can be summarized as follows:

[0083] Trigger the atmosphere adjustment function through air gestures: Use dynamic gestures to click the function button for cabin atmosphere adjustment to trigger the atmosphere adjustment function of the cabin ceiling screen or the front car screen.

[0084] IVI inquiry: After the above operations, the cockpit AI assistant can ask whether to trigger the cockpit atmosphere adjustment function. If a user makes a static gesture of OK, the system can lock the user as the target user;

[0085] User Prompt command: This module can be used to convert user voice commands into corresponding text commands;

[0086] Generative AI agent: This agent is a tool calling platform built by LLM after fine-tuning the cockpit vertical domain related data. It can perform semantic analysis on the user's text instructions to determine which functional module to call. For example, if the user says, "I want to lie on the beach and look at the blue sea", the agent can call the corresponding module according to the user's words, and enrich and process the prompt before calling the corresponding module, and generate the final prompt to input into the corresponding module. For example, for the Vincent music part, the agent can process the prompt, generate the corresponding song title that matches the mood, and then generate the theme music that matches the song title.

[0087] Generative AI module: This module consists of the Vincent image module, Vincent video module and Vincent music module. The Vincent image module can be used to generate car wallpapers, the Vincent video module can be used to generate theme videos of a certain length, and the Vincent music module can be used to generate theme music corresponding to the user prompt.

[0088] Cabin atmosphere adjustment: The color of the interior atmosphere light can be controlled by extracting the main color of the video frame, and the air volume and / or temperature of the scene in the video and the type of fragrance release can be determined through the video scene classification deep learning network to control the air conditioning and the interior fragrance release module; the brightness and flashing frequency of the atmosphere light can also be adjusted by analyzing the audio signal of the generated music. Ultimately, it gives users an immersive cabin experience.

[0089] From the above, it can be seen that the present invention allows users to trigger the in-car atmosphere adjustment function without contact through dynamic gesture operation, which improves the convenience of operation and driving safety. At the same time, using intelligent voice interaction technology, the AI ​​assistant can ask the user and lock the operating user through static gesture recognition, further improving the intelligence and personalized experience of the system.

[0090] The present invention can also interact through a generative AI agent, perform semantic analysis based on the user's text instructions, and select corresponding functional modules. For example, users can generate car wallpapers, theme videos, and music that meet their personal needs through voice description, which enhances the personalization and diversity of interaction.

[0091] The present invention can realize the linkage control of the in-car atmosphere light, air conditioning and fragrance system by intelligently analyzing the generated images, videos and music. Specifically, the system can adjust the color of the atmosphere light according to the main color of the video frame, adjust the air volume of the air conditioning and the release of fragrance through the video scene classification network, and adjust the light brightness and flashing frequency according to the audio signal analysis of the music, ultimately providing users with an immersive in-car experience.

[0092] In general, the present invention can greatly improve the intelligence level of in-vehicle atmosphere adjustment and the personalization level of user experience by deeply integrating generative AI technology with in-vehicle hardware equipment.

[0093] A cabin atmosphere control method is provided in an embodiment of the present invention, which determines a target user who needs to use the cabin atmosphere adjustment function by responding to a start-up operation of the cabin atmosphere adjustment function; thereby obtaining a voice command issued by the target user, and generating multimedia content according to the voice command; and then controlling and adjusting one or more of the air-conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content, thereby realizing the generation of multimedia content according to user instructions and the linkage control of the air-conditioning system, the fragrance system, and the lighting system according to the generated multimedia content; without the need for a preset plan or relying on the user's active setting, the corresponding multimedia content can be generated according to the user's real-time instructions to achieve adaptive adjustment of the in-vehicle atmosphere, thereby enhancing the user's immersive experience in the cabin and fully meeting the user's real-time emotional needs for using the cabin atmosphere adjustment function.

[0094] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0095] Reference Figure 3 , shows a schematic structural diagram of a vehicle battery thermal management device provided by some embodiments of the present invention, which may specifically include the following modules:

[0096] A target user determination module 301 is used to determine a target user who needs to use the cabin atmosphere adjustment function in response to a start-up operation of the cabin atmosphere adjustment function;

[0097] The multimedia content generation module 302 is used to obtain the voice command issued by the target user and generate multimedia content according to the voice command;

[0098] The cabin adjustment module 303 is used to control and adjust one or more of the air conditioning system, the fragrance system and the lighting system in the cabin according to the multimedia content.

[0099] In some embodiments of the present invention, the multimedia content generation module 302 includes:

[0100] The multimedia content generation submodule is used to convert the voice instructions to generate text instructions, and generate the multimedia content according to the text instructions.

[0101] In some embodiments of the present invention, the multimedia content generation submodule includes:

[0102] A multimedia type determination unit, configured to perform semantic analysis on the text instruction to determine the multimedia type of the multimedia content to be generated;

[0103] The multimedia content generating unit is used to generate the multimedia content according to the multimedia type and the text instruction.

[0104] In some embodiments of the present invention, the cabin adjustment module 303 includes:

[0105] A first control and regulation submodule, configured to control and regulate the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content of the picture type and / or the video type when the multimedia type includes the picture type and / or the video type;

[0106] The second control and adjustment submodule is used to control and adjust the lighting system in the cockpit according to the multimedia content of the audio type when the multimedia type includes the audio type.

[0107] In some embodiments of the present invention, the target user determination module 301 includes:

[0108] The target user determination submodule is used to determine the gesture information of the user in the cockpit, and determine the user who makes a preset gesture as the target user.

[0109] In some embodiments of the present invention, the device further comprises:

[0110] The multimedia content display and / or playback module is used to display and / or play the multimedia content to the target user.

[0111] Some embodiments of the present invention further provide an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the above-mentioned cabin atmosphere control method is implemented.

[0112] Some embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned cabin atmosphere control method is implemented.

[0113] Some embodiments of the present invention further provide a computer program product, including a computer program, which implements the above cabin atmosphere control method when executed by a processor.

[0114] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0115] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0116] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0117] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0118] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0119] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0120] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0121] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the above elements.

[0122] The cabin atmosphere control method and device, electronic device, and storage medium provided are introduced in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and scope of application. In summary, the contents of this specification should not be understood as limiting the present invention.

Claims

1. A method for controlling cabin atmosphere, characterized in that: The method comprises: In response to a start-up operation of the cabin atmosphere adjustment function, determining a target user who needs to use the cabin atmosphere adjustment function; Acquiring a voice command issued by the target user, and generating multimedia content according to the voice command; According to the multimedia content, one or more of the air conditioning system, the fragrance system and the lighting system in the cabin are controlled and adjusted.

2. The method according to claim 1, characterized in that Generating multimedia content according to the voice command includes: The voice instruction is converted to generate a text instruction, and the multimedia content is generated according to the text instruction.

3. The method according to claim 2, characterized in that Generating the multimedia content according to the text instruction includes: Performing semantic analysis on the text instruction to determine the multimedia type of the multimedia content to be generated; The multimedia content is generated according to the multimedia type and the text instruction.

4. The method according to claim 3, characterized in that The multimedia type includes at least one or more of a picture type, a video type and an audio type.

5. The method according to claim 4, characterized in that The controlling and adjusting one or more of the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content includes: In the case where the multimedia type includes the picture type and / or the video type, controlling and adjusting the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content of the picture type and / or the video type; In a case where the multimedia type includes the audio type, the lighting system in the cockpit is controlled and adjusted according to the multimedia content of the audio type.

6. The method according to claim 1, characterized in that The determining of the target user who needs to use the cabin atmosphere adjustment function includes: The gesture information of the user in the cockpit is determined, and the user who makes the preset gesture is determined as the target user.

7. The method according to claim 1, characterized in that Before controlling and adjusting one or more of the air conditioning system, the fragrance system, and the lighting system in the cabin according to the multimedia content, the method further includes: The multimedia content is displayed and / or played to the target user.

8. A cabin atmosphere control device, characterized in that: The device comprises: a target user determination module, configured to determine a target user who needs to use the cabin atmosphere adjustment function in response to a start-up operation of the cabin atmosphere adjustment function; A multimedia content generation module, used to obtain the voice command issued by the target user and generate multimedia content according to the voice command; The cabin adjustment module is used to control and adjust one or more of the air conditioning system, the fragrance system and the lighting system in the cabin according to the multimedia content.

9. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the method for controlling the cabin atmosphere according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the cabin atmosphere control method according to any one of claims 1 to 7 is implemented.

Images